Diagnostic Accuracy of Elevated Serum Carcinoembryonic Antigen for Recurrence in Postoperative Stage II Colorectal Cancer Patients: Comparison With Stage III.

PURPOSE: Elevated levels of serum carcinoembryonic antigen (CEA) following a curative resection of colorectal cancer (CRC) indicate recurrence; however, the levels of CEA may be elevated above the normal limit without recurrence. The aim of this study is to analyze the diagnostic accuracy of elevated serum CEA for predicting recurrence in postoperative stage II and stage III CRC patients.
METHODS: A total of 336 stage II and stage III CRC patients who underwent a curative resection between January 2005 and October 2009 were enrolled. Sensitivities, specificities, positive predictive values (PPVs), negative predictive values (NPVs), likelihood ratios and post-test probabilities of recurrence associated with elevated CEA were analyzed and compared.
RESULTS: The median follow-up duration was 45 months (36 to 134 months). Twenty-seven of 189 stage II patients (14.3%) and 52 of 147 stage III patients (35.4%) developed recurrence during the follow-up period. Sensitivities, specificities, PPVs, and NPVs of elevated CEA were 37.0%, 91.4%, 41.7%, and 89.7%, respectively, in stage II patients and 46.2%, 90.5%, 72.7%, and 75.4% in stage III patients. Post-test probabilities of recurrence associated with elevated CEA were 41.8% in stage II patients and 71.9% in stage III patients.
CONCLUSION: The predictive performance of the probability of recurrence associated with elevated serum CEA after a curative resection in stage II CRC patients is lower than that in stage III CRC patients.

INTRODUCTION

Recurrence after a curative resection of colorectal cancer (CRC) occurs in 30-40% of patients. However, resections of limited metastatic disease may result in a potential cure [1]. Therefore, early detection of recurrence is of paramount importance to identify patients who may benefit from salvage surgery. Carcinoembryonic antigen (CEA) has been most commonly used as a tumor marker to detect early recurrence amenable to curative surgery. In spite of its widespread use and cost effectiveness [2], little is known about the accuracy and the efficacy of CEA monitoring [3-5]. An elevated level of serum CEA following a curative resection of the CRC may indicate recurrence; however, the levels of CEA may be elevated above the normal limit without recurrence. Also, whether the accuracy of CEA monitoring in stage II is comparable to that in stage III is not known.

The likelihood ratio and the post-test probability have been recently reported to be superior to the sensitivity and the specificity in comparing the accuracy of a test because they are less influenced by the morbidity rate [6]. Here, we analyze the diagnostic accuracy of elevated serum CEA in postoperative stage II and stage III CRC patients by using the likelihood ratios and the post-test probabilities, as well as the sensitivities, specificities, positive predictive values (PPVs) and negative predictive values (NPVs).

METHODS

Patients who underwent a radical resection for CRC between January 2005 and October 2009 at Chonbuk National University Hospital were enrolled. Patients with stage 0, I or IV cancer, insufficient follow-up (less than three years), abnormal CEA in the first measurement after surgery (checked within three months after surgery), history of other cancers and/or history of preoperative concurrent chemoradiation therapy were excluded. Finally, 336 patients with stage II (n = 189) or III (n = 147) CRC were included.

CEA was measured using an immunoassay method (ADIVA Centaur XP immunoassay system, Siemen AG, Erlangen, Germany). CEA elevation was defined as levels above 5 ng/mL. All patients underwent routine serum CEA assays and radiologic examination for 5 years. CEA levels were assayed with a 3-month interval for the first 2 years and every 6 months thereafter. Chest computed tomography (CT) and abdomino-pelvic CT were performed with a 6-month interval for the first 2 years and every 1 year thereafter. The diagnosis of a tumor recurrence was confirmed by biopsy and radiologic evidence. We also obtained sensitivities, specificities, PPVs, and NPVs.

Determination of elevated CEA and recurrence was done each postoperative year (POY): POY was defined as the period within 1 year after surgery, POY2 as ≥1 but <2 years, POY3 as ≥2 but <3 years, and POY4 as ≥3 years. The recurrence rate in any given year was obtained by calculating the number of recurrences divided by the number of patients followed for that year.

The sensitivity was defined as the fraction of all diseased patients with a positive test. The specificity was defined as the fraction of all healthy patients with a negative test. The likelihood ratio for a positive test was defined as the ratio of the fraction of true positives to the fraction of false positives (sensitivity/[1-specificity]). The likelihood ratio for a negative test was defined as the fraction of false negatives to the true negatives ([1-sensitivity]/specificity).

The pretest probability was defined as the probability that a patient suffered from recurrence. The post-test probability was defined as the probability of recurrent disease in a patient with a certain test result for CEA. Thus, the likelihood ratio positive (LR+) is a measurement of the increase in the probability of disease according to a certain test result. LR+ >10 and LR- <0.1 were considered to be excellent test results (LR+ >10: a positive test is ten times more likely to occur in a patient with recurrence; LR- <0.1: a false negative test result will occur in less than one out of ten patients with a negative test) (Table 1).

Table 1

Statistical analysis

RESULTS

Patient characteristics

The median follow-up duration was 45 months (36 to 134 months). Of the 336 patients, 189 (56.3%) were stage II, and 147 (43.7%) were stage III. There was no difference between the two groups, stage II and stage III groups, except for the recurrence rate (Table 2).

Table 2

Clinicopathologic findings of patients according to stage

Values are presented as mean ± standard deviation (range) or number (%).

CEA, carcinoembryonic antigen.

Pretest probability

In the stage II group, recurrence developed in 27 patients (14.3%). The yearly recurrence rates of POY1, POY2, POY3, and POY4 were 4.2% (8/189), 5.5% (10/181), 1.8% (3/171), and 3.6% (6/168) respectively. On the other hand, in the stage III group, recurrence developed in 52 patients (35.4%). The yearly recurrence rates were 19.0% (28/147), 13.4% (16/119), 4.9% (5/103), and 3.1% (3/98), respectively (Table 3). These rates were regarded as the pretest probabilities in this study.

Table 3

Yearly recurrence rate after surgery according to stage

Values are presented as number (%).

Sensitivity, specificity, PPV, NPV in stage II and III

The overall sensitivity, specificity, PPV, and NPV of the 336 patients investigated were 43.0%, 91.1%, 59.6%, and 83.9%, respectively. In stage II patients, the results were 37.0%, 91.4%, 41.7%, and 89.7%, respectively, and in stage III patients, they were 46.2%, 90.5%, 72.7%, and 75.4% (Table 4).

Table 4

Elevated serum carcinoembryonic antigen for recurrence: sensitivity, specificity, PPV, and NPV based on stage

PPV, positive predictive value; NPV, negative predictive value.

Sensitivity, specificity, and LR in stages II and III each year

In stage II patients with recurrence, CEA elevation was observed in 4, 4, 1, and 1 patients in POY1, POY2, POY3, and POY4, respectively. The yearly sensitivities of elevated CEA for predicting recurrence were 50.0%, 40.0%, 33.3%, and 16.7%, respectively. In stage II patients without recurrence, CEA was not elevated in 176, 166, 166, and 160 patients in POY1, POY2, POY3, and POY4, respectively, and the yearly specificities were 97.3%, 97.1%, 98.8%, and 98.8%. Likewise, in stage III patients, the yearly sensitivities were 42.3%, 56.3%, 40.0%, and 33.3% in POY1, POY2, POY3, and POY4, respectively, and the yearly specificities were 95.8%, 97.1%, 99.0%, and 100.0%.

Using sensitivities and specificities, we calculated positive and negative LRs. In stage II patients, the positive LRs were 17.9, 13.8, 27.8 and 13.9 in POY1, POY2, POY3, and POY4, respectively, and the negative LRs were 0.5, 0.6, 0.7, and 0.8. In stage III patients, the positive and the negative LRs were 10.1, 19.4, and 40.0 (the positive LR of POY4 could not be calculated because the denominator was 0) and 0.6, 0.5, 0.6, and 0.7 in POY1, POY2, POY3, and POY4, respectively. There were no significant differences in sensitivity, specificity and LR between stage II and III (Table 5).

Table 5

Elevated serum CEA for recurrence: sensitivities, specificities and likelihood ratios at each year

CEA, carcinoembryonic antigen; POY, postoperative year; LR, likelihood ratio.

aSensitivity is calculated as recurrence with tumor marker elevation/recurrence. bSpecificity is calculated as no recurrence with normal tumor marker/no recurrence.

Post-test probability

The post-test probabilities with postoperative CEA elevation were 41.8% and 71.9% in stage II and III patients, respectively. In stage II patients, the corresponding post-test probabilities in POY1, POY2, POY3, and POY4, respectively, were 44.0%, 44.5%, 33.8%, and 34.2% with postoperative CEA elevation and 2.1%, 3.4%, 1.3%, and 2.9% without postoperative CEA elevation. However,, in stage III patients, the corresponding post-test probabilities in POY1, POY2, POY3, and POY4, respectively, were 70.3%, 75.0% and 67.4% with postoperative CEA elevation and 12.3%, 7.2%, 3.0%, and 2.2% without postoperative CEA elevation (the post-test probability of POY4 with CEA elevation could not be calculated because the positive LR of POY4 was not calculated) (Fig. 1).

Fig. 1

Elevated serum carcinoembryonic antigen (CEA) for recurrence: probabilities of colorectal cancer recurrence according to postoperative serum CEA status (black column, before test; gray column, probability when CEA is elevated; and white column, probability when CEA is normal). Post-test probability was 41.8% in stage II patients and 71.9% in stage III patients. POY, postoperative year.

DISCUSSION

Recurrence after a curative resection of CRC occurs in 30-40% of patients. However, recent chemotherapeutic agents and new biologic agents have greatly improved the survival of patients with recurrent disease. Furthermore, complete resections of limited recurrent diseases may result in a cure. Thus, early detection of recurrent disease after curative surgery is crucial to identify patients who may benefit from additional surgery [7]. CEA has been most commonly used as a tumor marker to detect early recurrence and is regarded as being more effective in detecting early evidence of recurrence than any other single entity, such as liver function tests, other tumor markers, and computed tomographic scans [8-10]. However, few studies have addressed the differences in the diagnostic accuracy of CEA elevation in stage II and III cancer patients.

In evidence-based medicine, the LR and the post-test probability have been used to assess the value of performing a diagnostic test [11] and have been considered to be more reliable than the sensitivity and the specificity in comparing the accuracy of tests for differences in morbidity and to be a useful measurement of the probability of obtaining a positive or negative test result [12-14]. In CRC follow-up, annual postoperative recurrence rates vary between stages II and III, indicating that the LR and the post-test probability are more suitable than the sensitivity and the specificity as accurate measures for yearly tumor-marker monitoring [15].

In the present study, no differences in sensitivity, specificity, PPV, and NPV were found between the stage II and III groups. However, the post-test probabilities with postoperative CEA elevation were found to be different, 41.8% in stage II patients and 71.9% in stage III patients. The accuracy of postoperative CEA to detect recurrence was lower in stage II patients, which could be due the low incidence of recurrence and the high false-positive rate of CEA in stage II patients [15].

Many studies have reported on the effectiveness of CEA and its diagnostic accuracy, but few studies have compared CEA elevation according to stage. CEA elevation has been reported to be diminished in value as a tumor marker in early stages [16]. However, the results were based on preoperative CEA levels according to stage, and follow-up patients after surgical treatment were not included.

Related to the postoperative diagnostic accuracy of CEA elevation after surgery, Hara et al. [15,17] also reported results similar to those of our study, with post-test probabilities of about 75% in stage III and 30% in stage II in the first postoperative year and with efficacy drops below 50% after the first year in stage III patients, decreasing progressively year by year. In our study, the post-test probability was continually maintained at 70% in stage III.

Our study has a few limitations. Firstly, as a retrospective study, clinical factors that could affect the results were not included in the analysis as CEA can be elevated by a few benign conditions such as smoking, chronic kidney disease, chronic obstructive pulmonary disease and liver disease [18]. Secondly, we did not consider the effect of adjuvant chemotherapy. Thirdly, the diagnostic accuracy of a one-time elevation of CEA was evaluated without serial follow-up to exclude temporary elevation [19]. Nonetheless, the present study showed that in stage III patients, postoperative CEA monitoring had a high accuracy for detecting recurrence. However, in stage II patients, CEA elevation indicated recurrence with around 40% probability, which is not reliable, and clinician always expect a high possibility of false positivity.

In conclusion, the predictive performance of the probability of recurrence associated with elevated serum CEA after a curative resection in stage II CRC patients is lower than it is in stage III colorectal cancer patients.