Yuqiang Li1,2, Da Liu3, Lilan Zhao4, Cenap Güngör2, Xiangping Song1, Dan Wang1,2, Wenxue Liu5,6, Fengbo Tan1. 1. Department of Gastrointestinal Surgery, Xiangya Hospital, Central South University, Changsha, China. 2. Department of General Visceral and Thoracic Surgery, University Medical Center Hamburg-Eppendorf, Hamburg, Germany. 3. Shanxi Medical University, Taiyuan, China. 4. Department of Thoracic surgery, Fujian Provincial Hospital, Fuzhou, China. 5. Department of Cardiology, Xiangya Hospital, Central South University, Changsha, China. 6. Department of Rheumatology, Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences, Guangzhou, China.
Abstract
BACKGROUND: Rectal cancer accounts for approximately 30-50% of colorectal cancer. Despite its widespread use and convenience, the American Joint Committee on Cancer (AJCC) staging system for predicting survival is prone to inaccuracy, even including a survival paradox for locally advanced rectal cancer (LARC). An accurate risk stratification of LARC is essential for proper treatment selection and prognostic evaluation. Therefore, we aimed to create prognostic nomograms for LARC capable of assessing overall survival (OS) and cancer-specific survival (CSS) precisely and intuitively. METHODS: The Surveillance, Epidemiology, and End Results (SEER) database was accessed. All of the significant variables in the multivariate analysis were integrated to build the nomograms. RESULTS: Data for a total of 23,055 patients with LARC were collected from the SEER database in this study. Based on the multivariate Cox regression analysis, both OS and CSS were significantly associated with 13 variables: age, marital status, race, pathological grade, histological type, T stage, N stage, surgery, radiotherapy, chemotherapy, regional nodes examined (RNE), tumor size, and carcinoembryonic antigen (CEA). These were included in the construction of nomograms for OS and CSS. Time-dependent receiver operating characteristic (ROC) curves, decision curve analysis (DCA), concordance index, and calibration curves demonstrated the discriminative superiority of the nomograms. CONCLUSIONS: The nomograms, which effectively solve the issue of the survival paradox in the AJCC staging system regarding LARC, may act as excellent tools for integrating clinical characteristics and to guiding therapeutic choices for LARC patients. 2021 Annals of Translational Medicine. All rights reserved.
BACKGROUND: Rectal cancer accounts for approximately 30-50% of colorectal cancer. Despite its widespread use and convenience, the American Joint Committee on Cancer (AJCC) staging system for predicting survival is prone to inaccuracy, even including a survival paradox for locally advanced rectal cancer (LARC). An accurate risk stratification of LARC is essential for proper treatment selection and prognostic evaluation. Therefore, we aimed to create prognostic nomograms for LARC capable of assessing overall survival (OS) and cancer-specific survival (CSS) precisely and intuitively. METHODS: The Surveillance, Epidemiology, and End Results (SEER) database was accessed. All of the significant variables in the multivariate analysis were integrated to build the nomograms. RESULTS: Data for a total of 23,055 patients with LARC were collected from the SEER database in this study. Based on the multivariate Cox regression analysis, both OS and CSS were significantly associated with 13 variables: age, marital status, race, pathological grade, histological type, T stage, N stage, surgery, radiotherapy, chemotherapy, regional nodes examined (RNE), tumor size, and carcinoembryonic antigen (CEA). These were included in the construction of nomograms for OS and CSS. Time-dependent receiver operating characteristic (ROC) curves, decision curve analysis (DCA), concordance index, and calibration curves demonstrated the discriminative superiority of the nomograms. CONCLUSIONS: The nomograms, which effectively solve the issue of the survival paradox in the AJCC staging system regarding LARC, may act as excellent tools for integrating clinical characteristics and to guiding therapeutic choices for LARC patients. 2021 Annals of Translational Medicine. All rights reserved.
Rectal cancer accounts for approximately 30–50% of all colorectal cancer cases (1), placing it third as the most common malignancy worldwide (2). With the advances in treatment technology, the survival rates of patients with locally advanced rectal cancer (LARC) have improved significantly over the past few decades (3).The combination of surgical resection, chemotherapy, and/or radiation therapy is the conventional treatment for LARC (3). Updated surgical equipment and concepts constitute the major advancements in surgical resection technology. Total mesorectal resection (TME) has become the standard surgical procedure for radical resection of rectal cancer (4,5). In addition, the refinement of colorectal cancer surgery is attributed to the application of laparoscopy and robot-assisted laparoscopy (6,7). Chemotherapy for patients with rectal cancer has evolved substantially over the past decades, together with the concept of neoadjuvant therapy, as well as the increased marketing of irinotecan, oxaliplatin, bevacizumab, and cetuximab. The adoption of TME combined with adjuvant oncological treatment for LARC has reduced local recurrence rates and improved long-term survival (8). In particular, advancements in chemotherapy regimens have been the main contributor to the upswing of colorectal cancer survival in the past decades (3).Patients who have colon and rectal cancers are generally analyzed in the context of statistical homogeneity, despite having different etiologies, anatomy, and treatments (9). Thus, it is necessary to conduct a specific analysis for LARC that is different from colon cancer owing to the apparent distinctions in treatment, the universal involvement of neoadjuvant chemoradiotherapy (nCRT), and the performance of TME in the surgical technique (10,11).Despite its widespread use and convenience, the American Joint Committee on Cancer (AJCC) staging system for the prediction of survival with this malignancy has proven inaccurate. The AJCC staging has even produced a survival paradox for LARC, in that those patients with T3–4N− were found to develop worse survival outcomes than those with T1–2N+ (12-14). A precise risk stratification of LARC is imperative for proper treatment selection and prognostic evaluation. As a visible representation of a mathematical model, a nomogram can not only integrate certain features together to estimate specific endpoints, but also provide pragmatic and comprehensive prediction for clinical practice. Meanwhile, national databases, such as the Surveillance, Epidemiology, and End Results (SEER) database, can provide the available clinical factors and ample patient data to build a reliable statistical model for the prediction of survival.Therefore, we aimed to create SEER-based prognostic nomograms for patients with LARC based that could accurately and conveniently assess overall survival (OS) and cancer-specific survival (CSS). We present the following article in accordance with the STROBE reporting checklist (available at http://dx.doi.org/10.21037/atm-20-4144).
Methods
Data collection
Data in this retrospective analysis were extracted from the SEER Linked database. The SEER Program of the National Cancer Institute is an authoritative source of information on cancer incidence and survival in the United States that is updated annually. The study was conducted in accordance with the Declaration of Helsinki (as revised in 2013). Approval from the ethical board for this study was not required because of the public nature of all the data. Patients’ informed consent was waived because of the retrospective nature of the study design.
Patient screening
The target population was limited to patients with stage II and III (T34 and/or N+) rectal adenocarcinoma [International Classification of Diseases for Oncology 3rd edition (ICD-O-3): 8,140, 8,144, 8,210, 8,211, 8,213, 8,245, 8,255, 8,260, 8,261, 8,262, 8,263, 8,310, 8,323, 8,480, 8,481, 8,490], resulting in a total of 23,444 patients. The exclusion criteria were as follows: diagnosed at autopsy or death certificate (n=11); survival months 0 (n=209); lack of positive histology (n=34); and T0 and Tx according to the 6th edition AJCC staging (n=135). The final study sample contained 23,055 patients ().
Figure 1
The workflow of the establishment of nomograms to predict OS and CSS of patients with LARC. OS, overall survival; CSS, cancer-specific survival; LARC, locally advanced rectal cancer.
The workflow of the establishment of nomograms to predict OS and CSS of patients with LARC. OS, overall survival; CSS, cancer-specific survival; LARC, locally advanced rectal cancer.Patients were chosen from the period between 2004 and 2011, since the follow-up time of who after 2011 was less than 5 years. The cutoff for follow-up was December 31, 2016. The endpoints of this study were OS and CSS. The median follow-up was estimated as the median observed survival time. OS was computed from the time of diagnosis to the time of death due to any cause or the time of last follow-up for patients still alive. CSS was computed as the time of diagnosis to the time of death attributed to rectal cancer or survival at last follow-up. The OS and CSS curves were evaluated by the Kaplan-Meier method and compared by the log-rank test. For each patient, the following data were acquired: age at diagnosis, marital status, gender, race, tumor size, grade, histological type, T stage, N stage, regional nodes examined (RNE), carcinoembryonic antigen (CEA), surgery, radiotherapy, and chemotherapy. All patients were randomly separated into 2 groups (training group, n=15,370 and validation group, n=7,685).
Construction and validation of the nomogram
Univariate and multivariate Cox regression analyses were applied to calculate the weight of variables in OS and CSS, as presented with odds ratio (OR), and were used to identify independent risk factors. The variables with significant differences in the univariate analysis were included in the Cox regression model for multivariate analysis. All of the significant variables in the multivariate analysis were integrated to build the nomograms for OS and CSS. The probabilities could be estimated for 2-, 3-, and 5-year OS and CSS after summing the scores related to each variable and casting total scores to the bottom scale. The total points in each case of the 2 survival groups were calculated using the established nomograms to verify the effect. The calibration curves were used to demonstrate the reliability of the nomograms. The distinguishing ability of the nomogram was evaluated by concordance index (C-index) and receiver operating characteristic (ROC) curve analysis. Decision curve analysis (DCA) was carried out to compare the latent profit of the prognostic nomograms.
Statistical analysis
The OR and a 95% confidence interval (CI) were evaluated by univariate and multivariate Cox regression analysis. Variables with significant differences in the univariate analysis were included in the Cox regression model for multivariate analysis. Missing data were marked as NOS (not otherwise specified) for analysis. R software (version 3.6.1, http://www.r-project.org) was used to build the nomograms, plot the calibration curves, Sankey diagrams, ROC curves, and DCA curves, and to calculate the C-index. The survival curves were drawn by GraphPad Prism 8 (GraphPad Software, San Diego, CA, USA). The univariate and multivariate Cox regression models were performed with IBM SPSS statistics trial ver. 22.0 (IBM, Armonk, NY, USA). All reported P values <0.05 were considered significant.
Results
Patient characteristics
A total of 389 patients with rectal cancer were not included in the final study [diagnosed at autopsy or death certificate (n=11); survival months 0 (n=209); lack of positive histology (n=34); T0 and Tx according to the 6th edition AJCC staging (n=135)] (). Eventually, data for 23,055 eligible patients with LARC were collected from the SEER database in this study. The characteristics of the patients are summarized in . More than half of the patients were male (59.97%), of whom 68.80% had moderately differentiated adenocarcinoma. The patients with mucinous cell carcinoma (MCC) or signet ring cell carcinoma (SRCC) accounted for 8.55% of the total population. The majority of LARCs were smaller than 5 cm in size (57.41%), and the proportion of patients with increased levels of CEA reached 26.54% in this study. The median OS and CSS were 69 and 72 months, respectively.
Table 1
Characteristics of patients with LARC in the training and validation group
Characteristics
Total (n=23,055)
Training group (n=15,370)
Validation group (n=7,685)
N
%
N
%
N
%
Gender
Female
9,229
40.03
6,138
39.93
3,091
40.22
Male
13,826
59.97
9,232
60.07
4,594
59.78
Age (years)
≤60
9,650
41.86
6,403
41.66
3,247
42.25
61–70
5,710
24.77
3,839
24.98
1,871
24.35
>70
7,695
33.38
5,128
33.36
2,567
33.40
Marital status
Married
13,269
57.55
8,845
57.55
4,424
57.57
Unmarried/NOS
9,786
42.45
6,525
42.45
3,261
42.43
Race
White
18,811
81.59
12,534
81.55
6,277
81.68
Black
1,961
8.51
1,325
8.62
636
8.28
Other/NOS
2,283
9.90
1,511
9.83
772
10.05
Pathological grade
I
1,398
6.06
947
6.16
451
5.87
II
15,861
68.80
10,570
68.77
5,291
68.85
III
3,452
14.97
2,303
14.98
1,149
14.95
IV
281
1.22
179
1.16
102
1.33
Unknown
2,063
8.95
1,371
8.92
692
9.00
Histologic type
Adenocarcinomas
21,083
91.45
14,073
91.56
7,010
91.22
MCC/SRCC
1,972
8.55
1,297
8.44
675
8.78
T stage
T1
772
3.35
504
3.28
268
3.49
T2
1,768
7.67
1,161
7.55
607
7.90
T3
18,184
78.87
12,114
78.82
6,070
78.99
T4
2,331
10.11
1,591
10.35
740
9.63
N stage
N0
10,506
45.57
6,965
45.32
3,541
46.08
N1
8,903
38.62
5,941
38.65
2,962
38.54
N2
3,646
15.81
2,464
16.03
1,182
15.38
Surgery
Yes
20,693
89.75
13,788
89.71
6,905
89.85
No
2,362
10.25
1,582
10.29
780
10.15
Radiotherapy
Neoradiotherapy
11,002
47.72
7,338
47.74
3,664
47.68
Radiotherapy*
6,139
26.63
4,102
26.69
2,037
26.51
No/unknown
5,914
25.65
3,930
25.57
1,984
25.82
Chemotherapy
Yes
17,763
77.05
11,866
77.20
5,897
76.73
No/unknown
5,292
22.95
3,504
22.80
1,788
23.27
RNE
<3
4,290
18.61
2,848
18.53
1,442
18.76
3–5
1,697
7.36
1,116
7.26
581
7.56
6–8
2,375
10.30
1,579
10.27
796
10.36
9–11
2,799
12.14
1,831
11.91
968
12.60
≥12
11,642
50.50
7,832
50.96
3,810
49.58
NOS
252
1.09
164
1.07
88
1.15
Tumor size (cm)
≤5
13,237
57.41
8,752
56.94
4,485
58.36
5–10
5,176
22.45
3,498
22.76
1,678
21.83
>10
338
1.47
243
1.58
95
1.24
NOS
4,304
18.67
2,877
18.72
1,427
18.57
CEA
Negative
7,813
33.89
5,191
33.77
2,622
34.12
Positive
6,119
26.54
4,149
26.99
1,970
25.63
NOS
9,123
39.57
6,030
39.23
3,093
40.25
OS (months)
69 (33 to 101)
69 (33 to 100)
69 (33 to 102)
CSS (months)
72 (37 to 104)
72 (37 to 103)
72 (37 to 105)
*, not neoadjuvant. MCC, mucinous cell carcinoma; SRCC, signet ring cell carcinoma; RNE, regional nodes examined; NOS, not otherwise specified.
*, not neoadjuvant. MCC, mucinous cell carcinoma; SRCC, signet ring cell carcinoma; RNE, regional nodes examined; NOS, not otherwise specified.In addition, 10.25% of patients with LARC did not undergo surgical resection, 25.65% did not undergo radiotherapy, and 22.95% did not undergo chemotherapy. As an important indicator of surgical quality in the SEER database (3), RNE >12 was only present in 50.50% of patients in this study.
Establishment of prognostic nomograms
Univariate and multivariate Cox regression analyses were applied to calculate the weight of variables in OS and CSS (presented as OR) and were used to identify independent risk factors.The variables with significant differences in the univariate analysis were included in the Cox regression model for multivariate analysis, where both OS and CSS were significantly associated with 13 variables, namely, age, marital status, race, pathological grade, histological type, T stage, N stage, surgery, radiotherapy, chemotherapy, RNE, tumor size, and CEA ().
Table 2
Univariable and multivariable Cox regression model analyses of OS for nomogram
Characteristics
Univariable analysis
Multivariable analysis
OR
95% CI
P
OR
95% CI
P
Gender
0.373
Female
Reference
1
NA
Male
1.021
0.976–1.068
0.373
Age (years)
<0.001
<0.001
≤60
Reference
1
Reference
1
61–70
1.410
1.327–1.499
<0.001
1.366
1.284–1.452
<0.001
>70
3.011
2.859–3.171
<0.001
2.565
2.427–2.710
<0.001
Marital status
<0.001
<0.001
Married
Reference
1
Reference
1
Unmarried/NOS
1.478
1.414–1.544
<0.001
1.203
1.150–1.258
<0.001
Race
<0.001
<0.001
White
Reference
1
Reference
1
Black
1.264
1.174–1.361
<0.001
1.256
1.165–1.354
<0.001
Other/NOS
0.869
0.804–0.940
<0.001
0.904
0.836–0.977
0.011
Pathological grade
<0.001
<0.001
I
Reference
1
Reference
1
II
0.998
0.909–1.096
0.970
1.024
0.932–1.125
0.622
III
1.412
1.273–1.567
<0.001
1.338
1.204–1.486
<0.001
IV
1.709
1.398–2.087
<0.001
1.471
1.203–1.799
<0.001
Unknown
1.149
1.023–1.291
0.019
1.007
0.896–1.132
0.907
Histological type
<0.001
<0.001
Adenocarcinomas
Reference
1
Reference
1
MCC/SRCC
1.344
1.249–1.445
<0.001
1.262
1.171–1.359
<0.001
T stage
<0.001
<0.001
T1
Reference
1
Reference
1
T2
1.024
0.866–1.211
0.781
1.015
0.857–1.201
0.864
T3
1.481
1.284–1.709
<0.001
1.482
1.280–1.717
<0.001
T4
2.786
2.391–3.246
<0.001
2.469
2.109–2.890
<0.001
N stage
<0.001
<0.001
N0
Reference
1
Reference
1
N1
0.924
0.880–0.971
0.002
1.262
1.197–1.330
<0.001
N2
1.430
1.348–1.518
<0.001
2.035
1.908–2.172
<0.001
Surgery
<0.001
<0.001
Yes
Reference
1
Reference
1
No
2.938
2.764–3.122
<0.001
2.024
1.839–2.227
<0.001
Radiotherapy
<0.001
<0.001
Neoradiotherapy
Reference
1
Reference
1
Radiotherapy*
1.577
1.495–1.664
<0.001
1.043
0.979–1.111
0.194
No/unknown
2.046
1.942–2.157
<0.001
1.220
1.132–1.315
<0.001
Chemotherapy
<0.001
<0.001
Yes
Reference
1
Reference
1
No/unknown
2.030
1.936–2.129
<0.001
1.448
1.351–1.551
<0.001
RNE
<0.001
<0.001
<3
Reference
1
Reference
1
3–5
0.556
0.508–0.610
<0.001
0.856
0.771–0.951
0.004
6–8
0.541
0.498–0.586
<0.001
0.794
0.721–0.875
<0.001
9–11
0.503
0.465–0.544
<0.001
0.730
0.663–0.803
<0.001
≥12
0.473
0.448–0.500
<0.001
0.651
0.601–0.705
<0.001
NOS
0.738
0.604–0.903
0.003
0.965
0.786–1.183
0.730
Tumor size (cm)
<0.001
<0.001
≤5
Reference
1
Reference
1
5–10
1.281
1.214–1.351
<0.001
1.113
1.053–1.175
<0.001
>10
1.561
1.323–1.840
<0.001
1.360
1.152–1.606
<0.001
NOS
1.158
1.092–1.227
<0.001
1.051
0.988–1.117
0.117
CEA
<0.001
<0.001
Negative
Reference
1
Reference
1
Positive
1.543
1.457–1.633
<0.001
1.354
1.278–1.435
<0.001
NOS
1.341
1.271–1.414
<0.001
1.215
1.151–1.282
<0.001
*, not neoadjuvant. MCC, mucinous cell carcinoma; SRCC, signet ring cell carcinoma; RNE, regional nodes examined; NOS, not otherwise specified, NA, Unavailable.
Table 3
Univariable and multivariable Cox regression model analyses of CSS for nomogram
Characteristics
Univariable analysis
Multivariable analysis
OR
95% CI
P
OR
95% CI
P
Gender
0.486
Female
Reference
1
NA
Male
0.979
0.921–1.040
0.486
Age (years)
<0.001
<0.001
≤60
Reference
1
Reference
1
61–70
1.115
1.032–1.204
0.006
1.119
1.035–1.209
0.005
>70
2.008
1.876–2.150
<0.001
1.840
1.712–1.979
<0.001
Marital status
<0.001
<0.001
Married
Reference
1
Reference
1
Unmarried/NOS
1.498
1.412–1.590
<0.001
1.247
1.173–1.326
<0.001
Race
<0.001
<0.001
White
Reference
1
Reference
1
Black
1.421
1.291–1.564
<0.001
1.322
1.199–1.457
<0.001
Other/NOS
0.926
0.836–1.025
0.137
0.925
0.835–1.024
0.134
Pathological grade
<0.001
<0.001
I
Reference
1
Reference
1
II
1.075
0.941–1.227
0.285
1.078
0.944–1.231
0.269
III
1.696
1.468–1.960
<0.001
1.519
1.313–1.758
<0.001
IV
1.997
1.520–2.624
<0.001
1.594
1.211–2.098
0.001
Unknown
1.352
1.153–1.586
<0.001
1.042
0.887–1.225
0.615
Histological type
<0.001
<0.001
Adenocarcinomas
Reference
1
Reference
1
MCC/SRCC
1.535
1.396–1.689
<0.001
1.410
1.279–1.555
<0.001
T stage
<0.001
<0.001
T1
Reference
1
Reference
1
T2
0.936
0.741–1.181
0.576
0.925
0.732–1.169
0.514
T3
1.472
1.210–1.791
<0.001
1.561
1.277–1.907
<0.001
T4
3.344
2.720–4.110
<0.001
2.898
2.343–3.586
<0.001
N stage
<0.001
<0.001
N0
Reference
1
Reference
1
N1
1.147
1.072–1.228
<0.001
1.505
1.401–1.616
<0.001
N2
2.001
1.851–2.164
<0.001
2.717
2.496–2.957
<0.001
Surgery
<0.001
<0.001
Yes
Reference
1
Reference
1
No
3.295
3.044–3.567
<0.001
2.221
1.947–2.533
<0.001
Radiotherapy
<0.001
0.003
Neoradiotherapy
Reference
1
Reference
1
Radiotherapy*
1.534
1.431–1.644
<0.001
0.994
0.914–1.081
0.891
No/unknown
1.638
1.519–1.765
<0.001
1.178
1.062–1.306
0.002
Chemotherapy
<0.001
<0.001
Yes
Reference
1
Reference
1
No/unknown
1.553
1.447–1.667
<0.001
1.293
1.172–1.427
<0.001
RNE
<0.001
<0.001
<3
Reference
1
Reference
1
3–5
0.504
0.444–0.572
<0.001
0.800
0.690–0.928
0.003
6–8
0.485
0.434–0.542
<0.001
0.728
0.635–0.833
<0.001
9–11
0.463
0.416–0.515
<0.001
0.662
0.579–0.756
<0.001
≥12
0.441
0.410–0.475
<0.001
0.589
0.527–0.657
<0.001
NOS
0.710
0.546–0.925
0.011
0.864
0.660–1.131
0.288
Tumor size (cm)
<0.001
.001
≤5
Reference
1
Reference
1
5–10
1.341
1.248–1.441
<0.001
1.114
1.035–1.200
0.004
>10
1.925
1.569–2.361
<0.001
1.407
1.144–1.730
0.001
NOS
1.282
1.187–1.385
<0.001
1.088
1.002–1.180
0.043
CEA
<0.001
<0.001
Negative
Reference
1
Reference
1
Positive
1.702
1.577–1.836
<0.001
1.450
1.342–1.566
<0.001
NOS
1.336
1.242–1.438
<0.001
1.251
1.162–1.346
<0.001
*, not neoadjuvant. MCC, mucinous cell carcinoma; SRCC, signet ring cell carcinoma; RNE, Regional nodes examined; NOS, Not otherwise specified, NA, Unavailable.
*, not neoadjuvant. MCC, mucinous cell carcinoma; SRCC, signet ring cell carcinoma; RNE, regional nodes examined; NOS, not otherwise specified, NA, Unavailable.*, not neoadjuvant. MCC, mucinous cell carcinoma; SRCC, signet ring cell carcinoma; RNE, Regional nodes examined; NOS, Not otherwise specified, NA, Unavailable.All of the significant variables were integrated to build the nomograms for OS and CSS. The prognostic nomogram for 2-, 3-, and 5-year OS is shown in , and the nomogram for 2-, 3-, and 5-year CSS is shown in . The probabilities could be estimated for 2-, 3-, and 5-year OS and CSS after summing the scores related to each variable and casting total scores to the bottom scale.
Figure 2
Development and validation of the nomogram predicting OS. (A) The nomogram predicting OS for patients with locally advanced rectal cancer (LARC). (B) The calibration curves predicting OS in the training group. (C) The calibration curves predicting OS in the validation group. (D) The time-dependent ROC curves of the nomogram predicting OS in the training group. (E) The time-dependent ROC curves of the nomogram predicting OS in the validation group. (F) The decision curve analysis of the nomogram and all prognostic factors for OS in the training cohort. (G) The decision curve analysis of the nomogram and all prognostic factors for OS in the validation group. ROC, receiver operating characteristic; OS, overall survival; LARC, locally advanced rectal cancer.
Figure 3
Development and validation of the nomogram predicting CSS. (A) The nomogram predicting CSS for patients with LARC. (B) The calibration curves predicting CSS in the training group. (C) The calibration curves predicting CSS in the validation group. (D) The time-dependent receiver operating characteristic (ROC) curves of the nomogram predicting CSS in the training group. (E) The time-dependent ROC curves of the nomogram predicting CSS in the validation group. (F) The decision curve analysis of the nomogram and all prognostic factors for CSS in the training cohort. (G) The decision curve analysis of the nomogram and all prognostic factors for CSS in the validation group. CSS, cancer-specific survival; LARC, locally advanced rectal cancer.
Development and validation of the nomogram predicting OS. (A) The nomogram predicting OS for patients with locally advanced rectal cancer (LARC). (B) The calibration curves predicting OS in the training group. (C) The calibration curves predicting OS in the validation group. (D) The time-dependent ROC curves of the nomogram predicting OS in the training group. (E) The time-dependent ROC curves of the nomogram predicting OS in the validation group. (F) The decision curve analysis of the nomogram and all prognostic factors for OS in the training cohort. (G) The decision curve analysis of the nomogram and all prognostic factors for OS in the validation group. ROC, receiver operating characteristic; OS, overall survival; LARC, locally advanced rectal cancer.Development and validation of the nomogram predicting CSS. (A) The nomogram predicting CSS for patients with LARC. (B) The calibration curves predicting CSS in the training group. (C) The calibration curves predicting CSS in the validation group. (D) The time-dependent receiver operating characteristic (ROC) curves of the nomogram predicting CSS in the training group. (E) The time-dependent ROC curves of the nomogram predicting CSS in the validation group. (F) The decision curve analysis of the nomogram and all prognostic factors for CSS in the training cohort. (G) The decision curve analysis of the nomogram and all prognostic factors for CSS in the validation group. CSS, cancer-specific survival; LARC, locally advanced rectal cancer.
Validation of prognostic nomograms
Various methods have been used to demonstrate the superiority of nomograms, including C-index, time-dependent ROC curves, DCA, and calibration curves. C-indices were used to comprehensively assess the discriminatory power of the predictive models in this study. The nomograms obtained a superior C-index compared with the AJCC staging system [OS: 0.718 (95% CI, 0.712–0.723) vs. 0.597 (95% CI, 0.588–0.605) in the training cohort; 0.712 (95% CI, 0.704–0.720) vs. 0.579 (95% CI, 0.567–0.591) in the validation cohort; CSS: 0.718 (95% CI, 0.710–0.725) vs. 0.646 (95% CI, 0.635–0.656) in the training cohort; 0.711 (95% CI, 0.700–0.722) vs. 0.625 (95% CI, 0.610–0.640) in the validation cohort] ().
Table 4
The C-indices for predictions of OS and CSS
Group
OS
CSS
C-index
95% CI
C-index
95% CI
Training group-nomogram
0.718
0.712–0.723
0.718
0.710–0.725
Training group-AJCC stage
0.597
0.588–0.605
0.646
0.635–0.656
Validation group-nomogram
0.712
0.704–0.720
0.711
0.700–0.722
Validation group-AJCC stage
0.579
0.567–0.591
0.625
0.610–0.640
OS, overall survival; CSS, cancer-specific survival; C-index, index of concordance; CI, confidence interval.
OS, overall survival; CSS, cancer-specific survival; C-index, index of concordance; CI, confidence interval.The sensitivity and specificity of predicting the prognosis of LARC were identified by time-dependent ROC curves. illustrates the 2-, 3-, and 5-year values of the area under the curve (AUC) regarding the nomogram for OS (training group: 2-year OS 79.51%; 3-year OS 78.33%; 5-year OS 76.20%; validation group: 2-year OS 78.73%; 3-year OS 77.35%; 5-year OS 75.43%). The AUC values of the nomogram predicting CSS are displayed in (training group: 2-year CSS 80.26%; 3-year CSS 78.66%; 5-year CSS 75.82%; validation group: 2-year CSS 79.97%; 3-year CSS 77.98%; 5-year CSS 74.72%).In addition, the calibration curves demonstrated a high degree of reliability of the nomograms in this study owing to the minor deviations from the reference line ( for OS; for CSS). DCA is able to identify predictive models that help clinicians make better decisions (15). The DCA curves for the novel nomograms and each predictor are presented in for OS and for CSS. The superior net benefits revealed that the nomograms in this study showed more pinpoint values than individual predictors in clinical application.
Risk stratification
X-tile software (version 3.6.1; Yale University, New Haven, CT, USA) was used to calculate the cutoff values concerning the total scores of LARC patients by summing the ones related to each variable. The cutoff values were 181 and 307 for OS, and 172 and 263 for CSS (). Therefore, LARC patients were classified as high risk (score >307), moderate risk (181< score ≤307), and low risk (score ≤181) for OS. In addition, patients with LARC were classified as high risk (score >263), moderate risk (172< score ≤263), and low risk (score ≤172) for CSS. Although it is widely used to evaluate the prognosis of various tumors, the AJCC staging system produces a survival paradox for LARC, in that rectal cancer patients with T3–4N0 (stage II) showed worse survival compared to patients with T1–2N+ (stage III) (;
for OS and for CSS). show the correspondence between AJCC stage and the risk stratification in this study. The risk stratification effectively avoided the survival paradox in this study. The low-risk group had the highest 5-year CSS rate of 84.71% and a 5-year OS rate of 79.71%, followed by the moderate-risk group (61.06% for CSS and 50.78% for OS), and the high-risk group (30.05% for CSS and 17.86% for OS) in the training cohort (). The validation group confirmed the results of the low-risk group having the highest 5-year OS (78.17%) and CSS (83.48%) rate, followed by the moderate-risk group (51.09% for OS and 62.25% for CSS), and the high-risk group (17.58% for OS and 28.26% for CSS) ().
Figure 4
The cutoff values were calculated by using X-tile based on the total scores of patients summing the ones related to each variable. (A) The cutoff values were 181 and 307 for OS. (B) The cutoff values were 172 and 263 for CSS. OS, overall survival; CSS, cancer-specific survival.
Figure 5
Performance of the nomograms in stratifying on the basis of risk points. (A) The difference in OS among T3–4N0, T1–2N+, and T3–4N+ patients. (B) The correspondence between the AJCC stage and the risk stratification based on the nomogram predicting OS. (C) OS in the subgroups according to the risk stratification in the training cohort. (D) OS in the subgroups according to the risk stratification in the validation cohort. (E) The difference in CSS among T3–4N0, T1–2N+, and T3–4N+ patients. (F) The correspondence between AJCC stage and the risk stratification based on the nomogram predicting CSS. (G) CSS in the subgroups according to the risk stratification in the training cohort. (H) CSS in the subgroups according to the risk stratification in the validation cohort. OS, overall survival; CSS, cancer-specific survival; AJCC, American Joint Committee on Cancer.
The cutoff values were calculated by using X-tile based on the total scores of patients summing the ones related to each variable. (A) The cutoff values were 181 and 307 for OS. (B) The cutoff values were 172 and 263 for CSS. OS, overall survival; CSS, cancer-specific survival.Performance of the nomograms in stratifying on the basis of risk points. (A) The difference in OS among T3–4N0, T1–2N+, and T3–4N+ patients. (B) The correspondence between the AJCC stage and the risk stratification based on the nomogram predicting OS. (C) OS in the subgroups according to the risk stratification in the training cohort. (D) OS in the subgroups according to the risk stratification in the validation cohort. (E) The difference in CSS among T3–4N0, T1–2N+, and T3–4N+ patients. (F) The correspondence between AJCC stage and the risk stratification based on the nomogram predicting CSS. (G) CSS in the subgroups according to the risk stratification in the training cohort. (H) CSS in the subgroups according to the risk stratification in the validation cohort. OS, overall survival; CSS, cancer-specific survival; AJCC, American Joint Committee on Cancer.
Discussion
Numerous studies have reported that the AJCC staging system’s ability to predict survival is insufficiently inaccurate for the medical demands of rectal cancer (16-18), especially for LARC. In order to develop a precise scoring system with clinical value, nomograms that could evaluate OS and CSS in patients with LARC were constructed and examined based on a large population from the SEER database. The nomograms not only incorporated pathological variables but also therapeutic and demographic ones, and can therefore provide comprehensive guidance for clinical practice.The positive status of regional lymph nodes, without the intervention of T stage, is classified as stage III in the AJCC staging system. However, those patients with T3–4N− developed worse survival outcomes than T1–2N+ (12-14), which was consistent with our study. Increasing research has focused on the survival paradox in the AJCC staging system, suggesting that the T stage has more influence than the N stage on survival in rectal cancer (19), which was further demonstrated by the nomograms of OS and CSS in our study. The poor predictive performance of the AJCC staging system for LARC has spurred clinicians to seek a new method of risk stratification that would effectively avoid the survival paradox.Currently, (nCRT) is recommended for patients with LARC (20). Consequently, numerous studies have actively explored the positive response of LARC to nCRT (21-23). However, our study did not find that neoadjuvant radiotherapy (nRT) conferred significantly superior survival to other radiotherapy regimens (OS: P=0.194; CSS: P=0.891). It is well-established that nRT can be conducive to sphincter preservation for low rectal cancer. Nevertheless, nRT may be abandoned in patients with mid-high rectal cancer without the issue of sphincter preservation, due to increased surgical complications after nRT. In addition, the intuitive nomograms, which showed noteworthy survival benefits from surgery, chemotherapy, and radiotherapy, support the active treatment of LARC. Furthermore, RNE has been utilized to measure the quality of surgery in other research (3) and is a major factor in the nomograms, which can remind surgeons of the importance of regional lymph node dissection.The effect of tumor size on survival has long been ignored in cavity organs. However, many studies have suggested that tumor size is related to the response of LARC to chemoradiotherapy (21,22), which may also affect the prognosis of LARC. CEA has been revealed to have a close association with chemosensitivity and survival of rectal cancer patients in various studies (24,25). Similarly, an elevated CEA was confirmed to be an indicator of poor prognosis in this study. Other essential prognostic factors were also incorporated into the study, including age, marital status, pathological grade, and histological type. Cancers can increase the risk of death from geriatric diseases, which is why age contributed a higher weight in the nomogram of OS compared to CSS. Furthermore, it is worth noting that patients with MCC/SRCC had a worse survival. The prognosis of LARC that was well/moderately differentiated was significantly better than that of poorly differentiated/undifferentiated LARC, which was in agreement with previous studies. Interestingly, marital status has been found to correlate with the prognosis of various tumors (26-28), which was also applicable to rectal cancer in our study.One-third of the patients were randomly selected as the validation group to confirm the superiority of the nomograms in this study. The excellent results, including C-index, time-dependent ROC curves, DCA, and calibration curves, in the validation group ensure the generalizability of the novel nomograms. However, some limitations were nonetheless present in our study. Firstly, as a retrospective study, the nomograms still need to be validated in the future by prospective studies. Secondly, we adopted the sixth edition of AJCC staging, rather than the latest editions, since the cases studied were taken from 2004 to 2011, which reduced, to some extent, the accuracy of the AJCC stage in that it lacked the T4 and N+ subgroups. Moreover, we still need more real-world data to verify the efficacy of the nomograms. These limitations notwithstanding, the study results attest to the excellent sensitivity, specificity, and outstanding clinical value of the nomograms.
Conclusions
Our nomograms, which effectively solved the issue of the survival paradox of the AJCC staging system regarding LARC, may serve as excellent tools for integrating clinical characteristics and guiding therapeutic choices for LARC patients.The article’s supplementary files as
Authors: K Tamas; A M E Walenkamp; E G E de Vries; M A T M van Vugt; R G Beets-Tan; B van Etten; D J A de Groot; G A P Hospers Journal: Cancer Treat Rev Date: 2015-06-28 Impact factor: 12.111