Yu-Jie Lu1, Wei-Ming Duan1. 1. Department of Oncology, the First Affiliated Hospital of Soochow University, Suzhou, China.
Abstract
BACKGROUND: Patients with prostate cancer (PCa) commonly suffer from bone metastasis during disease progression. This study aims to construct and validate a nomogram to quantify bone metastasis risk in patients with PCa. METHODS: Clinicopathological data of patients diagnosed with PCa between 2010 and 2015 were retrospectively retrieved from the Surveillance, Epidemiology, and End Results (SEER) database. Predictors for bone metastasis were identified by logistic regression analyses to establish a nomogram. The concordance index (c-index) and calibration plots were generated to assess the nomogram's discrimination, and the area under the receiver operating characteristic curve (AUC) was used to compare the precision of the nomogram with routine staging systems. The nomogram's clinical performance was evaluated by decision curve analysis (DCA) and clinical impact curves (CIC). Independent prognostic factors were identified by Cox regression analysis. RESULTS: A total of 168,414 eligible cases were randomly assigned to the training cohort or validation cohort at a ratio of 1:1. The nomogram, which was established based on independent factors, showed good accuracy, with c-indexes of 0.911 in the training set and 0.910 in the validation set. Calibration plots also approached 45 degrees. After other distant metastatic sites were included in the predictive model, the new nomogram displayed superior prediction performance. The AUCs and net benefit of the nomograms were both higher than those of other routine staging systems. Furthermore, bone metastasis prediction points were shown to be a new risk factor for overall survival. CONCLUSIONS: Novel validated nomograms can effectively predict the risk of bone metastasis in patients with PCa and help clinicians improve cancer management. 2021 Translational Andrology and Urology. All rights reserved.
BACKGROUND: Patients with prostate cancer (PCa) commonly suffer from bone metastasis during disease progression. This study aims to construct and validate a nomogram to quantify bone metastasis risk in patients with PCa. METHODS: Clinicopathological data of patients diagnosed with PCa between 2010 and 2015 were retrospectively retrieved from the Surveillance, Epidemiology, and End Results (SEER) database. Predictors for bone metastasis were identified by logistic regression analyses to establish a nomogram. The concordance index (c-index) and calibration plots were generated to assess the nomogram's discrimination, and the area under the receiver operating characteristic curve (AUC) was used to compare the precision of the nomogram with routine staging systems. The nomogram's clinical performance was evaluated by decision curve analysis (DCA) and clinical impact curves (CIC). Independent prognostic factors were identified by Cox regression analysis. RESULTS: A total of 168,414 eligible cases were randomly assigned to the training cohort or validation cohort at a ratio of 1:1. The nomogram, which was established based on independent factors, showed good accuracy, with c-indexes of 0.911 in the training set and 0.910 in the validation set. Calibration plots also approached 45 degrees. After other distant metastatic sites were included in the predictive model, the new nomogram displayed superior prediction performance. The AUCs and net benefit of the nomograms were both higher than those of other routine staging systems. Furthermore, bone metastasis prediction points were shown to be a new risk factor for overall survival. CONCLUSIONS: Novel validated nomograms can effectively predict the risk of bone metastasis in patients with PCa and help clinicians improve cancer management. 2021 Translational Andrology and Urology. All rights reserved.
Entities:
Keywords:
Prostate cancer (PCa); Surveillance, Epidemiology, and End Results (SEER); bone metastasis; nomogram; risk factors; validation
Prostate cancer (PCa) is the second most common malignancy among men and ranks as the fifth leading cause of cancer death worldwide (1). In the United States, PCa is the most commonly diagnosed cancer among men, with an estimated 174,650 new cases (20% of all cases) and 31,620 cancer-related deaths (10% of all cases) (2). However, despite the increasing survival rates of patients with PCa due to recent advancements in comprehensive treatment, metastatic disease is still related to a high mortality rate (3,4). Only 20–30% of metastatic PCa patients live to 5 years after diagnosis, and approximately 85% of cases suffer from bone metastasis (5,6). As the most common metastasis type in advanced PCa patients (7), bone metastasis seriously affects the quality of life due to skeletal complications (8). Early diagnosis and early treatment with antiresorptive drugs or radiopharmaceuticals can improve quality of life and even lead to better survival (9). However, according to the National Comprehensive Cancer Network (NCCN) guidelines, asymptomatic patients with PCa are not recommended for routine assessment or skeletal imaging (10). Furthermore, even if patients underwent imaging examinations, such as computed tomography (CT), magnetic resonance imaging (MRI), or bone scans, the recurrence of the disease may not be diagnosed in time because of the low sensitivity of these techniques (11). Thus, the prediction of bone metastasis is essential for choosing therapeutic strategies.Although some biological parameters and clinical factors have been verified to be related to bone metastasis in patients with PCa, the relevant studies only analyzed scattered factors or had inadequate sample sizes (12-14). A previous study assessed several clinical characteristics in promoting bone metastasis based on large sample size (15). However, more comprehensive and in-depth analyses have not been performed. Therefore, this study aimed to investigate the clinicopathological factors related to bone metastasis, and the second aim was to establish an accurate predictive model for quantifying the risk of bone metastasis. An effective nomogram is a reliable graphical calculating tool that can predict outcomes with a combination of all risk variables, benefiting both doctors and patients (16). In this study, patients with PCa were screened and selected from the Surveillance, Epidemiology, and End Results (SEER) database to establish a novel nomogram for predicting bone metastasis. Compared with several similar models for predicting bone metastasis in PCa patients in recent studies (17,18), the model developed in this study displayed better predictive performance, and was based on larger population-based sample size. Moreover, we identified bone metastasis prediction points as a new independent factor for the overall survival of patients with PCa. Furthermore, decision curve analysis (DCA) and clinical impact curves (CIC) analyses were performed to investigate the model’s clinical value. With this tool, clinicians can evaluate bone metastasis’s risk in patients with PCa to provide them with appropriate examinations and individualized treatment.We present the following article in accordance with the TRIPOD reporting checklist (available at http://dx.doi.org/10.21037/tau-20-1133).
Methods
Patients
The SEER database covers approximately 30% of the total American population and contains patients from different regions, including demographics, tumor morphology, staging system, and metastasis status (19). Information on patients diagnosed with PCa between 2010 and 2015 was retrieved from the SEER 18 Regs Research Data database using SEER-Stat 8.3.5 software, downloaded from https://seer.cancer.gov (20). The exclusion criteria were as follows: (I) patients diagnosed with more than one primary cancer; (II) aged <18 years; (III) diagnostic confirmation only based on clinical performance or without microscopic analysis; (IV) clinical background characteristics (age, race, and marital status), T stage, N stage, prostate-specific antigen (PSA) level, Gleason score, or metastasis status were unknown or untested. The study was conducted in accordance with the Declaration of Helsinki (as revised in 2013). As data from the SEER program is available for the public and does not need patient informed consent, and ethical approval was waived by the local Ethics Committee of the First Affiliated Hospital of Soochow University.
Study variables
Information on several clinicopathological characteristics was extracted for each patient. Age at diagnosis as a continuous variable was converted to a categorical variable based on the median value of 65. Patients were divided into four groups based on the eighth American Joint Committee on Cancer (AJCC) T stage, and two groups based on the eighth AJCC N stage (21). PSA level was classified as ≤20 and >20 ng/mL, which met the classification criteria of the NCCN guidelines (10). According to the consensus of the International Society of Urological Pathology (ISUP) in 2014, Gleason score was divided into five levels: grade 1 for score ≤6, grade 2 for score =3+4, grade 3 for score =4+3, grade 4 for score =8, grade 5 for score =9 or 10 (22), and patients were divided into these five groups accordingly. Marital status (married or unmarried), brain metastasis (absence or presence), liver metastasis (absence or presence), and lung metastasis (absence or presence) were considered as different categorical factors. Bone metastasis was the primary outcome variable in this study.
Nomogram construction and validation
All cases were randomly assigned to the training cohort and the validation cohort in a 1:1 ratio. After univariate unadjusted logistic regression analysis in the training cohort, significant variables (P<0.05) were further added into the multivariate logistic regression model to acquire the independent factors that predict bone metastasis in patients with PCa. The most significant variables were used to construct a visual prediction nomogram through the forward stepwise selection method in multivariable analysis (23). The concordance index (c-index) was used to evaluate the discrimination performance of the nomogram. A strong predictive power model usually has a high c-index, which fluctuates between 0.5 and 1.0 (24). The nomogram’s calibration power was validated by the calibration plots that showed the relationship between the predicted probabilities of bone metastasis and the actual ones. To reduce overfit bias, a bootstrapping method with 1,000 resamples was used in nomogram validation. Furthermore, the comparability between the predictive accuracy of the nomogram and that of other factors was measured based on receiver operating characteristic (ROC) curves. A larger value of the area under the ROC curve (AUC) indicated a stronger predictive power (25). All validation means mentioned above were used in both the training cohort and the validation cohort.
Clinical performance
The nomogram’s clinical usefulness was assessed by quantifying the net benefit (NB) at each risk in DCA (26,27). By calculating the number of true positive cases minus false-positive cases and weighing the correlative hazards brought by abandoning interventions against the negative effects of unnecessary treatment, the NB of each probability was eventually calculated (28). Also, according to the consequence of DCA, a CIC was generated to evaluate the clinical performance of the nomogram further. At each threshold probability, the number of patients classified as high risk in a nomogram and the outcome of bone metastasis was both displayed in the CIC (29).
Statistical analyses
A Student’s t-test or chi-square test was used to analyze continuous clinical characteristics and categorical variables. Kaplan-Meier and log-rank tests were performed to predict overall survival, and the Cox regression model was used to identify the independent factors for prognosis. All the statistical analyses, including univariate and multivariate logistic regression analysis, were performed using IBM SPSS Statistics software (version 24.0, SPSS Inc., Chicago, USA). Nomogram, c-index, calibration curves, ROC, DCA, and CIC, were calculated and visualized in R software (version 3.51, Foundation for Statistical Computing, Vienna, Austria) with relevant R packages, such as rms, Hmisc, calibrate ROCR, and rmda. All tests were two-sided, and P<0.05 was deemed statistically significant.
Results
Patient characteristics
The clinicopathological characteristics of patients with PCa in both groups are displayed in . A total of 168,414 cases, consisting of half in the training set and a half in the validation set, were eventually extracted from the SEER database after meeting the inclusion criteria. The mean age of the total cohort was 64.69 years, and the median age was 65 years. In this study, 2,607 cases in the training set and 2,747 cases in the validation set had bone metastasis at initial diagnosis, and the P value of the bone metastasis rate between the two sets was 0.052. All the P values of the chi-square tests and the Student’s t-tests in were larger than 0.05, indicating no statistically significant differences between the two cohorts. Ten variables, including age, race, marital status, T stage, N stage, PSA level, Gleason grade, brain metastasis, liver metastasis, and lung metastasis, were significantly related to bone metastasis in both sets, all with P values <0.05 ().
Table 1
Demographic and clinical information of patients with prostate cancer (PCa)
Variables
SEER cohort (n=168,414)
P value
Total cohort
Training (n=84,207)
Validation (n=84,207)
Age (years), mean
64.69
64.71
64.67
0.098
Race
0.029
White
130,655 (77.6)
65,140 (77.4)
65,515 (77.8)
Black
28,399 (16.9)
14,277 (17.0)
14,122 (16.8)
Other*
9,360 (5.6)
4,790 (5.7)
4,570 (5.4)
Marital status
0.420
Married
125,698 (74.6)
62,777 (74.6)
62,921 (74.7)
Unmarried
42,716 (25.4)
21,430 (25.4)
21,286 (25.3)
T (8th)
0.693
T1
69,241 (41.1)
34,562 (41.0)
34,679 (41.2)
T2
75,241 (44.7)
37,736 (44.8)
37,505 (44.5)
T3
22,385 (13.3)
11,140 (13.2)
11,245 (13.4)
T4
1,547 (0.9)
769 (0.9)
778 (0.9)
N (8th)
0.508
N0
162,492 (96.5)
81,271 (96.5)
81,221 (96.5)
N1
5,922 (3.5)
2,936 (3.5)
2,986 (3.5)
PSA (ng/mL)
0.494
≤20
5,082 (3.0)
2,517 (3.0)
2,565 (3.0)
>20
163,332 (97.0)
81,690 (97.0)
81,642 (97.0)
Gleason grade
0.638
1
67,278 (39.9)
33,743 (40.1)
33,535 (39.8)
2
46,804 (27.8)
23,333 (27.7)
23,471 (27.9)
3
21,961 (13.0)
10,950 (13.0)
11,011 (13.1)
4
17,446 (10.4)
8,772 (10.4)
8,674 (10.3)
5
14,925 (8.9)
7,409 (8.8)
7,516 (8.9)
Bone metastasis
0.052
No
163,060 (96.8)
81,600 (96.9)
81,460 (96.7)
Yes
5,354 (3.2)
2,607 (3.1)
2,747 (3.3)
Brain metastasis
0.064
No
168,372 (>99.9)
84,192 (>99.9)
84,180 (>99.9)
Yes
42 (<0.1)
15 (<0.1)
27 (<0.1)
Liver metastasis
0.779
No
168,210 (99.9)
84,103 (99.9)
84,107 (99.9)
Yes
204 (0.1)
104 (0.1)
100 (0.1)
Lung metastasis
0.191
No
168,018 (99.8)
83,996 (99.7)
84,022 (99.8)
Yes
396 (0.2)
211 (0.3)
185 (0.2)
*, other includes American Indian/Alaska native, Asian/Pacific Islander, and unknown. PSA, prostate-specific antigen; SEER, Surveillance, Epidemiology, and End Results.
Table 2
Relationship between clinicopathological variables and bone metastasis in the training and validation cohorts
Variables
Training cohort
Validation cohort
Negative (%)
Positive (%)
P value
Negative (%)
Positive (%)
P value
Age (years), mean
64.58
68.78
<0.001
64.53
68.75
<0.001
Race
0.004
<0.001
White
63,193 (77.4)
1,947 (74.7)
63,476 (77.9)
2,039 (74.2)
Black
13,785 (16.9)
492 (18.9)
13,574 (16.7)
548 (19.9)
Other*
4,622 (5.7)
168 (6.4)
4,410 (5.4)
160 (5.8)
Marital status
<0.001
<0.001
Married
61,171 (75.0)
1,606 (61.6)
61,244 (75.2)
1,677 (61.0)
Unmarried
20,429 (25.0)
1,001 (38.4)
20,216 (24.8)
1,070 (39.0)
T (8th)
<0.001
<0.001
T1
33,592 (41.2)
970 (37.2)
33,621 (41.3)
1,058 (38.5)
T2
36,808 (45.1)
928 (35.6)
36,543 (44.9)
962 (35.0)
T3
10,762 (13.2)
378 (14.5)
10,864 (13.3)
381 (13.9)
T4
438 (0.5)
331 (12.7)
432 (0.5)
346 (12.6)
N (8th)
<0.001
<0.001
N0
79,466 (97.4)
1,805 (69.2)
79,300 (97.3)
1,921 (69.9)
N1
2,134 (2.6)
802 (30.8)
2,160 (2.7)
826 (30.1)
PSA (ng/mL)
<0.001
<0.001
≤20
2,492 (3.1)
25 (1.0)
2,530 (3.1)
35 (1.3)
>20
79,108 (96.9)
2,582 (99.0)
78,930 (96.9)
2,712 (98.7)
Gleason grade
<0.001
<0.001
1
33,684 (41.3)
59 (2.3)
33,476 (41.1)
59 (2.1)
2
23,184 (28.4)
149 (5.7)
23,313 (28.6)
158 (5.8)
3
10,712 (13.1)
238 (9.1)
10,753 (13.2)
258 (9.4)
4
8,128 (10.0)
644 (24.7)
8,008 (9.8)
666 (24.2)
5
5,892 (7.2)
1,517 (58.2)
5,910 (7.3)
1,606 (58.5)
Brain metastasis
<0.001
<0.001
No
81,597 (>99.9)
2,595 (99.5)
81,450 (>99.9)
2,730 (99.4)
Yes
3 (<0.1)
12 (0.5)
10 (<0.1)
17 (0.6)
Liver metastasis
<0.001
<0.001
No
81,580 (>99.9)
2,523 (96.8)
81,433 (>99.9)
2,674 (97.3)
Yes
20 (<0.1)
84 (3.2)
27 (<0.1)
73 (2.7)
Lung metastasis
<0.001
<0.001
No
81,558 (99.9)
2,438 (93.5)
81,418 (99.9)
2,604 (94.8)
Yes
42 (0.1)
169 (6.5)
42 (0.1)
143 (5.2)
*, other includes Native American/Alaska native, Asian/Pacific Islander, and unknown. PSA, prostate-specific antigen; SEER, Surveillance, Epidemiology, and End Results.
*, other includes American Indian/Alaska native, Asian/Pacific Islander, and unknown. PSA, prostate-specific antigen; SEER, Surveillance, Epidemiology, and End Results.*, other includes Native American/Alaska native, Asian/Pacific Islander, and unknown. PSA, prostate-specific antigen; SEER, Surveillance, Epidemiology, and End Results.
Independent predictors in the training set
Seven variables, including age, race, marital status, T stage, N stage, PSA level, and Gleason grade, which were significantly related to bone metastasis after univariate unadjusted logistic regression analysis (P<0.05), were put into the multivariate-adjusted logistic regression analyses using the stepwise selection technique. As shown in model 1 of , six variables were considered independent factors. In model 2 of , the other 3 variables describing distant metastasis status were added into the predictive system, and eventually, all of them were independently associated with bone metastasis after logistic regression analyses. As shown in predictive model 2, there were nine independent indicators for bone metastasis in PCa, including age, marital status, T stage, N stage, PSA level, Gleason grade, brain metastasis, liver metastasis and lung metastasis. Age >65 years, unmarried status, tumor with T4 stage, regional lymph node metastasis, PSA level >20 ng/mL, Gleason grade 5, and a diagnosis of other distant metastases were all high-risk factors for bone metastasis.
Table 3
Univariate and multivariate logistic regression analyses for variables in model 1 or model 2
Variables
Univariate analysis
Multivariate analysis
Nomogram 1
Nomogram 2
OR
95% CI
P value
OR
95% CI
P value
OR
95% CI
P value
Age
≤65 years
Ref.
–
–
Ref.
–
–
Ref.
–
–
>65 years
1.779
1.643–1.927
<0.001
1.145
1.045–1.254
0.004
1.146
1.044–1.258
0.004
Race
White
Ref.
–
–
Ref.
–
–
Ref.
–
–
Black
1.158
1.048–1.281
0.004
1.032
0.918–1.160
0.598
1.095
0.972–1.232
0.135
Other*
1.180
1.005–1.385
0.043
0.929
0.777–1.111
0.419
0.880
0.732–1.056
0.170
Marital status
Married
Ref.
–
–
Ref.
–
–
Ref.
–
–
Unmarried
1.866
1.722–2.023
<0.001
1.541
1.407–1.688
<0.001
1.499
1.366–1.646
<0.001
T (8th)
T1
Ref.
–
–
Ref.
–
–
Ref.
–
–
T2
0.873
0.797–0.956
0.004
0.804
0.728–0.888
<0.001
0.804
0.726–0.890
<0.001
T3
1.216
1.078–1.373
0.001
0.355
0.310–0.407
<0.001
0.368
0.320–0.424
<0.001
T4
26.171
22.383–30.600
<0.001
3.082
2.557–3.715
<0.001
3.003
2.481–3.636
<0.001
N (8th)
N0
Ref.
–
–
Ref.
–
–
Ref.
–
–
N1
16.546
15.067–18.170
<0.001
4.838
4.314–5.424
<0.001
4.513
4.011–5.078
0.001
PSA (ng/mL)
≤20
Ref.
–
–
Ref.
–
–
Ref.
–
–
>20
3.253
2.190–4.834
<0.001
2.026
1.315–3.120
0.001
2.111
1.349–3.304
0.001
Gleason grade
1
Ref.
–
–
Ref.
–
–
Ref.
–
–
2
3.669
2.713–4.963
<0.001
3.739
2.763–5.060
<0.001
3.713
2.737–5.037
<0.001
3
12.685
9.531–16.882
<0.001
12.218
9.165–16.288
<0.001
11.969
8.954–16.000
<0.001
4
45.235
34.611–59.120
<0.001
38.865
29.648–50.948
<0.001
35.988
27.370–47.318
<0.001
5
146.992
113.163–190.934
<0.001
103.446
79.253–135.024
<0.001
98.858
75.553–129.352
<0.001
Brain metastasis
No
Ref.
–
–
–
–
–
Ref.
–
–
Yes
125.776
35.472–445.972
<0.001
–
–
–
21.598
4.514–103.345
<0.001
Liver metastasis
No
Ref.
–
–
–
–
–
Ref.
–
–
Yes
135.805
82.259–221.512
<0.001
–
–
–
19.841
10.546–37.328
<0.001
Lung metastasis
No
Ref.
–
–
–
–
–
Ref.
–
–
Yes
134.608
95.779–189.177
<0.001
–
–
–
28.741
19.384–42.614
<0.001
*, other includes American Indian/Alaska native, Asian/Pacific Islander, and unknown. OR, odds ratio; CI, confidence interval.
*, other includes American Indian/Alaska native, Asian/Pacific Islander, and unknown. OR, odds ratio; CI, confidence interval.
Construction and validation of nomograms
Six independent predictors in model 1 were incorporated into the construction of nomogram 1 to predict bone metastasis in patients with PCa (A, ). The nomogram displayed excellent predictive accuracy, with c-indexes of 0.911 (95% CI: 0.906–0.916, P<0.001) in the training set and 0.910 (95% CI: 0.905–0.915, P<0.001) in the validation set. Both the internal and external calibration curves reflected that the nomogram predicted metastasis well (). A combination of the other three statistically pronounced metastatic sites and the clinicopathological predictors mentioned above were used to develop a new nomogram (nomogram 2, B, ). The c-indexes for the training and the validation sets were 0.917 (95% CI: 0.912–0.922, P<0.001) and 0.915 (95% CI: 0.910–0.920, P<0.001), respectively. The internal and external calibration plots of nomogram 2 were slightly closer to 45 degrees than those of nomogram 1 (). These results suggest that the predictive model displayed slightly superior predictive performance when other distant metastatic sites were added into this predictive system. Also, the risk of bone metastasis in PCa patients could be calculated by adding up the detailed points given in of each factor. High-risk factors, such as age >65 years, unmarried status, tumor with T4 stage, regional lymph node metastasis, PSA level >20 ng/mL, Gleason grade 5, and a diagnosis of other distant metastases, achieved the highest scores in each group.
Figure 1
Nomograms for predicting the risk of bone metastasis in patients with prostate cancer (PCa). (A) Nomogram 1 consisted of clinicopathological factors; (B) nomogram 2 consisted of factors in nomogram 1 and other distant organ metastasis status. PSA, prostate-specific antigen.
Figure 2
The internal calibration curve (A) and external calibration curve (B) of nomogram 1. The internal calibration curve (C) and the external calibration curve (D) of nomogram 2.
Table 4
Scores for each predictor in the two nomograms
Variables
Classification
Nomogram score
Model 1
Model 2
Age
≤65 years
0
0
>65 years
3
3
Marital status
Married
0
0
Unmarried
9
9
T (8th)
T1
22
22
T2
18
17
T3
0
0
T4
47
46
N (8th)
N0
0
0
N1
34
33
PSA (ng/mL)
≤20
0
0
>20
15
16
Gleason grade
1
0
0
2
28
29
3
54
54
4
79
78
5
100
100
Brain metastasis
No
–
0
Yes
–
67
Liver metastasis
No
–
0
Yes
–
65
Lung metastasis
No
–
0
Yes
–
73
Nomograms for predicting the risk of bone metastasis in patients with prostate cancer (PCa). (A) Nomogram 1 consisted of clinicopathological factors; (B) nomogram 2 consisted of factors in nomogram 1 and other distant organ metastasis status. PSA, prostate-specific antigen.The internal calibration curve (A) and external calibration curve (B) of nomogram 1. The internal calibration curve (C) and the external calibration curve (D) of nomogram 2.
Comparison of nomograms and other factors
To compare the predictive performance of the two nomograms and other risk factors, we conducted ROC analysis in this study. For the training cohort, the AUC value of nomogram 2 was 0.911 (95% CI: 0.906–0.916, P<0.001), which was slightly higher than that of nomogram 1 (0.904, 95% CI: 0.989–0.909, P<0.001), and significantly higher than those of Gleason grade (0.883, 95% CI: 0.878–0.890, P<0.001), N stage (0.641, 95% CI: 0.628–0.653, P<0.001) and T stage (0.565, 95% CI: 0.552–0.577, P<0.001) (). For the validation cohort, the results of the ROC analyses were similar. The AUC value of nomogram 2 was 0.910 (95% CI: 0.905–0.915, P<0.001), which was slightly higher than that of nomogram 1 (0.904, 95% CI: 0.899–0.909, P<0.001), and significantly higher than those of Gleason grade (0.884, 95% CI: 0.879–0.890, P<0.001), N stage (0.637, 95% CI: 0.625–0.649, P<0.001) and T stage (0.557, 95% CI: 0.545–0.569, P<0.001) (). These outcomes suggest that compared to routine staging systems, the models we created show better accuracy in predicting bone metastasis in patients with PCa.
Figure 3
The receiver operating characteristic (ROC) plots for bone metastasis in the training set (A) and the validation set (B), respectively.
The receiver operating characteristic (ROC) plots for bone metastasis in the training set (A) and the validation set (B), respectively.
Clinical value of nomograms
DCA, a novel tool used to assess the clinical application value of predictive models, detailed different points of NB at each relevant probability. For the training set, the use of nomogram 2 to predict bone metastasis yielded greater NBs than the intervention-all or the intervention-none when the threshold probabilities ranged from 0.01 to 0.84 (). The threshold probability of 0.01 to 0.76 for bone metastasis was the most beneficial for prediction with nomogram 2 () for the validation set. In comparison with nomogram 1, Gleason grade, N stage, and T stage, the higher NBs of the nomogram 2 indicated that nomogram 2 could predict bone metastasis in patients with PCa more accurately in both cohorts (). To further evaluate the substantial clinical usefulness of nomogram 2, CIC analysis was adopted in both the training set and validation set. The results showed the number of predicted high-risk cases was larger than that of true positive cases when the risk threshold was in the range of 0–0.48 for the training set () and 0–0.50 for the validation set (). Furthermore, it was also satisfactory for the cost-benefit ratios at each risk threshold mentioned above (). To further determine the prognostic model’s daily application value, we divided all patients with PCa into two cohorts based on the median bone metastasis prediction points. Interestingly, patients with points higher than 62 had worse overall survival than those with points lower than 62 (P<0.001, ). Bone metastasis prediction points were investigated as a new factor and included in the multivariable Cox regression model and were finally demonstrated to be an independent variable for predicting patients’ overall survival with PCa (P<0.001, ).
Figure 4
Decision curve analysis (DCA) of the two nomograms and other traditional predictive factors, such as Gleason grade, N stage and T stage (A for the training set; B for the validation set). The x-axis and the y-axis represent the threshold probability and the net benefit, respectively. The gray line assumes all patients with PCa will suffer from bone metastasis, while the horizontal black line assumes all patients will not experience bone metastasis. (C,D) CIC of nomogram 2 for predicting bone metastasis in the training set (C) and the validation set (D). The x-axis represents the risk threshold, and the y-axis shows the predictive number of high-risk patients or the number of high-risk patients with bone metastasis. PCa, prostate cancer; CIC, clinical impact curves.
Figure 5
Kaplan-Meier survival analysis between prostate cancer (PCa) patients with low total points and those with high total points.
Table 5
Independent risk factors for overall survival in patients with PCa
Variables
Cox regression model
HR
95% CI
P value
Age
≤65 years
Ref.
–
–
>65 years
2.179
2.093–2.270
<0.001
Race
White
Ref.
–
–
Black
1.233
1.178–1.291
<0.001
Other*
0.716
0.655–0.784
<0.001
Marital status
Married
Ref.
–
–
Unmarried
1.622
1.561–1.685
<0.001
T (8th)
T1
Ref.
–
–
T2
0.736
0.707–0.767
<0.001
T3
0.628
0.590–0.669
<0.001
T4
1.402
1.286–1.530
<0.001
N (8th)
N0
Ref.
–
–
N1
1.301
1.221–1.386
<0.001
PSA (ng/mL)
≤20
Ref.
–
–
>20
0.856
0.759–0.965
0.011
Gleason grade
1
Ref.
–
–
2
0.894
0.794–1.005
0.062
3
1.061
0.925–1.218
0.397
4
1.609
1.406–1.841
<0.001
5
3.023
2.646–3.454
<0.001
Bone metastasis
No
Ref.
–
–
Yes
5.791
5.489–6.109
<0.001
Brain metastasis
No
Ref.
–
–
Yes
2.003
1.390–2.886
<0.001
Liver metastasis
No
Ref.
–
–
Yes
2.532
2.139–2.997
<0.001
Lung metastasis
No
Ref.
–
–
Yes
1.556
1.356–1.785
<0.001
Bone metastasis prediction
Low total points (≤62)
Ref.
–
–
High total points (>62)
1.747
1.547–1.972
<0.001
*, other includes Native American/Alaska native, Asian/Pacific Islander, and unknown. PCa, prostate cancer; HR, hazard ratio; CI, confidence interval; PSA, prostate-specific antigen.
Decision curve analysis (DCA) of the two nomograms and other traditional predictive factors, such as Gleason grade, N stage and T stage (A for the training set; B for the validation set). The x-axis and the y-axis represent the threshold probability and the net benefit, respectively. The gray line assumes all patients with PCa will suffer from bone metastasis, while the horizontal black line assumes all patients will not experience bone metastasis. (C,D) CIC of nomogram 2 for predicting bone metastasis in the training set (C) and the validation set (D). The x-axis represents the risk threshold, and the y-axis shows the predictive number of high-risk patients or the number of high-risk patients with bone metastasis. PCa, prostate cancer; CIC, clinical impact curves.Kaplan-Meier survival analysis between prostate cancer (PCa) patients with low total points and those with high total points.*, other includes Native American/Alaska native, Asian/Pacific Islander, and unknown. PCa, prostate cancer; HR, hazard ratio; CI, confidence interval; PSA, prostate-specific antigen.
Discussion
Nowadays, nomograms have become significant modern medical decision tools, that can predict the risk of disease or survival outcomes (17,30). These models integrate a variety of individual risk factors and quantify each variable’s influence to visualize the results of different patients (31,32). Several nomograms for predicting the risk of bone metastasis in patients with PCa have been constructed in recent studies. Godtman et al. developed a risk model for helping some patients to avoid unnecessary bone scans based on thousands of cases from the National Prostate Cancer Register of Sweden (17). Zhang et al. used the clinicopathological information of 116 patients to establish a risk model consisting of multiparametric MRI-based markers and clinical variables (18). However, there was no nomogram in existence that was simultaneously based on abundant clinical data and had excellent predictive ability in previous studies. This study collected data from 168,414 patients diagnosed with PCa from the SEER database, and 5,354 cases suffered from bone metastasis. After univariate and multivariate logistic regression analyses, two novel nomograms for predicting bone metastasis’s risk were successfully constructed. Both internal and external validation of the two nomograms demonstrated the nomograms’ excellent predictive performance through the evaluation of c-indexes and calibration plots. Interestingly, nomogram 2, consisting of nomogram 1 and other distant organ metastasis variables, had a slightly better predictive ability than nomogram 1. Compared with other routine predictive systems, the two nomograms both showed better accuracy in predicting bone metastasis according to ROC analyses’ outcomes. Nevertheless, great discrimination performance and strong calibration power do not necessarily mean the established model could be useful in daily clinical application (31). Thus, DCA was performed to evaluate the nomograms’ clinical usefulness, and nomogram 2 showed better clinical utility in the proper range than other predictive systems. Additionally, CICs in both the training and validation sets based on DCA further demonstrated the good discriminatory ability of nomogram 2. Moreover, bone metastasis prediction points that measure bone metastasis’s probability was defined as a new prognostic factor in patients with PCa. Once patients are predicted to have high bone metastasis risk according to the nomogram, even if patients are not found to have bone metastasis at initial diagnosis, the doctors are responsible for suggesting close imaging examinations of the bone in the future.This study provided novel insights into the correlation between clinicopathological characteristics and bone metastasis of patients with PCa. After logistic regression analysis, we found that older men with PCa were more likely to have bone metastasis than younger men, similar to several previous studies (33-35). Marital status has also been shown to be an independent factor for distant organ metastasis or overall survival in multiple malignant tumors (36-38). Jiang et al. demonstrated that married patients with metastatic PCa had better overall survival or cancer-specific survival than unmarried patients, which might be because married men tend to get more spiritual comfort and social support (39). The result that unmarried patients with PCa had a higher risk of progressive disease was consistent with a previous study (15). This may due to androgen changes after men get married, as it is well known that androgen plays an essential role in the development of PCa (40). Patients diagnosed at the T4 stage had the highest risk of bone metastasis among all cases. T1 patients had a greater risk of being diagnosed with bone metastasis than T2 or T3 patients. Although this is not an intuitive result, it is consistent with the findings from Guo et al. (15), though the specific reason behind this observation requires further exploration. Previous studies have illustrated that lymph node status, especially pelvic lymph nodes, is vital and therapeutically relevant predictor for patients with PCa (41,42). According to our research, patients experiencing regional lymph nodes usually have tumors with high histological grade (43), and are more likely to suffer from bone metastasis than N0 patients. PSA is a widely used tumor indicator for predicting treatment outcomes or even patient survival with PCa (39,44,45). Like previous studies’ classification methods (46-48), PSA level >20 ng/mL was defined as a high-risk group that increased the probability of bone metastasis. Gleason grade’s predictive ability, the most common classification standard for histological grading of patients with PCa (49), was further confirmed in this study.Besides bone metastases, we also investigated liver metastasis, brain metastasis, and lung metastasis, even if patients diagnosed with these distant metastatic sites accounted for only a small portion of the entire cohort. In this study, approximately 80% of lung metastasis cases suffered from bone metastasis, and approximately 70% of cases with liver or brain metastases had simultaneous bone metastasis. This indicated that PCa cells had already metastasized to multiple organs when distant metastases were detected, consistent with the findings from several previous studies (33,50). This also indicated that patients with liver, brain, or lung metastases were more likely to have bone metastasis. Thus, these metastatic indicators were included in the predictive system to quantify their influence on bone metastasis. Eventually, nomogram 2 exhibited slightly stronger predictive power and better clinical performance, and therefore it might be a more informed choice to select nomogram 2 as the new model to predict the risk of bone metastasis in patients with PCa.Our nomograms were established based on enough clinicopathological characteristics convenient to obtain in clinical practice, which made it possible to predict the risk of bone metastasis by collecting the prevalent information even if the patients with PCa had not been found with distant metastasis at initial diagnosis. Compared with routine diagnostic imaging examinations, the novel predictive models reduce radiation exposure and mitigate the economic burden for patients. Moreover, through comparing our model with others in previous studies, some advantages were found. Compared with the nomogram constructed by Godtman et al. (17), our model showed better predictive ability with a higher AUC value (0.800 vs. 0.911). The accuracy of Zhang et al.’s model was also excellent (18), but our model was based on larger sample size and more clinicopathological information.However, several limitations of this study deserve consideration. First, this was a retrospective study with known inherent drawbacks. Although we tried our best to reduce selection bias, more well-designed prospective analyses are required in the future. Second, some genetic markers that might play an important role in predicting distant metastases were unable to be retrieved from the SEER database, and the construction of a complete predictive model containing both clinicopathological information and genetic markers will be the direction of our future efforts. Third, both the training and validation cohorts in this study were from the SEER dataset, and the overfit bias of the nomograms could have existed. Hence, validating the models using an independent external set with adequate sample size and abundant clinicopathological data will also be the subject of our future investigations.
Conclusions
In conclusion, we established the first practical model for predicting the risk of bone metastasis in patients with PCa based on clinicopathological characteristics extracted from a large population-based dataset. With accurate and clinically valuable predictions, patients can experience fewer unnecessary examinations and less medical costs, and physicians may improve individual treatment approaches and find more appropriate management strategies.The article’s supplementary files as
Authors: Silke Gillessen; Gerhardt Attard; Tomasz M Beer; Himisha Beltran; Alberto Bossi; Rob Bristow; Brett Carver; Daniel Castellano; Byung Ha Chung; Noel Clarke; Gedske Daugaard; Ian D Davis; Johann de Bono; Rodolfo Borges Dos Reis; Charles G Drake; Ros Eeles; Eleni Efstathiou; Christopher P Evans; Stefano Fanti; Felix Feng; Karim Fizazi; Mark Frydenberg; Martin Gleave; Susan Halabi; Axel Heidenreich; Celestia S Higano; Nicolas James; Philip Kantoff; Pirkko-Liisa Kellokumpu-Lehtinen; Raja B Khauli; Gero Kramer; Chris Logothetis; Fernando Maluf; Alicia K Morgans; Michael J Morris; Nicolas Mottet; Vedang Murthy; William Oh; Piet Ost; Anwar R Padhani; Chris Parker; Colin C Pritchard; Mack Roach; Mark A Rubin; Charles Ryan; Fred Saad; Oliver Sartor; Howard Scher; Avishay Sella; Neal Shore; Matthew Smith; Howard Soule; Cora N Sternberg; Hiroyoshi Suzuki; Christopher Sweeney; Matthew R Sydes; Ian Tannock; Bertrand Tombal; Riccardo Valdagni; Thomas Wiegel; Aurelius Omlin Journal: Eur Urol Date: 2017-06-24 Impact factor: 20.096
Authors: Gladell P Paner; Walter M Stadler; Donna E Hansel; Rodolfo Montironi; Daniel W Lin; Mahul B Amin Journal: Eur Urol Date: 2018-01-09 Impact factor: 20.096