| Literature DB >> 35813248 |
Jan Chandra Engel1, Thorgerdur Palsdottir2, Donna Ankerst3, Sebastiaan Remmers4, Ashkan Mortezavi2,5, Venkatesh Chellappa2, Lars Egevad6, Henrik Grönberg2, Martin Eklund2, Tobias Nordström1,2.
Abstract
Background: External validation of risk calculators (RCs) is necessary to determine their clinical applicability beyond the setting in which these were developed. Objective: To assess the performance of the Rotterdam Prostate Cancer RC (RPCRC) and the Prostate Biopsy Collaborative Group RC (PBCG-RC). Design setting and participants: We used data from the prospective, population-based STHLM3 screening study, performed in 2012-2015. Participants with prostate-specific antigen ≥3 ng/ml who underwent systematic prostate biopsies were included. Outcome measurements and statistical analysis: Probabilities for clinically significant prostate cancer (csPCa), defined as International Society of Urological Pathology grade ≥2, were calculated for each participant. External validity was assessed by calibration, discrimination, and clinical usefulness for both original and recalibrated models. Results and limitations: Out of 5841 men, 1054 (18%) had csPCa. Distribution of risk predictions differed between RCs; median risks for csPCa using the RPCRC and PBCG-RC were 3.3% (interquartile range [IQR] 2.1-7.1%) and 20% (IQR 15-28%), respectively. The correlation between RC risk estimates on individual level was moderate (Spearman's r = 0.55). Using the RPCRC's recommended risk threshold of ≥4% for finding csPCa, 36% of participants would get concordant biopsy recommendations. At 10% risk cut-off, RCs agreed in 23% of cases. Both RCs showed good discrimination, with areas under the curves for the RPCRC of 0.74 (95% confidence interval [CI] 0.72-0.76) and the PBCG-RC of 0.70 (95% CI 0.68-0.72). Calibration was adequate using the PBCG-RC (calibration slope: 1.13 [95% CI 1.03-1.23]), but the RPCRC underestimated the risk of csPCa (calibration slope: 0.73 [0.68-0.79]). The PBCG-RC showed a net benefit in a decision curve analysis, whereas the RPCRC showed no net benefit at clinically relevant risk threshold levels. Recalibration improved clinical benefit, and differences between RCs decreased. Conclusions: Assessment of calibration is essential to ensure the clinical value of risk prediction tools. The PBCG-RC provided clinical benefit in its current version online. On the contrary, the RPCRC cannot be recommended in this setting. Patient summary: Predicting the probability of finding prostate cancer on biopsy differed between two assessed risk calculators. After recalibration, the agreement of the models improved, and both were shown to be clinically useful.Entities:
Keywords: External validation study; Prostate cancer; Prostate cancer screening; Recalibration of risk prediction tools; Risk calculators
Year: 2022 PMID: 35813248 PMCID: PMC9257644 DOI: 10.1016/j.euros.2022.04.010
Source DB: PubMed Journal: Eur Urol Open Sci ISSN: 2666-1683
Predictors incorporated in risk calculators and risk distribution for prostate cancer
| RPCRC | PBCG-RC | |
|---|---|---|
| Age | – | × |
| PSA | × | × |
| DRE | × | × |
| Prostate volume | × | – |
| Previous biopsy | × | × |
| Family history | – | × |
| Race | – | × |
| Median, % (IQR) | 3.3 (2.1–7.1) | 20 (15–28) |
| Median, % (IQR) | 13 (11–17) | 14 (9–22) |
csPCa = clinically significant prostate cancer; DRE = digital rectal examination; IQR = interquartile range; PBCG-RC = Prostate Biopsy Collaborative Group Risk Calculator; PSA = prostate-specific antigen; Race = African ancestry/other; RC = risk calculator; RPCRC = Rotterdam Prostate Cancer Risk Calculator.
Available in our data.
Population characteristics
| All | Benign biopsy | ISUP grade 1 | csPCa | |
|---|---|---|---|---|
| ( | ( | ( | ( | |
| 64.7 (59.8–67.6) | 64.5 (59.7–67.6) | 64.6 (59.3–67.5) | 65.3 (60.8–67.7) | |
| 4.2 (3.4–5.7) | 4.0 (3.4–5.4) | 4.1 (3.4–5.4) | 5.0 (3.8–8.4) | |
| | 571 (10) | 216 (6) | 101 (8) | 254 (24) |
| | 5270 (90) | 3378 (94) | 1092 (92) | 800 (76) |
| 42 (33–56) | 45 (36–60) | 40.5 (32–53) | 36 (28–45) | |
| 458 (7.8) | 372 (10) | 59 (4.9) | 27 (2.6) | |
| 810 (14) | 416 (12) | 212 (18) | 182 (17) | |
csPCa = Clinically significant prostate cancer; ISUP grade ≥2; DRE = digital rectal examination; IQR = interquartile range; ISUP = International Society of Urological Pathology; PSA = prostate-specific antigen.
First-degree relative diagnosed with prostate cancer.
Fig. 1(A) Combined calibration (observed probability vs predicted probability) and density plot for risk prediction from the PBCG-RC (purple) and RPCRC (orange). The black line represents perfect calibration. The shaded areas show the distribution of predicted risk in each risk calculator. (B) Decision curve analyses demonstrating the net benefit for predicting csPCa on biopsy. Net benefits from biopsy-all (grey line) and biopsy-none (horizontal black line) strategies are shown. csPCa = clinically significant prostate cancer; PBCG-RC = Prostate Biopsy Collaborative Group Risk Calculator; RPCRC = Rotterdam Prostate Cancer Risk Calculator.
Fig. 2(A) Combined calibration (observed probability vs predicted probability) and density plot for the recalibrated PBCG-RC and recalibrated RPCRC. (B) Decision curve analyses demonstrating the net benefit for predicting csPCa on biopsy. Net benefits from biopsy-all (grey line) and biopsy-none (horizontal black line) strategies are shown. csPCa = clinically significant prostate cancer; PBCG-RC = Prostate Biopsy Collaborative Group Risk Calculator; RPCRC = Rotterdam Prostate Cancer Risk Calculator.
Clinical effects of using the RPCRC and the PBCG-RC standardised per 1000 biopsied men
| Avoided biopsies (%) | Biopsied men, | Avoided ISUP grade 1, | Missed csPCa, | Risk threshold (%) | |
|---|---|---|---|---|---|
| Biopsy all men with PSA ≥3 ng/ml | 0 | 1000 | 0/204 (0) | 0/180 (0) | – |
| RPCRC | 25 | 754 | 43 (21) | 15 (9) | 2.1 |
| 33 | 685 | 61 (30) | 22 (12) | 2.4 | |
| 50 | 494 | 99 (48) | 46 (25) | 3.3 | |
| PBCG-RC | 25 | 784 | 39 (19) | 18 (10) | 15 |
| 33 | 685 | 61 (30) | 30 (17) | 17 | |
| 50 | 520 | 94 (46) | 50 (28) | 20 | |
| Recalibrated RPCRC | 25 | 738 | 45 (22) | 18 (10) | 11 |
| 33 | 677 | 61 (30) | 24 (13) | 12 | |
| 50 | 507 | 96 (47) | 45 (25) | 13 | |
| Recalibrated PBCG-RC | 25 | 766 | 43 (21) | 20 (11) | 9 |
| 33 | 663 | 65 (32) | 33 (18) | 11 | |
| 50 | 510 | 96 (47) | 52 (29) | 14 |
csPCa = clinically significant prostate cancer, ISUP grade ≥2; ISUP = International Society of Urological Pathology; PBCG-RC = Prostate Biopsy Collaborative Group Risk Calculator; PSA = prostate-specific antigen; RPCRC = Rotterdam Prostate Cancer Risk Calculator.
Risk threshold of finding clinically significant prostate cancer on biopsy, that is, cut-off risk score in the RPCRC and the PBCG-RC for biopsy recommendation.