Andreas N Strobl1, Ian M Thompson2, Andrew J Vickers3, Donna P Ankerst4. 1. Department of Mathematics, Technical University Munich, Munich, Germany. Electronic address: a.strobl@tum.de. 2. Department of Urology, University of Texas Health Science Center at San Antonio, San Antonio, Texas. 3. Memorial Sloan Kettering Cancer Center, New York, New York. 4. Department of Mathematics, Technical University Munich, Munich, Germany; Department of Urology, University of Texas Health Science Center at San Antonio, San Antonio, Texas; Department of Epidemiology and Biostatistics, University of Texas Health Science Center at San Antonio, San Antonio, Texas.
Abstract
PURPOSE: We evaluate whether annual updating of the PCPT Risk Calculator would improve institutional validation compared to static use of the PCPT Risk Calculator alone. MATERIALS AND METHODS: Data from 5 international cohorts including SABOR, Cleveland Clinic, ProtecT, Tyrol and Durham VA, comprising 18,400 biopsies, were used to evaluate an institution specific annual recalibration of the PCPT Risk Calculator. Using all prior years as a training set and the current year as the test set, annual recalibrations of the PCPT Risk Calculator were compared to static use of the PCPT Risk Calculator in terms of AUC and the Hosmer-Lemeshow goodness of fit statistic. RESULTS: For predicting high grade disease the median AUC (higher is better) of the recalibrated PCPT Risk Calculator (static PCPT Risk Calculator) across all test years for the 5 cohorts was 67.3 (67.5), 65.0 (60.4), 73.4 (73.4), 73.9 (74.1) and 69.6 (67.2), respectively, and median Hosmer-Lemeshow goodness of fit statistics indicated better fit for recalibration compared to the static PCPT Risk Calculator for Cleveland Clinic, ProtecT and the Durham VA but not for SABOR and Tyrol. For predicting overall cancer median AUC was 63.5 (62.7), 61.0 (57.3), 62.1 (62.5), 66.9 (67.3) and 68.5 (65.5), respectively, and median Hosmer-Lemeshow goodness of fit statistics indicated a better fit for recalibration in all cohorts except for Tyrol. CONCLUSIONS: A simple method has been provided to tailor the PCPT Risk Calculator to individual hospitals to optimize its accuracy for the patient population at hand.
PURPOSE: We evaluate whether annual updating of the PCPT Risk Calculator would improve institutional validation compared to static use of the PCPT Risk Calculator alone. MATERIALS AND METHODS: Data from 5 international cohorts including SABOR, Cleveland Clinic, ProtecT, Tyrol and Durham VA, comprising 18,400 biopsies, were used to evaluate an institution specific annual recalibration of the PCPT Risk Calculator. Using all prior years as a training set and the current year as the test set, annual recalibrations of the PCPT Risk Calculator were compared to static use of the PCPT Risk Calculator in terms of AUC and the Hosmer-Lemeshow goodness of fit statistic. RESULTS: For predicting high grade disease the median AUC (higher is better) of the recalibrated PCPT Risk Calculator (static PCPT Risk Calculator) across all test years for the 5 cohorts was 67.3 (67.5), 65.0 (60.4), 73.4 (73.4), 73.9 (74.1) and 69.6 (67.2), respectively, and median Hosmer-Lemeshow goodness of fit statistics indicated better fit for recalibration compared to the static PCPT Risk Calculator for Cleveland Clinic, ProtecT and the Durham VA but not for SABOR and Tyrol. For predicting overall cancer median AUC was 63.5 (62.7), 61.0 (57.3), 62.1 (62.5), 66.9 (67.3) and 68.5 (65.5), respectively, and median Hosmer-Lemeshow goodness of fit statistics indicated a better fit for recalibration in all cohorts except for Tyrol. CONCLUSIONS: A simple method has been provided to tailor the PCPT Risk Calculator to individual hospitals to optimize its accuracy for the patient population at hand.
Authors: Ian M Thompson; Donna Pauler Ankerst; Chen Chi; Phyllis J Goodman; Catherine M Tangen; M Scott Lucia; Ziding Feng; Howard L Parnes; Charles A Coltman Journal: J Natl Cancer Inst Date: 2006-04-19 Impact factor: 13.506
Authors: Donna P Ankerst; Josef Hoefler; Sebastian Bock; Phyllis J Goodman; Andrew Vickers; Javier Hernandez; Lori J Sokoll; Martin G Sanda; John T Wei; Robin J Leach; Ian M Thompson Journal: Urology Date: 2014-06 Impact factor: 2.649
Authors: Andrew J Vickers; Angel M Cronin; Monique J Roobol; Jonas Hugosson; J Stephen Jones; Michael W Kattan; Eric Klein; Freddie Hamdy; David Neal; Jenny Donovan; Dipen J Parekh; Donna Ankerst; George Bartsch; Helmut Klocker; Wolfgang Horninger; Amine Benchikh; Gilles Salama; Arnauld Villers; Steve J Freedland; Daniel M Moreira; Fritz H Schröder; Hans Lilja Journal: Clin Cancer Res Date: 2010-08-24 Impact factor: 12.531
Authors: Tessa S S Genders; Ewout W Steyerberg; Hatem Alkadhi; Sebastian Leschka; Lotus Desbiolles; Koen Nieman; Tjebbe W Galema; W Bob Meijboom; Nico R Mollet; Pim J de Feyter; Filippo Cademartiri; Erica Maffei; Marc Dewey; Elke Zimmermann; Michael Laule; Francesca Pugliese; Rossella Barbagallo; Valentin Sinitsyn; Jan Bogaert; Kaatje Goetschalckx; U Joseph Schoepf; Garrett W Rowe; Joanne D Schuijf; Jeroen J Bax; Fleur R de Graaf; Juhani Knuuti; Sami Kajander; Carlos A G van Mieghem; Matthijs F L Meijs; Maarten J Cramer; Deepa Gopalan; Gudrun Feuchtner; Guy Friedrich; Gabriel P Krestin; M G Myriam Hunink Journal: Eur Heart J Date: 2011-03-02 Impact factor: 29.983
Authors: P Schuetz; M Koller; M Christ-Crain; E Steyerberg; D Stolz; C Müller; H C Bucher; R Bingisser; M Tamm; B Müller Journal: Epidemiol Infect Date: 2008-02-27 Impact factor: 2.451
Authors: Lei Chen; Andrew M Tonkin; Lynelle Moon; Paul Mitchell; Annette Dobson; Graham Giles; Michael Hobbs; Patrick J Phillips; Jonathan E Shaw; David Simmons; Leon A Simons; Anthony P Fitzgerald; Guy De Backer; Dirk De Bacquer Journal: Eur J Cardiovasc Prev Rehabil Date: 2009-10
Authors: Robert K Nam; Raj Satkunavisam; Joseph L Chin; Jonathan Izawa; John Trachtenberg; Ricardo Rendon; David Bell; Rajiv Singal; Christopher Sherman; Linda Sugar; Kevin Chagin; Michael W Kattan Journal: Can Urol Assoc J Date: 2017-12-01 Impact factor: 1.862
Authors: Donna P Ankerst; Jing Xia; Ian M Thompson; Josef Hoefler; Lisa F Newcomb; James D Brooks; Peter R Carroll; William J Ellis; Martin E Gleave; Raymond S Lance; Peter S Nelson; Andrew A Wagner; John T Wei; Ruth Etzioni; Daniel W Lin Journal: Eur Urol Date: 2015-03-25 Impact factor: 20.096
Authors: Amirhossein Jalali; Robert W Foley; Robert M Maweni; Keefe Murphy; Dara J Lundon; Thomas Lynch; Richard Power; Frank O'Brien; Kieran J O'Malley; David J Galvin; Garrett C Durkan; T Brendan Murphy; R William Watson Journal: BMC Med Inform Decis Mak Date: 2020-07-03 Impact factor: 2.796
Authors: Johanna Tolksdorf; Michael W Kattan; Stephen A Boorjian; Stephen J Freedland; Karim Saba; Cedric Poyet; Lourdes Guerrios; Amanda De Hoedt; Michael A Liss; Robin J Leach; Javier Hernandez; Emily Vertosick; Andrew J Vickers; Donna P Ankerst Journal: BMC Med Res Methodol Date: 2019-10-15 Impact factor: 4.615