Ayesha Quddusi1, Hubert A J Eversdijk2, Anita M Klukowska2,3, Marlies P de Wispelaere4, Julius M Kernbach5, Marc L Schröder2, Victor E Staartjes6,7,8. 1. Center for Neuroscience, Queens University, Kingston, ON, Canada. 2. Department of Neurosurgery, Bergman Clinics, Naarden, Rijksweg 69, 1411 GE, Naarden, Amsterdam, The Netherlands. 3. School of Medicine, University of Nottingham, Nottingham, UK. 4. Department of Clinical Informatics, Bergman Clinics, Amsterdam, The Netherlands. 5. Department of Neurosurgery, Faculty of Medicine, RWTH Aachen University, Aachen, Germany. 6. Department of Neurosurgery, Bergman Clinics, Naarden, Rijksweg 69, 1411 GE, Naarden, Amsterdam, The Netherlands. victor.staartjes@gmail.com. 7. Amsterdam UMC, Neurosurgery, Amsterdam Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands. victor.staartjes@gmail.com. 8. Machine Intelligence in Clinical Neuroscience Lab, Department of Neurosurgery, University Hospital Zurich, Clinical Neuroscience Centre, University of Zurich, Zurich, Switzerland. victor.staartjes@gmail.com.
Abstract
OBJECTIVE: Patient-reported outcome measures following elective lumbar fusion surgery demonstrate major heterogeneity. Individualized prediction tools can provide valuable insights for shared decision-making. We externally validated the spine surgical care and outcomes assessment programme/comparative effectiveness translational network (SCOAP-CERTAIN) model for prediction of 12-month minimum clinically important difference in Oswestry Disability Index (ODI) and in numeric rating scales for back (NRS-BP) and leg pain (NRS-LP) after elective lumbar fusion. METHODS: Data from a prospective registry were obtained. We calculated the area under the curve (AUC), calibration slope and intercept, and Hosmer-Lemeshow values to estimate discrimination and calibration of the models. RESULTS: We included 100 patients, with average age of 50.4 ± 11.4 years. For 12-month ODI, AUC was 0.71 while the calibration intercept and slope were 1.08 and 0.95, respectively. For NRS-BP, AUC was 0.72, with a calibration intercept of 1.02, and slope of 0.74. For NRS-LP, AUC was 0.83, with a calibration intercept of 1.08, and slope of 0.95. Sensitivity ranged from 0.64 to 1.00, while specificity ranged from 0.38 to 0.65. A lack of fit was found for all three models based on Hosmer-Lemeshow testing. CONCLUSIONS: The SCOAP-CERTAIN tool can accurately predict which patients will achieve favourable outcomes. However, the predicted probabilities-which are the most valuable in clinical practice-reported by the tool do not correspond well to the true probability of a favourable outcome. We suggest that any prediction tool should first be externally validated before it is applied in routine clinical practice. These slides can be retrieved under Electronic Supplementary Material.
OBJECTIVE:Patient-reported outcome measures following elective lumbar fusion surgery demonstrate major heterogeneity. Individualized prediction tools can provide valuable insights for shared decision-making. We externally validated the spine surgical care and outcomes assessment programme/comparative effectiveness translational network (SCOAP-CERTAIN) model for prediction of 12-month minimum clinically important difference in Oswestry Disability Index (ODI) and in numeric rating scales for back (NRS-BP) and leg pain (NRS-LP) after elective lumbar fusion. METHODS: Data from a prospective registry were obtained. We calculated the area under the curve (AUC), calibration slope and intercept, and Hosmer-Lemeshow values to estimate discrimination and calibration of the models. RESULTS: We included 100 patients, with average age of 50.4 ± 11.4 years. For 12-month ODI, AUC was 0.71 while the calibration intercept and slope were 1.08 and 0.95, respectively. For NRS-BP, AUC was 0.72, with a calibration intercept of 1.02, and slope of 0.74. For NRS-LP, AUC was 0.83, with a calibration intercept of 1.08, and slope of 0.95. Sensitivity ranged from 0.64 to 1.00, while specificity ranged from 0.38 to 0.65. A lack of fit was found for all three models based on Hosmer-Lemeshow testing. CONCLUSIONS: The SCOAP-CERTAIN tool can accurately predict which patients will achieve favourable outcomes. However, the predicted probabilities-which are the most valuable in clinical practice-reported by the tool do not correspond well to the true probability of a favourable outcome. We suggest that any prediction tool should first be externally validated before it is applied in routine clinical practice. These slides can be retrieved under Electronic Supplementary Material.
Authors: Sara Khor; Danielle Lavallee; Amy M Cizik; Carlo Bellabarba; Jens R Chapman; Christopher R Howe; Dawei Lu; A Alex Mohit; Rod J Oskouian; Jeffrey R Roh; Neal Shonnard; Armagan Dagal; David R Flum Journal: JAMA Surg Date: 2018-07-01 Impact factor: 14.766
Authors: Asdrubal Falavigna; Diego Cassol Dozza; Alisson R Teles; Chung Chek Wong; Giuseppe Barbagallo; Darrel Brodke; Abdulaziz Al-Mutair; Zoher Ghogawala; K Daniel Riew Journal: World Neurosurg Date: 2017-09-08 Impact factor: 2.104
Authors: Christiaan H B van Niftrik; Frank van der Wouden; Victor E Staartjes; Jorn Fierstra; Martin N Stienen; Kevin Akeret; Martina Sebök; Tommaso Fedele; Johannes Sarnthein; Oliver Bozinov; Niklaus Krayenbühl; Luca Regli; Carlo Serra Journal: Neurosurgery Date: 2019-10-01 Impact factor: 4.654
Authors: Ewout W Steyerberg; Andrew J Vickers; Nancy R Cook; Thomas Gerds; Mithat Gonen; Nancy Obuchowski; Michael J Pencina; Michael W Kattan Journal: Epidemiology Date: 2010-01 Impact factor: 4.822
Authors: D Müller; D Haschtmann; T F Fekete; F Kleinstück; R Reitmeir; M Loibl; D O'Riordan; F Porchet; D Jeszenszky; A F Mannion Journal: Eur Spine J Date: 2022-07-14 Impact factor: 2.721
Authors: Katherine E Pierce; Bhaveen H Kapadia; Sara Naessig; Waleed Ahmad; Shaleen Vira; Carl Paulino; Michael Gerling; Peter G Passias Journal: Int J Spine Surg Date: 2021-12
Authors: Daniel Lubelski; Andrew Hersh; Tej D Azad; Jeff Ehresman; Zachary Pennington; Kurt Lehner; Daniel M Sciubba Journal: Global Spine J Date: 2021-04
Authors: Victor E Staartjes; Vittorio Stumpo; Julius M Kernbach; Anita M Klukowska; Pravesh S Gadjradj; Marc L Schröder; Anand Veeravagu; Martin N Stienen; Christiaan H B van Niftrik; Carlo Serra; Luca Regli Journal: Acta Neurochir (Wien) Date: 2020-08-18 Impact factor: 2.216