Lindsay A Tetreault1, Pierre Côté2, Branko Kopjar3, Paul Arnold4, Michael G Fehlings5. 1. Toronto Western Hospital, University Health Network, University of Toronto, Rm 4F-412, 399 Bathurst St, Toronto, Ontario M5T2S8, Canada. 2. Faculty of Health Sciences, University of Ontario Institute of Technology (UOIT), 2000 Simcoe Street North, Oshawa, ON L1H 7K4, Canada; Centre for the Study of Disability Prevention and Rehabilitation, Canadian Memorial Chiropractic College (CMCC), University of Ontario Institute of Technology (UOIT), 2000 Simcoe Street North, Oshawa, ON L1H 7K4, Canada. 3. Department of Health Services, University of Washington, 4333 Brooklyn Ave. NE, Ste 1400/#315, Box #359455, Seattle, WA 98195, USA. 4. Department of Neurosurgery, University of Kansas, 3901 Rainbow Blvd, Kansas City, KS 66160, USA. 5. Toronto Western Hospital, University Health Network, University of Toronto, Rm 4F-412, 399 Bathurst St, Toronto, Ontario M5T2S8, Canada. Electronic address: Michael.Fehlings@uhn.on.ca.
Abstract
BACKGROUND CONTEXT: Clinical prediction rules are valuable tools in a surgical setting but should not be used to guide clinical practice until validated in other populations. PURPOSE: The objective of this study was to validate a clinical prediction rule developed to determine surgical outcome in patients with cervical spondylotic myelopathy (CSM). The study will also identify key clinical predictors of outcome at a global level. STUDY DESIGN/ SETTING: This is a prospective multicenter cohort study. PATIENT SAMPLE: Two-hundred seventy-eight and 479 surgical CSM patients enrolled in the AOSpine CSM-North American (CSM-NA) and CSM-International (CSM-I) studies, respectively. OUTCOME MEASURES: The outcome measure was a Modified Japanese Orthopedic Association (mJOA) Scale. METHODS: A clinical prediction model was built using data from 272 patients enrolled in the CSM-NA study. Bootstrapping was used for internal validation. The original model was externally validated using data on 471 patients participating in the CSM-I study. The predictive performance of the model was evaluated, including its discrimination, measured by area under the receiver-operating curve (AUC), and calibration, assessed by calibration slope, observed:expected ratios, and Hosmer-Lemeshow goodness-of-fit test. RESULTS: The modified original model consisted of six covariates: age (odds ratio [OR], 0.96), duration of symptoms (0.76), baseline severity score (1.21), psychiatric comorbidities (0.44), impairment of gait (2.48), and smoking status (0.50). The AUC for the original model was 0.77 (95% confidence interval [CI]: 0.71, 0.82) and across the bootstrap replicates was 0.77 (95% CI: 0.76, 0.77), reflecting good discrimination and internal validity. The model tested on the CSM-I dataset yielded an AUC of 0.74 (95% CI: 0.69, 0.79), a calibration slope of 0.75, and an insignificant Hosmer-Lemeshow test. The ORs generated for baseline mJOA (OR, 1.26), impairment of gait (2.67), age (0.97), and smoking (0.55) were very similar to the original values of 1.28, 2.39, and 0.97, respectively. Duration of symptoms (OR, 0.94) had a significantly different odds ratio than in the original model, but the direction of its relationship with outcome was the same. Psychiatric comorbidities was not a significant predictor at an international level, likely because of underreporting: only six patients outside of North American centers were diagnosed with depression or bipolar. CONCLUSIONS: The parameter estimates generated from the original analysis were internally valid. The original model was also externally valid. The most significant global predictors of surgical outcome were baseline myelopathy severity, age, smoking status and impaired gait.
BACKGROUND CONTEXT: Clinical prediction rules are valuable tools in a surgical setting but should not be used to guide clinical practice until validated in other populations. PURPOSE: The objective of this study was to validate a clinical prediction rule developed to determine surgical outcome in patients with cervical spondylotic myelopathy (CSM). The study will also identify key clinical predictors of outcome at a global level. STUDY DESIGN/ SETTING: This is a prospective multicenter cohort study. PATIENT SAMPLE: Two-hundred seventy-eight and 479 surgical CSM patients enrolled in the AOSpine CSM-North American (CSM-NA) and CSM-International (CSM-I) studies, respectively. OUTCOME MEASURES: The outcome measure was a Modified Japanese Orthopedic Association (mJOA) Scale. METHODS: A clinical prediction model was built using data from 272 patients enrolled in the CSM-NA study. Bootstrapping was used for internal validation. The original model was externally validated using data on 471 patients participating in the CSM-I study. The predictive performance of the model was evaluated, including its discrimination, measured by area under the receiver-operating curve (AUC), and calibration, assessed by calibration slope, observed:expected ratios, and Hosmer-Lemeshow goodness-of-fit test. RESULTS: The modified original model consisted of six covariates: age (odds ratio [OR], 0.96), duration of symptoms (0.76), baseline severity score (1.21), psychiatric comorbidities (0.44), impairment of gait (2.48), and smoking status (0.50). The AUC for the original model was 0.77 (95% confidence interval [CI]: 0.71, 0.82) and across the bootstrap replicates was 0.77 (95% CI: 0.76, 0.77), reflecting good discrimination and internal validity. The model tested on the CSM-I dataset yielded an AUC of 0.74 (95% CI: 0.69, 0.79), a calibration slope of 0.75, and an insignificant Hosmer-Lemeshow test. The ORs generated for baseline mJOA (OR, 1.26), impairment of gait (2.67), age (0.97), and smoking (0.55) were very similar to the original values of 1.28, 2.39, and 0.97, respectively. Duration of symptoms (OR, 0.94) had a significantly different odds ratio than in the original model, but the direction of its relationship with outcome was the same. Psychiatric comorbidities was not a significant predictor at an international level, likely because of underreporting: only six patients outside of North American centers were diagnosed with depression or bipolar. CONCLUSIONS: The parameter estimates generated from the original analysis were internally valid. The original model was also externally valid. The most significant global predictors of surgical outcome were baseline myelopathy severity, age, smoking status and impaired gait.
Authors: Ayesha Quddusi; Hubert A J Eversdijk; Anita M Klukowska; Marlies P de Wispelaere; Julius M Kernbach; Marc L Schröder; Victor E Staartjes Journal: Eur Spine J Date: 2019-10-22 Impact factor: 3.134
Authors: Ian F Caplan; Saurabh Sinha; Benjamin Osiemo; Scott D McClintock; James M Schuster; Harvey Smith; Gregory Glauser; Nikhil Sharma; Ali K Ozturk; Zarina S Ali; Neil R Malhotra Journal: Int J Spine Surg Date: 2020-04-30
Authors: Branko Kopjar; Parker E Bohm; Joshua H Arnold; Michael G Fehlings; Lindsay A Tetreault; Paul M Arnold Journal: Spine (Phila Pa 1976) Date: 2018-08 Impact factor: 3.241
Authors: Kevin R O'Neill; Michael G Fehlings; Thomas E Mroz; Zachary A Smith; Wellington K Hsu; Adam S Kanter; Michael P Steinmetz; Paul M Arnold; Praveen V Mummaneni; Dean Chou; Ahmad Nassr; Sheeraz A Qureshi; Samuel K Cho; Evan O Baird; Justin S Smith; Christopher Shaffrey; Chadi A Tannoury; Tony Tannoury; Ziya L Gokaslan; Jeffrey L Gum; Robert A Hart; Robert E Isaacs; Rick C Sasso; David B Bumpass; Mohamad Bydon; Mark Corriveau; Anthony F De Giacomo; Adeeb Derakhshan; Bruce C Jobse; Daniel Lubelski; Sungho Lee; Eric M Massicotte; Jonathan R Pace; Gabriel A Smith; Khoi D Than; K Daniel Riew Journal: Global Spine J Date: 2017-04-01
Authors: Narihito Nagoshi; Michael G Fehlings; Hiroaki Nakashima; Lindsay Tetreault; Jeffrey L Gum; Zachary A Smith; Wellington K Hsu; Chadi A Tannoury; Tony Tannoury; Vincent C Traynelis; Paul M Arnold; Thomas E Mroz; Ziya L Gokaslan; Mohamad Bydon; Anthony F De Giacomo; Bruce C Jobse; Eric M Massicotte; K Daniel Riew Journal: Global Spine J Date: 2017-04-01