Lauren M Swany1, A Noelle Larson2, Todd A Milbrandt3, James O Sanders4, Kevin M Neal5, Laurel C Blakemore6, Peter O Newton7, Joshua M Pahys8, Patrick J Cahill9, Ahmet Alanay10. 1. Mayo Clinic Alix School of Medicine, Rochester, MN, USA. 2. Department of Orthopedic Surgery, Mayo Clinic, 200 1st St SW, Rochester, MN, USA. larson.noelle@mayo.edu. 3. Department of Orthopedic Surgery, Mayo Clinic, 200 1st St SW, Rochester, MN, USA. 4. Department of Orthopedic Surgery, University of North Carolina, Chapel Hill, NC, USA. 5. Department of Orthopedic Surgery, Nemours Children's Specialty Care, Jacksonville, FL, USA. 6. Pediatric Specialists of Virginia, Fairfax, VA, USA. 7. Department of Orthopedics and Scoliosis, Rady Children's Hospital, San Diego, CA, USA. 8. Department of Orthopedic Surgery, Shriners Hospitals for Children, Philadelphia, PA, USA. 9. Department of Orthopedics, The Children's Hospital of Philadelphia, Philadelphia, PA, USA. 10. Department of Orthopedics and Traumatology, Acibadem Mehmet Ali Aydinlar University, Istanbul, Turkey.
Abstract
PURPOSE: Pediatric orthopedic surgeons must accurately assess the skeletal stage of adolescent idiopathic scoliosis (AIS) patients for selection and timing of optimal treatment. Successful treatment using vertebral growth modulation is highly dependent on skeletal growth remaining. We sought to evaluate the current-state use of the Sanders Skeletal Maturity System (SSMS) in regard to precision and accuracy. We hypothesized that pediatric orthopedic surgeons currently use SSMS with moderate precision and accuracy. METHODS: Eight practicing pediatric orthopedic surgeons who perform vertebral body tethering surgery without specific training in SSMS were asked to assign the SSMS stage for 34 de-identified hand radiographs from AIS patients. Precision was evaluated as inter-rater reliability, using both Krippendorff's α and Weighted Cohen's kappa statistics, and as intra-rater reliability, using only Weighted Cohen's kappa statistics. Surgeon accuracy was evaluated using Weighted Cohen's kappa statistics with comparison of surveyed surgeons' responses to the gold standard rating. RESULTS: Inter-rater reliability across the surveyed surgeons indicated moderate to substantial agreement using both statistical methods (α = 0.766, κ = 0.627) with the majority of discord occurring when assigning SSMS stages 2 through 4. The surveyed surgeons displayed substantial accuracy when compared to the gold standard (κ = 0.627) with the majority of inaccuracy involving the identification of stage 3B. When re-surveyed, the surgeons showed substantial intra-rater reliability (κ = 0.71) with increased inconsistencies when deciding between SSMS stage 3A and stage 3B. CONCLUSION: The current-state use of SSMS across pediatric orthopedic surgeons for evaluation of AIS patients displays adequate but imperfect precision and accuracy with difficulties delineating SSMS stages 2 through 4, which correlate with adolescent growth periods germane to scoliosis growth modulation surgery. Centralized assessment of hand-bone age may help ensure standardized reporting for non-fusion scoliosis research.
PURPOSE: Pediatric orthopedic surgeons must accurately assess the skeletal stage of adolescent idiopathic scoliosis (AIS) patients for selection and timing of optimal treatment. Successful treatment using vertebral growth modulation is highly dependent on skeletal growth remaining. We sought to evaluate the current-state use of the Sanders Skeletal Maturity System (SSMS) in regard to precision and accuracy. We hypothesized that pediatric orthopedic surgeons currently use SSMS with moderate precision and accuracy. METHODS: Eight practicing pediatric orthopedic surgeons who perform vertebral body tethering surgery without specific training in SSMS were asked to assign the SSMS stage for 34 de-identified hand radiographs from AIS patients. Precision was evaluated as inter-rater reliability, using both Krippendorff's α and Weighted Cohen's kappa statistics, and as intra-rater reliability, using only Weighted Cohen's kappa statistics. Surgeon accuracy was evaluated using Weighted Cohen's kappa statistics with comparison of surveyed surgeons' responses to the gold standard rating. RESULTS: Inter-rater reliability across the surveyed surgeons indicated moderate to substantial agreement using both statistical methods (α = 0.766, κ = 0.627) with the majority of discord occurring when assigning SSMS stages 2 through 4. The surveyed surgeons displayed substantial accuracy when compared to the gold standard (κ = 0.627) with the majority of inaccuracy involving the identification of stage 3B. When re-surveyed, the surgeons showed substantial intra-rater reliability (κ = 0.71) with increased inconsistencies when deciding between SSMS stage 3A and stage 3B. CONCLUSION: The current-state use of SSMS across pediatric orthopedic surgeons for evaluation of AIS patients displays adequate but imperfect precision and accuracy with difficulties delineating SSMS stages 2 through 4, which correlate with adolescent growth periods germane to scoliosis growth modulation surgery. Centralized assessment of hand-bone age may help ensure standardized reporting for non-fusion scoliosis research.
Authors: Daniel G Hoernschemeyer; Melanie E Boeyer; Madeline E Robertson; Christopher M Loftis; John R Worley; Nicole M Tweedy; Sumit U Gupta; Dana L Duren; Christina M Holzhauser; Venkataraman M Ramachandran Journal: J Bone Joint Surg Am Date: 2020-07-01 Impact factor: 5.284
Authors: P N Soucacos; K Zacharis; J Gelalis; K Soultanis; N Kalos; A Beris; T Xenakis; E O Johnson Journal: Eur Spine J Date: 1998 Impact factor: 3.134
Authors: James O Sanders; Joseph G Khoury; Shyam Kishan; Richard H Browne; James F Mooney; Kali D Arnold; Sharon J McConnell; Jeanne A Bauman; David N Finegold Journal: J Bone Joint Surg Am Date: 2008-03 Impact factor: 5.284
Authors: Peter O Newton; Carrie E Bartley; Tracey P Bastrom; Dylan G Kluck; Wataru Saito; Burt Yaszay Journal: J Bone Joint Surg Am Date: 2020-05-06 Impact factor: 5.284
Authors: James O Sanders; Xing Qiu; Xiang Lu; Dana L Duren; Raymond W Liu; Debbie Dang; Mariano E Menendez; Sarah D Hans; David R Weber; Daniel R Cooperman Journal: Sci Rep Date: 2017-12-01 Impact factor: 4.379