Aditya V Karhade1, Michiel E R Bongers1, Olivier Q Groot1, Thomas D Cha2, Terence P Doorly3, Harold A Fogel2, Stuart H Hershman1, Daniel G Tobert2, Andrew J Schoenfeld4, James D Kang4, Mitchel B Harris1, Christopher M Bono1, Joseph H Schwab5. 1. Department of Orthopedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA. 2. Department of Orthopedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA; Department of Orthopedic Surgery, Newton Wellesley Hospital, Newton, MA, USA. 3. Department of Neurosurgery, North Shore Medical Center, Boston, MA, USA. 4. Department of Orthopedic Surgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA; Department of Orthopedic Surgery, Brigham and Women's Faulkner Hospital, Boston, MA, USA. 5. Department of Orthopedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA; Department of Orthopedic Surgery, Newton Wellesley Hospital, Newton, MA, USA. Electronic address: jhschwab@mgh.harvard.edu.
Abstract
BACKGROUND: Surgical site infections are a major driver of morbidity and increased costs in the postoperative period after spine surgery. Current tools for surveillance of these adverse events rely on prospective clinical tracking, manual retrospective chart review, or administrative procedural and diagnosis codes. PURPOSE: The purpose of this study was to develop natural language processing (NLP) algorithms for automated reporting of postoperative wound infection requiring reoperation after lumbar discectomy. PATIENT SAMPLE: Adult patients undergoing discectomy at two academic and three community medical centers between January 1, 2000 and July 31, 2019 for lumbar disc herniation. OUTCOME MEASURES: Reoperation for wound infection within 90 days after surgery METHODS: Free-text notes of patients who underwent surgery from January 1, 2000 to December 31, 2015 were used for algorithm training. Free-text notes of patients who underwent surgery after January 1, 2016 were used for algorithm testing. Manual chart review was used to label which patients had reoperation for wound infection. An extreme gradient-boosting NLP algorithm was developed to detect reoperation for postoperative wound infection. RESULTS: Overall, 5,860 patients were included in this study and 62 (1.1%) had a reoperation for wound infection. In patients who underwent surgery after January 1, 2016 (n=1,377), the NLP algorithm detected 15 of the 16 patients (sensitivity=0.94) who had reoperation for infection. In comparison, current procedural terminology and international classification of disease codes detected 12 of these 16 patients (sensitivity=0.75). At a threshold of 0.05, the NLP algorithm had positive predictive value of 0.83 and F1-score of 0.88. CONCLUSION: Temporal validation of the algorithm developed in this study demonstrates a proof-of-concept application of NLP for automated reporting of adverse events after spine surgery. Adapting this methodology for other procedures and outcomes in spine and orthopedics has the potential to dramatically improve and automatize quality and safety reporting.
BACKGROUND: Surgical site infections are a major driver of morbidity and increased costs in the postoperative period after spine surgery. Current tools for surveillance of these adverse events rely on prospective clinical tracking, manual retrospective chart review, or administrative procedural and diagnosis codes. PURPOSE: The purpose of this study was to develop natural language processing (NLP) algorithms for automated reporting of postoperative wound infection requiring reoperation after lumbar discectomy. PATIENT SAMPLE: Adult patients undergoing discectomy at two academic and three community medical centers between January 1, 2000 and July 31, 2019 for lumbar disc herniation. OUTCOME MEASURES: Reoperation for wound infection within 90 days after surgery METHODS: Free-text notes of patients who underwent surgery from January 1, 2000 to December 31, 2015 were used for algorithm training. Free-text notes of patients who underwent surgery after January 1, 2016 were used for algorithm testing. Manual chart review was used to label which patients had reoperation for wound infection. An extreme gradient-boosting NLP algorithm was developed to detect reoperation for postoperative wound infection. RESULTS: Overall, 5,860 patients were included in this study and 62 (1.1%) had a reoperation for wound infection. In patients who underwent surgery after January 1, 2016 (n=1,377), the NLP algorithm detected 15 of the 16 patients (sensitivity=0.94) who had reoperation for infection. In comparison, current procedural terminology and international classification of disease codes detected 12 of these 16 patients (sensitivity=0.75). At a threshold of 0.05, the NLP algorithm had positive predictive value of 0.83 and F1-score of 0.88. CONCLUSION: Temporal validation of the algorithm developed in this study demonstrates a proof-of-concept application of NLP for automated reporting of adverse events after spine surgery. Adapting this methodology for other procedures and outcomes in spine and orthopedics has the potential to dramatically improve and automatize quality and safety reporting.
Authors: Aditya V Karhade; Jacobien H F Oosterhoff; Olivier Q Groot; Nicole Agaronnik; Jeffrey Ehresman; Michiel E R Bongers; Ruurd L Jaarsma; Santosh I Poonnoose; Daniel M Sciubba; Daniel G Tobert; Job N Doornberg; Joseph H Schwab Journal: Clin Orthop Relat Res Date: 2022-04-12 Impact factor: 4.755
Authors: Grace Xiong; Nattaly E Greene; Harry M Lightsey; Alexander M Crawford; Brendan M Striano; Andrew K Simpson; Andrew J Schoenfeld Journal: Clin Orthop Relat Res Date: 2021-07-01 Impact factor: 4.755
Authors: G Michael Mallow; Zakariah K Siyaji; Fabio Galbusera; Alejandro A Espinoza-Orías; Morgan Giers; Hannah Lundberg; Christopher Ames; Jaro Karppinen; Philip K Louie; Frank M Phillips; Robin Pourzal; Joseph Schwab; Daniel M Sciubba; Jeffrey C Wang; Hans-Joachim Wilke; Frances M K Williams; Shoeb A Mohiuddin; Melvin C Makhni; Nicholas A Shepard; Howard S An; Dino Samartzis Journal: Global Spine J Date: 2020-11-28