Vikas Kumar1, Christopher Roche2, Steven Overman1, Ryan Simovitch3, Pierre-Henri Flurin4, Thomas Wright5, Joseph Zuckerman6, Howard Routman7, Ankur Teredesai1. 1. KenSci, Seattle, WA, USA. 2. Exactech, Gainesville, FL, USA. Electronic address: Chris.Roche@exac.com. 3. Hospital for Special Surgery Florida, West Palm Beach, FL, USA. 4. Bordeaux-Merignac Sport Clinic, Merignac, France. 5. Department of Orthopaedic Surgery, University of Florida, Gainesville, FL, USA. 6. Department of Orthopedic Surgery, NYU Langone Orthopedic Hospital, New York, NY, USA. 7. Atlantis Orthopedics, Palm Beach Gardens, FL, USA.
Abstract
BACKGROUND: A machine learning analysis was conducted on 5774 shoulder arthroplasty patients to create predictive models for multiple clinical outcome measures after anatomic total shoulder arthroplasty (aTSA) and reverse total shoulder arthroplasty (rTSA). The goal of this study was to compare the accuracy associated with a full-feature set predictive model (ie, full model, comprising 291 parameters) and a minimal-feature set model (ie, abbreviated model, comprising 19 input parameters) to predict clinical outcomes to assess the efficacy of using a minimal feature set of inputs as a shoulder arthroplasty clinical decision-support tool. METHODS: Clinical data from 2153 primary aTSA patients and 3621 primary rTSA patients were analyzed using the XGBoost machine learning technique to create and test predictive models for multiple outcome measures at different postoperative time points via the full and abbreviated models. Mean absolute errors (MAEs) quantified the difference between actual and predicted outcomes, and each model also predicted whether a patient would experience clinical improvement greater than the patient satisfaction anchor-based thresholds of the minimal clinically important difference and substantial clinical benefit for each outcome measure at 2-3 years after surgery. RESULTS: Across all postoperative time points analyzed, the full and abbreviated models had similar MAEs for the American Shoulder and Elbow Surgeons score (±11.7 with full model vs. ±12.0 with abbreviated model), Constant score (±8.9 vs. ±9.8), Global Shoulder Function score (±1.4 vs. ±1.5), visual analog scale pain score (±1.3 vs. ±1.4), active abduction (±20.4° vs. ±21.8°), forward elevation (±17.6° vs. ±19.2°), and external rotation (±12.2° vs. ±12.6°). Marginal improvements in MAEs were observed for each outcome measure prediction when the abbreviated model was supplemented with data on implant size and/or type and measurements of native glenoid anatomy. The full and abbreviated models each effectively risk stratified patients using only preoperative data by accurately identifying patients with improvement greater than the minimal clinically important difference and substantial clinical benefit thresholds. DISCUSSION: Our study showed that the full and abbreviated machine learning models achieved similar accuracy in predicting clinical outcomes after aTSA and rTSA at multiple postoperative time points. These promising results demonstrate an efficient utilization of machine learning algorithms to predict clinical outcomes. Our findings using a minimal feature set of only 19 preoperative inputs suggest that this tool may be easily used during a surgical consultation to improve decision making related to shoulder arthroplasty.
BACKGROUND: A machine learning analysis was conducted on 5774 shoulder arthroplasty patients to create predictive models for multiple clinical outcome measures after anatomic total shoulder arthroplasty (aTSA) and reverse total shoulder arthroplasty (rTSA). The goal of this study was to compare the accuracy associated with a full-feature set predictive model (ie, full model, comprising 291 parameters) and a minimal-feature set model (ie, abbreviated model, comprising 19 input parameters) to predict clinical outcomes to assess the efficacy of using a minimal feature set of inputs as a shoulder arthroplasty clinical decision-support tool. METHODS: Clinical data from 2153 primary aTSA patients and 3621 primary rTSA patients were analyzed using the XGBoost machine learning technique to create and test predictive models for multiple outcome measures at different postoperative time points via the full and abbreviated models. Mean absolute errors (MAEs) quantified the difference between actual and predicted outcomes, and each model also predicted whether a patient would experience clinical improvement greater than the patient satisfaction anchor-based thresholds of the minimal clinically important difference and substantial clinical benefit for each outcome measure at 2-3 years after surgery. RESULTS: Across all postoperative time points analyzed, the full and abbreviated models had similar MAEs for the American Shoulder and Elbow Surgeons score (±11.7 with full model vs. ±12.0 with abbreviated model), Constant score (±8.9 vs. ±9.8), Global Shoulder Function score (±1.4 vs. ±1.5), visual analog scale pain score (±1.3 vs. ±1.4), active abduction (±20.4° vs. ±21.8°), forward elevation (±17.6° vs. ±19.2°), and external rotation (±12.2° vs. ±12.6°). Marginal improvements in MAEs were observed for each outcome measure prediction when the abbreviated model was supplemented with data on implant size and/or type and measurements of native glenoid anatomy. The full and abbreviated models each effectively risk stratified patients using only preoperative data by accurately identifying patients with improvement greater than the minimal clinically important difference and substantial clinical benefit thresholds. DISCUSSION: Our study showed that the full and abbreviated machine learning models achieved similar accuracy in predicting clinical outcomes after aTSA and rTSA at multiple postoperative time points. These promising results demonstrate an efficient utilization of machine learning algorithms to predict clinical outcomes. Our findings using a minimal feature set of only 19 preoperative inputs suggest that this tool may be easily used during a surgical consultation to improve decision making related to shoulder arthroplasty.
Authors: Sai K Devana; Akash A Shah; Changhee Lee; Varun Gudapati; Andrew R Jensen; Edward Cheung; Carlos Solorzano; Mihaela van der Schaar; Nelson F SooHoo Journal: J Shoulder Elb Arthroplast Date: 2021-10-28