| Literature DB >> 34945849 |
Pedro Berjano1, Francesco Langella1, Luca Ventriglia2, Domenico Compagnone1, Paolo Barletta1, David Huber2, Francesca Mangili2, Ginevra Licandro2, Fabio Galbusera1, Andrea Cina1, Tito Bassani1, Claudio Lamartina1, Laura Scaramuzzo1, Roberto Bassani1, Marco Brayda-Bruno1, Jorge Hugo Villafañe3, Lorenzo Monti4, Laura Azzimonti2.
Abstract
The study aims to create a preoperative model from baseline demographic and health-related quality of life scores (HRQOL) to predict a good to excellent early clinical outcome using a machine learning (ML) approach. A single spine surgery center retrospective review of prospectively collected data from January 2016 to December 2020 from the institutional registry (SpineREG) was performed. The inclusion criteria were age ≥ 18 years, both sexes, lumbar arthrodesis procedure, a complete follow up assessment (Oswestry Disability Index-ODI, SF-36 and COMI back) and the capability to read and understand the Italian language. A delta of improvement of the ODI higher than 12.7/100 was considered a "good early outcome". A combined target model of ODI (Δ ≥ 12.7/100), SF-36 PCS (Δ ≥ 6/100) and COMI back (Δ ≥ 2.2/10) was considered an "excellent early outcome". The performance of the ML models was evaluated in terms of sensitivity, i.e., True Positive Rate (TPR), specificity, i.e., True Negative Rate (TNR), accuracy and area under the receiver operating characteristic curve (AUC ROC). A total of 1243 patients were included in this study. The model for predicting ODI at 6 months' follow up showed a good balance between sensitivity (74.3%) and specificity (79.4%), while providing a good accuracy (75.8%) with ROC AUC = 0.842. The combined target model showed a sensitivity of 74.2% and specificity of 71.8%, with an accuracy of 72.8%, and an ROC AUC = 0.808. The results of our study suggest that a machine learning approach showed high performance in predicting early good to excellent clinical results.Entities:
Keywords: adult spine deformity; artificial intelligence; degenerative disc disease; lumbar fusion; personalized medicine; scoliosis; spine registry
Year: 2021 PMID: 34945849 PMCID: PMC8705358 DOI: 10.3390/jpm11121377
Source DB: PubMed Journal: J Pers Med ISSN: 2075-4426
Table with the features included in the analysis and associated percentage of missing values.
| Glassman | Equipe | Age | Gender | BMI | ASA | ODIPre |
|---|---|---|---|---|---|---|
| 18.8% | 0.0% | 0.0% | 0.0% | 1.0% | 0.0% | 0.0% |
|
|
|
|
|
|
|
|
| 0.0% | 0.0% | 0.0% | 20.3% | 20.4% | 20.4% | 19.0% |
Glassman: Glassman classification data; Equipe: surgical team; BMI: body mass index; ODIPre: pre-operative Oswestry disability index; COMIPre: pre-operative core outcome measures index; SFPPre: pre-operative physical component score of the short form-36; SFMPre: pre-operative mental component score of the short form-36; CCI: Charlson comorbidity index.
Good clinical outcome AI predictions.
| Outcome + | Outcome − | Total | |||
|---|---|---|---|---|---|
| Prediction + | 653 | 75 | 728 | Sensitivity | 74.3% |
| Prediction − | 226 | 289 | 515 | Specificity | 79.4% |
| Total | 879 | 364 | 1243 | PPV | 89.7% |
| NPV | 56.1% | ||||
| Accuracy | 75.8% | ||||
| AUC ROC | 0.842 |
The table shows the performance evaluation of the AI model predicting the “good clinical outcome”—ODI at 6 months FU. Outcome +: patients with ODI Δ ≥ 12.7/100; Outcome −: patients with ODI Δ < 12.7/100; Prediction +: model’s predictions of patients with ODI Δ ≥ 12.7/100; Outcome −: model’s predictions of patients with ODI Δ < 12.7/100; PPV: Positive Predictive Values; NPV: Negative Predictive Values.
Excellent clinical outcome AI predictions.
| Outcome + | Outcome − | Total | |||
|---|---|---|---|---|---|
| Prediction + | 399 | 199 | 598 | Sensitivity | 74.2% |
| Prediction − | 139 | 506 | 645 | Specificity | 71.8% |
| Total | 538 | 705 | 1243 | PPV | 66.7% |
| NPV | 78.4% | ||||
| Accuracy | 72.8% | ||||
| AUC ROC | 0.808 |
The table shows the performance evaluation of the AI model predicting the “Excellent Clinical Outcome”—ODI—SF36—COMI Back at 6 months FU. Outcome +: patients with ODI Δ ≥ 12.7/100 and SF-36 PCS (Δ ≥ 6/100) and COMI back (Δ ≥ 2.2/10); Outcome −: patients with at least one of the following conditions ODI Δ < 12.7/100 or SF-36 PCS Δ < 6/100 or COMI back Δ < 2.2/10; Prediction +: model’s predictions of patients with ODI Δ ≥ 12.7/100 and SF-36 PCS Δ ≥ 6/100 and COMI back Δ ≥ 2.2/10; Outcome −: model’s predictions of patients with at least one of the following conditions—ODI Δ < 12.7/100 or SF-36 PCS Δ < 6/100 or COMI back Δ < 2.2/10; PPV: Positive Predictive Values; NPV: Negative Predictive Values
Figure 1ROC CURVE for the ODI model and the combined model.
Mean decreased Gini weights in good and excellent clinical outcomes.
| Predictive Variables | Good Clinical Outcome | Predictive Variables | Excellent Clinical Outcome |
|---|---|---|---|
| SFMPre | 73.20 | SFPPre | 90.34 |
| SFPPre | 70.80 | SFMPre | 87.13 |
| ODIPre | 66.77 | BMI | 78.61 |
| BMI | 62.97 | Age | 69.92 |
| Age | 61.12 | ODIPre | 66.21 |
| COMIPre | 31.00 | COMIPre | 43.74 |
| Glassman | 28.30 | Glassman | 29.90 |
Glassman: Glassman classification data; BMI: body mass index; ODIPre: pre-operative Oswestry disability index; COMIPre: pre-operative core outcome measures index; SFPPre: pre-operative physical component score of the short form-36; SFMPre: pre-operative mental component score of the short form-36.