Umberto Benedetto1, Arnaldo Dimagli2, Shubhra Sinha2, Lucia Cocomello2, Ben Gibbison2, Massimo Caputo2, Tom Gaunt3, Matt Lyon3, Chris Holmes4, Gianni D Angelini2. 1. Department of Translational Health Sciences, Bristol Heart Institute, University of Bristol, London, United Kingdom. Electronic address: umberto.benedetto@bristol.ac.uk. 2. Department of Translational Health Sciences, Bristol Heart Institute, University of Bristol, London, United Kingdom. 3. Population Health Sciences, University of Bristol, London, United Kingdom. 4. Department of Statistics, University of Oxford, Oxford, United Kingdom.
Abstract
BACKGROUND: Interest in the usefulness of machine learning (ML) methods for outcomes prediction has continued to increase in recent years. However, the advantage of advanced ML model over traditional logistic regression (LR) remains controversial. We performed a systematic review and meta-analysis of studies comparing the discrimination accuracy between ML models versus LR in predicting operative mortality following cardiac surgery. METHODS: The present systematic review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analysis statement. Discrimination ability was assessed using the C-statistic. Pooled C-statistics and its 95% credibility interval for ML models and LR were obtained were obtained using a Bayesian framework. Pooled estimates for ML models and LR were compared to inform on difference between the 2 approaches. RESULTS: We identified 459 published citations of which 15 studies met inclusion criteria and were used for the quantitative and qualitative analysis. When the best ML model from individual study was used, meta-analytic estimates showed that ML were associated with a significantly higher C-statistic (ML, 0.88; 95% credibility interval, 0.83-0.93 vs LR, 0.81; 95% credibility interval, 0.77-0.85; P = .03). When individual ML algorithms were instead selected, we found a nonsignificant trend toward better prediction with each of ML algorithms. We found no evidence of publication bias (P = .70). CONCLUSIONS: The present findings suggest that when compared with LR, ML models provide better discrimination in mortality prediction after cardiac surgery. However, the magnitude and clinical influence of such an improvement remains uncertain.
BACKGROUND: Interest in the usefulness of machine learning (ML) methods for outcomes prediction has continued to increase in recent years. However, the advantage of advanced ML model over traditional logistic regression (LR) remains controversial. We performed a systematic review and meta-analysis of studies comparing the discrimination accuracy between ML models versus LR in predicting operative mortality following cardiac surgery. METHODS: The present systematic review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analysis statement. Discrimination ability was assessed using the C-statistic. Pooled C-statistics and its 95% credibility interval for ML models and LR were obtained were obtained using a Bayesian framework. Pooled estimates for ML models and LR were compared to inform on difference between the 2 approaches. RESULTS: We identified 459 published citations of which 15 studies met inclusion criteria and were used for the quantitative and qualitative analysis. When the best ML model from individual study was used, meta-analytic estimates showed that ML were associated with a significantly higher C-statistic (ML, 0.88; 95% credibility interval, 0.83-0.93 vs LR, 0.81; 95% credibility interval, 0.77-0.85; P = .03). When individual ML algorithms were instead selected, we found a nonsignificant trend toward better prediction with each of ML algorithms. We found no evidence of publication bias (P = .70). CONCLUSIONS: The present findings suggest that when compared with LR, ML models provide better discrimination in mortality prediction after cardiac surgery. However, the magnitude and clinical influence of such an improvement remains uncertain.
Authors: Yue Yu; Chi Peng; Zhiyuan Zhang; Kejia Shen; Yufeng Zhang; Jian Xiao; Wang Xi; Pei Wang; Jin Rao; Zhichao Jin; Zhinong Wang Journal: Front Cardiovasc Med Date: 2022-05-03
Authors: Ashwath Radhachandran; Anurag Garikipati; Nicole S Zelin; Emily Pellegrini; Sina Ghandian; Jacob Calvert; Jana Hoffman; Qingqing Mao; Ritankar Das Journal: BioData Min Date: 2021-03-31 Impact factor: 2.522