Richard Rios1, Robert J H Miller1,2, Lien Hsin Hu3, Yuka Otaki1, Ananya Singh1, Marcio Diniz1, Tali Sharir4,5, Andrew J Einstein6,7, Mathews B Fish8, Terrence D Ruddy9, Philipp A Kaufmann10, Albert J Sinusas11, Edward J Miller11, Timothy M Bateman12, Sharmila Dorbala13, Marcelo DiCarli13, Serge Van Kriekinge1, Paul Kavanagh1, Tejas Parekh1, Joanna X Liang1, Damini Dey1, Daniel S Berman1, Piotr Slomka1. 1. Department of Imaging, Medicine, and Biomedical Sciences, Cedars-Sinai Medical Center, Los Angeles, CA 90048, USA. 2. Department of Cardiac Sciences, University of Calgary, Calgary, AB, Canada. 3. Department of Nuclear Medicine, Taipei, Veterans General Hospital, Taipei, Taiwan. 4. Department of Nuclear Cardiology, Assuta Medical Center, Tel Aviv, Israel. 5. Faculty of Health Sciences, Ben Gurion University of the Negev, Beer Sheba, Israel. 6. Division of Cardiology, Department of Medicine, Columbia University Irving Medical Center and New York-Presbyterian Hospital, New York, NY, USA. 7. Department of Radiology, Columbia University Irving Medical Center and New York-Presbyterian Hospital, New York, NY, USA. 8. Department of Nuclear Medicine, Oregon Heart and Vascular Institute, Sacred Heart Medical Center, Springfield, OR, USA. 9. Division of Cardiology, Department of Medicine, University of Ottawa Heart Institute, Ottawa ON, Canada. 10. Department of Nuclear Medicine, Cardiac Imaging, University Hospital Zurich, Zurich, Switzerland. 11. Department of Internal Medicine, Section of Cardiovascular Medicine, Yale University School of Medicine, New Haven, CT, USA. 12. Cardiovascular Imaging Technologies LLC, Kansas City, MO, USA. 13. Division of Nuclear Medicine and Molecular Imaging, Department of Radiology, Brigham and Women's Hospital, Boston, MA, USA.
Abstract
AIMS: Optimal risk stratification with machine learning (ML) from myocardial perfusion imaging (MPI) includes both clinical and imaging data. While most imaging variables can be derived automatically, clinical variables require manual collection, which is time-consuming and prone to error. We determined the fewest manually input and imaging variables required to maintain the prognostic accuracy for major adverse cardiac events (MACE) in patients undergoing a single-photon emission computed tomography (SPECT) MPI. METHODS AND RESULTS: This study included 20 414 patients from the multicentre REFINE SPECT registry and 2984 from the University of Calgary for training and external testing of the ML models, respectively. ML models were trained using all variables (ML-All) and all image-derived variables (including age and sex, ML-Image). Next, ML models were sequentially trained by incrementally adding manually input and imaging variables to baseline ML models based on their importance ranking. The fewest variables were determined as the ML models (ML-Reduced, ML-Minimum, and ML-Image-Reduced) that achieved comparable prognostic performance to ML-All and ML-Image. Prognostic accuracy of the ML models was compared with visual diagnosis, stress total perfusion deficit (TPD), and traditional multivariable models using area under the receiver-operating characteristic curve (AUC). ML-Minimum (AUC 0.798) obtained comparable prognostic accuracy to ML-All (AUC 0.799, P = 0.19) by including 12 of 40 manually input variables and 11 of 58 imaging variables. ML-Reduced achieved comparable accuracy (AUC 0.796) with a reduced set of manually input variables and all imaging variables. In external validation, the ML models also obtained comparable or higher prognostic accuracy than traditional multivariable models. CONCLUSION: Reduced ML models, including a minimum set of manually collected or imaging variables, achieved slightly lower accuracy compared to a full ML model but outperformed standard interpretation methods and risk models. ML models with fewer collected variables may be more practical for clinical implementation. Published on behalf of the European Society of Cardiology. All rights reserved.
AIMS: Optimal risk stratification with machine learning (ML) from myocardial perfusion imaging (MPI) includes both clinical and imaging data. While most imaging variables can be derived automatically, clinical variables require manual collection, which is time-consuming and prone to error. We determined the fewest manually input and imaging variables required to maintain the prognostic accuracy for major adverse cardiac events (MACE) in patients undergoing a single-photon emission computed tomography (SPECT) MPI. METHODS AND RESULTS: This study included 20 414 patients from the multicentre REFINE SPECT registry and 2984 from the University of Calgary for training and external testing of the ML models, respectively. ML models were trained using all variables (ML-All) and all image-derived variables (including age and sex, ML-Image). Next, ML models were sequentially trained by incrementally adding manually input and imaging variables to baseline ML models based on their importance ranking. The fewest variables were determined as the ML models (ML-Reduced, ML-Minimum, and ML-Image-Reduced) that achieved comparable prognostic performance to ML-All and ML-Image. Prognostic accuracy of the ML models was compared with visual diagnosis, stress total perfusion deficit (TPD), and traditional multivariable models using area under the receiver-operating characteristic curve (AUC). ML-Minimum (AUC 0.798) obtained comparable prognostic accuracy to ML-All (AUC 0.799, P = 0.19) by including 12 of 40 manually input variables and 11 of 58 imaging variables. ML-Reduced achieved comparable accuracy (AUC 0.796) with a reduced set of manually input variables and all imaging variables. In external validation, the ML models also obtained comparable or higher prognostic accuracy than traditional multivariable models. CONCLUSION: Reduced ML models, including a minimum set of manually collected or imaging variables, achieved slightly lower accuracy compared to a full ML model but outperformed standard interpretation methods and risk models. ML models with fewer collected variables may be more practical for clinical implementation. Published on behalf of the European Society of Cardiology. All rights reserved.
Authors: Kristian Thygesen; Joseph S Alpert; Harvey D White; Allan S Jaffe; Fred S Apple; Marcello Galvani; Hugo A Katus; L Kristin Newby; Jan Ravkilde; Bernard Chaitman; Peter M Clemmensen; Mikael Dellborg; Hanoch Hod; Pekka Porela; Richard Underwood; Jeroen J Bax; George A Beller; Robert Bonow; Ernst E Van der Wall; Jean-Pierre Bassand; William Wijns; T Bruce Ferguson; Philippe G Steg; Barry F Uretsky; David O Williams; Paul W Armstrong; Elliott M Antman; Keith A Fox; Christian W Hamm; E Magnus Ohman; Maarten L Simoons; Philip A Poole-Wilson; Enrique P Gurfinkel; José-Luis Lopez-Sendon; Prem Pais; Shanti Mendis; Jun-Ren Zhu; Lars C Wallentin; Francisco Fernández-Avilés; Kim M Fox; Alexander N Parkhomenko; Silvia G Priori; Michal Tendera; Liisa-Maria Voipio-Pulkki; Alec Vahanian; A John Camm; Raffaele De Caterina; Veronica Dean; Kenneth Dickstein; Gerasimos Filippatos; Christian Funck-Brentano; Irene Hellemans; Steen Dalby Kristensen; Keith McGregor; Udo Sechtem; Sigmund Silber; Michal Tendera; Petr Widimsky; José Luis Zamorano; Joao Morais; Sorin Brener; Robert Harrington; David Morrow; Michael Lim; Marco A Martinez-Rios; Steve Steinhubl; Glen N Levine; W Brian Gibler; David Goff; Marco Tubaro; Darek Dudek; Nawwar Al-Attar Journal: Circulation Date: 2007-10-19 Impact factor: 29.690
Authors: Damini Dey; Piotr J Slomka; Paul Leeson; Dorin Comaniciu; Sirish Shrestha; Partho P Sengupta; Thomas H Marwick Journal: J Am Coll Cardiol Date: 2019-03-26 Impact factor: 24.094
Authors: Stephan D Fihn; Julius M Gardin; Jonathan Abrams; Kathleen Berra; James C Blankenship; Apostolos P Dallas; Pamela S Douglas; Joanne M Foody; Thomas C Gerber; Alan L Hinderliter; Spencer B King; Paul D Kligfield; Harlan M Krumholz; Raymond Y K Kwong; Michael J Lim; Jane A Linderbaum; Michael J Mack; Mark A Munger; Richard L Prager; Joseph F Sabik; Leslee J Shaw; Joanna D Sikkema; Craig R Smith; Sidney C Smith; John A Spertus; Sankey V Williams Journal: J Am Coll Cardiol Date: 2012-11-19 Impact factor: 24.094
Authors: Juhani Knuuti; William Wijns; Antti Saraste; Davide Capodanno; Emanuele Barbato; Christian Funck-Brentano; Eva Prescott; Robert F Storey; Christi Deaton; Thomas Cuisset; Stefan Agewall; Kenneth Dickstein; Thor Edvardsen; Javier Escaned; Bernard J Gersh; Pavel Svitil; Martine Gilard; David Hasdai; Robert Hatala; Felix Mahfoud; Josep Masip; Claudio Muneretto; Marco Valgimigli; Stephan Achenbach; Jeroen J Bax Journal: Eur Heart J Date: 2020-01-14 Impact factor: 29.983
Authors: Piotr J Slomka; Julian Betancur; Joanna X Liang; Yuka Otaki; Lien-Hsin Hu; Tali Sharir; Sharmila Dorbala; Marcelo Di Carli; Mathews B Fish; Terrence D Ruddy; Timothy M Bateman; Andrew J Einstein; Philipp A Kaufmann; Edward J Miller; Albert J Sinusas; Peyman N Azadani; Heidi Gransar; Balaji K Tamarappoo; Damini Dey; Daniel S Berman; Guido Germano Journal: J Nucl Cardiol Date: 2018-06-19 Impact factor: 5.952
Authors: Lien-Hsin Hu; Robert J H Miller; Tali Sharir; Frederic Commandeur; Richard Rios; Andrew J Einstein; Mathews B Fish; Terrence D Ruddy; Philipp A Kaufmann; Albert J Sinusas; Edward J Miller; Timothy M Bateman; Sharmila Dorbala; Marcelo Di Carli; Joanna X Liang; Evann Eisenberg; Damini Dey; Daniel S Berman; Piotr J Slomka Journal: Eur Heart J Cardiovasc Imaging Date: 2021-05-10 Impact factor: 6.875
Authors: Richard Rios; Robert J H Miller; Nipun Manral; Tali Sharir; Andrew J Einstein; Mathews B Fish; Terrence D Ruddy; Philipp A Kaufmann; Albert J Sinusas; Edward J Miller; Timothy M Bateman; Sharmila Dorbala; Marcelo Di Carli; Serge D Van Kriekinge; Paul B Kavanagh; Tejas Parekh; Joanna X Liang; Damini Dey; Daniel S Berman; Piotr J Slomka Journal: Comput Biol Med Date: 2022-03-25 Impact factor: 6.698