Shaan Khurshid1,2,3, Samuel Friedman4, Christopher Reeder4, Paolo Di Achille4, Nathaniel Diamant4, Pulkit Singh4, Lia X Harrington2,3, Xin Wang2,3, Mostafa A Al-Alusi1,2,4, Gopal Sarma4, Andrea S Foulkes5, Patrick T Ellinor2,6,3, Christopher D Anderson6,7,8,9,10, Jennifer E Ho1,2,3,9, Anthony A Philippakis4,11, Puneet Batra4, Steven A Lubitz2,6,3,4,9. 1. Division of Cardiology (S.K., M.A.A., J.E.H.), Massachusetts General Hospital, Boston. 2. Cardiovascular Research Center (S.K., L.X.H., X.W., M.A.A., P.T.E., J.E.H., S.A.L.), Massachusetts General Hospital, Boston. 3. Cardiovascular Disease Initiative (S.K., L.X.H., X.W., M.A.A., P.T.E., J.E.H., S.A.L.), Broad Institute of Harvard and the Massachusetts Institute of Technology, Cambridge. 4. Data Sciences Platform (S.F., C.R., P.D.A., N.D., P.S., G.S., A.A.P., P.B.), Broad Institute of Harvard and the Massachusetts Institute of Technology, Cambridge. 5. Biostatistics Center (A.S.F.), Massachusetts General Hospital, Boston. 6. Cardiac Arrhythmia Service (P.T.E., C.D.A., S.A.L.), Massachusetts General Hospital, Boston. 7. Center for Genomic Medicine (C.D.A.), Massachusetts General Hospital, Boston. 8. Henry and Allison McCance Center for Brain Health (C.D.A.), Massachusetts General Hospital, Boston. 9. Harvard Medical School, Boston, MA (A.S.F., P.T.E., C.D.A., J.E.H., S.A.L.). 10. Department of Neurology, Brigham and Women's Hospital, Boston, MA (C.D.A.). 11. Eric and Wendy Schmidt Center (A.A.P.), Broad Institute of Harvard and the Massachusetts Institute of Technology, Cambridge.
Abstract
BACKGROUND: Artificial intelligence (AI)-enabled analysis of 12-lead ECGs may facilitate efficient estimation of incident atrial fibrillation (AF) risk. However, it remains unclear whether AI provides meaningful and generalizable improvement in predictive accuracy beyond clinical risk factors for AF. METHODS: We trained a convolutional neural network (ECG-AI) to infer 5-year incident AF risk using 12-lead ECGs in patients receiving longitudinal primary care at Massachusetts General Hospital (MGH). We then fit 3 Cox proportional hazards models, composed of ECG-AI 5-year AF probability, CHARGE-AF clinical risk score (Cohorts for Heart and Aging in Genomic Epidemiology-Atrial Fibrillation), and terms for both ECG-AI and CHARGE-AF (CH-AI), respectively. We assessed model performance by calculating discrimination (area under the receiver operating characteristic curve) and calibration in an internal test set and 2 external test sets (Brigham and Women's Hospital [BWH] and UK Biobank). Models were recalibrated to estimate 2-year AF risk in the UK Biobank given limited available follow-up. We used saliency mapping to identify ECG features most influential on ECG-AI risk predictions and assessed correlation between ECG-AI and CHARGE-AF linear predictors. RESULTS: The training set comprised 45 770 individuals (age 55±17 years, 53% women, 2171 AF events) and the test sets comprised 83 162 individuals (age 59±13 years, 56% women, 2424 AF events). Area under the receiver operating characteristic curve was comparable using CHARGE-AF (MGH, 0.802 [95% CI, 0.767-0.836]; BWH, 0.752 [95% CI, 0.741-0.763]; UK Biobank, 0.732 [95% CI, 0.704-0.759]) and ECG-AI (MGH, 0.823 [95% CI, 0.790-0.856]; BWH, 0.747 [95% CI, 0.736-0.759]; UK Biobank, 0.705 [95% CI, 0.673-0.737]). Area under the receiver operating characteristic curve was highest using CH-AI (MGH, 0.838 [95% CI, 0.807 to 0.869]; BWH, 0.777 [95% CI, 0.766 to 0.788]; UK Biobank, 0.746 [95% CI, 0.716 to 0.776]). Calibration error was low using ECG-AI (MGH, 0.0212; BWH, 0.0129; UK Biobank, 0.0035) and CH-AI (MGH, 0.012; BWH, 0.0108; UK Biobank, 0.0001). In saliency analyses, the ECG P-wave had the greatest influence on AI model predictions. ECG-AI and CHARGE-AF linear predictors were correlated (Pearson r: MGH, 0.61; BWH, 0.66; UK Biobank, 0.41). CONCLUSIONS: AI-based analysis of 12-lead ECGs has similar predictive usefulness to a clinical risk factor model for incident AF and the approaches are complementary. ECG-AI may enable efficient quantification of future AF risk.
BACKGROUND: Artificial intelligence (AI)-enabled analysis of 12-lead ECGs may facilitate efficient estimation of incident atrial fibrillation (AF) risk. However, it remains unclear whether AI provides meaningful and generalizable improvement in predictive accuracy beyond clinical risk factors for AF. METHODS: We trained a convolutional neural network (ECG-AI) to infer 5-year incident AF risk using 12-lead ECGs in patients receiving longitudinal primary care at Massachusetts General Hospital (MGH). We then fit 3 Cox proportional hazards models, composed of ECG-AI 5-year AF probability, CHARGE-AF clinical risk score (Cohorts for Heart and Aging in Genomic Epidemiology-Atrial Fibrillation), and terms for both ECG-AI and CHARGE-AF (CH-AI), respectively. We assessed model performance by calculating discrimination (area under the receiver operating characteristic curve) and calibration in an internal test set and 2 external test sets (Brigham and Women's Hospital [BWH] and UK Biobank). Models were recalibrated to estimate 2-year AF risk in the UK Biobank given limited available follow-up. We used saliency mapping to identify ECG features most influential on ECG-AI risk predictions and assessed correlation between ECG-AI and CHARGE-AF linear predictors. RESULTS: The training set comprised 45 770 individuals (age 55±17 years, 53% women, 2171 AF events) and the test sets comprised 83 162 individuals (age 59±13 years, 56% women, 2424 AF events). Area under the receiver operating characteristic curve was comparable using CHARGE-AF (MGH, 0.802 [95% CI, 0.767-0.836]; BWH, 0.752 [95% CI, 0.741-0.763]; UK Biobank, 0.732 [95% CI, 0.704-0.759]) and ECG-AI (MGH, 0.823 [95% CI, 0.790-0.856]; BWH, 0.747 [95% CI, 0.736-0.759]; UK Biobank, 0.705 [95% CI, 0.673-0.737]). Area under the receiver operating characteristic curve was highest using CH-AI (MGH, 0.838 [95% CI, 0.807 to 0.869]; BWH, 0.777 [95% CI, 0.766 to 0.788]; UK Biobank, 0.746 [95% CI, 0.716 to 0.776]). Calibration error was low using ECG-AI (MGH, 0.0212; BWH, 0.0129; UK Biobank, 0.0035) and CH-AI (MGH, 0.012; BWH, 0.0108; UK Biobank, 0.0001). In saliency analyses, the ECG P-wave had the greatest influence on AI model predictions. ECG-AI and CHARGE-AF linear predictors were correlated (Pearson r: MGH, 0.61; BWH, 0.66; UK Biobank, 0.41). CONCLUSIONS: AI-based analysis of 12-lead ECGs has similar predictive usefulness to a clinical risk factor model for incident AF and the approaches are complementary. ECG-AI may enable efficient quantification of future AF risk.
Entities:
Keywords:
atrial fibrillation; deep learning; electronic health records
Authors: Scott D Corley; Andrew E Epstein; John P DiMarco; Michael J Domanski; Nancy Geller; H Leon Greene; Richard A Josephson; Joyce C Kellen; Richard C Klein; Andrew D Krahn; Mary Mickel; L Brent Mitchell; Joy Dalquist Nelson; Yves Rosenberg; Eleanor Schron; Lynn Shemanski; Albert L Waldo; D George Wyse Journal: Circulation Date: 2004-03-08 Impact factor: 29.690
Authors: Sushravya Raghunath; John M Pfeifer; Brandon K Fornwalt; Christopher M Haggerty; Alvaro E Ulloa-Cerna; Arun Nemani; Tanner Carbonati; Linyuan Jing; David P vanMaanen; Dustin N Hartzel; Jeffery A Ruhl; Braxton F Lagerman; Daniel B Rocha; Nathan J Stoudt; Gargi Schneider; Kipp W Johnson; Noah Zimmerman; Joseph B Leader; H Lester Kirchner; Christoph J Griessenauer; Ashraf Hafez; Christopher W Good Journal: Circulation Date: 2021-02-16 Impact factor: 29.690
Authors: Jonas L Isaksen; Mathias Baumert; Astrid N L Hermans; Molly Maleckar; Dominik Linz Journal: Herzschrittmacherther Elektrophysiol Date: 2022-02-11
Authors: Georgios Petmezas; Leandros Stefanopoulos; Vassilis Kilintzis; Andreas Tzavelis; John A Rogers; Aggelos K Katsaggelos; Nicos Maglaveras Journal: JMIR Med Inform Date: 2022-08-15
Authors: Nathaniel Diamant; Paolo Di Achille; Lu-Chen Weng; Emily S Lau; Shaan Khurshid; Samuel Friedman; Christopher Reeder; Pulkit Singh; Xin Wang; Gopal Sarma; Mercedeh Ghadessi; Johanna Mielke; Eren Elci; Ivan Kryukov; Hanna M Eilken; Andrea Derix; Patrick T Ellinor; Christopher D Anderson; Anthony A Philippakis; Puneet Batra; Steven A Lubitz; Jennifer E Ho Journal: Cardiovasc Digit Health J Date: 2022-06-24