Peter A Noseworthy1,2, Zachi I Attia1, LaPrincess C Brewer1, Sharonne N Hayes1,3, Xiaoxi Yao1,2,4, Suraj Kapa1, Paul A Friedman1, Francisco Lopez-Jimenez1. 1. Department of Cardiovascular Medicine (P.A.N., Z.I.A., L.C.B., S.N.H., X.Y., S.K., P.A.F., F.L.-J.), Mayo Clinic, Rochester, MN. 2. Robert D. and Patricia E. Kern Center for the Science of Health Care Delivery (P.A.N., X.Y.), Mayo Clinic, Rochester, MN. 3. Office of Diversity and Inclusion (S.N.H.), Mayo Clinic, Rochester, MN. 4. Division of Health Care Policy and Research, Department of Health Sciences Research (X.Y.), Mayo Clinic, Rochester, MN.
Abstract
BACKGROUND: Deep learning algorithms derived in homogeneous populations may be poorly generalizable and have the potential to reflect, perpetuate, and even exacerbate racial/ethnic disparities in health and health care. In this study, we aimed to (1) assess whether the performance of a deep learning algorithm designed to detect low left ventricular ejection fraction using the 12-lead ECG varies by race/ethnicity and to (2) determine whether its performance is determined by the derivation population or by racial variation in the ECG. METHODS: We performed a retrospective cohort analysis that included 97 829 patients with paired ECGs and echocardiograms. We tested the model performance by race/ethnicity for convolutional neural network designed to identify patients with a left ventricular ejection fraction ≤35% from the 12-lead ECG. RESULTS: The convolutional neural network that was previously derived in a homogeneous population (derivation cohort, n=44 959; 96.2% non-Hispanic white) demonstrated consistent performance to detect low left ventricular ejection fraction across a range of racial/ethnic subgroups in a separate testing cohort (n=52 870): non-Hispanic white (n=44 524; area under the curve [AUC], 0.931), Asian (n=557; AUC, 0.961), black/African American (n=651; AUC, 0.937), Hispanic/Latino (n=331; AUC, 0.937), and American Indian/Native Alaskan (n=223; AUC, 0.938). In secondary analyses, a separate neural network was able to discern racial subgroup category (black/African American [AUC, 0.84], and white, non-Hispanic [AUC, 0.76] in a 5-class classifier), and a network trained only in non-Hispanic whites from the original derivation cohort performed similarly well across a range of racial/ethnic subgroups in the testing cohort with an AUC of at least 0.930 in all racial/ethnic subgroups. CONCLUSIONS: Our study demonstrates that while ECG characteristics vary by race, this did not impact the ability of a convolutional neural network to predict low left ventricular ejection fraction from the ECG. We recommend reporting of performance among diverse ethnic, racial, age, and sex groups for all new artificial intelligence tools to ensure responsible use of artificial intelligence in medicine.
BACKGROUND:Deep learning algorithms derived in homogeneous populations may be poorly generalizable and have the potential to reflect, perpetuate, and even exacerbate racial/ethnic disparities in health and health care. In this study, we aimed to (1) assess whether the performance of a deep learning algorithm designed to detect low left ventricular ejection fraction using the 12-lead ECG varies by race/ethnicity and to (2) determine whether its performance is determined by the derivation population or by racial variation in the ECG. METHODS: We performed a retrospective cohort analysis that included 97 829 patients with paired ECGs and echocardiograms. We tested the model performance by race/ethnicity for convolutional neural network designed to identify patients with a left ventricular ejection fraction ≤35% from the 12-lead ECG. RESULTS: The convolutional neural network that was previously derived in a homogeneous population (derivation cohort, n=44 959; 96.2% non-Hispanic white) demonstrated consistent performance to detect low left ventricular ejection fraction across a range of racial/ethnic subgroups in a separate testing cohort (n=52 870): non-Hispanic white (n=44 524; area under the curve [AUC], 0.931), Asian (n=557; AUC, 0.961), black/African American (n=651; AUC, 0.937), Hispanic/Latino (n=331; AUC, 0.937), and American Indian/Native Alaskan (n=223; AUC, 0.938). In secondary analyses, a separate neural network was able to discern racial subgroup category (black/African American [AUC, 0.84], and white, non-Hispanic [AUC, 0.76] in a 5-class classifier), and a network trained only in non-Hispanic whites from the original derivation cohort performed similarly well across a range of racial/ethnic subgroups in the testing cohort with an AUC of at least 0.930 in all racial/ethnic subgroups. CONCLUSIONS: Our study demonstrates that while ECG characteristics vary by race, this did not impact the ability of a convolutional neural network to predict low left ventricular ejection fraction from the ECG. We recommend reporting of performance among diverse ethnic, racial, age, and sex groups for all new artificial intelligence tools to ensure responsible use of artificial intelligence in medicine.
Entities:
Keywords:
United States; artificial intelligence; electrocardiography; humans; machine learning
Authors: Clyde W Yancy; Mariell Jessup; Biykem Bozkurt; Javed Butler; Donald E Casey; Mark H Drazner; Gregg C Fonarow; Stephen A Geraci; Tamara Horwich; James L Januzzi; Maryl R Johnson; Edward K Kasper; Wayne C Levy; Frederick A Masoudi; Patrick E McBride; John J V McMurray; Judith E Mitchell; Pamela N Peterson; Barbara Riegel; Flora Sam; Lynne W Stevenson; W H Wilson Tang; Emily J Tsai; Bruce L Wilkoff Journal: Circulation Date: 2013-06-05 Impact factor: 29.690
Authors: P W Macfarlane; I A Katibi; S T Hamde; D Singh; E Clark; B Devine; B G Francq; S Lloyd; V Kumar Journal: J Electrocardiol Date: 2014-08-07 Impact factor: 1.438
Authors: Sana M Al-Khatib; William G Stevenson; Michael J Ackerman; William J Bryant; David J Callans; Anne B Curtis; Barbara J Deal; Timm Dickfeld; Michael E Field; Gregg C Fonarow; Anne M Gillis; Christopher B Granger; Stephen C Hammill; Mark A Hlatky; José A Joglar; G Neal Kay; Daniel D Matlock; Robert J Myerburg; Richard L Page Journal: Circulation Date: 2018-09-25 Impact factor: 29.690
Authors: P M Rautaharju; L P Park; J S Gottdiener; D Siscovick; R Boineau; V Smith; N R Powe Journal: J Electrocardiol Date: 2000-07 Impact factor: 1.438
Authors: Zachi I Attia; Suraj Kapa; Xiaoxi Yao; Francisco Lopez-Jimenez; Tarun L Mohan; Patricia A Pellikka; Rickey E Carter; Nilay D Shah; Paul A Friedman; Peter A Noseworthy Journal: J Cardiovasc Electrophysiol Date: 2019-03-10
Authors: Margaret M Redfield; Richard J Rodeheffer; Steven J Jacobsen; Douglas W Mahoney; Kent R Bailey; John C Burnett Journal: Circulation Date: 2004-06-07 Impact factor: 29.690
Authors: Zachi I Attia; Suraj Kapa; Francisco Lopez-Jimenez; Paul M McKie; Dorothy J Ladewig; Gaurav Satam; Patricia A Pellikka; Maurice Enriquez-Sarano; Peter A Noseworthy; Thomas M Munger; Samuel J Asirvatham; Christopher G Scott; Rickey E Carter; Paul A Friedman Journal: Nat Med Date: 2019-01-07 Impact factor: 53.440
Authors: Daniel Sierra-Lara Martinez; Peter A Noseworthy; Oguz Akbilgic; Joerg Herrmann; Kathryn J Ruddy; Abdulaziz Hamid; Ragasnehith Maddula; Ashima Singh; Robert Davis; Fatma Gunturkun; John L Jefferies; Sherry-Ann Brown Journal: Am Heart J Plus Date: 2022-04-01
Authors: Demilade A Adedinsewo; Amy W Pollak; Sabrina D Phillips; Taryn L Smith; Anna Svatikova; Sharonne N Hayes; Sharon L Mulvagh; Colleen Norris; Veronique L Roger; Peter A Noseworthy; Xiaoxi Yao; Rickey E Carter Journal: Circ Res Date: 2022-02-17 Impact factor: 23.213
Authors: Donna K Arnett; Ramachandran S Vasan; Matthew Nayor; Li Shen; Gary M Hunninghake; Peter Kochunov; R Graham Barr; David A Bluemke; Ulrich Broeckel; Peter Caravan; Susan Cheng; Paul S de Vries; Udo Hoffmann; Márton Kolossváry; Huiqing Li; James Luo; Elizabeth M McNally; George Thanassoulis Journal: Circ Cardiovasc Imaging Date: 2021-08-13 Impact factor: 8.589
Authors: Jennifer M Kwan; Mariana L Henry; Briana Christophers; Kamala Tamirisa; Ritu Thamman; Diego Sadler; Niti R Aggarwal; Richard Cheng; Purvi Parwani; Susan Dent; Roohi Ismail-Khan; Michael G Fradley; Sherry-Ann Brown Journal: Curr Oncol Rep Date: 2021-07-14 Impact factor: 5.075