M D Li1, M Lang2, F Deng2, K Chang2, K Buch2, S Rincon2, W A Mehan2, T M Leslie-Mazwi3, J Kalpathy-Cramer2. 1. From the Departments of Radiology (M.D.L., M.L., F.D., K.C., K.B., S.R., W.A.M., J.K.-C.) mdli@mgh.harvard.edu. 2. From the Departments of Radiology (M.D.L., M.L., F.D., K.C., K.B., S.R., W.A.M., J.K.-C.). 3. Neurology and Neurosurgery (T.M.L.-M.), Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts.
Abstract
BACKGROUND AND PURPOSE: The coronavirus disease 2019 (COVID-19) pandemic has led to decreases in neuroimaging volume. Our aim was to quantify the change in acute or subacute ischemic strokes detected on CT or MR imaging during the pandemic using natural language processing of radiology reports. MATERIALS AND METHODS: We retrospectively analyzed 32,555 radiology reports from brain CTs and MRIs from a comprehensive stroke center, performed from March 1 to April 30 each year from 2017 to 2020, involving 20,414 unique patients. To detect acute or subacute ischemic stroke in free-text reports, we trained a random forest natural language processing classifier using 1987 randomly sampled radiology reports with manual annotation. Natural language processing classifier generalizability was evaluated using 1974 imaging reports from an external dataset. RESULTS: The natural language processing classifier achieved a 5-fold cross-validation classification accuracy of 0.97 and an F1 score of 0.74, with a slight underestimation (-5%) of actual numbers of acute or subacute ischemic strokes in cross-validation. Importantly, cross-validation performance stratified by year was similar. Applying the classifier to the complete study cohort, we found an estimated 24% decrease in patients with acute or subacute ischemic strokes reported on CT or MR imaging from March to April 2020 compared with the average from those months in 2017-2019. Among patients with stroke-related order indications, the estimated proportion who underwent neuroimaging with acute or subacute ischemic stroke detection significantly increased from 16% during 2017-2019 to 21% in 2020 (P = .01). The natural language processing classifier performed worse on external data. CONCLUSIONS: Acute or subacute ischemic stroke cases detected by neuroimaging decreased during the COVID-19 pandemic, though a higher proportion of studies ordered for stroke were positive for acute or subacute ischemic strokes. Natural language processing approaches can help automatically track acute or subacute ischemic stroke numbers for epidemiologic studies, though local classifier training is important due to radiologist reporting style differences.
BACKGROUND AND PURPOSE: The coronavirus disease 2019 (COVID-19) pandemic has led to decreases in neuroimaging volume. Our aim was to quantify the change in acute or subacute ischemic strokes detected on CT or MR imaging during the pandemic using natural language processing of radiology reports. MATERIALS AND METHODS: We retrospectively analyzed 32,555 radiology reports from brain CTs and MRIs from a comprehensive stroke center, performed from March 1 to April 30 each year from 2017 to 2020, involving 20,414 unique patients. To detect acute or subacute ischemic stroke in free-text reports, we trained a random forest natural language processing classifier using 1987 randomly sampled radiology reports with manual annotation. Natural language processing classifier generalizability was evaluated using 1974 imaging reports from an external dataset. RESULTS: The natural language processing classifier achieved a 5-fold cross-validation classification accuracy of 0.97 and an F1 score of 0.74, with a slight underestimation (-5%) of actual numbers of acute or subacute ischemic strokes in cross-validation. Importantly, cross-validation performance stratified by year was similar. Applying the classifier to the complete study cohort, we found an estimated 24% decrease in patients with acute or subacute ischemic strokes reported on CT or MR imaging from March to April 2020 compared with the average from those months in 2017-2019. Among patients with stroke-related order indications, the estimated proportion who underwent neuroimaging with acute or subacute ischemic stroke detection significantly increased from 16% during 2017-2019 to 21% in 2020 (P = .01). The natural language processing classifier performed worse on external data. CONCLUSIONS: Acute or subacute ischemic stroke cases detected by neuroimaging decreased during the COVID-19 pandemic, though a higher proportion of studies ordered for stroke were positive for acute or subacute ischemic strokes. Natural language processing approaches can help automatically track acute or subacute ischemic stroke numbers for epidemiologic studies, though local classifier training is important due to radiologist reporting style differences.
Authors: Saeed Hassanpour; Curtis P Langlotz; Timothy J Amrhein; Nicholas T Befera; Matthew P Lungren Journal: AJR Am J Roentgenol Date: 2017-01-31 Impact factor: 3.959
Authors: Enrique C Leira; Andrew N Russman; José Biller; Devin L Brown; Cheryl D Bushnell; Valeria Caso; Angel Chamorro; Claire J Creutzfeldt; Salvador Cruz-Flores; Mitchell S V Elkind; Pierre Fayad; Michael T Froehler; Larry B Goldstein; Nicole R Gonzales; Brian Kaskie; Pooja Khatri; Sarah Livesay; David S Liebeskind; Jennifer J Majersik; Asma M Moheet; Jose G Romano; Nerses Sanossian; Lauren H Sansing; Brian Silver; Alexis N Simpkins; Wade Smith; David L Tirschwell; David Z Wang; Dileep R Yavagal; Bradford B Worrall Journal: Neurology Date: 2020-05-08 Impact factor: 9.910
Authors: Dane Gunter; Paulo Puac-Polanco; Olivier Miguel; Rebecca E Thornhill; Amy Y X Yu; Zhongyu A Liu; Muhammad Mamdani; Chloe Pou-Prom; Richard I Aviv Journal: Neuroradiology Date: 2022-08-01 Impact factor: 2.995
Authors: Matthew I Miller; Agni Orfanoudaki; Michael Cronin; Hanife Saglam; Ivy So Yeon Kim; Oluwafemi Balogun; Maria Tzalidi; Kyriakos Vasilopoulos; Georgia Fanaropoulou; Nina M Fanaropoulou; Jack Kalin; Meghan Hutch; Brenton R Prescott; Benjamin Brush; Emelia J Benjamin; Min Shin; Asim Mian; David M Greer; Stelios M Smirnakis; Charlene J Ong Journal: Neurocrit Care Date: 2022-05-09 Impact factor: 3.532
Authors: Victor M Torres-Lopez; Grace E Rovenolt; Angelo J Olcese; Gabriella E Garcia; Sarah M Chacko; Amber Robinson; Edward Gaiser; Julian Acosta; Alison L Herman; Lindsey R Kuohn; Megan Leary; Alexandria L Soto; Qiang Zhang; Safoora Fatima; Guido J Falcone; M Seyedmehdi Payabvash; Richa Sharma; Aaron F Struck; Kevin N Sheth; M Brandon Westover; Jennifer A Kim Journal: JAMA Netw Open Date: 2022-08-01
Authors: Matthew D Li; Peter A Wood; Tarik K Alkasab; Michael H Lev; Jayashree Kalpathy-Cramer; Marc D Succi Journal: Am J Emerg Med Date: 2021-05-27 Impact factor: 4.093