Daniel T Ginat1. 1. Department of Radiology, Section of Neuroradiology, University of Chicago, 5841 S Maryland Avenue, Chicago, IL, 60637, USA. dtg1@uchicago.edu.
Abstract
PURPOSE: To analyze the implementation of deep learning software for the detection and worklist prioritization of acute intracranial hemorrhage on non-contrast head CT (NCCT) in various clinical settings at an academic medical center. METHODS: Urgent NCCT scans were reviewed by the Aidoc (Tel Aviv, Israel) neural network software. All cases flagged by the software as positive for acute intracranial hemorrhage on the neuroradiology worklist were prospectively included in this assessment. The scans were classified regarding presence and type of hemorrhage, whether these were initial or follow-up scans, and patient visit location, including trauma/emergency, inpatient, and outpatient departments. RESULTS: During the 2 months of enrollment, 373 NCCT scans were flagged by the Aidoc software for possible intracranial hemorrhage out of 2011 scans analyzed (18.5%). Among the flagged cases, 275 (72.4%) were positive; 290 (77.7%) were inpatient cases, 75 (20.1%) were trauma/emergency cases, and eight (2.1%) were outpatient cases, and 229 of 373 (62.5%) were follow-up cases, of which 219 (95.6%) inpatient cases. Among the 144 new cases flagged for hemorrhage, 66 (44.4%) were positive, of which 39 (58.2%) were trauma/emergency cases. The overall sensitivity, specificity, positive predictive value, negative predictive value, and accuracy were 88.7%, 94.2% and 73.7%, 97.7%, and 93.4%, respectively. The accuracy of the intracranial hemorrhage detection was significantly higher for emergency cases than for inpatient cases (96.5% versus 89.4%). CONCLUSION: This study reveals that the performance of the deep learning software for acute intracranial hemorrhage detection varies depending upon the patient visit location. Furthermore, a substantial portion of flagged cases were follow-up exams, the majority of which were inpatient exams. These findings can help optimize the artificial intelligence-driven clincical workflow.
PURPOSE: To analyze the implementation of deep learning software for the detection and worklist prioritization of acute intracranial hemorrhage on non-contrast head CT (NCCT) in various clinical settings at an academic medical center. METHODS: Urgent NCCT scans were reviewed by the Aidoc (Tel Aviv, Israel) neural network software. All cases flagged by the software as positive for acute intracranial hemorrhage on the neuroradiology worklist were prospectively included in this assessment. The scans were classified regarding presence and type of hemorrhage, whether these were initial or follow-up scans, and patient visit location, including trauma/emergency, inpatient, and outpatient departments. RESULTS: During the 2 months of enrollment, 373 NCCT scans were flagged by the Aidoc software for possible intracranial hemorrhage out of 2011 scans analyzed (18.5%). Among the flagged cases, 275 (72.4%) were positive; 290 (77.7%) were inpatient cases, 75 (20.1%) were trauma/emergency cases, and eight (2.1%) were outpatient cases, and 229 of 373 (62.5%) were follow-up cases, of which 219 (95.6%) inpatient cases. Among the 144 new cases flagged for hemorrhage, 66 (44.4%) were positive, of which 39 (58.2%) were trauma/emergency cases. The overall sensitivity, specificity, positive predictive value, negative predictive value, and accuracy were 88.7%, 94.2% and 73.7%, 97.7%, and 93.4%, respectively. The accuracy of the intracranial hemorrhage detection was significantly higher for emergency cases than for inpatient cases (96.5% versus 89.4%). CONCLUSION: This study reveals that the performance of the deep learning software for acute intracranial hemorrhage detection varies depending upon the patient visit location. Furthermore, a substantial portion of flagged cases were follow-up exams, the majority of which were inpatient exams. These findings can help optimize the artificial intelligence-driven clincical workflow.
Entities:
Keywords:
CT; Deep learning; Intracranial hemorrhage; Neural networks
Authors: Robert J McDonald; Kara M Schwartz; Laurence J Eckel; Felix E Diehn; Christopher H Hunt; Brian J Bartholmai; Bradley J Erickson; David F Kallmes Journal: Acad Radiol Date: 2015-07-22 Impact factor: 3.173
Authors: Charlotte Jj van Asch; Merel Ja Luitse; Gabriël Je Rinkel; Ingeborg van der Tweel; Ale Algra; Catharina Jm Klijn Journal: Lancet Neurol Date: 2010-01-05 Impact factor: 44.182
Authors: Darin B Zahuranec; Lynda D Lisabeth; Brisa N Sánchez; Melinda A Smith; Devin L Brown; Nelda M Garcia; Lesli E Skolarus; William J Meurer; James F Burke; Eric E Adelman; Lewis B Morgenstern Journal: Neurology Date: 2014-05-16 Impact factor: 9.910
Authors: Mohammad R Arbabshirani; Brandon K Fornwalt; Gino J Mongelluzzo; Jonathan D Suever; Brandon D Geise; Aalpen A Patel; Gregory J Moore Journal: NPJ Digit Med Date: 2018-04-04
Authors: Adam E Flanders; Luciano M Prevedello; George Shih; Safwan S Halabi; Jayashree Kalpathy-Cramer; Robyn Ball; John T Mongan; Anouk Stein; Felipe C Kitamura; Matthew P Lungren; Gagandeep Choudhary; Lesley Cala; Luiz Coelho; Monique Mogensen; Fanny Morón; Elka Miller; Ichiro Ikuta; Vahe Zohrabian; Olivia McDonnell; Christie Lincoln; Lubdha Shah; David Joyner; Amit Agarwal; Ryan K Lee; Jaya Nath Journal: Radiol Artif Intell Date: 2020-04-29
Authors: Y W Lui; P D Chang; G Zaharchuk; D P Barboriak; A E Flanders; M Wintermark; C P Hess; C G Filippi Journal: AJNR Am J Neuroradiol Date: 2020-07-30 Impact factor: 3.825
Authors: Muhannad Seyam; Thomas Weikert; Alexander Sauter; Alex Brehm; Marios-Nikos Psychogios; Kristine A Blackham Journal: Radiol Artif Intell Date: 2022-02-09
Authors: Yasasvi Tadavarthi; Valeria Makeeva; William Wagstaff; Henry Zhan; Anna Podlasek; Neil Bhatia; Marta Heilbrun; Elizabeth Krupinski; Nabile Safdar; Imon Banerjee; Judy Gichoya; Hari Trivedi Journal: Radiol Artif Intell Date: 2022-02-02
Authors: J J Heit; H Coelho; F O Lima; M Granja; A Aghaebrahim; R Hanel; K Kwok; H Haerian; C W Cereda; C Venkatasubramanian; S Dehkharghani; L A Carbonera; J Wiener; K Copeland; F Mont'Alverne Journal: AJNR Am J Neuroradiol Date: 2020-12-24 Impact factor: 3.825
Authors: Johannes Rueckel; Jonathan I Sperl; Sophia Kaestle; Boj F Hoppe; Nicola Fink; Jan Rudolph; Vincent Schwarze; Thomas Geyer; Frederik F Strobl; Jens Ricke; Michael Ingrisch; Bastian O Sabel Journal: Quant Imaging Med Surg Date: 2021-06
Authors: Kamil Zeleňák; Antonín Krajina; Lukas Meyer; Jens Fiehler; Daniel Behme; Deniz Bulja; Jildaz Caroff; Amar Ajay Chotai; Valerio Da Ros; Jean-Christophe Gentric; Jeremy Hofmeister; Omar Kass-Hout; Özcan Kocatürk; Jeremy Lynch; Ernesto Pearson; Ivan Vukasinovic Journal: Life (Basel) Date: 2021-05-27