Nathaniel Linna1, Charles E Kahn2. 1. Department of Radiology, University of Pennsylvania, 3400 Spruce Street, Philadelphia, PA 19104, USA. Electronic address: Nathaniel.Linna@pennmedicine.upenn.edu. 2. Department of Radiology, University of Pennsylvania, 3400 Spruce Street, Philadelphia, PA 19104, USA; Institute for Biomedical Informatics, University of Pennsylvania, USA. Electronic address: ckahn@upenn.edu.
Abstract
BACKGROUND: Recent advances in performance of natural language processing (NLP) techniques have spurred wider use and more sophisticated applications of NLP in radiology. This study systematically reviews the trends and applications of NLP in radiology within the last five years. METHODS: A search of three databases of peer-reviewed journal articles and conference papers from January 1, 2016 to April 21, 2021 resulted in a total of 228 publications included in the review. Manuscripts were analyzed by several factors, including clinical application, study setting, NLP technique, and performance. RESULTS: Of the 228 included publications, there was an overall increase in number of studies published with an increase in use of machine learning models. NLP models showed high performance: >50% of publications reported F1 > 0.91. There was variable sample size across the studies with a median of 3708 data points, most commonly radiology reports. 145 studies utilized data from a single academic center. Applications were classified as clinical (n = 87), technical (n = 66), quality improvement (n = 61), research (n = 9), and education (n = 5). DISCUSSION: There has been a continued increase in number of studies involving NLP in radiology. Newer NLP techniques, including word embedding, deep learning, and transformers, are being applied and show improved performance. There has been growth in the interpretative and non-interpretative use of NLP techniques in radiology and has great capacity to improve patient care and delivery. Although the performance and breadth of NLP applications is impressive, there is an overall lack of high-level evidence for actual clinical application of published tools. CONCLUSION: NLP applications in radiology has been increasing studied and more accurate in the last 5 years. More direct clinical application and portability of the NLP pipelines is need to reach the technology's full potential.
BACKGROUND: Recent advances in performance of natural language processing (NLP) techniques have spurred wider use and more sophisticated applications of NLP in radiology. This study systematically reviews the trends and applications of NLP in radiology within the last five years. METHODS: A search of three databases of peer-reviewed journal articles and conference papers from January 1, 2016 to April 21, 2021 resulted in a total of 228 publications included in the review. Manuscripts were analyzed by several factors, including clinical application, study setting, NLP technique, and performance. RESULTS: Of the 228 included publications, there was an overall increase in number of studies published with an increase in use of machine learning models. NLP models showed high performance: >50% of publications reported F1 > 0.91. There was variable sample size across the studies with a median of 3708 data points, most commonly radiology reports. 145 studies utilized data from a single academic center. Applications were classified as clinical (n = 87), technical (n = 66), quality improvement (n = 61), research (n = 9), and education (n = 5). DISCUSSION: There has been a continued increase in number of studies involving NLP in radiology. Newer NLP techniques, including word embedding, deep learning, and transformers, are being applied and show improved performance. There has been growth in the interpretative and non-interpretative use of NLP techniques in radiology and has great capacity to improve patient care and delivery. Although the performance and breadth of NLP applications is impressive, there is an overall lack of high-level evidence for actual clinical application of published tools. CONCLUSION: NLP applications in radiology has been increasing studied and more accurate in the last 5 years. More direct clinical application and portability of the NLP pipelines is need to reach the technology's full potential.
Authors: Matthias A Fink; Klaus Kades; Arved Bischoff; Martin Moll; Merle Schnell; Maike Küchler; Gregor Köhler; Jan Sellner; Claus Peter Heussel; Hans-Ulrich Kauczor; Heinz-Peter Schlemmer; Klaus Maier-Hein; Tim F Weber; Jens Kleesiek Journal: Radiol Artif Intell Date: 2022-07-20