Máté E Maros1, Ralf Wenz2, Alex Förster1, Matthias F Froelich3, Christoph Groden1, Wieland H Sommer3,4, Stefan O Schönberg5, Thomas Henzler5, Holger Wenz6. 1. Department of Neuroradiology, University Medical Center Mannheim, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany. 2. Department of Life Sciences, Faculty of Natural Sciences, Imperial College London, London, U.K. 3. Smart-Radiology, Smart Reporting GmbH, Munich, Germany. 4. Institute for Clinical Radiology, Ludwig Maximilian University Hospital, Munich, Germany. 5. Institute of Clinical Radiology and Nuclear Medicine, University Medical Center Mannheim, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany. 6. Department of Neuroradiology, University Medical Center Mannheim, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany Holger.Wenz@umm.de.
Abstract
BACKGROUND: This feasibility study of text-mining-based scoring algorithm provides an objective comparison of structured reports (SR) and conventional free-text reports (cFTR) by means of guideline-based key terms. Furthermore, an open-source online version of this ranking algorithm was provided with multilingual text-retrieval pipeline, customizable query and real-time-scoring. MATERIALS AND METHODS: Twenty-five patients with suspected stroke and magnetic resonance imaging were re-assessed by two independent/blinded readers [inexperienced: 3 years; experienced >6 years/Board-certified). SR and cFTR were compared with guideline-query using the cosine similarity score (CSS) and Wilcoxon signed-rank test. RESULTS: All pathological findings (18/18) were identified by SR and cFTR. The impressions section of the SRs of the inexperienced reader had the highest median (0.145) and maximal (0.214) CSS and were rated significantly higher (p=2.21×10-5 and p=1.4×10-4, respectively) than cFTR (median=0.102). CSS was robust to variations of query. CONCLUSION: Objective guideline-based comparison of SRs and cFTRs using the CSS is feasible and provides a scalable quality measure that can facilitate the adoption of structured reports in all fields of radiology. Copyright
BACKGROUND: This feasibility study of text-mining-based scoring algorithm provides an objective comparison of structured reports (SR) and conventional free-text reports (cFTR) by means of guideline-based key terms. Furthermore, an open-source online version of this ranking algorithm was provided with multilingual text-retrieval pipeline, customizable query and real-time-scoring. MATERIALS AND METHODS: Twenty-five patients with suspected stroke and magnetic resonance imaging were re-assessed by two independent/blinded readers [inexperienced: 3 years; experienced >6 years/Board-certified). SR and cFTR were compared with guideline-query using the cosine similarity score (CSS) and Wilcoxon signed-rank test. RESULTS: All pathological findings (18/18) were identified by SR and cFTR. The impressions section of the SRs of the inexperienced reader had the highest median (0.145) and maximal (0.214) CSS and were rated significantly higher (p=2.21×10-5 and p=1.4×10-4, respectively) than cFTR (median=0.102). CSS was robust to variations of query. CONCLUSION: Objective guideline-based comparison of SRs and cFTRs using the CSS is feasible and provides a scalable quality measure that can facilitate the adoption of structured reports in all fields of radiology. Copyright
Authors: Keith J Dreyer; Mannudeep K Kalra; Michael M Maher; Autumn M Hurier; Benjamin A Asfaw; Thomas Schultz; Elkan F Halpern; James H Thrall Journal: Radiology Date: 2004-12-10 Impact factor: 11.105
Authors: Pragya A Dang; Mannudeep K Kalra; Michael A Blake; Thomas J Schultz; Markus Stout; Paul R Lemay; David J Freshman; Elkan F Halpern; Keith J Dreyer Journal: J Am Coll Radiol Date: 2008-03 Impact factor: 5.532
Authors: Max Wintermark; Pina C Sanelli; Gregory W Albers; Jacqueline A Bello; Colin P Derdeyn; Steven W Hetts; Michele H Johnson; Chelsea S Kidwell; Michael H Lev; David S Liebeskind; Howard A Rowley; Pamela W Schaefer; Jeffrey L Sunshine; Greg Zaharchuk; Carolyn C Meltzer Journal: J Am Coll Radiol Date: 2013-08-13 Impact factor: 5.532
Authors: Arlene Casey; Emma Davidson; Michael Poon; Hang Dong; Daniel Duma; Andreas Grivas; Claire Grover; Víctor Suárez-Paniagua; Richard Tobin; William Whiteley; Honghan Wu; Beatrice Alex Journal: BMC Med Inform Decis Mak Date: 2021-06-03 Impact factor: 2.796