Thomas Weikert1, David J Winkel2, Jens Bremerich2, Bram Stieltjes2, Victor Parmar2, Alexander W Sauter2, Gregor Sommer2. 1. Clinic of Radiology & Nuclear Medicine, University Hospital Basel, University of Basel, Petersgraben 4, 4031, Basel, Switzerland. thomas.weikert@usb.ch. 2. Clinic of Radiology & Nuclear Medicine, University Hospital Basel, University of Basel, Petersgraben 4, 4031, Basel, Switzerland.
Abstract
OBJECTIVES: To evaluate the performance of an AI-powered algorithm for the automatic detection of pulmonary embolism (PE) on chest computed tomography pulmonary angiograms (CTPAs) on a large dataset. METHODS: We retrospectively identified all CTPAs conducted at our institution in 2017 (n = 1499). Exams with clinical questions other than PE were excluded from the analysis (n = 34). The remaining exams were classified into positive (n = 232) and negative (n = 1233) for PE based on the final written reports, which defined the reference standard. The fully anonymized 1-mm series in soft tissue reconstruction served as input for the PE detection prototype algorithm that was based on a deep convolutional neural network comprising a Resnet architecture. It was trained and validated on 28,000 CTPAs acquired at other institutions. The result series were reviewed using a web-based feedback platform. Measures of diagnostic performance were calculated on a per patient and a per finding level. RESULTS: The algorithm correctly identified 215 of 232 exams positive for pulmonary embolism (sensitivity 92.7%; 95% confidence interval [CI] 88.3-95.5%) and 1178 of 1233 exams negative for pulmonary embolism (specificity 95.5%; 95% CI 94.2-96.6%). On a per finding level, 1174 of 1352 findings marked as embolus by the algorithm were true emboli. Most of the false positive findings were due to contrast agent-related flow artifacts, pulmonary veins, and lymph nodes. CONCLUSION: The AI prototype algorithm we tested has a high degree of diagnostic accuracy for the detection of PE on CTPAs. Sensitivity and specificity are balanced, which is a prerequisite for its clinical usefulness. KEY POINTS: • An AI-based prototype algorithm showed a high degree of diagnostic accuracy for the detection of pulmonary embolism on CTPAs. • It can therefore help clinicians to automatically prioritize exams with a high suspection of pulmonary embolism and serve as secondary reading tool. • By complementing traditional ways of worklist prioritization in radiology departments, this can speed up the diagnostic and therapeutic workup of patients with pulmonary embolism and help to avoid false negative calls.
OBJECTIVES: To evaluate the performance of an AI-powered algorithm for the automatic detection of pulmonary embolism (PE) on chest computed tomography pulmonary angiograms (CTPAs) on a large dataset. METHODS: We retrospectively identified all CTPAs conducted at our institution in 2017 (n = 1499). Exams with clinical questions other than PE were excluded from the analysis (n = 34). The remaining exams were classified into positive (n = 232) and negative (n = 1233) for PE based on the final written reports, which defined the reference standard. The fully anonymized 1-mm series in soft tissue reconstruction served as input for the PE detection prototype algorithm that was based on a deep convolutional neural network comprising a Resnet architecture. It was trained and validated on 28,000 CTPAs acquired at other institutions. The result series were reviewed using a web-based feedback platform. Measures of diagnostic performance were calculated on a per patient and a per finding level. RESULTS: The algorithm correctly identified 215 of 232 exams positive for pulmonary embolism (sensitivity 92.7%; 95% confidence interval [CI] 88.3-95.5%) and 1178 of 1233 exams negative for pulmonary embolism (specificity 95.5%; 95% CI 94.2-96.6%). On a per finding level, 1174 of 1352 findings marked as embolus by the algorithm were true emboli. Most of the false positive findings were due to contrast agent-related flow artifacts, pulmonary veins, and lymph nodes. CONCLUSION: The AI prototype algorithm we tested has a high degree of diagnostic accuracy for the detection of PE on CTPAs. Sensitivity and specificity are balanced, which is a prerequisite for its clinical usefulness. KEY POINTS: • An AI-based prototype algorithm showed a high degree of diagnostic accuracy for the detection of pulmonary embolism on CTPAs. • It can therefore help clinicians to automatically prioritize exams with a high suspection of pulmonary embolism and serve as secondary reading tool. • By complementing traditional ways of worklist prioritization in radiology departments, this can speed up the diagnostic and therapeutic workup of patients with pulmonary embolism and help to avoid false negative calls.
Authors: Hongxia Zhang; Yan Cheng; Zhenbo Chen; Xinying Cong; Han Kang; Rongguo Zhang; Xiaojuan Guo; Min Liu Journal: Quant Imaging Med Surg Date: 2022-01
Authors: Muhannad Seyam; Thomas Weikert; Alexander Sauter; Alex Brehm; Marios-Nikos Psychogios; Kristine A Blackham Journal: Radiol Artif Intell Date: 2022-02-09
Authors: Julie Adhya; Charles Li; Laura Eisenmenger; Russell Cerejo; Ashis Tayal; Michael Goldberg; Warren Chang Journal: Neuroradiol J Date: 2021-04-28
Authors: Lorraine Abel; Jakob Wasserthal; Thomas Weikert; Alexander W Sauter; Ivan Nesic; Marko Obradovic; Shan Yang; Sebastian Manneck; Carl Glessgen; Johanna M Ospel; Bram Stieltjes; Daniel T Boll; Björn Friebe Journal: Diagnostics (Basel) Date: 2021-05-19