Ye Li1,2, Junyu Chen1,2, Justin L Brown3, S Ted Treves4,5, Xinhua Cao5,6, Frederic H Fahey5,6, George Sgouros2, Wesley E Bolch3, Eric C Frey1,2. 1. Johns Hopkins University, Whiting School of Engineering, Department of Electrical and Computer Engineering, Baltimore, Maryland, United States. 2. Johns Hopkins University, School of Medicine, Russell H. Morgan Department of Radiology and Radiological Science, Baltimore, Maryland, United States. 3. University of Florida, J. Crayton Pruitt Family Department of Biomedical Engineering, Gainesville, Florida, United States. 4. Brigham and Women's Hospital, Department of Radiology, Boston, Massachusetts, United States. 5. Harvard Medical School, Department of Radiology, Boston, Massachusetts, United States. 6. Boston Children's Hospital, Department of Radiology, Boston, Massachusetts, United States.
Abstract
Purpose: We propose a deep learning-based anthropomorphic model observer (DeepAMO) for image quality evaluation of multi-orientation, multi-slice image sets with respect to a clinically realistic 3D defect detection task. Approach: The DeepAMO is developed based on a hypothetical model of the decision process of a human reader performing a detection task using a 3D volume. The DeepAMO is comprised of three sequential stages: defect segmentation, defect confirmation (DC), and rating value inference. The input to the DeepAMO is a composite image, typical of that used to view 3D volumes in clinical practice. The output is a rating value designed to reproduce a human observer's defect detection performance. In stages 2 and 3, we propose: (1) a projection-based DC block that confirms defect presence in two 2D orthogonal orientations and (2) a calibration method that "learns" the mapping from the features of stage 2 to the distribution of observer ratings from the human observer rating data (thus modeling inter- or intraobserver variability) using a mixture density network. We implemented and evaluated the DeepAMO in the context of Tc 99 m -DMSA SPECT imaging. A human observer study was conducted, with two medical imaging physics graduate students serving as observers. A 5 × 2 -fold cross-validation experiment was conducted to test the statistical equivalence in defect detection performance between the DeepAMO and the human observer. We also compared the performance of the DeepAMO to an unoptimized implementation of a scanning linear discriminant observer (SLDO). Results: The results show that the DeepAMO's and human observer's performances on unseen images were statistically equivalent with a margin of difference ( Δ AUC ) of 0.0426 at p < 0.05 , using 288 training images. A limited implementation of an SLDO had a substantially higher AUC (0.99) compared to the DeepAMO and human observer. Conclusion: The results show that the DeepAMO has the potential to reproduce the absolute performance, and not just the relative ranking of human observers on a clinically realistic defect detection task, and that building conceptual components of the human reading process into deep learning-based models can allow training of these models in settings where limited training images are available.
Purpose: We propose a deep learning-based anthropomorphic model observer (DeepAMO) for image quality evaluation of multi-orientation, multi-slice image sets with respect to a clinically realistic 3D defect detection task. Approach: The DeepAMO is developed based on a hypothetical model of the decision process of a human reader performing a detection task using a 3D volume. The DeepAMO is comprised of three sequential stages: defect segmentation, defect confirmation (DC), and rating value inference. The input to the DeepAMO is a composite image, typical of that used to view 3D volumes in clinical practice. The output is a rating value designed to reproduce a human observer's defect detection performance. In stages 2 and 3, we propose: (1) a projection-based DC block that confirms defect presence in two 2D orthogonal orientations and (2) a calibration method that "learns" the mapping from the features of stage 2 to the distribution of observer ratings from the human observer rating data (thus modeling inter- or intraobserver variability) using a mixture density network. We implemented and evaluated the DeepAMO in the context of Tc 99 m -DMSA SPECT imaging. A human observer study was conducted, with two medical imaging physics graduate students serving as observers. A 5 × 2 -fold cross-validation experiment was conducted to test the statistical equivalence in defect detection performance between the DeepAMO and the human observer. We also compared the performance of the DeepAMO to an unoptimized implementation of a scanning linear discriminant observer (SLDO). Results: The results show that the DeepAMO's and human observer's performances on unseen images were statistically equivalent with a margin of difference ( Δ AUC ) of 0.0426 at p < 0.05 , using 288 training images. A limited implementation of an SLDO had a substantially higher AUC (0.99) compared to the DeepAMO and human observer. Conclusion: The results show that the DeepAMO has the potential to reproduce the absolute performance, and not just the relative ranking of human observers on a clinically realistic defect detection task, and that building conceptual components of the human reading process into deep learning-based models can allow training of these models in settings where limited training images are available.
Authors: Harrison H Barrett; Matthew A Kupinski; Stefan Müeller; Howard J Halpern; John C Morris; Roisin Dwyer Journal: Phys Med Biol Date: 2013-11-21 Impact factor: 3.609
Authors: Subok Park; Eric Clarkson; Matthew A Kupinski; Harrison H Barrett Journal: J Opt Soc Am A Opt Image Sci Vis Date: 2005-01 Impact factor: 2.129
Authors: Shannon E O'Reilly; Donika Plyku; George Sgouros; Frederic H Fahey; S Ted Treves; Eric C Frey; Wesley E Bolch Journal: Phys Med Biol Date: 2016-03-01 Impact factor: 3.609
Authors: Ye Li; Shannon O'Reilly; Donika Plyku; S Ted Treves; Yong Du; Frederic Fahey; Xinhua Cao; Abhinav K Jha; George Sgouros; Wesley E Bolch; Eric C Frey Journal: Phys Med Biol Date: 2018-07-09 Impact factor: 3.609