Christiana Balta1,2, Ramona W Bouwman1, Ioannis Sechopoulos1,2, Mireille J M Broeders1,3, Nico Karssemeijer2, Ruben E van Engen1, Wouter J H Veldkamp4. 1. Dutch Expert Centre for Screening (LRCB), Radboud University Medical Center, Wijchenseweg 101, 6538 SW, Nijmegen, The Netherlands. 2. Department of Radiology and Nuclear Medicine, Radboud University Medical Center, PO Box 9101, 6500 HB, Nijmegen, The Netherlands. 3. Department for Health Evidence, Radboud University Medical Center, PO Box 9101, 6500 HB, Nijmegen, The Netherlands. 4. Department of Radiology, Leiden University Medical Center, Albinusdreef 2, 2333 ZA, Leiden, The Netherlands.
Abstract
PURPOSE: To study the feasibility of a task-based framework composed of an anthropomorphic breast phantom and mathematical model observers (MOs) for the evaluation of system-processed mammographic images. METHODS: A prototype anthropomorphic breast phantom with inserted gold discs of 0.1 mm and 0.25 mm diameter was imaged with two digital mammography systems (system A and B) at four different dose levels. From the acquired processed and unprocessed images, signal-present and signal-absent regions of interest (ROIs) were extracted. The ROIs were evaluated by a non-pre-whitening MO with eye filter (NPWE) and by three human observers in a two-alternative forced-choice experiment. We compared the human and the MO performance on a simple detection task of the calcification-like discs in ROIs with and without postprocessing. Proportion of correct responses of the human (PCH ) and NPWE (PCNPWE ) experiments was calculated and the correlation between the two was analyzed using a mixed-effect regression model. Correlation results including the goodness of fit (r2 ) of PCH and PCNPWE for all different parameters investigated were evaluated to determine whether NPWE MO can be used to predict human observer performance. RESULTS: PCH and PCNPWE increased with dose for all conditions investigated (signal size, processing status, and different system). In case of the 0.1 mm discs, for system A, r2 between PCH with PCNPWE was 0.81. For system B, r2 was 0.93. In case of the 0.25 mm discs, r2 in system A was 0.79 and for system B, r2 was 0.82. For the combined parameters investigated, and after excluding the 0.1 mm discs on system A because the results were influenced by aliasing, the overall r2 was 0.81. Image processing did not affect the detectability of calcification-like signals. No significant difference (P > 0.05) was found between the predicted PCH(pred) by the MO and the PCH for all different conditions. CONCLUSIONS: The framework seems promising to be used in objective image quality assessment. It was found to be relatively robust for the range of parameters investigated. However, further optimization of the anthropomorphic breast phantom and investigation of other MOs for a broader range of image quality assessment tasks is needed.
PURPOSE: To study the feasibility of a task-based framework composed of an anthropomorphic breast phantom and mathematical model observers (MOs) for the evaluation of system-processed mammographic images. METHODS: A prototype anthropomorphic breast phantom with inserted gold discs of 0.1 mm and 0.25 mm diameter was imaged with two digital mammography systems (system A and B) at four different dose levels. From the acquired processed and unprocessed images, signal-present and signal-absent regions of interest (ROIs) were extracted. The ROIs were evaluated by a non-pre-whitening MO with eye filter (NPWE) and by three human observers in a two-alternative forced-choice experiment. We compared the human and the MO performance on a simple detection task of the calcification-like discs in ROIs with and without postprocessing. Proportion of correct responses of the human (PCH ) and NPWE (PCNPWE ) experiments was calculated and the correlation between the two was analyzed using a mixed-effect regression model. Correlation results including the goodness of fit (r2 ) of PCH and PCNPWE for all different parameters investigated were evaluated to determine whether NPWE MO can be used to predict human observer performance. RESULTS:PCH and PCNPWE increased with dose for all conditions investigated (signal size, processing status, and different system). In case of the 0.1 mm discs, for system A, r2 between PCH with PCNPWE was 0.81. For system B, r2 was 0.93. In case of the 0.25 mm discs, r2 in system A was 0.79 and for system B, r2 was 0.82. For the combined parameters investigated, and after excluding the 0.1 mm discs on system A because the results were influenced by aliasing, the overall r2 was 0.81. Image processing did not affect the detectability of calcification-like signals. No significant difference (P > 0.05) was found between the predicted PCH(pred) by the MO and the PCH for all different conditions. CONCLUSIONS: The framework seems promising to be used in objective image quality assessment. It was found to be relatively robust for the range of parameters investigated. However, further optimization of the anthropomorphic breast phantom and investigation of other MOs for a broader range of image quality assessment tasks is needed.
Authors: Christiana Balta; Ramona W Bouwman; Wouter J H Veldkamp; Mireille J M Broeders; Ioannis Sechopoulos; Ruben E van Engen Journal: J Med Imaging (Bellingham) Date: 2018-09-08
Authors: Christiana Balta; Ramona W Bouwman; Mireille J M Broeders; Nico Karssemeijer; Wouter J H Veldkamp; Ioannis Sechopoulos; Ruben E van Engen Journal: J Med Imaging (Bellingham) Date: 2019-09-27