PURPOSE: To evaluate a self-test for Dutch breast screening radiologists introduced as part of the national quality assurance programme. METHODS AND MATERIALS: A total of 144 radiologists were invited to complete a test-set of 60 screening mammograms (20 malignancies). Participants assigned findings such as location, lesion type and BI-RADS. We determined areas under the receiver operating characteristics (ROC) curves (AUC), case and lesion sensitivity and specificity, agreement (kappa) and correlation between reader characteristics and case sensitivity (Spearman correlation coefficients). RESULTS: A total of 110 radiologists completed the test (76%). Participants read a median number of 10,000 screening mammograms/year. Median AUC value was 0.93, case and lesion sensitivity was 91% and case specificity 94%. We found substantial agreement for recall (κ = 0.77) and laterality (κ = 0.80), moderate agreement for lesion type (κ = 0.57) and BI-RADS (κ = 0.45) and no correlation between case sensitivity and reader characteristics. CONCLUSION: Areas under the ROC curve, case sensitivity and lesion sensitivity were satisfactory and recall agreement was substantial. However, agreement in lesion type and BI-RADS could be improved; further education might be aimed at reducing interobserver variation in interpretation and description of abnormalities. We offered individual feedback on interpretive performance and overall feedback at group level. Future research will determine whether performance has improved. KEY POINTS: • We introduced and evaluated a self-test for Dutch breast screening radiologists. • ROC curves, case and lesion sensitivity and recall agreement were all satisfactory. • Agreement in BI-RADS interpretation and description of abnormalities could be improved. • These are areas that should be targeted with further education and training. • We offered individual feedback on interpretative performance and overall group feedback.
PURPOSE: To evaluate a self-test for Dutch breast screening radiologists introduced as part of the national quality assurance programme. METHODS AND MATERIALS: A total of 144 radiologists were invited to complete a test-set of 60 screening mammograms (20 malignancies). Participants assigned findings such as location, lesion type and BI-RADS. We determined areas under the receiver operating characteristics (ROC) curves (AUC), case and lesion sensitivity and specificity, agreement (kappa) and correlation between reader characteristics and case sensitivity (Spearman correlation coefficients). RESULTS: A total of 110 radiologists completed the test (76%). Participants read a median number of 10,000 screening mammograms/year. Median AUC value was 0.93, case and lesion sensitivity was 91% and case specificity 94%. We found substantial agreement for recall (κ = 0.77) and laterality (κ = 0.80), moderate agreement for lesion type (κ = 0.57) and BI-RADS (κ = 0.45) and no correlation between case sensitivity and reader characteristics. CONCLUSION: Areas under the ROC curve, case sensitivity and lesion sensitivity were satisfactory and recall agreement was substantial. However, agreement in lesion type and BI-RADS could be improved; further education might be aimed at reducing interobserver variation in interpretation and description of abnormalities. We offered individual feedback on interpretive performance and overall feedback at group level. Future research will determine whether performance has improved. KEY POINTS: • We introduced and evaluated a self-test for Dutch breast screening radiologists. • ROC curves, case and lesion sensitivity and recall agreement were all satisfactory. • Agreement in BI-RADS interpretation and description of abnormalities could be improved. • These are areas that should be targeted with further education and training. • We offered individual feedback on interpretative performance and overall group feedback.
Authors: Elizabeth Lazarus; Martha B Mainiero; Barbara Schepps; Susan L Koelliker; Linda S Livingston Journal: Radiology Date: 2006-03-28 Impact factor: 11.105
Authors: Patricia A Carney; T Andrew Bogart; Berta M Geller; Sebastian Haneuse; Karla Kerlikowske; Diana S M Buist; Robert Smith; Robert Rosenberg; Bonnie C Yankaskas; Tracy Onega; Diana L Miglioretti Journal: AJR Am J Roentgenol Date: 2012-04 Impact factor: 3.959
Authors: B C Yankaskas; C N Klabunde; R Ancelle-Park; G Renner; H Wang; J Fracheboud; G Pou; J-L Bulliard Journal: J Med Screen Date: 2004 Impact factor: 2.136
Authors: Diana L Miglioretti; Charlotte C Gard; Patricia A Carney; Tracy L Onega; Diana S M Buist; Edward A Sickles; Karla Kerlikowske; Robert D Rosenberg; Bonnie C Yankaskas; Berta M Geller; Joann G Elmore Journal: Radiology Date: 2009-09-29 Impact factor: 11.105
Authors: Joann G Elmore; Sara L Jackson; Linn Abraham; Diana L Miglioretti; Patricia A Carney; Berta M Geller; Bonnie C Yankaskas; Karla Kerlikowske; Tracy Onega; Robert D Rosenberg; Edward A Sickles; Diana S M Buist Journal: Radiology Date: 2009-10-28 Impact factor: 11.105
Authors: Tracy Onega; Megan Smith; Diana L Miglioretti; Patricia A Carney; Berta A Geller; Karla Kerlikowske; Diana S M Buist; Robert D Rosenberg; Robert A Smith; Edward A Sickles; Sebastien Haneuse; Melissa L Anderson; Bonnie Yankaskas Journal: J Am Coll Radiol Date: 2012-11 Impact factor: 5.532