OBJECTIVE: We conducted an analysis among 31 community radiologists to identify the average change in screening mammography interpretive accuracy afforded by independent double interpretation. MATERIALS AND METHODS: We assessed interpretive accuracy using a stratified random sample of test mammograms that included 30 women with cancer and 83 without. Radiologists were unaware of clinical information and of each other's assessments. We describe accuracy for individual radiologists and for double interpretation, including average sensitivity, specificity, diagnostic likelihood ratios positive and negative, and area under the receiver operating characteristic (ROC) curve. We also assessed weighted and nonweighted kappa statistics among all 465 pairs of radiologists and 31,465 pairs of unique pairs. The assessment for double interpretations used the "highest" (i.e., most abnormal) assessment of the two radiologists. We calculated the difference between each radiologist's individual accuracy and the average accuracy across that radiologist's 30 double interpretations. RESULTS: We found the following average accuracy statistics for individual radiologists: sensitivity, 79%; specificity, 81%; diagnostic likelihood ratio positive, 5.53; diagnostic likelihood ratio negative, 0.26; and area under the ROC curve, 0.85. The mean kappa statistic among radiologists for cancer cases increased with double interpretation from 0.59 to 0.70, and for noncancer cases from 0.30 to 0.34. Double interpretation resulted in an average increase in sensitivity of 7%, an average decrease in specificity of 11%, a decrease in diagnostic likelihood ratio positive of 2.35, a decrease in diagnostic likelihood ratio negative of 0.06, and an increase in area under the ROC curve of 0.02. CONCLUSION: Independent double interpretation does not increase accuracy as measured by the area under the ROC curve.
OBJECTIVE: We conducted an analysis among 31 community radiologists to identify the average change in screening mammography interpretive accuracy afforded by independent double interpretation. MATERIALS AND METHODS: We assessed interpretive accuracy using a stratified random sample of test mammograms that included 30 women with cancer and 83 without. Radiologists were unaware of clinical information and of each other's assessments. We describe accuracy for individual radiologists and for double interpretation, including average sensitivity, specificity, diagnostic likelihood ratios positive and negative, and area under the receiver operating characteristic (ROC) curve. We also assessed weighted and nonweighted kappa statistics among all 465 pairs of radiologists and 31,465 pairs of unique pairs. The assessment for double interpretations used the "highest" (i.e., most abnormal) assessment of the two radiologists. We calculated the difference between each radiologist's individual accuracy and the average accuracy across that radiologist's 30 double interpretations. RESULTS: We found the following average accuracy statistics for individual radiologists: sensitivity, 79%; specificity, 81%; diagnostic likelihood ratio positive, 5.53; diagnostic likelihood ratio negative, 0.26; and area under the ROC curve, 0.85. The mean kappa statistic among radiologists for cancer cases increased with double interpretation from 0.59 to 0.70, and for noncancer cases from 0.30 to 0.34. Double interpretation resulted in an average increase in sensitivity of 7%, an average decrease in specificity of 11%, a decrease in diagnostic likelihood ratio positive of 2.35, a decrease in diagnostic likelihood ratio negative of 0.06, and an increase in area under the ROC curve of 0.02. CONCLUSION: Independent double interpretation does not increase accuracy as measured by the area under the ROC curve.
Authors: R Edward Hendrick; Gary R Cutter; Eric A Berns; Connie Nakano; Joseph Egger; Patricia A Carney; Linn Abraham; Stephen H Taplin; Carl J D'Orsi; William Barlow; Joann G Elmore Journal: AJR Am J Roentgenol Date: 2005-02 Impact factor: 3.959
Authors: Jun Wei; Heang-Ping Chan; Chuan Zhou; Yi-Ta Wu; Berkman Sahiner; Lubomir M Hadjiiski; Marilyn A Roubidoux; Mark A Helvie Journal: Med Phys Date: 2011-04 Impact factor: 4.071
Authors: Shinsaku Sakurada; Nguyen T L Hang; Naoki Ishizuka; Emiko Toyota; Le D Hung; Pham T Chuc; Luu T Lien; Pham H Thuong; Pham T N Bich; Naoto Keicho; Nobuyuki Kobayashi Journal: BMC Infect Dis Date: 2012-02-01 Impact factor: 3.090
Authors: James R Hands; Graeme Clemens; Ryan Stables; Katherine Ashton; Andrew Brodbelt; Charles Davis; Timothy P Dawson; Michael D Jenkinson; Robert W Lea; Carol Walker; Matthew J Baker Journal: J Neurooncol Date: 2016-02-13 Impact factor: 4.130
Authors: L E M Duijm; M W J Louwman; J H Groenewoud; L V van de Poll-Franse; J Fracheboud; J W Coebergh Journal: Br J Cancer Date: 2009-03-03 Impact factor: 7.640