PURPOSE: To use a standardized set of chest radiographs to quantify interobserver differences and to provide a basis for comparing the diagnostic performance of physicians. MATERIALS AND METHODS: A standardized set of 60 chest radiographs was presented to 162 study participants. Each participant reviewed the radiographs and recorded his or her diagnostic impression by using a fixed five-point scale. These response data were used to generate receiver operating characteristic curves and to establish performance benchmarks. The variations in performance were tested for statistical significance. RESULTS: Significant interobserver variability was identified during these assessments. The composite group of board-certified radiologists demonstrated performance superior to that of the radiology residents and nonradiologist physicians. CONCLUSION: By using a receiver operating characteristic approach and a standardized set of chest radiographs, observer accuracy and variability are easily quantified. This approach provides a basis for comparing the diagnostic performance of physicians. When value is measured as a diminution in uncertainty, board-certified radiologists contribute substantial value to the diagnostic imaging system.
PURPOSE: To use a standardized set of chest radiographs to quantify interobserver differences and to provide a basis for comparing the diagnostic performance of physicians. MATERIALS AND METHODS: A standardized set of 60 chest radiographs was presented to 162 study participants. Each participant reviewed the radiographs and recorded his or her diagnostic impression by using a fixed five-point scale. These response data were used to generate receiver operating characteristic curves and to establish performance benchmarks. The variations in performance were tested for statistical significance. RESULTS: Significant interobserver variability was identified during these assessments. The composite group of board-certified radiologists demonstrated performance superior to that of the radiology residents and nonradiologist physicians. CONCLUSION: By using a receiver operating characteristic approach and a standardized set of chest radiographs, observer accuracy and variability are easily quantified. This approach provides a basis for comparing the diagnostic performance of physicians. When value is measured as a diminution in uncertainty, board-certified radiologists contribute substantial value to the diagnostic imaging system.
Authors: Samuel G Armato; Michael F McNitt-Gray; Anthony P Reeves; Charles R Meyer; Geoffrey McLennan; Denise R Aberle; Ella A Kazerooni; Heber MacMahon; Edwin J R van Beek; David Yankelevitz; Eric A Hoffman; Claudia I Henschke; Rachael Y Roberts; Matthew S Brown; Roger M Engelmann; Richard C Pais; Christopher W Piker; David Qing; Masha Kocherginsky; Barbara Y Croft; Laurence P Clarke Journal: Acad Radiol Date: 2007-11 Impact factor: 3.173
Authors: Leo L Tsai; Ross W Mair; Chih-Hao Li; Matthew S Rosen; Samuel Patz; Ronald L Walsworth Journal: Acad Radiol Date: 2008-06 Impact factor: 3.173
Authors: Uta Zaspel; David W Denning; Arne J Lemke; Reginald Greene; Dirk Schürmann; Georg Maschmeyer; Markus Ruhnke; Raoul Herbrecht; Patricia Ribaud; Olivier Lortholary; Harmien Zonderland; Klaus F Rabe; Rainer Röttgen; Roland Bittner; Klaus Neumann; Joerg W Oestmann Journal: Eur Radiol Date: 2004-08-11 Impact factor: 5.315