Literature DB >> 18682584

The "laboratory" effect: comparing radiologists' performance and variability during prospective clinical and laboratory mammography interpretations.

David Gur1, Andriy I Bandos, Cathy S Cohen, Christiane M Hakim, Lara A Hardesty, Marie A Ganott, Ronald L Perrin, William R Poller, Ratan Shah, Jules H Sumkin, Luisa P Wallace, Howard E Rockette.   

Abstract

PURPOSE: To compare radiologists' performance during interpretation of screening mammograms in the clinic with their performance when reading the same mammograms in a retrospective laboratory study.
MATERIALS AND METHODS: This study was conducted under an institutional review board-approved, HIPAA-compliant protocol; the need for informed consent was waived. Nine experienced radiologists rated an enriched set of mammograms that they had personally read in the clinic (the "reader-specific" set) mixed with an enriched "common" set of mammograms that none of the participants had previously read in the clinic by using a screening Breast Imaging Reporting and Data System (BI-RADS) rating scale. The original clinical recommendations to recall the women for a diagnostic work-up, for both reader-specific and common sets, were compared with their recommendations during the retrospective experiment. The results are presented in terms of reader-specific and group-averaged sensitivity and specificity levels and the dispersion (spread) of reader-specific performance estimates.
RESULTS: On average, the radiologists' performance was significantly better in the clinic than in the laboratory (P = .035). Interreader dispersion of the computed performance levels was significantly lower during the clinical interpretations (P < .01).
CONCLUSION: Retrospective laboratory experiments may not represent either expected performance levels or interreader variability during clinical interpretations of the same set of mammograms in the clinical environment well. (c) RSNA, 2008.

Entities:  

Mesh:

Year:  2008        PMID: 18682584      PMCID: PMC2607194          DOI: 10.1148/radiol.2491072025

Source DB:  PubMed          Journal:  Radiology        ISSN: 0033-8419            Impact factor:   11.105


  27 in total

1.  Improving the accuracy of mammography: volume and outcome relationships.

Authors:  Laura Esserman; Helen Cowley; Carey Eberle; Alastair Kirkpatrick; Sophia Chang; Kevin Berbaum; Alastair Gale
Journal:  J Natl Cancer Inst       Date:  2002-03-06       Impact factor: 13.506

2.  Changes in breast cancer detection and mammography recall rates after the introduction of a computer-aided detection system.

Authors:  David Gur; Jules H Sumkin; Howard E Rockette; Marie Ganott; Christiane Hakim; Lara Hardesty; William R Poller; Ratan Shah; Luisa Wallace
Journal:  J Natl Cancer Inst       Date:  2004-02-04       Impact factor: 13.506

Review 3.  Assessment of medical imaging and computer-assist systems: lessons from recent experience.

Authors:  Robert F Wagner; Sergey V Beiden; Gregory Campbell; Charles E Metz; William M Sacks
Journal:  Acad Radiol       Date:  2002-11       Impact factor: 3.173

4.  Prevalence effect in a laboratory environment.

Authors:  David Gur; Howard E Rockette; Derek R Armfield; Arye Blachar; Jennifer K Bogan; Giuseppe Brancatelli; Cynthia A Britton; Manuel L Brown; Peter L Davis; James V Ferris; Carl R Fuhrman; Sara K Golla; Sanj Katyal; Joan M Lacomis; Barry M McCook; F Leland Thaete; Thomas E Warfel
Journal:  Radiology       Date:  2003-07       Impact factor: 11.105

5.  Receiver operating characteristic rating analysis. Generalization to the population of readers and patients with the jackknife method.

Authors:  D D Dorfman; K S Berbaum; C E Metz
Journal:  Invest Radiol       Date:  1992-09       Impact factor: 6.016

6.  Multireader, multicase receiver operating characteristic analysis: an empirical comparison of five methods.

Authors:  Nancy A Obuchowski; Sergey V Beiden; Kevin S Berbaum; Stephen L Hillis; Hemant Ishwaran; Hae Hiang Song; Robert F Wagner
Journal:  Acad Radiol       Date:  2004-09       Impact factor: 3.173

7.  Quality standards and certification requirements for mammography facilities--FDA. Interim rule with request for comments.

Authors: 
Journal:  Fed Regist       Date:  1993-12-21

8.  Effect of observer instruction on ROC study of chest images.

Authors:  D Gur; H E Rockette; W F Good; B S Slasky; L A Cooperstein; W H Straub; N A Obuchowski; C E Metz
Journal:  Invest Radiol       Date:  1990-03       Impact factor: 6.016

9.  Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach.

Authors:  E R DeLong; D M DeLong; D L Clarke-Pearson
Journal:  Biometrics       Date:  1988-09       Impact factor: 2.571

10.  Variability in radiologists' interpretations of mammograms.

Authors:  J G Elmore; C K Wells; C H Lee; D H Howard; A R Feinstein
Journal:  N Engl J Med       Date:  1994-12-01       Impact factor: 91.245

View more
  67 in total

Review 1.  Systematic review: bias in imaging studies - the effect of manipulating clinical context, recall bias and reporting intensity.

Authors:  Darren Boone; Steve Halligan; Susan Mallett; Stuart A Taylor; Douglas G Altman
Journal:  Eur Radiol       Date:  2011-09-30       Impact factor: 5.315

2.  Standalone computer-aided detection compared to radiologists' performance for the detection of mammographic masses.

Authors:  Rianne Hupse; Maurice Samulski; Marc Lobbes; Ard den Heeten; Mechli W Imhof-Tas; David Beijerinck; Ruud Pijnappel; Carla Boetes; Nico Karssemeijer
Journal:  Eur Radiol       Date:  2012-07-08       Impact factor: 5.315

3.  Exploring the potential of context-sensitive CADe in screening mammography.

Authors:  Georgia D Tourassi; Maciej A Mazurowski; Brian P Harrawood; Elizabeth A Krupinski
Journal:  Med Phys       Date:  2010-11       Impact factor: 4.071

4.  Evaluating imaging and computer-aided detection and diagnosis devices at the FDA.

Authors:  Brandon D Gallas; Heang-Ping Chan; Carl J D'Orsi; Lori E Dodd; Maryellen L Giger; David Gur; Elizabeth A Krupinski; Charles E Metz; Kyle J Myers; Nancy A Obuchowski; Berkman Sahiner; Alicia Y Toledano; Margarita L Zuley
Journal:  Acad Radiol       Date:  2012-02-03       Impact factor: 3.173

5.  Quantra™ should be considered a tool for two-grade scale mammographic breast density classification.

Authors:  Ernest U Ekpo; Mark F McEntee; Mary Rickard; Patrick C Brennan; Jyotsna Kunduri; Delgermaa Demchig; Claudia Mello-Thoms
Journal:  Br J Radiol       Date:  2016-02-16       Impact factor: 3.039

6.  Radiological technologists' performance for the detection of malignant microcalcifications in digital mammograms without and with a computer-aided detection system.

Authors:  Rie Tanaka; Miho Takamori; Yoshikazu Uchiyama; Junji Shiraishi
Journal:  J Med Imaging (Bellingham)       Date:  2015-05-27

7.  Lexicon for standardized interpretation of gamma camera molecular breast imaging: observer agreement and diagnostic accuracy.

Authors:  Amy Lynn Conners; Carrie B Hruska; Cindy L Tortorelli; Robert W Maxwell; Deborah J Rhodes; Judy C Boughey; Wendie A Berg
Journal:  Eur J Nucl Med Mol Imaging       Date:  2012-06       Impact factor: 9.236

8.  Quantifying the clinical relevance of a laboratory observer performance paradigm.

Authors:  D P Chakraborty; T M Haygood; J Ryan; E M Marom; M Evanoff; M F McEntee; P C Brennan
Journal:  Br J Radiol       Date:  2012-05-09       Impact factor: 3.039

9.  Investigating the link between radiologists' gaze, diagnostic decision, and image content.

Authors:  Georgia Tourassi; Sophie Voisin; Vincent Paquit; Elizabeth Krupinski
Journal:  J Am Med Inform Assoc       Date:  2013-06-20       Impact factor: 4.497

10.  Experiences with a self-test for Dutch breast screening radiologists: lessons learnt.

Authors:  J M H Timmers; A L M Verbeek; R M Pijnappel; M J M Broeders; G J den Heeten
Journal:  Eur Radiol       Date:  2013-09-22       Impact factor: 5.315

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.