Les Irwig1, Petra Macaskill, Stephen D Walter, Nehmat Houssami. 1. Screening and Test Evaluation Program, School of Public Health, Building A 27, University of Sydney, New South Wales 2006, Australia. lesi@health.usyd.edu.au
Abstract
OBJECTIVE: Whether tests such as imaging should be read with or without access to prior clinical information is controversial. Naïve comparisons may suggest that the provision of prior information improves test accuracy, whereas in fact the opposite may be true. This is because provision of clinical background may actually bias test readers to over- or underinterpret relevant test findings, and they may suboptimally integrate the previous and current evidence. We propose comparing the combined accuracy of prior information and a test read (i) with or (ii) without knowledge of prior information. Analysis methods include simple decision rules and logistic regression. STUDY DESIGN AND SETTING: A study of cancer detection in women presenting with breast symptoms, in whom ultrasound could be read with or without reviewing prior mammography. RESULTS: Naïve analysis gave an area under the receiver operating characteristics curve (AUC) for ultrasound read with mammography on view that was 4.6% higher (P < .01) than without mammography on view. Our approach, comparing the combined accuracy of mammography and ultrasound read i) with and ii) without knowledge of mammographic findings, showed much smaller differences. CONCLUSION: Our approach is more appropriate than naïve analyses. The particular choice of analytic method depends on the study size and the diagnostic accuracy of combinations of the prior information and the test reading.
OBJECTIVE: Whether tests such as imaging should be read with or without access to prior clinical information is controversial. Naïve comparisons may suggest that the provision of prior information improves test accuracy, whereas in fact the opposite may be true. This is because provision of clinical background may actually bias test readers to over- or underinterpret relevant test findings, and they may suboptimally integrate the previous and current evidence. We propose comparing the combined accuracy of prior information and a test read (i) with or (ii) without knowledge of prior information. Analysis methods include simple decision rules and logistic regression. STUDY DESIGN AND SETTING: A study of cancer detection in women presenting with breast symptoms, in whom ultrasound could be read with or without reviewing prior mammography. RESULTS: Naïve analysis gave an area under the receiver operating characteristics curve (AUC) for ultrasound read with mammography on view that was 4.6% higher (P < .01) than without mammography on view. Our approach, comparing the combined accuracy of mammography and ultrasound read i) with and ii) without knowledge of mammographic findings, showed much smaller differences. CONCLUSION: Our approach is more appropriate than naïve analyses. The particular choice of analytic method depends on the study size and the diagnostic accuracy of combinations of the prior information and the test reading.
Authors: Adrienne van Randen; Wytze Laméris; C Yung Nio; Anje M Spijkerboer; Mark A Meier; Charlotte Tutein Nolthenius; Frank Smithuis; Patrick M Bossuyt; Marja A Boermeester; Jaap Stoker Journal: Eur Radiol Date: 2009-02-21 Impact factor: 5.315
Authors: Elizabeth S Burnside; Jesse Davis; Jagpreet Chhatwal; Oguzhan Alagoz; Mary J Lindstrom; Berta M Geller; Benjamin Littenberg; Katherine A Shaffer; Charles E Kahn; C David Page Journal: Radiology Date: 2009-04-14 Impact factor: 11.105
Authors: Madelon M Voets; Catharina G M Groothuis-Oudshoorn; Liset H J Veneklaas; Srirang Manohar; Mariël Brinkhuis; Jeroen Veltman; Linda de Munck; Lioe-Fee de Geus-Oei; Mireille J M Broeders; Sabine Siesling Journal: Curr Oncol Date: 2021-11-29 Impact factor: 3.677