Trafton Drew1, Corbin Cunningham, Jeremy M Wolfe. 1. Visual Attention Lab, Department of Surgery, Brigham & Women's Hospital, 64 Sidney St. Suite. 170, Cambridge, MA 0213-4170, USA. tdrew1@rics.bwh.harvard.edu
Abstract
RATIONAL AND OBJECTIVES: Computer-aided detection (CAD) systems are intended to improve performance. This study investigates how CAD might actually interfere with a visual search task. This is a laboratory study with implications for clinical use of CAD. METHODS: Forty-seven naive observers in two studies were asked to search for a target, embedded in 1/f(2.4) noise while we monitored their eye movements. For some observers, a CAD system marked 75% of targets and 10% of distractors, whereas other observers completed the study without CAD. In experiment 1, the CAD system's primary function was to tell observers where the target might be. In experiment 2, CAD provided information about target identity. RESULTS: In experiment 1, there was a significant enhancement of observer sensitivity in the presence of CAD (t(22) = 4.74, P < .001), but there was also a substantial cost. Targets that were not marked by the CAD system were missed more frequently than equivalent targets in no-CAD blocks of the experiment (t(22) = 7.02, P < .001). Experiment 2 showed no behavioral benefit from CAD, but also no significant cost on sensitivity to unmarked targets (t(22) = 0.6, P = NS). Finally, in both experiments, CAD produced reliable changes in eye movements: CAD observers examined a lower total percentage of the search area than the no-CAD observers (experiment 1: t(48) = 3.05, P < .005; experiment 2: t(50) = 7.31, P < .001). CONCLUSIONS: CAD signals do not combine with observers' unaided performance in a straightforward manner. CAD can engender a sense of certainty that can lead to incomplete search and elevated chances of missing unmarked stimuli.
RATIONAL AND OBJECTIVES: Computer-aided detection (CAD) systems are intended to improve performance. This study investigates how CAD might actually interfere with a visual search task. This is a laboratory study with implications for clinical use of CAD. METHODS: Forty-seven naive observers in two studies were asked to search for a target, embedded in 1/f(2.4) noise while we monitored their eye movements. For some observers, a CAD system marked 75% of targets and 10% of distractors, whereas other observers completed the study without CAD. In experiment 1, the CAD system's primary function was to tell observers where the target might be. In experiment 2, CAD provided information about target identity. RESULTS: In experiment 1, there was a significant enhancement of observer sensitivity in the presence of CAD (t(22) = 4.74, P < .001), but there was also a substantial cost. Targets that were not marked by the CAD system were missed more frequently than equivalent targets in no-CAD blocks of the experiment (t(22) = 7.02, P < .001). Experiment 2 showed no behavioral benefit from CAD, but also no significant cost on sensitivity to unmarked targets (t(22) = 0.6, P = NS). Finally, in both experiments, CAD produced reliable changes in eye movements: CAD observers examined a lower total percentage of the search area than the no-CAD observers (experiment 1: t(48) = 3.05, P < .005; experiment 2: t(50) = 7.31, P < .001). CONCLUSIONS: CAD signals do not combine with observers' unaided performance in a straightforward manner. CAD can engender a sense of certainty that can lead to incomplete search and elevated chances of missing unmarked stimuli.
Authors: Vijay M Rao; David C Levin; Laurence Parker; Barbara Cavanaugh; Andrea J Frangos; Jonathan H Sunshine Journal: J Am Coll Radiol Date: 2010-10 Impact factor: 5.532
Authors: Joshua J Fenton; Linn Abraham; Stephen H Taplin; Berta M Geller; Patricia A Carney; Carl D'Orsi; Joann G Elmore; William E Barlow Journal: J Natl Cancer Inst Date: 2011-07-27 Impact factor: 13.506
Authors: Monique D Dorrius; Marijke C Jansen-van der Weide; Peter M A van Ooijen; Ruud M Pijnappel; Matthijs Oudkerk Journal: Eur Radiol Date: 2011-03-15 Impact factor: 5.315
Authors: Melissa Treviño; George Birdsong; Ann Carrigan; Peter Choyke; Trafton Drew; Miguel Eckstein; Anna Fernandez; Brandon D Gallas; Maryellen Giger; Stephen M Hewitt; Todd S Horowitz; Yuhong V Jiang; Bonnie Kudrick; Susana Martinez-Conde; Stephen Mitroff; Linda Nebeling; Joseph Saltz; Frank Samuelson; Steven E Seltzer; Behrouz Shabestari; Lalitha Shankar; Eliot Siegel; Mike Tilkin; Jennifer S Trueblood; Alison L Van Dyke; Aradhana M Venkatesan; David Whitney; Jeremy M Wolfe Journal: JNCI Cancer Spectr Date: 2022-01-05
Authors: Emma Helbren; Thomas R Fanshawe; Peter Phillips; Susan Mallett; Darren Boone; Alastair Gale; Douglas G Altman; Stuart A Taylor; David Manning; Steve Halligan Journal: Eur Radiol Date: 2015-01-12 Impact factor: 5.315
Authors: J N Stember; H Celik; E Krupinski; P D Chang; S Mutasa; B J Wood; A Lignelli; G Moonis; L H Schwartz; S Jambawalikar; U Bagci Journal: J Digit Imaging Date: 2019-08 Impact factor: 4.056
Authors: Sonia Gaur; Nathan Lay; Stephanie A Harmon; Sreya Doddakashi; Sherif Mehralivand; Burak Argun; Tristan Barrett; Sandra Bednarova; Rossanno Girometti; Ercan Karaarslan; Ali Riza Kural; Aytekin Oto; Andrei S Purysko; Tatjana Antic; Cristina Magi-Galluzzi; Yesim Saglican; Stefano Sioletic; Anne Y Warren; Leonardo Bittencourt; Jurgen J Fütterer; Rajan T Gupta; Ismail Kabakus; Yan Mee Law; Daniel J Margolis; Haytham Shebel; Antonio C Westphalen; Bradford J Wood; Peter A Pinto; Joanna H Shih; Peter L Choyke; Ronald M Summers; Baris Turkbey Journal: Oncotarget Date: 2018-09-18