Literature DB >> 16825743

ROC curves predicted by a model of visual search.

D P Chakraborty1.   

Abstract

In imaging tasks where the observer is uncertain whether lesions are present, and where they could be present, the image is searched for lesions. In the free-response paradigm, which closely reflects this task, the observer provides data in the form of a variable number of mark-rating pairs per image. In a companion paper a statistical model of visual search has been proposed that has parameters characterizing the perceived lesion signal-to-noise ratio, the ability of the observer to avoid marking non-lesion locations, and the ability of the observer to find lesions. The aim of this work is to relate the search model parameters to receiver operating characteristic (ROC) curves that would result if the observer reported the rating of the most suspicious finding on an image as the overall rating. Also presented are the probability density functions (pdfs) of the underlying latent decision variables corresponding to the highest rating for normal and abnormal images. The search-model-predicted ROC curves are 'proper' in the sense of never crossing the chance diagonal and the slope is monotonically changing. They also have the interesting property of not allowing the observer to move the operating point continuously from the origin to (1, 1). For certain choices of parameters the operating points are predicted to be clustered near the initial steep region of the curve, as has been observed by other investigators. The pdfs are non-Gaussians, markedly so for the abnormal images and for certain choices of parameter values, and provide an explanation for the well-known observation that experimental ROC data generally imply a wider pdf for abnormal images than for normal images. Some features of search-model-predicted ROC curves and pdfs resemble those predicted by the contaminated binormal model, but there are significant differences. The search model appears to provide physical explanations for several aspects of experimental ROC curves.

Mesh:

Year:  2006        PMID: 16825743      PMCID: PMC2230636          DOI: 10.1088/0031-9155/51/14/013

Source DB:  PubMed          Journal:  Phys Med Biol        ISSN: 0031-9155            Impact factor:   3.609


  16 in total

1.  A contaminated binormal model for ROC data: Part II. A formal model.

Authors:  D D Dorfman; K S Berbaum
Journal:  Acad Radiol       Date:  2000-06       Impact factor: 3.173

2.  A contaminated binormal model for ROC data: Part I. Some interesting examples of binormal degeneracy.

Authors:  D D Dorfman; K S Berbaum; E A Brandser
Journal:  Acad Radiol       Date:  2000-06       Impact factor: 3.173

3.  "Proper" Binormal ROC Curves: Theory and Maximum-Likelihood Estimation.

Authors: 
Journal:  J Math Psychol       Date:  1999-03       Impact factor: 2.223

4.  A constrained formulation for the receiver operating characteristic (ROC) curve based on probability summation.

Authors:  R G Swensson; J L King; D Gur
Journal:  Med Phys       Date:  2001-08       Impact factor: 4.071

5.  Basic principles of ROC analysis.

Authors:  C E Metz
Journal:  Semin Nucl Med       Date:  1978-10       Impact factor: 4.446

6.  Observer studies involving detection and localization: modeling, analysis, and validation.

Authors:  Dev P Chakraborty; Kevin S Berbaum
Journal:  Med Phys       Date:  2004-08       Impact factor: 4.071

7.  Proper receiver operating characteristic analysis: the bigamma model.

Authors:  D D Dorfman; K S Berbaum; C E Metz; R V Lenth; J A Hanley; H Abu Dagga
Journal:  Acad Radiol       Date:  1997-02       Impact factor: 3.173

Review 8.  ROC methodology in radiologic imaging.

Authors:  C E Metz
Journal:  Invest Radiol       Date:  1986-09       Impact factor: 6.016

9.  Using eye movements to study visual search and to improve tumor detection.

Authors:  C F Nodine; H L Kundel
Journal:  Radiographics       Date:  1987-11       Impact factor: 5.333

10.  A visual concept shapes image perception.

Authors:  H L Kundel; C F Nodine
Journal:  Radiology       Date:  1983-02       Impact factor: 11.105

View more
  17 in total

1.  Spatial localization accuracy of radiologists in free-response studies: Inferring perceptual FROC curves from mark-rating data.

Authors:  Dev Chakraborty; Hong-Jun Yoon; Claudia Mello-Thoms
Journal:  Acad Radiol       Date:  2007-01       Impact factor: 3.173

2.  Model for the detection of signals in images with multiple suspicious locations.

Authors:  Lucreţiu M Popescu
Journal:  Med Phys       Date:  2008-12       Impact factor: 4.071

3.  On comparing methods for discriminating between actually negative and actually positive subjects with FROC type data.

Authors:  Tao Song; Andriy I Bandos; Howard E Rockette; David Gur
Journal:  Med Phys       Date:  2008-04       Impact factor: 4.071

4.  Correlation of free-response and receiver-operating-characteristic area-under-the-curve estimates: results from independently conducted FROC∕ROC studies in mammography.

Authors:  Federica Zanca; Stephen L Hillis; Filip Claus; Chantal Van Ongeval; Valerie Celis; Veerle Provoost; Hong-Jun Yoon; Hilde Bosmans
Journal:  Med Phys       Date:  2012-10       Impact factor: 4.071

5.  On the meaning of the weighted alternative free-response operating characteristic figure of merit.

Authors:  Dev P Chakraborty; Xuetong Zhai
Journal:  Med Phys       Date:  2016-05       Impact factor: 4.071

Review 6.  A brief history of free-response receiver operating characteristic paradigm data analysis.

Authors:  Dev P Chakraborty
Journal:  Acad Radiol       Date:  2013-04-12       Impact factor: 3.173

7.  A status report on free-response analysis.

Authors:  D P Chakraborty
Journal:  Radiat Prot Dosimetry       Date:  2010-01-18       Impact factor: 0.972

8.  Operating characteristics predicted by models for diagnostic tasks involving lesion localization.

Authors:  D P Chakraborty; Hong-Jun Yoon
Journal:  Med Phys       Date:  2008-02       Impact factor: 4.071

9.  Bias, underestimation of risk, and loss of statistical power in patient-level analyses of lesion detection.

Authors:  Nancy A Obuchowski; Peter J Mazzone; Abraham H Dachman
Journal:  Eur Radiol       Date:  2009-09-16       Impact factor: 5.315

10.  Application of threshold-bias independent analysis to eye-tracking and FROC data.

Authors:  Dev P Chakraborty; Hong-Jun Yoon; Claudia Mello-Thoms
Journal:  Acad Radiol       Date:  2012-10-04       Impact factor: 3.173

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.