Literature DB >> 27499571

Validation of Nonparametric Two-Sample Bootstrap in ROC Analysis on Large Datasets.

Jin Chu Wu1, Alvin F Martin1, Raghu N Kacker1.   

Abstract

The nonparametric two-sample bootstrap is applied to computing uncertainties of measures in ROC analysis on large datasets in areas such as biometrics, speaker recognition, etc., when the analytical method cannot be used. Its validation was studied by computing the SE of the area under ROC curve using the well-established analytical Mann-Whitney-statistic method and also using the bootstrap. The analytical result is unique. The bootstrap results are expressed as a probability distribution due to its stochastic nature. The comparisons were carried out using relative errors and hypothesis testing. They match very well. This validation provides a sound foundation for such computations.

Entities:  

Keywords:  ROC analysis; biometrics; bootstrap; large datasets; speaker recognition; uncertainty; validation

Year:  2015        PMID: 27499571      PMCID: PMC4971585          DOI: 10.1080/03610918.2015.1065327

Source DB:  PubMed          Journal:  Commun Stat Simul Comput        ISSN: 0361-0918            Impact factor:   1.118


  5 in total

1.  Comparison of quantitative diagnostic tests: type I error, power, and sample size.

Authors:  K Linnet
Journal:  Stat Med       Date:  1987-03       Impact factor: 2.373

2.  Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach.

Authors:  E R DeLong; D M DeLong; D L Clarke-Pearson
Journal:  Biometrics       Date:  1988-09       Impact factor: 2.571

3.  A method of comparing the areas under receiver operating characteristic curves derived from the same cases.

Authors:  J A Hanley; B J McNeil
Journal:  Radiology       Date:  1983-09       Impact factor: 11.105

4.  The meaning and use of the area under a receiver operating characteristic (ROC) curve.

Authors:  J A Hanley; B J McNeil
Journal:  Radiology       Date:  1982-04       Impact factor: 11.105

5.  Measures, Uncertainties, and Significance Test in Operational ROC Analysis.

Authors:  Jin Chu Wu; Alvin F Martin; Raghu N Kacker
Journal:  J Res Natl Inst Stand Technol       Date:  2011-02-01
  5 in total
  3 in total

1.  The Impact of Data Dependence on Speaker Recognition Evaluation.

Authors:  Jin Chu Wu; Alvin F Martin; Craig S Greenberg; Raghu N Kacker
Journal:  IEEE/ACM Trans Audio Speech Lang Process       Date:  2016-09-30

2.  A novel measure and significance testing in data analysis of cell image segmentation.

Authors:  Jin Chu Wu; Michael Halter; Raghu N Kacker; John T Elliott; Anne L Plant
Journal:  BMC Bioinformatics       Date:  2017-03-14       Impact factor: 3.169

3.  Dexterous Identification of Carcinoma through ColoRectalCADx with Dichotomous Fusion CNN and UNet Semantic Segmentation.

Authors:  Akella S Narasimha Raju; Kayalvizhi Jayavel; Thulasi Rajalakshmi
Journal:  Comput Intell Neurosci       Date:  2022-10-10
  3 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.