Evaluation and optimization of diagnostic tests using receiver operating characteristic analysis and information theory.

We describe a mathematical technique and an associated computer program for comparing, evaluating and optimizing diagnostic tests. The technique combines receiver operating characteristic (ROC) analysis with information theory and cost-benefit analysis to accomplish this. The program is menu driven and highly interactive; it generates 13 possible user-determined ASCII disk files which can be easily converted to graphs. These graphs allow the user to make detailed comparisons among various diagnostic tests for all values of disorder prevalence, and also provide guidelines for cut-off selection in order to optimize tests. These techniques are applied to three published studies of the enzyme screening assay for diagnosis of infection with the HIV virus. We show how graphs produced by this program can be used to compare and optimize these diagnostic tests. The program is written for an IBM-compatible microcomputer running on a DOS operating system.