Catherine Lee1, Nancy Landre2, Jerry J Sweet1. 1. Department of Psychiatry and Behavioral Sciences, NorthShore University HealthSystem , Evanston , IL , USA. 2. Independent Practice and Advocate Health Care , Park Ridge , IL , USA.
Abstract
Objective: Assessment of performance validity is an essential component of neuropsychological evaluation. Performance validity indicators contained within cognitive ability measures are particularly advantageous, as they do not require additional test administration time or material, and allow for assessment of validity across multiple cognitive domains over the course of an evaluation. The present study examined the classification accuracy of the Stroop Color and Word Test (Stroop) Word, Color, and Color-Word trials in detecting invalid performance in a mixed forensic and patient sample. Method: Archival data from a mixed-diagnosis sample were analyzed, consisting of 558 (Mage=40.8; Meducation=15.3) individuals referred for neuropsychological evaluation in clinical or forensic contexts, who completed a test battery that included the Stroop and at least two performance validity tests (PVTs). Examinees were assigned to Valid or Invalid performance groups based on PVT outcomes. Results: Word and Color scores were found to have excellent classification accuracy, whereas Color-Word yielded acceptable classification accuracy. Sensitivity and specificity values are presented for a range of cutoff scores, as are positive and negative predictive values for setting-specific base rates of invalid performance. Conclusions: Performances on the Stroop Color and Word Test, particularly the Word and Color trials, can be useful in detecting invalid performance in a mixed patient and forensic sample. Clinical implications are discussed.
Objective: Assessment of performance validity is an essential component of neuropsychological evaluation. Performance validity indicators contained within cognitive ability measures are particularly advantageous, as they do not require additional test administration time or material, and allow for assessment of validity across multiple cognitive domains over the course of an evaluation. The present study examined the classification accuracy of the Stroop Color and Word Test (Stroop) Word, Color, and Color-Word trials in detecting invalid performance in a mixed forensic and patient sample. Method: Archival data from a mixed-diagnosis sample were analyzed, consisting of 558 (Mage=40.8; Meducation=15.3) individuals referred for neuropsychological evaluation in clinical or forensic contexts, who completed a test battery that included the Stroop and at least two performance validity tests (PVTs). Examinees were assigned to Valid or Invalid performance groups based on PVT outcomes. Results:Word and Color scores were found to have excellent classification accuracy, whereas Color-Word yielded acceptable classification accuracy. Sensitivity and specificity values are presented for a range of cutoff scores, as are positive and negative predictive values for setting-specific base rates of invalid performance. Conclusions: Performances on the Stroop Color and Word Test, particularly the Word and Color trials, can be useful in detecting invalid performance in a mixed patient and forensic sample. Clinical implications are discussed.