W W Eaton1, K Neufeld, L S Chen, G Cai. 1. Department of Mental Hygiene, School of Hygiene and Public Health, Johns Hopkins University, Baltimore, MD 21205-1999, USA.
Abstract
BACKGROUND: The field of psychiatric epidemiology continues to employ self-report instruments, but the low degree of agreement between diagnoses achieved using these instruments vs. that achieved by psychiatrists in the clinical modality threatens the credibility of the results. METHODS: In the Baltimore Epidemiologic Catchment Area follow-up, 349 individuals who had a Diagnostic Interview Schedule (DIS) interview were blindly examined by psychiatrists using the Schedules for Clinical Assessment in Neuropsychiatry (SCAN). Comparisons were made at the level of diagnosis, syndrome, and DSM-IV symptom group. Indexes of agreement were computed and characteristics of discrepant cases were identified. RESULTS: Agreement on diagnosis of major depressive disorder was only fair (kappa = 0.20), with the DIS missing many cases judged to meet criteria for diagnosis using the SCAN (29% sensitivity). A major source of discrepancy was respondents with false-negative diagnoses who repeatedly failed to report DIS symptoms attributed to life crises or medical conditions. Older age, male sex, and lower impairment were associated with underdetection by the DIS, using logistic regression analysis. In spite of the diagnostic discrepancy, there was substantial correlation in numbers of symptom groups in the 2 modalities (r = 0.49). Agreement was highest (about 55% sensitivity and 90% specificity) when both the SCAN and DIS thresholds were set at the level of depression syndrome instead of diagnosis. CONCLUSIONS: Weak agreement at the level of diagnosis continues to threaten the credibility of estimates of prevalence of specific disorders. A bias toward underreporting, as well as stronger agreement at the level of the depression syndrome and on ordinal measures of depressive symptoms, suggests that associations with risk factors are conservative.
BACKGROUND: The field of psychiatric epidemiology continues to employ self-report instruments, but the low degree of agreement between diagnoses achieved using these instruments vs. that achieved by psychiatrists in the clinical modality threatens the credibility of the results. METHODS: In the Baltimore Epidemiologic Catchment Area follow-up, 349 individuals who had a Diagnostic Interview Schedule (DIS) interview were blindly examined by psychiatrists using the Schedules for Clinical Assessment in Neuropsychiatry (SCAN). Comparisons were made at the level of diagnosis, syndrome, and DSM-IV symptom group. Indexes of agreement were computed and characteristics of discrepant cases were identified. RESULTS: Agreement on diagnosis of major depressive disorder was only fair (kappa = 0.20), with the DIS missing many cases judged to meet criteria for diagnosis using the SCAN (29% sensitivity). A major source of discrepancy was respondents with false-negative diagnoses who repeatedly failed to report DIS symptoms attributed to life crises or medical conditions. Older age, male sex, and lower impairment were associated with underdetection by the DIS, using logistic regression analysis. In spite of the diagnostic discrepancy, there was substantial correlation in numbers of symptom groups in the 2 modalities (r = 0.49). Agreement was highest (about 55% sensitivity and 90% specificity) when both the SCAN and DIS thresholds were set at the level of depression syndrome instead of diagnosis. CONCLUSIONS: Weak agreement at the level of diagnosis continues to threaten the credibility of estimates of prevalence of specific disorders. A bias toward underreporting, as well as stronger agreement at the level of the depression syndrome and on ordinal measures of depressive symptoms, suggests that associations with risk factors are conservative.
Authors: Ronald C Kessler; Jamie Abelson; Olga Demler; Javier I Escobar; Miriam Gibbon; Margaret E Guyer; Mary J Howes; Robert Jin; William A Vega; Ellen E Walters; Philip Wang; Alan Zaslavsky; Hui Zheng Journal: Int J Methods Psychiatr Res Date: 2004 Impact factor: 4.035
Authors: Briana Mezuk; Jane A Rafferty; Kiarri N Kershaw; Darrell Hudson; Cleopatra M Abdou; Hedwig Lee; William W Eaton; James S Jackson Journal: Am J Epidemiol Date: 2010-09-30 Impact factor: 4.897
Authors: Ananda B Amstadter; Lisa Richardson; Ron Acierno; Dean G Kilpatrick; Mario T Gaboury; Trinh Luong Tran; Lam Tu Trung; Nguyen Thanh Tam; Tran Tuan; La Thi Buoi; Tran Thu Ha; Tran Duc Thach Journal: Int Perspect Vict Date: 2010-08-01
Authors: William W Eaton; Huibo Shao; Gerald Nestadt; Hochang Benjamin Lee; Ben Hochang Lee; O Joseph Bienvenu; Peter Zandi Journal: Arch Gen Psychiatry Date: 2008-05
Authors: Mary E Bongiovi-Garcia; Jessica Merville; M Goretti Almeida; Ainsley Burke; Steven Ellis; Barbara H Stanley; Kelly Posner; J John Mann; Maria A Oquendo Journal: J Affect Disord Date: 2008-09-23 Impact factor: 4.839