Deborah Hasin1, Dvora Shmulewitz2, Malka Stohl3, Eliana Greenstein3, Stephanie Roncone3, Efrat Aharonovich2, Melanie Wall2. 1. New York State Psychiatric Institute, 1051 Riverside Dr, New York, NY 10032, USA; Department of Psychiatry, Columbia University Medical Center, 1051 Riverside Dr, New York, NY, 10032, USA; Department of Epidemiology, Mailman School of Public Health, Columbia University, 722 W 168th St, New York, NY, 10032, USA. Electronic address: dsh2@cumc.columbia.edu. 2. New York State Psychiatric Institute, 1051 Riverside Dr, New York, NY 10032, USA; Department of Psychiatry, Columbia University Medical Center, 1051 Riverside Dr, New York, NY, 10032, USA. 3. New York State Psychiatric Institute, 1051 Riverside Dr, New York, NY 10032, USA.
Abstract
AIM: In DSM-5, the definitions of substance use disorders (SUD) were changed considerably, yet little is known about the reliability of DSM-5 SUD and its new features. METHODS: The test-retest reliability of DSM-5 SUD and DSM-IV substance dependence (SD) was evaluated in 565 adult substance users, each interviewed twice by different clinician interviewers using the semi-structured Psychiatric Research Interview for Substance and Mental Disorders, DSM-5 version (PRISM-5). DSM-5 SUD and DSM-IV SD criteria were assessed for past year and lifetime, yielding diagnoses and severity levels for alcohol, tobacco, cannabis, cocaine, heroin, opioids, sedatives, hallucinogen, and stimulant use disorders. Cohen's and intraclass correlation coefficients (ICC) assessed reliability for categorical and graded outcomes, respectively. Factors potentially influencing reliability were explored, including inpatient vs. community participant, days between interviews gender, age, race/ethnicity, and SUD severity. RESULTS: DSM-5 SUD diagnoses had substantial to excellent reliability for most substances (κ = 0.63-0.94), and moderate for others (hallucinogens, stimulants, sedatives; κ = 0.50-0.59). For graded outcomes (DSM-5 SUD mild, moderate, severe; criteria count 0-11), reliability was substantial to excellent (ICC = 0.74-0.99). Comparisons of DSM-5 SUD and DSM-IV SD reliability showed few significant differences. Reliability of the DSM-5 craving criterion was excellent for heroin (κ = 0.84-0.95) and moderate to substantial for other substances (κ = 0.49-0.76). The only factor influencing reliability of SUD was severity, with milder disorders significantly more likely to be discordant between the interviews. CONCLUSION: Reproducibility is crucial to good measurement. In a large sample using rigorous methodology, diagnoses and dimensional measures from clinician-administered interviews for DSM-5 SUD were generally highly reliable.
AIM: In DSM-5, the definitions of substance use disorders (SUD) were changed considerably, yet little is known about the reliability of DSM-5 SUD and its new features. METHODS: The test-retest reliability of DSM-5 SUD and DSM-IV substance dependence (SD) was evaluated in 565 adult substance users, each interviewed twice by different clinician interviewers using the semi-structured Psychiatric Research Interview for Substance and Mental Disorders, DSM-5 version (PRISM-5). DSM-5 SUD and DSM-IV SD criteria were assessed for past year and lifetime, yielding diagnoses and severity levels for alcohol, tobacco, cannabis, cocaine, heroin, opioids, sedatives, hallucinogen, and stimulant use disorders. Cohen's and intraclass correlation coefficients (ICC) assessed reliability for categorical and graded outcomes, respectively. Factors potentially influencing reliability were explored, including inpatient vs. community participant, days between interviews gender, age, race/ethnicity, and SUD severity. RESULTS: DSM-5 SUD diagnoses had substantial to excellent reliability for most substances (κ = 0.63-0.94), and moderate for others (hallucinogens, stimulants, sedatives; κ = 0.50-0.59). For graded outcomes (DSM-5 SUD mild, moderate, severe; criteria count 0-11), reliability was substantial to excellent (ICC = 0.74-0.99). Comparisons of DSM-5 SUD and DSM-IV SD reliability showed few significant differences. Reliability of the DSM-5 craving criterion was excellent for heroin (κ = 0.84-0.95) and moderate to substantial for other substances (κ = 0.49-0.76). The only factor influencing reliability of SUD was severity, with milder disorders significantly more likely to be discordant between the interviews. CONCLUSION: Reproducibility is crucial to good measurement. In a large sample using rigorous methodology, diagnoses and dimensional measures from clinician-administered interviews for DSM-5 SUD were generally highly reliable.
Authors: Bradley T Kerridge; S Patricia Chou; Roger P Pickering; W June Ruan; Boji Huang; Jeesun Jung; Haitao Zhang; Amy Z Fan; Tulshi D Saha; Bridget F Grant; Deborah S Hasin Journal: Addict Behav Date: 2018-11-07 Impact factor: 3.913
Authors: Deborah S Hasin; Charles P O'Brien; Marc Auriacombe; Guilherme Borges; Kathleen Bucholz; Alan Budney; Wilson M Compton; Thomas Crowley; Walter Ling; Nancy M Petry; Marc Schuckit; Bridget F Grant Journal: Am J Psychiatry Date: 2013-08 Impact factor: 18.112
Authors: Bridget F Grant; Tulshi D Saha; W June Ruan; Risë B Goldstein; S Patricia Chou; Jeesun Jung; Haitao Zhang; Sharon M Smith; Roger P Pickering; Boji Huang; Deborah S Hasin Journal: JAMA Psychiatry Date: 2016-01 Impact factor: 21.596
Authors: Nicole D Fitzgerald; Catherine W Striley; Joseph J Palamar; Jan Copeland; Steven Kurtz; Linda B Cottler Journal: Drug Alcohol Depend Date: 2021-09-21 Impact factor: 4.492
Authors: D Shmulewitz; M Stohl; E Greenstein; S Roncone; C Walsh; E Aharonovich; M M Wall; D S Hasin Journal: Psychol Med Date: 2021-11-01 Impact factor: 10.592
Authors: Kevin A Hallgren; Theresa E Matson; Malia Oliver; Ryan M Caldeiro; Daniel R Kivlahan; Katharine A Bradley Journal: Alcohol Clin Exp Res Date: 2022-03 Impact factor: 3.455