Robert D Gibbons1, Margarita Alegria2, Sheri Markle3, Larimar Fuentes3, Liting Zhang3, Rodrigo Carmona4, Francisco Collazos5,6, Ye Wang7, Enrique Baca-García8,9. 1. Departments of Medicine and Public Health Sciences, The University of Chicago Biological Sciences, Chicago, IL, USA. 2. Disparities Research Unit, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA. 3. Disparities Research Unit, Massachusetts General Hospital, Boston, MA, USA. 4. Department of Psychiatry, Fundación Jiménez Díaz, Madrid, Spain. 5. Department of Psychiatry and Forensic Medicine, Autonomous University of Barcelona, Barcelona, Spain. 6. Department of Psychiatry, Hospital Universitari Vall d'Hebron, Barcelona, Spain. 7. Disparities Research Unit, Department of Medicine, Massachusetts General Hospital, Boston, MA, USA. 8. Department of Psychiatry, Instituto de Investigación Sanitaria, Fundación Jiménez Díaz, Madrid, Spain. 9. Psychiatry Department, Autonoma University of Madrid, Madrid, Spain.
Abstract
BACKGROUND AND AIMS: The focus of this paper is on the improvement of substance use disorder (SUD) screening and measurement. Using a multi-dimensional item response theory model, the bifactor model, we provide a psychometric harmonization between SUD, depression, anxiety, trauma, social isolation, functional impairment and risk-taking behavior symptom domains, providing a more balanced view of SUD. The aims are to (1) develop the item-bank, (2) calibrate the item-bank using a bifactor model that includes a primary dimension and symptom-specific subdomains, (3) administer using computerized adaptive testing (CAT) and (4) validate the CAT-SUD in Spanish and English in the United States and Spain. DESIGN: Item bank construction, item calibration phase, CAT-SUD validation phase. SETTING: Primary care, community clinics, emergency departments and patient-to-patient referrals in Spain (Barcelona and Madrid) and the United States (Boston and Los Angeles). PARTICIPANTS/CASES: Calibration phase: the CAT-SUD was developed via simulation from complete item responses in 513 participants. Validation phase: 297 participants received the Composite International Diagnostic Interview (CIDI) and the CAT-SUD. MEASUREMENTS: A total of 252 items from five subdomains: (1) SUD, (2) psychological disorders, (3) risky behavior, (4) functional impairment and (5) social support. CAT-SUD scale scores and CIDI SUD diagnosis. FINDINGS: Calibration: the bifactor model provided excellent fit to the multi-dimensional item bank; 168 items had high loadings (> 0.4 with the majority > 0.6) on the primary SUD dimension. Using an average of 11 items (four to 26), which represents a 94% reduction in respondent burden (average administration time of approximately 2 minutes), we found a correlation of 0.91 with the 168-item scale (precision of 5 points on a 100-point scale). VALIDATION: strong agreement was found between the primary CAT-SUD dimension estimate and the results of a structured clinical interview. There was a 20-fold increase in the likelihood of a CIDI SUD diagnosis across the range of the CAT-SUD (AUC = 0.85). CONCLUSIONS: We have developed a new approach for the screening and measurement of SUD and related severity based on multi-dimensional item response theory. The bifactor model harmonized information from mental health, trauma, social support and traditional SUD items to provide a more complete characterization of SUD. The CAT-SUD is highly predictive of a current SUD diagnosis based on a structured clinical interview, and may be predictive of the development of SUD in the future.
BACKGROUND AND AIMS: The focus of this paper is on the improvement of substance use disorder (SUD) screening and measurement. Using a multi-dimensional item response theory model, the bifactor model, we provide a psychometric harmonization between SUD, depression, anxiety, trauma, social isolation, functional impairment and risk-taking behavior symptom domains, providing a more balanced view of SUD. The aims are to (1) develop the item-bank, (2) calibrate the item-bank using a bifactor model that includes a primary dimension and symptom-specific subdomains, (3) administer using computerized adaptive testing (CAT) and (4) validate the CAT-SUD in Spanish and English in the United States and Spain. DESIGN: Item bank construction, item calibration phase, CAT-SUD validation phase. SETTING: Primary care, community clinics, emergency departments and patient-to-patient referrals in Spain (Barcelona and Madrid) and the United States (Boston and Los Angeles). PARTICIPANTS/CASES: Calibration phase: the CAT-SUD was developed via simulation from complete item responses in 513 participants. Validation phase: 297 participants received the Composite International Diagnostic Interview (CIDI) and the CAT-SUD. MEASUREMENTS: A total of 252 items from five subdomains: (1) SUD, (2) psychological disorders, (3) risky behavior, (4) functional impairment and (5) social support. CAT-SUD scale scores and CIDI SUD diagnosis. FINDINGS: Calibration: the bifactor model provided excellent fit to the multi-dimensional item bank; 168 items had high loadings (> 0.4 with the majority > 0.6) on the primary SUD dimension. Using an average of 11 items (four to 26), which represents a 94% reduction in respondent burden (average administration time of approximately 2 minutes), we found a correlation of 0.91 with the 168-item scale (precision of 5 points on a 100-point scale). VALIDATION: strong agreement was found between the primary CAT-SUD dimension estimate and the results of a structured clinical interview. There was a 20-fold increase in the likelihood of a CIDI SUD diagnosis across the range of the CAT-SUD (AUC = 0.85). CONCLUSIONS: We have developed a new approach for the screening and measurement of SUD and related severity based on multi-dimensional item response theory. The bifactor model harmonized information from mental health, trauma, social support and traditional SUD items to provide a more complete characterization of SUD. The CAT-SUD is highly predictive of a current SUD diagnosis based on a structured clinical interview, and may be predictive of the development of SUD in the future.
Authors: Philip S Wang; Sergio Aguilar-Gaxiola; Jordi Alonso; Matthias C Angermeyer; Guilherme Borges; Evelyn J Bromet; Ronny Bruffaerts; Giovanni de Girolamo; Ron de Graaf; Oye Gureje; Josep Maria Haro; Elie G Karam; Ronald C Kessler; Viviane Kovess; Michael C Lane; Sing Lee; Daphna Levinson; Yutaka Ono; Maria Petukhova; José Posada-Villa; Soraya Seedat; J Elisabeth Wells Journal: Lancet Date: 2007-09-08 Impact factor: 79.321
Authors: Elizabeth Wenzel; Beatriz Penalver Bernabe; Shannon Dowty; Unnathi Nagelli; Lacey Pezley; Robert Gibbons; Pauline Maki Journal: Evid Based Ment Health Date: 2021-09-06
Authors: Mai Pho; Farah Erzouki; Basmattee Boodram; Antonio D Jimenez; Juliet Pineros; Valery Shuman; Emily Jane Claypool; Alida M Bouris; Nicole Gastala; Jessica Reichert; Marianne Kelly; Elizabeth Salisbury-Afshar; Matthew W Epperson; Robert D Gibbons; John A Schneider; Harold A Pollack Journal: J Subst Abuse Treat Date: 2021-03-11
Authors: Lauren M O'Reilly; Azhar I Dalal; Serena Maag; Matthew T Perry; Alex Card; Max B Bohrer; Jackson Hamersly; Setarah Mohammad Nader; Kelli Peterson; David G Beiser; Robert D Gibbons; Brian M D'Onofrio; Paul I Musey Journal: J Am Coll Emerg Physicians Open Date: 2022-09-22
Authors: Lisa A Brenner; Lisa M Betthauser; Molly Penzenik; Anne Germain; Jin Jun Li; Ishanu Chattopadhyay; Ellen Frank; David J Kupfer; Robert D Gibbons Journal: JAMA Netw Open Date: 2021-07-01