Kevin A Hallgren1,2,3, Theresa E Matson2,3,4, Malia Oliver2, Ryan M Caldeiro5, Daniel R Kivlahan4, Katharine A Bradley2,3,6. 1. Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, Washington, USA. 2. Kaiser Permanente Washington Health Research Institute, Seattle, Washington, USA. 3. Department of Health Systems and Population Health, University of Washington, Seattle, Washington, USA. 4. Health Services Research and Development, Center of Innovation for Veteran-Centered and Value-Driven Care, Veteran Affairs Puget Sound HealthCare System, Seattle, Washington, USA. 5. Mental Health and Wellness, Kaiser Permanente of Washington, Renton, Washington, USA. 6. Department of Medicine, University of Washington, Seattle, Washington, USA.
Abstract
BACKGROUND: Alcohol use disorder (AUD) is underdiagnosed and undertreated in medical settings, in part due to a lack of AUD assessment instruments that are reliable and practical for use in routine care. This study evaluates the test-retest reliability of a patient-report Alcohol Symptom Checklist questionnaire when it is used in routine care, including primary care and mental health specialty settings. METHODS: We performed a pragmatic test-retest reliability study using electronic health record (EHR) data from Kaiser Permanente Washington, an integrated health system in Washington state. The sample included 454 patients who reported high-risk drinking on a behavioral health screen and completed two Alcohol Symptom Checklists 1 to 21 days apart. Subgroups of these patients who completed both checklists in primary care (n = 271) or mental health settings (n = 79) were also examined. The primary measure was an Alcohol Symptom Checklist on which patients self-reported whether they experienced each of the 11 AUD criteria within the past year, as defined by the Diagnostic and Statistical Manual of Mental Disorders-5th edition (DSM-5). RESULTS: Alcohol Symptom Checklists completed in routine care and documented in EHRs had excellent test-retest reliability for measuring AUD criterion counts (ICC = 0.79, 95% CI: 0.76 to 0.82). Test-retest reliability estimates were also high and not significantly different for the subsamples of patients who completed both checklists in primary care (ICC = 0.82, 95% CI: 0.77 to 0.85) or mental health settings (ICC = 0.74, 95% CI: 0.62 to 0.83). Test-retest reliability was not moderated by having a past two-year AUD diagnosis, nor by the age or sex of the patient completing it. CONCLUSIONS: Alcohol Symptom Checklists can reliably and pragmatically assess AUD criteria in routine care among patients who screen positive for high-risk drinking. The Alcohol Symptom Checklist may be a valuable tool in supporting AUD-related care and monitoring AUD criteria longitudinally in routine primary care and mental health settings.
BACKGROUND: Alcohol use disorder (AUD) is underdiagnosed and undertreated in medical settings, in part due to a lack of AUD assessment instruments that are reliable and practical for use in routine care. This study evaluates the test-retest reliability of a patient-report Alcohol Symptom Checklist questionnaire when it is used in routine care, including primary care and mental health specialty settings. METHODS: We performed a pragmatic test-retest reliability study using electronic health record (EHR) data from Kaiser Permanente Washington, an integrated health system in Washington state. The sample included 454 patients who reported high-risk drinking on a behavioral health screen and completed two Alcohol Symptom Checklists 1 to 21 days apart. Subgroups of these patients who completed both checklists in primary care (n = 271) or mental health settings (n = 79) were also examined. The primary measure was an Alcohol Symptom Checklist on which patients self-reported whether they experienced each of the 11 AUD criteria within the past year, as defined by the Diagnostic and Statistical Manual of Mental Disorders-5th edition (DSM-5). RESULTS: Alcohol Symptom Checklists completed in routine care and documented in EHRs had excellent test-retest reliability for measuring AUD criterion counts (ICC = 0.79, 95% CI: 0.76 to 0.82). Test-retest reliability estimates were also high and not significantly different for the subsamples of patients who completed both checklists in primary care (ICC = 0.82, 95% CI: 0.77 to 0.85) or mental health settings (ICC = 0.74, 95% CI: 0.62 to 0.83). Test-retest reliability was not moderated by having a past two-year AUD diagnosis, nor by the age or sex of the patient completing it. CONCLUSIONS: Alcohol Symptom Checklists can reliably and pragmatically assess AUD criteria in routine care among patients who screen positive for high-risk drinking. The Alcohol Symptom Checklist may be a valuable tool in supporting AUD-related care and monitoring AUD criteria longitudinally in routine primary care and mental health settings.
Authors: Emily C Williams; Carol E Achtmeyer; Rachel M Thomas; Joel R Grossbard; Gwen T Lapham; Laura J Chavez; Evette J Ludman; Douglas Berger; Katharine A Bradley Journal: J Gen Intern Med Date: 2015-03-03 Impact factor: 5.128
Authors: Katharine A Bradley; Kristen R Bush; Amee J Epler; Dorcas J Dobie; Tania M Davis; Jennifer L Sporleder; Charles Maynard; Marcia L Burman; Daniel R Kivlahan Journal: Arch Intern Med Date: 2003-04-14
Authors: Mikko Sayre; Gwen T Lapham; Amy K Lee; Malia Oliver; Jennifer F Bobb; Ryan M Caldeiro; Katharine A Bradley Journal: J Gen Intern Med Date: 2020-01-23 Impact factor: 5.128
Authors: Daniel E Jonas; Halle R Amick; Cynthia Feltner; Georgiy Bobashev; Kathleen Thomas; Roberta Wines; Mimi M Kim; Ellen Shanahan; C Elizabeth Gass; Cassandra J Rowe; James C Garbutt Journal: JAMA Date: 2014-05-14 Impact factor: 56.272
Authors: Kevin A Hallgren; Elizabeth Witwer; Imara West; Laura-Mae Baldwin; Dennis Donovan; Brenda Stuvek; Gina A Keppel; Brenda Mollis; Kari A Stephens Journal: J Subst Abuse Treat Date: 2019-11-16
Authors: Joseph E Glass; Jennifer F Bobb; Amy K Lee; Julie E Richards; Gwen T Lapham; Evette Ludman; Carol Achtmeyer; Ryan M Caldeiro; Rebecca Parrish; Emily C Williams; Paula Lozano; Katharine A Bradley Journal: Implement Sci Date: 2018-08-06 Impact factor: 7.327
Authors: Emma D Ryan; Yanni M Chang; Malia Oliver; Katharine A Bradley; Kevin A Hallgren Journal: BMC Health Serv Res Date: 2022-09-05 Impact factor: 2.908