Kevin A Hallgren1, Katie Witkiewitz2, Henry R Kranzler3,4, Daniel E Falk5, Raye Z Litten5, Stephanie S O'Malley6, Raymond F Anton7. 1. Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, Washington. 2. Department of Psychology, Center on Alcoholism, Substance Abuse, and Addictions, University of New Mexico, Albuquerque, New Mexico. 3. Department of Psychiatry and Center for Studies of Addiction, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania. 4. VISN 4 MIRECC, Crescenz Philadelphia VAMC, Philadelphia, Pennsylvania. 5. National Institute on Alcohol Abuse and Alcoholism, Rockville, Maryland. 6. Department of Psychiatry, Yale School of Medicine, New Haven, Connecticut. 7. Department of Psychiatry, Addiction Sciences Division, Medical University of South Carolina, Charleston, South Carolina.
Abstract
BACKGROUND: Missing data are common in alcohol clinical trials for both continuous and binary end points. Approaches to handle missing data have been explored for continuous outcomes, yet no studies have compared missing data approaches for binary outcomes (e.g., abstinence, no heavy drinking days). This study compares approaches to modeling binary outcomes with missing data in the COMBINE study. METHODS: We included participants in the COMBINE study who had complete drinking data during treatment and who were assigned to active medication or placebo conditions (N = 1,146). Using simulation methods, missing data were introduced under common scenarios with varying sample sizes and amounts of missing data. Logistic regression was used to estimate the effect of naltrexone (vs. placebo) in predicting any drinking and any heavy drinking outcomes at the end of treatment using 4 analytic approaches: complete case analysis (CCA), last observation carried forward (LOCF), the worst case scenario (WCS) of missing equals any drinking or heavy drinking, and multiple imputation (MI). In separate analyses, these approaches were compared when drinking data were manually deleted for those participants who discontinued treatment but continued to provide drinking data. RESULTS: WCS produced the greatest amount of bias in treatment effect estimates. MI usually yielded less biased estimates than WCS and CCA in the simulated data and performed considerably better than LOCF when estimating treatment effects among individuals who discontinued treatment. CONCLUSIONS: Missing data can introduce bias in treatment effect estimates in alcohol clinical trials. Researchers should utilize modern missing data methods, including MI, and avoid WCS and CCA when analyzing binary alcohol clinical trial outcomes.
BACKGROUND: Missing data are common in alcohol clinical trials for both continuous and binary end points. Approaches to handle missing data have been explored for continuous outcomes, yet no studies have compared missing data approaches for binary outcomes (e.g., abstinence, no heavy drinking days). This study compares approaches to modeling binary outcomes with missing data in the COMBINE study. METHODS: We included participants in the COMBINE study who had complete drinking data during treatment and who were assigned to active medication or placebo conditions (N = 1,146). Using simulation methods, missing data were introduced under common scenarios with varying sample sizes and amounts of missing data. Logistic regression was used to estimate the effect of naltrexone (vs. placebo) in predicting any drinking and any heavy drinking outcomes at the end of treatment using 4 analytic approaches: complete case analysis (CCA), last observation carried forward (LOCF), the worst case scenario (WCS) of missing equals any drinking or heavy drinking, and multiple imputation (MI). In separate analyses, these approaches were compared when drinking data were manually deleted for those participants who discontinued treatment but continued to provide drinking data. RESULTS: WCS produced the greatest amount of bias in treatment effect estimates. MI usually yielded less biased estimates than WCS and CCA in the simulated data and performed considerably better than LOCF when estimating treatment effects among individuals who discontinued treatment. CONCLUSIONS: Missing data can introduce bias in treatment effect estimates in alcohol clinical trials. Researchers should utilize modern missing data methods, including MI, and avoid WCS and CCA when analyzing binary alcohol clinical trial outcomes.
Authors: Raymond F Anton; Stephanie S O'Malley; Domenic A Ciraulo; Ron A Cisler; David Couper; Dennis M Donovan; David R Gastfriend; James D Hosking; Bankole A Johnson; Joseph S LoCastro; Richard Longabaugh; Barbara J Mason; Margaret E Mattson; William R Miller; Helen M Pettinati; Carrie L Randall; Robert Swift; Roger D Weiss; Lauren D Williams; Allen Zweben Journal: JAMA Date: 2006-05-03 Impact factor: 56.272
Authors: Katie Witkiewitz; John W Finney; Alex H S Harris; Daniel R Kivlahan; Henry R Kranzler Journal: Alcohol Clin Exp Res Date: 2015-08-06 Impact factor: 3.455
Authors: Bryce A Basques; Ryan P McLynn; Michael P Fice; Andre M Samuel; Adam M Lukasiewicz; Daniel D Bohl; Junyoung Ahn; Kern Singh; Jonathan N Grauer Journal: Clin Orthop Relat Res Date: 2017-12 Impact factor: 4.176
Authors: Katie Witkiewitz; Nick Heather; Daniel E Falk; Raye Z Litten; Deborah S Hasin; Henry R Kranzler; Karl F Mann; Stephanie S O'Malley; Raymond F Anton Journal: Addiction Date: 2020-03-10 Impact factor: 6.526
Authors: Kevin A Hallgren; Richard K Ries; David C Atkins; Kristin Bumgardner; Peter Roy-Byrne Journal: J Am Board Fam Med Date: 2017 Mar-Apr Impact factor: 2.657
Authors: Anup Srivastav; Carla L Black; Peng-Jun Lu; Jun Zhang; Jennifer L Liang; Stacie M Greby Journal: Am J Prev Med Date: 2017-05-23 Impact factor: 5.043
Authors: Erica N Grodin; Suzanna Donato; Han Du; ReJoyce Green; Spencer Bujarski; Lara A Ray Journal: Alcohol Alcohol Date: 2022-09-10 Impact factor: 3.913
Authors: Daniel E Falk; Stephanie S O'Malley; Katie Witkiewitz; Raymond F Anton; Raye Z Litten; Megan Slater; Henry R Kranzler; Karl F Mann; Deborah S Hasin; Bankole Johnson; Didier Meulien; Megan Ryan; Joanne Fertig Journal: JAMA Psychiatry Date: 2019-04-01 Impact factor: 25.911