Kevin A Hallgren1, David C Atkins1, Katie Witkiewitz2. 1. Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, Washington. 2. Department of Psychology, Center on Alcoholism, Substance Abuse, and Addictions, University of New Mexico, Albuquerque, New Mexico.
Abstract
OBJECTIVE: Statistical analyses in alcohol clinical trials often use longitudinal daily drinking data (e.g., percentage of drinking days) to test treatment efficacy. Such data can be aggregated and analyzed in many ways. To assess how statistical analytic decisions may influence substantive results, the current report compares different aggregation methods (e.g., computing percentages of drinking days vs. using daily binary indicators of drinking) and statistical methods (i.e., least squares regression, linear mixed-effects models [LMM], generalized linear mixed models [GLMM], and generalized estimating equations [GEE]) for testing the effects of treatment on drinking outcomes in clinical trials. METHOD: A simulation study repeatedly resampled daily drinking data from the treatment period of the Combined Pharmacotherapies and Behavioral Interventions for Alcohol Dependence (COMBINE) Study at different sample sizes. Treatment effects in each data set were modeled using different aggregation and statistical methods. RESULTS: Type I error rates were near the expected rate for most models but on occasion were mildly elevated when disaggregated daily drinking data were analyzed using GLMM or GEE with an exchangeable correlation structure. Most methods yielded similar statistical power, although power decreased when modeling disaggregated daily drinking with GLMM and had mixed increases and decreases when the longitudinal nature of data was ignored by using fully aggregated data with independent samples t tests. CONCLUSIONS: When testing treatment main effects, relatively simpler statistical methods with fewer repeated measures may perform equally well or better than more complicated methods. Patterns of significance and treatment effect size estimates are likely comparable across most studies that use different aggregation and statistical methods, but differences between these methods may occasionally have an important impact on conclusions in clinical trials.
OBJECTIVE: Statistical analyses in alcohol clinical trials often use longitudinal daily drinking data (e.g., percentage of drinking days) to test treatment efficacy. Such data can be aggregated and analyzed in many ways. To assess how statistical analytic decisions may influence substantive results, the current report compares different aggregation methods (e.g., computing percentages of drinking days vs. using daily binary indicators of drinking) and statistical methods (i.e., least squares regression, linear mixed-effects models [LMM], generalized linear mixed models [GLMM], and generalized estimating equations [GEE]) for testing the effects of treatment on drinking outcomes in clinical trials. METHOD: A simulation study repeatedly resampled daily drinking data from the treatment period of the Combined Pharmacotherapies and Behavioral Interventions for Alcohol Dependence (COMBINE) Study at different sample sizes. Treatment effects in each data set were modeled using different aggregation and statistical methods. RESULTS: Type I error rates were near the expected rate for most models but on occasion were mildly elevated when disaggregated daily drinking data were analyzed using GLMM or GEE with an exchangeable correlation structure. Most methods yielded similar statistical power, although power decreased when modeling disaggregated daily drinking with GLMM and had mixed increases and decreases when the longitudinal nature of data was ignored by using fully aggregated data with independent samples t tests. CONCLUSIONS: When testing treatment main effects, relatively simpler statistical methods with fewer repeated measures may perform equally well or better than more complicated methods. Patterns of significance and treatment effect size estimates are likely comparable across most studies that use different aggregation and statistical methods, but differences between these methods may occasionally have an important impact on conclusions in clinical trials.
Authors: Ned L Cooney; Mark D Litt; Kevin A Sevarino; Lucienne Levy; Linda S Kranitz; Helen Sackler; Judith L Cooney Journal: J Consult Clin Psychol Date: 2015-01-26
Authors: Stephanie S O'Malley; William R Corbin; Robert F Leeman; Kelly S DeMartini; Lisa M Fucito; Jolomi Ikomi; Denise M Romano; Ran Wu; Benjamin A Toll; Kenneth J Sher; Ralitza Gueorguieva; Henry R Kranzler Journal: J Clin Psychiatry Date: 2015-02 Impact factor: 4.384
Authors: Raymond F Anton; Stephanie S O'Malley; Domenic A Ciraulo; Ron A Cisler; David Couper; Dennis M Donovan; David R Gastfriend; James D Hosking; Bankole A Johnson; Joseph S LoCastro; Richard Longabaugh; Barbara J Mason; Margaret E Mattson; William R Miller; Helen M Pettinati; Carrie L Randall; Robert Swift; Roger D Weiss; Lauren D Williams; Allen Zweben Journal: JAMA Date: 2006-05-03 Impact factor: 56.272
Authors: Elizabeth E Epstein; Barbara S McCrady; Kevin A Hallgren; Sharon Cook; Noelle K Jensen; Thomas Hildebrandt Journal: Psychol Addict Behav Date: 2017-11-20