Gerard J P Van Breukelen1. 1. Department of Methodology & Statistics, Research Institute Caphri, Maastricht University, P.O. Box 616, 6200 MD Maastricht, The Netherlands. gerard.vbreukelen@stat.unimaas.nl
Abstract
BACKGROUND AND OBJECTIVE: For inferring a treatment effect from the difference between a treated and untreated group on a quantitative outcome measured before and after treatment, current methods are analysis of covariance (ANCOVA) of the outcome with the baseline as covariate, and analysis of variance (ANOVA) of change from baseline. This article compares both methods on power and bias, for randomized and nonrandomized studies. METHODS: The methods are compared by writing both as a regression model and as a repeated measures model, and are applied to a nonrandomized study of preventing depression. RESULTS: In randomized studies both methods are unbiased, but ANCOVA has more power. If treatment assignment is based on the baseline, only ANCOVA is unbiased. In nonrandomized studies with preexisting groups differing at baseline, the two methods cannot both be unbiased, and may contradict each other. In the study of depression, ANCOVA suggests absence, but ANOVA of change suggests presence, of a treatment effect. The methods differ because ANCOVA assumes absence of a baseline difference. CONCLUSION: In randomized studies and studies with treatment assignment depending on the baseline, ANCOVA must be used. In nonrandomized studies of preexisting groups, ANOVA of change seems less biased than ANCOVA, but two control groups and two baseline measurements are recommended.
BACKGROUND AND OBJECTIVE: For inferring a treatment effect from the difference between a treated and untreated group on a quantitative outcome measured before and after treatment, current methods are analysis of covariance (ANCOVA) of the outcome with the baseline as covariate, and analysis of variance (ANOVA) of change from baseline. This article compares both methods on power and bias, for randomized and nonrandomized studies. METHODS: The methods are compared by writing both as a regression model and as a repeated measures model, and are applied to a nonrandomized study of preventing depression. RESULTS: In randomized studies both methods are unbiased, but ANCOVA has more power. If treatment assignment is based on the baseline, only ANCOVA is unbiased. In nonrandomized studies with preexisting groups differing at baseline, the two methods cannot both be unbiased, and may contradict each other. In the study of depression, ANCOVA suggests absence, but ANOVA of change suggests presence, of a treatment effect. The methods differ because ANCOVA assumes absence of a baseline difference. CONCLUSION: In randomized studies and studies with treatment assignment depending on the baseline, ANCOVA must be used. In nonrandomized studies of preexisting groups, ANOVA of change seems less biased than ANCOVA, but two control groups and two baseline measurements are recommended.
Authors: Carlos G Grijalva; Christianne L Roumie; Harvey J Murff; Adriana M Hung; Cole Beck; Xulei Liu; Marie R Griffin; Robert A Greevy Journal: J Comp Eff Res Date: 2015-08 Impact factor: 1.744
Authors: Shinichi Amano; Joe R Nocera; Srikant Vallabhajosula; Jorge L Juncos; Robert J Gregor; Dwight E Waddell; Steven L Wolf; Chris J Hass Journal: Parkinsonism Relat Disord Date: 2013-07-05 Impact factor: 4.891
Authors: Paul Bangirana; Bruno Giordani; Chandy C John; Connie Page; Robert O Opoka; Michael J Boivin Journal: J Dev Behav Pediatr Date: 2009-08 Impact factor: 2.225
Authors: Brodie M Sakakibara; William C Miller; Melanie Souza; Viara Nikolova; Krista L Best Journal: Arch Phys Med Rehabil Date: 2013-02-04 Impact factor: 3.966