Multisite effectiveness trials of treatments for substance abuse and co-occurring problems: have we chosen the best designs?

Multisite effectiveness trials such as those carried out in the National Drug Abuse Treatment Clinical Trials Network (CTN) are a critical step in the development and dissemination of evidence-based treatments because they address how such treatments perform in real-world clinical settings. As Brigham et al. summarized in a recent article (G. S. Brigham, D. J. Feaster, P. G. Wakim, & C. L. Dempsey C. L., 2009), several possible experimental designs may be chosen for such effectiveness trials. These include (a) a new treatment intervention (Tx) is compared to an existing mode of community based treatment as usual (TAU): Tx versus TAU; (b) a new intervention is added to TAU and compared to TAU alone: Tx + TAU versus TAU; or (c) a new intervention is added to TAU and compared to a control condition added to TAU: Tx + TAU versus control + TAU. Each of these designs addresses a different question and has different potential strengths and weaknesses. As of December 2009, the primary outcome paper had been published for 16 of the multisite randomized clinical trials conducted in the CTN, testing various treatments for drug abuse, HIV risk behavior, or related problems. This paper systematically examines, for each of the completed trials, the experimental design type chosen and its original rationale, the main findings of the trial, and the strengths and weaknesses of the design in hindsight. Based on this review, recommendations are generated to inform the design of future effectiveness trials on treatments for substance abuse, HIV risk, and other behavioral health problems.