OBJECTIVES: We reviewed published individually randomized group treatment (IRGT) trials to assess researchers' awareness of within-group correlation and determine whether appropriate design and analytic methods were used to test for treatment effectiveness. METHODS: We assessed sample size and analytic methods in IRGT trials published in 6 public health and behavioral health journals between 2002 and 2006. RESULTS: Our review included 34 articles; in 32 (94.1%) of these articles, inappropriate analytic methods were used. In only 1 article did the researchers claim that expected intraclass correlations (ICCs) were taken into account in sample size estimation; in most articles, sample size was not mentioned or ICCs were ignored in the reported calculations. CONCLUSIONS: Trials in which individuals are randomly assigned to study conditions and treatments administered in groups may induce within-group correlation, violating the assumption of independence underlying commonly used statistical methods. Methods that take expected ICCs into account should be used in reexamining past studies and planning future studies to ensure that interventions are not judged effective solely on the basis of statistical artifacts. We strongly encourage investigators to report ICCs from IRGT trials and describe study characteristics clearly to aid these efforts.
OBJECTIVES: We reviewed published individually randomized group treatment (IRGT) trials to assess researchers' awareness of within-group correlation and determine whether appropriate design and analytic methods were used to test for treatment effectiveness. METHODS: We assessed sample size and analytic methods in IRGT trials published in 6 public health and behavioral health journals between 2002 and 2006. RESULTS: Our review included 34 articles; in 32 (94.1%) of these articles, inappropriate analytic methods were used. In only 1 article did the researchers claim that expected intraclass correlations (ICCs) were taken into account in sample size estimation; in most articles, sample size was not mentioned or ICCs were ignored in the reported calculations. CONCLUSIONS: Trials in which individuals are randomly assigned to study conditions and treatments administered in groups may induce within-group correlation, violating the assumption of independence underlying commonly used statistical methods. Methods that take expected ICCs into account should be used in reexamining past studies and planning future studies to ensure that interventions are not judged effective solely on the basis of statistical artifacts. We strongly encourage investigators to report ICCs from IRGT trials and describe study characteristics clearly to aid these efforts.
Authors: Nancy Van Devanter; Virginia Gonzales; Cheryl Merzel; Nina S Parikh; David Celantano; Judith Greenberg Journal: Am J Public Health Date: 2002-01 Impact factor: 9.308
Authors: Lyne Lalonde; Katherine Gray-Donald; Ilka Lowensteyn; Sylvie Marchand; Marc Dorais; George Michaels; Hilary A Llewellyn-Thomas; Annette O'Connor; Steven A Grover Journal: Prev Med Date: 2002-07 Impact factor: 4.018
Authors: Charlotte A Pratt; Josephine Boyington; Layla Esposito; Victoria L Pemberton; Denise Bonds; Melinda Kelley; Song Yang; David Murray; June Stevens Journal: Contemp Clin Trials Date: 2013-08-31 Impact factor: 2.226
Authors: An-Wen Chan; Jennifer M Tetzlaff; Peter C Gøtzsche; Douglas G Altman; Howard Mann; Jesse A Berlin; Kay Dickersin; Asbjørn Hróbjartsson; Kenneth F Schulz; Wendy R Parulekar; Karmela Krleza-Jeric; Andreas Laupacis; David Moher Journal: BMJ Date: 2013-01-08
Authors: June Stevens; Charlotte Pratt; Josephine Boyington; Cheryl Nelson; Kimberly P Truesdale; Dianne S Ward; Leslie Lytle; Nancy E Sherwood; Thomas N Robinson; Shirley Moore; Shari Barkin; Ying Kuen Cheung; David M Murray Journal: Am J Prev Med Date: 2016-10-26 Impact factor: 5.043
Authors: Natalia E Morone; Carol M Greco; Bruce L Rollman; Charity G Moore; Bridget Lane; Lisa Morrow; Nancy W Glynn; Jill Delaney; Steven M Albert; Debra K Weiner Journal: Contemp Clin Trials Date: 2011-11-15 Impact factor: 2.226
Authors: Andria B Eisman; Megan Hicks; Poco D Kernsmith; Laney Rupp; Joanne P Smith-Darden; Marc A Zimmerman Journal: Transl Behav Med Date: 2021-02-11 Impact factor: 3.046