BACKGROUND: Previous reviews have identified problems in the design and analysis of group-randomized trials in a number of areas. Similar problems may exist in cancer research, but there have been no comprehensive reviews. METHODS: We searched Medline and PubMed for group-randomized trials focused on cancer prevention and control that were published between 2002 and 2006. We located and reviewed 75 articles to determine whether articles included evidence of taking group randomization into account in establishing the size of the trial, such as reporting the expected intraclass correlation, the group component of variance, or the variance inflation factor. We also examined the analytical approaches to determine their appropriateness. RESULTS: Only 18 (24%) of the 75 articles documented appropriate methods for sample size calculations. Only 34 (45%) limited their reports to analyses judged to be appropriate. Fully 26 (34%) failed to report any analyses that were judged to be appropriate. The most commonly used inappropriate analysis was an analysis at the individual level that ignored the groups altogether. Nine articles (12%) did not provide sufficient information. CONCLUSIONS: Many investigators who use group-randomized trials in cancer research do not adequately attend to the special design and analytic challenges associated with these trials. Failure to do so can lead to reporting type I errors as real effects, mislead investigators and policy-makers, and slow progress toward control and prevention of cancer. A collaborative effort by investigators, statisticians, and others will be required to ensure that group-randomized trials are planned and analyzed using appropriate methods so that the scientific community can have confidence in the published results.
BACKGROUND: Previous reviews have identified problems in the design and analysis of group-randomized trials in a number of areas. Similar problems may exist in cancer research, but there have been no comprehensive reviews. METHODS: We searched Medline and PubMed for group-randomized trials focused on cancer prevention and control that were published between 2002 and 2006. We located and reviewed 75 articles to determine whether articles included evidence of taking group randomization into account in establishing the size of the trial, such as reporting the expected intraclass correlation, the group component of variance, or the variance inflation factor. We also examined the analytical approaches to determine their appropriateness. RESULTS: Only 18 (24%) of the 75 articles documented appropriate methods for sample size calculations. Only 34 (45%) limited their reports to analyses judged to be appropriate. Fully 26 (34%) failed to report any analyses that were judged to be appropriate. The most commonly used inappropriate analysis was an analysis at the individual level that ignored the groups altogether. Nine articles (12%) did not provide sufficient information. CONCLUSIONS: Many investigators who use group-randomized trials in cancer research do not adequately attend to the special design and analytic challenges associated with these trials. Failure to do so can lead to reporting type I errors as real effects, mislead investigators and policy-makers, and slow progress toward control and prevention of cancer. A collaborative effort by investigators, statisticians, and others will be required to ensure that group-randomized trials are planned and analyzed using appropriate methods so that the scientific community can have confidence in the published results.
Authors: Bethany A Bell; Anthony J Onwuegbuzie; John M Ferron; Qun G Jiao; Susan T Hibbard; Jeffrey D Kromrey Journal: Am J Public Health Date: 2012-01-19 Impact factor: 9.308
Authors: Siyun Yang; Monique Anderson Starks; Adrian F Hernandez; Elizabeth L Turner; Robert M Califf; Christopher M O'Connor; Robert J Mentz; Kingshuk Roy Choudhury Journal: Contemp Clin Trials Date: 2019-06-20 Impact factor: 2.226
Authors: An-Wen Chan; Jennifer M Tetzlaff; Peter C Gøtzsche; Douglas G Altman; Howard Mann; Jesse A Berlin; Kay Dickersin; Asbjørn Hróbjartsson; Kenneth F Schulz; Wendy R Parulekar; Karmela Krleza-Jeric; Andreas Laupacis; David Moher Journal: BMJ Date: 2013-01-08
Authors: David M Murray; Sherri L Pals; Stephanie M George; Andrey Kuzmichev; Gabriel Y Lai; Jocelyn A Lee; Ranell L Myles; Shakira M Nelson Journal: Prev Med Date: 2018-03-16 Impact factor: 4.018
Authors: Victoria M Taylor; Tung T Nguyen; J Carey Jackson; Stephen J McPhee Journal: Cancer Epidemiol Biomarkers Prev Date: 2008-11 Impact factor: 4.254