Paul E Alexander1, Ashley J Bonner2, Arnav Agarwal3, Shelly-Anne Li4, Abishek Hariharan5, Zain Izhar5, Neera Bhatnagar6, Carolina Alba7, Elie A Akl8, Yutong Fei9, Gordon H Guyatt10, Joseph Beyene11. 1. Health Research Methods (HRM), Department of Clinical Epidemiology and Biostatistics, McMaster University, Health Sciences Building (HSB), 1280 Main Street West, Hamilton, Ontario L8N 3Z5, Canada. Electronic address: elias98_99@yahoo.com. 2. Health Research Methods (HRM), Department of Clinical Epidemiology and Biostatistics, McMaster University, 1280 Main Street West, Hamilton, Ontario L8N 3Z5, Canada. 3. Faculty of Health Sciences, McMaster University, Hamilton, Ontario L8N 3Z5, Canada; Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario L8N 3Z5, Canada; Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada. 4. Health Research Methods (HRM), Department of Clinical Epidemiology and Biostatistics, McMaster University, Health Sciences Building (HSB), 1280 Main Street West, Hamilton, Ontario L8N 3Z5, Canada. 5. Life Sciences IV, McMaster University, 1200 Main Street West, Hamilton, Ontario L8N 3Z5, Canada. 6. Health Sciences Library, McMaster University, Hamilton, Ontario L8N 3Z5, Canada. 7. Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario L8N 3Z5, Canada; Division of Cardiology and Heart Transplantation, University Health Network, 585 University Avenue, Toronto, Ontario, Canada. 8. Clinical Epidemiology Unit, American University of Beirut, Lebanon; Center for Systematic Reviews in Health Policy and Systems Research (SPARK), American University of Beirut, Lebanon. 9. Department of Clinical Epidemiology and Biostatistics, McMaster University, Health Sciences Building (HSB), 1280 Main Street West, Hamilton, Ontario L8N 3Z5, Canada; Centre for Evidence-Based Chinese Medicine, Beijing University of Chinese Medicine. 10. Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario L8N 3Z5, Canada. 11. Department of Clinical Epidemiology & Biostatistics, McMaster University, Michael DeGroote Centre for Learning & Discovery, Room 3208, 1200 Main Street West, Hamilton, Ontario L8N 3Z5, Canada; John D. Cameron Endowed Chair in Genetic Epidemiology, McMaster University, Michael DeGroote Centre for Learning & Discovery, Room 3208, 1200 Main Street West, Hamilton, Ontario L8N 3Z5, Canada; Population Genomics Program, McMaster University, Michael DeGroote Centre for Learning & Discovery, Room 3208, 1200 Main Street West, Hamilton, Ontario L8N 3Z5, Canada.
Abstract
OBJECTIVES: Prior studies regarding whether single-center trial estimates are larger than multi-center are equivocal. We examined the extent to which single-center trials yield systematically larger effects than multi-center trials. STUDY DESIGN AND SETTING: We searched the 119 core clinical journals and the Cochrane Database of Systematic Reviews for meta-analyses (MAs) of randomized controlled trials (RCTs) published during 2012. In this meta-epidemiologic study, for binary variables, we computed the pooled ratio of ORs (RORs), and for continuous outcomes mean difference in standardized mean differences (SMDs), we conducted weighted random-effects meta-regression and random-effects MA modeling. Our primary analyses were restricted to MAs that included at least five RCTs and in which at least 25% of the studies used each of single trial center (SC) and more trial center (MC) designs. RESULTS: We identified 81 MAs for the odds ratio (OR) and 43 for the SMD outcome measures. Based on our analytic plan, our primary analysis (core) is based on 25 MAs/241 RCTs (binary outcome) and 18 MAs/173 RCTs (continuous outcome). Based on the core analysis, we found no difference in magnitude of effect between SC and MC for binary outcomes [RORs: 1.02; 95% confidence interval (CI): 0.83, 1.24; I(2) 20.2%]. Effect sizes were systematically larger for SC than MC for the continuous outcome measure (mean difference in SMDs: -0.13; 95% CI: -0.21, -0.05; I(2) 0%). CONCLUSIONS: Our results do not support prior findings of larger effects in SC than MC trials addressing binary outcomes but show a very similar small increase in effect in SC than MC trials addressing continuous outcomes. Authors of systematic reviews would be wise to include all trials irrespective of SC vs. MC design and address SC vs. MC status as a possible explanation of heterogeneity (and consider sensitivity analyses).
OBJECTIVES: Prior studies regarding whether single-center trial estimates are larger than multi-center are equivocal. We examined the extent to which single-center trials yield systematically larger effects than multi-center trials. STUDY DESIGN AND SETTING: We searched the 119 core clinical journals and the Cochrane Database of Systematic Reviews for meta-analyses (MAs) of randomized controlled trials (RCTs) published during 2012. In this meta-epidemiologic study, for binary variables, we computed the pooled ratio of ORs (RORs), and for continuous outcomes mean difference in standardized mean differences (SMDs), we conducted weighted random-effects meta-regression and random-effects MA modeling. Our primary analyses were restricted to MAs that included at least five RCTs and in which at least 25% of the studies used each of single trial center (SC) and more trial center (MC) designs. RESULTS: We identified 81 MAs for the odds ratio (OR) and 43 for the SMD outcome measures. Based on our analytic plan, our primary analysis (core) is based on 25 MAs/241 RCTs (binary outcome) and 18 MAs/173 RCTs (continuous outcome). Based on the core analysis, we found no difference in magnitude of effect between SC and MC for binary outcomes [RORs: 1.02; 95% confidence interval (CI): 0.83, 1.24; I(2) 20.2%]. Effect sizes were systematically larger for SC than MC for the continuous outcome measure (mean difference in SMDs: -0.13; 95% CI: -0.21, -0.05; I(2) 0%). CONCLUSIONS: Our results do not support prior findings of larger effects in SC than MC trials addressing binary outcomes but show a very similar small increase in effect in SC than MC trials addressing continuous outcomes. Authors of systematic reviews would be wise to include all trials irrespective of SC vs. MC design and address SC vs. MC status as a possible explanation of heterogeneity (and consider sensitivity analyses).