P C Lambert1, A J Sutton, K R Abrams, D R Jones. 1. Department of Epidemiology and Public Health, University of Leicester, 22-28 Princess Road West, LE1 6TP, Leicester, UK. p14@le.ac.uk
Abstract
OBJECTIVES: To compare meta-analysis of summary study level data with the equivalent individual patient data (IPD) analysis when interest lies in identification of binary patient characteristics related to treatment efficacy. DESIGN: A simulation study comparing meta-regression with IPD analyses of randomized controlled trials. METHODS: Twenty-seven different meta-analysis situations were simulated with 1000 repetitions in each case. The following parameters were varied: (1) the treatment effect magnitude for different patient risk groups; (2) sample sizes of individual studies; and (3) number of studies. The meta-regression and IPD results were then compared for each situation. RESULTS: The statistical power of meta-regression was dramatically and consistently lower than that of IPD analysis, with little agreement between the parameter estimates obtained from the two methods. Only in meta-analyses of large numbers of large trials, did meta-regression detect differential treatment effects between risk groups with any consistency. CONCLUSIONS: Meta-analysis of summary data may be adequate when estimating a single pooled treatment effect or investigating study level characteristics. However, when interest lies in investigating whether patient characteristics are related to treatment, IPD analysis will generally be necessary to discover any such relationships. In these situations practitioners should try to obtain individual-level data.
OBJECTIVES: To compare meta-analysis of summary study level data with the equivalent individual patient data (IPD) analysis when interest lies in identification of binary patient characteristics related to treatment efficacy. DESIGN: A simulation study comparing meta-regression with IPD analyses of randomized controlled trials. METHODS: Twenty-seven different meta-analysis situations were simulated with 1000 repetitions in each case. The following parameters were varied: (1) the treatment effect magnitude for different patient risk groups; (2) sample sizes of individual studies; and (3) number of studies. The meta-regression and IPD results were then compared for each situation. RESULTS: The statistical power of meta-regression was dramatically and consistently lower than that of IPD analysis, with little agreement between the parameter estimates obtained from the two methods. Only in meta-analyses of large numbers of large trials, did meta-regression detect differential treatment effects between risk groups with any consistency. CONCLUSIONS: Meta-analysis of summary data may be adequate when estimating a single pooled treatment effect or investigating study level characteristics. However, when interest lies in investigating whether patient characteristics are related to treatment, IPD analysis will generally be necessary to discover any such relationships. In these situations practitioners should try to obtain individual-level data.
Authors: Rebecca N Adams; Catherine E Mosher; Cindy K Blair; Denise C Snyder; Richard Sloane; Wendy Demark-Wahnefried Journal: Cancer Date: 2014-08-25 Impact factor: 6.860
Authors: Christian Asseburg; Yolanda Bravo Vergel; Stephen Palmer; Elisabeth Fenwick; Mark de Belder; Keith R Abrams; Mark Sculpher Journal: Heart Date: 2007-02-03 Impact factor: 5.994
Authors: M Haasova; F C Warren; M Ussher; K Janse Van Rensburg; G Faulkner; M Cropley; J Byron-Daniel; E S Everson-Hock; H Oh; A H Taylor Journal: Psychopharmacology (Berl) Date: 2014-02-13 Impact factor: 4.530
Authors: Cosetta Minelli; John R Thompson; Keith R Abrams; Ammarin Thakkinstian; John Attia Journal: Am J Epidemiol Date: 2009-11-09 Impact factor: 4.897