R Lüdtke1, A L B Rutten2. 1. Karl und Veronica Carstens-Stiftung, Essen, Germany. Electronic address: r.luedtke@carstens-stiftung.de. 2. Commissie Methode en Validering, Artsenvereniging voor homeopathie VHAN (Association of Dutch homeopathic physicians), Breda, The Netherlands.
Abstract
OBJECTIVE: Shang's recently published meta-analysis on homeopathic remedies (Lancet) based its main conclusion on a subset of eight larger trials out of 21 high quality trials (out of 110 included trials). We performed a sensitivity analysis on various other meaningful trial subsets of all high quality trials. STUDY DESIGN: Subsets were defined according to sample size, type of homeopathy, type of publication, and treated disease/condition. For each subset, we estimated the overall odds ratios (ORs) from random effect meta-analyses. RESULTS: All trials were highly heterogeneous (I2=62.2%). Homeopathy had a significant effect beyond placebo (OR=0.76; 95% CI: 0.59-0.99; p=0.039). When the set of analyzed trials was successively restricted to larger patient numbers, the ORs varied moderately (median: 0.82, range: 0.71-1.02) and the P-values increased steadily (median: 0.16, range: 0.03-0.93), including Shang's results for the eight largest trials (OR=0.88, CI: 0.66-1.18; P=0.41). Shang's negative results were mainly influenced by one single trial on preventing muscle soreness in 400 long-distance runners. CONCLUSIONS: The meta-analysis results change sensitively to the chosen threshold defining large sample sizes. Because of the high heterogeneity between the trials, Shang's results and conclusions are less definite than had been presented.
OBJECTIVE: Shang's recently published meta-analysis on homeopathic remedies (Lancet) based its main conclusion on a subset of eight larger trials out of 21 high quality trials (out of 110 included trials). We performed a sensitivity analysis on various other meaningful trial subsets of all high quality trials. STUDY DESIGN: Subsets were defined according to sample size, type of homeopathy, type of publication, and treated disease/condition. For each subset, we estimated the overall odds ratios (ORs) from random effect meta-analyses. RESULTS: All trials were highly heterogeneous (I2=62.2%). Homeopathy had a significant effect beyond placebo (OR=0.76; 95% CI: 0.59-0.99; p=0.039). When the set of analyzed trials was successively restricted to larger patient numbers, the ORs varied moderately (median: 0.82, range: 0.71-1.02) and the P-values increased steadily (median: 0.16, range: 0.03-0.93), including Shang's results for the eight largest trials (OR=0.88, CI: 0.66-1.18; P=0.41). Shang's negative results were mainly influenced by one single trial on preventing muscle soreness in 400 long-distance runners. CONCLUSIONS: The meta-analysis results change sensitively to the chosen threshold defining large sample sizes. Because of the high heterogeneity between the trials, Shang's results and conclusions are less definite than had been presented.
Authors: Caroline Eyles; Geraldine M Leydon; George T Lewith; Sarah Brien Journal: Evid Based Complement Alternat Med Date: 2010-09-30 Impact factor: 2.629
Authors: Ana Paula Kawakami; Cesar Sato; Thayna Neves Cardoso; Leoni Villano Bonamin Journal: Evid Based Complement Alternat Med Date: 2011-01-19 Impact factor: 2.629
Authors: Matthias Rostock; Johannes Naumann; Corina Guethlin; Lars Guenther; Hans H Bartsch; Harald Walach Journal: BMC Cancer Date: 2011-01-17 Impact factor: 4.430
Authors: Ursula Wolf; Martin Wolf; Peter Heusser; André Thurneysen; Stephan Baumgartner Journal: Evid Based Complement Alternat Med Date: 2011-04-14 Impact factor: 2.629