Derrick A Bennett1, Nancy K Latham, Caroline Stretton, Craig S Anderson. 1. The Clinical Trials Research Unit, 3 Ferncroft Street, Grafton, Faculty of Medicine and Health Sciences, Private Bag 92019, University of Auckland, New Zealand. d.bennett@ctru.auckland.ac.nz
Abstract
OBJECTIVES: Publication bias is a problem in systematic reviews of randomized controlled trials. The aim of this study was to assess the influence of publication bias in a systematic review of the effectiveness of Progressive Resistance Training (PRT) in older people. STUDY DESIGN AND SETTING: The relevant studies were ascertained from three sources: electronic databases, experts, and handsearching. Capture-recapture, visual inspection of funnel plots, two statistical tests, and two methods that make adjustments for publication bias, were employed to check the robustness of the conclusions of the systematic review. RESULTS: The methods employed gave broadly consistent results. Capture-recapture estimated that 3 (95% CI ) relevant studies were missed, while Trim and Fill suggested 16 studies had been missed. Both Egger's test for bias and a funnel plot regression approach suggested that publication bias was present. A selection model approach suggested that the funnel plot asymmetry observed may not be entirely due to publication bias. CONCLUSION: Capture-recapture is a potentially useful method for assessing publication bias. Further research in the form of simulation studies is required, using a variety of scenarios to investigate the extent to which each method approximates the truth.
OBJECTIVES: Publication bias is a problem in systematic reviews of randomized controlled trials. The aim of this study was to assess the influence of publication bias in a systematic review of the effectiveness of Progressive Resistance Training (PRT) in older people. STUDY DESIGN AND SETTING: The relevant studies were ascertained from three sources: electronic databases, experts, and handsearching. Capture-recapture, visual inspection of funnel plots, two statistical tests, and two methods that make adjustments for publication bias, were employed to check the robustness of the conclusions of the systematic review. RESULTS: The methods employed gave broadly consistent results. Capture-recapture estimated that 3 (95% CI ) relevant studies were missed, while Trim and Fill suggested 16 studies had been missed. Both Egger's test for bias and a funnel plot regression approach suggested that publication bias was present. A selection model approach suggested that the funnel plot asymmetry observed may not be entirely due to publication bias. CONCLUSION: Capture-recapture is a potentially useful method for assessing publication bias. Further research in the form of simulation studies is required, using a variety of scenarios to investigate the extent to which each method approximates the truth.
Authors: Jalal Poorolajal; Ali Akbar Haghdoost; Mahmood Mahmoodi; Reza Majdzadeh; Siavosh Nasseri-Moghaddam; Akbar Fotouhi Journal: J Res Med Sci Date: 2010-03 Impact factor: 1.852
Authors: Gerben ter Riet; Daniel A Korevaar; Marlies Leenaars; Peter J Sterk; Cornelis J F Van Noorden; Lex M Bouter; René Lutter; Ronald P Oude Elferink; Lotty Hooft Journal: PLoS One Date: 2012-09-05 Impact factor: 3.240