Christopher W Halladay1, Thomas A Trikalinos2, Ian T Schmid3, Christopher H Schmid1, Issa J Dahabreh4. 1. Center for Evidence Based Medicine, School of Public Health, Brown University, Box G-S121-8, Providence, RI 02912, USA; Department of Biostatistics, School of Public Health, Brown University, Box G-S121-8, Providence, RI 02912, USA. 2. Center for Evidence Based Medicine, School of Public Health, Brown University, Box G-S121-8, Providence, RI 02912, USA; Department of Health Services, Policy, and Practice, School of Public Health, Brown University, Box G-S121-8, Providence, RI 02912, USA. 3. Center for Evidence Based Medicine, School of Public Health, Brown University, Box G-S121-8, Providence, RI 02912, USA. 4. Center for Evidence Based Medicine, School of Public Health, Brown University, Box G-S121-8, Providence, RI 02912, USA; Department of Health Services, Policy, and Practice, School of Public Health, Brown University, Box G-S121-8, Providence, RI 02912, USA. Electronic address: issa_dahabreh@brown.edu.
Abstract
OBJECTIVES: Searching multiple sources when conducting systematic reviews is considered good practice. We aimed to investigate the impact of using sources beyond PubMed in systematic reviews of therapeutic interventions. STUDY DESIGN AND SETTING: We randomly selected 50 Cochrane reviews that searched the PubMed (or MEDLINE) and EMBASE databases and included a meta-analysis of ≥10 studies. We checked whether each eligible record in each review (n = 2,700) was retrievable in PubMed and EMBASE. For the first-listed meta-analysis of ≥10 studies in each review, we examined whether excluding studies not found in PubMed affected results. RESULTS: A median of one record per review was indexed in EMBASE but not in PubMed; a median of four records per review was not indexed in PubMed or EMBASE. Meta-analyses included a median of 13.5 studies; a median of zero studies per meta-analysis was indexed in EMBASE but not in PubMed; a median of one study per meta-analysis was not indexed in PubMed or EMBASE. Meta-analysis using only PubMed-indexed vs. all available studies led to a different conclusion in a single case (on the basis of conventional criteria for statistical significance). In meta-regression analyses, effects in PubMed- vs. non-PubMed-indexed studies were statistically significantly different in a single data set. CONCLUSION: For systematic reviews of the effects of therapeutic interventions, gains from searching sources beyond PubMed, and from searching EMBASE in particular are modest.
OBJECTIVES: Searching multiple sources when conducting systematic reviews is considered good practice. We aimed to investigate the impact of using sources beyond PubMed in systematic reviews of therapeutic interventions. STUDY DESIGN AND SETTING: We randomly selected 50 Cochrane reviews that searched the PubMed (or MEDLINE) and EMBASE databases and included a meta-analysis of ≥10 studies. We checked whether each eligible record in each review (n = 2,700) was retrievable in PubMed and EMBASE. For the first-listed meta-analysis of ≥10 studies in each review, we examined whether excluding studies not found in PubMed affected results. RESULTS: A median of one record per review was indexed in EMBASE but not in PubMed; a median of four records per review was not indexed in PubMed or EMBASE. Meta-analyses included a median of 13.5 studies; a median of zero studies per meta-analysis was indexed in EMBASE but not in PubMed; a median of one study per meta-analysis was not indexed in PubMed or EMBASE. Meta-analysis using only PubMed-indexed vs. all available studies led to a different conclusion in a single case (on the basis of conventional criteria for statistical significance). In meta-regression analyses, effects in PubMed- vs. non-PubMed-indexed studies were statistically significantly different in a single data set. CONCLUSION: For systematic reviews of the effects of therapeutic interventions, gains from searching sources beyond PubMed, and from searching EMBASE in particular are modest.
Authors: Lin Wang; Benjamin Rouse; Arielle Marks-Anglin; Rui Duan; Qiyuan Shi; Kevin Quach; Yong Chen; Christopher Cameron; Christopher H Schmid; Tianjing Li Journal: J Clin Epidemiol Date: 2019-06-18 Impact factor: 6.437
Authors: Kim Peterson; Johanna Anderson; Erin Boundy; Lauren Ferguson; Ellen McCleery; Kallie Waldrip Journal: Am J Public Health Date: 2018-03 Impact factor: 9.308
Authors: A Kapoor; A Ellis; N Shaffer; J Gurwitz; A Chandramohan; J Saulino; A Ishak; T Okubanjo; F Michota; E Hylek; T A Trikalinos Journal: J Thromb Haemost Date: 2017-01-19 Impact factor: 5.824
Authors: Xiaoxin I Yao; Xiaofei Wang; Paul J Speicher; E Shelley Hwang; Perry Cheng; David H Harpole; Mark F Berry; Deborah Schrag; Herbert H Pang Journal: J Natl Cancer Inst Date: 2017-08-01 Impact factor: 13.506