OBJECTIVE: To independently appraise the methodological quality of a sample of reports of meta-analyses that address critical care topics in the Cochrane Database of Systematic Reviews compared with the quality of reports published in regular journals, using a validated assessment instrument, the Overview Quality Assessment Questionnaire (OQAQ). DATA SOURCE: Studies were selected from a search of MEDLINE, EMBASE, and the Cochrane Database of Systematic Reviews from 1994 to 2003, using multiple search terms for critical care and sensitive filters to identify meta-analyses. STUDY SELECTION: Two authors independently selected meta-analyses that addressed topics pertinent to critical care medicine. DATA EXTRACTION: Two authors independently extracted the data. The proportion of reports that met each component of the OQAQ was determined, as was the overall quality score. Meta-analyses published in the Cochrane Database of Systematic Reviews were compared with those published in regular journals. DATA SYNTHESIS: There were 36 reports of meta-analyses in the Cochrane Database of Systematic Reviews and 103 reports of meta-analyses published in regular journals; 11 of these were reports of Cochrane reviews. The meta-analyses published in the Cochrane Database of Systematic Reviews were more likely to fulfill most components of the OQAQ. The median overall OQAQ scores indicated significant methodological problems in the reports regardless of the source of publication, although the reports in the Cochrane database scored higher than those in regular journals (five compared with two, p<.001). Major methodological flaws, notably failure to appropriately refer to the validity of included studies, were found in meta-analyses in both the Cochrane Database of Systematic Reviews and regular journals (44.4% and 79.3%, respectively). CONCLUSIONS: Although the quality of reports of meta-analyses published in the Cochrane Database of Systematic Reviews is superior to the quality of reports of meta-analyses published in regular journals, there is significant room for improvement. Clinicians should critically appraise all reports of meta-analyses before considering the results, regardless of the source of publication.
OBJECTIVE: To independently appraise the methodological quality of a sample of reports of meta-analyses that address critical care topics in the Cochrane Database of Systematic Reviews compared with the quality of reports published in regular journals, using a validated assessment instrument, the Overview Quality Assessment Questionnaire (OQAQ). DATA SOURCE: Studies were selected from a search of MEDLINE, EMBASE, and the Cochrane Database of Systematic Reviews from 1994 to 2003, using multiple search terms for critical care and sensitive filters to identify meta-analyses. STUDY SELECTION: Two authors independently selected meta-analyses that addressed topics pertinent to critical care medicine. DATA EXTRACTION: Two authors independently extracted the data. The proportion of reports that met each component of the OQAQ was determined, as was the overall quality score. Meta-analyses published in the Cochrane Database of Systematic Reviews were compared with those published in regular journals. DATA SYNTHESIS: There were 36 reports of meta-analyses in the Cochrane Database of Systematic Reviews and 103 reports of meta-analyses published in regular journals; 11 of these were reports of Cochrane reviews. The meta-analyses published in the Cochrane Database of Systematic Reviews were more likely to fulfill most components of the OQAQ. The median overall OQAQ scores indicated significant methodological problems in the reports regardless of the source of publication, although the reports in the Cochrane database scored higher than those in regular journals (five compared with two, p<.001). Major methodological flaws, notably failure to appropriately refer to the validity of included studies, were found in meta-analyses in both the Cochrane Database of Systematic Reviews and regular journals (44.4% and 79.3%, respectively). CONCLUSIONS: Although the quality of reports of meta-analyses published in the Cochrane Database of Systematic Reviews is superior to the quality of reports of meta-analyses published in regular journals, there is significant room for improvement. Clinicians should critically appraise all reports of meta-analyses before considering the results, regardless of the source of publication.
Authors: Alex Pollock; Sybil E Farmer; Marian C Brady; Peter Langhorne; Gillian E Mead; Jan Mehrholz; Frederike van Wijck Journal: Cochrane Database Syst Rev Date: 2014-11-12
Authors: Mary Klem; Ester Saghafi; Rebecca Abromitis; Angela Stover; Mary Amanda Dew; Paul Pilkonis Journal: Qual Life Res Date: 2009-06-23 Impact factor: 4.147
Authors: Thomas Agoritsas; Arnaud Merglen; Delphine S Courvoisier; Christophe Combescure; Nicolas Garin; Arnaud Perrier; Thomas V Perneger Journal: J Med Internet Res Date: 2012-06-12 Impact factor: 5.428
Authors: Geumhee Gwak; Hae Kyung Lee; Hee Jung Kim; Si Youn Lee; Yong Lai Park; Jong Won Lee; Seung Gi Kim; Ho Huh; Hyukjai Shin; Je Ryong Kim; Jin-Seok Ahn; Ju Hyuk Son; Il Gyun Lee; Woo Chan Park; Sung Yong Kim; Sehwan Han; Eun Sook Lee Journal: J Breast Cancer Date: 2012-06-28 Impact factor: 3.588
Authors: Anders W Jørgensen; Katja L Maric; Britta Tendal; Annesofie Faurschou; Peter C Gøtzsche Journal: BMC Med Res Methodol Date: 2008-09-09 Impact factor: 4.615
Authors: Cosetta Minelli; John R Thompson; Keith R Abrams; Ammarin Thakkinstian; John Attia Journal: Am J Epidemiol Date: 2009-11-09 Impact factor: 4.897