BACKGROUND AND OBJECTIVE: Extracting data from primary articles is an essential component in conducting systematic reviews. Incorrect data extraction can lead to false conclusions. The objective of this study was to retrospectively repeat the data extraction in all systematic reviews conducted by the Cochrane Cystic Fibrosis and Genetic Disorders Group. STUDY DESIGN AND SETTING: For each review, data extraction was conducted, by an experienced statistician, for the same publications used by the reviewers. Results were compared with those obtained by the reviewers. RESULTS: Errors were found in 20 of 34 reviews, including incorrect calculations made when converting data in primary articles into data required for the review (2 reviews) and misinterpretation of data that were reported in the primary article (7 reviews). All data-handling errors led to changes in the summary results, but none of these affected the review conclusions. CONCLUSIONS: Important errors were identified in a high proportion of reviews. A variety of problems relating to the reporting of results within a review were identified, but these did not lead to substantial changes in any conclusion.
BACKGROUND AND OBJECTIVE: Extracting data from primary articles is an essential component in conducting systematic reviews. Incorrect data extraction can lead to false conclusions. The objective of this study was to retrospectively repeat the data extraction in all systematic reviews conducted by the Cochrane Cystic Fibrosis and Genetic Disorders Group. STUDY DESIGN AND SETTING: For each review, data extraction was conducted, by an experienced statistician, for the same publications used by the reviewers. Results were compared with those obtained by the reviewers. RESULTS: Errors were found in 20 of 34 reviews, including incorrect calculations made when converting data in primary articles into data required for the review (2 reviews) and misinterpretation of data that were reported in the primary article (7 reviews). All data-handling errors led to changes in the summary results, but none of these affected the review conclusions. CONCLUSIONS: Important errors were identified in a high proportion of reviews. A variety of problems relating to the reporting of results within a review were identified, but these did not lead to substantial changes in any conclusion.
Authors: Chris Littlewood; Marcus Bateman; David Clark; James Selfe; Duncan Watkinson; Mike Walton; Lennard Funk Journal: Shoulder Elbow Date: 2015-01-29
Authors: Alessandro Liberati; Douglas G Altman; Jennifer Tetzlaff; Cynthia Mulrow; Peter C Gøtzsche; John P A Ioannidis; Mike Clarke; P J Devereaux; Jos Kleijnen; David Moher Journal: BMJ Date: 2009-07-21
Authors: Alessandro Liberati; Douglas G Altman; Jennifer Tetzlaff; Cynthia Mulrow; Peter C Gøtzsche; John P A Ioannidis; Mike Clarke; P J Devereaux; Jos Kleijnen; David Moher Journal: PLoS Med Date: 2009-07-21 Impact factor: 11.069
Authors: Richeek Pradhan; David C Hoaglin; Matthew Cornell; Weisong Liu; Victoria Wang; Hong Yu Journal: J Clin Epidemiol Date: 2018-09-23 Impact factor: 6.437
Authors: Jens Jap; Ian J Saldanha; Bryant T Smith; Joseph Lau; Christopher H Schmid; Tianjing Li Journal: Res Synth Methods Date: 2018-11-19 Impact factor: 5.273
Authors: Dena Zeraatkar; Arrti Bhasin; Rita E Morassut; Isabella Churchill; Arnav Gupta; Daeria O Lawson; Anna Miroshnychenko; Emily Sirotich; Komal Aryal; David Mikhail; Tauseef A Khan; Vanessa Ha; John L Sievenpiper; Steven E Hanna; Joseph Beyene; Russell J de Souza Journal: Am J Clin Nutr Date: 2021-06-01 Impact factor: 7.045
Authors: Britta Tendal; Julian P T Higgins; Peter Jüni; Asbjørn Hróbjartsson; Sven Trelle; Eveline Nüesch; Simon Wandel; Anders W Jørgensen; Katarina Gesser; Søren Ilsøe-Kristensen; Peter C Gøtzsche Journal: BMJ Date: 2009-08-13