Barnaby C Reeves1, Julian P T Higgins2,3, Craig Ramsay4, Beverley Shea5, Peter Tugwell6, George A Wells7. 1. Clinical Trials and Evaluation Unit, School of Clinical Sciences, University of Bristol, UK. 2. MRC Biostatistics Unit, Cambridge, UK. 3. Centre for Reviews and Dissemination, University of York, UK. 4. Health Services Research Unit, University of Aberdeen, UK. 5. Community Information and Epidemiological Technologies, Institute of Population Health, Ottawa, Canada. 6. Centre for Global Health, Institute of Population Health, Ottawa, Canada. 7. Department of Epidemiology and Community Medicine, University of Ottawa, Canada.
Abstract
BACKGROUND: Methods need to be further developed to include non-randomised studies (NRS) in systematic reviews of the effects of health care interventions. NRS are often required to answer questions about harms and interventions for which evidence from randomised controlled trials (RCTs) is not available. Methods used to review randomised controlled trials may be inappropriate or insufficient for NRS. AIM AND METHODS: A workshop was convened to discuss relevant methodological issues. Participants were invited from important stakeholder constituencies, including methods and review groups of the Cochrane and Campbell Collaborations, the Cochrane Editorial Unit and organisations that commission reviews and make health policy decisions. The aim was to discuss methods for reviewing evidence when including NRS and to formulate methodological guidance for review authors. WORKSHOP FORMAT: The workshop was structured around four sessions on topics considered in advance to be most critical: (i) study designs and bias; (ii) confounding and meta-analysis; (iii) selective reporting; and (iv) applicability. These sessions were scheduled between introductory and concluding sessions. SUMMARY: This is the first of six papers and provides an overview. Subsequent papers describe the discussions and conclusions from the four main sessions (papers 2 to 5) and summarise the proposed guidance into lists of issues for review authors to consider (paper 6).
BACKGROUND: Methods need to be further developed to include non-randomised studies (NRS) in systematic reviews of the effects of health care interventions. NRS are often required to answer questions about harms and interventions for which evidence from randomised controlled trials (RCTs) is not available. Methods used to review randomised controlled trials may be inappropriate or insufficient for NRS. AIM AND METHODS: A workshop was convened to discuss relevant methodological issues. Participants were invited from important stakeholder constituencies, including methods and review groups of the Cochrane and Campbell Collaborations, the Cochrane Editorial Unit and organisations that commission reviews and make health policy decisions. The aim was to discuss methods for reviewing evidence when including NRS and to formulate methodological guidance for review authors. WORKSHOP FORMAT: The workshop was structured around four sessions on topics considered in advance to be most critical: (i) study designs and bias; (ii) confounding and meta-analysis; (iii) selective reporting; and (iv) applicability. These sessions were scheduled between introductory and concluding sessions. SUMMARY: This is the first of six papers and provides an overview. Subsequent papers describe the discussions and conclusions from the four main sessions (papers 2 to 5) and summarise the proposed guidance into lists of issues for review authors to consider (paper 6).
Authors: Robert W S Coulter; James E Egan; Suzanne Kinsky; M Reuel Friedman; Kristen L Eckstrand; Jessica Frankeberger; Barbara L Folb; Christina Mair; Nina Markovic; Anthony Silvestre; Ron Stall; Elizabeth Miller Journal: Pediatrics Date: 2019-08-19 Impact factor: 7.124
Authors: Penny A Dacks; Sandrine Andrieu; Deborah Blacker; Aaron J Carman; Allan M Green; Francine Grodstein; Victor W Henderson; Bryan D James; Rachel F Lane; Joseph Lau; Pei-Jung Lin; Barnaby C Reeves; Raj C Shah; Bruno Vellas; Kristine Yaffe; Karin Yurko-Mauro; Diana W Shineman; David A Bennett; Howard M Fillit Journal: J Prev Alzheimers Dis Date: 2014-02
Authors: Howard H Z Thom; Gorana Capkun; Annamaria Cerulli; Richard M Nixon; Luke S Howard Journal: BMC Med Res Methodol Date: 2015-04-12 Impact factor: 4.615
Authors: Ben Gibbison; José Carlos Villalobos Lizardi; Karla Isis Avilés Martínez; Daniel P Fudulu; Miguel Angel Medina Andrade; Giordano Pérez-Gaxiola; Alvin Wl Schadenberg; Serban C Stoica; Stafford L Lightman; Gianni D Angelini; Barnaby C Reeves Journal: Cochrane Database Syst Rev Date: 2020-10-12