Alonso Carrasco-Labra1, Romina Brignardello-Petersen2, Nancy Santesso3, Ignacio Neumann4, Reem A Mustafa5, Lawrence Mbuagbaw6, Itziar Etxeandia Ikobaltzeta7, Catherine De Stio8, Lauren J McCullagh8, Pablo Alonso-Coello9, Joerg J Meerpohl10, Per Olav Vandvik11, Jan L Brozek12, Elie A Akl13, Patrick Bossuyt14, Rachel Churchill15, Claire Glenton16, Sarah Rosenbaum16, Peter Tugwell17, Vivian Welch18, Paul Garner19, Gordon Guyatt12, Holger J Schünemann20. 1. Department of Clinical Epidemiology & Biostatistics, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; Department of Oral and Maxillofacial Surgery, Faculty of Dentistry, Universidad de Chile, Sergio Livingstone Pohlhammer 943, Independencia, Santiago, Chile; Evidence-Based Dentistry Unit, Faculty of Dentistry, Universidad de Chile, Sergio Livingstone Pohlhammer 943, Independencia, Santiago, Chile. 2. Evidence-Based Dentistry Unit, Faculty of Dentistry, Universidad de Chile, Sergio Livingstone Pohlhammer 943, Independencia, Santiago, Chile; Institute of Health Policy, Management and Evaluation, University of Toronto, 155 College Street, 4th Floor, Toronto, Ontario M5T 3M6, Canada. 3. Department of Clinical Epidemiology & Biostatistics, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; Cochrane GRADEing (Applicability and Recommendations) Methods Group, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; McMaster GRADE Center, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada. 4. Pontificia Universidad Católica de Chile, Alameda 340, Santiago, Región Metropolitana, Chile. 5. Department of Clinical Epidemiology & Biostatistics, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; Department of Medicine/Nephrology, University of Missouri-Kansas City, 2411 Holmes Street, Kansas City, MO 64108-2792, USA; Department of Biomedical & Health Informatics, University of Missouri-Kansas City, 2411 Holmes Street, Kansas City, MO 64108-2792, USA. 6. Department of Clinical Epidemiology & Biostatistics, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; Biostatistics Unit, Father Sean O'Sullivan Research Centre, St Joseph's Healthcare, 50 Charlton Avenue East, 3rd Floor Martha Wing, Room H321, Hamilton, Ontario L8N 4A6, Canada. 7. Department of Clinical Epidemiology & Biostatistics, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada. 8. Hofstra North Shore LIJ School of Medicine, Department of Medicine, 300 Community Drive, Manhasset, NY 11030, USA. 9. Department of Clinical Epidemiology & Biostatistics, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; Iberoamerican Cochrane Centre, Biomedical Research Institute Sant Pau-CIBER of Epidemiology and Public Health (CIBERESP-IIB Sant Pau), C/ Sant Antoni Maria Claret 167, Pavelló 18, planta 0, 08025 Barcelona, Spain. 10. German Cochrane Centre, Medical Center-University of Freiburg, Berliner Allee 29, 79110 Freiburg, Germany. 11. Department of Medicine, Division Gjøvik, Innlandet Hospital Trust, Kyrre Greppsgt 11, 2819 Gjøvik, Norway; Norwegian Knowledge Centre for the Health Services, Pilestredet Park 7, 0130 Oslo, Norway. 12. Department of Clinical Epidemiology & Biostatistics, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; Cochrane GRADEing (Applicability and Recommendations) Methods Group, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; McMaster GRADE Center, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; Department of Medicine, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada. 13. Department of Clinical Epidemiology & Biostatistics, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; Department of Internal Medicine, American University of Beirut, Riad-El-Solh Beirut 1107 2020, P.O. Box: 11-0236, Beirut, Lebanon. 14. Department of Clinical Epidemiology, Biostatistics and Bioinformatics, University of Amsterdam, Room J2-127, PO Box 22700, 1100 DE Amsterdam, The Netherlands. 15. Centre for Academic Mental Health, School of Social and Community Medicine, University of Bristol, Office Barley House, Room BF11, Oakfield House, Oakfield Grove, Bristol BS8 2BN, UK. 16. Norwegian Branch of the Nordic Cochrane Centre, Postboks 7004 Street Olavs plass, 0130 Oslo, Norway; Norwegian Knowledge Centre for the Health Services, P.O. Box 7004 Street Olavs plass, N-0130 Oslo, Norway. 17. Department of Medicine, Faculty of Medicine, University of Ottawa, 451 Smyth Road, Ottawa, Ontario K1H 8M5, Canada. 18. Bruyère Research Institute, University of Ottawa, 304b-85 Primrose Avenue, Ottawa, Ontario, Canada. 19. Evidence Synthesis for Global Health, Liverpool School of Tropical Medicine, Pembroke Place, Liverpool L3 5QA, UK. 20. Department of Clinical Epidemiology & Biostatistics, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; Cochrane GRADEing (Applicability and Recommendations) Methods Group, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; McMaster GRADE Center, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; Department of Medicine, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada. Electronic address: schuneh@mcmaster.ca.
Abstract
OBJECTIVES: The current format of summary of findings (SoFs) tables for presenting effect estimates and associated quality of evidence improve understanding and assist users finding key information in systematic reviews. Users of SoF tables have demanded alternative formats to express findings from systematic reviews. STUDY DESIGN AND SETTING: We conducted a randomized controlled trial among systematic review users to compare the relative merits of a new format with the current formats of SoF tables regarding understanding, accessibility of information, satisfaction, and preference. Our primary goal was to show that the new format is not inferior to the current format. RESULTS:Of 390 potentially eligible subjects, 290 were randomized. Of seven items testing understanding, three showed similar results, two showed small differences favoring the new format, and two (understanding risk difference and quality of the evidence associated with a treatment effect) showed large differences favoring the new format [63% (95% confidence interval {CI}: 55, 71) and 62% (95% CI: 52, 71) more correct answers, respectively]. Respondents rated information in the alternative format as more accessible overall and preferred the new format over the current format. CONCLUSIONS: While providing at least similar levels of understanding for some items and increased understanding for others, users prefer the new format of SoF tables.
RCT Entities:
OBJECTIVES: The current format of summary of findings (SoFs) tables for presenting effect estimates and associated quality of evidence improve understanding and assist users finding key information in systematic reviews. Users of SoF tables have demanded alternative formats to express findings from systematic reviews. STUDY DESIGN AND SETTING: We conducted a randomized controlled trial among systematic review users to compare the relative merits of a new format with the current formats of SoF tables regarding understanding, accessibility of information, satisfaction, and preference. Our primary goal was to show that the new format is not inferior to the current format. RESULTS: Of 390 potentially eligible subjects, 290 were randomized. Of seven items testing understanding, three showed similar results, two showed small differences favoring the new format, and two (understanding risk difference and quality of the evidence associated with a treatment effect) showed large differences favoring the new format [63% (95% confidence interval {CI}: 55, 71) and 62% (95% CI: 52, 71) more correct answers, respectively]. Respondents rated information in the alternative format as more accessible overall and preferred the new format over the current format. CONCLUSIONS: While providing at least similar levels of understanding for some items and increased understanding for others, users prefer the new format of SoF tables.
Authors: Benoît Béchard; Joachim Kimmerle; Justin Lawarée; Pierre-Oliver Bédard; Sharon E Straus; Mathieu Ouimet Journal: Int J Environ Res Public Health Date: 2022-05-20 Impact factor: 4.614
Authors: Gonçalo S Duarte; Filipe B Rodrigues; Raquel E Marques; Mafalda Castelão; Joaquim Ferreira; Cristina Sampaio; Austen P Moore; João Costa Journal: Cochrane Database Syst Rev Date: 2020-11-19
Authors: Filipe B Rodrigues; Gonçalo S Duarte; Mafalda Castelão; Raquel E Marques; Joaquim Ferreira; Cristina Sampaio; Austen P Moore; João Costa Journal: Cochrane Database Syst Rev Date: 2021-04-14
Authors: Filipe B Rodrigues; Gonçalo S Duarte; Raquel E Marques; Mafalda Castelão; Joaquim Ferreira; Cristina Sampaio; Austen P Moore; João Costa Journal: Cochrane Database Syst Rev Date: 2020-11-12
Authors: Jennifer Petkovic; Vivian Welch; Maria Helena Jacob; Manosila Yoganathan; Ana Patricia Ayala; Heather Cunningham; Peter Tugwell Journal: Implement Sci Date: 2016-12-09 Impact factor: 7.327
Authors: Juan José Yepes-Nuñez; Rebecca L Morgan; Lawrence Mbuagbaw; Alonso Carrasco-Labra; Stephanie Chang; Susanne Hempel; Paul Shekelle; Mark Helfand; Tejan Baldeh; Holger J Schünemann Journal: BMJ Open Date: 2018-01-23 Impact factor: 2.692
Authors: Linn Brandt; Per Olav Vandvik; Pablo Alonso-Coello; Elie A Akl; Judith Thornton; David Rigau; Katie Adams; Paul O'Connor; Gordon Guyatt; Annette Kristiansen Journal: BMJ Open Date: 2017-02-10 Impact factor: 2.692
Authors: Laura K Busert; Margot Mütsch; Christina Kien; Aline Flatz; Ursula Griebler; Manfred Wildner; Jan M Stratil; Eva A Rehfuess Journal: Health Res Policy Syst Date: 2018-07-09