Holger J Schünemann1, Reem A Mustafa2, Jan Brozek3, Karen R Steingart4, Mariska Leeflang5, Mohammad Hassan Murad6, Patrick Bossuyt5, Paul Glasziou7, Roman Jaeschke3, Stefan Lange8, Joerg Meerpohl9, Miranda Langendam5, Monica Hultcrantz10, Gunn E Vist11, Elie A Akl12, Mark Helfand13, Nancy Santesso3, Lotty Hooft14, Rob Scholten14, Måns Rosen10, Anne Rutjes15, Mark Crowther3, Paola Muti16, Heike Raatz17, Mohammed T Ansari18, John Williams19, Regina Kunz20, Jeff Harris21, Ingrid Arévalo Rodriguez22, Mikashmi Kohli23, Gordon H Guyatt24. 1. Department of Health Research Methods, Evidence, and Impact, McMaster GRADE Centre, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S4K1, Canada; Department of Medicine, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S4K1, Canada. Electronic address: schuneh@mcmaster.ca. 2. Department of Health Research Methods, Evidence, and Impact, McMaster GRADE Centre, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S4K1, Canada; Department of Medicine, University of Kansas Medical Center, Kansas City, KS, USA. 3. Department of Health Research Methods, Evidence, and Impact, McMaster GRADE Centre, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S4K1, Canada; Department of Medicine, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S4K1, Canada. 4. Department of Clinical Sciences, Liverpool School of Tropical Medicine, Pembroke Place, Liverpool L3 5QA, UK. 5. Department of Clinical Epidemiology, Biostatistics and Bioinformatics, Amsterdam University Medical Centers, Room J1b-214, Meibergdreef 9, 1105 AZ Amsterdam, The Netherlands. 6. Division of Preventive Medicine, Mayo Clinic, 200 1st Street SW, Rochester, MN 55902, USA. 7. CREBP, Faculty Health Science & Medicine, Bond University, Gold Coast QLD 4229, Australia. 8. Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen, Institute for Quality and Efficiency in Health Care (IQWiG), Im Mediapark 8, 50670 Köln, Germany Cologne, Germany. 9. Institute for Evidence in Medicine, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany; Cochrane Germany, Cochrane Germany Foundation, Freiburg, Germany. 10. Swedish Agency for Health Technology Assessment and Assessment of Social Services (SBU), S:t Eriksgatan 117, SE-102 33, Stockholm, Sweden. 11. Norwegian Knowledge Centre for the Health Services, PO Box 7004, St Olavs Plass, 0130 Oslo, Norway. 12. Department of Internal Medicine, American University of Beirut, Riad-El-Solh Beirut, Beirut 1107 2020, Lebanon. 13. Oregon Evidence-based Practice Center, Oregon Health & Science University, Portland VA Medical Center, Portland, OR, USA. 14. Cochrane Netherlands/Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, P.O. Box 85500, 3508 GA Utrecht, The Netherlands. 15. Clinical Trial Unit (CTU) Bern, Institute of Primary Health Care, University of Bern, Bern, Switzerland. 16. Department of Oncology, McMaster University, 711 Concession Street, Hamilton, Ontario L8V1C3, Canada. 17. University of Basel, Klingelbergstrasse 61, CH-4056 Basel, Switzerland; Kleijnen Systematic Reviews Ltd, 6 Escrick Business Park, Escrick, York YO19 6FD, UK. 18. School of Epidemiology and Public Health, Faculty of Medicine, Ottawa, Canada. 19. Duke University Medical Center and Durham Veterans Affairs Center for Health Services Research in Primary Care Durham, NC 27705, USA. 20. Basel Institute of Clinical Epidemiology, University Hospital Basel, Hebelstrasse 10, Basel 4031, Switzerland. 21. Harris Associates, 386 Richardson Way, Mill Valley, CA 94941, USA. 22. Clinical Biostatistics Unit, Hospital Universitario Ramón y Cajal, IRYCIS, CIBER of Epidemiology and Public Health, Madrid, Spain; Centro de investigación en Salud Pública y Epidemiología Clínica, Facultad de Ciencias de la Salud Eugenio Espejo, Universidad UTE, Quito, Ecuador. 23. Department of Epidemiology, Biostatistics and Occupational Health, McGill University, 1650 Cedar Avenue, Montreal, Quebec H3G 1A4, Canada. 24. Department of Health Research Methods, Evidence, and Impact, McMaster GRADE Centre, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S4K1, Canada; Department of Medicine, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S4K1, Canada; Department of Medicine, University of Kansas Medical Center, Kansas City, KS, USA.
Abstract
OBJECTIVES: This article provides updated GRADE guidance about how authors of systematic reviews and health technology assessments and guideline developers can assess the results and the certainty of evidence (also known as quality of the evidence or confidence in the estimates) of a body of evidence addressing test accuracy (TA). STUDY DESIGN AND SETTING: We present an overview of the GRADE approach and guidance for rating certainty in TA in clinical and public health and review the presentation of results of a body of evidence regarding tests. Part 1 of the two parts in this 21st guidance article about how to apply GRADE focuses on understanding study design issues in test accuracy, provide an overview of the domains, and describe risk of bias and indirectness specifically. RESULTS: Supplemented by practical examples, we describe how raters of the evidence using GRADE can evaluate study designs focusing on tests and how they apply the GRADE domains risk of bias and indirectness to a body of evidence of TA studies. CONCLUSION: Rating the certainty of a body of evidence using GRADE in Cochrane and other reviews and World Health Organization and other guidelines dealing with in TA studies helped refining our approach. The resulting guidance will help applying GRADE successfully for questions and recommendations focusing on tests.
OBJECTIVES: This article provides updated GRADE guidance about how authors of systematic reviews and health technology assessments and guideline developers can assess the results and the certainty of evidence (also known as quality of the evidence or confidence in the estimates) of a body of evidence addressing test accuracy (TA). STUDY DESIGN AND SETTING: We present an overview of the GRADE approach and guidance for rating certainty in TA in clinical and public health and review the presentation of results of a body of evidence regarding tests. Part 1 of the two parts in this 21st guidance article about how to apply GRADE focuses on understanding study design issues in test accuracy, provide an overview of the domains, and describe risk of bias and indirectness specifically. RESULTS: Supplemented by practical examples, we describe how raters of the evidence using GRADE can evaluate study designs focusing on tests and how they apply the GRADE domains risk of bias and indirectness to a body of evidence of TA studies. CONCLUSION: Rating the certainty of a body of evidence using GRADE in Cochrane and other reviews and World Health Organization and other guidelines dealing with in TA studies helped refining our approach. The resulting guidance will help applying GRADE successfully for questions and recommendations focusing on tests.
Authors: Ariel Izcovich; Adam Cuker; Robert Kunkle; Ignacio Neumann; Julie Panepinto; Menaka Pai; Matthew Seftel; Matthew C Cheung; Richard Lottenberg; Michael Byrne; Robert Plovnick; Deirdra Terrell; Jennifer L Holter-Chakrabarty; Benjamin Djulbegovic; Lisa K Hicks; Wojtek Wiercioch; Robby Nieuwlaat; Holger J Schünemann Journal: Blood Adv Date: 2020-05-12
Authors: Marjorie Eguren; Anderson Holguin; Karla Diaz; Jose Vidalon; Carlos Linan; Camila Pacheco-Pereira; Manuel Oscar Lagravere Vich Journal: Dentomaxillofac Radiol Date: 2021-06-19 Impact factor: 2.419
Authors: Adrienne E Shapiro; Jennifer M Ross; Mandy Yao; Ian Schiller; Mikashmi Kohli; Nandini Dendukuri; Karen R Steingart; David J Horne Journal: Cochrane Database Syst Rev Date: 2021-03-23
Authors: Paula D James; Nathan T Connell; Barbara Ameer; Jorge Di Paola; Jeroen Eikenboom; Nicolas Giraud; Sandra Haberichter; Vicki Jacobs-Pratt; Barbara Konkle; Claire McLintock; Simon McRae; Robert R Montgomery; James S O'Donnell; Nikole Scappe; Robert Sidonio; Veronica H Flood; Nedaa Husainat; Mohamad A Kalot; Reem A Mustafa Journal: Blood Adv Date: 2021-01-12
Authors: Kamal Awad; Maged Mohammed; Mahmoud Mohamed Zaki; Abdelrahman I Abushouk; Gregory Y H Lip; Michael J Blaha; Carl J Lavie; Peter P Toth; J Wouter Jukema; Naveed Sattar; Maciej Banach Journal: BMC Med Date: 2021-06-22 Impact factor: 8.775