Holger J Schünemann1, Reem A Mustafa2, Jan Brozek3, Nancy Santesso4, Patrick M Bossuyt5, Karen R Steingart6, Mariska Leeflang5, Stefan Lange7, Tommaso Trenti8, Miranda Langendam5, Rob Scholten9, Lotty Hooft9, Mohammad Hassan Murad10, Roman Jaeschke11, Anne Rutjes12, Jasvinder Singh13, Mark Helfand14, Paul Glasziou15, Ingrid Arevalo-Rodriguez16, Elie A Akl17, Jonathan J Deeks18, Gordon H Guyatt11. 1. Department of Health Research Methods, Evidence, and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S4K1, Canada; Department of Medicine, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S4K1, Canada; McMaster GRADE Centre, Michael DeGroote Cochrane Canada Centre, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S4K1, Canada. Electronic address: schuneh@mcmaster.ca. 2. Department of Health Research Methods, Evidence, and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S4K1, Canada; Department of Medicine, University of Kansas Medical Center, Kansas City, KS, USA. 3. Department of Health Research Methods, Evidence, and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S4K1, Canada; Department of Medicine, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S4K1, Canada; McMaster GRADE Centre, Michael DeGroote Cochrane Canada Centre, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S4K1, Canada. 4. Department of Health Research Methods, Evidence, and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S4K1, Canada; McMaster GRADE Centre, Michael DeGroote Cochrane Canada Centre, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S4K1, Canada. 5. Clinical Epidemiology and Biostatistics and Bioinformatics Academic Medical Center, University of Amsterdam, Meibergdreef 9, P.O.Box 227001100 DE, Amsterdam, The Netherlands. 6. Cochrane Infectious Diseases Group, Liverpool School of Tropical Medicine, Liverpool, L3 5QA UK. 7. Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen/Institute for Quality and Efficiency in Health Care (IQWiG), Im Mediapark 8, Köln, 50670 Cologne, Germany. 8. Azienda Ospedaliera Universitaria e Azienda USL di Modena, Nuovo Ospedale S. Agostino Estense, Via Giardini 1355, Modena, 41126 Italy. 9. Cochrane Netherlands/Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, P.O. Box 85500, Utrecht, 3508 GA The Netherlands. 10. Division of Preventive Medicine, Mayo Clinic, 200 1st, ST, SW, Rochester, MN 55902, USA. 11. Department of Health Research Methods, Evidence, and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S4K1, Canada; Department of Medicine, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S4K1, Canada. 12. Clinical Trial Unit (CTU) Bern, Institute of Primary Health Care; Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland. 13. Medicine Service, VA Medical Center, Birmingham, AL, USA; Department of Medicine, University of Alabama at Birmingham, 510, 20th Street South, Birmingham, FOT805B AL, USA. 14. Oregon Evidence-based Practice Center, Oregon Health & Science University, Portland VA Medical Center, Portland, OR, USA. 15. CREBP, Faculty Health Science & Medicine, Bond University, Gold Coast, Queensland 4229, Australia. 16. Clinical Biostatistics Unit, Ramón y Cajal Hospital (IRYCIS), Madrid, Spain; Division of Research, Fundación Universitaria de Ciencias de la Salud, Hospital de San José, Hospital Infantil de San José, Bogotá, Colombia. 17. Department of Internal Medicine, American University of Beirut, Riad-El-Solh Beirut, Beirut, 1107 2020 Lebanon. 18. Test Evaluation Research Group, Institute of Applied Health Research, University of Birmingham, Edgbaston, Birmingham, B15 2TT UK.
Abstract
OBJECTIVES: This article describes the Grading of Recommendations Assessment, Development and Evaluation (GRADE) Working Group's framework of moving from test accuracy to patient or population-important outcomes. We focus on the common scenario when studies directly evaluating the effect of diagnostic and other tests or strategies on health outcomes are not available or are not providing the best available evidence. STUDY DESIGN AND SETTING: Using practical examples, we explored how guideline developers and other decision makers can use information from test accuracy to develop a recommendation by linking evidence that addresses downstream consequences. Guideline panels should develop an analytic framework that summarizes the actions that follow from applying a test and the consequences. RESULTS: We describe GRADE's current thinking about the overall certainty of the evidence (also known as quality of the evidence or confidence in the estimates) arising from consideration of the often complex pathways that involve multiple tests and management options. Each link in the evidence can-and often does-lower the overall certainty of the evidence required to formulate recommendations and make decisions about tests. The frequency with which an outcome occurs and its importance will influence whether or not a particular step in the linked evidence is critical to decision-making. CONCLUSIONS: Overall certainty may be expressed by the weakest critical step in the linked evidence. The linked approach to addressing optimal testing will often require the use of decision analytic approaches. We present an example that involves decision modeling in a GRADE Evidence to Decision framework for cervical cancer screening. However, because resources and time of guideline developers may be limited, we describe alternative, pragmatic strategies for developing recommendations addressing test use.
OBJECTIVES: This article describes the Grading of Recommendations Assessment, Development and Evaluation (GRADE) Working Group's framework of moving from test accuracy to patient or population-important outcomes. We focus on the common scenario when studies directly evaluating the effect of diagnostic and other tests or strategies on health outcomes are not available or are not providing the best available evidence. STUDY DESIGN AND SETTING: Using practical examples, we explored how guideline developers and other decision makers can use information from test accuracy to develop a recommendation by linking evidence that addresses downstream consequences. Guideline panels should develop an analytic framework that summarizes the actions that follow from applying a test and the consequences. RESULTS: We describe GRADE's current thinking about the overall certainty of the evidence (also known as quality of the evidence or confidence in the estimates) arising from consideration of the often complex pathways that involve multiple tests and management options. Each link in the evidence can-and often does-lower the overall certainty of the evidence required to formulate recommendations and make decisions about tests. The frequency with which an outcome occurs and its importance will influence whether or not a particular step in the linked evidence is critical to decision-making. CONCLUSIONS: Overall certainty may be expressed by the weakest critical step in the linked evidence. The linked approach to addressing optimal testing will often require the use of decision analytic approaches. We present an example that involves decision modeling in a GRADE Evidence to Decision framework for cervical cancer screening. However, because resources and time of guideline developers may be limited, we describe alternative, pragmatic strategies for developing recommendations addressing test use.
Authors: Ariel Izcovich; Adam Cuker; Robert Kunkle; Ignacio Neumann; Julie Panepinto; Menaka Pai; Matthew Seftel; Matthew C Cheung; Richard Lottenberg; Michael Byrne; Robert Plovnick; Deirdra Terrell; Jennifer L Holter-Chakrabarty; Benjamin Djulbegovic; Lisa K Hicks; Wojtek Wiercioch; Robby Nieuwlaat; Holger J Schünemann Journal: Blood Adv Date: 2020-05-12
Authors: T Walsh; R Macey; D Ricketts; A Carrasco Labra; H Worthington; A J Sutton; S Freeman; A M Glenny; P Riley; J Clarkson; E Cerullo Journal: J Dent Res Date: 2021-10-12 Impact factor: 6.116
Authors: Robert I Liem; Sophie Lanzkron; Thomas D Coates; Laura DeCastro; Ankit A Desai; Kenneth I Ataga; Robyn T Cohen; Johnson Haynes; Ifeyinwa Osunkwo; Jeffrey D Lebensburger; James P Lash; Theodore Wun; Madeleine Verhovsek; Elodie Ontala; Rae Blaylark; Fares Alahdab; Abdulrahman Katabi; Reem A Mustafa Journal: Blood Adv Date: 2019-12-10
Authors: M Hassan Murad; Robert I Liem; Eddy S Lang; Elie A Akl; Joerg J Meerpohl; Michael R DeBaun; John F Tisdale; Amanda M Brandow; Sophie M Lanzkron; Stella T Chou; Starr Webb; Reem A Mustafa Journal: Blood Adv Date: 2019-12-10
Authors: Lucinda M Gruber; Veljko Strajina; Irina Bancos; M Hassan Murad; Benzon M Dy; William F Young; David R Farley; Melanie L Lyden; Geoffrey B Thompson; Travis J McKenzie Journal: Gland Surg Date: 2020-04
Authors: Paula D James; Nathan T Connell; Barbara Ameer; Jorge Di Paola; Jeroen Eikenboom; Nicolas Giraud; Sandra Haberichter; Vicki Jacobs-Pratt; Barbara Konkle; Claire McLintock; Simon McRae; Robert R Montgomery; James S O'Donnell; Nikole Scappe; Robert Sidonio; Veronica H Flood; Nedaa Husainat; Mohamad A Kalot; Reem A Mustafa Journal: Blood Adv Date: 2021-01-12