Holger J Schünemann1, Reem Mustafa2, Jan Brozek3, Nancy Santesso4, Pablo Alonso-Coello5, Gordon Guyatt3, Rob Scholten6, Miranda Langendam7, Mariska M Leeflang8, Elie A Akl9, Jasvinder A Singh10, Joerg Meerpohl11, Monica Hultcrantz12, Patrick Bossuyt8, Andrew D Oxman13. 1. Department of Clinical Epidemiology and Biostatistics & McGRADE Center, 1280 Main Street West McMaster University, Hamilton, Ontario L8S 4K1, Canada; Department of Medicine, McMaster University, 1280 Main Street West McMaster University, Hamilton, Ontario L8S 4K1, Canada; Cochrane GRADEing (Applicability and Recommendations) Methods Group, 1280 Main Street West McMaster University, Hamilton, Ontario L8S 4K1, Canada. Electronic address: schuneh@mcmaster.ca. 2. Department of Clinical Epidemiology and Biostatistics & McGRADE Center, 1280 Main Street West McMaster University, Hamilton, Ontario L8S 4K1, Canada; Cochrane GRADEing (Applicability and Recommendations) Methods Group, 1280 Main Street West McMaster University, Hamilton, Ontario L8S 4K1, Canada; Department of Medicine, School of Medicine, University of Missouri-Kansas City, M4-303, 2411 Holmes Street, Kansas City, MO 64108-2792, USA. 3. Department of Clinical Epidemiology and Biostatistics & McGRADE Center, 1280 Main Street West McMaster University, Hamilton, Ontario L8S 4K1, Canada; Department of Medicine, McMaster University, 1280 Main Street West McMaster University, Hamilton, Ontario L8S 4K1, Canada; Cochrane GRADEing (Applicability and Recommendations) Methods Group, 1280 Main Street West McMaster University, Hamilton, Ontario L8S 4K1, Canada. 4. Department of Clinical Epidemiology and Biostatistics & McGRADE Center, 1280 Main Street West McMaster University, Hamilton, Ontario L8S 4K1, Canada; Cochrane GRADEing (Applicability and Recommendations) Methods Group, 1280 Main Street West McMaster University, Hamilton, Ontario L8S 4K1, Canada. 5. Department of Clinical Epidemiology and Biostatistics & McGRADE Center, 1280 Main Street West McMaster University, Hamilton, Ontario L8S 4K1, Canada; Cochrane GRADEing (Applicability and Recommendations) Methods Group, 1280 Main Street West McMaster University, Hamilton, Ontario L8S 4K1, Canada; Centro Cochrane Iberoamericano, Instituto de Investigación Biomédica (IIB Sant Pau-CIBERESP), Sant Antoni Maria Claret 167, 08025 Barcelona, Spain. 6. Cochrane Netherlands/Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, P.O. Box 85500, 3508 GA Utrecht, The Netherlands. 7. Cochrane GRADEing (Applicability and Recommendations) Methods Group, 1280 Main Street West McMaster University, Hamilton, Ontario L8S 4K1, Canada; Clinical Epidemiology and Biostatistics and Bioinformatics Academic Medical Center, University of Amsterdam, Meibergdreef 9, Room J1b-209, P.O. Box 227001100 DE, Amsterdam, The Netherlands. 8. Clinical Epidemiology and Biostatistics and Bioinformatics Academic Medical Center, University of Amsterdam, Meibergdreef 9, Room J1b-209, P.O. Box 227001100 DE, Amsterdam, The Netherlands. 9. Department of Clinical Epidemiology and Biostatistics & McGRADE Center, 1280 Main Street West McMaster University, Hamilton, Ontario L8S 4K1, Canada; Cochrane GRADEing (Applicability and Recommendations) Methods Group, 1280 Main Street West McMaster University, Hamilton, Ontario L8S 4K1, Canada; Department of Internal Medicine, American University of Beirut Medical Center, P.O. Box 11-0236, Riad-El-Solh Beirut 1107 2020, Lebanon. 10. Cochrane GRADEing (Applicability and Recommendations) Methods Group, 1280 Main Street West McMaster University, Hamilton, Ontario L8S 4K1, Canada; Medicine Service and Center for Surgical Medical Acute care Research and Transitions, Department of Medicine, VA Medical Center, 510, 20th Street South, FOT 805B, Birmingham, AL, USA. 11. Cochrane GRADEing (Applicability and Recommendations) Methods Group, 1280 Main Street West McMaster University, Hamilton, Ontario L8S 4K1, Canada; Cochrane Germany, Medical Center, University of Freiburg, Berliner Allee 29, 79110 Freiburg, Germany. 12. Swedish Agency for Health Technology Assessment and Assessment of Social Services (SBU), S:t Eriksgatan 117, SE-102 33, Stockholm, Sweden & Department of Learning, Informatics, Management and Ethics, Karolinska Institutet, Tomtebodav. 18 A, SE-171 77, Stockholm, Sweden. 13. Norwegian Knowledge Centre for the Health Services, Boks 7004 Street Olavsplass, N-0130 Oslo, Norway.
Abstract
OBJECTIVES: To describe the grading of recommendations assessment, development and evaluation (GRADE) interactive evidence to decision (EtD) frameworks for tests and test strategies for clinical, public health, or coverage decisions. STUDY DESIGN AND SETTING: As part of the GRADE Working Group's DECIDE project, we conducted workshops, user testing with systematic review authors, guideline developers and other decision makers, and piloted versions of the EtD framework. RESULTS: EtD frameworks for tests share the structure, explicitness, and transparency of other EtD frameworks. They require specifying the purpose of the test, linked or related management, and the key outcomes of concern for different test results and subsequent management. The EtD criteria address test accuracy and assessments of the certainty of the additional evidence necessary for decision making. When there is no direct evidence of test effects on patient-important outcomes, formal or informal modeling is needed to estimate effects. We describe the EtD criteria based on examples developed with GRADEpro (www.gradepro.org), GRADE's software that also allows development and dissemination of interactive summary of findings tables. CONCLUSION: EtD frameworks for developing recommendations and making decisions about tests lay out the sequential steps in reviewing and assessing the different types of evidence that need to be linked.
OBJECTIVES: To describe the grading of recommendations assessment, development and evaluation (GRADE) interactive evidence to decision (EtD) frameworks for tests and test strategies for clinical, public health, or coverage decisions. STUDY DESIGN AND SETTING: As part of the GRADE Working Group's DECIDE project, we conducted workshops, user testing with systematic review authors, guideline developers and other decision makers, and piloted versions of the EtD framework. RESULTS: EtD frameworks for tests share the structure, explicitness, and transparency of other EtD frameworks. They require specifying the purpose of the test, linked or related management, and the key outcomes of concern for different test results and subsequent management. The EtD criteria address test accuracy and assessments of the certainty of the additional evidence necessary for decision making. When there is no direct evidence of test effects on patient-important outcomes, formal or informal modeling is needed to estimate effects. We describe the EtD criteria based on examples developed with GRADEpro (www.gradepro.org), GRADE's software that also allows development and dissemination of interactive summary of findings tables. CONCLUSION: EtD frameworks for developing recommendations and making decisions about tests lay out the sequential steps in reviewing and assessing the different types of evidence that need to be linked.
Authors: Amanda M Brandow; C Patrick Carroll; Susan Creary; Ronisha Edwards-Elliott; Jeffrey Glassberg; Robert W Hurley; Abdullah Kutlar; Mohamed Seisa; Jennifer Stinson; John J Strouse; Fouza Yusuf; William Zempsky; Eddy Lang Journal: Blood Adv Date: 2020-06-23
Authors: Shannon M Bates; Anita Rajasekhar; Saskia Middeldorp; Claire McLintock; Marc A Rodger; Andra H James; Sara R Vazquez; Ian A Greer; John J Riva; Meha Bhatt; Nicole Schwab; Danielle Barrett; Andrea LaHaye; Bram Rochwerg Journal: Blood Adv Date: 2018-11-27
Authors: Holger J Schünemann; Mary Cushman; Allison E Burnett; Susan R Kahn; Jan Beyer-Westendorf; Frederick A Spencer; Suely M Rezende; Neil A Zakai; Kenneth A Bauer; Francesco Dentali; Jill Lansing; Sara Balduzzi; Andrea Darzi; Gian Paolo Morgano; Ignacio Neumann; Robby Nieuwlaat; Juan J Yepes-Nuñez; Yuan Zhang; Wojtek Wiercioch Journal: Blood Adv Date: 2018-11-27
Authors: Adam Cuker; Gowthami M Arepally; Beng H Chong; Douglas B Cines; Andreas Greinacher; Yves Gruel; Lori A Linkins; Stephen B Rodner; Sixten Selleng; Theodore E Warkentin; Ashleigh Wex; Reem A Mustafa; Rebecca L Morgan; Nancy Santesso Journal: Blood Adv Date: 2018-11-27
Authors: Daniel M Witt; Robby Nieuwlaat; Nathan P Clark; Jack Ansell; Anne Holbrook; Jane Skov; Nadine Shehab; Juliet Mock; Tarra Myers; Francesco Dentali; Mark A Crowther; Arnav Agarwal; Meha Bhatt; Rasha Khatib; John J Riva; Yuan Zhang; Gordon Guyatt Journal: Blood Adv Date: 2018-11-27
Authors: Adam J Shapiro; Stephanie D Davis; Deepika Polineni; Michele Manion; Margaret Rosenfeld; Sharon D Dell; Mark A Chilvers; Thomas W Ferkol; Maimoona A Zariwala; Scott D Sagel; Maureen Josephson; Lucy Morgan; Ozge Yilmaz; Kenneth N Olivier; Carlos Milla; Jessica E Pittman; M Leigh Anne Daniels; Marcus Herbert Jones; Ibrahim A Janahi; Stephanie M Ware; Sam J Daniel; Matthew L Cooper; Lawrence M Nogee; Billy Anton; Tori Eastvold; Lynn Ehrne; Elena Guadagno; Michael R Knowles; Margaret W Leigh; Valery Lavergne Journal: Am J Respir Crit Care Med Date: 2018-06-15 Impact factor: 21.405
Authors: Laure Gossec; Laura C Coates; Maarten de Wit; Arthur Kavanaugh; Sofia Ramiro; Philip J Mease; Christopher T Ritchlin; Désirée van der Heijde; Josef S Smolen Journal: Nat Rev Rheumatol Date: 2016-11-10 Impact factor: 20.543