Monica Hultcrantz1, Reem A Mustafa2, Mariska M G Leeflang3, Valéry Lavergne4, Kelly Estrada-Orozco5, Mohammed T Ansari6, Ariel Izcovich7, Jasvinder Singh8, Lee Yee Chong9, Anne Rutjes10, Karen Steingart11, Airton Stein12, Nigar Sekercioglu13, Ingrid Arevalo-Rodriguez14, Rebecca L Morgan15, Gordon Guyatt15, Patrick Bossuyt3, Miranda W Langendam3, Holger J Schünemann16. 1. Swedish Agency for Health Technology Assessment and Assessment of Social Services (SBU), S:t Eriksgatan 117, SE-102 33, Stockholm, Sweden. Electronic address: monica.hultcrantz@sbu.se. 2. Division of Nephrology and Hypertension, Department of Medicine, University of Kansas Medical Center, 3901 Rainbow Blvd, MS3002, Kansas City, KS 66160, USA; Department of Health Research Methods, Evidence, and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada. 3. Department of Clinical Epidemiology, Biostatistics and Bioinformatics, Amsterdam Public Health research institute, Amsterdam University Medical Centers, Meibergdreef 9, Amsterdam, The Netherlands. 4. Department of Medicine, Sacré-Coeur Hospital, University of Montreal, Montreal, Canada; Department of Clinical Affairs & Practice Guidelines, Infectious Disease Society of America, Arlington, VA, USA. 5. Clinical Research Institute, Faculty of Medicine, Universidad Nacional de Colombia, Bogotá, Colombia; Research Unit, Faculty of Medicine, Fundación Universitaria Sanitas, Bogotá, Colombia. 6. School of Epidemiology, Public Health and Preventive Medicine, Faculty of Medicine, University of Ottawa, 600 Peter Morand Crescent, Ottawa, Ontario K1G 5Z3, Canada. 7. Internal Medicine Service, German Hospital, Pueyrredón 1640, Buenos Aires C1118AAT, Argentina. 8. Medicine Service, VA Medical Center, 510, 20th street South, FOT 805B, Birmingham, AL, USA; Department of Medicine at the School of Medicine, University of Alabama at Birmingham (UAB), 1720 Second Ave South, Birmingham, AL 35294-0022, USA; Department of Epidemiology at the UAB School of Public Health, 1665 University Blvd., Ryals Public Health Building, Room 220, Birmingham, AL 35294-0022, USA. 9. Ateimed Consulting Ltd., 3rd Floor 166 College Road, Harrow, Middlesex HA1 1BH, UK. 10. Institute of Social and Preventive Medicine (ISPM), University of Bern, Mittelstrasse 43, 3012 Bern, Switzerland. 11. Department of Clinical Sciences, Liverpool School of Tropical Medicine, Pembroke Place, Liverpool L3 5QA, UK. 12. Programa de Ciências da Saúde - Universidade Federal de Ciências da Saúde de Porto Alegre (Ufcspa) Rua Sarmento Leite, 245 - CEP 90050-170, Porto Alegre, Brazil; Teaching and Research Unit - Grupo Hospitalar Conceição (GHC) Rua Francisco Trein, 596 - CEP - 91.350-200, Porto Alegre, Brazil. 13. Division of Nephrology, Department of Medicine, University of Toronto, 585 University Avenue, Toronto, Ontario M5G 2N2, Canada; Department of Health Research Methods, Evidence, and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada. 14. Clinical Biostatistics Unit, Hospital Universitario Ramon y Cajal, CIBER Epidemiology and Public Health, Ctra. Colmenar Km. 9,100, 28034 Madrid, Spain. 15. Department of Health Research Methods, Evidence, and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada. 16. Department of Health Research Methods, Evidence, and Impact, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada; Department of Medicine, Michael G DeGroote Cochrane Canada Centre and GRADE centre, McMaster University, 1280 Main Street West, Hamilton, Ontario L8S 4K1, Canada.
Abstract
OBJECTIVE: The objective of the study was to clarify how the Grading of Recommendations Assessment, Development and Evaluation (GRADE) concept of certainty of evidence applies to certainty ratings of test accuracy. STUDY DESIGN AND SETTING: After initial brainstorming with GRADE Working Group members, we iteratively refined and clarified the approaches for defining ranges when assessing the certainty of evidence for test accuracy within a systematic review, health technology assessment, or guideline. RESULTS: Ranges can be defined both for single test accuracy and for comparative accuracy of multiple tests. For systematic reviews and health technology assessments, approaches for defining ranges include some that do not require value judgments regarding downstream health outcomes. Key challenges arise in the context of a guideline that requires ranges for sensitivity and specificity that are set considering possible effects on all critical outcomes. We illustrate possible approaches and provide an example from a systematic review of a direct comparison between two test strategies. CONCLUSIONS: This GRADE concept paper provides a framework for assessing, presenting, and making decisions based on the certainty of evidence for test accuracy. More empirical research is needed to support future GRADE guidance on how to best operationalize the candidate approaches.
OBJECTIVE: The objective of the study was to clarify how the Grading of Recommendations Assessment, Development and Evaluation (GRADE) concept of certainty of evidence applies to certainty ratings of test accuracy. STUDY DESIGN AND SETTING: After initial brainstorming with GRADE Working Group members, we iteratively refined and clarified the approaches for defining ranges when assessing the certainty of evidence for test accuracy within a systematic review, health technology assessment, or guideline. RESULTS: Ranges can be defined both for single test accuracy and for comparative accuracy of multiple tests. For systematic reviews and health technology assessments, approaches for defining ranges include some that do not require value judgments regarding downstream health outcomes. Key challenges arise in the context of a guideline that requires ranges for sensitivity and specificity that are set considering possible effects on all critical outcomes. We illustrate possible approaches and provide an example from a systematic review of a direct comparison between two test strategies. CONCLUSIONS: This GRADE concept paper provides a framework for assessing, presenting, and making decisions based on the certainty of evidence for test accuracy. More empirical research is needed to support future GRADE guidance on how to best operationalize the candidate approaches.
Authors: Eva A Rehfuess; Jacob B Burns; Lisa M Pfadenhauer; Shari Krishnaratne; Hannah Littlecott; Joerg J Meerpohl; Ani Movsisyan Journal: Res Synth Methods Date: 2022-07-31 Impact factor: 9.308
Authors: Gian Paolo Morgano; Lawrence Mbuagbaw; Nancy Santesso; Feng Xie; Jan L Brozek; Uwe Siebert; Antonio Bognanni; Wojtek Wiercioch; Thomas Piggott; Andrea J Darzi; Elie A Akl; Ilse M Verstijnen; Elena Parmelli; Zuleika Saz-Parkinson; Pablo Alonso-Coello; Holger J Schünemann Journal: BMJ Open Date: 2022-03-10 Impact factor: 2.692