Gowri Gopalakrishna1, Reem A Mustafa2, Clare Davenport3, Rob J P M Scholten4, Christopher Hyde5, Jan Brozek6, Holger J Schünemann6, Patrick M M Bossuyt7, Mariska M G Leeflang7, Miranda W Langendam7. 1. Department of Clinical Epidemiology, Biostatistics and Bioinformatics, Academic Medical Center, University of Amsterdam, PO Box 22700, 1100 DE Amsterdam, The Netherlands. Electronic address: g.gopalakrishna@amc.uva.nl. 2. Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario L8N 3Z5, Canada; Department of Medicine, McMaster University, Hamilton, Ontario L8N 3Z5, Canada; School of Medicine, University of Missouri-Kansas City 5100 Rockhill Road, Kansas City, MO 64110, USA. 3. Department of Public Health, Epidemiology and Biostatistics, University of Birmingham, Edgbaston, Birmingham B15 2TT UK. 4. Dutch Cochrane Center, University Medical Center, Postbus 85500 3508 GA Utrecht, The Netherlands. 5. Institute of Health Research, University of Exeter Medical School, The Veysey Building Salmon Pool Lane, Exeter EX2 4SG UK. 6. Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Ontario L8N 3Z5, Canada; Department of Medicine, McMaster University, Hamilton, Ontario L8N 3Z5, Canada. 7. Department of Clinical Epidemiology, Biostatistics and Bioinformatics, Academic Medical Center, University of Amsterdam, PO Box 22700, 1100 DE Amsterdam, The Netherlands.
Abstract
OBJECTIVES: The Grading of Recommendations Assessment, Development and Evaluation (GRADE) Working Group developed an approach to assess the quality of evidence of diagnostic tests. Its use in Cochrane diagnostic test accuracy reviews is new. We applied this approach to three Cochrane reviews with the aim of better understanding the application of the GRADE criteria to such reviews. STUDY DESIGN AND SETTING: We selected reviews to achieve clinical and methodological diversities. At least three assessors independently assessed each review according to the GRADE criteria of risk of bias, indirectness, imprecision, inconsistency, and publication bias. Two teleconferences were held to share experiences. RESULTS: For the interpretation of the GRADE criteria, it made a difference whether assessors looked at the evidence from a patient-important outcome perspective or from a test accuracy standpoint. GRADE criteria such as inconsistency, imprecision, and publication bias were challenging to apply as was the assessment of comparative test accuracy reviews. CONCLUSION: The perspective from which evidence is graded can influence judgments about quality. Guidance on application of GRADE to comparative test reviews and on the GRADE criteria of inconsistency, imprecision, and publication bias will facilitate the operationalization of GRADE for diagnostics.
OBJECTIVES: The Grading of Recommendations Assessment, Development and Evaluation (GRADE) Working Group developed an approach to assess the quality of evidence of diagnostic tests. Its use in Cochrane diagnostic test accuracy reviews is new. We applied this approach to three Cochrane reviews with the aim of better understanding the application of the GRADE criteria to such reviews. STUDY DESIGN AND SETTING: We selected reviews to achieve clinical and methodological diversities. At least three assessors independently assessed each review according to the GRADE criteria of risk of bias, indirectness, imprecision, inconsistency, and publication bias. Two teleconferences were held to share experiences. RESULTS: For the interpretation of the GRADE criteria, it made a difference whether assessors looked at the evidence from a patient-important outcome perspective or from a test accuracy standpoint. GRADE criteria such as inconsistency, imprecision, and publication bias were challenging to apply as was the assessment of comparative test accuracy reviews. CONCLUSION: The perspective from which evidence is graded can influence judgments about quality. Guidance on application of GRADE to comparative test reviews and on the GRADE criteria of inconsistency, imprecision, and publication bias will facilitate the operationalization of GRADE for diagnostics.
Authors: Christopher G Slatore; Nanda Horeweg; James R Jett; David E Midthun; Charles A Powell; Renda Soylemez Wiener; Juan P Wisnivesky; Michael K Gould Journal: Am J Respir Crit Care Med Date: 2015-08-15 Impact factor: 21.405
Authors: Adam J Shapiro; Maureen Josephson; Margaret Rosenfeld; Ozge Yilmaz; Stephanie D Davis; Deepika Polineni; Elena Guadagno; Margaret W Leigh; Valery Lavergne Journal: Ann Am Thorac Soc Date: 2017-07
Authors: Richard Macey; Tanya Walsh; Philip Riley; Anne-Marie Glenny; Helen V Worthington; Patrick A Fee; Janet E Clarkson; David Ricketts Journal: Cochrane Database Syst Rev Date: 2020-12-08