Allen F Shaughnessy1, Akansha Vaswani2, Bonnie K Andrews2, Deborah R Erlich3, Frank D'Amico4, Joel Lexchin5, Lisa Cosgrove2. 1. Tufts University School of Medicine, Boston, Massachusetts Allen.Shaughnessy@tufts.edu. 2. Department of Counseling and School Psychology, University of Massachusetts, Boston, Massachusetts. 3. Tufts University School of Medicine, Boston, Massachusetts. 4. McAnulty College and Graduate School of Liberal Arts, Duquesne University, Pittsburgh, Pennsylvania. 5. School of Health Policy and Management, York University, Toronto, Canada.
Abstract
BACKGROUND: Clinicians are faced with a plethora of guidelines. To rate guidelines, they can select from a number of evaluation tools, most of which are long and difficult to apply. The goal of this project was to develop a simple, easy-to-use checklist for clinicians to use to identify trustworthy, relevant, and useful practice guidelines, the Guideline Trustworthiness, Relevance, and Utility Scoring Tool (G-TRUST). METHODS: A modified Delphi process was used to obtain consensus of experts and guideline developers regarding a checklist of items and their relative impact on guideline quality. We conducted 4 rounds of sampling to refine wording, add and subtract items, and develop a scoring system. Multiple attribute utility analysis was used to develop a weighted utility score for each item to determine scoring. RESULTS: Twenty-two experts in evidence-based medicine, 17 developers of high-quality guidelines, and 1 consumer representative participated. In rounds 1 and 2, items were rewritten or dropped, and 2 items were added. In round 3, weighted scores were calculated from rankings and relative weights assigned by the expert panel. In the last round, more than 75% of experts indicated 3 of the 8 checklist items to be major indicators of guideline usefulness and, using the AGREE tool as a reference standard, a scoring system was developed to identify guidelines as useful, may not be useful, and not useful. CONCLUSION: The 8-item G-TRUST is potentially helpful as a tool for clinicians to identify useful guidelines. Further research will focus on its reliability when used by clinicians.
BACKGROUND: Clinicians are faced with a plethora of guidelines. To rate guidelines, they can select from a number of evaluation tools, most of which are long and difficult to apply. The goal of this project was to develop a simple, easy-to-use checklist for clinicians to use to identify trustworthy, relevant, and useful practice guidelines, the Guideline Trustworthiness, Relevance, and Utility Scoring Tool (G-TRUST). METHODS: A modified Delphi process was used to obtain consensus of experts and guideline developers regarding a checklist of items and their relative impact on guideline quality. We conducted 4 rounds of sampling to refine wording, add and subtract items, and develop a scoring system. Multiple attribute utility analysis was used to develop a weighted utility score for each item to determine scoring. RESULTS: Twenty-two experts in evidence-based medicine, 17 developers of high-quality guidelines, and 1 consumer representative participated. In rounds 1 and 2, items were rewritten or dropped, and 2 items were added. In round 3, weighted scores were calculated from rankings and relative weights assigned by the expert panel. In the last round, more than 75% of experts indicated 3 of the 8 checklist items to be major indicators of guideline usefulness and, using the AGREE tool as a reference standard, a scoring system was developed to identify guidelines as useful, may not be useful, and not useful. CONCLUSION: The 8-item G-TRUST is potentially helpful as a tool for clinicians to identify useful guidelines. Further research will focus on its reliability when used by clinicians.
Authors: Christopher J Coroneos; Sophocles H Voineskos; Sylvie D Cornacchi; Charlie H Goldsmith; Teegan A Ignacy; Achilleas Thoma Journal: Can J Surg Date: 2014-08 Impact factor: 2.089
Authors: James A Dickinson; Neil R Bell; Roland Grad; Harminder Singh; Stéphane Groulx; Olga Szafran Journal: Can Fam Physician Date: 2018-05 Impact factor: 3.275
Authors: James A Dickinson; Neil R Bell; Roland Grad; Harminder Singh; Stéphane Groulx; Olga Szafran Journal: Can Fam Physician Date: 2018-05 Impact factor: 3.275
Authors: Viola Antao; Roland Grad; Guylène Thériault; James A Dickinson; Olga Szafran; Harminder Singh; Raphael Rezkallah; Earle Waugh; Neil R Bell Journal: Can Fam Physician Date: 2022-05 Impact factor: 3.025
Authors: Viola Antao; Roland Grad; Guylène Thériault; James A Dickinson; Olga Szafran; Harminder Singh; Raphael Rezkallah; Earle Waugh; Neil R Bell Journal: Can Fam Physician Date: 2022-05 Impact factor: 3.025
Authors: G Michael Allan; Kris Aubrey-Bassler; Michel Cauchon; Noah M Ivers; Alan Katz; Jessica Kirkwood; Peter James Kuling; Eric J Mang; Simon Moore; Artem Safarov; Catherine Scrimshaw; Elizabeth Shaw; Penelope Stalker; Robert Woollard Journal: Can Fam Physician Date: 2021-07 Impact factor: 3.275