Silvia Bargeri1, Valerio Iannicelli2, Greta Castellini3, Michela Cinquini4, Silvia Gianola1. 1. IRCCS Istituto Ortopedico Galeazzi, Unit of Clinical Epidemiology, Milan, Italy. 2. IRCCS Istituto Ortopedico Galeazzi, Milan, Italy. 3. IRCCS Istituto Ortopedico Galeazzi, Unit of Clinical Epidemiology, Milan, Italy. Electronic address: greta.castellini@grupposandonato.it. 4. Mario Negri Institute for Pharmacological Research, IRCCS, Milan, Italy.
Abstract
OBJECTIVES: To analyze the reporting characteristics of Appraisal of Guidelines Research and Evaluation (AGREE) II appraisals in rehabilitation and explore how much quality ratings of Clinical Practice Guidelines (CPGs) vary applying different cut-offs. STUDY DESIGN AND SETTING: We conducted a methodological study re-analyzing data of an overview of AGREE II CPG appraisals in rehabilitation. Reporting characteristics of appraisals and methods used for quality rating were abstracted. We applied the most frequent cut-offs retrieved on all CPG sample to explore changes in quality ratings (i.e., high/low). RESULTS: We included 40 appraisals (n = 544 CPGs).The AGREE II overall assessment 1 (overall CPG quality) was reported in 26 appraisals (65%) and the overall assessment 2 (recommendation for use) in 17 (42.5%). Twenty-five appraisals (62.5%) reported the use of cut-offs based on domains and/or overall assessments. Application of the most reported cut-offs led to variability in quality ratings in 26% of the CPGs, of which 92% CPGs shifted their rating from low to high-quality and 8% shifted from high to low-quality. CONCLUSION: Rehabilitation stakeholders should take care to select the highest quality CPG in view of the poor reporting of AGREE II overall assessment 1 and 2 and moderate variability of quality ratings.
OBJECTIVES: To analyze the reporting characteristics of Appraisal of Guidelines Research and Evaluation (AGREE) II appraisals in rehabilitation and explore how much quality ratings of Clinical Practice Guidelines (CPGs) vary applying different cut-offs. STUDY DESIGN AND SETTING: We conducted a methodological study re-analyzing data of an overview of AGREE II CPG appraisals in rehabilitation. Reporting characteristics of appraisals and methods used for quality rating were abstracted. We applied the most frequent cut-offs retrieved on all CPG sample to explore changes in quality ratings (i.e., high/low). RESULTS: We included 40 appraisals (n = 544 CPGs).The AGREE II overall assessment 1 (overall CPG quality) was reported in 26 appraisals (65%) and the overall assessment 2 (recommendation for use) in 17 (42.5%). Twenty-five appraisals (62.5%) reported the use of cut-offs based on domains and/or overall assessments. Application of the most reported cut-offs led to variability in quality ratings in 26% of the CPGs, of which 92% CPGs shifted their rating from low to high-quality and 8% shifted from high to low-quality. CONCLUSION: Rehabilitation stakeholders should take care to select the highest quality CPG in view of the poor reporting of AGREE II overall assessment 1 and 2 and moderate variability of quality ratings.
Keywords:
AGREE II instrument; Methodological guideline appraisal; Methodological quality; Methodology, Research; practice guideline; practice guidelines as topic; rehabilitation
Authors: Mohamed Ali Babiker Mohamed; Wael Ahmed Abdelwahab Abdelkarim; Mohamed Abdulmonem Salih Aabdeen; Tarig Hassan Elobid Ahmed; Hassan H H Sarsour; Ahmed M El-Malky; Yasser S Amer; Nuha Alsaleh; Rakan I Nazer Journal: Ann Med Surg (Lond) Date: 2022-05-31