Alexandra N Colebatch-Bourn1, Philip G Conaghan2, Nigel K Arden3, Cyrus Cooper3, Maxime Dougados4, Christopher J Edwards5. 1. NIHR Wellcome Trust Clinical Research Facility, University Hospital Southampton NHS Foundation Trust, Southampton, UK, Department of Rheumatology, Yeovil District Hospital, Yeovil. 2. Leeds Institute of Rheumatic and Musculoskeletal Medicine, University of Leeds & NIHR Leeds Musculoskeletal Biomedical Research Unit, Leeds. 3. Oxford NIHR Musculoskeletal Biomedical Research Unit, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, MRC Lifecourse Epidemiology Unit, University of Southampton, Southampton General Hospital, Southampton, UK and. 4. Department of Rheumatology, Paris Descartes University, Hôpital Cochin, Assistance Publique-Hôpitaux de Paris, EULAR Centre of Excellence; INSERM (U1153): Clinical Epidemiology and Biostatistics, PRES Sorbonne Paris-Cité, Paris, France. 5. NIHR Wellcome Trust Clinical Research Facility, University Hospital Southampton NHS Foundation Trust, Southampton, UK, Oxford NIHR Musculoskeletal Biomedical Research Unit, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, MRC Lifecourse Epidemiology Unit, University of Southampton, Southampton General Hospital, Southampton, UK and cedwards@soton.ac.uk.
Abstract
OBJECTIVE: To increase understanding of how to raise the quality of rheumatology guidelines by reviewing European League Against Rheumatism (EULAR) management recommendations, using the Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument, 10 years after publication of the EULAR standardized operating procedures (SOP) for the production of recommendations. It was hoped that this work could help inform improvements in guideline development by other societies and organizations. METHODS: The SOP were published in 2004 to ensure the quality of EULAR-endorsed recommendations. We reviewed 27 published EULAR recommendations for management using the AGREE II tool. This provides a framework to assess the quality of guidelines across six broad domains using 23 specific questions. RESULTS: Overall the EULAR recommendations reviewed have been performed to a high standard. There are particular strengths in the methodology and presentation of the guidelines; however, the results indicate areas for development in future recommendations: in particular, stakeholder involvement and applicability of the recommendations. Improvements in quality were evident in recent years, with patient representation in 9 of 15 (60.0%) recommendations published 2010-14 compared with 4 of 12 (33.3%) published 2000-09. CONCLUSION: In the last 10 years the overall quality of recommendations was good, with standards improving over the decade following publication of the SOP. However, this review process has identified potential areas for improvement, especially in patient representation and provision of implementation tools. The lessons from this work can be applied to the development of rheumatology guidelines by other societies and organizations.
OBJECTIVE: To increase understanding of how to raise the quality of rheumatology guidelines by reviewing European League Against Rheumatism (EULAR) management recommendations, using the Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument, 10 years after publication of the EULAR standardized operating procedures (SOP) for the production of recommendations. It was hoped that this work could help inform improvements in guideline development by other societies and organizations. METHODS: The SOP were published in 2004 to ensure the quality of EULAR-endorsed recommendations. We reviewed 27 published EULAR recommendations for management using the AGREE II tool. This provides a framework to assess the quality of guidelines across six broad domains using 23 specific questions. RESULTS: Overall the EULAR recommendations reviewed have been performed to a high standard. There are particular strengths in the methodology and presentation of the guidelines; however, the results indicate areas for development in future recommendations: in particular, stakeholder involvement and applicability of the recommendations. Improvements in quality were evident in recent years, with patient representation in 9 of 15 (60.0%) recommendations published 2010-14 compared with 4 of 12 (33.3%) published 2000-09. CONCLUSION: In the last 10 years the overall quality of recommendations was good, with standards improving over the decade following publication of the SOP. However, this review process has identified potential areas for improvement, especially in patient representation and provision of implementation tools. The lessons from this work can be applied to the development of rheumatology guidelines by other societies and organizations.