David Tanner1, Kirstien Minley2, Kelsey Snider2, Micah Hartwell2, Trevor Torgerson2, Ryan Ottwell3, Jason Beaman2, Matt Vassar2. 1. Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, United States. Electronic address: davidtannerresearch@gmail.com. 2. Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, United States. 3. Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, United States; Department of Internal Medicine, University of Oklahoma, School of Community Medicine, Tulsa, OK, United States.
Abstract
BACKGROUND: As Clinical Practice Guidelines (CPGs) provide effective guidance for providing medical care for individuals with alcohol use disorder (AUD), the evidence behind them should be robust. OBJECTIVE: Our primary objective was to critically appraise the methodological and reporting quality of systematic reviews cited within CPGs regarding the treatment of AUD. Our secondary objective was to determine how frequently Cochrane Reviews were cited as justification and to evaluate appraisals between Cochrane and non-Cochrane reviews. METHODS: We searched PubMed to identify CPGs for the treatment of AUD published between 2015 and 2021. Systematic reviews included in each CPG were evaluated using the Preferred Reporting Instrument for Systematic Reviews and Meta-Analyses (PRISMA) and a validated quality assessment tool (AMSTAR-2). Additional study characteristics were recorded. RESULTS: From the screening process, 98 systematic reviews from 6 CPGs met inclusion criteria. PRISMA adherence ranged from 72% to 85% (mean of 79%). AMSTAR-2 adherence ranged from 52% to 73% (mean of 68%). AMSTAR appraisal ratings found 32 (35.6%) critically low, 10 (11.1%) low, 35 (38.9%) moderate, and only 13 (14.4%) high systematic reviews. Cochrane systematic reviews displayed greater PRISMA (0.92 vs. 0.75: p < 0.001) and AMSTAR-2 (0.90 vs. 0.61.; p < 0.001) scores compared to the non-Cochrane studies. CONCLUSION: Systematic reviews included in CPGs for AUD treatment showed variable adherence to PRISMA and AMSTAR-2 guidelines, with almost half of the systematic reviews being critically low to low methodological quality. Given the prevalence of alcohol use disorder, methodological and reporting quality recommendations are important to strengthening evidence informing CPGs.
BACKGROUND: As Clinical Practice Guidelines (CPGs) provide effective guidance for providing medical care for individuals with alcohol use disorder (AUD), the evidence behind them should be robust. OBJECTIVE: Our primary objective was to critically appraise the methodological and reporting quality of systematic reviews cited within CPGs regarding the treatment of AUD. Our secondary objective was to determine how frequently Cochrane Reviews were cited as justification and to evaluate appraisals between Cochrane and non-Cochrane reviews. METHODS: We searched PubMed to identify CPGs for the treatment of AUD published between 2015 and 2021. Systematic reviews included in each CPG were evaluated using the Preferred Reporting Instrument for Systematic Reviews and Meta-Analyses (PRISMA) and a validated quality assessment tool (AMSTAR-2). Additional study characteristics were recorded. RESULTS: From the screening process, 98 systematic reviews from 6 CPGs met inclusion criteria. PRISMA adherence ranged from 72% to 85% (mean of 79%). AMSTAR-2 adherence ranged from 52% to 73% (mean of 68%). AMSTAR appraisal ratings found 32 (35.6%) critically low, 10 (11.1%) low, 35 (38.9%) moderate, and only 13 (14.4%) high systematic reviews. Cochrane systematic reviews displayed greater PRISMA (0.92 vs. 0.75: p < 0.001) and AMSTAR-2 (0.90 vs. 0.61.; p < 0.001) scores compared to the non-Cochrane studies. CONCLUSION: Systematic reviews included in CPGs for AUD treatment showed variable adherence to PRISMA and AMSTAR-2 guidelines, with almost half of the systematic reviews being critically low to low methodological quality. Given the prevalence of alcohol use disorder, methodological and reporting quality recommendations are important to strengthening evidence informing CPGs.
Authors: Bridget F Grant; Risë B Goldstein; Tulshi D Saha; S Patricia Chou; Jeesun Jung; Haitao Zhang; Roger P Pickering; W June Ruan; Sharon M Smith; Boji Huang; Deborah S Hasin Journal: JAMA Psychiatry Date: 2015-08 Impact factor: 21.596
Authors: Pablo Alonso-Coello; Holger J Schünemann; Jenny Moberg; Romina Brignardello-Petersen; Elie A Akl; Marina Davoli; Shaun Treweek; Reem A Mustafa; Gabriel Rada; Sarah Rosenbaum; Angela Morelli; Gordon H Guyatt; Andrew D Oxman Journal: BMJ Date: 2016-06-28
Authors: Alessandro Liberati; Douglas G Altman; Jennifer Tetzlaff; Cynthia Mulrow; Peter C Gøtzsche; John P A Ioannidis; Mike Clarke; P J Devereaux; Jos Kleijnen; David Moher Journal: PLoS Med Date: 2009-07-21 Impact factor: 11.069
Authors: Jelena Savovic; Rebecca M Turner; David Mawdsley; Hayley E Jones; Rebecca Beynon; Julian P T Higgins; Jonathan A C Sterne Journal: Am J Epidemiol Date: 2018-05-01 Impact factor: 4.897