Raevti Bole1, Harrison Chase Gottlich2, Matthew J Ziegelmann2, Dillon Corrigan3, Laurence A Levine4, John P Mulhall5, Petar Bajic6. 1. Center for Men's Health, Glickman Urological and Kidney Institute, Cleveland Clinic, Cleveland, OH, USA; Department of Urology, Mayo Clinic, Rochester, MN, USA. 2. Department of Urology, Mayo Clinic, Rochester, MN, USA. 3. Department of Quantitative Health Sciences, Lerner Research Institute, Cleveland Clinic, Cleveland, OH, USA. 4. Department of Urology, Rush University Medical Center, Chicago, IL, USA. 5. Department of Urology, Memorial Sloan Kettering Cancer Center, New York, NY, USA. 6. Center for Men's Health, Glickman Urological and Kidney Institute, Cleveland Clinic, Cleveland, OH, USA. Electronic address: BAJICP@ccf.org.
Abstract
BACKGROUND: Despite an increasing number of publications on Peyronie's disease (PD), evidence-based clinical decision-making remains challenging due to the small number of well-designed clinical trials. AIM: To perform a critical analysis of reporting quality in PD systematic reviews (SR) and meta-analyses (MA). METHODS: Study protocol registration was performed on the Open Science Framework platform. In January 2021, a systematic electronic search of the Medline/PubMed, Embase, Ovid, Scopus, Joanne Briggs Institute, and Cochrane databases was performed. Search terms included "Peyronie's disease" and "systematic review OR meta-analysis OR meta-analysis." Eligibility criteria were English-language, relevance to PD and specification of "systematic review" or "meta-analysis" in the title or abstract. Oxford Center for Evidence-Based Medicine levels of evidence were used to classify original studies reviewed within each publication. Risk of bias was assessed using the ROBIS tool. Data were tabulated and reported as means with standard deviation, median with interquartile range and t-testing as appropriate. Strength of association between variables was calculated using Pearson correlation coefficient. Statistical analyses were performed on RStudio (version 1.4.1106). OUTCOMES: Outcomes included review type, level of evidence, authorship, journal, publication date, "A MeaSurement Tool to Assess systematic Reviews" (AMSTAR-2) score and "Preferred Reporting Items for Systematic Reviews and Meta-Analyses" (PRISMA) score. RESULTS: From 1974 to 2021, 340 articles were identified. After review, 17 full length articles were included. Thirteen were SR, 2 MA and 2 was combined. Significant heterogeneity was seen in evidence level of included studies. There was median 54% adherence to AMSTAR-2 criteria and 74% adherence to PRISMA criteria. Overall AMSTAR-2 confidence rating was Critically Low in 11 of 17 studies. Correlation analysis revealed very high positive association between AMSTAR 2 and PRISMA adherence (+0.95). ROBIS revealed "High" concern regarding methods used to collect data and appraise 12/17 studies (71%), and "High" concern regarding synthesis and findings in 8 of 17 studies (47%). CLINICAL IMPLICATIONS: Many SR include markedly heterogenous levels of evidence and fail to meet accepted methodological criteria for reporting. STRENGTHS AND LIMITATIONS: Main strengths include extensive literature review and analysis of standardized study reporting. One limitation is that aggregate scoring of AMSTAR-2 and PRISMA is not intended as primary method of quality assessment; however effect was minimized by reporting critical domains, overall quality assessments and specifics on globally poorly reported domains. CONCLUSION: More high quality randomized controlled PD trials are necessary; SR and MA should focus on these studies alone. Bole R, Gottlich HC, Ziegelmann MJ, et al. A Critical Analysis of Reporting in Systematic Reviews and Meta-Analyses in the Peyronie's Disease Literature. J Sex Med 2022;19:629-640.
BACKGROUND: Despite an increasing number of publications on Peyronie's disease (PD), evidence-based clinical decision-making remains challenging due to the small number of well-designed clinical trials. AIM: To perform a critical analysis of reporting quality in PD systematic reviews (SR) and meta-analyses (MA). METHODS: Study protocol registration was performed on the Open Science Framework platform. In January 2021, a systematic electronic search of the Medline/PubMed, Embase, Ovid, Scopus, Joanne Briggs Institute, and Cochrane databases was performed. Search terms included "Peyronie's disease" and "systematic review OR meta-analysis OR meta-analysis." Eligibility criteria were English-language, relevance to PD and specification of "systematic review" or "meta-analysis" in the title or abstract. Oxford Center for Evidence-Based Medicine levels of evidence were used to classify original studies reviewed within each publication. Risk of bias was assessed using the ROBIS tool. Data were tabulated and reported as means with standard deviation, median with interquartile range and t-testing as appropriate. Strength of association between variables was calculated using Pearson correlation coefficient. Statistical analyses were performed on RStudio (version 1.4.1106). OUTCOMES: Outcomes included review type, level of evidence, authorship, journal, publication date, "A MeaSurement Tool to Assess systematic Reviews" (AMSTAR-2) score and "Preferred Reporting Items for Systematic Reviews and Meta-Analyses" (PRISMA) score. RESULTS: From 1974 to 2021, 340 articles were identified. After review, 17 full length articles were included. Thirteen were SR, 2 MA and 2 was combined. Significant heterogeneity was seen in evidence level of included studies. There was median 54% adherence to AMSTAR-2 criteria and 74% adherence to PRISMA criteria. Overall AMSTAR-2 confidence rating was Critically Low in 11 of 17 studies. Correlation analysis revealed very high positive association between AMSTAR 2 and PRISMA adherence (+0.95). ROBIS revealed "High" concern regarding methods used to collect data and appraise 12/17 studies (71%), and "High" concern regarding synthesis and findings in 8 of 17 studies (47%). CLINICAL IMPLICATIONS: Many SR include markedly heterogenous levels of evidence and fail to meet accepted methodological criteria for reporting. STRENGTHS AND LIMITATIONS: Main strengths include extensive literature review and analysis of standardized study reporting. One limitation is that aggregate scoring of AMSTAR-2 and PRISMA is not intended as primary method of quality assessment; however effect was minimized by reporting critical domains, overall quality assessments and specifics on globally poorly reported domains. CONCLUSION: More high quality randomized controlled PD trials are necessary; SR and MA should focus on these studies alone. Bole R, Gottlich HC, Ziegelmann MJ, et al. A Critical Analysis of Reporting in Systematic Reviews and Meta-Analyses in the Peyronie's Disease Literature. J Sex Med 2022;19:629-640.
Authors: Ekkehard W Hauck; Ulrich O Mueller; Thomas Bschleipfer; Hans U Schmelz; Thorten Diemer; Wolfgang Weidner Journal: J Urol Date: 2004-02 Impact factor: 7.450
Authors: Sally Hopewell; Mike Clarke; David Moher; Elizabeth Wager; Philippa Middleton; Douglas G Altman; Kenneth F Schulz Journal: Lancet Date: 2008-01-26 Impact factor: 79.321
Authors: Daniel R Greenberg; Michael T Richardson; Jonathan D Tijerina; Michelle B Bass; Michael L Eisenberg Journal: J Sex Med Date: 2019-02-14 Impact factor: 3.802
Authors: Giorgio Ivan Russo; Giovanni Cacciamani; Andrea Cocci; Thomas M Kessler; Giuseppe Morgia; Ege Can Serefoglu; Maarten Albersen; Paolo Verze Journal: J Sex Med Date: 2019-01-26 Impact factor: 3.802
Authors: Ajay Nehra; Ralph Alterowitz; Daniel J Culkin; Martha M Faraday; Lawrence S Hakim; Joel J Heidelbaugh; Mohit Khera; Erin Kirkby; Kevin T McVary; Martin M Miner; Christian J Nelson; Hossein Sadeghi-Nejad; Allen D Seftel; Alan W Shindel; Arthur L Burnett Journal: J Urol Date: 2015-06-09 Impact factor: 7.450
Authors: Alan R G Barbosa; Lucas S Takemura; Jonathan D Cha; Arie Carneiro; Gustavo C Lemos; Sidney Glina; Fernando Korkes Journal: Sex Med Rev Date: 2019-09-27