Anna K N Tsoi1, Leonard T F Ho2, Irene X Y Wu3, Charlene H L Wong4, Robin S T Ho1, Joanne Y Y Lim1, Chen Mao5, Eric K P Lee1, Vincent C H Chung6. 1. The Jockey Club School of Public Health and Primary Care, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong. 2. School of Chinese Medicine, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong. 3. Xiangya School of Public Health, Central South University, China. 4. The Jockey Club School of Public Health and Primary Care, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong. Electronic address: charlene.wong@link.cuhk.edu.hk. 5. Department of Epidemiology, School of Public Health, Southern Medical University, China. 6. The Jockey Club School of Public Health and Primary Care, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong; School of Chinese Medicine, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong.
Abstract
PURPOSE: Systematic reviews (SRs) provide the best evidence on the effectiveness of treatment strategies for osteoporosis. Carefully conducted SRs provide high-quality evidence for supporting decision-making, but the trustworthiness of conclusions can be hampered by limitation in rigor. We aimed to appraise the methodological quality of a representative sample of SRs on osteoporosis treatments in a cross-sectional study. METHODS: Cochrane Database of Systematic Reviews, EMBASE, MEDLINE, and PsycINFO were searched for SRs on osteoporotic treatments. AMSTAR (A MeaSurement Tool to Assess systematic Reviews) 2 was used to evaluate methodological quality of SRs. Associations between bibliographical characteristics and methodological quality ratings were explored using multivariate regression analyses. RESULTS: A total of 101 SRs were appraised. Overall, one (1.0%) was rated "high quality", three (3.0%) were rated "moderate quality", eleven (10.9%) were rated "low quality", and eighty-six (85.1%) were rated "critically low quality". Ninety-nine (98.0%) did not explain study design selection, eighty-five (84.2%) did not provide a list of excluded studies (84.2%), and eighty-five (84.2%) did not report funding sources of included studies. SRs published in 2018 or after were associated with higher overall quality [adjusted odds ratio (AOR): 5.48; 95% confidence interval (CI): 1.12-26.89], while SRs focused on pharmacological interventions were associated with lower overall quality [AOR: 0.24; 95% CI: 0.06-0.96]. CONCLUSION: The methodological quality of the included SRs is far from satisfactory. Future reviewers must strengthen rigor by improving literature search comprehensiveness, registering and publishing a priori protocols, and optimising study selection and data extraction. Better transparency in reporting conflicts of interest among reviewers, as well as sources of funding among included primary studies, are also needed.
PURPOSE: Systematic reviews (SRs) provide the best evidence on the effectiveness of treatment strategies for osteoporosis. Carefully conducted SRs provide high-quality evidence for supporting decision-making, but the trustworthiness of conclusions can be hampered by limitation in rigor. We aimed to appraise the methodological quality of a representative sample of SRs on osteoporosis treatments in a cross-sectional study. METHODS: Cochrane Database of Systematic Reviews, EMBASE, MEDLINE, and PsycINFO were searched for SRs on osteoporotic treatments. AMSTAR (A MeaSurement Tool to Assess systematic Reviews) 2 was used to evaluate methodological quality of SRs. Associations between bibliographical characteristics and methodological quality ratings were explored using multivariate regression analyses. RESULTS: A total of 101 SRs were appraised. Overall, one (1.0%) was rated "high quality", three (3.0%) were rated "moderate quality", eleven (10.9%) were rated "low quality", and eighty-six (85.1%) were rated "critically low quality". Ninety-nine (98.0%) did not explain study design selection, eighty-five (84.2%) did not provide a list of excluded studies (84.2%), and eighty-five (84.2%) did not report funding sources of included studies. SRs published in 2018 or after were associated with higher overall quality [adjusted odds ratio (AOR): 5.48; 95% confidence interval (CI): 1.12-26.89], while SRs focused on pharmacological interventions were associated with lower overall quality [AOR: 0.24; 95% CI: 0.06-0.96]. CONCLUSION: The methodological quality of the included SRs is far from satisfactory. Future reviewers must strengthen rigor by improving literature search comprehensiveness, registering and publishing a priori protocols, and optimising study selection and data extraction. Better transparency in reporting conflicts of interest among reviewers, as well as sources of funding among included primary studies, are also needed.
Authors: Leonard Ho; Fiona Y T Ke; Charlene H L Wong; Irene X Y Wu; Andy K L Cheung; Chen Mao; Vincent C H Chung Journal: BMC Med Res Methodol Date: 2021-10-30 Impact factor: 4.615
Authors: Andy K L Cheung; Leonard Ho; Charlene H L Wong; Irene X Y Wu; Fiona Y T Ke; Vincent C H Chung Journal: BMC Complement Med Ther Date: 2022-02-23