Kyu Shik Kim1, Jae Hoon Chung1, Jung Ki Jo1, Jae Heon Kim2, Seungjun Kim3, Jeoung Man Cho4, Hee Ju Cho4, Hong Yong Choi1, Seung Wook Lee5,6. 1. Department of Urology, Hanyang University College of Medicine, Seoul, South Korea. 2. Department of Urology, Soonchunhyang University Hospital, Soonchunhyang University College of Medicine, Seoul, South Korea. 3. The Warren Alpert Medical School of Brown University, Providence, RI, USA. 4. Department of Urology, Eulji general hospital, Eulji University School of Medicine, Seoul, South Korea. 5. Department of Urology, Hanyang University College of Medicine, Seoul, South Korea. swleepark@hanyang.ac.kr. 6. Department of Urology, Hanyang University Guri Hospital, 249-1, Gyomun-dong, Guri, 471-701, South Korea. swleepark@hanyang.ac.kr.
Abstract
INTRODUCTION AND HYPOTHESIS: Randomized controlled trials (RCTs) provide the best quality clinical evidence. The aim of this study was to assess the quality of RCTs published by the International Urogynecology Journal (IUJ) in 2007-2016. METHODS: RCTs in original articles were extracted from PubMed and IUJ homepage. Change in RCT quality over time was assessed with Jadad and van Tulder scales and Cochrane Collaboration's risk of bias tool (CCRBT). Jadad scores of 3-5 or van Tulder scores of >5 indicated high-quality RCTs. The effect on RCT quality of including funding source and institutional review board (IRB) approval statements and describing the intervention was assessed. In addition, changes in RCT topics over time were assessed. RESULTS: Annual RCT frequencies did not change significantly (6.7-15.7%): 36.1% and 25.7% described blinding and allocation concealment, respectively. Both tended to increase between 2013 and 2016, particularly 2013 and 2014. Funding statement inclusion (39.1% overall) and intervention description (78.2% overall) tended to increase steadily. IRB statement inclusion (60.4% overall) increased significantly (p < 0.01). Jadad scores and van Tulder rose significantly until 2014 (p < 0.01). Frequencies of high-quality RCTs tended to rise. CCRBT indicated that RCTs with a low risk of bias tended to increase until 2014. However, from 2015, Jadad scores, van Tulder, and CCRBT the low risk tended to decreased. RCTs with funding and IRB approval statements had higher Jadad and van Tulder scores than unfunded RCTs (p < 0.01 and p < 0.01, respectively). Intervention description did not associate with better quality. CONCLUSIONS: RCT quality improved over time, but a dip in quality was observed in 2015-2016 because of decreased blinding and allocation concealment.
INTRODUCTION AND HYPOTHESIS: Randomized controlled trials (RCTs) provide the best quality clinical evidence. The aim of this study was to assess the quality of RCTs published by the International Urogynecology Journal (IUJ) in 2007-2016. METHODS: RCTs in original articles were extracted from PubMed and IUJ homepage. Change in RCT quality over time was assessed with Jadad and van Tulder scales and Cochrane Collaboration's risk of bias tool (CCRBT). Jadad scores of 3-5 or van Tulder scores of >5 indicated high-quality RCTs. The effect on RCT quality of including funding source and institutional review board (IRB) approval statements and describing the intervention was assessed. In addition, changes in RCT topics over time were assessed. RESULTS: Annual RCT frequencies did not change significantly (6.7-15.7%): 36.1% and 25.7% described blinding and allocation concealment, respectively. Both tended to increase between 2013 and 2016, particularly 2013 and 2014. Funding statement inclusion (39.1% overall) and intervention description (78.2% overall) tended to increase steadily. IRB statement inclusion (60.4% overall) increased significantly (p < 0.01). Jadad scores and van Tulder rose significantly until 2014 (p < 0.01). Frequencies of high-quality RCTs tended to rise. CCRBT indicated that RCTs with a low risk of bias tended to increase until 2014. However, from 2015, Jadad scores, van Tulder, and CCRBT the low risk tended to decreased. RCTs with funding and IRB approval statements had higher Jadad and van Tulder scores than unfunded RCTs (p < 0.01 and p < 0.01, respectively). Intervention description did not associate with better quality. CONCLUSIONS: RCT quality improved over time, but a dip in quality was observed in 2015-2016 because of decreased blinding and allocation concealment.
Authors: David Moher; Sally Hopewell; Kenneth F Schulz; Victor Montori; Peter C Gøtzsche; P J Devereaux; Diana Elbourne; Matthias Egger; Douglas G Altman Journal: Int J Surg Date: 2011-10-12 Impact factor: 6.071
Authors: Charles D Scales; Regina D Norris; Glenn M Preminger; Johannes Vieweg; Bercedis L Peterson; Philipp Dahm Journal: J Urol Date: 2008-08-16 Impact factor: 7.450
Authors: C Begg; M Cho; S Eastwood; R Horton; D Moher; I Olkin; R Pitkin; D Rennie; K F Schulz; D Simel; D F Stroup Journal: JAMA Date: 1996-08-28 Impact factor: 56.272