OBJECTIVES: To develop and validate a new risk-of-bias tool for nonrandomized studies (NRSs). STUDY DESIGN AND SETTING: We developed the Risk of Bias Assessment Tool for Nonrandomized Studies (RoBANS). A validation process with 39 NRSs examined the reliability (interrater agreement), validity (the degree of correlation between the overall assessments of RoBANS and Methodological Index for Nonrandomized Studies [MINORS], obtained by plotting the overall risk of bias relative to effect size and funding source), face validity with eight experts, and completion time for the RoBANS approach. RESULTS: RoBANS contains six domains: the selection of participants, confounding variables, the measurement of exposure, the blinding of the outcome assessments, incomplete outcome data, and selective outcome reporting. The interrater agreement of the RoBANS tool except the measurement of exposure and selective outcome reporting domains ranged from fair to substantial. There was a moderate correlation between the overall risks of bias determined using RoBANS and MINORS. The observed differences in effect sizes and funding sources among the assessed studies were not correlated with the overall risk of bias in these studies. The mean time required to complete RoBANS was approximately 10 min. The external experts who were interviewed evaluated RoBANS as a "fair" assessment tool. CONCLUSIONS: RoBANS shows moderate reliability, promising feasibility, and validity. The further refinement of this tool and larger validation studies are required.
OBJECTIVES: To develop and validate a new risk-of-bias tool for nonrandomized studies (NRSs). STUDY DESIGN AND SETTING: We developed the Risk of Bias Assessment Tool for Nonrandomized Studies (RoBANS). A validation process with 39 NRSs examined the reliability (interrater agreement), validity (the degree of correlation between the overall assessments of RoBANS and Methodological Index for Nonrandomized Studies [MINORS], obtained by plotting the overall risk of bias relative to effect size and funding source), face validity with eight experts, and completion time for the RoBANS approach. RESULTS: RoBANS contains six domains: the selection of participants, confounding variables, the measurement of exposure, the blinding of the outcome assessments, incomplete outcome data, and selective outcome reporting. The interrater agreement of the RoBANS tool except the measurement of exposure and selective outcome reporting domains ranged from fair to substantial. There was a moderate correlation between the overall risks of bias determined using RoBANS and MINORS. The observed differences in effect sizes and funding sources among the assessed studies were not correlated with the overall risk of bias in these studies. The mean time required to complete RoBANS was approximately 10 min. The external experts who were interviewed evaluated RoBANS as a "fair" assessment tool. CONCLUSIONS: RoBANS shows moderate reliability, promising feasibility, and validity. The further refinement of this tool and larger validation studies are required.
Authors: Soon-Hyun Ahn; Hyun Jun Hong; Soon Young Kwon; Kee Hwan Kwon; Jong-Lyel Roh; Junsun Ryu; Jun Hee Park; Seung-Kuk Baek; Guk Haeng Lee; Sei Young Lee; Jin Choon Lee; Man Ki Chung; Young Hoon Joo; Yong Bae Ji; Jeong Hun Hah; Minsu Kwon; Young Min Park; Chang Myeon Song; Sung-Chan Shin; Chang Hwan Ryu; Doh Young Lee; Young Chan Lee; Jae Won Chang; Ha Min Jeong; Jae-Keun Cho; Wonjae Cha; Byung Joon Chun; Ik Joon Choi; Hyo Geun Choi; Kang Dae Lee Journal: Clin Exp Otorhinolaryngol Date: 2017-01-03 Impact factor: 3.372
Authors: Steven P Cohen; Arun Bhaskar; Anuj Bhatia; Asokumar Buvanendran; Tim Deer; Shuchita Garg; W Michael Hooten; Robert W Hurley; David J Kennedy; Brian C McLean; Jee Youn Moon; Samer Narouze; Sanjog Pangarkar; David Anthony Provenzano; Richard Rauck; B Todd Sitzman; Matthew Smuck; Jan van Zundert; Kevin Vorenkamp; Mark S Wallace; Zirong Zhao Journal: Reg Anesth Pain Med Date: 2020-04-03 Impact factor: 6.288