Joseph J Ruzbarsky1, Ryan C Rauck2, Joseph Manzi3, Sariah Khormaee2, Bridget Jivanelli2, Russell F Warren2. 1. Department of Orthopaedics, Hospital for Special Surgery, New York, NY, USA. Electronic address: ruzbarskyj@hss.edu. 2. Department of Orthopaedics, Hospital for Special Surgery, New York, NY, USA. 3. Weill Cornell School of Medicine, New York, NY, USA.
Abstract
BACKGROUND: Considered the gold standard of study designs, randomized controlled trials' (RCTs) results shape clinical practice, effect policy, and influence reimbursement. The fragility index (FI) can be used to quantitate the relative robustness of RCT results, with higher scores indicating more stout results. Unfortunately, most RCTs in surgery have fragile results. The aim of this study was to report on the FI in addition to a qualitative assessment of recent RCTs within the field of shoulder and elbow surgery. METHODS: A systematic review was performed identifying recently published shoulder/elbow RCTs that included 1:1 allocated parallel study arms, dichotomous primary outcome variables, and statistical significance. The FI was calculated by sequentially modifying outcome groups by exchanging a nonevent in one group to an event until the P value for the outcome comparison, as calculated by the Fisher exact test, was increased above the .05 threshold. RESULTS: Thirty RCTs were included. The median FI was 4. Sixty percent trials had a FI of 2 or less. Fifty-three percent studies reported that participants were lost to follow-up. In 87.5% of these studies, the losses to follow-up exceeded their respective FIs. Only 53% of studies defined a primary outcome variable and 60% studies performed a prestudy power analysis. CONCLUSIONS: The median FI reported in the recent shoulder/elbow literature is 4; however, a high proportion of included RCTs display significant methodological concerns. The FI is a useful adjunct to analyze RCT results, but careful analysis of trial methods should be employed in each circumstance before drawing conclusions.
BACKGROUND: Considered the gold standard of study designs, randomized controlled trials' (RCTs) results shape clinical practice, effect policy, and influence reimbursement. The fragility index (FI) can be used to quantitate the relative robustness of RCT results, with higher scores indicating more stout results. Unfortunately, most RCTs in surgery have fragile results. The aim of this study was to report on the FI in addition to a qualitative assessment of recent RCTs within the field of shoulder and elbow surgery. METHODS: A systematic review was performed identifying recently published shoulder/elbow RCTs that included 1:1 allocated parallel study arms, dichotomous primary outcome variables, and statistical significance. The FI was calculated by sequentially modifying outcome groups by exchanging a nonevent in one group to an event until the P value for the outcome comparison, as calculated by the Fisher exact test, was increased above the .05 threshold. RESULTS: Thirty RCTs were included. The median FI was 4. Sixty percent trials had a FI of 2 or less. Fifty-three percent studies reported that participants were lost to follow-up. In 87.5% of these studies, the losses to follow-up exceeded their respective FIs. Only 53% of studies defined a primary outcome variable and 60% studies performed a prestudy power analysis. CONCLUSIONS: The median FI reported in the recent shoulder/elbow literature is 4; however, a high proportion of included RCTs display significant methodological concerns. The FI is a useful adjunct to analyze RCT results, but careful analysis of trial methods should be employed in each circumstance before drawing conclusions.
Authors: Robert L Parisien; David P Trofa; Patrick K Cronin; Jesse Dashe; Emily J Curry; Josef K Eichinger; William N Levine; Paul Tornetta; Xinning Li Journal: Arthrosc Sports Med Rehabil Date: 2021-10-12
Authors: Nathan P Fackler; Theofilos Karasavvidis; Cooper B Ehlers; Kylie T Callan; Wilson C Lai; Robert L Parisien; Dean Wang Journal: Foot Ankle Int Date: 2022-08-24 Impact factor: 3.569