Peter William Kyriakides1, Blake Joseph Schultz2, Kenneth Egol2, Philipp Leucht3. 1. Georgetown University School of Medicine, Washington, DC, USA. 2. Department of Orthopedic Surgery, NYU Langone Health, New York, NY, USA. 3. Department of Orthopedic Surgery, NYU Langone Health, New York, NY, USA. Philipp.Leucht@nyulangone.org.
Abstract
BACKGROUND: The quality of evidence of the orthopedic literature has been often called into question. The fragility index (FI) has emerged as a means to evaluate the robustness of a significant result. Similarly, reverse fragility index (RFI) can be used for nonsignificant results to evaluate whether one can confidently conclude that there is no difference between groups. The analysis of FI and RFI in proximal humerus fracture (PHF) management is of particular interest, given ongoing controversy regarding optimal management and patient selection. The aim of this study was to report the FI, RFI and quality of the evidence in the proximal humerus fracture literature. METHODS: A systematic review was conducted based on the PRISMA (preferred reporting items for systematic reviews and meta-analyses) guidelines, which utilized EMBASE, MEDLINE and Cochrane Library databases. Inclusion criteria included randomized controlled clinical trials related to the management of proximal humerus fractures, published from 2000 to 2020 with dichotomous outcome measures and 1:1 allocation. The FI and RFI were calculated by successively changing one nonevent to an event for each outcome measure until the result was made nonsignificant or significant, respectively. The fragility quotient, (FQ), calculated by dividing the FI by the total sample size, was calculated as well. RESULTS: There were 25 studies that met our criteria with 48 outcome measures recorded. A total of 21 studies had at least one fragile result, with ten studies including a fragile result in the conclusion of the abstract. A total of 31 outcome measures had nonsignificant results and the median RFI was found to be 4, with 71% greater than number of patients lost to follow up. Seventeen outcomes had significant results, with a median FI of 1, with 65% greater than or equal to the number patients lost to follow up. A total of 18 of 25 studies (72%) included a power analysis. In particular, ten studies reported a statistical analysis of complication rates, 90% of which were fragile. The median FQ was found to be 0.037. CONCLUSIONS: The literature on PHF management is frequently fragile. Outcome measures are often fragile, particularly with regards to comparing complication rates and reoperation rates in treatment arms. Comparing to the studies in other subspecialties PHF RCTs are relatively more fragile and underpowered. Standardized reporting of FI, FQ and RFI can help the reader to reliably draw conclusions based on the fragility of outcome measures.
BACKGROUND: The quality of evidence of the orthopedic literature has been often called into question. The fragility index (FI) has emerged as a means to evaluate the robustness of a significant result. Similarly, reverse fragility index (RFI) can be used for nonsignificant results to evaluate whether one can confidently conclude that there is no difference between groups. The analysis of FI and RFI in proximal humerus fracture (PHF) management is of particular interest, given ongoing controversy regarding optimal management and patient selection. The aim of this study was to report the FI, RFI and quality of the evidence in the proximal humerus fracture literature. METHODS: A systematic review was conducted based on the PRISMA (preferred reporting items for systematic reviews and meta-analyses) guidelines, which utilized EMBASE, MEDLINE and Cochrane Library databases. Inclusion criteria included randomized controlled clinical trials related to the management of proximal humerus fractures, published from 2000 to 2020 with dichotomous outcome measures and 1:1 allocation. The FI and RFI were calculated by successively changing one nonevent to an event for each outcome measure until the result was made nonsignificant or significant, respectively. The fragility quotient, (FQ), calculated by dividing the FI by the total sample size, was calculated as well. RESULTS: There were 25 studies that met our criteria with 48 outcome measures recorded. A total of 21 studies had at least one fragile result, with ten studies including a fragile result in the conclusion of the abstract. A total of 31 outcome measures had nonsignificant results and the median RFI was found to be 4, with 71% greater than number of patients lost to follow up. Seventeen outcomes had significant results, with a median FI of 1, with 65% greater than or equal to the number patients lost to follow up. A total of 18 of 25 studies (72%) included a power analysis. In particular, ten studies reported a statistical analysis of complication rates, 90% of which were fragile. The median FQ was found to be 0.037. CONCLUSIONS: The literature on PHF management is frequently fragile. Outcome measures are often fragile, particularly with regards to comparing complication rates and reoperation rates in treatment arms. Comparing to the studies in other subspecialties PHF RCTs are relatively more fragile and underpowered. Standardized reporting of FI, FQ and RFI can help the reader to reliably draw conclusions based on the fragility of outcome measures.
Authors: Joseph J Ruzbarsky; Ryan C Rauck; Joseph Manzi; Sariah Khormaee; Bridget Jivanelli; Russell F Warren Journal: J Shoulder Elbow Surg Date: 2019-08-14 Impact factor: 3.019
Authors: Michael Walsh; Sadeesh K Srinathan; Daniel F McAuley; Marko Mrkobrada; Oren Levine; Christine Ribic; Amber O Molnar; Neil D Dattani; Andrew Burke; Gordon Guyatt; Lehana Thabane; Stephen D Walter; Janice Pogue; P J Devereaux Journal: J Clin Epidemiol Date: 2014-02-05 Impact factor: 6.437
Authors: Reinier B Beks; Yassine Ochen; Herman Frima; Diederik P J Smeeing; Olivier van der Meijden; Tim K Timmers; Detlef van der Velde; Mark van Heijl; Luke P H Leenen; Rolf H H Groenwold; R Marijn Houwert Journal: J Shoulder Elbow Surg Date: 2018-05-04 Impact factor: 3.019
Authors: Sarah B Floyd; Joel Campbell; Cole G Chapman; Charles A Thigpen; Michael J Kissenberth; John M Brooks Journal: J Orthop Surg Res Date: 2019-01-21 Impact factor: 2.359
Authors: Nathan P Fackler; Cooper B Ehlers; Kylie T Callan; Arya Amirhekmat; Eric J Smith; Robert L Parisien; Dean Wang Journal: Orthop J Sports Med Date: 2022-05-10
Authors: Nathan P Fackler; Theofilos Karasavvidis; Cooper B Ehlers; Kylie T Callan; Wilson C Lai; Robert L Parisien; Dean Wang Journal: Foot Ankle Int Date: 2022-08-24 Impact factor: 3.569