Robert L Parisien1, Michael Constant2, Bryan M Saltzman3, Charles A Popkin2, Christopher S Ahmad2, Xinning Li4, David P Trofa2. 1. Department of Orthopaedics, Harvard Medical School & Boston Children's Hospital, Boston, MA, USA. 2. Department of Orthopaedics, Columbia University Irving Medical Center, New York, NY, USA. 3. Ortho Carolina, Sports Medicine, Knee & Shoulder/Elbow, Charlotte, NC, USA. 4. Department of Orthopaedics, Boston University Medical Center, Boston, MA, USA.
Abstract
OBJECTIVE: The purpose of this study was to utilize fragility analysis to assess the robustness of randomized controlled trials (RCTs) evaluating the management of articular cartilage defects of the knee. We hypothesize that the cartilage restorative literature will be fragile with the reversal of only a few outcome events required to change statistical significance. DESIGN: RCTs from 11 orthopedic journals indexed on PubMed from 2000 to 2020 reporting dichotomous outcome measures relating to the management of articular cartilage defects of the knee were included. The Fragility Index (FI) for each outcome was calculated through the iterative reversal of a single outcome event until significance was reversed. The Fragility Quotient (FQ) was calculated by dividing each FI by study sample size. Additional statistical analysis was performed to provide median FI and FQ across subgroups. RESULTS: Nineteen RCTs containing 60 dichotomous outcomes were included for analysis. The FI and FQ of all outcomes was 4 (IQR 2-7) and 0.067 (IQR 0.034-0.096), respectively. The average number of patients lost to follow-up (LTF) was 3.9 patients with 15.8% of the included studies reporting LTF greater than or equal to 4, the FI of all included outcomes. CONCLUSIONS: The orthopedic literature evaluating articular cartilage defects of the knee is fragile as the reversal of relatively few outcome events may alter the significance of statistical findings. We therefore recommend comprehensive fragility analysis and triple reporting of the P value, FI, and FQ to aid in the interpretation and contextualization of clinical findings reported in the cartilage restoration literature.
OBJECTIVE: The purpose of this study was to utilize fragility analysis to assess the robustness of randomized controlled trials (RCTs) evaluating the management of articular cartilage defects of the knee. We hypothesize that the cartilage restorative literature will be fragile with the reversal of only a few outcome events required to change statistical significance. DESIGN: RCTs from 11 orthopedic journals indexed on PubMed from 2000 to 2020 reporting dichotomous outcome measures relating to the management of articular cartilage defects of the knee were included. The Fragility Index (FI) for each outcome was calculated through the iterative reversal of a single outcome event until significance was reversed. The Fragility Quotient (FQ) was calculated by dividing each FI by study sample size. Additional statistical analysis was performed to provide median FI and FQ across subgroups. RESULTS: Nineteen RCTs containing 60 dichotomous outcomes were included for analysis. The FI and FQ of all outcomes was 4 (IQR 2-7) and 0.067 (IQR 0.034-0.096), respectively. The average number of patients lost to follow-up (LTF) was 3.9 patients with 15.8% of the included studies reporting LTF greater than or equal to 4, the FI of all included outcomes. CONCLUSIONS: The orthopedic literature evaluating articular cartilage defects of the knee is fragile as the reversal of relatively few outcome events may alter the significance of statistical findings. We therefore recommend comprehensive fragility analysis and triple reporting of the P value, FI, and FQ to aid in the interpretation and contextualization of clinical findings reported in the cartilage restoration literature.
Authors: Elliott E Ridgeon; Paul J Young; Rinaldo Bellomo; Marta Mucchetti; Rosalba Lembo; Giovanni Landoni Journal: Crit Care Med Date: 2016-07 Impact factor: 7.598
Authors: Sariah Khormaee; Judy Choe; Joseph J Ruzbarsky; Kunal N Agarwal; John S Blanco; Shevaun M Doyle; Emily R Dodwell Journal: J Pediatr Orthop Date: 2018-09 Impact factor: 2.324
Authors: Julian P T Higgins; Douglas G Altman; Peter C Gøtzsche; Peter Jüni; David Moher; Andrew D Oxman; Jelena Savovic; Kenneth F Schulz; Laura Weeks; Jonathan A C Sterne Journal: BMJ Date: 2011-10-18
Authors: Nathan P Fackler; Cooper B Ehlers; Kylie T Callan; Arya Amirhekmat; Eric J Smith; Robert L Parisien; Dean Wang Journal: Orthop J Sports Med Date: 2022-05-10
Authors: Robert L Parisien; David P Trofa; Michaela O'Connor; Brock Knapp; Emily J Curry; Paul Tornetta; T Sean Lynch; Xinning Li Journal: JB JS Open Access Date: 2021-10-21
Authors: Nathan P Fackler; Theofilos Karasavvidis; Cooper B Ehlers; Kylie T Callan; Wilson C Lai; Robert L Parisien; Dean Wang Journal: Foot Ankle Int Date: 2022-08-24 Impact factor: 3.569