Alexandra Desnoyers1, Brooke E Wilson2, Michelle B Nadler1, Eitan Amir3. 1. Division of Medical Oncology & Hematology, Department of Medicine, Princess Margaret Cancer Centre and the University of Toronto, 610 University Avenue, Toronto, Ontario M5G 2M9, Canada. 2. Division of Medical Oncology & Hematology, Department of Medicine, Princess Margaret Cancer Centre and the University of Toronto, 610 University Avenue, Toronto, Ontario M5G 2M9, Canada; University of New South Wales, Sydney, NSW 2052, Australia. 3. Division of Medical Oncology & Hematology, Department of Medicine, Princess Margaret Cancer Centre and the University of Toronto, 610 University Avenue, Toronto, Ontario M5G 2M9, Canada. Electronic address: eitan.amir@uhn.ca.
Abstract
BACKGROUND: The Fragility Indexquantifies the reliability of positive trials by estimating the number of events, which would change statistically significant results to non-significant results. METHODS: We identified randomized trials supporting drug approvals by the US FDA between 2009 and 2019 in lung, breast, prostate, and colon cancers and in melanoma. We reconstructed survival tablesand calculated the number of events, which would result in a non-significant result for the primary endpoint. The FI was then compared to the number of patients in each trial who withdrew consent or were lost to follow-up. Regression analyses were used to explore associations between RCT characteristics and FI and trials in which FI was lower or equal to number of participants who withdrew consent or were lost to follow-up. RESULTS: Among 81 RCTs, the median FI was 28. The median number of patients who withdrew consent or were lost to follow up was 27. FI was equal or lower than the number of patients who withdrew consent or were lost to follow-up in 47 trials (58%). There was a modest increase in FI over time (p = 0.02). Trials with overall survival as the primary endpoint (p = 0.006) and those in the palliative setting (p < 0.001) had lower FI. There was no association with trial sample size or duration of follow-up. FINDINGS: Statistical significance of RCTs in common solid tumours can be reversed often with a small number of additional events. Post-approval RCTs or real-world data analyses should be performed to ensure results of registration trials are robust.
BACKGROUND: The Fragility Indexquantifies the reliability of positive trials by estimating the number of events, which would change statistically significant results to non-significant results. METHODS: We identified randomized trials supporting drug approvals by the US FDA between 2009 and 2019 in lung, breast, prostate, and colon cancers and in melanoma. We reconstructed survival tablesand calculated the number of events, which would result in a non-significant result for the primary endpoint. The FI was then compared to the number of patients in each trial who withdrew consent or were lost to follow-up. Regression analyses were used to explore associations between RCT characteristics and FI and trials in which FI was lower or equal to number of participants who withdrew consent or were lost to follow-up. RESULTS: Among 81 RCTs, the median FI was 28. The median number of patients who withdrew consent or were lost to follow up was 27. FI was equal or lower than the number of patients who withdrew consent or were lost to follow-up in 47 trials (58%). There was a modest increase in FI over time (p = 0.02). Trials with overall survival as the primary endpoint (p = 0.006) and those in the palliative setting (p < 0.001) had lower FI. There was no association with trial sample size or duration of follow-up. FINDINGS: Statistical significance of RCTs in common solid tumours can be reversed often with a small number of additional events. Post-approval RCTs or real-world data analyses should be performed to ensure results of registration trials are robust.
Authors: Benjamin R Baer; Mario Gaudino; Mary Charlson; Stephen E Fremes; Martin T Wells Journal: Proc Natl Acad Sci U S A Date: 2021-12-07 Impact factor: 12.779