Joseph C Del Paggio1, Ian F Tannock2. 1. Department of Medical Oncology, Thunder Bay Regional Health Sciences Centre and Northern Ontario School of Medicine, Thunder Bay, ON, Canada. 2. Division of Medical Oncology, Princess Margaret Cancer Centre and University of Toronto, Toronto, ON, Canada. Electronic address: ian.tannock@uhn.ca.
Abstract
BACKGROUND: The fragility index of trial results-ie, the minimum number of changes from non-events to events resulting in loss of statistical significance-can provide a measure of confidence that a positive effect reported in a randomised controlled trial is real. We aimed to calculate the fragility index of randomised controlled trials supporting US Food and Drug Administration (FDA)-approved anticancer drugs. METHODS: This is a retrospective analysis of phase 3, randomised, controlled trials supporting anticancer drugs that were approved by the FDA between Jan 1, 2014, and Dec 31, 2018. Two-arm studies with 1:1 randomisation and significant positive results for a time-to-event outcome were eligible for the fragility index calculation, which involves the iterative addition of an event to the experimental group (defined as the group with the smaller number of events in positive trials) and concomitant subtraction of a non-event from that group, until positive significance (defined as p<0·05 by Fisher's exact test) is lost. FINDINGS: We identified 36 phase 3 randomised controlled trials, of which 17 (47%) were included in the fragility index analysis. The median fragility index was 2 (IQR 0-27). The fragility index was 2 or less in nine (53%) of 17 trials; for these trials, the fragility index was 1% or less of the total sample size. In five (29%) of 17 trials, the number lost to follow-up was more than the fragility index. INTERPRETATION: Many phase 3 randomised controlled trials supporting FDA-approved anticancer drugs have a low fragility index, challenging confidence for concluding their superiority over control treatments. Although not a measure of effect, the fragility index might provide an additional means of assessing the robustness of clinical trial data. FUNDING: None.
BACKGROUND: The fragility index of trial results-ie, the minimum number of changes from non-events to events resulting in loss of statistical significance-can provide a measure of confidence that a positive effect reported in a randomised controlled trial is real. We aimed to calculate the fragility index of randomised controlled trials supporting US Food and Drug Administration (FDA)-approved anticancer drugs. METHODS: This is a retrospective analysis of phase 3, randomised, controlled trials supporting anticancer drugs that were approved by the FDA between Jan 1, 2014, and Dec 31, 2018. Two-arm studies with 1:1 randomisation and significant positive results for a time-to-event outcome were eligible for the fragility index calculation, which involves the iterative addition of an event to the experimental group (defined as the group with the smaller number of events in positive trials) and concomitant subtraction of a non-event from that group, until positive significance (defined as p<0·05 by Fisher's exact test) is lost. FINDINGS: We identified 36 phase 3 randomised controlled trials, of which 17 (47%) were included in the fragility index analysis. The median fragility index was 2 (IQR 0-27). The fragility index was 2 or less in nine (53%) of 17 trials; for these trials, the fragility index was 1% or less of the total sample size. In five (29%) of 17 trials, the number lost to follow-up was more than the fragility index. INTERPRETATION: Many phase 3 randomised controlled trials supporting FDA-approved anticancer drugs have a low fragility index, challenging confidence for concluding their superiority over control treatments. Although not a measure of effect, the fragility index might provide an additional means of assessing the robustness of clinical trial data. FUNDING: None.
Authors: F Giugliano; J Uliano; V A A Zia; D Trapani; A Marra; G Viale; E Ferraro; A Esposito; C Criscitiello; P D'amico; G Curigliano Journal: Breast Cancer Res Treat Date: 2021-05-27 Impact factor: 4.872
Authors: Muhammad Shahzeb Khan; Rohan Kumar Ochani; Asim Shaikh; Muhammad Shariq Usman; Naser Yamani; Safi U Khan; M Hassan Murad; John Mandrola; Rami Doukky; Richard A Krasuski Journal: Circ Cardiovasc Qual Outcomes Date: 2019-12-11