Ash Bullement1, Nicholas R Latimer2, Helen Bell Gorrod2. 1. BresMed Health Solutions, Sheffield, UK; Delta Hat, Nottingham, UK. Electronic address: abullement@gmail.com. 2. School of Health and Related Research, University of Sheffield, Sheffield, UK.
Abstract
BACKGROUND: Immune-checkpoint inhibitors may provide long-term survival benefits via a cured proportion, yet data are usually insufficient to prove this upon submission to health technology assessment bodies. OBJECTIVE: We revisited the National Institute for Health and Care Excellence assessment of ipilimumab in melanoma (TA319). We used updated data from the pivotal trial to assess the accuracy of the extrapolation methods used and compared these to previously unused techniques to establish whether an alternative extrapolation may have provided more accurate survival projections. METHODS: We compared projections from the piecewise survival model used in TA319 and those produced by alternative models (fit to trial data with minimum follow-up of 3 years) to a longer-term data cut (5-year follow-up). We also compared projections to external data to help assess validity. Alternative approaches considered were parametric, spline-based, mixture, and mixture-cure models. RESULTS: Only the survival model used in TA319 and a mixture-cure model provided 5-year survival predictions close to those observed in the 5-year follow-up data set. Standard parametric, spline, and non-curative-mixture models substantially underestimated 5-year survival. Survival estimates from the TA319 model and the mixture-cure model diverge considerably after 5 years and remain unvalidated. CONCLUSIONS: In our case study, only models that incorporated an element of external information (through a cure fraction combined with background mortality rates or using registry data) provided accurate estimates of 5-year survival. Flexible models that were able to capture the complex hazard functions observed during the trial, but which did not incorporate external information, extrapolated poorly.
BACKGROUND: Immune-checkpoint inhibitors may provide long-term survival benefits via a cured proportion, yet data are usually insufficient to prove this upon submission to health technology assessment bodies. OBJECTIVE: We revisited the National Institute for Health and Care Excellence assessment of ipilimumab in melanoma (TA319). We used updated data from the pivotal trial to assess the accuracy of the extrapolation methods used and compared these to previously unused techniques to establish whether an alternative extrapolation may have provided more accurate survival projections. METHODS: We compared projections from the piecewise survival model used in TA319 and those produced by alternative models (fit to trial data with minimum follow-up of 3 years) to a longer-term data cut (5-year follow-up). We also compared projections to external data to help assess validity. Alternative approaches considered were parametric, spline-based, mixture, and mixture-cure models. RESULTS: Only the survival model used in TA319 and a mixture-cure model provided 5-year survival predictions close to those observed in the 5-year follow-up data set. Standard parametric, spline, and non-curative-mixture models substantially underestimated 5-year survival. Survival estimates from the TA319 model and the mixture-cure model diverge considerably after 5 years and remain unvalidated. CONCLUSIONS: In our case study, only models that incorporated an element of external information (through a cure fraction combined with background mortality rates or using registry data) provided accurate estimates of 5-year survival. Flexible models that were able to capture the complex hazard functions observed during the trial, but which did not incorporate external information, extrapolated poorly.
Authors: Casey Quinn; Louis P Garrison; Anja K Pownell; Michael B Atkins; Gérard de Pouvourville; Kevin Harrington; Paolo Antonio Ascierto; Phil McEwan; Samuel Wagner; John Borrill; Elise Wu Journal: J Immunother Cancer Date: 2020-07 Impact factor: 13.751
Authors: Mario J N M Ouwens; Pralay Mukhopadhyay; Yiduo Zhang; Min Huang; Nicholas Latimer; Andrew Briggs Journal: Pharmacoeconomics Date: 2019-09 Impact factor: 4.981
Authors: Will Dunlop; Marjolijn van Keep; Peter Elroy; Ignacio Diaz Perez; Mario J N M Ouwens; Tina Sarbajna; Yiduo Zhang; Alastair Greystoke Journal: Pharmacoecon Open Date: 2021-09-16
Authors: Ash Bullement; Anna Willis; Amerah Amin; Michael Schlichting; Anthony James Hatswell; Murtuza Bharmal Journal: BMC Med Res Methodol Date: 2020-05-06 Impact factor: 4.615