Effects of Trial Population Selection on Quality of Life and Healthcare Decision-Making: A Systematic Review and Example in the Treatment of Hepatocellular Carcinoma with Radioembolization.

BACKGROUND AND AIMS: Quality of life is among the most important considerations in the treatment of hepatocellular carcinoma (HCC), arguably second only to overall survival. Measuring and modeling patient quality of life is also crucial in the evaluation of the cost-effectiveness of health interventions. In the present study, we aimed to identify cost-utility analyses comparing selective internal radiation therapy (SIRT) with systemic therapy in patients with unresectable HCC and to compare the modeled incremental quality of life differences between the two therapies.
METHODS: A systematic literature review was conducted. PubMed, EMBASE, the Cochrane Library, and health technology assessment agency websites were searched to identify cost-utility studies of SIRT versus systemic therapies in the treatment of HCC. Key characteristics of the studies, modeled populations and incremental quality of life outcomes were extracted from the included studies.
RESULTS: The systematic literature review retrieved 1140 studies, of which four were ultimately included. Hand searches then identified two distinct analyses, and an updated version of one of the four studies identified initially. From these seven studies, 18 analyses were included. Analyses using data from the overall trial populations reported incremental quality-of-life estimates spanning -0.09 to +0.28 quality-adjusted life years (QALYs), with that range expanding to -0.09 to +0.60 QALYs when also considering post hoc sub-group analyses.
CONCLUSION: The wide range of incremental QALYs, with substantial differences between overall trial populations and subgroups, illustrates the impact that the choice of target population may have on the relative quality of life outcomes of the compared interventions, which may in turn affect clinical decision-making. The small differences also highlight both the importance of reporting measures of dispersion around the findings, and the limitations of the incremental cost-effectiveness ratio (ICER) for assessing the relative cost-effectiveness of interventions that are predicted to result in similar quality-of-life outcomes.

Background and Aims

Quality of life is among the most important considerations in palliative care settings where the prospect of a cure is uncertain, arguably second to overall survival.1 Accurately measuring and modeling health-related quality of life (HRQoL) is therefore crucial for healthcare decision-making.

The HRQoL outcomes of treatments are often compared and valued using quality-adjusted life years (QALYs), an outcome combining measures of both the length and quality of life. When small differences in overall survival exist between two treatment options, the instruments used to value quality of life, the selection of underlying trial population (and associated survival analysis), and the choice of modeling technique can drastically affect the outcome and interpretation of health economic analyses. This is particularly apparent when considering the incremental cost-effectiveness ratio (ICER) as the key outcome measure, where changes in the directionality of the QALY outcomes may determine whether an intervention is, for example, more costly and more effective (and therefore potentially also cost-effective) or more costly and less effective (ie, dominated).2

Unresectable hepatocellular carcinoma (HCC) is a condition associated with a poor survival prognosis, and advances in therapy able to prolong the life expectancy of patients have been notably difficult to achieve in HCC.3 The challenges arising from the comparison of technologies between which no significant overall survival difference has been established have recently been illustrated in two health technology assessments (HTA) in unresectable HCC from the National Institute for Health and Care Excellence (NICE) and the French Haute Autorité de Santé (HAS). NICE recently conducted a multiple technology appraisal (MTA) that included an evaluation of the cost-utility of selective internal radiation therapy (SIRT) versus sorafenib in the treatment of patients with unresectable HCC.4 The cost-utility analysis showed that SIRT would result in a reduction of 0.076 QALYs versus sorafenib, contradicting a 2018 analysis by HAS, which concluded that SIRT using SIR-Spheres Y-90 resin microspheres was associated with an improvement of 0.023 QALYs versus sorafenib based on models using data from the same two Phase III randomized controlled trials (RCTs).5–7 This raises questions about the influence of the selection of clinical data, survival modeling techniques, and quality of life modeling on healthcare decision-making.

In the present study, we aimed to identify cost-utility analyses comparing SIRT using SIR-Spheres Y-90 resin microspheres versus systemic therapy in patients with unresectable HCC and to compare the modeled incremental QALY outcomes between the two therapies. The comparison of SIRT and systemic therapies for unresectable HCC was selected because a recent systematic literature review (SLR) and network meta-analysis confirmed that only two RCTs have been conducted comparing these interventions (specifically SIR-Spheres Y-90 resin microspheres and sorafenib). This limited availability of RCT data restricts the drivers of differences in modeled QALYs to the selection of the trial population, HRQoL measures, and the modeling approaches employed, rather than different underlying clinical data.8

Methods

An SLR was conducted to identify cost–utility studies of SIRT using SIR-Spheres Y-90 resin microspheres versus systemic therapies in the treatment of unresectable HCC. Search terms were designed using a combination of free-text and Medical Subject Heading (MeSH) terms aligned with those employed by NICE in the SLR conducted as part of the HCC MTA.4,9 PubMed, EMBASE, and the Cochrane Collaboration databases were searched on 3 March 2020 for studies published between 2017 and the search date, with results being collated and de-duplicated using Sourcerer (Covalence Research Ltd, London, UK).10 The database searches were identical to those conducted as part of the SLR registered in PROSPERO under ID CRD42020179826.11 Results from the searches were combined with the economic studies identified during the NICE SLR conducted for the MTA of SIRT in the treatment of HCC, which covered the period from 2000 to January 2019. The overlap between the NICE searches and the new searches conducted for the present study (covering the period 2017 and 2018) allowed the agreement between the search strategies and study retrieval to be validated, with the new search then also extending the coverage of the NICE search by 14 months. Hand searches of prominent HTA agency websites were also conducted, covering NICE in the UK, HAS in France, Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen (IQWiG) in Germany, Agenzia Italiana del Farmaco (AIFA) in Italy, Agencia Española de Medicamentos y Productos Sanitarios (AEMPS) in Spain, Medical Services Advisory Committee (MSAC) in Australia, and Canadian Agency for Drugs and Technologies in Health (CADTH).

The titles and abstracts of the unique studies retrieved from the searches were screened by two independent reviewers against a pre-specified set of inclusion/exclusion criteria. Full-text versions of the remaining included studies were retrieved and screened against the same inclusion/exclusion criteria to determine the final inclusion status. Any discrepancies between reviewers were resolved by discussion. Incremental QALY outcomes were extracted from the included studies, and the magnitudes of incremental QALYs were ranked in descending order to illustrate the range and distribution of values.

Results

The SLR retrieved 1140 studies across PubMed, EMBASE, and Cochrane Collaboration databases, of which 84 were duplicates, leaving 1056 studies for screening. After title and abstract screening, 15 studies were left that potentially met the inclusion criteria, with further full-text screening leaving four studies included.12–15 Two of the studies retrieved as congress abstracts were also published as a full manuscript after the search dates.16,17 In one of the manuscripts, by Marqueen et al, results differed substantially from those presented in the abstract and outcomes from both studies were therefore ultimately extracted to facilitate a comparison of the results.16 The additional two cost-utility analyses from NICE and HAS were identified through hand searches, giving a total of seven studies evaluating the cost-utility of SIR-Spheres Y-90 resin microspheres versus sorafenib in the treatment of HCC (Figure 1). Six of the seven included studies used clinical data obtained exclusively from the SARAH and SIRveNIB RCTs comparing SIR-Spheres Y-90 resin microspheres with sorafenib.6,7 The only study not based on SARAH or SIRveNIB assumed equal efficacy of sorafenib and SIR-Spheres Y-90 resin microspheres and modeled a QALY difference based on the incidence of adverse events from the SHARP trial of sorafenib and the ENRY study of SIR-Spheres Y-90 resin microspheres.14,18,19 Eighteen analyses from the seven studies were ultimately included for presentation in the present study, of which 14 were based on the overall trial populations, one assumed equal efficacy, and three were of subgroups of either patients with low tumor burden (LTB) and albumin-bilirubin (ALBI) grade 1, or patients receiving a tumor absorbed radiation dose of ≥100 Gy (referred to as an “optimized dosimetry” subgroup).

Figure 1

Systematic literature review flow diagram for the identification of cost–utility studies of selective internal radiation therapy versus systemic therapy in patients with hepatocellular carcinoma.

Across the 14 analyses of the overall trial populations, the incremental quality of life estimates ranged from −0.09 to +0.28 QALYs (equivalent to spending between 4.7 fewer weeks and 14.6 more weeks in full health), with the negative end of the range favoring sorafenib over SIR-Spheres Y-90 resin microspheres, and the positive end favoring SIR-Spheres Y-90 resin microspheres over sorafenib (Figure 2). Notably, the 2019 Parikh et al study reported analyses at both ends of the range, with the −0.09 QALY difference driven by data from the SARAH intention-to-treat (ITT) population, and the +0.28 QALY difference driven by data from the SIRveNIB per protocol (PP) populations.12 The single analysis assuming equal efficacy reported a QALY difference of 0.0079 QALYs in favor of SIR-Spheres Y-90 resin microspheres, as it accounted for the favorable adverse event profile of SIR-Spheres Y-90 resin microspheres compared with sorafenib.

Figure 2

Incremental quality-adjusted life years gained with SIR-Spheres Y-90 resin microspheres versus sorafenib in the treatment of patients with hepatocellular carcinoma.

When including the three subgroup analyses, the upper end of the range (favoring SIR-Spheres Y-90 resin microspheres) increased to +0.601 QALYs in a subgroup analysis in patients with LTB ALBI grade 1.20 Only seven of the eighteen analyses reported confidence intervals around the ICER.13,14,16

Discussion

The SLR identified seven studies evaluating the cost-utility of SIR-Spheres Y-90 resin microspheres versus sorafenib in the treatment of unresectable HCC, six of which were based on data from SARAH and SIRveNIB RCTs. Across the 15 analyses included in the present synthesis not based on specific subgroups, incremental QALYs ranged from −0.09 to +0.28 with SIR-Spheres Y-90 resin microspheres versus sorafenib. Both bounds of the range arose from different analyses in the same modeling study, with the difference between the two extremes being driven exclusively by the choice of the trial analysis population. When including analyses based on either LTB/ALBI grade 1 or optimized dosimetry sub-groups, the range widened on the positive end to +0.601 QALYs in favor of SIR-Spheres Y-90 resin microspheres versus sorafenib. A key strength of the present study was the systematic identification of incremental QALY outcomes across seven studies comparing SIR-Spheres Y-90 resin microspheres with sorafenib, interventions for which head-to-head data were only available from two RCTs. This limited the available data on which health economic comparisons could be based, and thereby focused on differences beyond trial selection; however, this could also be considered a weakness of the study in that the scope of the review was relatively narrow given the recent growth of the HCC armamentarium to include lenvatinib and atezolizumab-bevacizumab.

The recent NICE appraisal of SIR-Spheres Y-90 resin microspheres versus sorafenib reported a reduction of 0.076 QALYs with SIR-Spheres Y-90 resin microspheres relative to sorafenib, ranking as the 13th least favorable of the 14 analyses based on the overall trial populations (ie, not sub-groups). In the discussion of previous health economic evidence comparing SIRT with sorafenib, the NICE appraisal report noted that “results may be very sensitive to different assumptions around survival or HRQoL”. Given that this sensitivity was known ahead of time, the efforts to characterize uncertainty around the analysis conducted by the Assessment Group on behalf of NICE were not extensive, likely falling short of health economic reporting guidelines codified in the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) checklist (specifically item 20b on the characterization of uncertainty).21 No confidence or credible intervals were reported around any of the base case or scenario analyses conducted by NICE, and scatterplots from probabilistic sensitivity analyses were not presented, thereby frustrating efforts to understand the modeled distributions of incremental QALY outcomes. Regarding the overall assessment of cost-effectiveness, the final appraisal determination noted that the NICE committee “took this uncertainty into consideration in its decision-making”, but based on the minimal extent to which measures of uncertainty were presented, the committee must either have been restricted to a qualitative rather than quantitative assessment of the uncertainty or had access to uncertainty measures that are not in the public domain.22

Further to these methodological and reporting considerations, the present review highlights that the comparison of interventions with distinct modalities (a molecular-targeted agent versus a locoregional transarterial intervention) can have additional implications for economic modeling. In this instance, high proportions of patients in the ITT populations of the SARAH and SIRveNIB trials did not ultimately go on to receive SIRT (22.4% and 28.6% respectively), much higher than the proportions not ultimately receiving sorafenib (2.8% and 9.0% respectively). In most cases, this was because patients enrolled into and randomized within these trials were ultimately deemed ineligible for SIRT after an initial work-up phase performed after randomization. Patient selection for these trials may therefore not reflect the current clinical practice of SIRT, in which approximately 10% of patients are considered ineligible after their work-up.23 In this context, economic models including per protocol analyses (in which all patients received their allocated treatment) or post hoc subgroup analyses focused on patients most likely to receive and benefit from the intervention are most appropriate to ensure the external validity of their outcomes. This aspect of patient selection is particularly pertinent for the present example comparing SIR-Spheres Y-90 resin microspheres versus sorafenib, as all the models resulting in a negative QALY outcome were based at least in part on unselected populations, such as the full ITT population of the SARAH and/or SIRveNIB trials. Analyses conducted exclusively in PP or subgroup analyses resulted in QALY gains for SIR-Spheres Y-90 resin microspheres. Methodological approaches and selection of specific trial populations and utility values may legitimately differ between different healthcare systems (or even different treatment centers within the same system), but should always be justified, and ideally validated with local clinical input.

Further to considerations around the ITT and PP populations, patients randomly assigned to the SIR-Spheres Y-90 resin microsphere arm who went on to receive the treatment, waited a median time of 21 and 29 days after randomization before receiving treatment, compared with a median time of 3 and 7 days to receive sorafenib in SIRveNIB and SARAH, respectively.24 Importantly for the present analysis, these treatment initiation delays of approximately three weeks were not captured or adjusted for in either the ITT or PP analyses of the trials. Given the NICE finding of a difference of 3.76 quality-adjusted weeks of life between the two treatments, for example, a 3-week delay in initiation of one treatment should not be discounted when interpreting the findings. This consideration is particularly important because clinical practice of SIRT with SIR-Spheres Y-90 resin microspheres has recently been evolving to allow patients to be treated during the same hospital admission as their work-up, whether in an inpatient or outpatient setting.25

The wide range of incremental quality of life estimates spanning parity raises further considerations on the reporting of health economic analyses. The present study found that only two of the included studies (detailing seven of the included analyses) reported confidence intervals around the ICERs. Given the underlying clinical data and the precedent for directionally opposite findings from the same clinical trials illustrated by Parikh et al in 2018, the importance of characterizing uncertainty around the findings cannot be overstated. Given the diverse array of drivers of QALY outcomes, all possible sources of uncertainty should be explored, including population-level heterogeneity, first-order uncertainty, second-order parameter uncertainty, and structural uncertainty in the model.26

In conclusion, there are numerous factors that can contribute to differences in modeled incremental QALY outcomes. Across the studies included in the present analysis, incremental QALY outcomes ranged from −0.09 to +0.28 QALYs in analyses based on the ITT or PP populations. Analyses based on patient subgroups yielded substantially higher QALY outcomes for SIR-Spheres Y-90 resin microspheres compared to sorafenib, ranging from +0.117 to +0.601 QALYs. These outcomes demonstrate that appropriate patient selection can translate into meaningful improvements in the quality-adjusted life expectancy of patients with unresectable HCC in real-world clinical practice. In addition, the wide variations in QALY outcomes underline the importance of analyzing and presenting all of the factors driving QALY differences in line with best practice guidelines on the reporting of economic evaluations, such as those outlined in the CHEERS statement and checklist, especially in analyses in which the QALY difference is close to zero.