Is Protocolised Weaning that Includes Early Extubation Onto Non-Invasive Ventilation More Cost Effective Than Protocolised Weaning Without Non-Invasive Ventilation? Findings from the Breathe Study.

BACKGROUND: Optimising techniques to wean patients from invasive mechanical ventilation (IMV) remains a key goal of intensive care practice. The use of non-invasive ventilation (NIV) as a weaning strategy (transitioning patients who are difficult to wean to early NIV) may reduce mortality, ventilator-associated pneumonia and intensive care unit (ICU) length of stay.
OBJECTIVES: Our objectives were to determine the cost effectiveness of protocolised weaning, including early extubation onto NIV, compared with weaning without NIV in a UK National Health Service setting.
METHODS: We conducted an economic evaluation alongside a multicentre randomised controlled trial. Patients were randomised to either protocol-directed weaning from mechanical ventilation or ongoing IMV with daily spontaneous breathing trials. The primary efficacy outcome was time to liberation from ventilation. Bivariate regression of costs and quality-adjusted life-years (QALYs) provided estimates of the incremental cost per QALY and incremental net monetary benefit (INMB) overall and for subgroups [presence/absence of chronic obstructive pulmonary disease (COPD) and operative status]. Long-term cost effectiveness was determined through extrapolation of survival curves using flexible parametric modelling.
RESULTS: NIV was associated with a mean INMB of £620 ($US885) (cost-effectiveness threshold of £20,000 per QALY) with a corresponding probability of 58% that NIV is cost effective. The probability that NIV is cost effective was higher for those with COPD (84%). NIV was cost effective over 5 years, with an estimated incremental cost-effectiveness ratio of £4618 ($US6594 per QALY gained).
CONCLUSIONS: The probability of NIV being cost effective relative to weaning without NIV ranged between 57 and 59% overall and between 82 and 87% for the COPD subgroup.

RCT Entities:   Population Interventions Outcomes

Key Points for Decision Makers

Introduction

Optimising techniques to wean patients from invasive mechanical ventilation (IMV) remains a key goal of intensive care practice [1, 2]. To date, no definitive guidelines exist on the best approach to use in the intensive care unit (ICU) [2]. Evidence from structured and systematic and literature reviews of studies, including randomised controlled trials (RCTs) suggests that the use of non-invasive ventilation (NIV) as a weaning strategy (transitioning patients who are difficult to wean to early NIV) may reduce mortality, ventilator-associated pneumonia and ICU length of stay, although this beneficial effect may be limited to patients with chronic obstructive pulmonary disease (COPD) [3, 4, 8].

In light of current clinical practices [2], the findings of existing trials are of limited generalizability to clinical settings across a number of industrialised countries as treatment pathways for COPD exacerbations vary across settings and over time. Whereas patients with respiratory failure would have previously received IMV, in the UK for example, this is now largely reserved for patients who fail a trial of NIV. Furthermore, few published studies have reported the impact of NIV on health-related quality of life (HRQoL) outcomes [3] or economic costs associated with NIV in critical care settings [5, 6]. Where these have been reported, sample sizes are small [6] or focus has solely been on patients with an exacerbation of COPD. Importantly, only one study, conducted in Canada, has estimated the cost effectiveness of NIV as a weaning strategy in patients with COPD [7], whereas, to our knowledge, no study has estimated its cost effectiveness in patients within the ICU presenting with or without COPD.

It is crucial to evaluate the cost effectiveness of NIV before its use can be considered more widely. We therefore present a health economic evaluation from a multicentre RCT comparing protocolised weaning that includes early extubation onto NIV versus weaning without NIV (Breathe study; ISRCTN 15,635,197).

Materials and Methods

Trial Background

Details of the design and clinical outcome measures for the Breathe study are reported elsewhere [8]. Briefly, patients aged ≥ 16 years recruited from 41 UK critical care units were eligible for randomisation if they had received IMV for over 48 h, were ready to wean and had failed a spontaneous breathing trial (SBT). Patients were randomised to receive either protocolised weaning with extubation to NIV (non-invasive weaning) or protocolised weaning via IMV with daily SBTs (invasive weaning). NIV refers to the delivery of mechanical ventilation without the need for an endotracheal airway. Positive pressure ventilation is delivered to the patient through the mouth or nose via an interface such as a mask or helmet.

Clinicians were permitted to use one of three types of SBT in accordance with local unit practices: a T-piece trial, use of continuous positive airway pressure (CPAP) or low-level pressure support (5–7 cm H2O). A T-piece trial involves the patient breathing spontaneously through their endotracheal tube, with the appropriate inspired oxygen concentration being maintained by a cross-flow device (T-piece). CPAP involved leaving a standing pressure of 5–10 cm H2O delivered via the ventilator at the top of the endotracheal tube but with no assistance on inspiration. A low-level pressure support trial provided 5–7 cm H2O inspiratory assistance.

Each SBT was scheduled to last for at least 30 min and could be increased up to 120 min in patients considered to be at higher risk of re-intubation (e.g. prolonged ventilation, past history of COPD, heart failure). During SBTs, patients were closely monitored for the following signs of distress or fatigue: heart rate > 20% of baseline or > 140 beats min−1; systolic blood pressure > 20% of baseline or > 180 mmHg or < 90 mmHg; cardiac arrhythmias; respiratory rate > 50% of baseline value or > 35 min−1, respiratory rate (min)/tidal volume (L) > 105 min−1 L−1; arterial blood gases; clinical assessments such as agitation, anxiety or depression. A patient was considered to pass the SBT if no signs of distress or fatigue developed. A patient who displayed any sign of distress or fatigue was judged to have failed the SBT.

Clinicians were provided with information about the Walsh criteria, which were suggested as guidance to indicate when the patient was ready to commence weaning [9]. The Walsh criteria recommend that meeting all the following conditions indicates readiness for weaning: cooperative and pain free; good cough; PaO2:FiO2 (ratio of arterial oxygen partial pressure to fractional inspired oxygen) > 24 kPa; positive end-expiratory pressure < 10 cm H2O; haemoglobin > 7 g dL−1; axillary temperature 36–38.5 °C; vasoactive drugs reduced or unchanged over previous 24 h; and spontaneous ventilatory frequency > 6 breaths per minute. Heated humidified oxygen (on both invasive ventilation and NIV) was not mandated or recommended in the study protocol but could be used at clinician discretion in accordance with local unit policy.

A sample size of 364 (90% power, two-sided 5% type I error), allowing for a 23% dropout rate, was required to detect a clinically meaningful median difference of 24 h between the non-invasive and invasive group for the primary outcome of time to liberation from ventilation.

Study Perspective and Time Horizon

The primary economic analysis was undertaken from the perspective of the UK National Health Service (NHS) and personal social services (PSS) [10]. The time horizon for the within-trial economic evaluation was limited to a follow-up period of 6 months. In addition, a 5-year time horizon was considered for a long-term cost-effectiveness analysis. A discount rate of 3.5% per annum was applied to both costs and effects during years 2–5 for the longer-term cost-effectiveness analysis [10].

Measurement and Valuation of Resource Use

Resource use data were collected from randomisation to 6 months post-randomisation using case report forms (for initial hospitalisations) and participant questionnaires. The resource and cost components associated with the intervention were aggregated into five groups:

intensive care support, including organ support, level of care and use of sedatives,

tracheostomies,

use of high-cost antivirals and antifungals or other high-cost drugs in the ICU,

hospital care between ICU discharge and hospital discharge,

use of any emergency transport to transfer patients between hospital sites.

For critical care stays, healthcare resource groups (HRGs) were assigned according to the maximum number of organ systems supported daily during each stay. Critical care HRGs value standard resource expenditures (e.g. staffing, consumables, diagnostics), such that high-cost drugs and interventions were separately collected and valued to derive a total overall critical care cost. Following critical care discharge, the costs of step-down care were based on number of days spent in each step-downward/facility (until death or discharge) multiplied by the respective per diem cost for that level of care [11]. Further details of healthcare resource use can be found in Table 1 in the electronic supplementary material (ESM) and include the number of organs supported, the number of days in ICU, highest level of care and details of tracheostomies, antifungal/antiviral use, inpatient and outpatient care, residential care services, community health and social care, frequency of prescription medications, equipment and aids and additional health resource used by patient or carer/supporter.

Table 1

Economic costs for complete cases for entire follow-up period, by trial allocation and cost category (£; year 2015–16 values)

Evaluation period by cost type	Non-invasivea	Invasivea	Mean difference	p value	Bootstrap 95% CI
Randomisation to hospital discharge	n = 182	n = 182
Intensive care supportb	20,509.7 ± 1762.56	22,018.9 ± 1685.17	− 1509.2	0.5515	− 5533.9 to 2586.3
Tracheostomy	980.9 ± 131.08	1254.6 ± 141.7	− 273.7	0.1570	− 584.1 to 57.2
Antivirals/antifungals	455.7 ± 194.91	758.2 ± 219.66	− 302.5	0.3036	− 768.1 to 215.8
Hospital care between ICU and hospital discharge	7694.5 ± 695.69	7967.0 ± 1038.27	− 272.5	0.8275	− 2511.2 to 1682.5
Transfer by ambulance/NHS transport	56.0 ± 7.97	53.1 ± 7.82	2.87	0.7971	− 16.1 to 20.7
Total NHS and PSS costs	29,696.8 ± 2069.8	32,051.8 ± 2204.56	− 2355.0	0.4472	− 7291.5 to 2750.0
Hospital discharge to 3 months post − randomisation	n = 130	n = 131
Health and social care resource use
Hospital inpatient care	686.8 ± 163.83	381.8 ± 123.63	305.0	0.1387	− 30.0 to 642.2
Hospital outpatient care	130.7 ± 25.95	86.7 ± 17.41	− 4.0	0.1602	− 5.2 to 97.3
Residential care	158.6 ± 55.55	43.2 ± 22.64	115.4	0.0560	20.1 to 219.7
Community health and social care	280.7 ± 46.03	301.3 ± 75.31	− 20.6	0.8157	− 171.3 to 114.3
Medications	67.8 ± 21.23	139.5 ± 36.84	− 71.7	0.0935	− 141.4 to − 4.7
Equipment and aids	32.2 ± 8.79	13.9 ± 4.71	18.3	0.0679	2.8 to 35.5
Total NHS and PSS costs	1356.8 ± 196.32	966.4 ± 151.99	390.4	0.0836	− 47.1 to 775.7
Broader societal costs
Additionalc	108.6 ± 33.02	297.7 ± 129.15	− 189.1	0.0926	− 324.6 to − 4.2
Equipment and aids (private and charity)	29.3 ± 10.53	158.3 ± 120.1	− 129	0.2854	− 259.3 to 131.4
Total broader societal costs	137.9 ± 22.47	456.0 ± 93.68	− 318.1	0.0012	− 434.1 to − 158.4
Total societal costs	1104.3 ± 179.61	1812.8 ± 202.29	− 708.5	0.0004	− 1108.2 to − 308.4
3 months post-randomisation to 6 months post-randomisation	n = 129	n = 127
Health and social care resource use
Hospital inpatient care	788.4 ± 203.12	403.0 ± 144.18	385.4	0.1233	− 7.0 to 1101.3
Hospital outpatient care	131.5 ± 20.23	123.0 ± 24.85	28.50	0.7913	− 56.8 to 105.0
Residential care	264.4 ± 140.96	0.0 ± 0.00	264.0	0.0630	57.6 to 515.2
Community health and social care	373.2 ± 102.74	214.5 ± 66.54	158.7	0.1963	− 33.2 to 362.5
Medications	176.2 ± 45.39	206.0 ± 46.65	− 29.8	0.6480	− 135.9 to 78.5
Equipment and aids	30.9 ± 6.30	17.4 ± 5.25	− 13.5	0.1010	− 0.27 to 26.9
Total NHS and PSS costs	1764.6 ± 258.47	963.9 ± 157.71	798.6	0.0031	308.9 to 1294.7
Broader societal costs
Additionalc	171.8 ± 70.17	245.9 ± 110.38	− 74.1	0.3864	− 207.6 to 52.9
Equipment and aids (private and charity)	25.9 ± 9.67	14.7 ± 12.5	11.2	0.4788	− 10.8 to 33.2
Total broader societal costs	197.7 ± 45.3	260.6 ± 66.3	− 62.9	0.4336	− 173.9 to 48.1
Total societal costs	1962.3 ± 265.94	1224.5 ± 178.96	737.8	0.2262	− 432.6 to 1928.3
From randomisation to 6 months post-randomisation	n = 129	n = 127
Initial hospitalisation costs
Intensive care supportb	20,815.7 ± 2,134,027	21,659.9 ± 2059.30	− 844.2	0.7761	− 5699 to 4114
Tracheostomy	922.6 ± 149.01	1129.5 ± 159.01	− 206.9	0.3435	− 570.1 to 151.2
Antivirals/antifungals	448.2 ± 234.98	968.8 ± 288.76	− 520.6	0.1635	− 1131.2 to 89.9
Hospital care between ICU and hospital discharge	6613.3 ± 707.09	6914.7 ± 896.01	− 301.4	0.7921	− 2229 to 1519
Transfer by ambulance/NHS transport	42.6 ± 8.33	46.1 ± 8.57	− 3.5	0.7681	− 23.3 to 16.1
Total NHS and PSS costs	28,842.4 ± 2462.57	30,719.0 ± 2501.67	− 1876.6	0.5934	− 7612 to 3989
Health and social care resource use
Hospital inpatient care	1323.6 ± 294.88	698.2 ± 221.55	625.4	0.0913	28.3 to 1236.9
Hospital outpatient care	240.7 ± 39.10	188.8 ± 34.85	51.9	0.3222	− 33.4 to 139.6
Residential care	405.4 ± 150.44	41.6 ± 21.81	363.8	0.0180	132.7 to 632.6
Community health and social care	613.8 ± 129.40	475.5 ± 124.74	138.3	0.4426	− 153.7 to 424.5
Medications	226.3 ± 59.99	315.8 ± 68.56	− 89.5	0.3268	− 237.9 to 60.7
Equipment and aids	59.1 ± 10.89	28.6 ± 8.45	30.5	0.0276	7.3 to 53.4
Total NHS and PSS costs	2868.9 ± 392.94	1748.5 ± 276.45	1120.4	0.0494	176.5 to 1542.9
Broader societal costs
Additionalb	171.7 ± 67.65	374.6 ± 164.09	− 202.9	0.2542	− 441.1 to − 23.3
Equipment and aids (private and charity)	51.2 ± 24.45	157.0 ± 98.87	− 105.8	0.2498	− 179.3 to 16.0
Total broader societal costs	222.9 ± 97.44	531.6 ± 120.33	− 309.7	0.0142	− 489.5 to 272.6
Total societal costs	3091.8 ± 392.94	2280.1 ± 276.45	811.7	0.3163	− 128.3 to 1371.6
Total NHS/PSS including ICU	31,711.3 ± 2498.47	32,467.5 ± 2550.99	− 756.2	0.8321	− 6642.1 to 5245.7
Total societal including ICU	31,934.2 ± 2498.58	32,999.1 ± 2547.95	− 1064.9	0.7981	− 6804.2 to 5055.9

CI confidence interval, ICU intensive care unit, NHS national health service, PSS Personal and Social Services

aData are presented as mean ± standard error of the mean

bIncludes organ monitoring support, level of care and antibiotics

cIncludes travel, childcare, income lost, housework help and laundry services costs

Differences in resource use between the two intervention groups for the period between randomisation and hospital discharge were determined by (1) comparing the number of days that patients had two or more organs supported while in the ICU (or alternatively, days in level 3 care); (2) comparing differences in overall length of stay in the ICU; and (3) comparing proportions of patients who required tracheostomies, used high-cost antifungals, used high-cost antivirals or needed emergency transport for transfers between hospitals. Patients requiring support for two or more organs and those receiving advanced respiratory support alone were considered to receive level 3 care [12].

Broader health and PSS resource use data (e.g. hospital readmissions, contacts with community health and social care professionals, medication use) were collected at 3 and 6 months post-randomisation using postal questionnaires completed by participants or their primary carers. We also collected data on direct non-medical costs (including travel expenses) incurred by patients and their caregivers, days off work and loss of earnings. Resource use values were converted into costs by applying unit costs obtained from key UK national databases [13-20] (Table 2 in the ESM).

All costs were expressed in £ sterling (year 2015–2016 values). Where appropriate, costs were inflated to year 2015–2016 values using the NHS Hospital and Community Health Services Pay and Prices index [21].

Measurement and Valuation of Health Outcomes

The primary outcome for the economic evaluation was the quality-adjusted life-year (QALY) [10]. HRQoL was assessed using the three-level EuroQol 5-Dimensions (EQ-5D-3L) [22] at 3 and 6 months post-randomisation. The EQ-5D-3L descriptive system consists of five dimensions (mobility, self-care, usual activities, pain/discomfort and anxiety/depression), each divided into three ordinal levels: (1) no problems, (2) some or moderate problems, and (3) severe or extreme problems. The UK time trade-off tariff was applied to each set of responses to generate an EQ-5D-3L utility score for each participant [23]. Given the challenges of collecting baseline data from patients in critical care settings, we assumed in the baseline analysis that the baseline utility value was − 0.402, the value assigned by the EQ-5D-3L tariff to an unconscious health state [24]. QALY values for each patient were calculated as the area under the baseline-adjusted utility curve [25] assuming a fixed baseline of − 0.402 (equivalent to an unconscious health state) and using linear interpolation between baseline and follow-up utility scores. QALYs were also derived from 6-Dimension Short-Form survey (SF-6D) utilities (UK tariff), generated from responses to the SF-12 as a sensitivity analysis [26], assuming a baseline utility value of zero. Patients who survived the initial hospital admission were also asked to recollect their pre-admission health state using both the EQ-5D-3L and the SF-12 questionnaires.

Missing Data

Multiple imputation under chained equations [27] was used for missing resource use or HRQoL data, based on the tested assumption that data were missing at random. Regression models were used to estimate missing costs and QALYs at each time point, by treatment allocation, conditional on fully observed baseline variables: age, sex, randomisation centre, presence/absence of COPD, non-operative/operative status and post-SBT PaCO2. In total, 20 datasets were generated using predictive mean matching. Estimates obtained were pooled to generate mean and variance estimates for costs and QALYs in each allocation group over the trial time horizon using Rubin’s rule [28]. All mean incremental costs take into account heterogeneity in baseline costs, leading to estimates of incremental costs that would have adjusted for costs arising from differences between groups in terms of severity at baseline [8].

Analyses of Resource Use, Costs and Outcome Data

Economic values were summarised by treatment group, resource category and assessment time; differences between groups were analysed using two-sample t tests. Non-parametric bootstrapping, based on 10,000 replications (10,000 was expected to stabilise the confidence intervals [CIs] for point estimates), was used to assess whether differences in mean total costs between allocation groups were statistically significant. EQ-5D-3L utility scores were compared using two-sample t tests.

Cost-Effectiveness Analysis

A cost-effectiveness analysis using individual patient-level data was conducted. Cost-effectiveness results were expressed in terms of an incremental cost-effectiveness ratio (ICER) and calculated by dividing the difference between trial arms in mean total costs by the difference in mean total QALYs. Value-for-money assessments involved comparing the ICER value with a range of cost-effectiveness thresholds. Cost-effectiveness thresholds held by UK decision makers typically range between £20,000 and 30,000 per QALY [10].

Several types of uncertainty analyses were undertaken. Stochastic uncertainty was presented in terms of CIs, decision uncertainty was undertaken using various cost-effectiveness thresholds that determined the INMB, and uncertainty from heterogeneity was implicitly assessed through modelling the pre-specified covariates (presence/absence of COPD, operative status, baseline costs, baseline utility) considered to be related to cost-effectiveness outcomes. In addition, 10,000 estimates of incremental costs and benefits were generated through non-parametric bootstrapping to determine the level of sampling uncertainty around the ICER. The bootstrap replicates were used to populate cost-effectiveness scatterplots. We also calculated the incremental net monetary benefit (INMB) of using NIV versus IMV across three cost-effectiveness thresholds: £15,000 [29], £20,000 and £30,000 per QALY gained. A positive INMB indicates that the intervention is cost effective compared with the alternative at the given cost-effectiveness threshold. Cost-effectiveness acceptability curves (CEACs) summarised the likelihood that NIV was cost effective as the cost-effectiveness threshold varies.

Sensitivity and subgroup analyses

Sensitivity analyses included (1) adopting a wider societal perspective encompassing direct non-medical costs incurred by trial participants and their families, and economic values placed on attributable work absences being collected in the case report form by asking patients/carers whether items such as travel cost and income lost occurred and how much cost was incurred; (2) restricting analysis to complete cases; (3) using SF-6D utility scores estimated from the SF-12 for the purposes of QALY estimation; and (4) additionally using the pre-randomisation EQ-5D-3L utility value (recalled at hospital discharge) as a covariate for the purpose of QALY adjustments. Pre-specified subgroup analyses were presence/absence of COPD and operative status.

Longer-Term Economic Modelling

Extrapolation of Survival Data

Long-term cost effectiveness was determined over a 5-year time horizon by extrapolating survival beyond 6 months. The 5-year point was arbitrary; but we felt that extrapolating beyond 5 years would have generated too much uncertainty. For a cost-effectiveness analysis conducted over a lifetime horizon, using data from many patients who were censored would potentially lead to highly uncertain survival rates. Observed survival curves (Fig. 1 in the ESM) showed that most deaths occurred between randomisation and hospital discharge; a 5-year time horizon therefore limited the uncertainty of the long-term cost-effectiveness results compared with modelling over a lifetime horizon.

A flexible parametric model was used to predict survival rates at each time point [30]. Flexible parametric models are commonly used in the assessment of the cost effectiveness of cancer drugs for prediction of survival beyond trial follow-up [31]. Three parametric models were considered: exponential, Weibull and a more flexible model using cubic splines with up to four knots (points at which splines are joined). This involved fitting survival curves using the observed survival data by modelling the background (baseline hazard) risk of death over time and the risk of death due to intervention. The choice of model selection was based on Akaike’s information criterion (AIC). The parameter estimates and corresponding standard errors were reported. The observed survival data (time to death) were used along with a censoring variable, and stratified covariates were included in the model.

Extrapolation of Costs and Quality-Adjusted Life-Years (QALYs)

We adopted a conservative approach to estimating (extrapolated) longer-term costs and health utilities beyond 6 months separately for each treatment group. Costs between 6 months and 5 years post-randomisation were estimated by using the observed 3- to 6-month post-randomisation total costs but also adjusting for covariates and multiplying by the predicted survival probabilities over the 5-year post-randomisation period. The trial-based estimates of health utilities (adjusted for covariates) were used as a basis for estimating utility values beyond 6 months.

The primary assumption for longer-term cost effectiveness was that future costs and utility patterns beyond 6 months were equal, so only predicted survival rates were likely to drive future costs and QALYs. Thereafter, several sensitivity analyses were undertaken for how future cost and utility patterns could behave, including (1) the 6-month utility values were carried forward (linear constancy); (2) utilities declined in a linear fashion; (3) utilities declined exponentially; (4) survival rates were lower in the NIV arm by 10% (justified by an examination of the plots of log-survival and hazard function); (5) future costs and utilities differed between arms based on 6-month values (carried forward); and (6) future costs were assumed equal but future utilities could differ. The estimated utility values in each of these alternative scenarios (adjusted for proportion of patients alive at the corresponding time point) were used to compute the 5-year QALY estimates. A further sensitivity analysis of longer-term cost-effectiveness outcomes adopted a societal perspective.

All statistical and cost-effectiveness analyses were undertaken using SAS® version 9.4 on a Windows platform. A published SAS macro [31] was used for flexible parametric modelling. Reporting was made in line with the CHEERS statement [32]. The trial protocol was designed by the trial investigators and was approved by South Central C Research Ethics Committee (reference 12/SC/0515).

Results

Details of the clinical study have been reported elsewhere [8]. Briefly, 364 patients were randomised: 182 to non-invasive weaning and 182 to invasive weaning. The primary clinical endpoint showed no clinical or statistical difference in median time to liberation from mechanical ventilation: median 4.3 vs. 4.5 days; adjusted hazard ratio 1.1; 95% CI 0.89–1.40. Early extubation to NIV did not shorten time to liberation from any ventilation. Approximately 52 and 50% of all health resource use data were complete at 3 months for the non-invasive and invasive groups, respectively; this was 51 and 46%, respectively, at 6 months (Table 3 in the ESM).

A complete QALY profile was available for about 50% of patients (179/364) (Table 3 in the ESM). Data were missing because patients either died before 3 months (n = 82), were not available to provide a response (n = 60) or withdrew from follow-up (n = 37).

Resource Use and Economic Costs

Resource use for the period between randomisation and hospital discharge was generally higher for patients allocated to the invasive group (Table 1 in the ESM). The proportion of patients who used antifungals was significantly higher in the invasive group (12% for IMV vs. 5% for NIV; p = 0.0168). Broader resource use (post-initial hospital discharge) was similar between the non-invasive and invasive groups.

The mean intervention costs from randomisation until hospital discharge were £29,697 and 32,052 for NIV and IMV participants with complete data, respectively: mean cost difference − £2355; 95% CI – 7292 to 2750; p = 0.4472 (Table 1).

The mean total NHS and PSS costs throughout the first 6 months post-randomisation were, on average, lower for the non-invasive group than for the invasive group: £31,711 versus 32,468; mean difference − 756.20; 95% CI – 6642 to 5246; p = 0.8321 (Table 1). Mean societal costs were £31,934 and 32,999, respectively; mean difference − 1065; 95% CI – 6804 to 5056; p = 0.7981. The wide CIs for differences in mean costs reflected the uncertainty in the estimates. Significant differences between groups in terms of baseline clinical characteristics were not observed.

Health-Related Quality-of-Life Outcomes and QALYs

There were no significant differences in EQ-5D-3L outcomes between the trial groups prior to hospital admission or at 3 months post-randomisation (Tables 4 and 5 in the ESM).

However, mean EQ-5D-3L utility scores among complete cases were significantly lower at 6 months post-randomisation for the NIV group (0.53 vs. 0.66; p = 0.0147). The mean QALY value was, on average, higher for the NIV group (0.0928 vs. 0.0747; p = 0.4522). The mean improvement in QALYs was because mean utility at a specific time point was based on observed cases and did not consider deaths (utility score of 0) and differential survival rates. Since more patients died in the invasive group, more utility scores were set to zero. Moreover, our QALY estimates are derivations over time, based on modelled estimates of mean utility at each time point, taking into account heterogeneity and missing data.

The base-case economic evaluation, using imputed attributable costs and QALYs and covariate adjustment, indicated that—over the first 6 months—NIV was associated with a lower net cost (− £302; 95% CI – 5490 to 4760) and a higher net effect (0.02 QALYs; 95% CI − 0.01 to 0.05) and was therefore dominant (Table 2).

Table 2

Cost effectiveness, cost per QALY (£, year 2016 values): non-invasive vs. invasive weaning

Cost perspective	Mean incremental cost/QALY			Probability of cost effectiveness			INMB
	Incremental cost	Incremental QALYs	ICERa	pb	p	pd	INMBb	INMBc	INMBd
Base case (NHS/PSS perspective)
Imputed attributable costs and QALYs (fixed baseline), adjusted for covariates	− 302 (− 5489 to 4761)	0.01589 (− 0.01262 to 0.0465)	NIV dominant	0.57	0.58	0.59	541(− 4598 to 5833)	620 (− 4545 to 5928)	779 (− 4470 to 6162)
Sensitivity analyses
1. Imputed societal attributable costs and QALYs (fixed baseline), adjusted for covariates	− 339 (− 5422 to 4645)	0.01631 (− 0.01271 to 0.04714)	NIV dominant	0.57	0.58	0.60	584 (− 4509 to 5733)	665 (− 4473 to 5862)	828 (− 4369 to 6075)
2. Complete cases (NHS/PSS) attributable costs and QALYs (fixed baseline), adjusted for covariates	− 739.5 (− 7139 to 5641)	0.01605 (− 0.0211 to 0.0557)	NIV dominant	0.59	0.60	0.62	980 (− 5539 to 7442)	1060 (− 5505 to 7559)	1220 (− 5456 to 7833)
3. Imputed attributable costs and QALYs (fixed baseline using SF-6D utility score), covariates adjusted	− 330 (− 540 to 4692)	0.0295 (− 0.1367 to 0.1762)	NIV dominant	0.58	0.60	0.62	774 (− 5033 to 6521)	922 (− 5357 to 7025)	1218 (− 6163 to 8267)
4. Imputed attributable costs and QALYs (fixed baseline), adjusted for covariates and pre-admission EQ-5D-3L covariate	− 445 (− 5305 to 4486)	0.0156 (− 0.0151 to 0.0479)	NIV dominant	0.59	0.60	0.61	625 (− 4809 to 5114)	735 (− 4914 to 5044)	894 (− 5182 to 4962)
Subgroup analyses (COPD and operative status)
COPD: Presence of COPD: Imputed attributable costs and QALYs (fixed baseline), covariates adjusted EQ-5D-3L utility score	− 5322 (− 17,899 to 6431)	0.1169 (0.0353 to 0.215)	NIV dominant	0.82	0.84	0.87	7076 (− 4817 to 19,814)	7660 (− 4308 to 20,451)	8829 (− 3368 to 21,731)
COPD: Absence of COPD: Imputed attributable costs and QALYs (fixed baseline), covariates adjusted EQ-5D-3L utility score	756 (− 4768 to 6380)	− 0.0050 (− 0.0352 to 0.0258)	NIV dominated	0.40	0.40	0.39	− 831 (− 6588 to 4793)	− 856 (− 6629 to 4801)	− 906 (− 6745 to 4863)
Operative status: Non-operative: Imputed attributable costs and QALYs (fixed baseline), covariates adjusted EQ-5D-3L utility score	-1915 (− 7955 to 3932)	0.03743 (0.00105 to 0.0766)	NIV dominant	0.75	0.76	0.79	2477 (− 3491 to 8559)	2664 (− 3394 to 8806)	3038 (− 3134 to 9264)
Operative status: Operative: Imputed attributable costs and QALYs (fixed baseline), covariates adjusted EQ-5D-3L utility score	3266 (− 6808 to 13,041)	− 0.0311 (− 0.0747 to 0.0135)	NIV dominated	0.27	0.26	0.25	− 3733 (− 13,560 to 6415)	− 3888 (− 13,736 to 6284)	− 4200 (− 14,063 to 6042)

ICER dominant: indicates average costs were lower and average benefit greater for the non-intensive treatment group. Figures in parentheses are 95% confidence intervals

COPD chronic obstructive pulmonary disease, EQ-5D-3L three-level EuroQoL 5-Dimensions instrument, ICER incremental cost-effectiveness ratio, INMB incremental net monetary benefit (QALY at thresholds £15,000, £20,000 and £30,000), NHS UK national health service, NIV non-invasive, P probability, QALY quality-adjusted life-year, PSS personal social services, SF-6D 6-Dimension Short-Form survey

aConfidence intervals based on 10,000 simulations

Probability cost effective or net monetary benefit if cost-effectiveness threshold is £15,000/QALY

Probability cost effective or net monetary benefit if cost-effectiveness threshold is £20,000/QALY

Probability cost effective or net monetary benefit if cost-effectiveness threshold is £30,000/QALY

The simulated ICERs showed uncertainty largely across the north-east and south-east quadrants of the cost-effectiveness plane (Fig. 1).

Fig. 1

a Cost-effectiveness plane, b cost-effectiveness acceptability curve for base case: fixed baseline utility, imputed costs, adjustment for covariates

The NIV protocol showed net economic gains based on INMBs of £541, £620 and £779, on average, at cost-effectiveness thresholds of £15,000, £20,000 and £30,000 per QALY, respectively (Table 2). The CEAC shows that the probability that NIV is cost effective is approximately 57–59% across cost-effectiveness thresholds (Fig. 1). INMBs were similar across scenarios considered by the sensitivity analyses, indicating that the results are robust to alternative assumptions (Fig. 2; Figs. 2 and 3 in the ESM).

Fig. 2

Sensitivity analyses and subgroup results (cost-effectiveness threshold of £30,000/quality-adjusted life-year)

Subgroup Analyses

Both presence of COPD and operative status had a notable impact on cost-effectiveness results (Fig. 2; Figs. 2 and 3 in the ESM). For patients with COPD, the probability that NIV is cost effective increased to 82–87% (Table 2). In contrast, the probability of cost effectiveness was < 30% among post-operative surgical patients. A tornado diagram displaying the impact on the INMB of variations in several inputs is provided in Fig. 5 in the ESM.

Results of Longer-Term Cost-Effectiveness Analysis

The base-case extrapolation analysis, based on mortality predictions using the Royston–Parmar model [3 knots; i.e. a RP(4) model] yielded mean survival times (over the 5-year time horizon) of 41.9 versus 33.3 months for the non-invasive versus the invasive group, respectively. Among the three models [exponential, Weibull and RP(4)] used to predict survival rates to 5 years (Table 7 and Fig. 1 in the ESM), the RP(4) model showed the smallest AIC value (a well-established metric of model fit). Extrapolated survival rate estimates were in broad agreement with those in published studies [33-35], which report 1-, 2- and 3-year survival rates of 69%, 50% and 47%, respectively. For the invasive group, these were 65%, 60% and 50% at years 1, 2 and 3, respectively. There was no statistically significant difference between the two survival curves for survival data observed during the trial (log rank p value = 0.366). The above models also confirmed this (Table 6 in the ESM).

The extrapolated survival to 5 years post-randomisation estimated that 67% of patients were expected to remain alive in the non-invasive group versus 45% for the invasive group. However, given the high uncertainty around these estimates as a result of extrapolation, we also conducted sensitivity analyses (Table 8 in the ESM) that included an assumption of equal future (beyond 6 months and 5 years) survival rates between arms.

Under the assumption that future costs and utility patterns beyond 6 months are equal (based on extrapolated survival data), the mean discounted expected QALYs were 2.25 (non-invasive group) and 1.82 (invasive group) (Table 7 in the ESM), resulting in an incremental QALY gain of 0.427. The mean NHS and PSS costs over the entire 5-year period were higher in the NIV group than in the IMV group (£43,759 vs. 41,787, respectively). The 5-year ICER associated with NIV was £4618 per QALY gained (an INMB of £10,838 at a cost-effectiveness threshold of £30,000). The probability that NIV was cost effective was > 90% at a cost-effectiveness threshold of £20,000 per QALY (Fig. 7 in the ESM).

However, the sensitivity analyses indicated that the probability of cost effectiveness for NIV strongly depended on assumptions surrounding future costs, utilities and survival rates beyond 6 months (Table 8 and Figs. 4 and 6 [tornado plot] in the ESM). In particular, under the assumption of equal survival rates between 6 months and 5 years, and equal future utilities, the mean incremental costs and QALYs were (non-invasive vs. invasive group) £6453 and − 0.092 (Table 8 in the ESM), respectively, yielding negative INMBs ranging between £7833 and £9213 favouring invasive weaning. This showed that the incremental QALY gains in favour of NIV were largely driven by the higher extrapolated survival rates for the NIV arm. Hence, despite predicted survival rate estimates being in broad agreement with those in published studies [33-35], the uncertainty around the long-term cost-effectiveness results should be carefully considered.

When the projected survival rates were assumed to be lower by 10% in the non-invasive weaning arm (vs. the invasive arm), the INMB fell by > 90% from £10,838 to 603, and the expected probability of long-term cost effectiveness fell to around 79% (Table 8 and Fig. 8 in the ESM). If future survival estimates reflect patterns shown here (Fig. 1 in the ESM), and future patient costs accumulate based on patterns observed during the trial, without improvements in QALYs (Table 8 in the ESM, scenario 4), NIV is no longer be cost effective (change from INMB of £10,838 in favour of NIV to INMB of £6061 favouring invasive weaning).

Discussion

This trial-based economic evaluation showed that NIV has potential to be cost effective compared with invasive weaning; the probability of cost effectiveness ranged from 57 to 59%, depending on the cost-effectiveness threshold. This is likely to be largely driven by the difference in the mean ± standard error number of days in the ICU (14 ± 1.08 vs. 15 ± 1.12) and ICU-related costs (Table 1; Table 1 and 9 in the ESM).

This finding remained robust to most sensitivity and subgroup analyses considered. The main exception related to subgroups of patients without COPD and those who required surgery, in whom IMV was the dominant strategy.

The primary clinical endpoint of time to liberation from mechanical ventilation did not show a statistical difference: median 4.3 vs. 4.5 days; adjusted hazard ratio 1.1; 95% CI 0.89–1.40. However, a lack of difference in the time to liberation from ventilation does not imply that costs of ICU care beyond this point are no longer relevant for the purposes of cost effectiveness. In this cost-effectiveness analysis, health resource use and HRQoL beyond liberation from ventilation were considered, which could logically result in differing conclusions. We observed that, on average, patients in the invasive group stayed about 1 day long in the ICU than those in the non-invasive group (Table 1 in the ESM). Moreover, other costs, including broader NHS and broader societal costs, also influenced the observed cost differential in favour of NIV. In addition, improved QALYs associated with NIV were observed once deaths are accounted for (driven by more deaths in the IMV arm). The cost-effectiveness analysis considered a broader assessment of consequences than the clinical study, resulting in a conclusion that NIV weaning may be cost effective, particularly for patients with COPD.

The differences in costs and QALYs between the trial comparators were not statistically significant. However, the trial was not powered to detect such differences over a short-term time horizon. A power calculation for a future trial covering a 5-year follow-up period, using the observed results from this trial, taking into account long-term survival predictions (i.e. using mean costs and projected QALYs and their standard deviations along with a £30,000 cost-effectiveness threshold), would require a sample size of at least 215 per group (430 in total) to show with at least 80% power (5% significance) that the INMB would be > 0. This would be the case even if NIV weaning was more expensive by as much as £2737 (one possible scenario of the sensitivity analyses in Table 8 in the ESM). Hence, this trial provides useful data to prospectively design a future (larger) confirmatory trial with longer follow-up that could demonstrate long-term cost effectiveness. In the more optimistic scenario, where NIV was projected over 5 years to be cheaper by £302 (Table 2; Table 8 in the ESM), the sample size required would be around 120 per group (240 in total). The observed probabilities of cost effectiveness observed in this trial, although < 80%, may partly be because the sample size (n = 364 vs. n = 430) was smaller than required to demonstrate cost effectiveness [36].

Previous clinical trials have reported significant clinical benefits with the NIV protocol among patients with COPD, in contrast to studies that enrolled mixed populations [3]. However, none of those studies reported impacts on HRQoL among survivors. Therefore, our findings add new insights into available evidence, emphasising that other factors may need to be considered when deciding on optimal weaning approaches for patients in critical care settings who present without COPD.

When the benefits of NIV weaning on mortality were extrapolated to 5 years, the NIV protocol remained cost effective (5-year ICER £4618/QALY (INMB £6568 at a cost-effectiveness threshold of £20,000) with probability of cost effectiveness of NIV > 90%). NIV as a bridge to liberation from mechanical ventilation could be recommended on economic grounds provided that the assumptions of constant costs and health utilities beyond the trial period continue to hold in practice. The longer-term cost effectiveness of NIV is highly dependent on assumptions surrounding costs and benefits beyond 6 months. However, we have included sensitivity analyses for various parameters (including survival rates) while noting that estimated survival rates were broadly similar to those reported in the literature [33-35]. We also suggest that additional information on longer-term outcomes is needed in future studies to reduce the uncertainty around our estimates.

To our knowledge, this is the first trial-based economic evaluation that compares the cost effectiveness of two protocolised weaning strategies for patients in the ICU. Previous studies have compared the cost effectiveness of NIV weaning with other strategies and in different countries and clinical settings. Chandra et al. [7] conducted a cost-effectiveness analysis of multiple interventions for COPD, including a comparative assessment of weaning protocols (NIV vs. weaning with invasive ventilation), within the Canadian setting, using a Markov probabilistic model. The results indicated that weaning with NIV dominated weaning with invasive ventilation; the probability of cost effectiveness for NIV weaning exceeded 99% at cost-effectiveness thresholds as low as $25,000 per QALY gained. Nonetheless, the analysis was restricted to patients with COPD. We also considered using the data from Chandra et al. [7] as an external input but felt that long-term extrapolations of survival could be misleading or unreliable because the populations differed. Other studies reported costs associated with NIV weaning in critical care settings [5, 6] but did not report HRQoL outcomes and were either based on small sample sizes [6] or focussed solely on patients with a COPD exacerbation [37].

A strength of the Breathe trial was that it was prospectively designed for an economic evaluation using individual-level data. Costs and outcomes were carefully considered in the trial design with a view to reaching a robust cost-effectiveness conclusion based on a large sample. However, potential limitations to this analysis do exist. First, we assumed that the baseline utility value for each patient was − 0.402, the value assigned by the UK EQ-5D-3L tariff to an unconscious health state. This assumption is in keeping with broader methodological practice for trial-based economic evaluations conducted in critical care settings [38]. Moreover, we recently demonstrated that applying alternative fixed baseline utility scores generally had no effect on incremental QALY calculations [38]. Second, approximately 35% of QALY data and 6–40% of costs (at the component level) were missing by 6 months. Had our base-case cost-effectiveness analysis only considered individuals with complete QALY and cost data, we would have removed approximately 50% of patients from the analysis, which would have likely biased the results. After demonstrating that the data were missing at random, we used multiple imputation to ‘replace’ missing values to allow a comprehensive analysis using the whole dataset. Third, the modelling undertaken was constrained by assumptions concerning post-6-month costs and health utilities. However, a systematic search of external studies that compared these two weaning approaches revealed that none reported long-term economic outcomes. As a result, the evidence base for extrapolating cost effectiveness is currently weak. Longer follow-up would have reduced uncertainty surrounding our long-term cost-effectiveness estimates.

Conclusions

The results from the Breathe study indicated that early extubation to NIV did not shorten time to liberation from any ventilation. The probability of NIV being cost effective relative to weaning without NIV ranged between 57 and 59% and was higher for patients with COPD (82–87%). Future trials with extended follow-up are needed to reduce uncertainty surrounding the long-term cost effectiveness of NIV.

Below is the link to the electronic supplementary material.

Supplementary file1 (DOCX 435 kb)

Early extubation to non-invasive ventilation (NIV) did not shorten time to liberation from ventilation.

However, the probability of NIV being cost effective relative to weaning without NIV was modest: between 57% and 59%.

For patients with chronic obstructive pulmonary disorder, the probability of cost effectiveness of NIV was much higher (82–87%).

Future trials with extended follow-up are needed to reduce uncertainty surrounding the long-term cost effectiveness of NIV.