Exploratory cost-effectiveness model of electromagnetic navigation bronchoscopy (ENB) compared with CT-guided biopsy (TTNA) for diagnosis of malignant indeterminate peripheral pulmonary nodules.

INTRODUCTION: Lung cancer is accountable for 35 000 deaths annually, and prognosis is improved when the cancer is diagnosed early. CT-guided biopsy (transthoracic needle aspiration, TTNA) and electromagnetic navigation bronchoscopy (ENB) can be used to investigate indeterminate pulmonary nodules if the patient is unfit for surgery. However, there is a paucity of clinical and health economic evidence that directly compares ENB with TTNA in this population group. This cost-effectiveness study aimed to explore potential scenarios whereby ENB may be considered cost-effective when compared with TTNA.
METHODS: A cohort decision analytic model was developed using a UK National Health Service perspective. ENB was assumed to have equal sensitivity to TTNA at 82%. Lifetime costs and quality-adjusted life-year (QALY) gain were calculated to estimate the net monetary benefit at a £20 000 per QALY threshold. Sensitivity analyses were used to explore scenarios where ENB could be considered a cost-effective intervention.
RESULTS: Under the assumption that ENB has equal efficacy to TTNA, ENB was found to be dominant (less costly and more effective) when compared with TTNA, due to having a reduced risk and cost of adverse events. This conclusion was most sensitive to changes in the cost of intervention, estimates of effectiveness and adverse event rates. DISCUSSION: ENB is expected to be cost-effective when the likelihood of an accurate diagnosis is equal to (or better than) TTNA, which may occur in certain subgroups of patients in whom TTNA is unlikely to accurately diagnose malignancy or when an experienced practitioner achieves a high accuracy with ENB. © Author(s) (or their employer(s)) 2020. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.

Under which circumstances is electromagnetic navigation bronchoscopy (ENB) compared with CT-guided biopsy (transthoracic needle aspiration, TTNA) expected to be cost-effective for the diagnosis of malignant indeterminate peripheral pulmonary nodules?

Health economic decision modelling suggests that ENB is likely to be cost-effective compared with TTNA when equal diagnostic accuracy is assumed, however, in certain scenarios ENB remains cost-effective even if TTNA has a higher sensitivity.

Currently, there is uncertainty regarding the extent that the lower risks, costs and clinical harm of adverse events associated with ENB may offset the higher procedural cost of ENB when compared with TTNA to diagnose malignant indeterminate pulmonary nodules; this paper explores the scenarios in which ENB may be considered cost-effective.

Introduction

Lung cancer is the third most common cancer in the UK and the UK’s biggest cancer killer accounting for nearly 50 000 new cases per year and over 35 000 deaths; more than breast, bowel, bladder and uterine cancer combined.1 There are four stages of lung cancer (I–IV). Cancers diagnosed at the early stages are usually treated with curative intent2 and have a significantly better prognosis.3

The number of cases diagnosed at early stages is expected to increase as lung cancer screening gains momentum. However, many lung cancer cases first present as indeterminate nodules requiring further investigation before proceeding to definitive treatment. As many as 96.4% of positive screening results were actually false positives in the National Lung Screening Trial.4 Despite the use of nodule algorithms, many nodules still remain indeterminate, presenting a clinical dilemma as to whether to proceed with surgery for potentially benign disease or attempt to confirm malignancy first by invasive biopsy techniques.

On suspicion of lung cancer, a fluorodeoxyglucose-positron emission tomography scan is undertaken to determine the site with the highest staging significance for example, site of potential metastasis, such as liver, or nodal disease. This site is sampled to confirm malignancy and staging in a single procedure.5 For indeterminate pulmonary nodules, especially those too peripheral to be sampled by conventional bronchoscopy, options of further management include CT-guided biopsy (transthoracic needle aspiration (TTNA)), electromagnetic navigation bronchoscopy (ENB) and surgical excision biopsy. These strategies all carry a risk of direct complications, such as surgical and perioperative complications, iatrogenic pneumothorax or haemorrhage, or indirect complications arising from delayed or missed diagnosis. The choice of modality should take into account both diagnostic accuracy and safety6 with nodule size and location as well as lung function and the presence, location and degree of emphysema influencing this.

The British Thoracic Society (BTS) guidelines recommend image-guided biopsy for people who may not be fit for surgery and as the first line of investigation for people with indeterminate pulmonary nodules (Herder risk 10%–70%).6 TTNA is considered as standard of care in image-guided biopsy and has been shown to have a high sensitivity6 (therefore decreasing the probability of a delayed or missed diagnosis). However, it carries a relatively high likelihood of adverse events such as pneumothorax and pulmonary haemorrhage when compared with less invasive techniques, such as ENB.

ENB is a minimally invasive approach that uses navigation technology to access peripheral areas of the lung.7 ENB is a viable option for diagnostic investigation when the location of the pulmonary nodule means alternative diagnostic investigations would result in low diagnostic yield or pose a high risk of complications. There is also a clinical expectation that diagnostic sensitivity of ENB could be similar to TTNA if used routinely.

However, in this high-risk group, there is uncertainty as to whether the lower complication rates with ENB outweigh the higher upfront cost of ENB compared with TTNA. This study presents an exploratory cost-effectiveness model comparing ENB with TTNA for the investigation of malignancy in indeterminate peripheral pulmonary nodules under the assumption of equal efficacy of ENB and TTNA in patients who have high risk of direct complications with invasive biopsy.

Methods

Model overview

The cost-effectiveness model was developed in Microsoft Excel 2013 using a UK National Health Service (NHS) and personal social services perspective and a lifetime horizon. The model comprised a diagnostic decision tree and submodels for the delay period and long-term outcome following a diagnostic result. This is shown in the top left, right and bottom left panels in figure 1, respectively. The model was used to quantify the lifetime costs and benefits (expressed as quality-adjusted life years (QALYs)) for the population of interest receiving either ENB or TTNA.

Figure 1

Model structure top panel: schematic of diagnostic decision-tree used in short-term model (top left panel), Delay period (right panel) and long-term outcomes (bottom left panel). ENB, electromagnetic navigation bronchoscopy; TTNA, transthoracic needle aspiration.

Initially, a hypothetical cohort of patients entered the diagnostic decision tree (top left panel, figure 1). The proportion of patients for each diagnostic outcome was calculated using the baseline prevalence of malignancy and the test sensitivity. Further diagnostic tests were not indicated if malignancy was not identified. Costs and health-related quality of life (HRQoL) decrements were applied proportionally to the risk of adverse events associated with the diagnostic modality. The procedural cost of the diagnostic test was applied to all patients.

Patients with benign nodules entered a health state with all-cause mortality estimates applied. Patients found to have malignant nodules entered the long-term outcomes model (bottom left panel, figure 1) at the determined stage of cancer. Progression to the long-term outcomes model was either immediate (following a true positive diagnostic outcome) or after a delay period (following a false negative diagnostic outcome).

Within the delay period, either disease progression or death could occur during the wait to treatment. The outcome of the delay period was calculated by a series of Markov models with a monthly cycle (right panel, figure 1). Movement between health states in the delay period was based on a series of fixed transition probabilities and death was possible from all health states. A 1-month delay to treatment was assumed, with a 6-month delay tested in sensitivity analysis.

The long-term outcomes model consisted of four health states defined by stage of cancer at diagnosis, and death. Movement between health states, once allocated on entry into the long-term model was not possible. The survival trajectory of each health state corresponded with that expected for the stage of cancer at diagnosis.8 The long-term outcome model had an annual cycle length and a half cycle correction applied to costs and benefits.

Costs and benefits in all three submodels were discounted at 3.5% per annum in line with the National Institute for Health and Care Excellence reference case.9 The model was populated using studies identified through targeted literature searches, and supplemented by clinical opinion. Key model outputs were incremental cost-effectiveness ratios based on the ratio of additional costs and benefits of ENB over TTNA and incremental net monetary benefit (NMB). The latter was calculated using a cost-effectiveness threshold of £20 000 per QALY gained.

Data sources and model parameters

Population

The model evaluated a hypothetical cohort of patients with an indeterminate peripheral pulmonary nodule that required further investigation for malignancy. This included patients not suitable for invasive biopsy due to poor lung function (such as people with advanced chronic obstructive pulmonary disorder, emphysema or postsurgical patients).10 11 The pretest prevalence of malignancy of any severity was assumed to be 40% (the midpoint of the Herder score that would indicate further investigation6), the starting age of the population was 70 years old and 50% were assumed to be male.12 Assuming an individual had lung cancer, the distribution of patients across each of the four severity stages used in the model was taken from Folch et al12 (see table 1).

Table 1

List of key parameter values and sources

Input	Value in model	Source/notes
Proportion of presenting cohort by stage of lung cancer
Stage I	54%	Folch et al12
Stage II	11%
Stage III	17%
Stage IV	18%
Survival and disease progression
All-cause mortality	Various	Age and sex adjusted, ONS13
Annual probability of death with treatment (by stage at diagnosis)
Stage I	0.1032	Derived from information in Cancer Research UK (2014)8
Stage II	0.1857
Stage III	0.3180
Stage IV	0.4043
Monthly probability of disease progression without treatment
Stage I and II to stage III	0.05	Informed by information in Hinde et al14
Stage I and II to stage IV	0.10
Stage III to IV	0.20
Death	0.01	Assumed to have the same survival as patients with stage I cancer. Cancer Research UK (2014)8
Probability of adverse events
ENB-related pneumothorax (requiring intervention)	2.88%	Folch et al12
ENB-related pneumothorax (not requiring intervention)	1.40%
ENB pulmonary haemorrhage	1.48%
TTNA-related pneumothorax (requiring intervention)	7.28%	DiBardino et al16
TTNA-related pneumothorax (not requiring intervention)	13.20%
TTNA pulmonary haemorrhage	2.73%
HRQoL*
No cancer utility	0.855	Szende et al18
Stage I utility	0.825	Based on the pooled estimate of non-metastatic NSCLC, Sturza17
Stage II utility	0.825	Assumed equivalent to stage I cancer. Sturza17
Stage III utility	0.772	Based on the pooled estimate of mixed/not specified NSCLC. Sturza (2010)17
Stage IV utility	0.537	Based on the pooled estimate of metastatic NSCLC. Sturza (2010)17
Relative decrement for age	0.912	Based on utility value of 0.78 for a 70 year old. Kind et al (1999)19
Disutility of pneumothorax	−0.1388	SMDM29. Disutility applied for a 2-month duration (assumed)
Disutility of haemorrhage	−0.0821
Costs
Intervention procedural costs
ENB	£1942	Estimated via a micro costing (see table 2)
TTNA	£1630	Calculated by adding the costs of the image-guided biopsy of lesion muscle of connective tissue (£1481) (Total HRG code: YH32A) and the cost of the full pulmonary function testing (£150) (Total HRG code: DZ52Z)22
Adverse event costs
Haemorrhage	£3127	Assumed equivalent to non-elective tracheostomy code: CA63Z22
Pneumothorax (requiring intervention)	£2939	Average cost of non-elective pneumothorax treatment with single or multiple interventions. Codes: DZ26G toDZ26L22
Pneumothorax (not requiring intervention)	£1286	Average cost of non-elective pneumothorax without Interventions. Codes: Z26M to DZ26P22
Cost of false negative (delayed diagnosis)
Cost of CT scan	£106	CT scan of two areas, with contrast. Code: RD24Z22
Cost of GP appointment	£37	PSSRU 201821
Annual cost of each stage of cancer: inflated to 2017/2018 (original value)
Stage I non-resected cancer	£8267 (£7952)	Cancer Research UK30
Stage II non-resected cancer	£8679 (£8349)
Stage III non-resected cancer	£9078 (£8733)
Stage IV non-resected cancer	£13 595 (£13 078)

*Please note utilities were age adjusted throughout the lifetime of the cohort.

ENB, electromagnetic navigation bronchoscopy; HRQoL, health-related quality of life; NSCLC, non-small-cell lung carcinoma; ONS, Office for National Statistics; TTNA, transthoracic needle aspiration.

Survival and disease progression

An age and gender-dependent all-cause mortality rate was applied in the long-term outcomes model to the patients with benign nodules.13 For people diagnosed with lung cancer, fixed annual probabilities of death, stratified by severity stage, were derived from 5-year survival rates in a large worldwide study (81 000 patients from 19 countries) which incorporated any cause of death8 (table 1). The annual probability of death for non-diagnosed lung cancer was assumed to be the same as for stage I cancer. The monthly probability of prediagnosis disease progression in the delay period was informed by published expert elicitation estimates for limited, advanced and extensive non-small-cell lung carcinoma14 (table 1).

Effectiveness

The difference in sensitivity between ENB and TTNA is uncertain due to a lack of published comparative data regarding the diagnosis of malignant peripheral indeterminate pulmonary nodules. The sensitivity of ENB reported by studies included in a meta-analysis evaluating diagnosis of peripheral lung nodules was 50%–100%.15 The sensitivity of TTNA quoted by studies considered in the BTS guideline for the diagnosis of malignant indeterminate nodules (but not necessarily peripheral) ranged from 77% to 97%.6 For the purposes of this exploratory model, the sensitivity of TTNA and ENB was assumed to be equivalent at 82%, the mean from the ENB meta-analysis.15

The relative accuracy between diagnostic modalities is highly uncertain, and therefore effectiveness values were subject to sensitivity analysis. Specificity was assumed to be 100%; with no false positive results given malignancy would only be identified if present.

Diagnostic intervention-related adverse events

Iatrogenic pneumothorax and pulmonary haemorrhage were the two key diagnostic intervention-related adverse events considered within the model. Clinically significant haemorrhage and pneumothorax requiring hospitalisation were associated with a cost and disutility. The likelihood and cost of pneumothorax was refined by whether or not an intervention was required within the hospital stay. The values used in the model for ENB and TTNA were taken from publications by Folch et al12 and DiBardino et al,16 respectively (table 1).

Health-related quality of life (HRQoL)

Health state preference values (utilities) were assigned to each health state in the model (including sub-models). These values conventionally range from 0 to 1, with 1 corresponding to perfect health and 0 to death. Based on information presented in a UK-specific HRQoL study by Sturza et al17 the values used in the model for stages I/II, III and IV were assumed to correspond to the published values for non-metastatic, mixed/not specified and metastatic lung cancer, respectively (table 1). The utilities applied within the model were age adjusted with a relative decrement derived from the HRQoL expected for people without malignancy and population norms.18 19 Each year survived in the long-term outcomes model was weighted by the relevant utility value to estimate the QALY gain. The model applied a utility decrement for each of the two adverse events, calculated by applying the associated disutility of the event20 over an assumed 2-month period (table 1).

Resources and costs

Resources and costs associated with the implementation of the interventions, management of adverse events and delayed diagnosis, as well as the long-term management of the different stages of cancer were taken into account (table 1). Wherever possible, costs were identified from publicly available sources and list prices21–23 and, where applicable, inflated to 2017–2018 (the cost year of the analysis) using the HCHS index.21 The estimated cost of ENB was derived through a micro costing (with summarised costs presented in table 2). The resource use for this costing was derived from unstructured interviews and observations at a London tertiary hospital (personal communication, Medtronic) in 2016/2017, with costs inflated to the year of the analysis. The cost of ENB is dependent first on the running costs of the bronchoscopy suite, radiology department or operating theatre and second on the proportion of procedures which are undertaken under general anaesthetic. Both of these parameters were subject to sensitivity analysis.

Table 2

Items and costs included within the ENB costing scenarios

Input	Value used in model	Upper estimate	Notes
Costs of superDimension device for ENB	£1103		Average of three separate strategies (personal communication, Medtronic):Dx strategy 1 = £1026Dx strategy 2 = £1119Marker insertion = £1094
Cost of running operating room	£153	£537	25 min X £6 per minute (personal communication, Medtronic)25 min X £21 per minute (personal communication, Medtronic)
Staff time	£566		Subtotal for: 25 min for medical consultant, operating department practitioner (band 5) and scrub nurse (band 6); 30 min for recovery nurse (band 5); 75 min for anaesthetist (75 min)21
Proportion of procedures under GA	0%	81.40%12
Drugs—GA	£0	£24	Weighted subtotal according to proportion of procedures under GA (unweighted subtotal £29.87)23
Drugs—sedation	£12	£2	Weighted subtotal according to proportion of procedures under GA (unweighted subtotal = £11.77)23
Consumables	£11		Includes: 2 suction tubes, 2 20 mL syringe, Green hypo, 100 mL N/saline bag, gallipot, sputum pot, 3 small specimen bottles, long thin endoscopic sucker (personal communication, Medtronic)
Anaesthetic consumables	£5		Includes: cannula, drip, seven syringes (personal communication, Medtronic)
Tests	£13		Includes FBC, blood clot test, platelet count, INR and IPT22
Total	£1863	£2226

Note, where applicable costs were inflated to the 2017/2018 cost year using the HCHS index. Cost of device provided by Medtronic, with cost of the operating room and related consumables based on data collected at tertiary London hospital in 2016 (personal communication, Medtronic).

ENB, electromagnetic navigation bronchoscopy; FBC, full blood count; GA, general anaesthesia; HCHS, Hospital and Community Health Services; INC, international normalised ratio; IPT, immune thrombocytopenia.

Uncertainty analysis

In this exploratory model, deterministic sensitivity analysis was undertaken to evaluate the impact of uncertainty of input values on the conclusions. In these analyses, a positive value of NMB corresponds to ENB being cost-effective. One-way (where input parameters were varied one by one between plausible extremes) sensitivity was carried out on the adverse event rates and two-way (where more than one parameter is varied at the same time) sensitivity analyses were undertaken on the sensitivity values for ENB and TTNA and the ENB costs. In addition, analyses were rerun with a higher sensitivity of 92%, taken from a meta-analysis of diagnostic accuracy for TTNA16 to explore the thresholds at which ENB could be cost-effective if diagnostic effectiveness was not equal.

Results

The summary results of this early exploratory cost-effectiveness model are presented in table 3. Under the assumption of equal efficacy and that ENB can be undertaken in a bronchoscopy suite/radiology department with no need for general anaesthetic, ENB was found to be dominant (less costly and more effective) when compared with TTNA due to having a reduced risk and cost of adverse events (which offset the higher intervention cost of ENB).

Table 3

Results (per patient) assuming equal sensitivity of ENB and TTNA

Economic outcome	ENB	TTNA	Incremental
Diagnostic strategy cost	£1863	£1630	£232
Cancer treatment cost	£17 677	£17 677	£0
Cost of delayed diagnosis	£10	£10	£0
Cost of adverse events	£149	£469	−£320
Total cost per patient	£19 698	£19 786	−£88
QALYs	6.45048	6.45048	0.00000
Disutility	−0.00086	−0.00349	0.00263
Total QALY per patient	6.44962	6.44699	0.00263
ICER			Dominated
Incremental NMB			£140

ENB, electromagnetic navigation bronchoscopy; ICER, Incremental cost-effectiveness ratio; NMB, net monetary benefit; QALYs, quality-adjusted life-years; TTNA, transthoracic needle aspiration.

Uncertainty analysis

One-way sensitivity analysis demonstrated that under the assumption of equal efficacy, the results were sensitive to the accuracy and cost of both diagnostic procedures, and the risk of TTNA-related adverse events. Changing the pretest prevalence of malignancy between 10% and 70% did not have sufficient impact to change conclusions.

The impact of different combinations of sensitivity values for ENB and TTNA on cost-effectiveness was evaluated in a two-way sensitivity analysis. The results in table 4 show that ENB can be up to 8% less sensitive than TTNA and remain cost-effective. With a 6-month delay to treatment after a false negative result, ENB can be up to 2% less sensitive than TTNA and remain cost-effective.

Table 4

Two-way sensitivity analysis for the effectiveness of ENB and TTNA

		ENB sensitivity
		80%	81%	82%	83%	84%	85%	86%	87%	88%	89%	90%	91%	92%
TTNA sensitivity	85%	£55	£72	£89	£106	£123	£140	£158	£175	£192	£209	£226	£243	£261
	86%	£37	£55	£72	£89	£106	£123	£140	£158	£175	£192	£209	£226	£243
	87%	£20	£37	£55	£72	£89	£106	£123	£140	£158	£175	£192	£209	£226
	88%	£3	£20	£37	£55	£72	£89	£106	£123	£140	£158	£175	£192	£209
	89%	−£14	£3	£20	£37	£55	£72	£89	£106	£123	£140	£158	£175	£192
	90%	−£31	−£14	£3	£20	£37	£55	£72	£89	£106	£123	£140	£158	£175
	91%	−£48	−£31	−£14	£3	£20	£37	£55	£72	£89	£106	£123	£140	£158
	92%	−£65	−£48	−£31	−£14	£3	£20	£37	£55	£72	£89	£106	£123	£140
	93%	−£83	−£65	−£48	−£31	−£14	£3	£20	£37	£55	£72	£89	£106	£123
	94%	−£100	−£83	−£65	−£48	−£31	−£14	£3	£20	£37	£55	£72	£89	£106
	95%	−£117	−£100	−£83	−£65	−£48	−£31	−£14	£3	£20	£37	£55	£72	£89
	96%	−£134	−£117	−£100	−£83	−£65	−£48	−£31	−£14	£3	£20	£37	£55	£72
	97%	−£151	−£134	−£117	−£100	−£83	−£65	−£48	−£31	−£14	£3	£20	£37	£55
	98%	−£168	−£151	−£134	−£117	−£100	−£83	−£65	−£48	−£31	−£14	£3	£20	£37
	99%	−£186	−£168	−£151	−£134	−£117	−£100	−£83	−£65	−£48	−£31	−£14	£3	£20
	100%	−£203	−£186	−£168	−£151	−£134	−£117	−£100	−£83	−£65	−£48	−£31	−£14	£3

Results presented are for NMB at £20 000 threshold.

ENB, electromagnetic navigation bronchoscopy; NMB, net monetary benefit; TTNA, transthoracic needle aspiration.

Two-way sensitivity analyses were also undertaken for trade-offs between ENB sensitivity and ENB cost. ENB is cost-effective under the assumption of equal effectiveness (82%) with TTNA if ENB costs approximately £2000 or less (table 5). For ENB to achieve this cost, the operating theatre cost needs to be lower than £11 per minute and fewer than 50% of ENB procedures undertaken with general anaesthetic (table 6). Anecdotally it is likely that the majority of ENB is currently being undertaken under general anaesthetic, but with increasing operator experience and improving accuracy of the system the numbers being performed without general anaesthetic are increasing.

Table 5

Two-way sensitivity analysis for the cost and effectiveness of ENB

		ENB sensitivity
		50%	60%	65%	70%	75%	80%	82%	85%	90%	92%	95%	100%
ENB cost	£1000	£454	£626	£711	£797	£883	£969	£1003	£1054	£1140	£1175	£1226	£1312
	£1250	£204	£376	£461	£547	£633	£719	£753	£804	£890	£925	£976	£1062
	£1500	−£46	£126	£211	£297	£383	£469	£503	£554	£640	£675	£726	£812
	£1600	−£146	£26	£111	£197	£283	£369	£403	£454	£540	£575	£626	£712
	£1700	−£246	−£74	£11	£97	£183	£269	£303	£354	£440	£475	£526	£612
	£1800	−£346	−£174	−£89	−£3	£83	£169	£203	£254	£340	£375	£426	£512
	£1900	−£446	−£274	−£189	−£103	−£17	£69	£103	£154	£240	£275	£326	£412
	£2000	−£546	−£374	−£289	−£203	−£117	−£31	£3	£54	£140	£175	£226	£312
	£2100	−£646	−£474	−£389	−£303	−£217	−£131	−£97	−£46	£40	£75	£126	£212
	£2200	−£746	−£574	−£489	−£403	−£317	−£231	−£197	−£146	−£60	−£25	£26	£112
	£2300	−£846	−£674	−£589	−£503	−£417	−£331	−£297	−£246	−£160	−£125	−£74	£12
	£2400	−£946	−£774	−£689	−£603	−£517	−£431	−£397	−£346	−£260	−£225	−£174	−£88

Results presented are for NMB at £20 000 threshold, assuming TTNA sensitivity of 82% sensitivity.

ENB, electromagnetic navigation bronchoscopy; NMB, net monetary benefit; TTNA, transthoracic needle aspiration.

Table 6

Two-way sensitivity analysis for the cost of theatre operation and proportion of people requiring general anaesthetic for ENB

		Percentage of people requiring anaesthetic
		0	10	20	30	40	50	60	70	80	90	100
Cost of procedure room (per minute)	£6	£140	£137	£134	£131	£128	£125	£122	£119	£116	£113	£110
	£10	£38	£35	£32	£29	£26	£23	£20	£17	£14	£11	£8
	£11	£13	£10	£7	£4	£1	−£2	−£5	−£8	−£11	−£14	−£17
	£12	−£13	−£16	−£19	−£22	−£25	−£28	−£31	−£34	−£37	−£40	−£43
	£21	−£243	−£246	−£249	−£252	−£255	−£258	−£261	−£264	−£267	−£270	−£273

Results presented are for NMB using a £20 000 threshold.

NMB, net monetary benefit.

Table 7 shows that if the sensitivity of TTNA is 92%, and ENB is at 82%, then assuming a 1-month delay ENB would need to cost approximately £1800 or less to be cost-effective (ie, an additional saving of £200 is needed to offset the shortfall in efficacy, tables 5 and 7). If a 6-month delay to diagnosis is expected after a false negative, ENB would need to cost approximately £1300 or less (ie, an additional saving of £700 is required to offset the shortfall in efficacy).

Table 7

Two-way sensitivity analysis for the cost and effectiveness of ENB

		ENB sensitivity
		50%	60%	65%	70%	75%	80%	82%	85%	90%	92%	95%	100%
ENB cost	£1000	£282	£454	£540	£626	£711	£797	£831	£883	£969	£1003	£1054	£1140
	£1250	£32	£204	£290	£376	£461	£547	£581	£633	£719	£753	£804	£890
	£1500	−£218	−£46	£40	£126	£211	£297	£331	£383	£469	£503	£554	£640
	£1600	−£318	−£146	−£60	£26	£111	£197	£231	£283	£369	£403	£454	£540
	£1700	−£418	−£246	−£160	−£74	£11	£97	£131	£183	£269	£303	£354	£440
	£1800	−£518	−£346	−£260	−£174	−£89	−£3	£31	£83	£169	£203	£254	£340
	£1900	−£618	−£446	−£360	−£274	−£189	−£103	−£69	−£17	£69	£103	£154	£240
	£2000	−£718	−£546	−£460	−£374	−£289	−£203	−£169	−£117	−£31	£3	£54	£140
	£2100	−£818	−£646	−£560	−£474	−£389	−£303	−£269	−£217	−£131	−£97	−£46	£40
	£2200	−£918	−£746	−£660	−£574	−£489	−£403	−£369	−£317	−£231	−£197	−£146	−£60
	£2300	−£1018	−£846	−£760	−£674	−£589	−£503	−£469	−£417	−£331	−£297	−£246	−£160
	£2400	−£1118	−£946	−£860	−£774	−£689	−£603	−£569	−£517	−£431	−£397	−£346	−£260

Results presented are for NMB at £20 000 threshold, assuming TTNA sensitivity of 92%

ENB, electromagnetic navigation bronchoscopy; NMB, net monetary benefit; TTNA, transthoracic needle aspiration.

Figure 2 illustrates the impact that changing the likelihood of adverse events has on the incremental benefit via a one-way sensitivity analysis. Assuming equal diagnostic efficacy of 82% and all else held constant, for ENB to be cost-effective the likelihood of pneumothorax requiring intervention needs to be below 7% with ENB and above 3% with TTNA. This finding remained constant when delay to diagnosis following a false negative was increased to 6 months.

Figure 2

One-way sensitivity analysis regarding adverse events. Panel A (top left): varying the probability of pneumothorax requiring intervention (equal efficacy). Panel B (top right): varying the probability of pulmonary haemorrhage (equal efficacy). Panel C (bottom left): varying the probability of pneumothorax requiring intervention (TTNA sensitivity=92%). Panel D (bottom right): varying the probability of pulmonary haemorrhage (TTNA sensitivity=92%). Mean NMB for base case analysis is indicated by a circle for each intervention. ENB, electromagnetic navigation bronchoscopy; NMB, net monetary benefit; TTNA, transthoracic needle aspiration.

If the sensitivity of TTNA increases to 92%, all else held constant, then the TTNA probabilities of pneumothorax requiring intervention and haemorrhage need to be at least 8% and 4%, respectively for ENB to be cost-effective in comparison. If the delay to diagnosis was increased to 6 months following a false negative, these probabilities of adverse events increase to 21% and 18% respectively.

Discussion

The model aimed to explore the potential key drivers of the cost-effectiveness of ENB compared with TTNA, the current standard of care. The primary conclusion from our analysis is that ENB is likely cost-effective when the likelihood of an accurate diagnosis is equal to (or better than) TTNA. This may occur in certain subgroups of patients whom TTNA is unlikely to accurately diagnose malignancy or when an experienced practitioner achieves a high accuracy with ENB.

However, findings in the main analysis (table 3) need to be interpreted with caution given that the relative accuracy of the tests was assumed to be equal. If TTNA is parametrised with 92% accuracy (rather than 82% accuracy), ENB would have to be either (1) no less than 84% accurate, or (2) cost under £1800 (assuming 82% sensitivity of ENB) to be cost-effective (see table 7). Alternatively, if the rates of pneumothorax requiring intervention or pulmonary haemorrhage with TTNA were at least 8% and 4%, respectively, ENB would be cost-effective (even when TTNA had a 92% sensitivity vs an ENB sensitivity of 82%).

Lack of comparative data which is applicable to the population of interest

There is currently a lack of robust comparative evidence between ENB and standard of care in the population of interest. In previous studies, differences in baseline characteristics of study populations (such as stage of cancer and location of lesions) and differences in observable and unobservable effect modifiers when synthesising diagnostic evidence, has hindered robust comparative analysis of different diagnostics.24 ENB is likely to be most suitable for patients with peripheral nodules and those at high risk of diagnostic complications. Considering this, it is unclear if the higher estimates of sensitivity for TTNA (ie, often above 90%6 16) are applicable to the population who may most benefit from ENB. A small case study (n=108) found that while TTNA sensitivity to diagnose central samples was 76%, sensitivity was less than 69% in regard to peripheral samples.25 However, the NAVIGATE study12 estimated an ENB sensitivity of 69%, which is only comparable to the lower estimates of TTNA and ENB sensitivity.15 While NAVIGATE evaluated ENB in the population of interest, the primary outcome measure was safety. Linear or radial endobronchial ultrasound could be used at physician discretion prior or as a complement to ENB, and the pragmatic study design allowed for physician judgement in patient selection12; meaning the population selected for ENB may differ from that typically evaluated in TTNA accuracy studies.

The range of sensitivities reported in the literature for ENB may result from heterogeneity between study populations, variations of technique and technology, as well as variation in the reference test. Such limitations and methodological constraints are unlikely to be resolved easily. However, the model results are presented for a range of possible accuracy estimates, and therefore are helpful in understanding potential thresholds at which an intervention may be viewed as cost-effective in the absence of definitive evidence.

Adverse events

TTNA-related pneumothorax plays an important role in the overall cost of TTNA and the expected cost-effectiveness of ENB. The probability used for TTNA-related pneumothorax that required treatment (7.28%) is likely conservative. For example, the model developed by Dale et al26 used an estimate of 15%, and a more recent study by Boskovic et al27 reported a slightly higher rate of 20%. Abdullah et al28 also reported the risk of pneumothorax from CT-guided biopsy in a UK setting at 25% for patients with diminished lung capacity (a forced expiratory volume in one second less than 1 L) and 41.5% in patients with poor inspired oxygen transfer (a transfer factor for carbon monoxide less than <40%).28 As shown in the one-way sensitivity analysis (figure 2), ENB is expected to be cost-effective when the risk of clinically significant pneumothorax with TTNA is higher than 10%. As such, ENB is likely to be cost-effective in patients at high risk of complications, even when the ENB has a lower accuracy than TTNA.

Cross-validity with other existing models

A lack of published models for this indication, as well as the lack of comparative trials of ENB against standard care, means that robust external validation of the model is difficult to achieve. Dale et al developed a decision tree model which compared CT-guided biopsy with navigational bronchoscopy for the diagnosis of solitary pulmonary nodules, using a respective sensitivity of 90% and 70%.26 Under the assumption that the incremental QALY gain would be minimal, HRQoL was not incorporated. Dale et al found navigational bronchoscopy with biopsy cost more per case, with the cost per diagnosis most sensitive to a change in sensitivity of CT-guided biopsy. However, this model focused on sequential diagnostic pathways for a mixed patient population group and adopted a societal perspective. These aspects differ from the model presented herein, preventing direct comparison of results.

Uncaptured benefits and costs

A key consideration when interpreting results of the study is that benefits beyond the diagnosis of malignancy were not captured. Both TTNA and ENB have high reported diagnostic yields6 and could bring additional benefit (which has not been explicitly modelled) in obtaining samples for microbiological diagnosis, undertaking lung lesion biopsy, fiducial marker placement, pleural dye marking or lymph node biopsy within the same ENB procedure. Furthermore, new technological developments may mean isolated diagnostic investigations could be superseded by test and treat strategies, such as navigational bronchoscopy and ablation within one procedure. The potential for ENB to be multipurpose or combined with other procedures was not a focus of this model, however, future evaluations may consider ENB as a means to reduce overall cost by avoidance of a second procedure that may require anaesthetic.

In addition, the overall cost-effectiveness of ENB in comparison to standard care may improve if future routine adoption of ENB led to an increased number of skilled practitioners, potentially leading to improved sensitivity and safety of ENB, as well as a reduced need for general anaesthetic or an operating theatre (two drivers of the cost of ENB).

Conclusion

The applicability and quality of the data informing the model is limited due to a lack of comparative studies in the population of interest. Nonetheless, all inputs were subject to clinical validation and sensitivity analysis. The pathway and costing perspective has high applicability to the NHS context. Beyond effectiveness and procedural cost parameters that depend on the service context (ie, practitioner experience or running cost) and population characteristics, all other inputs that relied on expert clinical opinion did not have a large effect on the results and did not change the direction of the results.