Gastroenterologist and nurse management of symptoms after pelvic radiotherapy for cancer: an economic evaluation of a clinical randomized controlled trial (the ORBIT study).

BACKGROUND: Over 20 distressing gastrointestinal symptoms affect many patients after pelvic radiotherapy, but in the United Kingdom few are referred for assessment. Algorithmic-based treatment delivered by either a consultant gastroenterologist or a clinical nurse specialist has been shown in a randomized trial to be statistically and clinically more effective than provision of a self-help booklet. In this study, we assessed cost-effectiveness.
METHODS: Outcomes were measured at baseline (pre-randomization) and 6 months. Change in quality-adjusted life years (QALYs) was the primary outcome for the economic evaluation; a secondary analysis used change in the bowel subset score of the modified Inflammatory Bowel Disease Questionnaire (IBDQ-B). Intervention costs, British pounds 2013, covered visits with the gastroenterologist or nurse, investigations, medications and treatments. Incremental outcomes and incremental costs were estimated simultaneously using multivariate linear regression. Uncertainty was handled non-parametrically using bootstrap with replacement.
RESULTS: The mean (SD) cost of treatment was £895 (499) for the nurse and £1101 (567) for the consultant. The nurse was dominated by usual care, which was cheaper and achieved better outcomes. The mean cost per QALY gained from the consultant, compared to usual care, was £250,455; comparing the consultant to the nurse, it was £25,875. Algorithmic care produced better outcomes compared to the booklet only, as reflected in the IBDQ-B results, at a cost of ~£1,000.
CONCLUSION: Algorithmic treatment of radiation bowel injury by a consultant or a nurse results in significant symptom relief for patients but was not found to be cost-effective according to the National Institute for Health and Care Excellence (NICE) criteria.

RCT Entities:   Population Interventions Outcomes

Introduction

Up to 23 distressing gastrointestinal symptoms, including fecal incontinence, defecatory urgency, loose stools and abdominal pain, have been described to affect up to half of all patients who have undergone radiotherapy to treat a cancer in the pelvis.1,2 In the UK, however, only a small minority of survivors are ever referred for treatment for these symptoms, despite the serious repercussions they have on their quality of life.3,4 Although previously considered refractory, a three-arm clinical randomized controlled trial (RCT) (ORBIT), completed in 2012, has shown that such chronic symptoms of radiation-induced bowel injury can be improved by algorithm-based treatment led by either a gastroenterologist or a clinical nurse specialist.5 The primary end point in this study was the bowel subset score of the Modified Inflammatory Bowel Disease Questionnaire (IBDQ-B).6,7 A statistically and clinically significant improvement in IBDQ-B was recorded for both the gastroenterologist group and the nurse group, when compared to a control group who were given a self-help booklet.5 The step-by-step algorithm was designed prior to the trial through a series of pilot studies that tested investigations and sequential treatments for the 23 symptoms that develop after radiotherapy.8–13 Application of the algorithm means that patients receive tests and treatments that are tailored to their individual needs.

Because of rising healthcare costs and limited budgets, new treatments are increasingly required to demonstrate value-for-money as well as clinical efficacy. This article reports the economic evaluation of the ORBIT trial. The costs of implementing the algorithm by both the gastroenterologist and the nurse, and the findings from a cost-effectiveness analysis, are presented. Each professional is compared with the control (booklet) condition, and with each other. The primary analysis was a cost-utility analysis where the effectiveness metric, quality-adjusted life years (QALYs), reflects morbidity or health-related quality of life associated with the alternative strategies. QALYs provide a common unit of measurement through which the value of interventions in different areas can be compared.14 The National Institute for Health and Care Excellence (NICE), which provides guidance and quality standards for health, public health and social care in the UK, uses a threshold cost per QALY gained of between £20,000 and £30,000 to determine the cost-effectiveness in health technology appraisals.15 The secondary analysis concerned the cost per unit of therapeutic gain from the algorithm, using the IBDQ-B.

Methods

Participants

The ORBIT trial was conducted at the Royal Marsden Hospital in London between 2007 and 2011. Full details have been published elsewhere.5 Participants were aged 18 years or older, with persisting bowel symptoms that had started either during or following pelvic radiotherapy given curatively for various urological, gynecological and gastrointestinal cancers. They had to be well enough to travel to and from the hospital and be treated as outpatients. To be eligible, radiotherapy must have completed at least 6 months prior to enrollment in the study. Patients were excluded if they had serious comorbidities, metastatic disease, short life expectancy (<1 year), a colostomy or ileostomy (unless reversed more than 6 months previously) or been assessed previously by a gastroenterologist for the symptoms. Patients were withdrawn from the study if they required treatment for recurrence of cancer or were hospitalized for the treatment of gastrointestinal symptoms during the study.

Recruitment and data collection

Potentially eligible patients were identified through the hospital radiotherapy department. Clinical records were searched for current or past patients meeting the eligibility criteria. Invitations to participate were delivered either by direct contact at normal patient follow-up appointments, or by telephone and/or mail. Patients referred to a routine National Health Service (NHS) outpatient clinic specializing in post-radiotherapy bowel symptoms for non-urgent treatment were also invited to take part.

All volunteers were screened for eligibility and invited to attend an outpatient clinic to complete consenting processes and provide baseline information. Participants were then randomized (block randomization stratified by tumor site and degree of bowel dysfunction, that is, IBDQ-B <60 or ≥60) to one of three treatment groups: usual care (consisting of a self-help booklet), specialist nurse-led algorithmically driven care and consultant gastroenterologist-led algorithmically driven care. The trial duration was 1 year. Data were collected at baseline, 6-month and 12-month follow-up. At the 6-month follow-up, patients in the usual care (booklet) arm were given the option to transfer to the consultant arm if they had persisting gastrointestinal symptoms. For this reason, the analysis was conducted at the 6-month time point.

Health outcome measures

The primary outcome for the economic evaluation was a participant’s QALY, obtained from Medical Outcomes Study’s Short Form 12 health survey (SF-12) scores that were gathered at each assessment point. SF-12 is a well-validated and widely used generic measure of health-related quality of life that incorporates general health, mental health, pain, vitality, and physical, social and emotional functioning across 12 items.16 Responses can be converted to a reduced six dimension score (the SF-6D), which can be used to estimate single health utility index scores ranging from 0 (death) to 1 (perfect health) using standardized utility weights.17 These utility scores were then mapped to EQ-5D (EuroQoL) using a published procedure.18,19 EQ-5D is the widely used generic instrument, with a UK utility tariff,20 which is favored by NICE to estimate health utility index scores. Using EQ-5D mapped utility estimates allows direct comparability of the cost-effectiveness results to other studies conducted using the EQ-5D to elicit QALY values. To provide an estimate of a participant’s QALYs accrued over the 6-month time period, the area under the curve between baseline and 6 months was calculated using the trapezoid method (also known as discrete time integration).

Secondary analysis was conducted using the IBDQ-B change from baseline (the primary outcome for the clinical study),5 in place of the patient’s QALY. Being a condition-specific measure of health-related quality of life with scores ranging from 10 (worst possible bowel function) to 70 (perfect), the IBDQ-B is more sensitive to small changes in patient outcomes that may not be detected by the generic EQ-5D scale. A shift of six or more points in the IBDQ-B is considered to be a clinically relevant change from the patient perspective.21

Costs

The cost of the intervention is made up of several elements: the number and duration of visits with either the consultant gastroenterologist or the clinical nurse specialist, and the cost of any investigations and treatments delivered as part of the algorithm, including medications. All costs were calculated at the individual patient level in British pounds, 2013, and measured from the perspective of the National Health Service.

The intervention consisted of an initial meeting with the consultant or the nurse, at which the patients’ symptoms were assessed and tests and treatments were ordered according to the algorithm. Additional follow-up visits with the consultant or the nurse were arranged, as required. Unit costs for clinical contact were fully absorbed, inclusive of oncosts and overheads, and obtained from NHS reference costs,22 or Department of Health sources.23 The duration of the initial meeting was recorded in minutes, and the cost was calculated pro rata. For any subsequent outpatient appointments, the duration is not known so these follow-up sessions were assumed to have a 15-minute duration for both the consultant-led and nurse-led intervention arms. The investigations and treatments delivered to patients were retrieved from patient notes at the end of the study, and costs were provided by the hospital finance department. All cost elements were summed to provide a total cost per patient of the intervention over the first 6 months.

Analysis

All economic analyses were conducted using STATA13 (Stata Statistical Software, release 13; StataCorp LP, College Station, TX, USA). Results presented are based on a complete case analysis for those subjects with complete data at baseline and 6 months, covering resource use, IBDQ-B and SF-12. Three sets of analysis were conducted: nurse-led intervention was compared with usual care (booklet), consultant-led intervention was compared with usual care and, finally, consultant-led care was compared directly with nurse-led care.

Cost utility (QALY)

The cost-effectiveness of the intervention was assessed as an incremental cost-effectiveness ratio (ICER). This is the incremental cost per QALY gained, when moving from usual care (booklet arm) to either nurse-led algorithmic care, consultant-led algorithmic care or comparing nurse with consultant.

The incremental costs and incremental QALYs were estimated simultaneously using a seemingly unrelated regression (SUR). No covariates were included for estimation of costs. However, in the QALY equation, baseline utility score was included to control for patient-level differences at baseline.24

Uncertainty was handled non-parametrically using bootstrap with replacement.25 Samples (n=10,000) of equal size to the original sample were drawn, and the incremental costs and QALYs were estimated using the SUR for each of the bootstrap samples. The results of this process are presented on a cost-effectiveness plane. In addition, the probability that each treatment would be deemed cost-effective at the NICE threshold willingness to pay of £20,000–£30,000 per QALY was calculated and presented in a cost-effectiveness acceptability curve and cost-effectiveness acceptability frontier (CEAF).

Cost-effectiveness (IBDQ-B)

The same non-parametric bootstrap sampling approach was used, as described earlier, using the IBDQ-B outcomes, and the results were presented as cost per six-point (clinically relevant) change in IBDQ-B score.

Ethical considerations

The ORBIT study gained a favorable ethical opinion following review by the Royal Marsden Research Ethics Committee (later named NRES Committee London – Chelsea), reference 07/Q0801/47. All participants provided informed written consent for their data to be used in the study. The trial is registered with ClinicalTrials.gov, number NCT00737230.

Results

Characteristics of participants

Of 2,484 patients assessed for eligibility, 218 participated and the rest were ineligible (n=876), not contactable (185), reported no new symptoms (934) or refused (271).5 At randomization, 68, 80 and 70 participants were allocated to the usual care (booklet), nurse-led algorithmic care and consultant-led algorithmic care groups, respectively. At 6 months, loss to follow-up and withdrawals from the study reduced these sample sizes to 57, 62 and 59, respectively (n=178). Of these 178 participants, 159 (47, 61, 51) had complete data on the SF-12 at baseline and 6 months, sufficient to estimate a health utility index. Three of the 159 patients had no information captured on the duration of their baseline clinical consultation, so simple imputation was applied using the mean duration for the appropriate treatment arm, rather than dropping the patients from the analysis. There were 182 (57, 66, 59) patients with IBDQ-B data at baseline and 6 months.

Based on those patients with complete data for costs and SF-12 at baseline and 6 months, the unconditional mean (SD) cost of treatment was £895 (499) and £1101 (567) for nurse and consultant-led treatments, respectively (Table 1). The consultant was more costly than the nurse in clinical time (due to higher unit costs) and in use of investigations and prescribing. The higher value of medications in the consultant arm is driven by a few outliers (median [interquartile range] medication cost £1.05 (0–35) for nurse and £25.80 (0–35) for consultant). When the complete case sample was delimited based on IBDQ-B rather than SF-12, the sample size increased marginally, but this did not result in a significant change in resource use or costs (Table 1). The cost of treatment for the usual care arm (booklet) is treated as zero, since there is no required clinical contact, or additional prescription of medication.

Table 1

Resources and costs (British pounds 2013)

Treatment group	N	Baseline consultation duration			Additional consultationsa			Investigations, treatments		Medications		Total cost
		Mean (min)	SD (min)	Costb (£)	Mean, n	SD	Costb (£)	Mean costc (£)	SD	Mean costd (£)	SD	Mean (£)	SD
Based on participants with SF-12 (QALY) data at baseline and 6 months
Nurse	61	47.5	21.5	70	1.03	0.86	22.66	786	493	17	23.77	895	499
Consultant	51	29.7	15.8	162	0.98	0.95	80.12	793	527	66	152.46	1101	567
Based on participants with IBDQ-B data at baseline and 6 months
Nurse	66	47.8	20.9	70.	1.03	0.86	22.66	768	494	17	23.25	878	498
Consultant	59	29.4	14.9	159	1	1	82.60	764	536	69	166.7	1075	580

Notes:

Duration based on 15-minute consultation.

Unit costs for specialist nurse is £88/hour23 and for gastroenterologist is £162/consultation of 30 minutes.22

Costs of investigations and treatments supplied by the hospital finance department: abdominal X-ray £49.95; anal ultrasound £77.23; bloods battery £75.12; colonoscopy £683.00; CT scan £120.34; flexible sigmoidoscopy £436.95; breath test £142.28; MRI scan £288.97; SehCAT scan £265.00; stool culture £28.13; endoscopy £491.56; fecal elastase £15.76; liver ultrasound £77.23.

Total cost of medications per patient supplied by clinical team.

Abbreviations: CT, computerised tomography; IBDQ-B, Inflammatory Bowel Disease Questionnaire; MRI, magnetic resonance imaging; QALY, quality-adjusted life year; SehCAT scan, selenium homocholic acid taurine scan; SD, standard deviation; SF-12, Medical Outcomes Study’s Short-Form 12.

Outcomes

All three treatment arms saw small improvements in utility between baseline and 6-month follow-up, the smallest mean increase being in the nurse-led arm. None of the changes were statistically significantly different from zero. The mean QALY gains over the 6-month period in the consultant and nurse arms were not significantly different from those in the booklet arm, and there was no significant difference between the improvements in the nurse or consultant groups (Table 2).

Table 2

Outcomes

Treatment group	N	Utility score (baseline)		Utility score (6 months)		Incremental QALYs gained versus booklet groupa
		Utility	SD	Utility	SD	Mean	SD
Based on participants with SF-12 (QALY) data at baseline and 6 months
Booklet	47	0.776	0.200	0.797	0.170
Nurse	61	0.789	0.172	0.792	0.177	−0.0036	0.005
Consultant	51	0.799	0.165	0.829	0.157	0.0044	0.005
Consultant vs. nurse	51					0.0076	0.006
	N	IBDQ-B score (baseline)		IBDQ-B score (6 months)		Incremental change in IBDQ-B score vs. booklet groupa
Based on participants with IBDQ-B data at baseline and 6 months
Booklet	57	52.53	12.66	57.46	12.86
Nurse	66	52.95	10.13	62.00	10.21	4.12b	2.0 (SE)
Consultant	59	52.62	10.93	60.68	10.76	5.07b	2.16 (SE)
Consultant vs. nurse						0.95	1.68 (SE)

Notes:

Incremental QALY gain based on ordinary least squares regression estimates controlling for baseline utility.

Differences between groups statistically significant at a 5% level using two-sample t-test. Within-group changes were significant for nurse and consultant, but not for booklet.5

Abbreviations: IBDQ-B, Inflammatory Bowel Disease Questionnaire; SD, standard deviation; QALY, quality-adjusted life year; SE, standard error; SF-12, Medical Outcomes Study’s Short-Form 12.

The mean IBDQ-B scores improved in all three groups over the 6 months. The change in the mean IBDQ-B score was larger in the consultant than nurse arm, but the difference between these two changes was not statistically significant. However, the changes in both intervention arms were significantly larger than the change in the booklet arm.

Cost-utility analysis

In the cost-utility analysis (Table 3; Figure 1), the nurse-led arm was dominated by the usual care (booklet arm), being more expensive and having worse health (QALY) outcomes in approximately two thirds of the 10,000 sampling realizations. The consultant-led treatment, compared to usual care, was more expensive but led to better health outcomes in more than half of the sampling realizations (mean cost per QALY gained [ICER]=£250,455). When the consultant-led treatment is compared to the nurse-led treatment, there is a small incremental cost, but in the majority of sampling realizations, the consultant-led treatment resulted in better health outcomes (mean cost per QALY gained [ICER]=£25,875).

Table 3

Cost-utility and cost-effectiveness analysis

Cost-utility analysis	N	Incremental cost (£)	Incremental mean change in QALY	ICER (incremental cost per QALY gained)
Nurse vs. booklet	108	£895	−0.0036	Dominated
Consultant vs. booklet	98	£1102	0.0044	£250,455
Consultant vs. nurse	112	£207	0.0076	£25,875
Cost effectiveness analysis	N	Incremental cost (£)	Incremental mean change in IBDQ-B score	ICER (incremental cost per 6-point IBDQ-B score gain)
Nurse vs. booklet	123	£878	4.12	£1279
Consultant vs. booklet	116	£1076	5.07	£1273
Consultant vs. nurse	125	£198	0.95	£1251

Abbreviations: IBDQ-B, Inflammatory Bowel Disease Questionnaire; ICER, incremental cost-effectiveness ratio; QALY, quality-adjusted life year.

Figure 1

QALY scores: cost-effectiveness planes and cost-effectiveness acceptability frontier.

Abbreviation: QALY, quality-adjusted life years.

For each of the 10,000 realizations, the three treatments can be ranked in terms of which yielded the most cost-effective result for a given willingness to pay per QALY. The frequency of ‘wins’ from these rankings over the 10,000 samples is an estimate of the probability the treatment would be deemed the most cost-effective when compared to the alternatives. This analysis generates the CEAF. The nurse-led treatment option is dominated by both the booklet and consultant-led treatment options. At the lower willingness to pay per QALY, the booklet is favored and, at a WTP of £30,000 (the upper limit normally imposed by NICE), the booklet arm is predicted to have a near 100% likelihood of being the most cost-effective. Above a WTP of ~£250,000 per QALY gained, the consultant-led treatment is favored with ~52% probability of being the most cost-effective treatment option (Figure 1). This result suggests that although the consultant-led treatment leads to marginally better treatment outcomes on average, than either usual care (booklet) or the nurse-led treatment, the gain in QALY is too small to offset the relatively high incremental cost.

Cost-effectiveness analysis

Results of the probabilistic analysis using the IBDQ-B change from baseline differ from those using the QALY as the outcome measure (Table 3; Figure 2). For the IBDQ-B analysis, the bootstrap samples, for both the comparison of the consultant and the nurse with the booklet arm, are to the right of the zero line indicating both achieved a benefit compared to the usual care/booklet arm.

Figure 2

IBDQ-B scores: cost-effectiveness planes and cost-effectiveness acceptability frontier.

Abbreviation: IBDQ-B, inflammatory bowel disease questionnaire.

The CEAF suggests that at lower willingness to pay per 6-point gain in IBDQ-B score, the booklet has the highest probability of being the most cost-effective intervention. At ~£1280, this shifts in favor of the nurse-led arm, which has ~45% probability of being the most cost-effective intervention. Beyond a willingness to pay of £2000 per 6-point IBDQ-B change, the consultant-led intervention is favored at a probability of ~50%. This probability tends asymptotically towards a probability of ~62% as the willingness to pay increases to £8000. This shift towards the consultant-led intervention is driven by the marginally better health outcomes this intervention achieved. However, without a defined threshold willingness to pay per 6-point change in IBDQ-B score, which is independently justifiable (equivalent to the NICE £30,000 per QALY), it is hard to make a judgment over which intervention is most favored by this analysis. Both the nurse- and consultant-led intervention achieve better health outcomes, as measured using the IBDQ-B; however, on average neither have a high likelihood of being deemed the most cost-effective, when compared to the booklet arm alone.

Discussion

The provision of algorithmic-based treatment to patients experiencing enduring gastrointestinal symptoms after radiotherapy for cancer costs ~£1100 when delivered by a consultant gastroenterologist and £895 when delivered by a specialist nurse (British pounds 2013). Symptoms improved to a similar extent in both algorithmic care groups over a 6-month period, and significantly more than in a group of patients receiving only a self-help booklet. At a societal willingness to pay below £1280 for a clinically significant improvement in symptoms (i.e., at least a 6-point change in IBDQ-B), the booklet has a high probability of being the most cost-effective option. As the willingness to pay rises above that level, the nurse and then the consultant become more likely to be cost-effective, but the probabilities do not rise above 50% until a willingness to pay of about £3000 is reached. Simply put, the algorithmic care achieves better outcomes as reflected in IBDQ-B scores, and this comes at an additional cost of around £1000.

The finding that outcomes of nursing care are largely equivalent to those of doctors is consistent with other studies as shown in endoscopy clinics26 and in soft tissue clinics in an emergency department.27 As well as having similar outcomes, the use of nurses has also been shown to reduce costs compared to doctors in outpatient departments28 and rheumatoid arthritis clinics.29 As other studies compare the two types of practitioners in the delivery of usual care, this study focused on the evaluation of a new intervention. Lower costs associated with the nurse-led care was largely attributable to salary differences, and less medication prescribing; the application of the algorithm resulted in very similar diagnostic and non-pharmacological treatment costs for the two types of practitioners.

Although patients in the trial recorded clinically and statistically significant improvements in bowel symptoms as a result of the nurse and consultant interventions, commensurate changes in generic health-related quality of life (QALYs) were not found. At the upper limit of the NICE threshold of willingness to pay of £30,000/QALY gained, the booklet arm has a near 100% chance of being the most cost-effective option. The incremental cost of consultant- and nurse-led treatments, compared to usual care, were too high, given the small utility gains, to be deemed cost-effective options. A societal willingness to pay in the region of £250,000/QALY gained is required before the consultant treatment achieves a 50% probability of being the most cost-effective option. The nurse option was not found to be cost-effective compared to either the booklet- or consultant-led care. A comparison of care of people with rheumatoid arthritis by nurse and rheumatologist similarly showed the nurse was not cost-effective, as measured using QALYs estimated from generic utility scores.29 Therefore, caution must be taken when considering provision of care based solely on the generic health-related quality of life instruments that may not capture the full patient benefit of symptom-specific interventions. The marginal cost of treating post-radiotherapy symptoms identified in this study (~£1000) is relatively small when considering the overall cost of the cancer treatment already incurred for this patient group. Moreover, inflammatory bowel disease, which affects equivalent numbers of people and incurs similar symptoms, is routinely managed through specialist supportive secondary care.30

The economic analysis had several limitations. Bias may have arisen from non-random missing data. The conversion of SF-12 scores to SF-6 and then EQ-5D utility may have caused lack of precision in the calculation of QALYs. In addition, given a significant change was detected in the disease-specific IBDQ-B measure, it is possible that the SF-12 instrument may have been insensitive to changes in the symptom-specific quality of life of these patients. Although attempts were made to gather data from participants on use of other services over the 6-month observation period, many did not return usable information so potential healthcare savings to offset the cost of the intervention could not be explored. The length of follow-up consultations was not recorded, and the assumption of 15 minutes may underestimate the costs. The usual care comparison condition was not entirely representative of treatment as usual as many people with gastrointestinal symptoms after radiotherapy do not receive any information or treatment in the UK. Hence, provision of a booklet and the opportunity to receive treatment from the consultant if symptoms remained at 6 months represented an enhancement on usual care for people recruited to the trial.

Conclusion

The clinical trial and cost-effectiveness analysis were conducted robustly and evaluated an important new treatment for cancer survivors. This patient group often tolerates significant gastrointestinal symptoms and reduced quality of life in the belief that this is the normal sequel to radiation therapy. Although evidence for cost-effectiveness according to the NICE criteria was not found in this study, participants in both intervention groups recorded, on average, significantly (statistically and clinically) greater improvement in bowel symptoms than those in the booklet-only group. Monitoring the continuing side effects of radiation therapy and providing treatment for radiation injury would add some £1000 to the overall package of care for cancer patients which, for example, currently costs between £10,000 and £15,000 for bowel cancer (based on applying the GDP deflator to figures from 2007).31,32 The failure of the economic evaluation to show cost-effectiveness of the treatment algorithm in terms of cost per QALY gained may reflect the reliance of the criterion on a generic measure of health-related quality of life and should not be viewed in isolation. Improvements in this instance are highly symptom specific; therefore, relying on the generic measure of quality of life may not capture the full patient benefit from this intervention, as evidenced by the clinical IBDQ-B results.5 The cost-effectiveness of the booklet suggests that a care pathway might be developed where patients with bowel symptoms after pelvic radiotherapy are offered the self-help booklet first, and if troublesome symptoms remain after 6 months, they are referred for specialist algorithmic care.