Cost-Effectiveness of Constraint-Induced Movement Therapy Implementation in Neurorehabilitation: The ACTIveARM Project.

BACKGROUND: Constraint-induced movement therapy (CIMT) is a recommended intervention for improving arm recovery following stroke and traumatic brain injury; however, delivery in practice remains rare.
PURPOSE: The aim of this study was to investigate the costs and cost effectiveness of CIMT delivery, and the use of a CIMT implementation package designed to improve CIMT uptake and delivery by therapists in Sydney, Australia.
METHODS: This economic evaluation was conducted with a subset of CIMT programmes (n = 20) delivered by neurological rehabilitation teams at five varied hospitals within a mixed methods implementation study (ACTIveARM). The costs of delivering the CIMT implementation package and publicly funded CIMT were calculated using a bottom-up approach. A cost-effectiveness analysis was conducted, using decision analytic modelling. We compared the uptake and outcomes of people who received CIMT from health services that had received a CIMT implementation package, with those receiving standard upper limb therapy. An Australian health care system perspective was used in the model, over a 3-week time horizon (the average timeframe of a CIMT programme). All costs were calculated in Australian dollars (AUD). Inputs were derived from the ACTIveARM study and relevant literature. The Action Research Arm Test was used to measure arm outcomes. Sensitivity analyses assessed the impact of improving CIMT uptake, scale-up of the implementation package and resource adjustment, including a 'best-case' scenario analysis.
RESULTS: The total cost of delivering the implementation package to nine teams across five hospitals was $110,336.43 AUD over 18 months. The mean cost of delivering an individual CIMT programme was $1233.38 AUD per participant, and $936.03 AUD per participant for group-based programmes. The incremental cost-effectiveness ratio (ICER) of individual CIMT programmes was $8052 AUD per additional person achieving meaningful improvement in arm function, and $6045 AUD for group-based CIMT. The ICER was most sensitive to reductions in staffing costs. In the 'best-case' scenario, the ICER for both individual and group-based CIMT was $245 AUD per additional person gaining a meaningful change in function.
CONCLUSION: Therapists improved CIMT uptake and delivery with the support of an implementation package, however cost effectiveness was unclear. CLINICAL TRIAL REGISTRATION: https://anzctr.org.au/Trial ID: ACTRN12617001147370.

Key Points for Decision Makers

Introduction

Stroke is a leading cause of long-term disability, with around 40% of Australian stroke survivors experiencing disability impacting their independence with daily activities [1, 2]. Arm impairment is common after stroke and traumatic brain injury (TBI). Approximately two-thirds of stroke survivors experience arm impairment affecting their function [3]. Stroke and TBI also have a large economic impact. The estimated Australian healthcare expenditure for stroke was over $606 million Australian dollars (AUD, $1 AUD = $0.78 USD 1 June 2021 [4]) between 2008 and 2009, accounting for 0.5% of total healthcare expenditure nationwide ($113.6 billion AUD) [1]. Similarly, the lifetime costs associated with TBI are high. Lifetime costs per person who sustains a TBI have been estimated to be $2.5 million AUD per person with moderate TBI and $4.8 million AUD per person with severe TBI [5].

Whilst there are published studies exploring the cost effectiveness of models of stroke care [6] and the introduction or scale up of acute stroke interventions [7-11], there has been limited exploration of the cost effectiveness of stroke and acquired brain injury rehabilitation interventions. Stroke rehabilitation costs around $150 million AUD per year in Australia, forming the largest component of first-year costs post-stroke, at almost 30% [12]. Healthcare costs in Australia for moderate and severe TBI have been estimated at $269.1 million AUD and $308.0 million AUD, respectively, with substantial costs also associated with long-term care ($962.5 million AUD for severe TBI) and productivity losses ($256.3 million AUD) [5]. Considering these significant costs, investigation of the costs and cost effectiveness of rehabilitation interventions are needed. Additionally, there has been limited exploration of the costs and cost effectiveness of providing clinicians with support to implement evidence-based interventions into practice, which is vital to improve the long-term outcomes for stroke survivors [13] and people with TBI.

Constraint-induced movement therapy (CIMT) is a highly effective intervention for arm recovery after stroke [14] and has also been demonstrated to improve arm function after TBI [15-17]. CIMT comprises three core components: a high intensity, task-specific retraining programme using the affected arm, a restraint (mitt) worn on the non-affected hand encouraging use of the affected hand, and a transfer package comprising behaviour change strategies to encourage generalisation of skills into daily life [18]. CIMT has evolved over time, with different models of CIMT delivery described in the literature, varying in intensity, duration and restraint-wearing time [14]. CIMT is recommended as an intervention for eligible stroke survivors and people with brain injury in the Australian stroke guidelines [19], and clinical practice guidelines for acquired brain injury internationally [20, 21], yet routine delivery of CIMT is rare. A recent national audit indicated that only 12% of eligible Australian stroke survivors received CIMT during their rehabilitation [22]. Barriers to implementing CIMT have been explored in several studies [23-26] where therapists identified a perceived lack of knowledge and skills, insufficient support from colleagues and lack of time and resources as key barriers. Another barrier to CIMT implementation are the costs associated with delivering the intervention. In Australia, CIMT has primarily been offered by private practitioners at a significant out-of-pocket expense to the patient of between $5000 and $10,000 AUD for a 2-week programme with limited reimbursement options via private health insurance or government funding. Similarly, in the United States of America (USA) the structure of reimbursement for interventions via health insurance often does not support the intensive model of CIMT [18], preventing access to funding support for eligible people to receive the intervention.

Research investigating the costs and cost effectiveness of CIMT is limited. A cost-impact analysis conducted in the Ontario Health Service, Canada, calculated the costs of CIMT in addition to usual upper limb rehabilitation. Usual upper limb rehabilitation was calculated at 30 minutes per day, 5 days per week [27]. CIMT costs were based on a range of six treatment options, including variations in programme duration (10 days vs 15 days), and therapy time (total therapy range 30–52.5 h) [27]. They found CIMT cost was between $884 and $1857 Canadian dollars (CAD) per stroke survivor when combined with usual care, compared with $177 CAD for usual upper limb care alone [13]. This equates to between $0.59 million and $1.22 million CAD additional costs if all eligible stroke survivors in Ontario received CIMT in 2011. In the United Kingdom, a systematic review that included modelling of resource use, costs and effectiveness for repetitive functional task practice found that this therapy, which included CIMT, was cost effective, with an incremental cost-effectiveness ratio (ICER) of £10,870 GBP per quality-adjusted life-year (QALY) [28]. Research on the cost effectiveness of CIMT from the societal viewpoint has also been limited. One retrospective study of participants who had received CIMT in the USA (n = 121) found that after the CIMT programme, some participants’ caregivers were able to resume employment, even though the CIMT participants themselves may have retired from the workforce [29].

To date, the costs and cost effectiveness of supporting therapists to implement CIMT in routine practice have not been explored. Similarly, there is limited evidence on the costs and cost effectiveness of CIMT delivery, particularly in the Australian context. Our aim was to investigate the costs and cost effectiveness of a CIMT implementation support package provided to therapists treating adults with arm impairment after stroke or TBI, and the costs of CIMT programme delivery.

The objectives were to estimate

The costs of delivering a CIMT implementation support package.

The costs of delivering CIMT (either individual or group-based) at a service level within a public health setting.

The cost effectiveness of a CIMT implementation support package in terms of the arm recovery of stroke survivors and people with TBI.

Method

Design

We conducted a bottom-up costing of an implementation support package and delivery of CIMT in practice. CIMT cost effectiveness was modelled from the Australian health system perspective, as the purpose of the ACTIveARM study was to inform health system policy and improve delivery of CIMT within the health service. The cost-effectiveness model compared the uptake of CIMT in practice following delivery of the implementation package and associated arm outcomes with standard care. This study was embedded within a larger mixed methods implementation study, the ACTIveARM project (Australian Constraint Therapy Implementation study of the ARM) [30].

The ACTIveARM Implementation Support Package

The ACTIveARM implementation support package targeted behaviour change among physiotherapists, occupational therapists and allied health assistants to increase delivery of CIMT to eligible stroke survivors and people with brain injury. The implementation package included 2-day training workshops, monthly community of practice meetings, onsite support, quarterly audit and feedback to teams about their practice, and poster reminders.

The implementation package was delivered to participating teams between March 2017 and September 2018. The primary outcome for the ACTIveARM project was the proportion of eligible people who were offered, and received, CIMT. CIMT is a suitable intervention for those with mild to moderate upper limb impairment after stroke or TBI. Eligibility for CIMT was determined in accordance with the Australian national clinical guidelines for stroke management [19], which recommends that to be eligible for CIMT, individuals should have some movement in at least two fingers and thumb in the affected hand.

Outcomes were collected using file audits at three baseline timepoints (T1–T3) prior to delivery of the implementation package, and then quarterly for 18 months during the supported implementation period (T4–T9). The final audit and feedback cycle was 6 months after withdrawal of the implementation package (T10). Secondary outcomes relating to CIMT participants’ arm function were collected pre-CIMT, post-CIMT and 4 weeks after programme completion. Arm outcomes were measured using the Action Research Arm Test (ARAT) [31], Canadian Occupational Performance Measure [32], Nine Hole Peg Test [33], Box and Block Test [34], and Motor Activity Log [35].

Each team in the ACTIveARM project implemented a locally tailored model of CIMT service that maintained the three core components of CIMT. CIMT was delivered using either a one therapist/one participant model (individual) or group therapy. Programmes were delivered either 5 days/week for 2 weeks or 3 days/week for 3 weeks as a range of CIMT protocols have been demonstrated to achieve efficacious outcomes [14, 36–38].

Setting

The study was conducted within the public healthcare system of South Western Sydney Local Health District, Australia. This District is one of the largest in New South Wales (NSW), servicing suburban and regional communities [39]. Four acute hospitals and one subacute hospital providing specialist acute and rehabilitation services for people with stroke and TBI participated in the ACTIveARM project. Services included inpatient acute care and subacute care, outpatient and community-based rehabilitation teams. Services are provided under the Australian universal healthcare (Medicare) system at no cost to individuals [40]. Refer to Supplementary Table A in the electronic supplementary material (ESM) for further details regarding participating teams.

Model Structure

Our model compared the costs and effectiveness of CIMT against standard care, when CIMT was implemented with the support of an implementation package. We developed a decision tree using Microsoft Excel (Fig. 1) to reflect the relatively simple clinical pathway and short time horizon [41]. The decision tree time horizon was 3 weeks, consistent with the time from determining a person’s eligibility for CIMT to completion of the CIMT programme (maximum 3 weeks) and the duration of standard rehabilitation upper limb therapy (average 2.5 weeks).

Fig. 1

CIMT decision analytic tree structure, showing costs (in Australian dollars), probability of uptake and outcomes. CIMT constraint-induced movement therapy, MCID minimal clinically important difference

Model Inputs: Costs

Supplementary Table B summarises the parameters used in the model (see ESM). All costs are expressed in 2017–2018 Australian dollars (AUD). Costs of the implementation package and therapist time delivering CIMT were collected using a bottom-up approach. Costs associated with delivery of the implementation package to nine teams across five hospitals, including printing and travel costs, were recorded by the research team. Treating therapists self-reported time spent preparing, delivering and following up CIMT programmes (in minutes) for a subset of CIMT programmes conducted during the ACTIveARM mixed methods implementation study. Information from a subset of 20 CIMT programmes (15 individual and five group programmes) delivered during the ACTIveARM study implementation period (T4-T9) that involved 34 patient participants were collated for therapist inputs. Data were also collected on therapist resource use and equipment (such as restraint mitts). As the implementation package was delivered at the level of the team, and it is unknown in advance which patients will be eligible for CIMT and which will not, implementation package costs were spread across both eligible and ineligible patients, consistent with an implementation science approach and application of training in a real-world setting. Therapy costs associated with CIMT were assigned only to patients who received CIMT.

Therapist costs were based on the salary level of individual staff using the appropriate NSW Health Awards for the relevant financial year [42-47]. Resources used for delivery of both the therapist implementation package and CIMT programmes for patient participants were costed using actual purchase prices. As the time horizon for the cost-effectiveness period was < 12 months, neither costs nor outcomes were discounted.

Model Inputs: Outcomes

CIMT Uptake

CIMT uptake was defined and measured as the proportion of eligible individuals with stroke or TBI who were offered and received CIMT 18 months after delivery of the implementation package (timepoint T9). At this timepoint, 46% of eligible individuals received CIMT (n = 41 people eligible, n = 19 received a CIMT programme). The 18-month uptake rate allowed adequate time for services to deliver multiple CIMT programmes and embed CIMT into routine practice. For the standard care arm of the model, the average pre-implementation baseline delivery of CIMT (2%) was assumed to stay consistent. Refer to Supplementary Table A in the ESM for details of CIMT delivery per team.

CIMT Effectiveness

The primary effectiveness outcome measure in the economic model was the proportion of patients who achieved a clinically meaningful improvement in arm function on the ARAT [48] post-CIMT programme from a sample of 64 CIMT participants (n = 57 stroke survivors [89%], n = 7 TBI survivors [11%]) over the course of the ACTIveARM study. Due to the lack of an established minimal clinically important difference (MCID) for the ARAT in a TBI population, we used the established MCID for acute and chronic stroke populations for both stroke and TBI participants. A clinically meaningful improvement in arm function, or MCID, was defined for the ARAT as an improvement of 12 points or more for individuals in the acute phase of recovery [49], an improvement of 5.7 points or more for individuals in the chronic phase of recovery [50, 51] or achieving the maximum score of 57/57. Tasks completed to achieve the maximum score on the ARAT include being able to pick up a cup and pour water from it, lifting an object to above shoulder height and picking up small objects (including a marble) between the index finger and thumb [48].

Standard Care

Standard care estimates for the model came from data describing upper limb therapy provided to inpatient stroke survivors and their arm outcomes in a previously published cohort study at one of the ACTIveARM hospital sites [52, 53]. Inpatient stroke survivors at that site completed a mean of two upper limb therapy sessions per week [52]. Approximately half (53%) were reported to achieve either the MCID or the maximum score (57/57) on the ARAT between admission and discharge with standard upper limb rehabilitation [53]. CIMT was not routinely offered at this hospital site at the time these data were collected.

Incremental Cost-Effectiveness Ratios (ICER)

ICERs were calculated as the additional costs required for an additional person to achieve a clinically meaningful improvement in arm function (measured as achieving the MCID or maximum score on the ARAT) after completing CIMT compared with standard care. An ICER was calculated for CIMT delivered as an individual programme, CIMT delivered as a group-based programme, and CIMT individual and group programmes combined by using the average costs of individual and group programmes.

Because there is no standard accepted threshold for the value of achieving the MCID on the ARAT, we are unable to define at what ICER the intervention is deemed cost effective within the Australian public health care setting; however, we have calculated confidence intervals (CIs) around the ICER and present a cost-effectiveness acceptability curve (CEAC) to aid interpretation.

Sensitivity Analysis: One-Way Sensitivity Analysis and Scenario Analysis

One-way sensitivity analyses were conducted to understand the impact of different parameter assumptions on the baseline ICER, with results presented in a tornado plot. We investigated:

Varying uptake of CIMT within a health service. This analysis was conducted in three ways. First, an attainable and objective benchmark was established using the Achievable Benchmark of Care (ABC) method [54]. Using this methodology, we ranked the nine ACTIveARM teams in relation to their delivery of CIMT, adjusting for teams with small patient numbers. Based on this, uptake for the sensitivity analysis was set at 58% of eligible people receiving CIMT. Second, we considered it realistic for health services to set a goal of offering CIMT to all eligible patients (i.e. 100%), since CIMT is the only upper limb intervention that is strongly recommended in the Australian stroke guidelines [13]. Assuming some patients may decline CIMT due to personal preference, we set uptake as 80% of eligible people receiving CIMT. Finally, we considered that following withdrawal of the implementation package, therapists may reduce their delivery of CIMT by 50% without the availability of support. We therefore reduced the proportion of eligible people who received a CIMT programme to 21%.

Implementation package delivered at scale We assumed the CIMT implementation package would be scaled up and delivered across other health districts (for example, as part of a state-wide rollout). For this we only included ongoing implementation package costs and costs of CIMT delivery. Costs such as production of training videos and development of workshop materials were excluded as they had already been prepared. Costs included provision of two training workshops per health district, one day of onsite support during each team’s first CIMT programme, and monthly CIMT community of practice teleconferences for 12 months.

Varying resourcing costs In the base-case scenario, resourcing (i.e. staffing) costs are estimated as additional to existing time spent delivering standard upper limb therapy. However, as no additional staff were employed to run CIMT, and staff workloads were adjusted to accommodate CIMT, we conducted a sensitivity analysis to assume no opportunity cost when staff delivered CIMT instead of standard therapy (i.e. staff integrated CIMT into their usual work practices). We therefore only included the additional costs of the implementation package (e.g. training workshops) to support therapists to initially implement then sustain CIMT programmes over time, along with resource costs such as assessment kits. We also explored the impact on outcomes if costs to deliver CIMT and the implementation package had been underestimated and costs were to increase by 30%.

Finally, we also conducted a scenario-based sensitivity analysis. We developed a ‘best-case’ scenario for each assumption in the model, based on the literature and experience in the ACTIveARM study. In this best-case scenario, we assumed 80% of people who were eligible for CIMT received CIMT (as some eligible people may decline CIMT based on personal preferences), that 67% of those who completed CIMT achieved a MCID or full score on the ARAT (based on patient outcome data from the ACTIveARM study), and that only the additional costs of the implementation package were paid for by the health service, with staff time reallocated from existing resources and therefore no costs associated with staff time.

Stochastic Sensitivity Analysis

As the ICER is a ratio and cost data is typically skewed, non-parametric methods are required to calculate confidence intervals for the ICER [55]. We used non-parametric bootstrap, where repeated random samples from the ACTIveARM CIMT population, of the same size as the original sample (n = 64), were taken from 1000 replications. We present the bootstrapped CI along with the cost-effectiveness plane [56] for the bootstrapped cost-effectiveness pairs for the base-case analysis.

Given the uncertainty around willingness to pay for improvements in upper limb function, we also present the bootstrapped cost-effectiveness results as a CEAC [55]. This displays the probability of cost effectiveness at thresholds between $0 and $50,000 per additional participant achieving either the MCID or maximum score on the ARAT, and we report the probabilities for the threshold values of the average daily cost ($1701 AUD) and the average total cost ($10,890 AUD) of a hospital admission for a stroke with intermediate complexity [57] to illustrate interpretation of the graph.

Results

Costs of Delivering a CIMT Implementation Package

Supplementary Table B shows the various costs of delivering the CIMT implementation package. The total cost of the implementation package when delivered to therapists across nine teams was $110,336.43 AUD. This equates to $98.08 AUD per person that was potentially eligible to receive CIMT during the ACTIveARM study (n = 1125).

Costs of Delivering a CIMT Programme

The mean cost of delivering an individual CIMT programme was $1233.38 AUD per participant, and the group format was $936.03 AUD per participant compared with $263.70 AUD for standard therapy (see Table 1). The mean time spent by therapists preparing for, delivering then providing follow-up after an individual CIMT programme was 33.5 h per participant (range 13.1–61.9 h), and 24.6 h per participant when delivered in a group (range 5.7–53.0 h) (see Table 1).

Table 1

Costs of delivering a CIMT implementation package and of delivering standard care, an individual CIMT programme or group CIMT programme, and best-case scenario cost inputs

Costs of upper limb programme delivery	Average therapist time (hours)	Average therapist cost for treatment time (AUD)
Standard care	5.00	$263.70
Individual CIMT programme	33.49	$1233.38
Group CIMT programme	24.62	$936.03
‘Best-case scenario’ analysisa individual programme	33.49	$0
‘Best-case scenario’ analysisa group programme	24.62	$0

AUD Australian dollars, CIMT constraint-induced movement therapy

aBest-case scenario assumes 80% uptake, all therapy delivered within existing resources, and scaled up delivery of implementation package

The Cost-Effectiveness of a CIMT Implementation Package in Terms of Arm Recovery

Sixty-seven percent of people who received a CIMT programme achieved the MCID or full marks on the ARAT compared with 53.1% in the usual care group. Taking into account that not all people who were eligible received CIMT and assuming equal effectiveness of group and individual therapy, overall effectiveness was 59.6% for people who were eligible for CIMT (incremental effect 6.5%). Similarly, total costs, accounting for uptake, used in the cost-effectiveness analysis were $811.14 AUD for individual CIMT and $673.34 AUD for group CIMT in the intervention arm, compared with $286.39 AUD for individual therapy and to $279.43 AUD for group therapy in the standard care arm (incremental cost for individual CIMT = $524.75 AUD; group CIMT = $393.91 AUD).

The ICER equated to a cost of $8052 AUD for individual CIMT, $6045 AUD for group-based CIMT, and $7048.39 AUD for combined individual and group CIMT per additional person gaining a meaningful change in arm function as measured by the ARAT (See Table 2).

Table 2

Cost-effectiveness outcomes of base-case and best-case scenario analysis—effects, costs and ICERs

	Effect (%)			Cost (AUD)			ICERc
	Control	Intervention	Incremental effectiveness	Control	Intervention	Incremental cost	Per case
Group-based CIMT base casea	53.13	59.64	6.52	$279.43	$673.34	$393.91	$6044.51
Individual CIMT base casea	53.13	59.64	6.52	$286.39	$811.14	$524.75	$8052.27
Best-case scenario (individual or group-based CIMT)b	53.00	58.00	5.00	$0.00	$12.23	$12.23	$244.60

AUD Australian dollars, CIMT constraint-induced movement therapy, ICER incremental cost-effectiveness ratio

aBase-case analysis assumes 46% uptake in the intervention arm, 2% uptake in the control arm

bBest-case scenario analysis assumes 80% uptake in the intervention arm, 0% uptake in the control arm

cSome ICER results differ slightly due to rounding. ICER represents cost per additional person achieving meaningful improvement or full score on Action Research Arm Test

Sensitivity Analyses: One-Way and Scenario Analyses

Results of the one-way sensitivity analyses are presented in Fig. 2. All results relate to outcomes per person achieving meaningful change in arm function. Increasing the delivery of CIMT within a health service from 46% of eligible people to the ABC-derived benchmark level of 58% had almost no impact on cost effectiveness ($7819 AUD for individual CIMT and $5789 AUD for group-based CIMT). Further increasing the delivery and uptake of CIMT to 80% of eligible people also had only a small impact on cost effectiveness ($7566 AUD for individual CIMT and $5513 AUD for group-based CIMT). Reducing the delivery and uptake of CIMT in a pessimistic scenario to 21% of eligible people increased the ICER by 56% for individual CIMT programmes ($9448 AUD) and by 25% for group CIMT ($7569 AUD).

Fig. 2

Sensitivity analysis tornado plot: change in ICER as a proportion associated with each change in assumptions. Costs in Australian dollars. CIMT constraint-induced movement therapy, ICER incremental cost-effectiveness ratio

Adjustment to the delivery of the implementation package at scale had a small impact on the ICER ($6735 AUD for individual CIMT and $4727 AUD for group-based CIMT). An increase in CIMT programme costs by 30% reduced cost effectiveness ($11,653 AUD for individual CIMT and $9043 AUD for group-based CIMT).

When we assumed that the cost of staff time to deliver CIMT instead of standard therapy was covered by existing resources, this resulted in a large improvement in cost effectiveness, with an ICER of $1505 AUD for both individual (− 81%) and group-based CIMT (− 75%).

The ICER for the best-case scenario model was $245 AUD per additional person gaining a meaningful improvement in their arm function.

Stochastic Sensitivity Analyses

Stochastic sensitivity analysis found that the bootstrap replications of the baseline ICER fell between $1376.17 AUD per additional person (lower limit of the 95% CI; north-east sector of the cost-effectiveness plane), and − $17,536.41 AUD per additional person (upper limit of the 95% CI; north-west sector of the cost-effectiveness plane) with meaningful change when group and individual therapy were combined (see Fig. 3). The 5.4% fraction of the bootstrap replications falling in the north-west quadrant of the cost-effectiveness plane (incremental cost > 0; incremental effectiveness < 0; negative ICER) suggests that CIMT when delivered with the implementation package may be dominated by usual care.

Fig. 3

Bootstrapping of incremental costs and effects for group and individual therapy (additional person achieving MCID or full marks [57/57] measured with ARAT). Costs in Australian dollars (AUD). MCID minimal clinically important difference, ARAT Action Research Arm Test

The CEAC (Fig. 4) displays the probability that CIMT implementation is cost effective at a range of willingness to pay (WTP) thresholds. With a WTP threshold of $1 AUD there is a 0.2% probability that CIMT will be cost effective, while at a $50,000 AUD threshold the probability of CIMT being cost effective is 93.7%. Using hospitalisation costs for stroke with intermediate complexity as further proxies for WTP thresholds, we see that at the average daily cost of admission ($1703 AUD [57]), the probability of CIMT being cost effective is 10%, while at the average total cost of admission ($10,890 AUD [57]), the probability of CIMT being cost effective is 88.4%.

Fig. 4

Bootstrapped cost-effectiveness acceptability curve (CEAC) showing probability of CIMT (with individual and group therapy combined) being cost effective at varying willingness-to-pay (WTP) thresholds from 0 to 50,000 per additional person achieving meaningful improvement in arm function. Costs in Australian dollars. CIMT constraint-induced movement therapy

Discussion

The implementation package resulted in increased delivery of CIMT in practice, and there were improved arm outcomes for CIMT participants when compared with the outcomes achieved from standard upper limb therapy. Our findings suggest that CIMT programmes have lower delivery costs in the Australian context compared with similar programmes delivered in Canada [27] and the United Kingdom [28], despite these programmes not including implementation support. The Canadian study only estimated therapist costs and used an average therapist pay to calculate costs whilst the United Kingdom study allocated some costs for staff training (up to 20 hours of therapist time per study), average equipment costs (£100 GBP per CIMT participant) and average therapist costs (£40 per therapist per hour) (UK results are based on 2005/06 prices).

While there is no established threshold to determine value for money in relation to arm function, the ICERs for individual ($8052 AUD) CIMT and to a lesser extent group-based CIMT ($6045 AUD) could be considered poor value for money when planning to deliver the CIMT implementation package and introducing CIMT into routine practice, and there is a 5% chance that it could be more expensive and less effective. However, our best-case scenario was developed based on realistic targets consistent with benchmarking literature [54] and reflective of clinical practice in the real world, and suggests that when therapists, within their existing roles, are supported to achieve best-practice rates of CIMT uptake (80%) and arm outcomes, the cost per person achieving meaningful improvement reduces significantly to $245 AUD. This suggests that supporting best-practice implementation of CIMT in the Australian health care system is achievable and may represent good value for money when compared with standard care, particularly when the average daily cost of a stroke hospital admission currently ranges from $1701 to $2106 AUD per day [57].

This study has implications for public health policy managers and health services with regard to resource allocation, which are outlined in the following sections.

Implications for Clinical Practice

In Australia, the average length of stay within inpatient stroke rehabilitation continues to fall (national average 22 days in 2018 [22] versus 26 days in 2015–2016 [2]). A shorter length of stay results in challenges with allocation of limited resources. Care is often transferred to outpatient rehabilitation where patients usually receive low-intensity individual upper limb therapy, on a weekly or fortnightly basis, for several weeks or months. We found that CIMT delivered as an individual or group-based programme resulted in worthwhile and meaningful improvements in arm function within 2–3 weeks. Our research suggests that around one third of the approximately 40,000 acute care hospitalisations with a principal diagnosis of stroke in Australia annually [58] are eligible for CIMT, and only 11% of eligible stroke survivors receive CIMT during their rehabilitation [59]. This indicates that over 10,000 Australians are missing out on this evidence-based intervention, which our research demonstrates can be successfully implemented in clinical practice [30] and may be cost effective. Considering the cost of CIMT delivery in the context of daily inpatient rehabilitation costs, CIMT is an attractive alternative to standard care. These intensive programmes lead to improvements in arm function in a shorter time, reducing service use and perhaps also reducing informal carer burden, which may improve the cost effectiveness of rehabilitation.

Furthermore, the use of technology for telehealth enables alternative modes of CIMT delivery, with further opportunities to improve cost effectiveness. In the current study, CIMT was predominantly delivered in person, with costs incurred for therapy time and therapist travel for follow-up. CIMT delivered via telehealth may reduce resource demands, improve programme uptake and reach to patients, thereby reducing overall costs. A few studies have demonstrated promising outcomes for arm recovery when CIMT is delivered via telehealth [60, 61] or online platforms [62, 63]. However, these studies have several limitations including small sample sizes and risk of bias associated with the methods used. Therefore, further research is required, evaluating both the efficacy and cost effectiveness of CIMT when delivered via remote methods.

Implications for Service Delivery and Policy

With investment in implementation support, we have demonstrated that CIMT can be implemented in acute, rehabilitation, inpatient and outpatient settings [30]. The modest cost of the CIMT implementation package, when delivered at scale, provides a model for applying these implementation strategies in practice. Furthermore, the costs associated with supporting CIMT implementation including staff education could be further reduced if CIMT training was provided as a standard part of the curriculum in occupational therapy and physiotherapy training programmes. This would reduce the need for site-specific training and education, with only booster training sessions needed to accommodate staffing changes.

Studies in acute stroke care have suggested that reducing evidence–practice gaps can have positive economic benefits [7]; however, few studies have explored the cost effectiveness of recommended rehabilitation interventions [64-66]. Challenges associated with evaluating the cost effectiveness of rehabilitation interventions such as CIMT include the complexity of the intervention and the significant variation in how outcomes are measured across services [67]. In this study, we focused on costing arm recovery. Future economic evaluations of CIMT should use a standardised approach to economic evaluations [64], including the use of measures to evaluate the impact of CIMT on level of disability (e.g. the modified Rankin Scale) [68] and quality of life (e.g. the EQ-5D) [69] in addition to the collection of measures of arm function, the primary area targeted by CIMT. Evaluation that incorporates outcome measures that can be expressed in QALYs would allow cost-utility analysis and comparison with established thresholds for assessment of cost effectiveness [41] and comparison across different interventions and areas of healthcare. Alternatively, discrete choice experiment methods to identify the WTP for gains in arm function would allow a threshold for cost effectiveness to be determined [70].

Implications for Future Research

Despite a large improvement in the proportion of people offered, then receiving CIMT, about half of the people offered CIMT in this study declined or did not receive a programme. To date, there has been limited research exploring the acceptability of CIMT from the stroke or brain injury survivor’s perspective [71-73]. It is well established that when patient preferences for treatment are taken into account, uptake and compliance improves, leading to better health outcomes [74] and improving cost effectiveness. Further research in relation to CIMT implementation should therefore focus on exploring factors that influence the reach and uptake of CIMT by the target population.

Strengths and Limitations

Our study collected detailed data on the real-world costs associated with CIMT delivery in a public health setting, including staff time and resource use. We measured practice before and after delivery of the CIMT implementation package. Over 1500 files were audited across 10 time points and nine teams. We therefore feel confident that our assumptions within the model for the effectiveness of the CIMT implementation package are an accurate representation of the package’s influence on practice change.

Despite these strengths, there are always some study limitations. We discuss above the limitations of our outcome measure of cost per person with improved arm function. Without a formal WTP threshold there is no clear recommendation regarding the cost effectiveness of CIMT. However, as the first examination of the cost effectiveness of CIMT, this work provides a valuable platform for future research on the cost effectiveness and cost utility of CIMT and other upper-limb therapy approaches.

Economic models represent a simplified version of reality. Several assumptions have been made within the model that may not reflect practice, particularly in relation to standard care estimates. Firstly, the ‘no implementation package’ arm of our decision analytic tree included CIMT delivery outcomes that were collected from the study sites at earlier time points, prior to the introduction of the implementation package. Secondly, participant outcomes used in the standard care group were calculated from the literature, using data collected between 2011 and 2013, and without specific information on eligibility of CIMT available. These estimates therefore may not reflect current standard care. However, as the standard care outcomes used were from a study site where the implementation package was later delivered, we believe they are representative of standard care within the health district.

Another limitation of the study is that we did not test the hypothesis that there may be diminishing returns in the effectiveness of CIMT when CIMT is expanded to a larger patient population during scale up of the implementation package. Whilst expanding scale up of CIMT implementation might result in economies of scale in terms of costs of providing CIMT, scale up of CIMT implementation may also result in changes or reductions in average efficacy of CIMT.

We used a short time horizon within the model, consistent with the duration of a CIMT programme. This may have resulted in truncation of CIMT outcomes or costs, and potentially biased estimates of CIMT cost effectiveness [75].

Due to the small number of people with TBI included within the sample (n = 7, 11%) there is some uncertainty in the results for this patient population. Finally, self-reported data from therapists were used to calculate resource use and time spent completing CIMT activities. Self-reported data may have resulted in under or overestimates of actual time needed to complete CIMT activities.

Conclusion

CIMT uptake and delivery improved with implementation support, with observed improvements in arm function for people with stroke and TBI. This economic model demonstrates that with financial investment to support initial implementation and ongoing training, CIMT results in important improvements in arm function for patients. Although it is difficult to say without an established threshold, the ICERs in this study for individual and group therapy may not represent cost-effective intervention. However, the best-case scenario suggests when therapists are supported to provide best-practice CIMT it likely represents good value for money.

Below is the link to the electronic supplementary material.

Supplementary file1 (DOCX 30 kb)

Constraint-induced movement therapy (CIMT) is an evidence based, clinically effective and recommended intervention for arm recovery after stroke and traumatic brain injury. CIMT is a time-intensive and complex intervention, which has limited its translation into practice.

With investment in training and support to allied health staff, CIMT can be implemented into acute, rehabilitation, inpatient and outpatient public health services and results in important improvements in arm function for patients.

This is one of the first studies to examine the costs and cost effectiveness of CIMT when delivered with implementation support. Our findings suggest that, in the best-case scenario, when therapists are supported to provide best-practice CIMT within usual care it likely represents good value for money.