Adoption and Initial Implementation of a National Integrated Care Programme for Diabetes: A Realist Evaluation.

Background: The implementation of models of integrated care for chronic conditions is not well understood. We conducted a realist evaluation to determine how and why the implementation of the National Diabetes Programme in Ireland worked (or not).
Methods: Documentary analysis and qualitative interviews with a purposive sample of national stakeholders (n = 19), were used to develop an initial theory on expected programme delivery. We refined this theory using semi-structured interviews (n = 38) with professionals from different clinical disciplines involved in programme implementation.
Results: Locally important contexts facilitating implementation included staff experience of delivering diabetes care, capacity, and familiarity with the intended purpose of new clinical posts. The extent to which integrated care was adopted and implemented depended on judgements made by professionals working in these contexts; specifically, judging the relative advantage of the programme and whether to engage in negotiations to legitimize their new roles in diabetes care. Conclusions: Our results highlight the need for adequate preparatory work to raise awareness of and support new roles to implement integrated care, clarification on the core components of new care models, and the development of local service infrastructures to support integrated care. Copyright:

Background

Worldwide, the increasing burden of chronic disease is leading to health system reforms, including strengthening primary care and increasing the provision of specialist support in the community [1]. Integrated care has become a pillar of chronic disease management reform internationally as a way to address service fragmentation, improve patient experience, and achieve better efficiency and value from healthcare systems [2345]. Diabetes is often used as an exemplar chronic condition to study health service reforms such as integrated care as effective diabetes management requires the involvement of healthcare practitioners (HCPs) from different disciplines and settings [67].

Over the past four decades the prevalence of diabetes has increased substantially; in 2014 it was estimated that 8.5% adults globally have the condition [8]. Should trends in diabetes prevalence and mortality continue, it is estimated that by 2030, the global economic burden of diabetes will increase to $2.5 trillion or 2.2% of global GDP [7]. Diabetes-specific integrated care programmes have been implemented across Europe [9101112131415161718] as well as in high income countries such as Australia [192021] and Singapore [22]. These programmes often comprise protocols to guide patient stratification according to risk/need [1011131415], and the introduction of new staff to support multidisciplinary working [101213161718]. In Ireland, a National Diabetes Programme (NDP) was established in 2010; one of several clinical care programmes set up as part of a larger reform process [23]. The overarching goal of the NDP was to standardise diabetes care delivery. Among other reforms, the NDP introduced national models of integrated of care for routine diabetes management across primary, secondary, and tertiary settings and for the management of diabetic foot disease. Historically, diabetes care in Ireland has been hospital-centric with a disconnect between secondary and primary care services in how they are funded, managed, and resourced [24]. There was a deficient in access to allied health services such as podiatry, and diabetes nurse specialists [DNS] were primarily hospital-based [25]. Some alternatives to hospital-based management have developed in the past few years; shared care between general practitioners [GPs] and hospitals, and structured primary care-led management [2641].

The process by which models of integrated care are implemented is not well understood [2728293031]; specifically, why these models work in some circumstances and not others [103233]. There is growing emphasis on theory-based evaluations which are better equipped to deal with the complexity of introducing such multi-component interventions, like integrated care for chronic conditions such as diabetes, into complex and dynamic health systems [34]. Theory-based evaluations address some of the limitations of more traditional or quasi-experimental research designs which do not adequately factor in the role of context in the delivery of health system interventions [3536]. The realist evaluation approach, developed by Pawson and Tilley, is a type of theory-based evaluation interested in explaining what works, for whom, how and why, in different contexts. The approach tries to determine the mechanisms and the contextual factors that bring about change, rather than focusing on specific endpoints [37383940].

We carried out a realist evaluation during the early stages of the NDP implementation to examine how and why it worked (or not) in different settings and for different groups across the country, specifically;

How was the programme implemented and by what mechanisms did its components lead to different outcomes?

What are the important contexts that determined whether these mechanisms produced intended (or unintended) outcomes?

Methods

National Programme for Diabetes

The overarching goal of the NDP is to standardise diabetes care delivery. It was led by a national clinical lead and programme manager supported by representatives from various clinical disciplines: 1) a multidisciplinary working group, 2) advisory group, and 3) regional implementation groups (Figure 1). Once the programme was implemented into the health system, there were liaison structures in place between local hospitals and GPs represented by the implementation groups.

Figure 1

National Diabetes Programme.

As part of national reforms, governance structures and programme components were developed by the Health Service Executive and the Royal College of Physicians in Ireland for each of the new clinical programmes (Figure 1). In line with their goal to develop standardised patient pathways and evidence-based models of care, the NDP working group developed national models of integrated care for the routine management of diabetes and diabetic foot disease [43], and the addition of new staff resources (Figure 1, Additional File 1).

Design

This evaluation follows the research stages originally outlined by Pawson and Tilley [40] (Figure 2). Detailed methods can be found in the research protocol [44]. The evaluation was conducted in line with quality standards and reported based on realist evaluation publication standards. Additional File 2 outlines where the methods map to the reporting standards for realist evaluations (RAMESES II) [45]. Details on sampling, recruitment and data collection are outlined in the protocol [44].

Figure 2

Realist research cycle adapted with permission from Marchal et al. [34].

Formulating initial programme theories

Stage 1: Data collection and analysis to formulate initial programme theories

Stage one involved: 1) documentary analysis of policy documents, national working group presentations, and national service plans (2011–2014) to establish the official programme theory and, 2) concurrent qualitative interviews (conducted by MT) with a purposive sample of stakeholders from the NDP working group involved at a national level in the design, development, and management of the programme. Some participants were implementers within their own local diabetes service in addition to being involved in programme design at national level. Analysis focused on building plausible Context Mechanism Outcome Configuration (CMOC) statements that explained how the programme was expected to work. In addition to discussing planned implementation and expected outcomes (official programme theory), participants discussed their own experience of implementation, and locally perceived outcomes in their area, and the barriers encountered. This information was also used later in Stage 4 to refine the initial programme theory.

Refining initial programme theories

Stage 2: Data collection to test initial programme theories

A case study design was used, informed by the initial programme theory. Stage two involved semi-structured interviews with professionals in each case, defined as a geographical area within one of the four administrative regions in the national health service. Cases were sampled based on two criteria: 1) receipt of a NDP component (i.e., integrated DNS and/or podiatrist), and 2) the presence or absence of an existing diabetes initiative [44]. Within each case, professionals were purposively sampled to represent different disciplines working in that geographical area: endocrinologist, GP, practice nurse (PN), DNS/integrated DNS, podiatrists, local implementation group member.

A topic guide was developed based on the initial programme theories developed during stage one. The topic guide was tailored to the stakeholder group being interviewed. Drawing on the principles of theory-driven interviewing [42], participants were invited to explain how their experience fit (or did not fit) with our initial theory and reflect on what may explain the outcomes in their area. During the interview, the interviewer (MT, FR, KON) had an active and explicit role in explaining the contexts and outcomes of interest, to ensure a shared understanding of the terminology and purpose of the question (i.e., to elucidate how the programme was working). The topic guide was piloted with a convenience sample of one GP and two PNs familiar with or in receipt of most programme components. With the written consent of participants, interviews were digitally recorded, transcribed verbatim and imported into NVivo 11 software.

Stage 3: Analyse data to interrogate theories and assess outcomes

During analysis, we adopted a retroductive approach, moving between inductive and deductive analysis, as well as following insights and hunches [46]. Using programme outcomes as the starting point, transcripts were analysed to 1) link an outcome to the response (mechanism) which most likely contributed to it, and then 2) linking this mechanism to the circumstances that triggered it (context). Mechanisms were often implicit therefore inference was required to determine whether the data were functioning as a C, M or O and the relationships between them. To identify potential patterns, Context-Mechanism-Outcome Configurations (CMOCs) from each transcript, along with supportive quotes, were tabulated in a Word document. For each programme outcome, recurring CMOC patterns were grouped into conceptual categories. Data analysis was led by KON and FR, with regular team discussions about CMOCs [with SMH, ER, and CP]. We developed separate CMOCs for the two models of care (routine management and management of the diabetic foot disease).

Outcome assessment

Though the data was predominantly qualitative, some outcomes were defined both qualitatively and quantitatively. For example, data were available to assess the implementation of certain components of the programme. First, integrated DNS routinely collect data on their activity, including GP practice visits, patient episodes of care, and service capacity [47]. DNS activity was analysed and reported per 1 Whole Time Equivalent (WTE) and across defined areas of community healthcare services outside of acute hospitals, called Community Healthcare Organisations (CHO). Second, a national survey was carried out with PNs (October 2016–May 2017) to examine their role in diabetes care. This 59-item survey included questions on how diabetes care is delivered at their practice, the current support in diabetes care available at the practice, including access to specialist services, and how they used these services. Nurses (n = 1466) were sent the survey via Professional Development Coordinators for Practice Nursing and the Irish Practice Nurse Association. Activity data and survey data were used to examine engagement with (i.e., whether the programme was adopted in primary care), and implementation of, the programme components. Descriptive statistics (N (%)) were generated for relevant questions.

Stage 4: Synthesis and interpretation

Data were then used to support, refine, or refute the initial CMOCs developed from stage 1 of the study. Similarities and overlaps between the CMOCs for the models of care were identified (by FR and KON) and presented to the wider research team (SMH, ER, CP). The group refined interpretations by explicitly seeking conflicting data and making comparisons across different contexts. Finally, CMOCs were consolidated to provide an explanation of why the programme worked for some but not others. Memos were used and shared throughout the analysis to note assumptions, coding definitions, hunches, and early impressions. The language and expressions of the participants were maintained as far as possible, using in vivo codes, to avoid losing the meaning and context.

The study was approved by the Clinical Research Ethics Committee of the Cork Teaching Hospitals.

Results

Participants included 19 stakeholders purposively sampled from the NDP working group (Stage 1) and 38 professionals purposively sampled to represent different disciplines implementing the NDP in each case (Stage 2). More details of participants are provided in Additional File 3. In this section we first outline how the programme was expected to work based on documentary analysis and interviews with national stakeholders (Stage 1). This is followed by a series of refined theories (CMOCs) based on data collection during programme implementation, outlining the important contexts that influenced whether mechanisms produced intended and unintended outcomes (Stages 2–4).

Formulating initial programme theories: How was the programme expected to work (Stage 1)

There was no formal or standardised dissemination route for the programme. It was assumed that information would ‘filter down’ (working group #3) through a variety of existing informal channels and networks. This included presentations to professional groups, largely comprising people already interested in diabetes quality improvement (e.g., training and conferences, existing connections to primary care initiatives, contact with a new integrated DNS or podiatrist, and local implementation groups). Due to this informal approach, there were varying levels of awareness about the programme among HCPs.

Those involved in the design of the models of care assumed that introducing protocols would standardise how care was provided, and that new clinical posts would become a catalyst for service change, facilitating integrated care at local level. It was expected that HCPs would buy in to new ways of working, see the value of new resources and, as a result, align their work practices accordingly to the new models of care. However, the changes outlined by the NDP were not mandated. Due to the socio-political and service context certain planned components of the programme did not materialise (Additional File 4), including the official release of the protocol for the model of integrated care for routine management. For those that did materialise, there was a disconnect between design/planning (i.e., the NDP working groups) and implementation once introduced into the health system (i.e., health service executive and primary care). Despite liaison structures in place between local hospitals, represented by the Diabetes Services Implementation Groups, the lines of accountability and responsibility were unclear once the programme was introduced.

“It’s not as clear cut as one crowd provide the policy and the other crowd will implement; there has to be a merging in the middle.” (working group #15)

Refining initial programme theories: How the programme was implemented: in what contexts and by what mechanisms did it lead to (intended and unintended) outcomes (Stages 2–4)

Thus, in this context, where there was a disconnect between responsibility for designing and planning the programme and the responsibility for implementation once introduced into the health system, HCPs used their professional judgment to engage with, implement, and adapt the new models of care to varying degrees and in ways that matched their immediate priorities and circumstances (Table 1). This was not limited to one stakeholder group; GPs, nurses, specialists, and podiatrists made professional judgements about whether and how to engage with the programme resources. Details of the overarching CMOCs for the programme are provided in Table 1. Additional individual CMOCs supporting them along with exemplar quotes are available in Additional File 5.

Table 1

Summary of CMOs.

Overarching CMOCVarying levels of awareness about the programme (C), no planned approach to implementation (C), and professional oversight (C), and resource demands within the primary and secondary care health system (C) meant that it was more likely HCPs used their own professional judgment (M) to implement the models of care in ways that matched their priorities (O) with varying degrees of engagement (O) and implementation (O).
CMOC 1: Weighing up the advantage of engagement in primary care
Depending on their experience delivering diabetes care (C) and resource demands at each primary care practice (C), HCPs weighed up the relative advantage of the programme over their current approach to diabetes care (M) which led to variability in their willingness to engage with the programme (O).
CMOC 2: Legitimising a new role in secondary care
Given different levels of familiarity with the role of integrated DNS and podiatrists among existing HCPs (C), and depending on the availability of published protocols which provided guidance on the new roles (C), new HCPs recruited through the programme made judgements about how to legitimise their role (M) to engage HCPs with the programme and establish role boundaries (O).
CMOC 3: Implementation; adjusting to fulfil immediate local need
3.1 Implementation in primary careDepending on HCP’s resources (C) or experience in diabetes (C), they felt more or less supported by the programme (M) and therefore, adapted the programme components to meet their immediate needs (O).	3.2 Implementation in secondary careDepending on familiarity with the role of integrated DNS and podiatrists among existing HCPs (C), resources (C) and existing professional boundaries in secondary care (C), new HCPs recruited by the programme and secondary care HCPs made judgements about how to best adapt the role (M) to meet immediate service needs (O).

Initial engagement in primary care

Weighing up relative advantage

Primary care HCPs’ experience providing diabetes care, and resource demands in the practice at that time, influenced whether they perceived the programme to be more or less advantageous than current care delivery (e.g., level of diabetes care they were providing already), and whether they saw it as an opportunity to receive more support or to improve care (e.g., a need for the programme resources) (see Additional File 5, CMO 1.4, 1.5). In some cases, recognising this immediate need for resources motivated HCPs to work around feasibility issues (e.g., practice space) (Additional File 5, CMO 1.6).

“Well, we saw the value of it [integrated DNS service] … we’ve a lot of people with diabetes and we’ve a lot of young diabetics and so to us, it just seemed like a good idea.” (PN#7)

Where practices had sufficient resources (e.g., access to specialists) and believed their care was good, they were unsure how the new programme would align with or improve current practice (Table 1, CMO 1). Some contexts were contingent on others with respect to implementation; for example, once an integrated DNS was embedded in the practice, practice nurses felt more supported, changing the context, and leading them to become more engaged in the management of diabetic foot disease (Additional File 5, CMO 1.5).

“We had the set-up. We probably hadn’t the protocol as such. We would do the full blood count, the A1C, the cholesterol and that, but we wouldn’t have weighed them on each visit, or done the BMI, nor would we have done the foot examination unless they had a problem…I’m trying now, a bit, since [integrated DNS] gave me all the literature, and I have the books.” (PN#15)

Resistance to engagement

In some practices, there were exceptions. Due to the breakdown of GP contract negotiations [48] and owing to the position of GPs as sole traders, the new programme was perceived by some as undermining practices and their resources. Interviewees suggested that the programme did not adequately reimburse the cost of implementation (Additional File 5, CMO 1.3).

“You can’t expect GPs to fork out and pay for facilities for nurses and build rooms for them and everything else…And become an, an outpost to the hospitals so they provide services.” (GP#4)

Implementation in primary care: adjusting to need

In a similar way to how professionals initially engaged in the programme, implementation of the programme components in practice depended largely on HCPs’ resources or experience in diabetes. These two contexts identified in our qualitative data, appeared to explain the extent to which HCPs felt supported (or not) by the programme, and whether they were likely to adjust protocols and the new roles to fulfil their immediate needs. Depending on resources, practices referred different cases to the integrated DNS; some referred people with uncomplicated diabetes and others referred those considered more complex (Additional File 5, CMO 3.1.2). This variation was also evident in the activity data collected by integrated DNS (n = 29) (Additional File 6) [47] and survey data. Among practice nurses who were using the integrated DNS service (n = 215), 30% reported that the integrated DNS supported the practice by reviewing patients with uncomplicated type 2 diabetes. The intention was that practice nurses would upskill by observing the integrated DNS during clinics, however primary care HCPs judged that ‘doubling up’ (DNS#13) was not the best use of resources (Additional File 5, CMO 3.1.3).

“Some of the busier practices, no [the practice nurse does not sit in with me], not always, they will book the patients in but they cannot afford the practice nurse hours on a morning or an afternoon to be spent doing it.” (DNS#6)

Legitimising the new roles in secondary care

Two factors played a part in whether the roles of newly recruited staff were implemented as intended in the secondary care setting: 1) the availability of guidance documents which afforded some legitimacy to, and 2) the level of familiarity with, the specialist role. Based on these factors, integrated DNS and podiatrists judged the extent to which they would promote and engage in negotiations about their role. Where secondary care staff were unfamiliar with the role of new HCPs, the HCPs were more uncertain about (the legitimacy of) their role within the team and whether their contribution to diabetes management would be accepted. This uncertainty led them to engage in efforts to increase awareness of their expertise among other HCPs (Table 1, CMO 2.1).

Integrated DNS and podiatrists differed in the way they engaged in negotiations about their role. The role of hospital DNS was already well-established and in the absence of formal guidance on this new ‘integrated’ role that would span primary and secondary care, conditions did not support integrated DNS to assert professional boundaries. Where integrated DNS were previously part of the hospital team, they were not necessarily willing to challenge the status quo (Additional File 5, CMO 2.2). This contrasted to podiatrists who had a published protocol and so were more comfortable asserting their role. They could rely on this document to assert their role in the team (Additional File 5, CMO 2.3).

“We needed something (guidance) to say this is what has to be done, you know, that’s what kind of made it easier going in implementing these changes, like “listen, it’s not me, it’s the programme, you have to do it”. (Podiatrist #12)

Implementing new roles in secondary care: adjusting to service need

The implementation of new roles in secondary care depended on professional boundaries/working relationships and demands on the current service. In the case of podiatrists, the decision about how the role was implemented depended on whether the HCPs in secondary care were receptive to facilitating the new service. With support at consultant level and the presence of an established MDT, podiatrists felt empowered to implement the risk stratified pathways as intended, or adjust as required (Additional File 5, CMO 3.2.1).

“A lot of the [podiatrists] that I know wouldn’t have support from the diabetes consultant at podiatric level…[it has] taken almost a year to get it up and running. If I wasn’t attached to [the hospital], we wouldn’t have this (service)” (Podiatrist #14)

Similar to the response in primary care, HCPs in secondary care adapted the role to meet immediate service needs. In the case of the integrated DNS role, the decision about how the role was implemented depended on hospital resources, specifically staffing levels, and the demand for the service (Additional File 5, CMO 3.2.2). This influenced the type of patients (i.e., type 1 or 2) seen by the integrated DNS during their time in the hospital.

“So now what we end up doing is actually putting [the integrated DNS] into our clinics, to save one of our other nurses for the other patients, seeing as we’re short on nurses.” (Endocrinologist #2)

In the case of the podiatrists, demand on the service also influenced the implementation of the risk stratified pathways. The shortage of podiatry services prior to implementation and the securement of only 16 podiatry positions in secondary care meant that podiatry services were “snowed under with work” (working group #17) and “stretched to the limit” (working group #4). As a result, podiatrists aimed to provide the best service they could with the resources available (Additional File 5, CMO 3.2.3). Depending on the availability of community podiatry services, risk stratified pathways were only partially implemented with podiatrists only managing to address active or high-risk foot disease and not moderate risk as outlined in the model of care.

“Moderate risks have been neglected, for the last year, just because our caseload of high risk patients has just gone through the roof.” (Podiatrist #20)

Discussion

Our aim was to understand how and why a national programme to introduce integrated care for routine management of diabetes and diabetic foot disease worked (or not), in different settings and for different groups. Unlike previous evaluations of integrated diabetes care, we used a realist approach to determine the mechanisms and the contextual factors that bring about change. Our results suggest that at the outset there was an implicit assumption that HCPs would buy into a new way of working which involved greater multidisplinarity, and delivery of care across professional boundaries. However, there was a disconnect between responsibility for designing and planning the programme and the responsibility for implementation once introduced into the health system. In this context, HCPs used their own judgment on whether to adopt, or adjust the programme which influenced how the programme worked on the ground.

Implications

Our findings have three key implications which are relevant given broader reforms to support integrated care. First, the study highlights the importance of developing a shared awareness of integrated care programmes and their aims among all key actors/implementers. One of the programme aims was to involve different clinical disciplines to co-produce service change, i.e., involving professionals (and patients) in jointly designing and planning how the new service might look, therefore increasing ownership and commitment. However, despite this process at the design stage, at the implementation stage, primary care HCPs engaged with, and implemented the programme based on whether they saw a relative advantage. This is in line with existing research which suggests professional judgements and adaptations are often part of the work done to embed service changes [49], with adaptations often a response to organisational challenges such as staffing [20], clinical experience [3950], working relationships [51] and internal or external rewards [39]. To support implementation of the programme, new staff had to champion their own role, negotiate their role boundaries, challenge the status quo, and serve as catalyst for integrated care, communicating information about service changes. However, their capacity to do so depended on others’ familiarity with the role and their relationships with existing staff, together with external validation and the legitimacy afforded by guidelines. It was challenging for individual HCPs to achieve this without complementary systematic service level communication, the lack of which was highlighted in a recent evaluation of the national clinical programmes as a whole [52], or changes to existing team structures in primary or secondary care [53]. International work suggests that when clinicians are working across boundaries – physical boundaries between care settings, or professional boundaries between disciplines within a multidisciplinary teams – there will be issues in terms of the understanding and implementation of new roles [545556]. Previous studies of whole system change [5758], have reported tensions between clinical professions, arising from the fact the programme challenged accepted role boundaries and the status quo. In their study of health services modernisation, Huby et al linked the momentum of service reform to the degree to which role boundaries could be negotiated [59]. The success of integrated care in England [60], Scotland [61], Belgium [62], Canada [63] and the Netherlands [10], has been linked to efforts to cultivate a shared culture and understanding of new roles and changes to existing roles [61], and whether or not there is a tradition and understanding of interdisciplinary work [10606263].

Second, it is important to strike a balance between standardisation and facilitating professional autonomy. In the current study, primary care HCPs asserted their autonomy when deciding to engage with and implement the programme. New staff were expected to assert their autonomy to drive implementation of integrated care and negotiate their role. While research with HCPs and service managers in the UK suggests striking this balance is key to successful implementation [64], there are some important considerations. HCPs may see standardisation as a challenge to their autonomy [10]. Also, while some flexibility may facilitate implementation into existing practice [49], this can create an acceptance of delivering new interventions differently than intended [an agreed standard or protocol], with a negative impact on effectiveness and the quality of patient care [65]. These issues further indicate the importance of generating a shared understanding of the what and why of new integrated care programmes.

Third, our results indicate the importance of the local service infrastructure given that standardisation of new care models depends on the ‘starting point’, that is, the existing standard of care, resources, and experience, all of which drove HCP judgements about implementation. The programme in Ireland, like other diabetes integrated care programmes [1062], seeks to standardise care delivery to address continuing variation [6667]. Yet, regional differences in resourcing in both secondary and primary care influenced programme implementation, issues which are relevant internationally [68697071727374]. These challenges meant there are few local structures in place to create opportunities for ‘integrative’ working, such as shared clinics between practice nurses and integrated DNS in primary care, or referral pathways between community and hospital podiatrists. The unintended consequences of a shortage of resources like integrated DNS and podiatrist posts was also evident in the current study; specifically, the loss of the prevention aspect for diabetic foot disease with moderate risk patients not seen as frequently as necessary.

Recommendations

There are three broad recommendations for the implementation of integrated care arising from this evaluation. First, preparatory work is needed to raise awareness of and support health professionals in new roles to implement integrated care. Strategies include providing protocols which outline the role – new clinical responsibilities [7576] – local ‘champions’ or opinion leaders [7778] who are already embedded in the setting [627679], or taking a more structured (e.g., unified ‘big bang’ [80]) approach to communicating the goals and benefits of the new models of care.

Second, the core components of new care models required for effectiveness and which elements are optional or can be modified to fit with practice needs should be clarified with frontline HCPs. Without clarity on the core components, the result may be to exacerbate existing variation and widen the gap between the care provided in different parts of the country. While co-production of service change at the design stage is important; it is not a once-off process, and ongoing co-production and local tailoring during the implementation phase is to be expected. Policymakers should not assume that service changes can be entirely prescriptive. Implementation should be supported in such a way that it leads to desired outcomes, for example, empowering HCPs and strengthening their capacity to adapt both their roles and new interventions.

Third, local service infrastructures which can support integrated care (i.e., staff or remuneration for staff time, training, space) should be developed. HCPs have competing priorities and will make decisions about implementation within constraints [8182]. Policies at a national level need to account for the fact that efforts to standardise diabetes or chronic disease management take place in a context where there are ‘pockets of excellence’. With different starting points and circumstances, a ‘one size fits all’ approach to implementation may not be a realistic or optimal goal for everyone. On this point, we suggest implementation support may need to be tailored accordingly, to ensure the core components can be delivered across the board. For example, some practices may need more intensive support from an integrated DNS to build confidence and expertise, or, in the absence of practice space, the option to refer patients to an integrated DNS based at another location in the community such as a primary care health centre.

Our findings highlight the early challenges to implementation. The service and policy context has continued to change, which may contribute to a more supportive context for integrated care. The integrated DNS and hospital podiatrist roles have now been in place for over five years [47]. Those who are longer in the role are embedded in local services and may be able to provide support and act as champions for colleagues in newer posts. A GP contract has been negotiated and secured [82].

Strengths and limitations

To our knowledge this is the first realist evaluation of the implementation of an integrated diabetes care programme. While several disease specific programmes have been introduced internationally [910121314151617181920], few have interrogated how they are implemented. Barriers and facilitators to implementation are often represented as unconnected lists operating at higher, macro-level [83]. We have shown here benefits to understanding micro-level decisions and negotiations by those receiving a new programme on the ground. However, our evaluation has limitations which should be mentioned.

It was difficult to define cases and draw boundaries around ‘local diabetes services’. Case study boundaries in this study were somewhat fuzzy because, in Ireland, patients are not restricted to hospitals or practices in a defined geographic area and practices may refer into multiple community specialists and hospitals, sometimes based on historical or local arrangements. This may be why we did not identify regional boundaries as an important context for implementation.

We did not have access to routine administrative data on processes of care that would reflect whether implementation was happening or not. Moreover, given those involved in the development of the programme were not explicit in terms of what fidelity to the programme looked like, it was challenging to assess the implementation of specific processes and procedures reflective of integrated care.

Professionals were purposively sampled to represent relevant stakeholders in an area, and theoretical sampling was used to follow lines of inquiry. However, this was not always successful. For example, we failed to recruit HCPs without an interest in diabetes quality improvement (an important contextual factor). This notwithstanding, we did identify some disconfirming cases; integrated DNS spoke about the challenging of engaging with some practices, and GPs who had adopted the programme, spoke about resistance to adoption among colleagues.

The realist analysis allowed an in depth understanding of implementation in different contexts, and in particular this approach facilitated us to generate transferable lessons about how models of integrated care work, rather than learning specific to a single context or intervention. This was a key strength as it ensures our findings are relevant for future implementation of models of integrated care and maintain a policy-relevance beyond the specific interventions studied. However, it was also extremely time consuming. This was largely because analysis done manually in Microsoft Word using an approach similar to that outlined by Jackson et al [84]. That is, we identified dyads (CO, MO, CM) and triads (CMO) within individual participant transcripts, formulating multiple CMOCs within one interview transcript. This enabled us to make logical inferences across transcripts. Immersion in data analysis was particularly important to be able to make these inferences however, in a practical sense dedicating longer blocks of time to data analysis was an ongoing challenge. While this work could be done independently for different models of care by different researchers (FR: routine management; KON: management of the diabetic foot disease), regular discussions with the wider team were crucial to formulate the final programme theory. These discussions were particularly valuable at two specific timepoints; when sharing our findings on the two models of care and discussing similarities, and when considering our individual CMOCs and how they consolidate to form an overarching programme theory. The broad scope of the intervention (encompassing two models of care) made the evaluation challenging. We found theory-driven interviews, whereby we presented initial theories for two models to participants, demanded more explanation by the researcher and could be lengthy, particularly for those HCPs who could comment on both models (GPs, PNs).

Conclusion

In summary, the implementation of whole system service changes should be supported both by a comprehensive implementation plan incorporating a communication strategy to establish a shared understanding and ownership, guidance which clarifies the core versus flexible programme components, together with ‘bottom up’ efforts to create structures and arrangements which can facilitate implementation which is tailored to local needs and different ‘starting points’.

Additional File

The additional file for this article can be found as follows:

Additional Files 1 to 6.