Effects of primary care antimicrobial stewardship outreach on antibiotic use by general practice staff: pragmatic randomized controlled trial of the TARGET antibiotics workshop.

Objectives: To determine whether local trainer-led TARGET antibiotic interactive workshops improve antibiotic dispensing in general practice.
Methods: Using a McNulty-Zelen-design randomized controlled trial within three regions of England, 152 general practices were stratified by clinical commissioning group, antibiotic dispensing rate and practice patient list size, then randomly allocated to intervention (offered TARGET workshop that incorporated a presentation, reflection on antibiotic data, promotion of patient and general practice (GP) staff resources, clinical scenarios and action planning, 73 practices) or control (usual practice, 79 practices). The primary outcome measure was total oral antibiotic items dispensed/1000 patients for the year after the workshop (or pseudo-workshop date for controls), adjusted for the previous year's dispensing.
Results: Thirty-six (51%) intervention practices (166 GPs, 51 nurses and 101 other staff) accepted a TARGET workshop invitation. In the ITT analysis total antibiotic dispensing was 2.7% lower in intervention practices (95% CI -5.5% to 1%, P = 0.06) compared with controls. Dispensing in intervention practices was 4.4% lower for amoxicillin/ampicillin (95% CI 0.6%-8%, P = 0.02); 5.6% lower for trimethoprim (95% CI 0.7%-10.2%, P = 0.03); and a non-significant 7.1% higher for nitrofurantoin (95% CI -0.03 to 15%, P = 0.06). The Complier Average Causal Effect (CACE) analysis, which estimates impact in those that comply with assigned intervention, indicated 6.1% (95% CI 0.2%-11.7%, P = 0.04) lower total antibiotic dispensing in intervention practices and 11% (95% CI 1.6%-19.5%, P = 0.02) lower trimethoprim dispensing. Conclusions: This study within usual service provision found that TARGET antibiotic workshops can help improve antibiotic use, and therefore should be considered as part of any national antimicrobial stewardship initiatives. Additional local facilitation will be needed to encourage all general practices to participate.

RCT Entities:   Population Interventions Outcomes

Introduction

Antibiotic prescribing can most effectively be improved long term through multifaceted interventions. These interventions work well if they include training for professionals that increases their capability and motivation to prescribe well, combined with feedback about their antibiotic prescribing, and readily accessible tools to use during the consultation. This may include tools to improve information sharing with the patient, symptom scores and clinical prediction rules, or near-patient tests., Most evaluations of these interventions have been undertaken in general practice within research networks, with clinical researchers who both recruit participants and provide the intervention delivery. Practices consent to take part and therefore self-select. Participants who decline to take part (and therefore may be less inclined to improve their antibiotic prescribing) are not included in these studies. Furthermore, previous evaluations have usually included a subset of patients with specific symptoms, for example: acute cough, sore throat or children with acute cough. This focus on one syndrome in an intervention may facilitate an improvement in clinicians’ antibiotic prescribing behaviour during the study period, especially if clinicians are reimbursed for recruiting patients or for participating in research studies. These evaluations may not reflect the reality of everyday practice for a primary care clinician, who has limited time, and is being asked to improve their prescribing for all infections., Only one study exclusively in UK general practice has evaluated the effect of a multifaceted intervention on total antibiotic dispensing over a whole year and when individual patient recruitment was not required, but the ‘Stemming the Tide of Antibiotic Resistance’ (STAR) educational programme was also undertaken within a research network.

The ‘Treat Antibiotics Responsibly, Guidance, Education, Tools’ (TARGET) antibiotics toolkit, developed by PHE with the Royal College of General Practitioners (RCGP) and other professional societies, and hosted on the RCGP web site, aims to influence prescribers’ and patients’ personal attitudes, social norms and perceived barriers to responsible antibiotic prescribing. The toolkit is evidence based and includes many of the principles proven to be effective in previous successful interventions.,, It includes an interactive workshop that incorporates participant reflection on their own antimicrobial stewardship (AMS) activities using a self-assessment questionnaire and the practice’s own antibiotic dispensing data [non-anonymized compared with other practices in the clinical commissioning group (CCG) and nationally], the importance of antimicrobial resistance (AMR) and AMS strategies, and information on using and accessing other resources including: free leaflets to share with patients, resources for clinical and waiting areas, audit toolkits, national antibiotic management guidance, other online training resources and a facilitator’s manual.

We aimed to determine the effect of the TARGET 1 h outreach workshop facilitated by existing UK NHS healthcare staff with promotion of TARGET web site resources, on general practice (GP) antibiotic dispensing within routine NHS service provision.

Methods

Setting

In 2013 we selected four primary care CCGs across three rural and urban regions of England that were not involved in implementing similar AMS interventions or research. CCGs are state funded and commission primary medical care from general practices. All the UK population is registered with, or has access to, a general medical practice that they consult for primary care.

Design

We used a McNulty–Zelen randomized controlled trial design. This means that the research subjects (GP medical practices) were not aware that they had been randomly assigned to intervention or control or that they were taking part in a trial. Consent was given on their behalf by a senior clinician in the CCG, who was requested not to inform local GPs about the study. Workshop facilitators were informed that they were participating in an evaluation of the TARGET workshops, but were not involved in the randomization of practices. As we were using the McNulty–Zelen design, to keep the trial unknown to participants, the trial was not registered.

Sample size

We undertook a standard sample size calculation based on the prescribing in one average prescribing CCG in England between 2010 and 2012; to detect a 10% reduction in the average dispensing rate for GP practices [from 1.0 item per specific therapeutic group age-sex related prescribing unit (STAR PU) to 0.9 STAR PU] with 90% power at the 5% significance level, two equal-sized groups of 35 practices were required. To allow for lack of clustering, anticipated 50% uptake of workshops, and any practices merging or closing, we planned to recruit at least 150 practices.

Ethics

The NHS Research Ethics Committee waived participant consent for this trial, since obtaining consent would invalidate the results and create an administrative burden on practice participants.

This trial was not registered as it assigned healthcare providers, rather than patients, to intervention and comparison/control groups, and examined the effect of education only on the providers’ behaviour. When the study started we were advised that trial registration was unnecessary, and threatened unblinding the McNulty–Zelen design.

We did obtain Cardiff University ethical approval (SMREC 13/58), and local R&D approvals in each CCG to proceed (Gloucestershire: 13/025/PXT, West Sussex ID: 1562/NOCI/2013, Swindon: 2013/068; Oldham provided a confirmation letter).

Intervention allocation

We stratified GP medical practices within each CCG by the number of patients on their list (list size) and total antibiotic dispensing/1000 patients. CCGs were asked how many workshops they had staff capacity to undertake within their usual service delivery, which provided the basis for the number of study practices randomized in each CCG. Multiple practices within the same building were grouped. Practices were excluded if they had previously received a TARGET workshop, or merged with another GP practice. In total, 152 general practices were randomly (using computer-generated pseudo-random numbers) allocated into intervention (73, offered a TARGET workshop) or control (79, usual AMS provision by CCG). The units for randomization and analysis were GP practices rather than individual prescribers because all practice staff are involved in patient care, and all practice staff were invited to the workshop to influence subjective norms.

Participants in workshops

All intervention practices were invited to participate in a practice-based face-to-face workshop by a letter from CCG AMS leads. The letter stated that: All practice staff were invited (to influence subjective norms and help with action planning), but were able to accept or refuse any part of the workshop and TARGET materials at any time. Non-responders were followed up by email and/or telephone call.

PHE is currently providing outreach workshops with GP surgery staff to showcase the materials available on the Royal College of General Practitioner’s TARGET web site to help improve antibiotic prescribing. The Workshop should last no longer than one hour and will cover: how TARGET can help influence antibiotic prescribing and AMR; improving education of patients about antibiotics through the TARGET web site; how to implement the TARGET web site materials into your practice, using the self-assessment checklist; the resources from the web site, including leaflets, posters, patient information, audit tools; developing a surgery prescribing antibiotic and audit plan.

The TARGET workshop

The workshop (Figure 1) and TARGET resources aimed to influence antibiotic prescribing behaviour in prescribers based on the theory of planned behaviour (TPB). TPB proposes that whether a person intends to do something (in this case prescribing antibiotics appropriately) is influenced by whether the person is in favour of doing it (‘personal attitude’); how much the person feels social pressure to do it (‘subjective norm’); and whether the person feels in control of the action in question (‘perceived behavioural control, including confidence to prescribe appropriately’).

Figure 1.

TARGET antibiotics workshop and toolkit content.

The workshop was designed to be delivered to all members of the primary healthcare team. Workshops were delivered by trained health professionals already involved locally in AMS (GP, microbiologist or medicines manager). Local facilitators received 1 h of face-to-face or Skype training on the principles of the TARGET toolkit and workshop, and a toolkit pack with a video of the workshop presentation, together with TARGET materials and workshop planning materials. The importance of presenting the practice antibiotic data compared with others locally and nationally, and discussion was stressed. Facilitators usually spent up to 2 h familiarizing themselves with the presentation, TARGET materials and local prescribing data.

Workshop participants were first asked to complete the TARGET AMS self-assessment checklist. Central to the 1 h workshop was the TARGET PowerPoint presentation, which aimed to stress the advantages to staff and patients of AMS, as well as the evidence around benefits for or against antibiotics for common community infections using national PHE antibiotic and NICE guidance and clinical scenarios. Facilitators showed and discussed participants’ own practice antibiotic dispensing data including total and broad-spectrum antibiotics and patient-facing materials on the TARGET web site (in particular the TARGET ‘Treat Your Infection’ leaflet). Facilitators stressed the importance of a practice-wide approach, and the importance of improving prescribing for respiratory tract infections (RTIs), increasing the use of nitrofurantoin for lower urinary tract infection (UTI), and reducing unnecessary broad-spectrum antimicrobials especially co-amoxiclav. Facilitators showed participants, and encouraged future use of, the TARGET audit templates and online clinical courses, and asked participants to plan future actions. Practice staff were reminded that their local medicine managers would be following their antibiotic prescribing, and that antibiotic prescribing was being monitored nationally.

The TARGET RCGP web site hosting AMS materials for primary care staff and their patients was launched in November 2012. During the study period, all practices in England were encouraged to reduce their antibiotic prescribing through an annual national campaign aligning with European Antibiotic Awareness Day. In April 2015, 9 months after the workshops were completed, the national quality premium (QP) encouraging CCGs to increase their AMS activities with general practices was launched. This QP incentivized CCGs by £0.40 per patient to reach a 1% reduction in total antibiotic prescription items/STAR PU, and a 10% reduction in broad-spectrum antibiotics (cephalosporins, quinolones, co-amoxiclav) or to stay below the England median value of 11.3%. A small number of practices within each CCG were sent a personal letter from the Chief Medical Officer of England informing them that they were in the top 10% of prescribing practices, and encouraging them to reduce their prescribing (this was added to the regression model below). No other specific AMS activities were held in any of the CCGs involved.

Data collection

Data on antibiotic use in England are collected electronically from pharmacies when each antibiotic prescription is dispensed; each prescription dispensed is referred to as an ‘item’. These GP practices’ oral antibiotic dispensing data and the size of the GP practice were obtained from the Centre of Infectious Disease Surveillance and Control, Information Management and Technology department for 32 months from January 2013 to August 2015 inclusive, including both numbers of items dispensed each month and practice list size for each quarter. The potential effect modifier of Index of Multiple Deprivation was collected from the Public Health Profiles.

Primary outcome

This was: total oral antibiotics dispensed (per 1000 practice patients, excluding anti-tuberculosis and minocycline) within intervention practices compared with controls in the year following the intervention, taking into account dispensing in the previous year.

Secondary outcomes

These were: workshop uptake, dispensing of antibiotics typically prescribed for RTIs [amoxicillin, clarithromycin, tetracyclines excluding minocycline and limecycline (as these are only prescribed as long courses for acne in the UK), and phenoxymethylpenicillin], UTIs (nitrofurantoin, trimethoprim and pivmecillinam) and broad-spectrum antibiotics (co-amoxiclav, quinolones and cephalosporins).

Data analysis

We undertook descriptive data analysis of GP practice demographic data, workshop practice attendance and trends in dispensing data for each GP practice over the period before and during the study. Mixed-effects negative binomial time-series regression models were used to provide estimates of the intervention effect. As workshops were delivered over 7 months (January–August 2014) and prescribing has seasonal patterns, to ensure that the months of outcome data for the control practices mirrored precisely the months after the workshops were delivered, the practice dispensing rate in 2013 was used by the statistician (A. C.), using Stata 13 to undertake post hoc matching of intervention practices accepting the workshop and control practices. A ‘change point’ was assigned to intervention practices that declined the workshop, and to control practices. The empirical cumulative distribution function (CDF) of the 2013 dispensing rate for each of the three study groups (intervention-accepted workshops, intervention-declined workshops and controls) was constructed and the date of the workshop assigned to percentiles within that distribution. For example, the practice with the lowest dispensing rate had a workshop in February 2014, and those control and intervention practices that declined workshops whose rate fell below the 2.5th percentile were also allocated a change point of February 2014. Within the mixed-effects models, GP was included as a random intercept.

As planned in the protocol, we undertook an ITT analysis, including all intervention practices (whether they had a workshop or not), using baseline dispensing rate in the 12 months prior to the workshops, ‘change point’ and CCG, sequential month (and sequential month squared), calendar month and other AMS interventions as explanatory variables in the regression model. The natural logarithm of the practice list size was included as an offset. In addition, to overcome the effects of confounding due to non-compliance (refusing the intervention) we used a Complier-Average Causal Effect (CACE) analysis using an instrument variable approach with randomization as an instrumental variable for workshop received. A Poisson regression model with an endogenous regressor using a two-step generalized method of moments estimator was employed. This provides an estimate of the study effect in compliant practices, compared with the theoretical compliant practices in the control arm. All analyses were performed using Stata 13.

Results

Thirty-six of the 73 intervention practices (49%) received a workshop between January and July 2014 (Figure 2). Baseline total antibiotic dispensing in 2013 was similar in control and intervention (accepted or declined workshops) practices. Workshops were attended by 166 GPs, 51 nurses, and 101 other staff including receptionists, healthcare assistants and practice managers (median for each practice 5–6, range 1–16). On average, each workshop consisted of 4 GPs (mode 5, range 1–10), 3 nurses (mode 1, range 1–7) and 2 other staff (mode 1, range 1–9).

Figure 2.

Study flow chart.

The absolute number and rate of total antibiotic items dispensed in the year after the workshop compared with the year before was lower in the intervention practices compared with controls (Table 1). Dispensing of phenoxymethylpenicillin, amoxicillin/ampicillin, co-amoxiclav, oral cephalosporins, macrolides and trimethoprim was lower in the intervention practices accepting a workshop compared with those who declined, while dispensing of oral nitrofurantoin and pivmecillinam was higher.

Table 1.

Oral antibiotic items dispensed and rate per 100 patients per year (excluding anti-TB and minocycline) for 1 year before and 1 year post workshop, aggregated across all practices by study group

				Intervention practices offered 1 h workshop
Antibiotic groupings	Time	Control practices		declined		accepted
		items	ratea	items	ratea	items	ratea
Total antibiotics
	pre	368 940	61.44	180 270	61.42	164 126	61.84
	post	372 427	62.45	182 946	62.75	160 946	59.82
Respiratory tract infection antibiotics
phenoxymethylpenicillin	pre	20 276	3.376	9447	3.219	8990	3.387
	post	20 162	3.381	9650	3.310	8928	3.318
amoxicillin and ampicillin	pre	100 913	16.804	48 615	16.564	44 125	16.626
	post	103 992	17.437	50 324	17.260	42 774	15.898
all tetracyclines excluding minocycline/lymecycline	pre	30 429	5.067	13 390	4.562	13 802	5.201
	post	28 979	4.859	13 033	4.470	14 463	5.376
all macrolides	pre	48 022	7.997	25 139	8.565	22 182	8.358
	post	50 750	8.509	25 330	8.687	21 216	7.885
Urinary tract infection antibiotics
trimethoprim	pre	45 951	7.652	23 106	7.873	20 280	7.642
	post	44 022	7.381	22 940	7.868	19 853	7.379
nitrofurantoin	pre	23 502	3.914	11 861	4.041	11 866	4.471
	post	23 164	3.884	11 487	3.940	12 907	4.797
pivmecillinam/mecillinam	pre	529	0.442	232	0.389	83	0.124
	post	24	0.021	19	0.032	644	0.968
Broad-spectrum antibiotics
co-amoxiclav	pre	26 917	4.482	13 803	4.703	11 463	4.319
	post	28 784	4.826	14 780	5.069	9 237	3.433
all cephalosporins	pre	9917	1.651	4545	1.549	4111	1.549
	post	10 727	1.799	4921	1.688	3630	1.349
all quinolones	pre	9983	1.662	5603	1.909	4703	1.772
	post	10 224	1.714	5563	1.908	4706	1.749
all broad spectrum	pre	46 817	7.796	23 951	8.160	20 277	7.640
	post	49 735	8.339	25 264	8.665	17 573	6.531

All decreased rates in bold. Values in bold are statistically significant (P ≤ 0.05).

Rate per 100 patients per year.

Intention-to-treat analyses

In the ITT analyses (Table 2) there was non-significantly lower total antibiotic dispensing in the intervention practices allocated to receive the workshop compared with controls, which almost attained significance [−2.7%, dispensing rate ratio (DRR) 0.973, 95% CI 0.945–1.001, P = 0.06]. Amoxicillin/ampicillin dispensing was significantly lower (−4.4%, DRR 0.956, 95% CI 0.920–0.994, P = 0.02), trimethoprim dispensing was significantly lower, but almost attained significance (−5.6%, DRR 0.944, 95% CI 0.898–0.993, P = 0.03) and dispensing of nitrofurantoin was non-significantly higher (+7.1%, DRR 1.071, 95% CI 0.997–1.150, P = 0.06) in the intervention practices compared with control practices. There was no significant change in overall usual ‘UTI-specific’ antibiotic use (trimethoprim, plus nitrofurantoin plus pivmecillinam).

Table 2.

Estimated DRR comparing intervention practices with controls from ITT and the CACE analyses

Oral antibiotics (excluding anti-TB and minocycline)	Analysis
	ITT		CACE
	DRR (95% CI)	P	DRR (95% CI)	P
Total antibiotics	0.973 (0.945–1.001)	0.06	0.939 (0.883–0.998)	0.04
Usual respiratory tract infection antibiotics
phenoxymethylpenicillin	0.971 (0.908–1.038)	0.39	0.928 (0.811–1.063)	0.28
amoxicillin/ampicillin	0.956 (0.920–0.994)	0.02	0.924 (0.839–1.017)	0.11
All tetracyclines	0.987 (0.921–1.058)	0.71	0.925 (0.809–1.058)	0.26
All macrolides	1.007 (0.956–1.062)	0.79	1.005 (0.889–1.136)	0.93
Usual urinary tract infection antibiotics
trimethoprim	0.944 (0.898–0.993)	0.03	0.890 (0.805–0.984)	0.02
nitrofurantoin	1.071 (0.997–1.150)	0.06	1.116 (0.964–1.293)	0.14
pivmecillinam	1.611 (0.852–3.046)	0.14	a
all UTI only: trimethoprim, nitrofurantoin and pivmecillinam	0.988 (0.947–1.031)	0.58	0.964 (0.893–1.041)	0.35
Broad-spectrum antibiotics
all: co-amoxiclav, quinolones and cephalosporins	0.986 (0.927–1.048)	0.65	0.967 (0.847–1.104)	0.61
co-amoxiclav only	0.969 (0.891–1.054)	0.46	0.945 (0.778–1.148)	0.57
quinolones only	1.037 (0.946–1.136)	0.44	1.043 (0.849–1.281)	0.69
cephalosporins only	1.003 (0.871–1.155)	0.97	0.976 (0.726–1.312)	0.87

Values in bold are statistically significant (P < 0.05).

Unable to converge to a solution.

CACE analysis

In these analyses, total antibiotic dispensing and trimethoprim dispensing were significantly lower (total 6.1%, 95% CI 0.2%–11.7%, P = 0.04; trimethoprim 11%, 95% CI 1.6%–19.5%, P = 0.02), respectively, in intervention practices compared with control practices (Table 2). However, for both amoxicillin/ampicillin and nitrofurantoin, the estimates from this analysis were larger in magnitude [7.6% lower (95% CI −16.1% to +17%, P = 0.11)] and 11.6% higher (95% CI −3.6% to +29.3%, P = 0.14, respectively) but less precise (with larger P values).

In the ITT and CACE analyses, phenoxymethylpenicillin, co-amoxiclav, oral cephalosporin and quinolone dispensing were all lower in the intervention practices, while pivmecillinam dispensing from these practices was higher. However, none of these changes was significant. Macrolide use remained unchanged.

Discussion

We found that face-to-face TARGET AMS workshops, including reflection on antibiotic prescribing, guidance, clinical scenarios, strategies to improve prescribing, and demonstration of TARGET patient-facing resources, audits and educational resources, improved antibiotic dispensing for infections in general practices outside a research setting. However, in 2014 before any QP was introduced in England, around half of NHS general practices turned down the offer of a workshop.

Strengths

The McNulty–Zelen design minimizes the risk of research processes influencing outcome. It is particularly useful for evaluating education interventions, and estimates of effect are more likely to reflect what would happen if the intervention were to be introduced in non-trial conditions. It minimizes many of the biases discussed in a 2014 systematic review of educational interventions to improve antibiotic prescribing. It is difficult to determine the exact impact of ‘knowing you are in a study’ (the Hawthorne effect) without repeating the randomized controlled trial within research practices, and with full awareness and consent of all GP staff taking part.

Contamination between intervention and control groups was minimized by randomizing all practices in the same location into the same arm. Other cross-contamination would reflect usual events in everyday practice. There was some evidence that GPs knew other practices were getting educated, as three practices not in the study requested the intervention. We used local staff to give the workshops, so there was no reason for staff to think they were in a trial; no GP staff participating in focus groups or interviews to explore their views of the intervention reported that they thought they were part of a trial. The TARGET workshop and toolkit are based on a behavioural approach, and address prescribing for all common infections rather than just one condition, which was highlighted as a weakness of studies in the 2014 systematic review. Another systematic review found UTIs were under-represented; the TARGET workshop includes UTI cases and encourages more appropriate prescribing for UTIs, including advice to use nitrofurantoin for acute uncomplicated UTIs in line with national guidance, and in line with the 2017/18 QP incentive. Only half of the intervention practices took up the offer of workshops in 2014, but this is probably a true reflection of the difficulties that CCG facilitators face in the context of stretched general practices with many conflicting priorities. Changes to the organization of general practice or incentives from CCGs to practices encouraged by the QP could make the workshops more attractive. Furthermore the effect of the workshops may be greater in the presence of the QP, as practices will know that their prescribing is being closely monitored. Practice randomization was stratified by antibiotic use in the year prior to the intervention, and all practices were involved, not just high-prescribing practices. The effect may be greater if directed only at practices with higher than average prescribing., To match usual service provision, intervention practices were able to opt in or out of the offer of a workshop. We controlled for key potential confounders induced by the non-response (practice list size, baseline dispensing, CCG, seasonal variations and Chief Medical Officer letter to practices) and found no evidence of important differences between randomized groups.

Limitations

Although practices that declined workshops had similar pre-intervention total antibiotic dispensing to those that accepted workshops, they had on average higher broad-spectrum antibiotic dispensing. This supports the use of the CACE analysis, instead of a per-protocol analysis, to allow for selection bias due to differences in intervention practices that declined and attended workshops in their attitude to AMS. The study was powered to determine an effect on all-cause antibiotic dispensing; the sample size would have had to be much larger to determine the effect of the intervention on individual antibiotic classes. We did not attempt to directly collect data on appropriateness of antibiotic use for different infections, or clinical outcomes including adverse events, as this would require practice searches that would be time consuming and lead to a loss of concealment. Furthermore, assessment of the appropriateness of prescribing is difficult as clinicians tend to legitimize an antibiotic prescription with a diagnosis that requires an antibiotic. There was some evidence of more appropriate use of antibiotics for probable UTI, in line with PHE antibiotic guidance, and there was some evidence of a decrease in trimethoprim and increase in nitrofurantoin dispensing, though only the reduction in trimethoprim was statistically significant. A 10% reduction in total antibiotic dispensing (used in our sample size calculation) was probably over-ambitious; the QP that was introduced in England in 2015 only sought a 1% reduction in total antibiotic use. The 2017/18 QP is seeking a 10% reduction in trimethoprim items dispensed for patients aged ≥70 years, and a 10% reduction in the ratio of trimethoprim to nitrofurantoin dispensing in primary care (baseline 2015/16). Both of these reductions were achieved in our study before the QP was in place. Unintended consequences of reducing antibiotic use, such as increased complications from common infections, will need to be monitored by health providers. In England, Escherichiacoli bacteraemias are being specifically monitored prospectively from 2017.,

As this was a pragmatic study, workshops were arranged at the convenience of practices, and undertaken mostly after peak winter prescribing when staff were under less pressure. The workshop effect may have been greater if undertaken before the winter peak prescribing. The workshops were completed 9 months before the start of the English QP (which incentivized CCGs to reduce total antibiotic prescribing by 1% and broad-spectrum antibiotics by 10%). When this QP intervention, starting in April 2015, was added to the model, it had no effect on outcomes. We could only study the effect of the offer of the TARGET workshop on normal service provision, as all the TARGET resources are available free to any users on the web site. Although we performed a qualitative evaluation on a subset of the intervention practices (details to be published separately), we could not ask all practices to collect prospective information on what TARGET resources they had used. We have not presented the cost effectiveness of this approach, but it used freely available PHE/RCGP resources, the usual staff involved in AMS, and the usual practice continuing professional development sessions. The opportunity costs, ie the costs of taking staff away from their other work for training themselves, and the costs of travel and practice workshops, will need to be balanced locally against the amount an area is willing to pay to achieve reductions in antibiotic use and more appropriate prescribing, which in turn may help to control AMR.

Comparison with other studies

The general public have some awareness that most coughs, sore throats, colds and flu get better without antibiotic treatment, but when it comes to themselves they are concerned about the possible severity and duration of their own illness, and consequently about one-fifth will seek advice at a GP practice. Not surprisingly, therefore, a 2016 review of interventions to change prescribing in primary care indicated that although media campaigns are more effective than medical professionals at disseminating information about antibiotics, health professionals are more effective at actually changing behaviours. Thus, not surprisingly, multifaceted interventions involving health professionals as well as patients and community education have consistently produced moderate changes in prescribing behaviours, in comparison with single interventions aimed at only one of these components, which are often unsuccessful. The TARGET workshop gives health professionals the impetus and intentions to change their behaviour, and then gives them the patient-facing materials and dispensing data to facilitate this intentional change. Workshops alone without feedback about antibiotic prescribing do not give prescribers the information they need regarding their prescribing, and how they could improve it compared with their peers locally, nationally or in Europe. Consequently, they may be happy to continue their current prescribing, unaware where they lie compared with others. Involving the whole practice staff rather than just interested individuals or ‘champions’ is therefore important so that an action plan for antibiotic prescribing can be established that involves all staff.

Audit and feedback are often used as a strategy to improve professional practice on their own or as a component of multifaceted interventions (as in TARGET workshops); this is based on the belief that prescribers will modify their practice when given performance feedback showing that their clinical practice is inconsistent with a desirable target, thus influencing their personal attitudes and social norms within a given setting. Although guidance and data provision form the bedrock of AMS, they may not change behaviour when used in isolation. Systematic reviews show that audit and feedback can lead to small but potentially important improvements in professional practice, but are more effective if the baseline performance is poor, if the source is a supervisor or colleague, and if they are provided more than once, and are delivered in both written and verbal formats, with explicit targets and an action plan. The TARGET workshops fulfilled most of these criteria, but we did not insist on repeated feedback of antibiotic use within the study. The TARGET workshop did encourage ongoing antibiotic audits in the practices, but we have not collected data on how many practices performed these. Feedback from commissioners and TARGET facilitators suggested that making time at the TARGET workshop to do even more specific action planning and set targets for dispensing, and pledges to do audits, may facilitate more behaviour change (data presented separately). TARGET training resources stress the extreme importance of action planning and setting targets in the workshop.

Our TARGET workshops within routine practice had effects on total antibiotic dispensing similar to those of the STAR programme (4.2% difference between intervention and controls, which was evaluated within research practices). STAR had a phased engagement and implementation with a practice-based seminar reflecting on practice dispensing and local resistance data, followed by online educational materials and practising consulting skills in routine care through web-based exchange of learning. Our results indicate that if the correct behavioural components are in place, a longer programme may not be needed. Further follow-up of the study practices would determine if the effect lasted longer than 1 year, but this has become more difficult as additional QPs that would influence outcomes are now in place across England.

A time-series analysis of a similar health board intervention in Tayside showed that a multifaceted intervention led to a 33.5% reduction in prescribing the 4Cs broad-spectrum antibiotics (cephalosporins, ciprofloxacin, co-amoxiclav and clindamycin), when specific targets and actions for individual practices were set. Although there was a reduction in co-amoxiclav use this was not significant, as this was a secondary outcome and the sample size was too small. Interestingly quinolone use increased slightly but this was not statistically significant; therefore trainers will need to focus on this antibiotic in future workshops if the practice prescribes high levels of this antibiotic. NHS England has now set dispensing indicators for English practices using the QP. Combined with the QP, the TARGET resources should lead to greater changes in dispensing.

The patient-focused TARGET leaflets are an important behavioural component of the resources, as they give the patient information about self-care, likely illness duration and when to reconsult. They also provide the prescriber with something to give to the patient when they leave (thus legitimizing their visit) and provide the clinician with the opportunity to use a back-up/delayed prescription., A systematic review has shown that back-up/delayed antibiotic dispensing is an effective strategy to reduce immediate antibiotic dispensing. Although GP staff in 2014 in routine practice across England reported that delayed antibiotic dispensing was useful, they reported that a lack of an agreed strategy within a practice, perceived damage to the patient/doctor relationship, lack of training on the strategy, and lack of feedback on dispensing data to inform if their action had made a difference reduced its use. The TARGET workshop and resources could address most of these barriers if complemented with focused action planning around the back-up dispensing and how to implement it using the TARGET leaflet during consultations. There is also a TARGET audit template that includes an assessment for delayed/back-up dispensing in common RTIs and UTI.

Implications

This study indicates that the TARGET workshop with its freely available resources can help improve antibiotic dispensing in primary care. We suggest that commissioners and prescribers access the free workshop and TARGET resources, and promote these to their practices and prescribers with action planning and dispensing feedback in line with any local performance indicators. Further work is needed to study the effect of TARGET workshops long term on antibiotic use and resistance using the antibiotic dispensing, patient and routine laboratory susceptibility data that are now available. Ongoing evaluation of the TARGET antibiotics workshop intervention, ideally using routine prescribing data and monitoring of unexpected consequences, should be incorporated into any scale-up that is planned by primary care commissioners.