Practice and professional development plans (PPDPs): results of a feasibility study.

BACKGROUND: Dissatisfaction with uniprofessional education structures as a means of improving the quality of healthcare has led to proposals to develop ways of integrating professional learning and organisational development. AIMS: Test the feasibility of introducing practice and professional development plans using a centrally sponsored project in Wales.
DESIGN: Qualitative observational study. STUDY SAMPLE: All 541 practices in Wales were alerted to the project and invited to apply. A selection process was suggested to Health Authorities but not always efficiently conducted: 23 practices were selected and 18 participated in the process.
METHOD: Central funding was made available to health authorities. The project framework was designed by an educational department and conceptualised as the development of personal portfolios linked to one key organisation change in each practice, facilitated by external consultants who would typically hold workshops or other events. An independent researcher using non-participant observation techniques at workshops and practices undertook documentary analysis and fieldwork in four health authorities.
RESULTS: Difficulties were encountered with the process of implementing the project: marketing and practice selection inconsistencies delayed the work and it was difficult to recruit practices into the project. The lack of experienced individuals to do the work and practitioner suspicion about perceived 'management' agendas were significant problems. After initial hesitancies most practices appreciated the value of developing wider ownership and commitment to proposed practice changes. Organisations found it difficult to support individual completion of the personal portfolio component of the plans. The ability to develop systems for clinical services was dependent on having already established a culture of effective teamwork in the organisation.
CONCLUSIONS: This work supports the view that organisational development has considerable potential for bringing about effective change, and individual contributions could form a valuable component of personal portfolios. We believe that the existing structures in education and management in the health service are not yet able to support these processes. Evidence from the fields of risk management and quality improvement all point to the need to develop effective organisational systems and the results of this feasibility study indicate that alternative models of sustaining organisational development need careful evaluation.

Introduction

The drive to improve the quality of patient care puts 'lifelong learning' and 'continuing professional development' centre stage in the UK, but, as in other countries, there is an increasing realisation that 'real improvement comes from changing systems, not changing within systems' [1]. This attention on systems puts much more of an emphasis on organisational development [[1-5]]. In addition, the recognised limitations of didactic and uniprofessional continuing education [[6-8]] led to the Chief Medical Officer's review of professional development in primary care. This report recommended that practice and professional development plans should replace existing arrangements as a way of shifting the focus onto systemic interventions [[9-11]]. Although it is appreciated that high quality health care depends on professional collaboration, very little research has been done on how best to develop effective care processes and implement new systems [12].

Practice and professional development plans (PPDPs) have therefore emerged as a widely anticipated replacement in general practice to attendance-based educational systems, incentivised in the UK by the postgraduate educational allowance (PGEA). PPDPs are envisaged to be part of the emphasis placed on learning organisations [13] with the added element of encouraging participants to maintain personal portfolios - which are also likely to be the basis of revalidation [14]. They seem to have been conceptualised as formative organisational plans [15] that can contribute to an individual's professional development portfolio [16, 17].

General practitioners are wary of PPDPs, and the potential opportunity costs involved [15, 18]. This study was therefore set up to assess the feasibility of implementing PPDPs using the management capabilities within Health Authorities. The project was evaluated by a researcher who had no responsibility for the implementation process using qualitative observational methods.

Method

The PPDP project was planned by a postgraduate education department for general practice but managed by coordinators appointed in the five health authorities (budget holders) in Wales - as an additional task to their usual roles. Every practice was given the opportunity to apply and the selection process was designed to ensure that one practice per Local Health Group (LHG) - equivalent in Wales to Primary Care Groups (PCG) in England - be recruited into the study. The Welsh Office (1998) felt that this would enable the LHGs to gain valuable experience of the PPDP initiative. The project initiation document provided detailed information about the concept and constitution of a multiprofessional selection panel. The timetable suggested 2 months for marketing, 1 month for selection and 10 months for completion. The health authorities were asked to identify workshop facilitators that could be contracted to support practice organisational development.

Evaluation criteria and study method

A full time independent research officer evaluated the work using, process-focused qualitative research methods that included non-participant observation, interviews and documentary analysis over a period of 15 months [[19-22]]. 40 workshops involving 16 practices were observed in 4 health authorities, and participants interviewed. The project initiation document [21] incorporated evaluation criteria that informed the observation and interview schedules. Practices were evaluated using both process and outcome criteria [21], which included the appointment and use of experienced facilitators, clearly defined development goals based on a needs assessment exercise, involvement of an appropriate group of professionals for the chosen task, patient awareness and contribution to the change processes and the establishment of a planned organisational change in the practice. Field notes and other documents (practice applications; workshop reports; final plans describing practice-specific outcomes) provided a substantial basis for thematic analysis using a template approach developed during data collection [23]. A final version of this paper was circulated to all practices, facilitators and coordinators to ensure factual and presentational accuracy, and agreement achieved. The participating practices were contacted after the completion date to verify the documented outcomes and to explore the sustained impact of the completed PPDP process.

Results

Project Marketing

There was significant variation in the timing and enthusiasm of the marketing exercise performed by the health authorities. In one area, financial resources were advertised prominently but left unmentioned in others. In three authorities, practices were not provided with the project initiation document and had to make applications on the basis of sparse information. In Gwent, initial applicants were asked to re-submit and comply with additional locally imposed steps.

The Welsh Office stipulation that one practice per LHG should be selected led to significant delays. For example, of the 6 applications in Bro Taf, 5 came from one LHG (Cardiff) and one from Merthyr, leaving two LHGs without applicants. Similar gaps occurred in other areas (except for Dyfed Powys), and some coordinators eventually felt compelled to cajole practices (see Table 1). Adherence to the suggested selection process was variable and inefficiently conducted in some, but not all, areas. The average time for practice selection was 6 months, with the range of 3 to 11 months. The fact that less than 10% of practices in Wales showed any interest in the PPDP process was investigated and found to be partly attributable to suspicions about the health authorities' agenda as organisers of PPDPs and the climate of change fatigue in 1998, as many extracted themselves from fundholding arrangements.

Table 1

Practice response to the initial invitation to apply

Health Authority	Local Health Groups	Number of 'eventual' practice	Number of 'selected'
	represented by 'voluntary'	applications / total in HA (%)	practices
	applications
BroTaf	2 out of 4	6/136 (4%)	5
Gwent	3 out of 5	12/112(11%)	5
Iechyd Morgannwg	1 out of 3	5/84 (6%)	3
North Wales	5 out of 6	15/124(6%)	6
Dyfed Powys	4 out of 4	12/85(14%)	4
Total		50/541 (9%)	23/541 (4%)

PPDP facilitators

The criteria for PPDP facilitators were: capacity to provide a series of interactive workshops over a period of 9 months, ability to support organisational development and experience of teaching others how to use portfolios for professional development. These skills were scarce (and time even scarcer) within health authorities. Other potential candidates, such as general practice tutors, lacked time and experience of facilitating organisational development. We were not able to locate facilitators who had prior experience of leading portfolio learning. Contracts were eventually placed with four providers: three independent companies and one NHS management training organisation (NHS Staff College Wales).

The health authority coordinators initially arranged 'marriages' between facilitators and practices. This approach sometimes resulted in a lack of practice ownership and concerns that the facilitators were management agents. This process was revised and facilitators were asked to provide a presentation to selected practices, who were then allowed a free choice. This 'beauty parade' process increased the sense of commitment. The coordinator in Gwent allowed practices to devise their own facilitation arrangements but only highly motivated practices managed to make progress (see Table 2).

Table 2

Practices, facilitators, project topics and outcomes

Practice Name (List	Local Health	Facilitator	PPDP Process (number of participants per	PPDP Topic
Size)	Group (Health		workshop in brackets)	Outcomes
	Authority)
North Cardiff Medical	Cardiff (BroTaf)	NHS-SCW	5 PPDP sessions: 2 extended group	Management of COPD and leadership development.
Centre (13,000)			meetings (31,27), one visit to neighbouring	Established a COPD register using British Thoracic Society protocol.
			practice (16) and two core group meetings	Improvement of the team's knowledge and skills in COPD and development of
			(8,9).	clinical leadership within the practice.
Ynysangharad Surgery	Rhondda Cynon	NHS-SCW	5 PPDP sessions: 4 extended group	Improvement of patient waiting and time management.
(2,850)	Taf (Bro Taf)		meetings (11,10,10,11), one practice group	Computerised appointments and patient call system. Efficiency gains for
			meeting (8).	patient management and access.
Pontcae Surgery (9,430)	MerthyrTydfil	NHS-SCW	3 PPDP sessions: 3 core group meetings	Planning processes discussed by partners and manager.
	(BroTaf)		(5,6,6).	Increased knowledge regarding strategic planning and policy development that
				led to the establishment of clinical leadership within the practice and an
				acceptance of the need to work with differing leadership styles.
Stanwell Road Health	Vale of	NHS-SCW	1 PPDP session: extended group meeting	Project suspended because of staff illness: no topic chosen
Centre (9,157)	Glamorgan (Bro		(22).
	Taf)
Kings Road Surgery	Cardiff ((Bro Taf)	NHS-SCW	5 PPDP sessions: 3 core group meetings (7,	Clinical data management.
(5,650)	sponsored)		7,7), and two visits to neighbouring practices.	Direct entry of systematised data regarding clinical processes within
				consultations. Improved data management and use of audit and feedback
				techniques to improve clinical systems.
MeddygfaTeilo (9,000)	Carmarthenshire	NHS-SCW	5 PPDP sessions: 3 extended group	Enhancement of information standardisation and team use of clinical database.
	(Dyfed Powys)		meetings (22,16,16), one core group (9) and	Improvement of existing high quality information management systems by
			one visit to neighbouring practice.	provision of training in data quality and management for all members of the
				practice.
Tan-y-Fron (5,500)	Ceredigion	Pi	5 PPDP sessions: 4 extended group	Improvement of a repeat prescribing system.
	(Dyfed Powys)	Associates	meetings (12,12,13,11) and one core group	Organisation-wide protocol agreed to improve the effectiveness and safety of
			(3) meeting.	the repeat prescribing system, linked to the introduction of weekly meetings
				involving practice-based and Community Trust staff.
Winch Lane Surgery	Pembrokeshire	NHS-SCW	5 PPDP sessions: 3 core group meetings	Application for Quality Practice Award.
(12,800)	(Dyfed Powys)		(6,8,9) and two sessions providing personal	Development of specified quality systems to meet the Quality Practice Award
			evaluation feedback to participants.	criteria and assessment of the leadership styles and team roles of selected
				professionals.
LlanfairCaereinion	Powys (Dyfed	Pi	5 PPDP sessions: 3 extended group	Development of practice integration and communication
(4,800)	Powys)	Associates	meetings (24,19,24) and two core group	Outcomes: Introduced regular non-medical staff meetings, and Partner and
			meetings (5,5).	Practice Manager meetings. Appointing a new General Manager
Morrison Road Surgery	Neath Port Talbot	Hammond	4 PPDP sessions: 4 extended group	Generic organisational development discussions.
(4,600)	(Morgannwg)	Irvine	meetings (11,11,11,11).	Developed ideas for the future of the practice and designed ways to improve
				staff management and training. Efficiency gains and improved patient access
				by modifying the appointment systems.
Victoria Road Surgery	Bridgend	Pi	5 PPDP sessions: 3 practice group meetings	Search for solution to lack of space and high workload.
(2,400)	(Morgannwg)	Associates	(9,9,9) and two core group meetings (2,2).	Multiprofessional involvement in problem solving. Solutions identified (new
				premises and enhanced roles for primary care staff) but no follow up support
				from health authority.
Gower Group Practice	Swansea	NHS-SCW	4 PPDP sessions: 4 extended group	Enhancement of information management systems
(6,255)	(Morgannwg)		meetings (14,14,12,12).	Structured data collection systems designed in two clinical areas (diabetes and
				contraception) and attention given to high-risk patients identified by data audits.
Kinmel Avenue Surgery	Conwy (N Wales)	NHS-SCW	5 PPDP sessions: 1 extended group	Practice computerisation.
(13,500)			meetings (23), two core group (9,7) and two	Skills development for both clinical and ancillary staff and clinicians and
			visits to neighbouring practice.	significant enhancement of the use of information technology and
				communication within the organisation.
Bronyffynnon Surgery	Denbighshire (N	NHS-SCW	5 PPDP sessions: 3 extended group	Improvement of practice premises.
(5,200)	Wales)		meetings (16,14,14), two core group	A commissioned architectural audit of the current and potential facilities leading
			consultation with architect.	to a collaborative approach to the development of improved use of space for
				clinical processes.
Caerffynnon Surgery	Gwynedd (N	NHS-SCW	5 PPDP sessions: 5 extended group	Care pathway for patients with terminal illness.
(4,800)	Wales)		meetings (12,12,12,12,12).	Development of a whole team understanding of cancer care via case history
				reviews and patient pathway mapping which led to planned sessions of specific
				training and skills development.
Regent Street Health	Wrexham (N	McEwen	3 PPDP sessions: 3 extended group	Generic organisational development and protocol development.
Centre (8,150)	Wales)		meetings (13,13,13).	Increased emphasis on developing collaborative practice systems and
				improved communication between team members to develop specific clinical
				protocols.
Cambria Surgery (5,200)	Ynys Mon (N	McEwen	2 PPDP sessions: 2 extended group	Coronary heart disease and hormone replacement clinics.
	Wales)		meetings (17,15).	Patient cohorts identified in order to implement a proactive system of
				information provisions (patient leaflets), triaged contact, improvement in data
				collection and internal communication.
Padeswood Road (5800)	Flintshire (N	McEwen	3 PPDP sessions: 2 extended group	Improved practice communication and time management.
	Wales)		meetings (16,16) and one visit to	Regular practice meetings introduced and patient liaison group established.
			neighbouring practice.	Staff attendance at stress management course and the introduction of a
				counselling service to selected bereaved patients.
Chippenham Surgery	Monmouth	NHS-SCW	5 PPDP sessions: 5 extended group	Multiprofessional collaboration to develop intermediate care proposal.
(11,000)	(Gwent)		meetings (92,92,14,9,12).	Development of a multiprofessional collaboration to establish an intermediate
				care proposal, integrating health and social care in Gwent.
Cwmbran Surgery	Torfaen (Gwent)	Internal	3 PPDP sessions: 3 extended group	Care pathway for diabetes mellitus
(6,800)			meetings (16,10,10).	Development of a multiprofessional pathway for the management of chronic
				disease and identification of training needs.
Glan-yr-Afon Surgery	Blaenau Gwent	None	PPDP process not initiated
(3,564)	(Gwent)
Ty Bryn Surgery (10,	Caerphilly	None	PPDP process not initiated
561)	(Gwent)
Bellevue Surgery (11,	Newport (Gwent)	None	PPDP process not initiated
804)

key for PPDP sessions (one session approximately equivalent to 3-4 hours) E Extended General practitioners, employed staff plus others, for example, Community Nurses and Health Visitors, Community Pharmacists, Social Workers, Occupational and Physiotherapists. P Practice General practitioners and employed orattached staff based in the practice. C Core General practitioners, Practice Manager and Practice Nurse. (Pi Associates, NHS Staff College Wales (NHS-SCW), Hammond and Irvine and Ewan McEwen are the organisations that provided the PPDP facilitation skills.

Participants and process

The 23 participating general practices included 3 practices from valley communities, 7 from cities or large towns and the remainder were from rural or market town settings. Three practices had less than 4,000 patients and 6 practices had lists above 10,000. They did not have prior experience of facilitated organisation-wide development or portfolio-based learning.

Typical PPDP workshops took place in half-day sessions, either at neutral venues or in practice meeting rooms. Initial sessions were devoted to explaining the PPDP concept and agreeing the organisation's development priorities. In subsequent sessions some practices met regularly to review progress on agreed tasks and a number undertook visits to other practices.

General practitioners shaped the project groups in differing ways and usually involved one or more of the following arrangements:

• 'core' groups: general practitioners, practice manager and practice nurse

• practice-based groups: as above plus administrative staff

• extended groups: as above plus others e.g. community nurses and health visitors, pharmacists, social workers, occupational and physiotherapists.

The task of agreeing dates for the workshop took several months and illustrated the low priority given PPDPs, compared to meeting service demands. Many doctors were uncertain about closing the practice for half a day in order to allow maximum participation, and were not convinced that time spent on organisational development was a good investment. 'Core' groups found their development objectives to be unachievable without the collaboration of others. Conversely, extended groups experienced difficulty focusing on practice development needs and tensions emerged between practice priorities and community-orientated aspirations. Some practices had predetermined proposals but most allowed goals to emerge. Development priorities focused mainly on improving operational systems and procedures as general practitioners believed these to be essential for good quality patient care. There were examples of raised expectations leading to frustration, for example, a small practice (list 2400) identified an urgent need for new premises to create space for additional roles and new colleagues but subsequently received no active support from the health authority. Workshops occasionally exposed poor professional relationships, either within the organisation or in the wider network. Plans to develop clinical services had to be shelved until these problems were resolved.

As the PPDP process developed, opinions changed. Participants appreciated the 'luxury of thinking space' provided by the workshops. It became clear that facilitated 'time out' was a useful method of designing, implementing and managing organisational change. However, the benefit for personal development was less apparent. Some general practitioners expressed concern about the possible replacement of the existing postgraduate education system. They perceived PPDPs as an inappropriate vehicle for their own professional education and viewed their inclusive nature as a 'dumbing down' procedure. In the words of one doctor, 'there's a flaw in tying personal and practice development together.' These anxieties were partly resolved as individuals realised the benefit of linking personal learning to the enhancement of organisational systems. Box 1 summarises the key lessons identified.

Box 1

Lessons from the PPDP feasibility study

Key messages

Discussion

Principal findings

Introducing general practices to PPDPs by using a short time-scale top-down initiative that required competitive applications for health authority controlled budgets and the imposition of external facilitation was an unwieldy method. The recruitment methods used will, in our opinion, limit responses to be from those who are already confident to tackle the suggested tasks of coordinating an application and may work against those who be starting from a lower base, thus introducing an inverse bias [24]. Health authority management had severe limitations on their capacity to take on this work, external facilitation was relatively expensive yet reflected the realities of commercial rates for this type of work. However, when practices were allowed to choose facilitators and had time to understand the aims of PPDPs, both ownership and commitment to the process increased noticeably. As practices experienced external facilitation, they welcomed the opportunity to learn as organisations and readily appreciated the potential benefits of involving a wide group of relevant professionals in the development of new systems of service delivery. Provided more effective methods of marketing and sustaining PPDPS are devised and tested, the outcomes at organisational levels demonstrate the benefit of using a systems based method of achieving change in primary care.

Strengths and weaknesses of the study

We believe that the strength of this study is its comprehensive account of the complexity involved in supporting organisational change in primary care. We are not aware of any other studies that have tracked the implementation, facilitation and outcomes of organisational development initiatives. Evaluation of the project was a continuous process from inception to completion, using multiple qualitative research methods to record, describe and analyse the convoluted social and organisational processes involved. From this contextual basis we highlight some key issues likely to confront the organisational development of general practice. We recognise that this was an uncontrolled observational study and that no standardised outcome measures are available for this type of intervention [25]. We therefore assessed outcomes by assessing progress against each practice's stated aims. Further research should measure baseline organisational capacity and to be prepared to assess change over a longer timeframe.

Implications

Although it was anticipated that PPDPs would replace the postgraduate education allowance system there have been no further statutory announcements and it is not clear whether the recommendations of the Chief Medical Officer's review will be taken forward [9]. It seems likely that personal portfolios will be required for revalidation purposes but there are no plans emerging about how best to support organisational development in primary care, despite evidence of benefit and a recognised need to fulfil clinical governance requirements [26].

If PPDPs are introduced, the results of this project could guide the implementation process. The skills required to facilitate organisational development do not have a natural home in the NHS nor do they sit comfortably in the uniprofessional departments of postgraduate education for general practice. Managerial systems (health authorities and primary care health groups) are viewed with suspicion by service providers and we found no evidence that they had the necessary background or the skills to support the development of learning organisations [27]. Practices are likely to be most enthusiastic about these opportunities when they understand and agree with the aims of the exercise, feel ready to take on the challenge of addressing change using a group-based approach, have complete confidence in the facilitation process and believe outcomes to be worth the effort involved. Perhaps the introduction of accountability procedures and salaried general practitioners will focus more attention on these issues?

In summary, this work supports the view that organisational development has considerable potential for bringing about effective change, and individual contributions could form a valuable component of personal portfolios. We believe that the existing structures in education and management in the health service are not yet able to support these processes. Evidence from the fields of risk management and quality improvement all point to the need to develop effective organisational systems [4, 28] and the results of this feasibility study indicate that alternative models of sustaining organisational development need careful evaluation.

Pre-publication history

The pre-publication history for this paper can be accessed here: