Training Family Doctors and Primary Care Nurses in Evidence-based Prevention, Screening and Management of Cardiovascular Risks in Western Ukraine: A Longitudinal Study.

INTRODUCTION: The Ukrainian primary healthcare programme of preventive and screening recommendations has not been evidence-based. The traditional system of continuous medical education in Ukraine places participants in the role of passive listeners. This study explored the effects of an interactive training course on evidence-based prevention and screening of cardiovascular risks, on changes in Ukrainian family doctors' (FDs) and primary care nurses' (PCNs) knowledge and readiness to change practice over time.
METHODS: Three hundred and seven FDs and PCNs participated in the study. Changes in participants' knowledge were assessed with 20 multiple choice questions, and their readiness to change practice with a five-item questionnaire. These were administered before, immediately after, three and twelve months after training.
RESULTS: The mean pre-course knowledge score was 6.1 (SD 1.8) out of 20, increasing to 14.9 (SD 2.3) immediately afterwards (p<0.001). Three months later it was 10.2 (SD 3.2) and at one year it was 10.4 (SD 3.3), both of which were significantly higher than the pre-training level (p<0.005). The percentage of participants that were highly motivated to change their practice increased from 18.4% before the training to 62.3% immediately afterwards (p<0.001). Three months later, this fell to 40.4%. At 12 months it further reduced to 27.4%, but was still significantly higher than the baseline level (p<0.001).
CONCLUSIONS: The interactive training was effective in increasing both participants' knowledge and their readiness to change their clinical practice. The impact of the training diminished over time, but was still evident a year later.

Introduction

The global burden of chronic non-communicable diseases is rising, and achieving an adequate balance between addressing modifiable risk factors and avoiding over-treatment is a international priority (1, 2, 3). In the past, chronic disease screening systems in post-Soviet countries were not evidence-based (4). Following Ukrainian Ministry of Health Care legislation in 2018, the post-Soviet screening protocol was cancelled (5), and it has not been replaced by a new state screening system (4). Individual primary care providers (mainly family doctors, FDs) have their own systems of screening for their patients, which are not always evidence-based, but there are now plans for a state cardio-vascular risk screening programme (blood pressure, cholesterol and blood glucose measurements, body mass index evaluation) (4). The future role of primary care nurses (PCNs) in screening for chronic disease in Ukraine is, as yet, undecided (4), but there is a move to involve them in screening management. There is, therefore, a need to increase the knowledge of both FDs and PCNs regarding evidence-based screening recommendations and to increase their readiness to implement them (4).

Continuing medical education (CME) increases clinician knowledge, as well as improving their performance and patient outcomes (6). The effect size is larger when the educational interventions are interactive (7) and use multiple methods (6). Traditional lectures and seminars are less effective than interactive teaching (8, 9), yet passive learning with minimal trainee participation still dominates the medical education curriculum in Ukraine and other post-Soviet Eastern European countries (10, 11, 12). Innovative training techniques may thus improve FD and PCN training in these countries and be an effective means to induce changes in medical practice (13, 14). Interactive teaching techniques are recommended by the European Academy of Teachers in General Practice / Family Medicine (EURACT) and other medical organizations, and are part of the blended teaching model used with FDs in most developed European countries (15, 16, 17). Interactive training seminars combine various methods which draw participants’ attention and involve them in practical interactions (18, 19, 20, 21). Interactive pedagogical methods include “brainstorming” (a group activity that encourages participants to focus on a topic and contribute to the free flow of ideas), work in small groups, demonstrations, presentation of clinical cases, role-play and feedback. Active teaching/learning techniques can be used to develop creative thinking and establish practical skills and competencies (8, 22, 23). Interactive methods of education in CME of doctors and nurses, such as blended learning, may help to raise their levels of knowledge (15, 17). While interactive training, with the assessment of FDs’ knowledge levels before and immediately after the training, is being introduced into the system of education for primary health care providers in different regions of Ukraine, it mostly relates to emergency care (24, 25).

We aimed to evaluate the effectiveness of interactive training sessions for FDs and PCNs on evidence-based prevention screening and management of cardiovascular risks. We describe our experience in introducing such a training programme in the western (Transcarpathian) region of Ukraine, and we report the changes in participants’ level of knowledge and their readiness to implement the evidence-based strategies they learned over time.

Methods

Setting

The Transcarpathian region is a mountainous area of western Ukraine which includes some remote and distant districts. Primary medical health care is provided by 662 FDs and by approximately 1,000 PCNs for the region’s population of 1.25 million people, about two-thirds of whom live rurally. All FDs and PCNs work at state-supported family medicine clinics, subordinated to local Primary Care Centres.

CME, in the form of a one-month academic course every five years, has been mandatory for FDs and PCNs wishing to confirm or upgrade their qualification category. These courses are conducted at the Postgraduate Faculty of the Uzhhorod National University (UzhNU), and are funded by the practitioners themselves, or by their Primary Care Centres (10). The courses have mainly been based on traditional didactic lectures, with the teaching provided by non-FD specialists. FDs from remote districts often work in solo practices without replacements available and thus cannot complete the full one-month training course. Shorter practical training sessions can, therefore, potentially become an alternative to the current system.

The Training Sessions

Our team at the UzhNU Family Medicine Training Centre organized an eight-hour practical training course on “Evidence-based steps for the prevention, screening and management of cardiovascular risks in FD’s practice”. We used a blended model of teaching with interactive pedagogical techniques that were developed from descriptions of similar programmes in other countries (22, 23). We held 20 identical training sessions for FDs and PCNs in the 12 districts of the Transcarpathian region during 2016-2017, and each participating FD and PCN attended a single session. PCNs were invited to the sessions to increase their understanding of their role in screening management, as we considered that they could be involved in counselling at-risk patients (smoking cessation, lifestyle changes, etc.), measurement of body mass index (BMI) and blood pressure (BP), glucose and cholesterol testing, and organizing follow-up appointments.

At the beginning of each training session we gave a short interactive introductory talk, aimed at increasing participants’ readiness to implement changes in their medical practice. To allow for multiple points of view, we then divided the participants into five small groups (usually with six participants in each). To ensure that each group could benefit from a wide range of skills and experience, the groups were made heterogeneous in terms of age, profession (FD/PCN) and experience. Trainers from our training centre (members of EURACT who were trained in, and had experience of, using interactive training methods for FDs) facilitated a series of four 45-minute workshops, leading discussions on the prevention, screening and management of cardiovascular diseases. The trainers encouraged the participants to express their thoughts and suggest solutions to perceived barriers. Every group rotated through each of the four workshops, with short breaks (5-15 minutes) in between. An overview of the modules is given in Table 1.

Table 1

Module aims and teaching methods.

Module name	Key learning aims	Teaching methods used
Evidence-based approaches to effective counselling for patients with cardiovascular risks	Evidence-based counselling methods for patients with cardiovascular risks	• Participant discussion of clinical cases • Work in small groups • Role-play
Metabolic syndrome	Screening and management of components of metabolic syndrome	• Brainstorming • Demonstrations of practical skills (determination of BMI, waist circumference, glucose measurement) • Clinical cases discussion • Work in small groups
Rational statin therapy	Evidence-based steps for dyslipidemia screening and rational statin therapy for patients with cardiovascular risks	• Brainstorming • Hands-on training in taking blood samples for lipid profile and glucose measurement • Clinical cases discussion • Work in small groups
Essential hypertension and its complications	Evidence-based steps for management of patients with essential hypertension and its complications	• Brainstorming • Work in small groups • Participant discussion of clinical cases

Module 1 (“Evidence-based approaches to effective counselling for patients with cardiovascular risks”) employed participant role-play. Participants were offered situational tasks, as close as possible to real life situations, which gave them the opportunity to apply their knowledge and skills regarding effective counselling of patients with cardiovascular disease risks.

Module 2 (“Metabolic syndrome”) included a presentation of a simulated clinical case, with use of “brainstorming” and demonstrations of practical skills (determination of BMI, waist circumference, glucose measurement). An online resource for FDs that had been developed by the organizers, the “Primary Prevention and Screening Calculator”, was presented to the participants for use in their practice (26). This resource gives practitioners clear evidence-based algorithms for the prevention of cardiovascular disease, and advice on how to develop a cardiovascular disease screening plan.

Module 3 (“Rational statin therapy”) was conducted as a clinical case demonstration of evidence-based management of a patient with dyslipidemia in an FD’s practice. During this session the PCNs had an opportunity to get hands-on training in taking blood samples for lipid profile and glucose measurement.

Module 4 (“Essential hypertension and its complications”) was the final session, in which all participants brainstormed techniques and discussed clinical cases.

Questionnaires

Participants completed two paper questionnaires in which they were asked to state their age, profession (FD or PCN), number of years in practice, and location of their practice (rural or urban). We assessed participants’ knowledge levels by using 20 multiple choice questions (MCQs) about the training topic, chosen by the course trainers from a bank of MCQs used for the certification of doctors and nurses (31). Each correctly answered question was given a score of 1 point, and a wrong answer scored no points, giving a possible range of 0-20 points. We categorized the results as ‘high’ or ‘low’ levels of knowledge, depending on whether individuals answered more than half of the questions correctly (≥11 points).

We assessed participants’ readiness to implement evidence-based prevention and screening with a five-item questionnaire (see Appendix 1). The items were adapted from an IDEA Health and Fitness Association questionnaire (27) and piloted by 20 FDs and 20 PCNs. No changes needed to be made as a result of the pilot. Respondents were asked to assess their levels of readiness to use evidence-based screening of cardio-vascular risks in their own clinical practice, using a five-point scale (ranging from 1, not ready/unmotivated, to 5, very ready/motivated). For each respondent, the sum of the five scores gave a total “readiness to change” score, giving a possible range of 5 to 25. Scores of ≥21 were categorized as “Very ready to change practice”.

We administered the questionnaires immediately before and after the training, as well as three months and one year after the training days. For the latter, we emailed the questionnaires to each of the regional departmental heads, who sent paper copies to the practitioners in their regions. The completed questionnaires were returned to us by post.

Statistical Analysis

Participants’ baseline characteristics were analysed using percentages for categorical variables, with means and standard deviations (SD) for continuous variables. The scores for each round of questionnaires and the proportion of those who achieved high scores are presented as means with 95% confidence intervals (CI). Chi square tests were used to compare proportions, and t-tests to compare means. Statistical data were processed using Stata, version 15.1 IC (StataCorp LP, College Station, Texas).

Results

Overall, 600 FDs and PCNs took part in the training sessions, and of those 307 (51.2%) (211 FDs, 96 PCNs) agreed to participate in the study. All study participants completed the survey immediately after and three months after the training, but 12 months afterwards only 218 participants out of the 307 (71%) did so. The mean study participant age was 45.4 years (SD 12.8), and most (73.4%) worked in rural areas (Table 2).

Table 2

Characteristics of study population (N=307).

Mean age (SD)	45.4 (12.8)
Age <45years (%)	146 (47.6)
Profession (%)
Primary care nurse	96 (31.3)
Family doctor	211 (68.7)
Years in practice (%)
<10	59 (19.1)
10-19	48 (15.7)
20-29	85 (27.8)
≥30	115 (37.4)
Working in rural practices (%)	225 (73.4)

The mean participant knowledge level before the training was 6.1 (SD 1.8) (see Figure 1 and Table 3), and significantly higher immediately after the training: 14.9 (SD 2.3, p<0.001). Three months after the training it was 10.2 (SD 3.2), and one year after the training it was 10.4 (SD 3.3), both of which were significantly higher than the pre-training level (p<0.005).

Figure 1

Mean participant knowledge and levels of readiness to change at different times, with 95% confidence intervals.

Table 3

Results of the knowledge and readiness to change questionnaires before and after the training sessions.

	Knowledge		Readiness to change
Characteristic	Mean score (SD)	High level of knowledge, % (95% CI)	Mean score (SD)	High level of motivation, % (95% CI)
Before training	6.1 (1.8)	2.4 (1.0-4.7)	15.8 (3.4)	18.4 (11.8-26.7)
Immediately after training	14.9 (2.3)	93.7 (90.5-96.1)	20.0 (2.4)	62.3 (52.7-71.2)
After 3 months	10.2 (3.2)	51.7 (46.1-57.1)	19.1 (3.2)	40.4 (31.3-50.0)
After 12 months	10.4 (3.3)	48.2 (41.4-55.1)	16.1 (4.5)	27.4 (21.6-33.8)

The mean level of readiness to implement evidence-based prevention, screening and management of cardiovascular risks at the beginning of the training was 15.8 (SD 3.4) (see Figure1 and Table 3). Immediately after the training, it increased to 20.0 (SD 2.4), significantly higher than the pre-course results (p<0.005). While three months after the training this increase had been maintained, at 19.1 (SD 3.2), and was still significantly higher than before the training, twelve months after the training it had fallen to 16.1 (SD 4.5), similar to the pre-training level.

The proportion of FDs and PCNs who had a high level of knowledge (≥11 points) before the training was 2.4%, immediately after the training it was 93.7%, three months after the training it was 51.7%, and after 12 months it was 48.2%. All these values were significantly higher than that for the pre-training course (p<0.001), (Figure 2).

Figure 2

Percentage of participants who answered more than half of the questions correctly at different times, and who were very ready to make changes to their practice, with 95% confidence intervals.

The percentage of FDs and PCNs that were very ready to implement evidence-based preventive measures in their own practices increased significantly from 18.4% before the training to 62.3% immediately after (p<0.001) (see Figure 2 and Table 3). Three months later, this had fallen to 40.4%, and after 12 months it had further reduced to 27.4%, though this was still significantly higher than the pre-training level (p<0.001).

Discussion

Summary of Important Findings

In a training programme for FDs and PCNs in western Ukraine, the level of knowledge of evidence-based prevention, screening and management of cardiovascular risks increased substantially after a one-day interactive training course and, while it reduced in subsequent testing, remained significantly higher than baseline one year later. While the percentage of participants who were very ready to make changes to their clinical practice was significantly higher at all stages after the training, overall readiness-to-change scores had fallen back to near-baseline levels one year later.

Strengths and Limitations

This is the first report of interactive training for FDs andprimary care nurses in this region. The study included almost a third of all the FDs working in the Transcarpathian region. We were able to explore the effects of our training programme over twelve months of follow-up. While just over half of the training session participants completed the questionnaires, we did not have consent to collect data on the characteristics of those that did not complete these. The knowledge level questions were chosen by experienced FDs from a pre-existing MCQ question bank and therefore have face validity. The “readiness to change” questionnaire was piloted before use in the study. However, we did not assess the reliability of either questionnaire.

We also did not assess whether the programme had an impact on actual patient care. There was no comparison of the effect of the interactive training seminars with traditional Ukrainian medical teaching methods, such as didactic lectures. Moreover, it should be noted that other, unmeasured factors could have influenced participants’ knowledge and readiness to change during the year following their training seminars.

Comparison with Existing Literature

A Spanish study assessed the effect of an interactive course comprising four half-day sessions designed to develop the knowledge and skills required to practice evidence-based care (22). Similar to our study, it demonstrated a significant increase in participants’ knowledge. However, there was no follow-up beyond the questionnaire administered at the end of the course. In a study in China, a weekly face-to-face evidence-based medicine training course was found to increase knowledge and future anticipated use (24). Participants’ subsequent management of hypertension in the community was significantly better than that of a control group that had followed a self-instruction course instead. In a South African five-day interactive training programme for family physician clinical trainers, participants showed an increase in self-reported competencies three months after the course, but an objective assessment showed no change in their capabilities (25).

In a manual for motivational interview training, there are recommendations to assess participants’ levels of interest and confidence in their skills, their readiness to learn those skills, and their self-perceived skill levels (26), all of which were assessed in our interactive training programme. The majority of General Practitioners (GPs) consider evidence-based medicine to be a positive concept (32). However, barriers have been reported that limit its use (33, 34). Research showed that audits, feedback information and group discussion positively contributed to Dutch GPs’ motivation to change their practice (35).

Interpretation of the Findings and Recommendation for Further Research

An interactive teaching method for Ukrainian primary care clinicians resulted in an increase in their knowledge and readiness to change clinical practice, which was to a varying extent still present a year later. Barriers to changing practice identified by the participants included lack of time for motivational interviewing, low levels of patient motivation for lifestyle modification and limited access to screening investigations, especially in rural areas, and these may have limited the extent to which the participants’ own motivation increased.

While there was an immediate increase in the levels of motivation, this reduced over time, which may reflect the limited effect of the single, eight-hour intervention. More research is thus needed to find out whether the increased readiness to change results in real changes in clinical practice, and, if so, what those changes are. There is also a need to find out how, in the post-Soviet Eastern European countries, the increased readiness to change clinical practice can be sustained in the long term.

Conclusions

Interactive training is an effective way to increase primary care clinicians’ level of knowledge of evidence-based prevention, screening and management of their patients’ cardiovascular disease risks, and their short-term readiness to make changes. Although participants’ level of knowledge increased and remained stable between three and 12 months after training, their initial increase in levels of readiness to change reduced over that time. Further research should thus identify methods to attain long-lasting effects from CME, as well as explore the effects of this course on practitioners’ satisfaction and patients’ health outcomes.

	Rating, from 1 to 5
1. From a personal point of view, how motivated are you to conduct evidence-based screening of cardio-vascular risks in your own clinical practice?
2. Taking external factors into account, how motivated are you to conduct evidence-based screening of cardio-vascular risks?
3. How ready will you be to implement the planned new state programme of screening for cardio-vascular risks?
4. How ready are you, in terms of your own clinical abilities, to conduct evidence-based screening of cardio-vascular risks?
5. How ready are you to manage the full range of evidence-based screening tests for cardio-vascular risks? *

Evidence-based screening of cardiovascular risks includes:

- every 1-2 years, measuring the blood pressure of all your patients who are aged 18 or older;

- regular assessment of cardio-vascular risk factors (smoking, alcohol intake, calculation of BMI, family history) for all your patients who are aged 18 or older;

- lipid profile measurement every 5 years, in all your male patients who are aged 40 or older, and all your female patients who are aged 45 or older;

- blood glucose measurement every 5 years for all your patients who are aged 45 or older, or sooner in patients with BMI ≥25 or who have additional risk factors.