Teaching pediatric communication skills to medical students.

BACKGROUND: Delivering effective clinical pediatric communication skills training to undergraduate medical students is a distinct and important challenge. Pediatric-specific communication skills teaching is complex and under-researched. We report on the development of a scenario-based pediatric clinical communication skills program as well as students' assessment of this module.
METHODS: We designed a pediatric clinical communication skills program and delivered it five times during one academic year via small-group teaching. Students were asked to score the workshop in eight domains (learning objectives, complexity, interest, competencies, confidence, tutors, feedback, and discussion) using 5-point Likert scales, along with free text comments that were grouped and analyzed thematically, identifying both the strengths of the workshop and changes suggested to improve future delivery.
RESULTS: Two hundred and twenty-one of 275 (80%) student feedback forms were returned. Ninety-six percent of students' comments were positive or very positive, highlighting themes such as the timing of teaching, relevance, group sizes, and the use of actors, tutors, and clinical scenarios.
CONCLUSION: Scenario-based teaching of clinical communication skills is positively received by students. Studies need to demonstrate an impact on practice, performance, development, and sustainability of communications training.

Introduction

It is well recognized that communicating with children and their families can be challenging for health professionals. A survey of young patients by the Health Commission in 2004 suggested that many children are unhappy with the way in which health workers relate to them whilst they are in hospital.1 Equipping undergraduate students with the tools for effective communication via specific teaching whilst on clinical placement should therefore be part of the curriculum at all universities. Good clinical communication skills correlate with improved health care outcomes.2–4 The recognition that communication skills are a basic clinical skill and the development of practical teaching tools such as the Calgary-Cambridge Guide to the Medical Interview5,6 have led to an improvement in communication skills teaching.7 Draper’s work has been centered on consultations with an adult patient. Although several projects have addressed pediatric trainees’ communication skills,8,9 there is limited work exploring undergraduate level teaching that is focused on the distinct complexities of communicating with children and their families, particularly the challenges of a three-way consultation between a child, their parent, and the doctor.10–14

At Cardiff University, as at other UK medical schools, there is an expectation that undergraduates will finish their pediatric clinical placement with appropriate communication skills. We test this in an Objective Structured Clinical Examination (OSCE)15 at the end of the 5-week placement. Learning good communication skills requires an understanding of the key skills and an opportunity to practice these skills. This practice should be done within a setting where mistakes may be made with no ill effect on patients and from which students can receive personalized feedback on their performance. Using actors has an advantage over using patients as actors may reliably reproduce roles, can consistently portray difficult emotions, and may offer feedback.2,14–17 To allow students to practice communication skills in the pediatrics context, workshops were designed with actors. The aims of this report are to describe the development of a compulsory module for fourth year undergraduate students focusing on the key issues of communicating with children and families, and to assess this module in terms of students’ perceptions of their experience.

Materials and methods

Program design

At the Cardiff University School of Medicine, students are taught clinical communication skills from their first year. Generic communication skills teaching focuses upon students developing an understanding of the basic principles of effective communication, an ability to consider both content and process in effective communication, giving and receiving feedback, and in setting personal learning agendas. The curriculum ensures that the students meet gradually increasing challenges as their clinical skills develop.

The learning outcomes for the pediatrics session were built upon the previous teaching sessions, with the addition of increased emphasis on the need to consider both the child and their family, the emotional impact of the illness within the consultation, and how skilled communication can improve children’s and families’ experience of that illness (see Figure 1).

Figure 1

Intended learning outcomes.

Abbreviation: TD09, Tomorrow’s Doctors 2009 General Medical Council.

Developing and delivering the module

A group of general practitioners with training in effective communication worked closely with pediatricians to identify the challenges of communicating with children. Using these as the foundation, we developed a teaching program, run initially as a pilot scheme, to ensure that students were well equipped to communicate with children during their pediatric ward placement. We did not formally conduct a needs assessment, but whilst we assess students on their pediatric communication skills, we were not formally teaching them. We designed the program using the Calgary-Cambridge guide5 as a foundation. This model provides a clear framework of skills for a generic consultation and highlights the need to address both the disease (the biomedical problem) and the illness (the patient’s experience) within the consultation. Five components of a consultation are recognized (ie, initiating the session, gathering information, physical examination, explanation, and closing the session), as are encouraging fluidity and a structured approach.5 Our teaching session allows students to observe an example of communication with a child or family, using a video recording, then having the chance to practice and develop their own communication skills. Time was also taken to discuss the individual student’s learning agenda, with the aim that feedback can be tailored appropriately to best meet individual learning needs.

During the 2012–2013 academic year, we delivered five sessions, teaching six groups of approximately ten students each time. Two tutors, a general practitioner and a pediatrician, taught each group. This balance of experience offers students teaching in effective communication together with expertise in pediatric practice.

The duration of the teaching session delivered during the introductory week of classroom teaching, prior to students moving out across Wales on clinical placements, was two and a half hours (Figure 2). A video of a three-way consultation between a doctor, an 8-year-old girl with a chronic history of headaches, and her mother was used as a focus for discussion. Tutors are encouraged to stop and start the video, allowing students to raise points that they want to explore.

Figure 2

Lesson plan.

Three scenarios of 30 minutes each followed the video (outlined in Figure 3). Simulated patients/parents (actors) were given a detailed clinical scenario, including possible responses and questions they might use. Tutors received the scenario along with a list of key skills to be focused upon for each consultation, having completed a “train the trainers” day previously. Students received a shorter introduction to each scenario in workbooks, which were available from the start of the academic year on the intranet and distributed as a hard copy to each student on the day before the teaching session. The students were encouraged to read the scenarios and familiarize themselves with their content prior to the session. The workbook includes suggested resources from which they can read about the clinical issues arising for each scenario in advance. Students were encouraged to volunteer to interact with the actors, and were reassured that the tutors would pause the scenarios after a few minutes in order to analyze the content and generate discussion. So that each student had a chance to consult, the scenarios were structured in two parts, allowing one student to take the first part and receive feedback, before a second student swapped into the role of the doctor. The final 30 minutes of the workshop were allocated to summarizing the session and addressing points raised by the students, directing them to resources and learning opportunities on future clinical placements.

Figure 3

Details of the three scenarios for teaching communication skills.

Notes: It is unusual to get a bruise in a 4-month-old child on the cheek and this raises concerns of child abuse. You need to explain that this needs to be further investigated, Luke needs to be admitted to hospital for this assessment and you need to make a referral to social services regarding your concern.

Abbreviation: CEAU, Children’s Emergency Assessment Unit.

During the workshops, we used agenda-led outcome-based analysis18 which is designed to focus feedback on the learner’s needs or agenda. Following a consultation with the simulated patient, the student was first encouraged to reflect upon their own performance using a domain-centered, self-assessment rating sheet as a guide (Table S1). This was separate from the Likert-scale tool used for assessment of the overall session (see below). Feedback was then given by their tutors and peers, with the simulated patient giving the perspective of the patient. After consulting, students were asked if they felt their feedback agenda had changed, and feedback was focused appropriately by the tutors using the Calgary-Cambridge model. Each student was encouraged to discuss their consultation experience with input from the rest of the group.

Student assessment of the module

In order to assess the teaching, students were asked to complete an anonymous feedback form before leaving the session. This form explored eight domains: learning objectives, complexity, interest, competencies, confidence, tutors, feedback, and discussion (Table 1). Each question was scored using a Likert scale from 1 to 5 (1, strongly disagree; 5, strongly agree). In addition to scoring each question, the students were encouraged to give written free text feedback. Two separate analyses were then performed: KF collated the scores for each question, and a thematic content analysis, using a coding scheme developed by SG, was performed on the free text data. RB, CP, and KF reached the consensus that several themes could be identified, ie, the timing of teaching, its relevance, group sizes, the use of actors, tutors, clinical scenario, feedback, and environment. A method of scoring the comments was then devised and agreed upon, and KF analyzed the comments. Each was scored between 1 and 4, as detailed in Table 2.

Table 1

Questions asked of students, with their response to a 5-point Likert scale

Question	1	2	3	4	5	n
	Strongly disagree (%)	Disagree (%)	Neutral (%)	Agree (%)	Strongly agree (%)
1. Today’s session has been helpful in meeting my learning needs	0	0	4 (1.8)	84 (38.0)	133 (60.2)	221
2. The session was pitched at the right level for me	0	2 (0.9)	5 (2.3)	84 (38.2)	129 (58.6)	220
3. The session was interesting	0	0	2 (0.9)	64 (29.1)	154 (70.0)	220
4. I feel I gained new competencies during the workshop	0	0	11 (5.0)	95 (43.0)	115 (52.0)	221
5. I feel more confident communicating with children and their parents after this session	0	1 (0.5)	21 (9.5)	105 (47.5)	94 (42.5)	221
6. I felt comfortable asking the tutor questions	1 (0.4)	2 (0.9)	5 (2.3)	45 (20.4)	168 (76.0)	221
7. I received useful feedback from the tutor/s	1 (0.5)	2 (0.9)	9 (4.1)	65 (29.5)	143 (65.0)	220
8. I felt able to participate in discussion	1 (0.4)	0	3 (1.4)	60 (27.1)	157 (71.0)	221
Totals	3 (0.2)	7 (0.4)	60 (3.4)	602 (34.1)	1,093 (61.9)	1,765

Table 2

Numbers of free text comments, classified by their level of critique

Theme	Negative		Positive		Grand total
	1	2	3	4
Clinical scenarios	10	12	5	42	69
Environment	1	3	1	12	17
Feedback	4	2	2	24	32
Group sizes	5	19	5	4	33
Relevance of teaching	7	5	3	32	47
Timing of teaching	1	4	1	16	22
Tutors	0	1	0	21	22
Use of actors	7	4	1	12	24
Grand total	35 (13%)	50 (19%)	18 (7%)	163 (61%)	266

Notes: Key for codes used to classify level of critique in free text comments, as assessed by researchers: 1, negative; 2, negative but with additional constructive criticism; 3, positive with additional constructive criticism; 4, very positive.

Results

Quantitative data

Of the 275 students invited to attend teaching during the 2012–2013 academic year, 221 (80%) returned feedback forms, although some were incomplete. Overall, 96% of respondents said they agreed or strongly agreed with the statements (Table 1). Students strongly agreed that the sessions were interesting (70%) and helpful (60%), and that they felt comfortable both asking the tutors questions (76%) and participating (71%). Lower proportions strongly agreed that they had gained new competencies (52%) or that they felt more confident communicating with children and their parents after the session (43%). The proportion of students disagreeing or strongly disagreeing with all the positively worded statements was very small.

Qualitative data

Table 2 shows the numbers of comments made by students and classified by the researchers according to theme, and their level of critique as highlighted in the key. The great majority of comments (181/266, 68%) were coded as positive (scoring 3 or 4). The themes receiving the highest proportion of positive comments were tutors and feedback. Group size was the only theme to receive more negative than positive comments, and comments on the use of actors were evenly divided between positive and negative. To understand more about the themes, particularly those that received fewer unanimous comments, an analysis of specific comments was undertaken and is presented here grouped under the themes.

Timing and relevance of teaching

The majority of students commenting felt the workshop was more useful before their placement:

I enjoyed this teaching and feel more confident now with the prospect of dealing with difficult situations while on my pediatric placement.

However, several were concerned about their own lack of pediatric knowledge:

May be more useful at the end of the block when we’ve seen and witnessed some of the situations.

Clinical scenarios and use of actors

Approximately 50% of the students commenting were very positive about the use of actors:

The actors were really good, made the consultations feel realistic.

However, several students commented that it would have been better to have children in the role:

Very good but would be much better at developing our communication skills with children if we had children to practice with.

Some found the scenarios challenging and felt ill-prepared, particularly for the confrontation with a father in the safeguarding scenario (scenario 3). In general though, whilst students found the scenarios challenging, they felt that it was good to explore issues such as safeguarding within a teaching session:

Good to deal with difficult situations and that everyone had an opportunity to take part.

I liked the more challenging scenarios as it gave us an opportunity to come up with ideas/methods to deal with such cases in real practice.

Some students also expressed a view that the difficult scenarios were helpful but took up time that they would rather have used in preparation for their assessments:

It was useful to have such a confrontational consultation and to deal with child protection. However, this was not relevant to things I would have to deal with as a fourth year and I feel this was to the detriment of me having experience of what I will be expected to do in my OSCEs.

Environment, group sizes, tutors, and feedback

Students consistently suggested that smaller student groups would enable more effective learning:

Maybe smaller groups/more actors so everyone gets a chance to do a full consultation.

Some, however, felt that the group size allowed them to learn from one another:

Nice to have a big group allowing you to pick up tips from other people,

Very useful to see others do scenarios and have a go too.

In general, students felt the teaching environment was friendly and relaxed and that they had a good chance to practice their communication skills comfortably:

It was great to practice the skills in a non-threatening environment.

Relaxed atmosphere, which helped when it came to consulting. Didn’t feel pressure to do it perfectly.

Students’ comments were unanimous that the tutors were supportive and encouraging, providing feedback to the students and guiding them as to the additional skills that they could use in future consultations. Opinion was split between wanting feedback straight away or at the end:

Tutors made it easy to voice opinions and discuss each topic.

Tutors were positive with feedback and helpful at directing the consultations.

The feedback was always constructive and has helped me change how I’ll interact with patients.

It was very useful to receive feedback immediately.

Would have been better to have fewer interruptions during each scenario and feedback at the end.

Some commented on aspects such as enjoying hearing anecdotes of working life and sharing tutors’ experiences:

Good to hear doctors’ life experiences.

Tutors were really helpful and added a lot to the experience.

Discussion

Our teaching program has received very good feedback from students and addresses important learning outcomes. It builds upon skills learnt during students’ earlier undergraduate years at Cardiff University using a spiral curriculum and develops these skills in the context of pediatric patients, resulting in a patient-centered approach to communication. Teaching and feedback are linked to each student’s individual learning needs.

Overall, students perceived this workshop module positively. As highlighted in the results section, quantitative data analysis showed that 96% of respondents agreed or strongly agreed with the statements used for assessment of the program. Qualitative analysis demonstrates that the majority of free text comments left by students were positive (68%). It is reassuring that the qualitative analysis appears to agree with the quantitative survey data, where the highest proportion of “strongly agree” scores went to questions including “I felt comfortable asking the tutor questions”, “I felt able to participate in discussion”, and “I received useful feedback from the tutor(s).”

When developing a teaching program, it is important that the environment and teaching style are supportive of creating a safe and secure session during which students can practice their communication without fear of criticism, since it is known that academic performance and self-efficacy are to some extent interrelated.19–21 In this program, students strongly agreed that they felt comfortable both asking the tutor questions (76%) and participating (71%).

Students were divided on whether the use of actors was positive or negative, with some commenting that they would rather work with real patients and children than actors. However, child employment laws state that children cannot be employed within school hours and there are stringent definitions of what is suitable employment.22 These laws have made it necessary to use actors and actresses in the scenarios used in teaching (though the 8-year-old girl filmed for the example of a consultation was the daughter of an actress and filmed her part within the school holidays). Nonetheless, working with actors does have the advantage that we can provide students with challenges, for example, about a child abuse consultation, which they would not be able to experience in a teaching session with real patients.

The majority of comments relating to group size were negative, with many reflecting the students’ desire for smaller group sizes, enabling them to have more chance to consult. As a result, group sizes were reduced for 2013–2014. Many suggested that they would like to be able to take scenarios further and have more discussion, recognizing that the workshop is aimed at introducing the challenges of pediatric communication that students will build upon whilst on clinical placement.

We acknowledge, however, that the type of feedback that we have collated recognizes only the students’ reactions to the teaching, ie, a Kirkpatrick level one evaluation.23 More optimally, one would attempt to obtain measures of impact beyond this, such as assessing student learning (level 2) or observing their subsequent communication behaviors (level 3) on the placement. The feedback has, however, allowed us to discover strengths and weaknesses of the workshop and identify areas that need improvement.

We will continue to assess this teaching program, particularly considering the design changes made as a result of the initial evaluation. There are students who attend with pre-existing experience and confidence in communicating with children and families. Development of future modules could focus on individual student expectations and learning needs, as this may enable them to improve their confidence and gain new competencies. We realize that students tend to reflect positively immediately at the end of a session. It is hoped that for future sessions we may ask for feedback at the end of the clinical placement so as to assess the impact that the teaching had on each student’s skills and clinical experience.

In time, we hope that the sessions will be exclusively taught by paediatricians. Tutor training sessions will be delivered by general practitioner communication skills tutors, highlighting the principles of the course and its objectives. Pediatricians have also been encouraged to use an e-learning package developed by the UK Clinical Communication in Undergraduate Medical Education, which students also have access to through the Cardiff University website.

Conclusion

This teaching session worked well as a pilot scheme and has been positively received during its first year. It is now a recognized part of the undergraduate pediatric curriculum in Cardiff and will be taught to all future years of students. This small-scale study has shown how a pediatric communication skills module can be developed and evaluated using standardized tools and a structured approach. It should be replicable in other centers and also transferable to different stages in undergraduate and postgraduate curricula, given that it would be the complexity of challenges presented and not the structure that would need to be varied.

Table S1

Clinical communication skills: domain-based self-assessment sheet

Domains of competence	Not achieved	Satisfactory	Good	Achieved with excellence
Communication skills (content)
Accuracy of information gathered or given, taking account of biomedical and patient ± family’s perspectives, ICEE - ideas, concerns, expectations & effects on daily life
Communication skills (process)
Introduces self by full name, clarifies reason for consultationInformation gathering: patient centeredness- using open to closed questioning, short and long summaries, good nonverbal communication, managing patient’s concerns, demonstrating empathy, responding to verbal and nonverbal cuesInformation giving: elicit, provide, elicit modelEnds consultation appropriately with clear follow-up plan
Clinical diagnostics and reasoning
Accurate summary and logical interpretation of clinical findings/dataDifferential diagnosis covers common and important “red flag” conditions when appropriate
Clinical care
Management plan and ability to appropriately justify choice of investigations
Professionalism and patient safety
Uses empathic behavior and language to develop rapport with patient and gives accurate explanations, appropriate to the patient (language and pace), checking patient understandingConsiders patient safety, comfort, and dignity
What was done well?
What could be done better?

Note: Students are encouraged to use this sheet to structure their self-assessment and to provide feedback to their peers.

Abbreviation: ICEE, ideas, concerns, expectations and effects on daily life.