M D Elfassy1, L J Duncan2, A Green1, H Sun1, T Guimond1,2,3,4, K Tzanetos1,3, J Nyhof-Young1,4. 1. Faculty of Medicine, University of Toronto, Ontario, Canada. 2. Faculty of Health Sciences, McMaster University, Ontario, Canada. 3. University Health Network, Ontario, Canada. 4. Office of Assessment and Evaluation, MD Program, University of Toronto, Ontario, Canada.
Abstract
PURPOSE: Early patient encounters in medical education are an important element of clinical skill development. This study explores the experiences of volunteer inpatients (VIPs) participating in clinical skills training with junior medical students (JMS) solely for educational purposes. METHODS: Following first-year medical students practicing history taking and clinical examinations with VIPs at Toronto General Hospital (TGH) and Toronto Western Hospital (TWH), patients completed a questionnaire and a short audio-recorded interview. This study used a mixed methodological approach. A 5-point Likert-scaled survey queried satisfaction regarding the recruitment process, student and faculty interactions and patient demographics (e.g. age and educational background). A 10-minute follow-up interview investigated patient perspectives. Survey responses were correlated to patient demographics and descriptive thematic analysis summarized trends in patient perspectives. RESULTS: Of 93 consenting VIPs, 66% were male and 58% participated at TGH. The mean overall experience was positive (4.76 and 4.93 at TGH and TWH, respectively). Three themes emerging through thematic analysis were Not "Just" a Medical Student, Patient as Teacher, and Promoting Best Practices. VIPs reported positive experiences when they were adequately informed of the VIP role during recruitment, and when students exhibited confidence, interest, and respect throughout the session. CONCLUSION: Study results provide clarity about VIP experiences with JMS and lay a foundation for improved patient satisfaction and best practices within clinical skills curricula in the health professions.
PURPOSE: Early patient encounters in medical education are an important element of clinical skill development. This study explores the experiences of volunteer inpatients (VIPs) participating in clinical skills training with junior medical students (JMS) solely for educational purposes. METHODS: Following first-year medical students practicing history taking and clinical examinations with VIPs at Toronto General Hospital (TGH) and Toronto Western Hospital (TWH), patients completed a questionnaire and a short audio-recorded interview. This study used a mixed methodological approach. A 5-point Likert-scaled survey queried satisfaction regarding the recruitment process, student and faculty interactions and patient demographics (e.g. age and educational background). A 10-minute follow-up interview investigated patient perspectives. Survey responses were correlated to patient demographics and descriptive thematic analysis summarized trends in patient perspectives. RESULTS: Of 93 consenting VIPs, 66% were male and 58% participated at TGH. The mean overall experience was positive (4.76 and 4.93 at TGH and TWH, respectively). Three themes emerging through thematic analysis were Not "Just" a Medical Student, Patient as Teacher, and Promoting Best Practices. VIPs reported positive experiences when they were adequately informed of the VIP role during recruitment, and when students exhibited confidence, interest, and respect throughout the session. CONCLUSION: Study results provide clarity about VIP experiences with JMS and lay a foundation for improved patient satisfaction and best practices within clinical skills curricula in the health professions.
The early patient encounter is an important aspect of Undergraduate Medical Education (UME).[1] Surveys of junior medical students (JMS) (i.e. pre-clerkship students) report positive experiences and improved clinical skills when learning within a clinical environment.[2],[3] JMS have valued their interactions with real patients, describing their learning as more authentic, focused, and meaningful.[4],[5] They also described an improved ability to communicate therapeutically, build rapport, and express empathy.[6],[7]From the patient perspective, numerous studies have demonstrated an overall positive patient response to medical student participation in their care.[9],[10],[11] One study showed that when JMS were integrated into a patient’s care team, patients maintained high levels of satisfaction with their care.[9] The most common reason cited for positive attitudes towards medical student involvement was a desire to contribute to the education of others. Conversely, concerns around privacy and increased length of office visits resulted in negative patient feedback.[11] Other patients interviewed by first-year medical students believed they benefited from the process, noting the therapeutic nature of discussing their illness in depth.[12] Similar studies at the University of Toronto demonstrated that 89% of patient volunteers assessed by JMS for educational purposes enjoyed the experience. Of these patients, 94% reported a positive volunteer experience and communicated willingness to participate again.[13],[14]Evidently, early patient interaction in UME confers benefit to both JMS and patients themselves. However, few studies have evaluated patients volunteering to participate in the teaching of JMS who are not involved in their care; available research is limited to outpatients affiliated with organizations that enroll volunteers in the community, and who may be compensated for their time.[6],[12],[13] For decades, UME has relied on inpatients to volunteer their time to participate in clinical skills training for JMS.[15] Nonetheless, volunteer inpatient (VIP) experiences have not been thoroughly explored.Physician tutors in the Integrated Clinical Skills (ICE) curriculum at the University of Toronto regularly recruit consenting VIPs at local teaching hospitals for educational interactions with JMS; however, no standard recruitment method currently exists. For example, many tutors will go to the ward the morning of the clinical skills session and recruit their patients or those of colleagues to be interviewed and examined by medical trainees. In the authors’ (MDE, LD, AG) previous experiences as JMS interacting with such volunteers, patients often appeared uninformed about the volunteer process, asking, “Why are you asking me these questions?” or “Why don’t you look up the answers in my chart?” We would then repeat the interaction’s purpose, concerned that patients felt uninformed or uncomfortable during the encounter. Similarly, others have proposed that VIPs may feel pressured to participate by feelings of owing the doctor or staying in their good graces.[15]Thus, a knowledge gap exists regarding VIP experiences in UME, particularly when sessions are unrelated to patient care. We used a convergent parallel mixed methods study design to evaluate VIP experiences with first-year pre-clerkship medical students practicing history taking and physical examinations for strictly educational purposes. By concurrently using both survey and interview data, we set out to develop a more thorough and integrated understanding of VIP encounters and the resulting patient satisfaction levels. Our goal was to provide insight into VIP experiences, thereby revealing necessary considerations to promote a better, more patient-centered clinical skills curricula. We anticipate that lessons learned will be relevant to other medical schools and health professional training programs that work with VIPs.
Methods
Curriculum content
Each Friday, approximately 260 first-year University of Toronto medical students engage in the ICE curriculum to learn clinical skills from physician tutors, and then practice them with standardized patients and VIPs. Two subsets of first-year students are located at Toronto General Hospital (TGH) and Toronto Western Hospital (TWH), two large downtown Toronto teaching hospitals affiliated with the University Health Network that serve diverse patient populations. ICE physician tutors recruit and consent adult, English-speaking inpatients from among their own patients and those outside their circle of care to participate in a clinical history and/or physical examination with medical students. ICE students divide into groups of six, each led by a faculty physician tutor. The groups then further divide into subgroups, typically of two students (but ranging between one to six students), to practice their interview and physical examination skills with a preselected VIP. The resulting clinical skills session between the VIP and students is standard hospital educational practice. However, for our study, Research Assistants (RAs) (non-medical students) collected post-encounter satisfaction data from consented VIPs. Research Ethics Board approval was obtained from the University Health Network.
Research elements
A questionnaire and follow-up interview were developed and validated after a review of the literature and in consultation with education scientists, program leadership, and JMS. Consensus was reached, and the materials were then validated with two VIPs. RAs were trained to administer both components in a standardized fashion.A 10-minute questionnaire asked about VIPs’ demographics, encounter factors (e.g. time students spent with participants, number of students present), and satisfaction. Satisfaction sub-scale scores were generated for recruitment (composed of 5 questions), clinical interaction (5 questions), interview (5 questions), physical examination (5 questions) and overall experience (3 questions), by averaging the 5-point Likert-type items within each survey sub-scale. The completed questionnaire content guided the subsequent 10-15-minute, audio-recorded patient follow-up interview.The interview guide consisted of open-ended prompts such as: “Tell me about your experience working with the students today”; “why did you agree to participate with the student(s)?”; “how did you feel with the student(s)?”; “what do you think could have been done to improve your experience?” RAs also asked VIPs to elaborate on any outliers scored in the questionnaire (i.e. anomalous ratings).
Procedure
Physician tutors were recruited and consented to the study prior to the teaching session. Generally, one RA was assigned to a group of six students and their physician tutor. The tutor informed the RA once the JMS completed the patient interaction; RAs did not observe the private JMS-patient interactions. The RAs then entered the room, recruited and consented each patient to the study, and administered the questionnaire and interview. Four to six RAs and one site lead were at both TGH and TWH each week.This study was carried out in accordance with the Declaration of Helsinki,[16] including but not limited to ensuring privacy, confidentiality and obtaining informed consent. Written consent was obtained from all VIPs.
Data analysis
Questionnaire responses were coded into Excel spreadsheets and descriptive Statistics (measures of central tendency and dispersion) were performed (R version 3.5.3,[17] with the Tidyverse package[18]). Patient satisfaction was compared to gender, age, how the patient was feeling, number of students present, physician presence, and student time spent with the patient. Spearman rank-order correlational analyses were performed between normally and non-normally distributed variables respectively, comparing satisfaction level with continuous variables (e.g. patient age and student time spent with patient).Audio recordings were transcribed, and descriptive thematic analysis performed, based on grounded theory methods developed by Glaser and Strauss.[19] Two independent researchers iteratively analyzed each interview line-by-line to generate initial codes, which were then then grouped into categories based on common properties. Constant comparison was used to generate overarching themes in the data, and data saturation was achieved. The resulting coding framework was reviewed by the entire research team and finalized via consensus. The entire dataset was then reanalyzed using the finalized coding scheme until all data were coded and accounted for.
Results
Volunteer in-patient demographics
Of 93 total VIP encounters, one patient participated twice, resulting in 92 participants. Of these, 61 were male (66.3%), and 54 (58.1%) participated at Toronto General Hospital. Education level varied among participants; the majority (80%) completed high school. No statistically significant differences existed between hospital sites regarding age, gender, or education. Demographic data are presented in Table 1.
Table 1
Inpatient demographic information
N(%) n = 93
Age(Mean ± SD)
58.4 (18.2)
GenderMaleFemale
61 (66.3)31 (33.7)
Education≤ 8thgradeSome High schoolCompleted High schoolSome PostsecondaryCompleted PostsecondaryCompleted Postgraduate
Hospital SiteToronto General HospitalToronto Western Hospital
54 (58.1)39 (41.9)
Inpatient demographic information
Patient feedback questionnaire results
. A majority of VIPs (66 or 71.0%) completed both the physical examination and medical interview, a quarter (23 or 24.7%) the medical interview only, and 4 (4.3%) a physical exam only. About three quarters of the VIPs (68 or 73.1%) reported that the recruiting physician was not their own; a quarter (25 or 26%) were recruited by their providing physician, and the remainder were unsure. The majority (61 or 66.3%) of encounters had two students present; 18 (19.6%) had three or more students, and 13 (14.1%) had only one student. About half (50 or 53.8%) of VIPs reported that physicians were not present; about a quarter (22 or 23.7%) of encounters had physicians present throughout; and 21 (22.6%) had physicians present some of the time. Encounter duration varied: 44 (47.3%) were between 21-40 minutes, 33 (35.5%) between 0-20 minutes, and 16 (17.2%) greater than 40 minutes. Patients reported a low average fatigue score of 2.3 (SD 2.1) on a 10-point scale (0 being not at all tired and 10 extremely tired). Fatigue scores were not found to be related to the length of encounter duration in a linear model, (p = 0.342) nor when alternate models using different cut-off points for greater fatigue beyond a specific length were used as the predictor (p-values ranged from 0.240 to 0.889). Encounter factors are presented in Table 2
Table 2
Clinical encounter factors
Encounter Factors
Task, N = 93 Physical Exam Medical Interview Both
4 (4.3%)23 (24.7%)66 (71.0%)
Patient Recruited by Providing Physician,N = 93 Yes No Unsure
25 (26.9%)46 (49.5%)22 (23.7%)
Number of Students Present, N = 92 1 2 3+
13 (14.1%)61 (66.3%)18 (19.6%)
Physician Present, N = 93 Yes No Sometimes
22 (23.7%)50 (53.8%)21 (22.6%)
Encounter Duration (min), N = 93 0-20 21-40 >40
33 (35.5%)44 (47.3%)16 (17.2%)
Patient Fatigue Rating [mean (SD)], N = 93 Rating from 1-10
2.3 (2.1)
Clinical encounter factors
Recruitment, clinical interaction, medical interview, and physical examination
Participants at both hospitals rated their experiences (e.g. recruitment, clinical interaction, medical interview, physical examination, and overall rating) very positively, (4.7 or higher out of 5). They reported statistically significant differences between hospital sites, where TWH was rated slightly higher for clinical interactions (p = 0.012), physical examinations (p = 0.020), and overall rating (0.033). See Table 3.
P values were generated from t-tests. P values < 0.05* were considered significant
Overall satisfaction scores by siteP values were generated from t-tests. P values < 0.05* were considered significant
Qualitative results
VIPs provided both positive and constructive feedback regarding their experience. They provided rich commentary and supportive critique to improve the sessions. Three overarching themes emerged: Not “Just” a Medical Student, Patient as Teacher, and Promoting Best Practices.
Theme 1: Not “just” a medical student
The strong bedside manner of JMS was commented on very favourably and often by VIPs, specifically as it relates to the unique human element that students brought to the interactions. It appeared that student emphasis on being “just” a medical student did a disservice to the student-patient relationship, despite VIPs being understanding of this lack of professional confidence given their early stage of clinical training.: Bedside manner describes a doctor’s approach or attitude toward a patient. JMS’ strong bedside manner was commented on very favorably and often: “If they’re going to be doctors, they’re going to get top points for bedside manner.” VIPs identified contributing student qualities and skills, emphasizing the human element that medical students brought to the clinical interactions: “They even warned me sometimes that they had cold hands, so I really appreciated that. We’re all humans and that kind of made me feel more comfortable.” Another patient explained: “They came to sound my chest, and then they talked to me. Just making me feel human, and not like some sort of number on a chart. ‘Cause you can get lost in the shuffle of the hospital, and they didn’t make me feel that way”. A strong bedside manner involved showing VIPs respect and by being patient throughout their interactions: “They were very patient. They let me talk.”One family member commented:They just took their time and being compassionate and respectful of the individual’s dignity if you will. Like having to take your clothes off and expose yourself when there are younger people in the room could be somewhat intimidating at her age, but they covered her up and did it in the most respectful manner that they could. It was done very nicely.Several VIPs identified a lack of student confidence as an area for improvement. They understood that students possessed minimal clinical experience, but noted that projecting professional confidence helps put VIPs at ease. One VIP suggested that students should try to appear more confident than they truly may feel: “Go into it with even some false confidence…if someone comes in and they’re obviously very nervous, it’s kind of unsettling to you…That’s a piece of advice: ‘Fake it till you make it!’” Another VIP highlighted that students repeatedly explaining that they were “just first year medical students” could detract from both students’ and VIPs’ experience. They suggested: “Say that they’re first year the one time, but maybe not too continuously, because then it kind of takes away from the fact that they’re examining and that they’re becoming doctors.”
Theme 2: Patients as teachers
Having the opportunity to share their illness narrative was both important and educational for VIPs, and the JMS demonstrated attitudes and behaviours that made the VIPs feel heard. VIPs felt that providing JMS with these early clinical interactions was an important educational experience and that their stories served as strong teaching tools in preparing JMS with the skills needed to understand the needs of their future patients.Many VIPs enjoyed the opportunity to teach medical students about their illnesses and unique medical journeys. One VIP described the importance of this: “I just feel that it’s important being able to teach other people but also to explain about my disease, because it’s a rare condition.” Some VIPs saw the experience as a helpful exercise in understanding their own hospital and medical history: “I think it was informative for both myself and the medical students. Basically, after explaining my medical history to them, it gave me a deeper realization of what my health status was.” Finally, VIPs appreciated opportunities to ask questions and gain information from the students. “There are things that I didn’t understand before, that I understand now. The nurses here have so much stuff to do, and I got the chance to ask questions. […] the experience is great… you get to ask questions that you wouldn’t really ask otherwise.”Many VIPs expressed satisfaction because they felt listened to by the students: “The students seemed very interested in my story, and so, most people are happy when people seem interested in their story.” Students accomplished this in several ways, including the use of engaged body language: “They were very attentive, listening to every word I was saying. There were noises going on in here and not once did either of their heads turn in that direction of the noise.” They also showed interest in both medical and non-medical information provided by VIPs: “I know that sometimes I do go off on tangents, and then I asked if he wanted me to get back on track with more medical issues and he said no, which is wonderful because then you know he’s listening.”A large proportion of VIPs felt that their contributions were important to improve physician education. They enjoyed providing students with hands-on experience. One said, “I feel that it’s so important that the doctors get a personal perspective…if they would get more experiences like this, that could really help them understand the needs of the patients.” Another explained, “I think it’s very important for students to get in front of real-life patients, how they’re feeling, what’s going on and what they’re experiencing at bedside.” Similarly, VIPs felt positively about their contributions as a way to improve medical care both for themselves and for future patients: “I think it’s a good experience knowing it could potentially help someone else and the future doctors.”
Theme 3: Promoting best practices
The majority of session improvements identified by VIPs were related to deciding whether or not to volunteer, with specific mention of timing of recruitment and information provision.The time provided to each VIP to decide to volunteer was not standardized; it varied among recruiting physicians. Several VIPs reported having only a few minutes to consent, and more time to make this decision would have been appreciated: “Well it was sudden… I didn’t really have any warning before… Just give a little time, I’d say. Instead of coming suddenly and saying, we’re going to do this.” They enjoyed the experience nonetheless: “Yeah, probably maybe a day earlier rather than the morning of. But yeah, it was great.”Discrepancies existed in the information patients received about being a VIP. Some recalled receiving no information: “I wasn’t informed at all.” Others may have received incomplete information: “I wasn’t aware there was going to be a physical portion… he may have mentioned it, and maybe I didn’t hear it.” Multiple patients recommended providing both printed and verbal information ahead of time.
Discussion
This study aimed to better understand the experiences of patients who volunteer to be assessed by first-year medical students practicing clinical skills for educational rather than patient care purposes. Methodological triangulation demonstrated strong agreement between quantitative and qualitative datasets and allowed for a robust account of our findings.Similar to previous studies, our results demonstrated that volunteering was a positive experience for these VIPs, as demonstrated by a high overall satisfaction rating of 4.73 and 4.93 out of 5 at the two hospital sites. Satisfaction was unrelated to various encounter factors (e.g. time students spent with participants, number of students present), suggesting that together these factors are optimal.Although both hospital sites showed similarly positive scores, statistically significant differences existed such that TWH scored slightly higher in clinical interaction, physical examination and overall scores. This difference may be due to the increased complexity and severity of illness of patients at TGH, which is a quaternary care, research-intensive hospital. However, the overall satisfaction levels were remarkably positive in both sites.Our qualitative themes enabled a deeper understanding of survey responses and elucidated pertinent context. In general, VIPs reported feeling listened to, described the students as having generally good bedside manner, and felt they were contributing to patient care and medical education. One area of feedback was for the JMS to exude more confidence in their encounters.A key area for improvement elicited from the interviews was our VIP recruitment process. Some patients reported a lack of information provision regarding the volunteer process; they felt they had insufficient time or information to decide to participate. Although this concern did not appear to reduce VIPs’ satisfaction, we are utilizing this insight to improve the consent process to ensure patients more completely understand and appreciate their volunteer role. While no respondents indicated feeling pressured to volunteer, recruiting physician tutors need to also emphasize that participation is completely voluntary, and will not impact patient care. The University of Toronto MD Program is currently developing written information pamphlets for patients to reinforce the verbal recruitment messages of tutors. Ideally this multimodal approach will to allow patients more means and time to absorb information regarding the volunteer process and have their questions answered. We anticipate developing faculty development materials for new tutors.
Study limitations
Our study was conducted in two large academic urban teaching hospitals; thus our patient sample may not be generalizable to inpatients in community based or rural settings (e.g. respondents were mostly high school graduates or higher); however, our large and diverse sample and triangulation of survey with interview data gives us confidence in our results.Our study may have an inherent selection bias; inpatients who agreed to be study volunteers may be more or less satisfied than other VIPs. However, given our diverse respondent demographics, the broad range of opinions and perspectives offered, and reaching data saturation, we believe that our sample is representative and provides worthwhile data. Since no between group comparisons were planned, a sample size calculation was not indicated, but we had a robust sample size (n = 92 inpatients). Our results are proving informative for enhancing local medical education practice, and we believe our lessons learned have practical implications for other healthcare professional training settings.The logistics of this large, two-site, patient-centred study were complex, and we were unable to obtain broader student perspectives than those in the research team about student experiences in the clinical encounter, a worthwhile future endeavor.
Conclusions
In conclusion, VIPs with the ICE curriculum at the University of Toronto report their experiences as overwhelmingly positive. Specifically, our qualitative results revealed several themes explaining such positive ratings. These included; Not “Just” a Medical Student, Patient as Teacher, and Promoting Best Practice. Further, satisfaction ratings were highly positive across diverse encounter factors including patient demographics, fatigue, number of students present, physician presence, and student time spent with the patient. This suggests that current educational encounter factors are already optimal.Our study findings may also provide valuable lessons for other health professional training programs using volunteer inpatients in their curriculum. Our current VIP recruitment process could be improved. Study respondents occasionally reported a lack of information regarding the volunteer process, and some felt that more time or information for participant decision-making would have been helpful. Therefore, we recommend that the consent process prior to an educational interaction provide VIPs with detailed verbal and written information regarding the VIP role. Ideally, our future VIPs will receive recruitment information pamphlets and have sufficient time to review the information and ask questions prior to consenting to the clinical interaction. This may serve to further increase patient satisfaction, and as importantly, ensure the best possible ethical practices and experiences during the clinical training of medical students with their highly valued volunteer inpatient collaborators.As interactions with VIPs are often the first clinical encounters in UME, future research should evaluate the impact of these seminal experiences for JMS. This may expose gaps in knowledge or preparation, and offer valuable insight to continue to shape clinical skills curricula and JMS’ comfort, and further promote VIP satisfaction.
Authors: Christopher Kiefer; Joseph S Turner; Shelley M Layman; Stephen M Davis; Bart R Besinger; Aloysius Humbert Journal: West J Emerg Med Date: 2015-11-22