| Literature DB >> 27846882 |
Noelle Junod Perron1,2, Martine Louis-Simonet3, Bernard Cerutti4, Eva Pfarrwaller5, Johanna Sommer5, Mathieu Nendaz4,3.
Abstract
BACKGROUND: During their pre-clinical years, medical students are given the opportunity to practice clinical skills with simulated patients. During these formative objective structured clinical encounters (OSCEs), tutors from various backgrounds give feedback on students' history taking, physical exam, and communication skills. The aim of the study was to evaluate whether the content and process of feedback varied according to the tutors' profile.Entities:
Keywords: Feedback; Formative OSCE; Quality; Tutor
Mesh:
Year: 2016 PMID: 27846882 PMCID: PMC5111213 DOI: 10.1186/s12909-016-0815-x
Source DB: PubMed Journal: BMC Med Educ ISSN: 1472-6920 Impact factor: 2.463
Tutors’ sociodemographic data, clinical and teaching experience
| Socio-demographic data and clinical and teaching experience | All | Generalists | Specialists | p |
|---|---|---|---|---|
| n=38 | n=22 | n=16 | ||
| Female n (%) | 17 (45%) | 13 (59%) | 4 (25%) | 0.079 |
| Mean age (SD) | 45 (8) | 44 (9) | 48 (5) | 0.123 |
| Mean years of clinical experience (SD) | 18 (8) | 17 (10) | 20 (6) | 0.341 |
| Mean years of clinical supervision (SD) | 9 (7) | 8 (7) | 11 (6) | 0.133 |
| Mean years as OSCE tutor (SD) | 4 (4) | 5 (4) | 4 (3) | 0.642 |
| Involved in communication skills teaching n (%) | 16 (42%) | 14 (64%) | 2 (12%) | 0.005 |
| Structured training in feedback skills n (%) | 28 (74%) | 19 (86%) | 9 (56%) | 0.062 |
Quality of the feedback perceived by the students (n = 348 questionnaires, 79 “video based” and 269 “direct observation” feedback sessions)
| Quality of the feedback perceived by the students | All Tutors | Generalists | Specialists | ||
|---|---|---|---|---|---|
|
|
|
| |||
| (Likert 1: completely disagree-5: completely agree) | Mean (SD) | Mean (SD) | Mean (SD) | p | Adjusted p* |
| The feedback session was useful | 4.73 (0.57) | 4.78 (0.49) | 4.63 (0.60) | 0.034 | 0.164 |
| I improved my history taking skills | 4.35 (0.84) | 4.38 (0.79) | 4.26 (0.88) | 0.250 | 0.435 |
| I improved my physical examination skills | 4.26 (0.94) | 4.30 (0.92) | 4.12 (1.00) | 0.162 | 0.306 |
| I improved my communication skills | 4.20 (0.93) | 4.26 (0.87) | 3.97 (1.10) | 0.102 | 0.051 |
| The tutor was aware of what I needed to learn | 4.74 (0.58) | 4.80 (0.48) | 4.59 (0.72) | 0.003 | 0.010 |
| The tutor made me feel comfortable and confident | 4.65 (0.72) | 4.72 (0.61) | 4.48 (0.83) | 0.006 | 0.024 |
| The tutor asked me my learning needs | 3.56 (1.63) | 3.81 (1.54) | 2.75 (1.62) | <0.001 | 0.013 |
| The tutor asked me to evaluate what I did well | 4.51 (0.90) | 4.59 (0.77) | 4.30 (1.10) | 0.014 | 0.096 |
| The tutor asked me to evaluate what I could improve | 4.74 (0.62) | 4.83 (0.47) | 4.56 (0.82) | 0.001 | 0.005 |
| The tutor gave me balanced feedback (including both positive and less positive aspects) | 4.71 (0.64) | 4.80 (0.47) | 4.57 (0.85) | 0.006 | 0.030 |
| The tutor stimulated me to participate to the problem solving process | 3.95 (1.24) | 4.14 (1.13) | 3.43 (1.36) | <0.001 | 0.001 |
| The tutor gave me precise and concrete suggestions for improvement | 4.47 (0.92) | 4.53 (0.84) | 4.30 (1.08) | 0.065 | 0.128 |
| The tutor provided me opportunities to practice parts of the history taking, physical exam or the communication | 2.73 (1.62) | 2.84 (1.60) | 2.32 (1.63) | 0.015 | 0.184 |
| The tutor asked the simulated patient to give me a feedback | 4.42 (1.29) | 4.58 (1.11) | 4.04 (1.57) | 0.002 | 0.159 |
| The tutor checked my understanding | 3.23 (1.61) | 3.49 (1592) | 2.52 (1.48) | <0.001 | 0.001 |
*Using a model taking into account the type of OSCE (fixed effect), and the supervisor (random effect)
Categories used to code the content of the feedback and related definitions
| Category | Definition | Example |
|---|---|---|
| Content – history taking | Number of items mentioned and/or discussed regarding history taking during the feedback session | It is good that you asked about the presence of shortness of breath |
| Don’t forget to ask about the past history | ||
| Content – physical examination | Number of items related to diagnosis and management mentioned and/or discussed regarding the physical examination during the feedback session | Your physical exam was systematic |
| You did not palpate the spleen | ||
| Content – explanation and planning-ending the session | Number of items mentioned and/or discussed regarding the suspected diagnosis and management | The diagnosis was correct |
| Content – communication skills | Number of items related to communication skills mentioned and/or discussed during the feedback session | I liked the way you responded to the patients’ emotions |
| You used jargon during the encounter | ||
| Elaboration – clinical reasoning | Number of times the tutor elaborated in directive or facilitative way on the importance or relevance of collecting such items during the feedback session | Why is it important to ask about gynecological complaints in a young woman with abdominal pain? (facilitative) |
| Elaboration – communication/professionalism | Number of times the tutor elaborated in directive or facilitative way on the importance of professionalism or communication | Do not forget to explore patients’ beliefs and emotions: it will influence the way you will explain the diagnosis (directive) |
Objective analysis of the quality of the feedback (n = 140 videotaped “direct observation” feedback sessions)
| Objective analysis | All Tutors | Generalists | Specialists | ||
|---|---|---|---|---|---|
|
|
|
| |||
| Mean (SD) | Mean (SD) | Mean (SD) | p | Adjusted p* | |
| Content | |||||
| Global performance | 0.64 (0.66) | 0.54 (0.60) | 0.77 (0.72) | 0.039 | 0.264 |
| History taking | 4.76 (3.51) | 5.73 (3.75) | 3.54 (2.77) | <0.001 | 0.160 |
| Physical examination | 5.17 (3.05) | 5.73 (3.17) | 4.47 (2.76) | 0.014 | 0.372 |
| Explanation-end | 1.01 (1.03) | 0.92 (1.10) | 1.13 (0.93) | 0.242 | 0.169 |
| Communication | 2.30 (1.70) | 2.61 (1.89) | 1.92 (1.32) | 0.015 | 0.230 |
| Elaboration- clinical reasoning | 1.56 (1.53) | 1.76 (1.57) | 1.32 (1.45) | 0.09 | 0.768 |
| Elaboration- communication/professionalism | 1.46 (1.39) | 1.96 (1.41) | 0.82 (1.06) | <0.001 | <0.001 |
| Process | |||||
| The tutor explored students’ learning needs | 2.67 (1.53) | 3.49 (0.90) | 1.67 (1.54) | <0.001 | <0.001 |
| The tutor stimulated students’ self-assessment | 2.30 (1.53) | 3.07 (1.11) | 1.37 (1.45) | <0.001 | <0.001 |
| The feedback was descriptive | 3.63 (1.22) | 4.12 (0.92) | 3.00 (1.27) | <0.001 | 0.001 |
| The feedback was subjective (using “I”) | 3.16 (1.85) | 3.99 (1.52) | 2.11 (1.70) | <0.001 | <0.001 |
| The feedback was balanced | 3.78 (1.27) | 4.23 (0.90) | 3.21 (1.44) | <0.001 | <0.001 |
| The supervisor took into account the student’s self-assessment | 2.30 (1.65) | 3.19 (1.27) | 1.23 (1.42) | <0.001 | <0.001 |
| The tutor stimulated students to participate to the problem solving process | 2.96 (1.13) | 3.55 (0.86) | 2.21 (0.98) | <0.001 | <0.001 |
| The tutor used role-playing or hands on to give students the opportunity to practice parts of the consultation | 1.18 (1.30) | 1.49 (1.38) | 0.78 (1.08) | 0.001 | 0.036 |
| The tutor checked students’ understanding at the end of the idem | 2.70 (1.60) | 3.67 (1.14) | 1.47 (1.20) | <0.001 | <0.001 |
| Transversal dimensions | |||||
| Empathy | 3.92 (1.02) | 4.46 (0.62) | 3.24 (1.02) | <0.001 | <0.001 |
| Pedagogical effectiveness | 3.14 (1.23) | 3.86 (0.86) | 2.23 (1.00) | <0.001 | <0.001 |
| Structure of the feed-back | 3.11 (1.25) | 3.95 (0.79) | 2.05 (0.86) | <0.001 | <0.001 |
| Verbal interaction | 3.33 (1.05) | 3.74 (0.99) | 2.81 (0.88) | <0.001 | 0.002 |
| Global evaluation | 3.30 (1.07) | 4.01 (0.61) | 2.40 (0.82) | <0.001 | <0.001 |
*using a model taking into account the type of OSCE (fixed effect), and the supervisor (random effect)