| Literature DB >> 35263461 |
Eva K Hennel1, Andrea Trachsel1, Ulrike Subotic2, Andrea C Lörwald1, Sigrid Harendza3, Sören Huwendiek1.
Abstract
INTRODUCTION: Multisource feedback (MSF), also called 360-degree assessment, is one form of assessment used in postgraduate training. However, there is an ongoing discussion on its value, because the factors that influence the impact of MSF and the main impact of MSF are not fully understood. In this study, we investigated both the influencing factors and the impact of MSF on residency training.Entities:
Mesh:
Year: 2022 PMID: 35263461 PMCID: PMC9314722 DOI: 10.1111/medu.14798
Source DB: PubMed Journal: Med Educ ISSN: 0308-0110 Impact factor: 7.647
FIGURE 1Overview of data collection and analysis
FIGURE 2Themes as derived from focus group discussions. Seven themes concern the influencing factors on multisource feedback, and three themes concern the impact of multisource feedback
Sample quotes categorised by theme
| Theme | Sample quote |
|---|---|
| Clear goal | ‘(…) that is a serious thing for someone's career. And then, I suddenly felt like: Okay, what's actually happening with that?’ (Rater 1.4) |
| Training of raters | ‘So there will be no negative effect if you write “unable to comment” everywhere; that is not negative, is it?’ (Rater 2.8) |
| Continuity of observation | ‘(…) you watch them a little closer than you normally would (…) So the focus is then different for me, (…) if I know beforehand that there might be someone asking me [for an MSF] in the near future’. (Rater 2.5) |
| Timing | ‘(…) one month is incredibly early (…) Three months is okay. It's still early, but it's okay’. (Supervisor 3) |
| Narrative comments | ‘But when you give a concrete example (…) that gives you much more feedback, even if it is only a quick snapshot (…)’ (Resident 1.2) |
| Self‐assessment | ‘I think in the feedback conversation, (…) this short addition [the self‐assessment] that would certainly remain with you (…) in the long run’. (Resident 1.5) |
| Role of supervisor | ‘And it [the feedback conversation] always gets mixed up, (…) it always turns into a bit of a career talk, does not it?’ (Supervisor 1) |
| Impact on the professional development of residents | ‘(…) this is the first time I've really left a feedback conversation and thought “ok, I feel rated fairly now,” not only because two consultants told me “oh, you are doing things well or badly,” but a whole group did. And I felt for the first time that maybe I can even apply this feedback’. (Resident 1.2) |
| Impact on teamwork | ‘But even the anaesthesiologists or nurses have been open to it [giving feedback]. They welcomed it. (…) And that, I think, in turn promotes team spirit’. (Resident 1.6) |
| Impact on the commitment of raters | ‘And you can support the resident in this respect. So, for example, if one goal is better communication, then I leave more of the patient interviews to the resident and pay more attention to it and give him the opportunity to improve (…)’ (Rater 2.7) |
Note: The broader context and additional quotes are provided in the Supporting Information.
Recommendations for the implementation of multisource feedback (MSF), derived from the results of the focus group interviews in comparison to the state of the literature
| Influencing factors as derived from the focus group interviews | State of the literature on influencing factors | Recommendations for the implementation of MSF. Italic text indicates the perspective of identity formation theory. |
|---|---|---|
| Clear goal | The aim of MSF should be made clear to all participants in advance. | All participants should be informed about the goals of MSF, as this clarifies the raters' responsibility |
| Training of raters | Raters must feel confident in their task, | Training of raters should include information on ‘unable to comment’ ratings and the scale, including clear reference points |
| Continuity of observation | Raters must be familiar with the residents' work, | It may be helpful for residents to remain with the same raters, depending on the learning goals. If the setting or raters change, residents could voluntarily inform the next raters |
| Timing |
Overeem et al. We found no studies on the problems of rotations for MSF, although rotations are a typical feature of residency training. |
Repeated rotations reduce a resident's chance to work on specific learning goals. A flexible approach or timeframe for carrying out MSF has advantages and might help decide the ideal timing, but the programme must make sure that time is reserved for feedback. |
| Narrative comments | The use of narrative comments is advisable. | Narrative comments strengthen the formative purpose of MSF |
| Self‐assessment | Reflection can help residents use feedback. | Self‐assessment and reflection should be encouraged because it helps residents to prepare for the feedback conversation and take a more active role in their training |
| Role of supervisor | Supervisors have a responsible task. | Feedback should be facilitated by a person familiar with the context, |
FIGURE 3Mutual interactions between influencing factors on multisource feedback (MSF) and impact of MSF (not italicised) as explained with identity formation theory (in italics)