Literature DB >> 35263461

How does multisource feedback influence residency training? A qualitative case study.

Eva K Hennel1, Andrea Trachsel1, Ulrike Subotic2, Andrea C Lörwald1, Sigrid Harendza3, Sören Huwendiek1.   

Abstract

INTRODUCTION: Multisource feedback (MSF), also called 360-degree assessment, is one form of assessment used in postgraduate training. However, there is an ongoing discussion on its value, because the factors that influence the impact of MSF and the main impact of MSF are not fully understood. In this study, we investigated both the influencing factors and the impact of MSF on residency training.
METHODS: We conducted a qualitative case study within the boundaries of the residency training for paediatricians and paediatric surgeons at a University Hospital. We collected data from seven focus group interviews with stakeholders of MSF (residents, raters and supervisors). By performing a reflexive thematic analysis, we extracted the influencing factors and the impact of MSF.
RESULTS: We found seven influencing factors: MSF is facilitated by the announcement of a clear goal of MSF, the training of raters on the MSF instrument, a longitudinal approach of observation, timing not too early and not too late during the rotation, narrative comments as part of the ratings, the residents' self-assessment and a supervisor from the same department. We found three themes on the impact of MSF: MSF supports the professional development of residents, enhances interprofessional teamwork and increases the raters' commitment to the training of residents.
CONCLUSION: This study illuminates the influencing factors and impact of MSF on residency training. We offer novel recommendations on the continuity of observation, the timing during rotations and the role of the supervisor. Moreover, by discussing our results through the lens of identity formation theory, this work advances our conceptual understanding of MSF. We propose identity formation theory as a framework for future research on MSF to leverage the potential of MSF in residency training.
© 2022 The Authors. Medical Education published by Association for the Study of Medical Education and John Wiley & Sons Ltd.

Entities:  

Mesh:

Year:  2022        PMID: 35263461      PMCID: PMC9314722          DOI: 10.1111/medu.14798

Source DB:  PubMed          Journal:  Med Educ        ISSN: 0308-0110            Impact factor:   7.647


multisource feedback

INTRODUCTION

If not executed well, multisource feedback (MSF) can feel like a waste of time. Thus, there is an ongoing discussion on the value of MSF. We know that feedback is a powerful tool to support learning, but surprisingly, little is known about the factors that influence the impact of MSF in residency training. To make the best use of MSF, a better understanding of how MSF works is needed. MSF, also called 360‐degree assessment, is a form of assessment that can support postgraduate medical training. , MSF for physicians is mostly used with a formative purpose, sometimes with a summative purpose. , , , Typically, MSF comprises the feedback from several raters given to a trainee via structured questionnaires. Raters may be peers, supervisors, medical or non‐medical co‐workers or sometimes patients. Their written feedback is often transferred to the resident by a supervisor in a feedback conversation. There, the resident and supervisor formulate learning goals together. Outside of medical education, one meta‐analysis included longitudinal studies on MSF to quantitatively investigate performance improvement and moderating factors. These authors proposed a theoretical model of eight factors that influence performance improvement; these are characteristics of the feedback, initial reactions to feedback, personality, feedback orientation, perceived need for change, beliefs about change, goal setting and taking action. In the setting of medical education, several reviews have focused on the impact of MSF , , , and the factors that influence the impact. , , In summary, it is known that the use of MSF is influenced by facilitating conversations, , , , , , rater credibility, , scoring by colleagues, narrative comments and the perceived quality of mentoring. Still poorly understood is the influence of contextual or cultural factors on MSF, the mentoring relationships and mentors' roles and responsibilities. We also need to determine MSF's effects and track them over time. , , To address these gaps in the literature on MSF, we pose two research questions: What are the factors that influence the impact of MSF on residency training, as perceived by stakeholders in MSF, namely, residents, raters and supervisors? What is the impact of MSF on residency training, as perceived by stakeholders in MSF, namely, residents, raters and supervisors? To explore these questions, we conducted a heuristic qualitative case study based on data collected in focus groups of residents, raters and supervisors. By integrating all these relevant perspectives and discussing them critically with the literature, we derived recommendations, which might help to leverage the potential of MSF for residency training.

METHODS

Study design

Based on a constructivist worldview, we designed a qualitative case study as described by Merriam. A constructivist worldview sees meaning not as stable but as negotiated through the interactions among participants and researchers within the specific context, where researchers interpret and influence the findings. Out of several possible qualitative approaches, we chose a heuristic case study to understand the phenomenon and discover new meaning. This approach enabled us to illuminate the contemporary phenomenon of MSF in residency training within the boundaries of a real‐world setting. , , , We collected data in focus group discussions and conducted a reflexive thematic analysis. We chose focus groups because participants' discussions can reveal underlying social phenomena when a group of participants is gathered and focuses on a certain phenomenon all of them have experienced. When participants share not only what they think but why, underlying beliefs come to the surface and are used as a source of data. In order to derive collective meaning and experiences, we used thematic analysis. , This process uses the researchers' subjectivity as a resource for interpreting the data, in line with our constructivist worldview. Study design and analysis were informed by the literature on influencing factors on MSF and workplace‐based assessment in residency training. In Section 4, we used identity formation theory as the theoretical lens to explain and critically interpret our findings.

Context: Case and phenomenon of interest

This study is bound to the residency training for paediatricians and paediatric surgeons at the surgical clinic of the University Children's Hospital Zurich, Switzerland, between 2015 and 2018 (single‐case study). This clinic aims ‘to continuously ensure a highly competent and highly motivated next generation of paediatric surgeons by providing the maximum possible support to the most suitable candidates’. The strong commitment to training is embodied in a unique training programme that includes, e.g. individual mentoring and rotations abroad dedicated to attaining specific learning goals. Prior to this study, this clinic had already gained experience with formative assessment using Mini‐Clinical Evaluation Exercise (mini‐CEX) and Direct Observation of Procedural Skills (DOPS) and, in addition to the national standard, a form of multirater assessment. Compared with some international training programmes like those accredited by the Accreditation Council for Graduate Medical Education in the United States or those regulated by the General Medical Council in the United Kingdom, MSF is not mandatory in Switzerland. Notably, the study clinic wanted to improve further, aiming for evidence‐based methods to best support their residents. So they were one of the first clinics in Switzerland to implement MSF and still use it. Every resident receives MSF regularly during residency training. Intervals are once in 6 months for surgical trainees or twice during the 6‐month surgical rotation for paediatric trainees. MSF questionnaires are filled in online, usually by 12 raters whom the trainee selects from different groups of co‐workers. Raters, residents and supervisors are informed about the formative purpose of MSF and trained to give feedback via the MSF questionnaire. In a structured feedback conversation between a trained supervisor and the resident, the resident's self‐assessment is contrasted to the summarised MSF feedback, and learning goals for the resident are formulated together. Details about the MSF questionnaire have been described earlier. To the best of our knowledge, only very few residency training programmes voluntarily offer MSF, without existing national obligations. We were able to observe this rare situation in which MSF was implemented to support training, without external requirements.

Conducting the focus groups

Focus groups included persons who participated in the MSF as residents, raters or supervisors and were moderated by EH and SHu using a question route. This question route was built by EH, SHu and AL using a structured method which leads researchers to reflect on their prior knowledge and implicit expectations. To include arising topics, the question route was iteratively refined after each focus group. For an example of the question route, see the Supporting Information. Our sampling strategy within the study aimed for a variety of perspectives. To support open discussions, we held separate focus groups for residents, raters and supervisors. The residents' groups included residents from paediatrics and paediatric surgery. The raters' groups included nurses from the ward, nurses from the surgical theatre, consultant paediatric surgeons and consultant anaesthesiologists. The one group of supervisors consisted of consultants from paediatric surgery. These groups of different stakeholders were convened in alternating order for the cross‐pollination of ideas between stakeholders, which means from a group of raters to a group of residents, to the group of supervisors and so on. See Figure 1. For more data on participants, see the Supporting Information.
FIGURE 1

Overview of data collection and analysis

Overview of data collection and analysis

Data processing

Focus group interviews were held in German and Swiss German, recorded on video to enable better recognition of the different speakers and then transcribed into German. We anonymised participants, replacing names with codes and removing identifying information from the transcripts.

Analysis of focus group data

Our aim was to investigate MSF as an overall process, including its setting, social boundaries, behaviour of participants and the resultant learning goals. There are some theoretical frameworks that help explain certain aspects of MSF; however, to be open to all kinds of results, we decided on an inductive approach without focus on a specific theoretical framework. To identify factors from the participants' experiences, we took a reflexive thematic approach, as described by Clarke et al. , ; see Figure 1. Our analysis was informed by literature on feedback and MSF in medical education, our personal experiences, the reflective notes taken by EH and SHu and shaped by reflective discussions between focus groups. Following the proposed steps, after familiarisation with the data, we systematically coded all transcripts in an inductive manner (EH and AT), using the QDA Miner Lite software, sorted the codes and associated data into initial themes (EH, AT and SHu) and visualised their connections in several mind maps (EH, AT, AL and SHu). Then, the themes were reviewed at the level of the coded data extracts and the level of the whole dataset (EH and AT). This step included iterative cycles of reflection and rewriting, by reading transcripts or viewing respective parts of the videos again, and through discussions of the study authors.

Researchers

In constructivist qualitative research and reflexive thematic analysis, the researchers' subjective opinions and experiences influence data generation and interpretations. Our study acknowledges both the emic (within the setting) and the etic (without the setting) perspective of researchers: The emic perspective is offered by US, who stems directly from within the context and is one of the supervisors of MSF. The etic perspective is offered by AT, AL and SHa. AT studied psychology and had been unfamiliar with medical education. AL is a medical education researcher with a focus on workplace‐based assessment. SHa is a clinician engaged in medical education. All three had no prior contact with the study hospital. EH and SHu are physicians by background, mainly engaged in medical education, and they supported the implementation of MSF at the study hospital. Reflexivity was supported by discussing each focus group before and afterwards, including the assumptions of the focus group moderators. EH kept a reflective diary. We followed O'Brien et al.'s standards for reporting qualitative research and the criteria by Cheek et al. for reporting case studies. For more detailed information on our methods, see the Supporting Information.

RESULTS

Our analysis of the experiences described in the focus groups reveals 10 themes, visualised in Figure 2. Seven themes concern the perceived influencing factors on MSF, and three themes concern the perceived impact of MSF. Sample quotes are shown in Table 1, and further quotes and context are provided in the Supporting Information.
FIGURE 2

Themes as derived from focus group discussions. Seven themes concern the influencing factors on multisource feedback, and three themes concern the impact of multisource feedback

TABLE 1

Sample quotes categorised by theme

ThemeSample quote
Clear goal‘(…) that is a serious thing for someone's career. And then, I suddenly felt like: Okay, what's actually happening with that?’ (Rater 1.4)
Training of raters‘So there will be no negative effect if you write “unable to comment” everywhere; that is not negative, is it?’ (Rater 2.8)
Continuity of observation‘(…) you watch them a little closer than you normally would (…) So the focus is then different for me, (…) if I know beforehand that there might be someone asking me [for an MSF] in the near future’. (Rater 2.5)
Timing‘(…) one month is incredibly early (…) Three months is okay. It's still early, but it's okay’. (Supervisor 3)
Narrative comments‘But when you give a concrete example (…) that gives you much more feedback, even if it is only a quick snapshot (…)’ (Resident 1.2)
Self‐assessment‘I think in the feedback conversation, (…) this short addition [the self‐assessment] that would certainly remain with you (…) in the long run’. (Resident 1.5)
Role of supervisor‘And it [the feedback conversation] always gets mixed up, (…) it always turns into a bit of a career talk, does not it?’ (Supervisor 1)
Impact on the professional development of residents‘(…) this is the first time I've really left a feedback conversation and thought “ok, I feel rated fairly now,” not only because two consultants told me “oh, you are doing things well or badly,” but a whole group did. And I felt for the first time that maybe I can even apply this feedback’. (Resident 1.2)
Impact on teamwork‘But even the anaesthesiologists or nurses have been open to it [giving feedback]. They welcomed it. (…) And that, I think, in turn promotes team spirit’. (Resident 1.6)
Impact on the commitment of raters‘And you can support the resident in this respect. So, for example, if one goal is better communication, then I leave more of the patient interviews to the resident and pay more attention to it and give him the opportunity to improve (…)’ (Rater 2.7)

Note: The broader context and additional quotes are provided in the Supporting Information.

Themes as derived from focus group discussions. Seven themes concern the influencing factors on multisource feedback, and three themes concern the impact of multisource feedback Sample quotes categorised by theme Note: The broader context and additional quotes are provided in the Supporting Information.

Influencing factors during the generation of feedback

We identified four themes connected to generating feedback: A clear goal, the training of raters, continuity of observation and timing

A clear goal is fundamental, and whether it is formative or summative has relevant implications. Some residents and raters described being uncertain about whether MSF was intended to be formative or summative and said that their perception of its purpose had shaped their ratings. Residents' motivation to participate and their choice of raters had also been influenced by their perception of its purpose. All supervisors were certain the purpose was formative. All groups concluded that a clear formative goal would allow residents to choose honest raters, and raters would feel free to give accurate and rich feedback. However, residents and raters proposed a possible summative use of MSF for career decisions. The training of raters is relevant, especially on the possibility to mark ‘unable to comment’ and the scale. Although raters had been trained, they were not sure how to use the option of picking ‘unable to comment’. They also questioned their objectivity about certain items and about the rating scale, which asked them to rate residents based on their expectations of performance for that year of training. Unlike the raters, residents and supervisors did not doubt the objectivity of the raters and felt that the ratings were fair. The continuity of observation in a longitudinal approach facilitates the ratings. Residents found it important to find raters who had observed them often enough and in an informed and careful manner to give constructive feedback. Similarly, raters stated that after the MSF had been announced, they had tried to follow residents' performance more closely. They suggested that residents should remain with their chosen raters as long as they could work together to provide opportunities for learning to know the residents' work and behaviour in different situations. They additionally suggested that in case of rotations, residents should inform new raters about their earlier learning goals. Some residents, however, felt learning goals were private and should not be shared with raters. The timing of MSF should be late enough to gather meaningful feedback and early enough for residents to work on learning goals. All three stakeholder groups agreed that the right moment in training to conduct an MSF had been difficult to decide. They agreed that depending on the speciality and duration of the rotation, 3 to 6 months of training might generate a reasonable number of contacts. Residents pointed out that enough time to work on learning goals was needed and hence MSF should not be too close to the end of rotations.

Influencing factors during the feedback conversation

We identified three themes connected to the feedback conversation: Narrative comments, self‐assessment and role of the supervisor

Narrative comments help residents to understand and accept feedback and can help guide feedback conversations. Residents were grateful to raters who took the time to write comments instead of just ticking boxes. They said that when scale‐based ratings were provided with narrative comments, they were much easier to work with and accept. Residents appreciated both reinforcing and correcting comments. Supervisors explained that they had sometimes let narrative comments guide the feedback conversation. Self‐assessment was perceived as helpful by residents. Residents found self‐assessment difficult but appreciated its value. They reported that it helped them prepare for the feedback conversation. They also claimed that the comparison between their self‐assessment and the MSF ratings deepened their insights into their performance. The role of a supervisor should be fulfilled by persons from the same department. Residents and supervisors discussed whether the feedback conversations could be led by an external person like a physician from another department or a psychologist from outside the hospital. They argued that, on the one hand, an external person might be without role conflicts, but on the other hand, an external person might not understand the feedback as well. Supervisors found that conversations, guided by residents, sometimes tended to move beyond formative feedback, in the direction of career planning. Overall, supervisors and residents agreed that a supervisor from the same department could facilitate the feedback better than an external person.

Impact

We identified three themes on the perceived impact of MSF: MSF supports the professional development of residents, enhances interprofessional teamwork and increases the raters' commitment to the training of residents. The professional development of residents was supported by the multidisciplinary perspectives of the raters. Residents explained that the multidisciplinary feedback helped them grow and they appreciated the broad range of raters across different fields and hierarchies. Raters confirmed that they had already observed examples of positive changes, especially in situations they had described in narrative comments. Stakeholders reported several observations, which led to their perception of enhanced interprofessional teamwork: The raters' understanding of the residents' work grew. Residents and raters appreciated that the implementation of MSF trained them on giving and receiving feedback in general, which facilitated their communication. This improved communication between raters and residents helped raters to gain a better understanding of residents' working conditions and duties. The better understanding led to enhanced respect for the residents' work and improved interprofessional teamwork. The commitment of raters to training was increased as they became aware of their supporting role. Residents felt thankful that co‐workers were motivated to give feedback in support of their training and realised that co‐workers viewed residency training as an important task. Raters said that they had become aware of their active role in training not only during the MSF itself but also beyond the MSF.

DISCUSSION

To address the ongoing discussion on the value of MSF, we performed a case study that elucidated the influencing factors in MSF and the impact of MSF on residency training. In focus group interviews, we collected data from residents, raters and supervisors of MSF. By performing a thematic analysis and discussing the resulting themes critically with the literature, we derived recommendations. The central insights gained in this study include new aspects relevant to the implementation of MSF and novel theoretical assumptions on how MSF works. In the following, first, we discuss the novel theoretical assumptions. Second, we summarise all recommendations on influencing factors, as derived from the focus group interviews, in Table 2, including those not discussed in detail, as they mainly confirm earlier studies. Third, we discuss those recommendations we deemed as adding most to the extant body of literature.
TABLE 2

Recommendations for the implementation of multisource feedback (MSF), derived from the results of the focus group interviews in comparison to the state of the literature

Influencing factors as derived from the focus group interviewsState of the literature on influencing factorsRecommendations for the implementation of MSF. Italic text indicates the perspective of identity formation theory.
Clear goalThe aim of MSF should be made clear to all participants in advance. 7 , 34 All participants should be informed about the goals of MSF, as this clarifies the raters' responsibility and makes the raters' role as socialising agents explicit.
Training of ratersRaters must feel confident in their task, 7 , 35 and trust in raters is needed and appropriate. 36 Training of raters should include information on ‘unable to comment’ ratings and the scale, including clear reference points and shared discussions on the community's expectations.
Continuity of observationRaters must be familiar with the residents' work, 17 and a longer period of co‐working is helpful. 37 It may be helpful for residents to remain with the same raters, depending on the learning goals. If the setting or raters change, residents could voluntarily inform the next raters (community of practice) about their learning goals. Both supports the role of socialising agents.
Timing

Overeem et al. 18 asked how often feedback conversations should take place.

We found no studies on the problems of rotations for MSF, although rotations are a typical feature of residency training.

Repeated rotations reduce a resident's chance to work on specific learning goals.

A flexible approach or timeframe for carrying out MSF has advantages and might help decide the ideal timing, but the programme must make sure that time is reserved for feedback.

Narrative commentsThe use of narrative comments is advisable. 13 , 35 , 37 , 38 Narrative comments strengthen the formative purpose of MSF and help to define the expectations raters have of residents and make these expectations visible.
Self‐assessmentReflection can help residents use feedback. 7 , 14 Self‐assessment and reflection should be encouraged because it helps residents to prepare for the feedback conversation and take a more active role in their training, thus supporting the process of reidentification and development.
Role of supervisorSupervisors have a responsible task. 14 , 34 , 39 Feedback should be facilitated by a person familiar with the context, as context knowledge is needed to assemble the ratings into a broader picture.
Recommendations for the implementation of multisource feedback (MSF), derived from the results of the focus group interviews in comparison to the state of the literature Overeem et al. asked how often feedback conversations should take place. We found no studies on the problems of rotations for MSF, although rotations are a typical feature of residency training. Repeated rotations reduce a resident's chance to work on specific learning goals. A flexible approach or timeframe for carrying out MSF has advantages and might help decide the ideal timing, but the programme must make sure that time is reserved for feedback.

The literature offers theoretical models and frameworks that enhance our understanding of MSF

These are, primarily, general frameworks such as self‐regulated learning, social cognitive theories or theories on communities of practice and, secondly, specific models for MSF. The specific models focus on concrete aspects of MSF and describe the facilitation of MSF, the reactions of MSF recipients and, as presented in Section 1, performance improvements following MSF. Our study took the overall process of MSF into consideration, including its setting and the relevant stakeholders. This way, we discovered a new perspective that might be helpful in the context of residency training: During the analysis of the data, we realised that the participants' views on the influencing factors and on the impact of MSF can well be understood through the lens of identity formation theory, as described by Jarvis‐Selinger et al. Jarvis‐Selinger et al. explain that identity formation theory describes the ‘relation between the development of competency and the formation of identities’. Unlike competency‐based frameworks, identity formation theory defines the goal of training not only as the expert performance of a sum of competences but also their integration into a more holistic professional identity. Training in this respect concerns the individual level of one's personal development and the collective level of one's socialisation into a community of practice. Development is supported not only by work experience and explicit feedback but also by the repeated reinterpretation of the self and the alignment to new roles that are attributed by the community of practice. Consequently, development is supported not only by clinical supervisors who give explicit feedback but also by socialising agents, whose (implicit) messages help to shape the expected roles. Most studies on MSF focus on its impact on performance. , , Findings on further impacts beyond competence have rarely been reported. , Our study newly illustrates the interaction between the implementation of MSF, the community of practice, which in our case includes residents, raters, and supervisors and the impact of MSF (see Figure 3).
FIGURE 3

Mutual interactions between influencing factors on multisource feedback (MSF) and impact of MSF (not italicised) as explained with identity formation theory (in italics)

Mutual interactions between influencing factors on multisource feedback (MSF) and impact of MSF (not italicised) as explained with identity formation theory (in italics) Using the theories on identity formation, we can understand the impact of MSF better: First, we found that multidisciplinary feedback supported the professional development. Using identity formation theory, we can explain that residents and raters define their roles in the context of their social surroundings and that feedback is needed to shape these roles. Thus, MSF can help to guide residents' professional development. Second, we found that teamwork was enhanced due to the raised communication about the residents' work. Using identity formation theory, we can explain that explicit discussions on expected role behaviour again help to shape the expected roles. Thus, MSF can initiate discussions that indirectly enhance teamwork. Third, we found that raters increased their engagement in teaching. Using identity formation theory, we can explain that a commitment to training can be understood as part of the raters' role and was strengthened by making it explicit. Thus, MSF reinforces raters' commitment to training.

Influencing factors

All recommendations on influencing factors are summarised in Table 2. Following, we discuss the themes concerning influencing factors which add most to the existing body of literature.

Continuity of observation

Raters expressed their efforts to contribute to valid observations and meaningful feedback. All groups of stakeholders made clear that meaningful rating depends on raters knowing residents well. While this finding has been reported in the literature on formative assessment, it has seldom been discussed with regard to MSF. As far as we know, few studies on MSF have taken the raters' perspective more deeply into account. Our findings show the importance of raters in MSF. It empowers their role as socialising agents when raters get to know residents better over time or when residents voluntarily inform the community of practice about their learning goals. Our findings suggest that the raters' role as socialising agents should be explicitly discussed when implementing MSF and be regarded a valuable resource. The proposed continuity of observation enables the raters to fulfil their role as socialising agents.

Timing

Residents explained that they preferred to receive feedback as soon as reasonable to have enough time left for working on goals, but repeated rotations that last only some months could be a hindrance. For the setting of this study, residents and raters considered 3 to 6 months a useful observation period. As far as we know, there are no studies on the problem of timing during rotations, although rotations are a typical feature of residency training in many places. Our current impression is that a flexible approach for the moment of carrying out an MSF is needed. It should allow both, a minimum of observation and enough time before the end of a rotation to work on goals. However, as was shown for other forms of workplace‐based assessment, a flexible approach can more easily be sacrificed for lack of time. So the programme has to make sure that time for feedback is reserved. One solution might be to offer a broader timeframe when to conduct the MSF or to set the moment for the MSF depending on the activities during a rotation.

Role of supervisor

Raters and residents perceived the role of the supervisor in the feedback conversation as very important, and they concluded that the feedback could not be facilitated by an external person without a thorough knowledge of the context. Though the literature on MSF also describes delivering the feedback as a task of great responsibility, , , it offers no clear guidance, how and by whom this task should be fulfilled. In identity formation theory, it is postulated that beginners need to concentrate on ‘doing’ and performance, while later in training, the focus shifts from competence to a more holistic ‘identity as a physician’. Assessment should thus be based on more than the sum of competencies. We conclude that while the description of single competencies in the MSF instrument is useful for raters, to assemble those ratings into a picture that can be used to support the resident, experienced supervisors are needed.

Strengths and limitations

The main strength of the present study is the choice of a setting in which MSF had been implemented explicitly to individually support residents. In addition, we investigated the most relevant perspectives by including residents, raters and supervisors. Our study leads to new recommendations on the implementation of MSF and, unlike most studies on MSF, proposes a theoretical framework (identity formation theory), which can guide further research on MSF in residency training and its use. A limitation of the study is that only during the focus group interviews we realised the huge impact of MSF on identity formation. A study that integrates this aspect directly into the research question and question route would probably result in richer and more precise findings concerning this concept. This study did not integrate patients as raters of MSF or as participants of the study, who presumably would have added additional important perspectives. As this study used qualitative methods, we did not measure the proposed factors and outcomes. Future research should investigate the impact of MSF not only on the competences of single residents but also on social implications and teamwork, to better understand how MSF can influence physicians and their communities of practice.

CONCLUSION

This study illuminates the influencing factors and impact of MSF on residency training. Our findings add to the body of literature on the implementation of MSF. We derive recommendations on the continuity of observation, the timing during rotations and the role of the supervisor. Moreover, we provide novel theoretical assumptions on how MSF works. By discussing our results through the lens of identity formation theory, this work advances our conceptual understanding of MSF and might guide further research to leverage the potential of MSF in residency training.

CONFLICT OF INTEREST

None.

ETHICS STATEMENT

The local committee of the Association of Swiss Ethics Committees (Kantonale Ethikkommission Zürich) decided from the study protocol that no further approval was necessary. All participants of the study gave informed consent.

AUTHOR CONTRIBUTIONS

EH, US, SHa and SHu designed the study. EH and SHu acquired the data. EH, AT, AL and SHu analysed and interpreted the data. EH and SHu drafted the manuscript. AT, US, AL and SHa revised it critically for important intellectual content. All authors approved the version to be published and agree to be accountable for all aspects of this study. Data S1. Supporting Information Click here for additional data file.
  33 in total

1.  Assessment of physician performance in Alberta: the physician achievement review.

Authors:  W Hall; C Violato; R Lewkonia; J Lockyer; H Fidler; J Toews; P Jennett; M Donoff; D Moores
Journal:  CMAJ       Date:  1999-07-13       Impact factor: 8.262

Review 2.  Workplace-based assessment as an educational tool: AMEE Guide No. 31.

Authors:  John Norcini; Vanessa Burch
Journal:  Med Teach       Date:  2007-11       Impact factor: 3.650

3.  User perceptions of multi-source feedback tools for junior doctors.

Authors:  Bryan Burford; Jan Illing; Charlotte Kergon; Gill Morrow; Moira Livingston
Journal:  Med Educ       Date:  2010-01-05       Impact factor: 6.251

4.  Doctors' perceptions of why 360-degree feedback does (not) work: a qualitative study.

Authors:  Karlijn Overeem; Hub Wollersheim; Erik Driessen; Kiki Lombarts; Geertje van de Ven; Richard Grol; Onyebuchi Arah
Journal:  Med Educ       Date:  2009-09       Impact factor: 6.251

5.  A qualitative study on trainees' and supervisors' perceptions of assessment for learning in postgraduate medical education.

Authors:  Marja G K Dijksterhuis; Lambert W T Schuwirth; Didi D M Braat; Pim W Teunissen; Fedde Scheele
Journal:  Med Teach       Date:  2013-04-22       Impact factor: 3.650

6.  Thematic analysis of qualitative data: AMEE Guide No. 131.

Authors:  Michelle E Kiger; Lara Varpio
Journal:  Med Teach       Date:  2020-05-01       Impact factor: 3.650

Review 7.  Impact of workplace based assessment on doctors' education and performance: a systematic review.

Authors:  Alice Miller; Julian Archer
Journal:  BMJ       Date:  2010-09-24

8.  Nudging clinical supervisors to provide better in-training assessment reports.

Authors:  Valérie Dory; Beth-Ann Cummings; Mélanie Mondou; Meredith Young
Journal:  Perspect Med Educ       Date:  2020-02

9.  How does multisource feedback influence residency training? A qualitative case study.

Authors:  Eva K Hennel; Andrea Trachsel; Ulrike Subotic; Andrea C Lörwald; Sigrid Harendza; Sören Huwendiek
Journal:  Med Educ       Date:  2022-03-16       Impact factor: 7.647

10.  A qualitative exploration: questioning multisource feedback in residency education.

Authors:  Brie A Yama; Michael Hodgins; Katherine Boydell; Sarah B Schwartz
Journal:  BMC Med Educ       Date:  2018-07-24       Impact factor: 2.463

View more
  1 in total

1.  How does multisource feedback influence residency training? A qualitative case study.

Authors:  Eva K Hennel; Andrea Trachsel; Ulrike Subotic; Andrea C Lörwald; Sigrid Harendza; Sören Huwendiek
Journal:  Med Educ       Date:  2022-03-16       Impact factor: 7.647

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.