Literature DB >> 36199481

Coaching for Surgeons: A Scoping Review of the Quantitative Evidence.

Sarah C Skinner1,2, Stéphanie Mazza1, Matthew J Carty3, Jean-Christophe Lifante1,4, Antoine Duclos1,2,3.   

Abstract

To characterize quantitative studies on coaching interventions for professional surgeons to understand how surgical coaching is defined; examine how different coaching programs are designed, implemented, and evaluated; and identify any relevant research gaps. Background: Surgical coaching is gaining attention as an approach that could help surgeons optimize performance and improve overall wellbeing. However, surgical coaching programs and definitions of coaching vary widely between studies.
Methods: A systematic literature search of PubMed, Scopus, Web of Science, CENTRAL, clinicaltrials.gov, and WHO ICTRP was conducted according to the PRISMA-ScR framework to identify studies and registered clinical trials written in English. Original quantitative studies on coaching interventions for professional surgeons were included. Characteristics of the coachees, coaching programs, study designs, outcomes, and findings were charted and analyzed.
Results: From 2589 references, 8 studies (6 published; 2 registered trials) met inclusion criteria. Published studies targeted technical or nontechnical skills, included 2-26 surgeons as coachees, and used coaches who were surgeons. Two studies demonstrated that surgeons react positively to coaching. Studies showed inconsistent effects on technical/nontechnical skills. Only two studies measured patient adverse events and reported no significant positive impacts. The registered randomized trials targeted surgeons' physiological parameters or wellbeing and used professional coaches. These trials measure surgeon and patient outcomes. Conclusions: There is an emerging interest in coaching programs to improve surgeons' performance by targeting their professional skills and personal factors. However, more randomized trials are needed to evaluate the impact of coaching interventions on patient outcomes and surgeon wellness.
Copyright © 2022 The Author(s). Published by Wolters Kluwer Health, Inc.

Entities:  

Keywords:  coaching; nontechnical skills; performance; technical skills; wellbeing

Year:  2022        PMID: 36199481      PMCID: PMC9508984          DOI: 10.1097/AS9.0000000000000179

Source DB:  PubMed          Journal:  Ann Surg Open        ISSN: 2691-3593


INTRODUCTION

Professional surgeons are expected to maintain peak performance throughout their careers. However, opportunities for continuous professional development (CPD) are often limited to short courses, lectures, and self-study. These methods have been criticized because they do not adhere to the principles of adult learning theories, which promote the use reflection, personalized feedback, and individualized goal setting for skill acquisition and behavior change.[1,2] Furthermore, opportunities for CPD generally do not address the full range of factors that can affect a surgeon’s performance, including burnout, stress management, and wellbeing.[3,4] Surgical coaching has been proposed as a solution that could be used to improve surgeons’ performance and overall wellbeing.[5] Unlike mentoring and teaching, which involve advising and unidirectional knowledge transfer, coaching involves an exchange that guides the coachee to identify their own solutions.[6] The potential benefits of coaching for surgeons have attracted increasing attention.[5] However, this field of research is still developing, and the content and objectives of coaching programs are highly variable. Past reviews have included studies assessing coaching for surgeons in training, and have limited their scope to only include coaching interventions aiming to improve technical or nontechnical skills.[7-12] No previous review has evaluated coaching interventions for professional surgeons targeting any aspect of their professional skills or personal development. This scoping review aims to identify quantitative studies on coaching interventions for practicing surgeons to clarify how surgical coaching is defined, to analyze how these interventions are designed, implemented, and evaluated, and to illuminate relevant research gaps in the field.

METHODS

Literature Search

The study protocol was registered a priori with the Open Science Framework (https://osf.io/3kzp4/). A systematic database search using PubMed, Scopus, and Web of Science was conducted in accordance with the PRISMA-ScR guidelines.[13] Unpublished studies were identified using Cochrane CENTRAL, clinicaltrials.gov, and WHO ICTRP. Studies in English published or registered from the inception of each database up until the final search in March 2021 were included. Search algorithms for each database are detailed in Supplementary Table 1, http://links.lww.com/AOSO/A133. The reference lists of all included articles and relevant review articles were manually searched to identify additional studies.

Eligibility Criteria and Study Selection

Studies involving original quantitative research on coaching for professional surgeons were eligible. Interventions that included only unidirectional or intraoperative feedback, that involved only surgeons in training, were based around learning a new procedure, or reported only qualitative results were excluded. Two authors (S.C.S. and A.D) independently screened the titles and abstracts of identified citations according to the eligibility criteria. The full texts of all selected studies were screened by S.C.S and A.D. using the eligibility criteria to determine admissibility for data extraction. Disagreements between reviewers were resolved through discussion and mutual agreement.

Data Extraction and Analysis

One investigator (S.C.S.) extracted data using a predetermined form (Supplemental Table 2, http://links.lww.com/AOSO/A133). The data extraction was verified by another investigator (A.D.). Study outcomes were categorized using Kirkpatrick’s 4-level evaluation model adapted for coaching.[14] Study designs were classified using a simplified version of Grading of Recommendations Assessment, Development, and Evaluation (GRADE) (randomized trials were considered “high” evidence level, quasi-experimental studies with contemporaneous controls were “moderate” and without controls were “low,” cross-sectional studies were “very low”).[15]

RESULTS

Four thousand two hundred twenty-six records were identified (Supplemental Figure 1, http://links.lww.com/AOSO/A133). Once duplicates were removed, 2589 references remained. After title and abstract screening, 27 articles were identified for full-text review. Ultimately, 6 published studies and 2 ongoing registered trials were selected for analysis.

Coaching Definitions and Goals

Each study was assigned an identifier based on the first or last author’s last name and the publication year (Table 1). Five of the six published articles defined coaching, peer coaching, surgical coaching, or surgical peer coaching. Common themes that emerged were the importance of a one-on-one, nonhierarchical coach-coachee relationship, the use of objective feedback, and setting individualized goals to refine existing skills.
TABLE 1.

List of Articles Selected for Inclusion and Their Definitions of Coaching

No.TitleStudy IDCoaching Definitions(s)Study Objectives
1A statewide surgical coaching program provides opportunity for continuous professional developmentGreenberg et al[16]Coaching—“an experiential process for improving any aspect of surgical performance, including technical, cognitive, and interpersonal skills… based upon a partnership between 2 surgeons in which one facilitates the other’s pursuit of self-identified goals through collaborative analysis, peer support, and constructive feedback. Coaching emphasizes the development and refinement of the learner’s existing skills and his/her empowerment to make changes to practice”Peer coaching—“a distinctive type of coaching in which peers at a similar level of knowledge engage in an equal noncompetitive relationship”To develop and implement an evidence-based peer coaching program for board-eligible/certified surgeons across practice settings in the state of Wisconsin. The four main objectives were to identify the goals of surgeons participating in the peer coaching, evaluate the extent that the coaching session adhered to the stated goal, evaluate the effectiveness of surgeon coaches to employ activities of coaching; evaluate the perceived value of participation in a surgical coaching program
2Targeted surgical coaching can improve operative self-assessment ability: A single-blinded nonrandomized trialBull et al[17]Surgical coaching—“a constructive relationship that provides objective feedback to individuals about a broad range of factors influencing operative performance. There is a focus on improvement and refinement of existing skills, rather than teaching new techniques or philosophies. Individualized approaches are required to effectively implement these objectives. Excellent coaching interactions encourage discussion, affirm positive beliefs, and challenge assumptions”To investigate the effect of targeted surgical coaching on self-assessment of laparoscopic skill
3Team Leader Coaching Intervention: An Investigation of the Impact on Team Processes and Performance Within a Surgical ContextMaynard et al[18]Coaching—“a process of equipping people with the tools, knowledge, and opportunities they need to develop themselves and become more effective.”Leadership coaching—“targeted interventions that involve a formal one-on-one relationship between a leader and a coach (who has no formal supervisor authority over the person being coached), with the purpose of improving the leader’s effectiveness”To determine whether a team leader coaching intervention can improve episodic team processes and enhance operating team outcomes
4Surgical Coaching for Operative Performance Enhancement (SCOPE): skill ratings and impact on surgeons’ practicePradarelli et al[19]Surgical peer coaching—a “series of structured one-on-one discussions over time… provides space for surgeons to reflect on their performance with another surgeon (i.e., a peer coach) and make changes to their own practice”To better understand the impact of coaching on surgeons’ performance, to measure surgeons’ technical and nontechnical skills throughout a longitudinal surgical coaching program
5Feasibility of Surgeon-Delivered Audit and Feedback Incorporating Peer Surgical Coaching to Reduce Fistula Incidence following Cleft Palate Repair: A Pilot TrialSitzman et al[20]Surgical coaching—“a social interaction that aims to develop expertise by setting specific goals and providing feedback to achieve those goals”To determine the feasibility of a surgeon-delivered audit and feedback intervention incorporating peer surgical coaching.
6Association of a Statewide Surgical Coaching Program with Clinical Outcomes and Surgeon PerceptionsGreenberg et al[21]N/ATo assess the association between participation in a surgical coaching program and risk-adjusted outcomes
7Evaluation of Coaching Impact on Surgical OutcomesDuclos[22]N/ATo evaluate the impact of a customized surgical coaching program, targeting surgeons’ physiological factors (sleep, stress, physical activity), on the occurrence of patient major adverse events.
8Effect of Coaching on Surgeon Wellbeing, Job Satisfaction, & FulfillmentDyrbye[23]N/ATo determine if individualized professional coaching improves physicians’ sense of wellbeing and jobsatisfaction.
List of Articles Selected for Inclusion and Their Definitions of Coaching Details about the coaching programs are provided in Table 2. The coaching goals of all published studies targeted technical or nontechnical skills. Two studies focused on improving specific technical skills defined by the investigators.[17,20] One study focused on leadership, a nontechnical skill, to improve episodic team processes.[18] Three studies allowed coachees to identify their own goals related to their intraoperative performance.[16,19,21] The registered trials target surgeons’ wellbeing and physiological factors.[22,23] Figure 1 provides a visualization of the different interventions’ coaching goals and their settings.
TABLE 2.

Description of Coaching Programs

Coaching Intervention GoalsDescription of CoachesInteractionCoaching “Material” Used to EvaluateStudy ID
Type of Intervention GoalaOverall Goalsa Defined by Coachees or Investigators?Details About Coaching GoalsaHow Many?Who Were the Coaches?Were the Coaches Trained?In Person?Surgery Observed?Metrics/Assessment Tools Used to Evaluate Coachees
Technical skillsInvestigatorsImprove technical performance of cleft palate repair (decreasing fistula incidence)2Surgeons (peer)NoIn personVideo recording of operation in ORAudit and feedback—collects standardized outcome measurements and reports individual and peer group results.Sitzman et al[20]
InvestigatorsImprove accuracy of self-assessment of laparoscopic operative skill using the OSATS scale2Surgeons (study investigators)Specialists in rater training and coaching techniquesIn personVideo recording of operation in ORCoachees assessed the same peer surgery video at baseline, midway, and completion of the interventionto provide a point of reference forimproving their use of the OSATS scale.Bull et al[17]
Nontechnical skillsInvestigatorsLeadership training to improve episodic team processes (transition, action, interpersonal) and team performance outcomes (surgical delays and distractions)1Surgeon (retired)Certified in Crew Resource Management trainingIn personObservation in ORCoded assessment of surgical delays and distractions, and interpersonal, transition, and action processesMaynard et al[18]
Technical and/or nontechnical skillsCoachee6 coachees identified nontechnical goals (teaching, leadership, communication), 3 identified technical goals (new procedure, improving efficiency), and 2 did not identify a specific focus8Surgeons (peer)4-hour training session, training manual, and instructional videosIn personVideo recording of operation in ORNoneGreenberg et al[16]
CoacheeCoachees could focus on any aspect of intraoperative performance, including technical skills, nontechnical skills (situational awareness, decision making, teamwork, leadership), or intraoperative teaching skills23Surgeons (peer)3-hour training session and weekly emails with coaching tipsIn personObservation in OROSATS and NOTTSPradarelli et al[19]
CoacheeNo details about individual coachee’s goals were provided.15Surgeons (peer)4-hour training and “refresher” on coaching principles before each sessionIn personVideo recording of operation in OROperative time and 30-day patient complicationsGreenberg et al[21]
Physiological factorsCoacheeImprove physiological factors to enhance surgeons’ performance and improve patient outcomesN/ANonsurgeonCertified professional coachBy videoconferenceNoneCharting system providing patient outcomes and profiling of individual surgeons as feedbackDuclos[22]
WellbeingCoacheeImprove wellbeing (Burnout, job satisfaction, professional fulfillment)N/ANonsurgeonCertified professional coachBy phoneN/AN/ADyrbye[23]

aThe goal the coachee was aiming to achieve over the course of the intervention. This goal was either defined by the study investigators or the coachees themselves.

OR, operating room; OSATS, objective structured assessment of technical skills; NOTTS, nontechnical skills for surgeons.

FIGURE 1.

Visualization of the coaching goals and settings of the interventions.

Description of Coaching Programs aThe goal the coachee was aiming to achieve over the course of the intervention. This goal was either defined by the study investigators or the coachees themselves. OR, operating room; OSATS, objective structured assessment of technical skills; NOTTS, nontechnical skills for surgeons. Visualization of the coaching goals and settings of the interventions.

Participating Surgeon Coachees and Coaches

A median of 20 surgeons were included as coachees (Supplemental Table 3, http://links.lww.com/AOSO/A133). Two studies included coachees from only one surgical specialty.[16,20] The six other studies included surgeons from multiple specialties (Table 3). Only one study recruited surgeons from a single center and included both attending surgeons and surgeons in training in the coachee group.[17]
TABLE 3.

Description of Study Designs, Coachees, and Study Setting

Study DesignCoachee Population
(GRADE Study Design)aMixed Methods?Multi- or MonospecialtyNo.Study Setting
Cross-sectionalNo control (Very low)YesMultispecialty11WI, USA
Quasi-ExperimentalBefore-After without contemporaneous control(Low)NoMultispecialty4bAustralia
YesMultispecialty23Boston, MA, USA
Before-After with contemporaneous control (Moderate)NoMultispecialty20Rocky Mountain Region of CO, USA
YesMonospecialty26MI, USA
YesMonospecialty2Across the U.S. and Canada
ExperimentalCluster-randomized trial(High)YesMultispecialty20Lyon, France
Crossover-randomized trial(High)NoMultispecialty80Mayoclinic, USAMulticenter

aGRADE - simplified version of the Grading of Recommendations Assessment, Development, and Evaluation system - cross-sectional studies with no control group were classified as “very low”, quasi-experimental designs with no controls were classified as “low”, quasi-experimental designs with contemporaneous controls were classified as “moderate”, and experimental studies were classified as “high”. These ratings categorize studies based on their design, and unlike the comprehensive GRADE scale, do not fully reflect the validity or reliability of the research.

bStudy included 12 total coachees, but only 4 were attending surgeons, while 3 were fellows and 5 were residents.

Description of Study Designs, Coachees, and Study Setting aGRADE - simplified version of the Grading of Recommendations Assessment, Development, and Evaluation system - cross-sectional studies with no control group were classified as “very low”, quasi-experimental designs with no controls were classified as “low”, quasi-experimental designs with contemporaneous controls were classified as “moderate”, and experimental studies were classified as “high”. These ratings categorize studies based on their design, and unlike the comprehensive GRADE scale, do not fully reflect the validity or reliability of the research. bStudy included 12 total coachees, but only 4 were attending surgeons, while 3 were fellows and 5 were residents. In all of the published studies the coaches were professional surgeons; however, the studies differed in the level of training the coaches received. In one of the two studies that focused on technical skills, the coaches were surgeons who had lower fistula incidences than the coachees, but had no specific training in coaching techniques.[20] In the other study, the coaches were study investigators, who were surgeons with considerable experience or training in coaching.[17] Maynard et al[18] implemented a team leader coaching intervention, which used a retired surgeon who was certified in Crew Resource Management training as a coach. In the three studies that let coachees identify their own technical or nontechnical goals, the coachees were assigned peer coaches. The formats of these interventions were based on the Wisconsin Surgical Coaching Program (WSCP).[24] Coaches attended a 3- to 4-hour training session in the beginning of the study, and received other training materials to help them maintain and deepen their understanding of coaching throughout the intervention. The coaches were selected based on a variety of factors. In Greenberg et al,[16] coaches were chosen based on peer nominations from members of the Wisconsin Surgical Society. In Smink et al[19] coaches were chosen by a local faculty surgeon at each academic medical center, based on their familiarity with the participants or the surgeons’ preferences. In Dimick et al[21] members of the Michigan Bariatric Surgery Collaborative with the lowest rates of surgical complications were asked to participate as coaches. The ongoing trials differ from the published studies in that the coaches have specific training in coaching but are not surgeons.[22,23]

Coaching Interactions and Observation of Surgery

In the studies that provided the relevant information, the frequency and length of coaching sessions varied across the studies and among coachees, with surgeons attending between 1 and 8 sessions that ranged from 21 to 96 minutes in length. Details about the different coaching interventions can be found in Supplemental Table 4, http://links.lww.com/AOSO/A133. Coaching sessions took place in person in all of the published studies, whereas the registered trials by Dyrbye[23] and Duclos et al[22] will use coaching by phone or videoconference. The coaching interactions were centered around the analysis of the coachees’ operations in all published studies. In four of these studies, video recordings of the coachee’s operations were discussed.[16,17,20,21] In the other two published studies coaches observed the coachees operate in real time, and the coaching session took place at a later time.[18,19] Conversely, the two registered trials do not include observations of coachees’ operations either in real time or by video recording (Table 2).[22,23]

Assessment Tools and Improvement Solutions

Only one published study provided assessment data in addition to coaching.[20] This study combined coaching with an “audit and feedback” system, which provided each coachee with feedback about their own and the whole groups’ surgical outcomes before the coachee met with the coach. Four other published studies used metrics or scoring systems to evaluate surgeons’ technical or nontechnical skills or intraoperative performance but did not provide the information to the coachees as feedback.[17-19,21] Duclos et al[22] will use a charting system and individualized profiles to provide feedback, as well as modules of improvement to help guide surgeons during the intervention.

Study Designs and Outcomes

Study designs with corresponding GRADE levels are presented in Table 4. One study was cross-sectional,[16] five were quasi-experimental studies with or without contemporaneous control groups,[17-21] and the two ongoing registered trials were cluster or crossover-randomized designs.[22,23] Four of the studies used mixed methods.
TABLE 4.

Study Outcomes and Findings

Quantitative OutcomesFindingsStudy ID
Kirkpatrick 1 (Reaction)Kirkpatrick 3 (Behavior)Kirkpatrick 4 (Results)
Surgeons’ Reactions About Being CoachedSurgeons’ Technical SkillsSurgeons’ Nontechnical SkillsSurgeons’ WellnessPatient OutcomesPositive Outcome(s) ?
Coachees used 5-point likert scales to evaluate the effectiveness of the coaches and to evaluate the program following the interventionYesGreenberg et al[16]
A likert type participant questionnaire was used to evaluate the surgeons’ opinions about the coaching intervention and coaching in general, after the programImprovement of self-assessment accuracy (using OSATS scale) compared to expert rating and correlation of self-assessment with expert ratings.YesBull et al[17]
Summary assessment of the coachee’s overall technical skill and ratings for each of five domains of technical skills using the OSATS framework.The Nontechnical Skills for Surgeons assessment tool was used to rate coachees performance on each of four domains of nontechnical skill: situation awareness, decision making, communication and teamwork.NoPradarelli et al[19]
Evaluated episodic team processes (interpersonal, transition, and action processes measured by SME) and subsequent team performance outcomes (delays and distractions)YesMaynard et al[18]
Operative time30-day overall complications and 30-day surgical complicationsOperative time: yes;Patient outcomes: NoGreenberg et al[21]
Ornonasal fistula incidenceNoSitzman et al[20]
Operative timeBurnout (MBI), Psycho-social risk (self-reported 26 item Karasek questionnaire)Occurrence of major adverse event, death, unplanned stay in intensive care unit, unplanned reoperation, and intraoperative and post-operative complicationsDuclos[22]
MBI, Job satisfaction (self-reported Physician Job Satisfaction Scale score) and professional fulfillment (change in Empowerment at Work Scale)Dyrbye[23]

We used an adapted Kirkpatrick model to categorize the studies’ outcomes. Outcomes related to surgeons’ reactions to the coaching intervention or coaching in general were classified as level 1. Outcomes measuring technical or nontechnical skills, knowledge, or attitudes in a simulated environment were considered level 2. Outcomes measuring technical or nontechnical skill or changes in behavior measured in the operating room or in real life were classified as level 3. Patient outcomes or surgeon-centered outcomes were classified as level 4.

OSATS, Objective Structured Assessment of Technical Skills; MBI, Maslach Burnout Inventory Scale; SME, subject matter expert.

Study Outcomes and Findings We used an adapted Kirkpatrick model to categorize the studies’ outcomes. Outcomes related to surgeons’ reactions to the coaching intervention or coaching in general were classified as level 1. Outcomes measuring technical or nontechnical skills, knowledge, or attitudes in a simulated environment were considered level 2. Outcomes measuring technical or nontechnical skill or changes in behavior measured in the operating room or in real life were classified as level 3. Patient outcomes or surgeon-centered outcomes were classified as level 4. OSATS, Objective Structured Assessment of Technical Skills; MBI, Maslach Burnout Inventory Scale; SME, subject matter expert. The following types of outcomes were identified: surgeons’ reactions about being coached, surgeons’ technical skills, surgeons’ nontechnical skills, surgeons’ wellness, and patient outcomes. Two studies addressed surgeon’s reactions about being coached, and were classified as Kirkpatrick level 1.[16,17] No studies measured knowledge or skill acquisition in relation to coaching sessions using questionnaires, surveys, a simulated environment, or any other learning evaluation strategy. Therefore, no results were considered Kirkpatrick level 2 (learning). Four studies reported results related to surgeons’ technical skills during real operations, including OSATS skill ratings and operative time, and were classified as Kirkpatrick level 3 (behavior).[17,19,21,22] Two studies reported outcomes related to nontechnical skills in the operating room and were also classified as Kirkpatrick level 3. One used the NOTTS scale, and the other coded team processes during surgery.[18,19] The two registered trials plan to report surgeon wellness results, including measures of burnout, job satisfaction, and professional fulfillment, which were categorized as Kirkpatrick level 4 (results).[22,23] Two published studies and one registered trial report patient outcomes, and were also classified as Kirkpatrick level 4.[20-22]

Main Findings

Results from published studies are summarized in Supplementary Table 5, http://links.lww.com/AOSO/A133 and Table 4. The two studies with Kirkpatrick level 1 analyses demonstrated that surgeons considered coaching to be effective, and reacted positively to the intervention.[16,17] Of the four studies with Kirkpatrick level 3 evaluations, two showed that coaching improved technical skills, one showed that coaching improved nontechnical skills,[17,18,21] but one found that coaching had no effect on technical/nontechnical skills.[19] The two studies with Kirkpatrick level 4 evaluations failed to show that coaching significantly improved patient outcomes.[20,21] To highlight research gaps, main findings were charted in Figure 2 according to studies’ coaching goals and measured outcomes.
FIGURE 2.

Research gaps diagram classifying studies by coaching goal, outcome, design GRADE, and findings. Study findings are represented by colors. Green represents positive findings, yellow mixed findings, and red negative findings. Dark gray represents outcomes of trials that have not been published yet. Light gray represents outcomes that were not evaluated by any of the studies included in the review. We used an adapted Kirkpatrick model to categorize the studies’ outcomes. Outcomes related to surgeons’ reactions to the coaching intervention or coaching in general were classified as Kirkpatrick level 1. Outcomes measuring technical or nontechnical skills, knowledge, or attitudes in a simulated environment were considered Kirkpatrick level 2. Outcomes measuring technical or nontechnical skill or changes in behavior measured in the operating room or in real life were classified as Kirkpatrick level 3. Patient outcomes or surgeon-centered outcomes were classified as Kirkpatrick level 4. We used an approach inspired by the GRADE system to to classify evidence levels based on intervention study designs. Randomized trials were considered “high,” quasi-experimental studies with contemporaneous controls were categorized as “moderate” and without controls as “low.”

Research gaps diagram classifying studies by coaching goal, outcome, design GRADE, and findings. Study findings are represented by colors. Green represents positive findings, yellow mixed findings, and red negative findings. Dark gray represents outcomes of trials that have not been published yet. Light gray represents outcomes that were not evaluated by any of the studies included in the review. We used an adapted Kirkpatrick model to categorize the studies’ outcomes. Outcomes related to surgeons’ reactions to the coaching intervention or coaching in general were classified as Kirkpatrick level 1. Outcomes measuring technical or nontechnical skills, knowledge, or attitudes in a simulated environment were considered Kirkpatrick level 2. Outcomes measuring technical or nontechnical skill or changes in behavior measured in the operating room or in real life were classified as Kirkpatrick level 3. Patient outcomes or surgeon-centered outcomes were classified as Kirkpatrick level 4. We used an approach inspired by the GRADE system to to classify evidence levels based on intervention study designs. Randomized trials were considered “high,” quasi-experimental studies with contemporaneous controls were categorized as “moderate” and without controls as “low.”

DISCUSSION

Coaching is an emerging field that has been gaining traction as a possible approach to improve the performance and overall wellbeing of professional surgeons. However, the results of this scoping review show that very few quantitative studies have actually addressed this subject. Furthermore, all of the published studies have focused on coaching to improve surgeons’ technical or nontechnical skills in the operating room. Overall, the level of evidence from these nonrandomized studies is suboptimal with limited samples of coachees. Although the studies reported that surgeons generally considered coaching to be beneficial, their findings also showed that coaching had contrasting effects on surgeons’ skills and demonstrated no significant impact on patient outcomes. In contrast, the coaching strategies of the two registered randomized trials that were identified diverge from the previously published studies by employing professional coaches to help surgeons achieve goals related to the surgeons’ wellbeing and physiological factors. The inconsistency in how coaching is defined in the literature represents a barrier that could prevent surgical coaching from being effectively studied or adopted on a large scale.[16,25] Indeed, our results demonstrated that the definitions used to describe surgical coaching varied between the studies. However, a comparison and synthesis of the different definitions revealed common themes, which we incorporated in the following working definition: surgical coaching is a nonhierarchical relationship between an individual coachee (surgeon) and a coach (trained or untrained surgeon, or nonsurgeon professional coach) that aims to refine the coachee’s skills (technical or nontechnical) and/or capacities (physical or mental) through individualized goal setting, objective feedback, and self-assessment, and ultimately empowers the surgeon to find strategies to achieve their personal objectives. This definition differentiates surgical coaching from mentoring, which is instructional and involves counseling and advising, generally by an expert.[25] The definition also aligns surgical coaching with goal-oriented coaching, which is nondirective, solution-focused, and performance-driven.[25] Coaching can be used to help an individual achieve personal and professional goals that can be related to both performance and overall wellbeing.[26] Nevertheless, one of the primary findings of this scoping review was that all of the published studies’ coaching goals centered around improving technical and/or nontechnical skills. Three of the studies’ overall goals were specified by the study investigators, and included decreasing fistula incidence after cleft palate surgery, improving self-assessment skills, and improving surgeons’ team leadership skills.[17,18,20] The three other studies followed the basic structure established by the WSCP framework, and allowed coachees to identify any coaching goal related to intraoperative performance. Interestingly, rather than focusing on technical and nontechnical skills, the goals of the ongoing registered trials are related to wellbeing, stress management, sleep, and physical activity.[22,23] This may reflect an expanding recognition of the important role physician wellness plays in health-care system performance.[27] Another common theme that emerged was that all of the coaches in the published studies were surgeons. However, there were differences in the coaches’ levels of expertise and training. Two of the studies used expert coaches, who were not only surgeons, but also had training and expertise in the skills they were coaching.[17,18] Both of these studies showed positive outcomes. The four other studies paired coachees with other surgeons who provided feedback as peer coaches, either following a training course to teach them core coaching principles[16,19,21] or not.[20] The three studies in which surgeons attended training sessions showed mixed results,[16,19,21] whereas the study that used untrained peer coaches did not show positive results.[20] Although the evidence remains much too limited to draw any definitive conclusions, these results underscore that formal training could potentiate the benefits of peer coaching. Peer coaching between two surgeons with similar skill levels adds the benefit of fostering trust, which can lead to mutually beneficial discussions.[21] Nevertheless, several disadvantages of peer coaching have also been recognized. For example, social and cultural influences may prevent peers from critically evaluating a colleague’s performance.[28] On the other hand, surgeon coaches may shift into a mentoring or teaching mindset, and offer advice or direction, which does not promote the coachees’ sense of autonomy.[29] Furthermore, both surgeons must find the time in their demanding schedules to attend peer coaching sessions, making time constraints a potentially limiting factor.[16] In contrast to the published studies, the two ongoing trials reported that they will use coaches who are not surgeons.[21,23] This choice appears to be in accordance with the studies’ goals, which are not related to surgical skills. This approach could potentially help surgeons fit coaching into their busy schedules. A previous study showed that professional coaching could decrease burnout and improve quality of life among physicians.[30] This study also highlighted that physicians may feel less concerned about confidentiality and more comfortable opening up to credentialed coaches than peer coaches, as they adhere to a professional code of ethics.[30] Therefore, this type of coaching may be particularly suited for addressing burnout in surgeons as well as other personal goals. Assessment and feedback data have been shown to be crucial to performance enhancement and CPD.[31] However, physicians’ judgments about their performance are unreliable.[31,32] Bull et al[17] addressed this issue through coaching surgeons’ self-assessment skills. Another possible solution is to provide surgeons with external assessment data to guide their self-assessments. Coaching can help surgeons engage with objective assessment data and plan and implement their responses. These activities have been shown to optimize physicians’ reactions to assessment data.[31] Although four studies used scales or performance metrics to assess coachees’ performance, none shared this assessment data with the coachees in addition to the coaching exchanges.[17-19,21] Furthermore, evaluating change strategies and measuring outcomes are core components of CPD for physicians.[31,33] Coaches observed coachees operations in five studies.[16-19,21] The coachee’s performance was subsequently discussed during the coaching session. This provided the opportunity for the coaches and coachees to evaluate change strategies employed by the surgeons during their operations. However, none of the published studies, and only one registered trial, provided coachees with external assessment data that tracked their performance or patient outcomes, providing objective feedback during the coaching program.[22] One common limitation of the published studies was a potential lack of generalizability either because the study had a small sample size, the study included coachees from only one surgical specialty, or the study was not multi-centric.[17,18,20,21] An additional possible limitation is that the success of a coaching intervention can depend on the efficacy of the coach, the motivation of the coachee, and the quality of the coaching relationship.[34,35] Future studies could address this by including metrics to assess coaching program implementation, and to confirm the coaches’ and coachees’ adhesion to the program, their motivation, and their feelings about the coaching relationship. Furthermore, none of the studies tested the effects of combining coaching with solutions to help coachees achieve their goals. Bundling coaching with replicable strategies, tools, or exercises, such as procedure-specific checklists, team training, simulation sessions, or wellness techniques, with proven benefits could improve the reproducibility, and possibly the efficacy, of coaching interventions.[36-41] Due to the very limited number of studies identified, the variability of the study designs and outcomes, and the lack of control groups in half of the published studies, it is difficult to come to any definitive conclusions about the efficacy of coaching for professional surgeons at this time. However, the evidence from studies included in this review does corroborate the findings of qualitative studies showing that professional surgeons consider peer coaching for intraoperative skills to be beneficial. Future studies are needed to determine whether surgeons consider other styles of coaching or coaching interventions with goals unrelated to technical or nontechnical proficiency to be valuable. Mixed-methods study designs, as used in four of the studies included in this review, could be particularly useful for exploring these research questions. The studies examining the impacts of coaching on surgeons’ technical and nontechnical skills reported conflicting results, and used suboptimal study designs.[17-19,21] In addition, the two studies that measured the effects of surgical coaching on patient outcomes did not report positive results.[20,21] Overall, additional adequately powered, multi-site, randomized trials are needed to determine whether coaching impacts professional surgeons’ performance and patient outcomes. Moreover, future studies could explore the impacts of combining different styles of coaching with assessment data for objective feedback and/or replicable solutions to help surgeons achieve their goals.

CONCLUSIONS

The small number of studies that quantitatively evaluated the effects of coaching for professional surgeons indicate that coaching is well accepted, but the effects of coaching on their technical and nontechnical skills have been inconsistent, and no studies conclusively demonstrate impacts on patient safety. The findings of this scoping review ultimately suggest a potential framework for subsequent studies on surgical coaching. Future coaching programs may consider the integration of objective metrics to provide feedback to individual surgeons as well as accurate program implementation assessment. Furthermore, evaluations of coaching programs should not only evaluate surgeons’ performance, but should also consider assessing patient outcomes and surgeons’ overall wellness, using appropriate randomized trial designs.
  34 in total

1.  Training and simulation for patient safety.

Authors:  Rajesh Aggarwal; Oliver T Mytton; Milliard Derbrew; David Hananel; Mark Heydenburg; Barry Issenberg; Catherine MacAulay; Mary Elizabeth Mancini; Takeshi Morimoto; Nathaniel Soper; Amitai Ziv; Richard Reznick
Journal:  Qual Saf Health Care       Date:  2010-08

2.  Stress management training for surgeons-a randomized, controlled, intervention study.

Authors:  Cordula M Wetzel; Akram George; George B Hanna; Thanos Athanasiou; Stephen A Black; Roger L Kneebone; Debra Nestel; Maria Woloshynowych
Journal:  Ann Surg       Date:  2011-03       Impact factor: 12.969

Review 3.  Physician wellness: a missing quality indicator.

Authors:  Jean E Wallace; Jane B Lemaire; William A Ghali
Journal:  Lancet       Date:  2009-11-14       Impact factor: 79.321

4.  Burnout and medical errors among American surgeons.

Authors:  Tait D Shanafelt; Charles M Balch; Gerald Bechamps; Tom Russell; Lotte Dyrbye; Daniel Satele; Paul Collicott; Paul J Novotny; Jeff Sloan; Julie Freischlag
Journal:  Ann Surg       Date:  2010-06       Impact factor: 12.969

5.  Prospective observational study to evaluate NOTSS (Non-Technical Skills for Surgeons) for assessing trainees' non-technical performance in the operating theatre.

Authors:  J Crossley; J Marriott; H Purdie; J D Beard
Journal:  Br J Surg       Date:  2011-04-08       Impact factor: 6.939

6.  Strategies for Building Peer Surgical Coaching Relationships.

Authors:  Heather L Beasley; Hala N Ghousseini; Douglas A Wiegmann; Nicole A Brys; Sudha R Pavuluri Quamme; Caprice C Greenberg
Journal:  JAMA Surg       Date:  2017-04-19       Impact factor: 14.766

Review 7.  Video-based coaching in surgical education: a systematic review and meta-analysis.

Authors:  Knut Magne Augestad; Khayam Butt; Dejan Ignjatovic; Deborah S Keller; Ravi Kiran
Journal:  Surg Endosc       Date:  2019-11-20       Impact factor: 4.584

8.  A Statewide Surgical Coaching Program Provides Opportunity for Continuous Professional Development.

Authors:  Caprice C Greenberg; Hala N Ghousseini; Sudha R Pavuluri Quamme; Heather L Beasley; Lane L Frasier; Nicole A Brys; Janet C Dombrowski; Douglas A Wiegmann
Journal:  Ann Surg       Date:  2018-05       Impact factor: 12.969

9.  Coaching in Surgical Education: A Systematic Review.

Authors:  Marisa Louridas; Ajit K Sachdeva; Andrew Yuen; Patrice Blair; Helen MacRae
Journal:  Ann Surg       Date:  2022-01-01       Impact factor: 12.969

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.