Suliat M Nurudeen1, Gifty Kwakye2, William R Berry1, Elliot L Chaikof3, Keith D Lillemoe4, Frederick Millham5, Marc Rubin6, Steven Schwaitzberg7, Robert C Shamberger8, Michael J Zinner9, Luke Sato10, Stuart Lipsitz1, Atul A Gawande1, Alex B Haynes11. 1. Ariadne Labs, Boston, MA; Brigham and Women's Hospital, Boston, MA; Harvard School of Public Health, Boston, MA. 2. Ariadne Labs, Boston, MA; Brigham and Women's Hospital, Boston, MA. 3. Beth Israel Deaconess Medical Center, Boston, MA. 4. Massachusetts General Hospital, Boston, MA. 5. South Shore Hospital, South Weymouth, MA. 6. North Shore Medical Center, Salem, MA. 7. Cambridge Health Alliance, Cambridge, MA. 8. Boston Children's Hospital, Boston, MA. 9. Brigham and Women's Hospital, Boston, MA. 10. Risk Management Foundation of the Harvard Medical Institutions, Inc, Cambridge, MA. 11. Ariadne Labs, Boston, MA; Harvard School of Public Health, Boston, MA; Massachusetts General Hospital, Boston, MA. Electronic address: abhaynes@mgh.harvard.edu.
Abstract
BACKGROUND: Medical organizations have increased interest in identifying and improving behaviors that threaten team performance and patient safety. Three hundred and sixty degree evaluations of surgeons were performed at 8 academically affiliated hospitals with a common Code of Excellence. We evaluate participant perceptions and make recommendations for future use. STUDY DESIGN: Three hundred and eighty-five surgeons in a variety of specialties underwent 360-degree evaluations, with a median of 29 reviewers each (interquartile range 23 to 36). Beginning 6 months after evaluation, surgeons, department heads, and reviewers completed follow-up surveys evaluating accuracy of feedback, willingness to participate in repeat evaluations, and behavior change. RESULTS: Survey response rate was 31% for surgeons (118 of 385), 59% for department heads (10 of 17), and 36% for reviewers (1,042 of 2,928). Eighty-seven percent of surgeons (95% CI, 75%-94%) agreed that reviewers provided accurate feedback. Similarly, 80% of department heads believed the feedback accurately reflected performance of surgeons within their department. Sixty percent of surgeon respondents (95% CI, 49%-75%) reported making changes to their practice based on feedback received. Seventy percent of reviewers (95% CI, 69%-74%) believed the evaluation process was valuable, with 82% (95% CI, 79%-84%) willing to participate in future 360-degree reviews. Thirty-two percent of reviewers (95% CI, 29%-35%) reported perceiving behavior change in surgeons. CONCLUSIONS: Three hundred and sixty degree evaluations can provide a practical, systematic, and subjectively accurate assessment of surgeon performance without undue reviewer burden. The process was found to result in beneficial behavior change, according to surgeons and their coworkers.
BACKGROUND: Medical organizations have increased interest in identifying and improving behaviors that threaten team performance and patient safety. Three hundred and sixty degree evaluations of surgeons were performed at 8 academically affiliated hospitals with a common Code of Excellence. We evaluate participant perceptions and make recommendations for future use. STUDY DESIGN: Three hundred and eighty-five surgeons in a variety of specialties underwent 360-degree evaluations, with a median of 29 reviewers each (interquartile range 23 to 36). Beginning 6 months after evaluation, surgeons, department heads, and reviewers completed follow-up surveys evaluating accuracy of feedback, willingness to participate in repeat evaluations, and behavior change. RESULTS: Survey response rate was 31% for surgeons (118 of 385), 59% for department heads (10 of 17), and 36% for reviewers (1,042 of 2,928). Eighty-seven percent of surgeons (95% CI, 75%-94%) agreed that reviewers provided accurate feedback. Similarly, 80% of department heads believed the feedback accurately reflected performance of surgeons within their department. Sixty percent of surgeon respondents (95% CI, 49%-75%) reported making changes to their practice based on feedback received. Seventy percent of reviewers (95% CI, 69%-74%) believed the evaluation process was valuable, with 82% (95% CI, 79%-84%) willing to participate in future 360-degree reviews. Thirty-two percent of reviewers (95% CI, 29%-35%) reported perceiving behavior change in surgeons. CONCLUSIONS: Three hundred and sixty degree evaluations can provide a practical, systematic, and subjectively accurate assessment of surgeon performance without undue reviewer burden. The process was found to result in beneficial behavior change, according to surgeons and their coworkers.
Authors: Salman Y Guraya; Shaista S Guraya; Nehal Anam Mahabbat; Khulood Yahya Fallatah; Bashaer Ahmad Al-Ahmadi; Hadeel Hadi Alalawi Journal: J Clin Diagn Res Date: 2016-05-01
Authors: Joceline V Vu; Calista M Harbaugh; Ana C De Roo; Ben E Biesterveld; Paul G Gauger; Justin B Dimick; Gurjit Sandhu Journal: J Surg Educ Date: 2019-09-03 Impact factor: 2.891
Authors: Rebecca Baines; Sam Regan de Bere; Sebastian Stevens; Jamie Read; Martin Marshall; Mirza Lalani; Marie Bryce; Julian Archer Journal: BMC Med Educ Date: 2018-07-31 Impact factor: 2.463