Jonah J Stulberg1,2, Reiping Huang1,2, Lindsey Kreutzer1,2, Kristen Ban1,3, Bradley J Champagne4, Scott R Steele5, Julie K Johnson1,2, Jane L Holl6, Caprice C Greenberg7, Karl Y Bilimoria1,2,3. 1. Surgical Outcomes and Quality Improvement Center, Feinberg School of Medicine, Department of Surgery, Northwestern University, Chicago, Illinois. 2. Center for Health Services and Outcomes Research, Feinberg School of Medicine, Northwestern University, Chicago, Illinois. 3. American College of Surgeons, Chicago, Illinois. 4. Department of Colorectal Surgery, Cleveland Clinic, Fairview, Ohio. 5. Department of Colorectal Surgery, Cleveland Clinic, Cleveland, Ohio. 6. Biological Sciences Division, The University of Chicago, Chicago, Illinois. 7. Department of Surgery, University of Wisconsin School of Medicine and Public Health, Madison.
Abstract
Importance: Postoperative complications remain common after surgery, but little is known about the extent of variation in operative technical skill and whether variation is associated with patient outcomes. Objectives: To examine the (1) variation in technical skill scores of practicing surgeons, (2) association between technical skills and patient outcomes, and (3) amount of variation in patient outcomes explained by a surgeon's technical skill. Design, Setting, and Participants: In this quality improvement study, 17 practicing surgeons submitted a video of a laparoscopic right hemicolectomy that was then rated by at least 10 blinded peer surgeons and 2 expert raters. The association between surgeon technical skill scores and risk-adjusted outcomes was examined using data from the American College of Surgeons National Surgical Quality Improvement Program. The association between technical skill scores and outcomes was examined for colorectal procedures and noncolorectal procedures (ie, assessed on whether technical skills demonstrated during colectomy were associated with patient outcomes across other cases). In addition, the proportion of patient outcomes explained by technical skill scores was examined using robust regression techniques. The study was conducted from September 23, 2016, to February 10, 2018; data analysis was performed from November 2018 to January 2019. Exposures: Colorectal and noncolorectal procedures. Main Outcomes and Measures: Any complication, mortality, unplanned hospital readmission, unplanned reoperation related to principal procedure, surgical site infection, and death or serious morbidity. Results: Of the 17 surgeons included in the study, 13 were men (76%). The participants had a range from 1 to 28 years in surgical practice (median, 11 years). Based on 10 or more reviewers per video and with a maximum quality score of 5, overall technical skill scores ranged from 2.8 to 4.6. From 2014 to 2016, study participants performed a total of 3063 procedures (1120 colectomies). Higher technical skill scores were significantly associated with lower rates of any complication (15.5% vs 20.6%, P = .03; Spearman rank-order correlation coefficient r = -0.54, P = .03), unplanned reoperation (4.7% vs 7.2%, P = .02; r = -0.60, P = .01), and a composite measure of death or serious morbidity (15.9% vs 21.4%, P = .02; r = -0.60, P = .01) following colectomy. Similar associations were found between colectomy technical skill scores and patient outcomes for all types of procedures performed by a surgeon. Overall, technical skill scores appeared to account for 25.8% of the variation in postcolectomy complication rates and 27.5% of the variation when including noncolectomy complication rates. Conclusions and Relevance: The findings of this study suggest that there is wide variation in technical skill among practicing surgeons, accounting for more than 25% of the variation in patient outcomes. Higher colectomy technical skill scores appear to be associated with lower complication rates for colectomy and for all other procedures performed by a surgeon. Efforts to improve surgeon technical skills may result in better patient outcomes.
Importance: Postoperative complications remain common after surgery, but little is known about the extent of variation in operative technical skill and whether variation is associated with patient outcomes. Objectives: To examine the (1) variation in technical skill scores of practicing surgeons, (2) association between technical skills and patient outcomes, and (3) amount of variation in patient outcomes explained by a surgeon's technical skill. Design, Setting, and Participants: In this quality improvement study, 17 practicing surgeons submitted a video of a laparoscopic right hemicolectomy that was then rated by at least 10 blinded peer surgeons and 2 expert raters. The association between surgeon technical skill scores and risk-adjusted outcomes was examined using data from the American College of Surgeons National Surgical Quality Improvement Program. The association between technical skill scores and outcomes was examined for colorectal procedures and noncolorectal procedures (ie, assessed on whether technical skills demonstrated during colectomy were associated with patient outcomes across other cases). In addition, the proportion of patient outcomes explained by technical skill scores was examined using robust regression techniques. The study was conducted from September 23, 2016, to February 10, 2018; data analysis was performed from November 2018 to January 2019. Exposures: Colorectal and noncolorectal procedures. Main Outcomes and Measures: Any complication, mortality, unplanned hospital readmission, unplanned reoperation related to principal procedure, surgical site infection, and death or serious morbidity. Results: Of the 17 surgeons included in the study, 13 were men (76%). The participants had a range from 1 to 28 years in surgical practice (median, 11 years). Based on 10 or more reviewers per video and with a maximum quality score of 5, overall technical skill scores ranged from 2.8 to 4.6. From 2014 to 2016, study participants performed a total of 3063 procedures (1120 colectomies). Higher technical skill scores were significantly associated with lower rates of any complication (15.5% vs 20.6%, P = .03; Spearman rank-order correlation coefficient r = -0.54, P = .03), unplanned reoperation (4.7% vs 7.2%, P = .02; r = -0.60, P = .01), and a composite measure of death or serious morbidity (15.9% vs 21.4%, P = .02; r = -0.60, P = .01) following colectomy. Similar associations were found between colectomy technical skill scores and patient outcomes for all types of procedures performed by a surgeon. Overall, technical skill scores appeared to account for 25.8% of the variation in postcolectomy complication rates and 27.5% of the variation when including noncolectomy complication rates. Conclusions and Relevance: The findings of this study suggest that there is wide variation in technical skill among practicing surgeons, accounting for more than 25% of the variation in patient outcomes. Higher colectomy technical skill scores appear to be associated with lower complication rates for colectomy and for all other procedures performed by a surgeon. Efforts to improve surgeon technical skills may result in better patient outcomes.
Authors: Tyler J Loftus; Alexander P J Vlaar; Andrew J Hung; Azra Bihorac; Bradley M Dennis; Catherine Juillard; Daniel A Hashimoto; Haytham M A Kaafarani; Patrick J Tighe; Paul C Kuo; Shuhei Miyashita; Steven D Wexner; Kevin E Behrns Journal: Surgery Date: 2021-11-21 Impact factor: 4.348
Authors: Recai Yilmaz; Alexander Winkler-Schwartz; Nykan Mirchi; Aiden Reich; Sommer Christie; Dan Huy Tran; Nicole Ledwos; Ali M Fazlollahi; Carlo Santaguida; Abdulrahman J Sabbagh; Khalid Bajunaid; Rolando Del Maestro Journal: NPJ Digit Med Date: 2022-04-26
Authors: Colin F Mackenzie; Shiming Yang; Evan Garofalo; Peter Fu-Ming Hu; Darcy Watts; Rajan Patel; Adam Puche; George Hagegeorge; Valerie Shalin; Kristy Pugh; Guinevere Granite; Lynn G Stansbury; Stacy Shackelford; Samuel Tisherman Journal: World J Surg Date: 2021-01-03 Impact factor: 3.352
Authors: Florian Aspart; Jon L Bolmgren; Joël L Lavanchy; Guido Beldi; Michael S Woods; Nicolas Padoy; Enes Hosgor Journal: Int J Comput Assist Radiol Surg Date: 2021-07-23 Impact factor: 2.924