Neha Bansal1, Kristina D Simmons2, Andrew J Epstein3, Jon B Morris1, Rachel R Kelz4. 1. Perelman School of Medicine at the University of Pennsylvania, Philadelphia2Department of Surgery, Center for Surgery and Health Economics, University of Pennsylvania Health System, Philadelphia. 2. Department of Surgery, Center for Surgery and Health Economics, University of Pennsylvania Health System, Philadelphia. 3. Perelman School of Medicine at the University of Pennsylvania, Philadelphia3Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia4Department of Veterans Affairs' Center for Health Equity Research and Promotion, Philadelphia. 4. Perelman School of Medicine at the University of Pennsylvania, Philadelphia2Department of Surgery, Center for Surgery and Health Economics, University of Pennsylvania Health System, Philadelphia3Leonard Davis Institute of Health Economics, University of P.
Abstract
IMPORTANCE: To evaluate and financially reward general surgery residency programs based on performance, performance must first be defined and measureable. OBJECTIVE: To assess general surgery residency program performance using the objective clinical outcomes of patients operated on by program graduates. DESIGN, SETTING, AND PARTICIPANTS: A retrospective cohort study was conducted of discharge records from 349 New York and Florida hospitals between January 1, 2008, and December 31, 2011. The records comprised 230,769 patients undergoing 1 of 24 general surgical procedures performed by 454 surgeons from 73 general surgery residency programs. Analysis was conducted from June 4, 2014, to June 16, 2015. MAIN OUTCOMES AND MEASURES: In-hospital death; development of 1 or more postoperative complications before discharge; prolonged length of stay, defined as length of stay greater than the 75th percentile when compared with patients undergoing the same procedure type at the same hospital; and failure to rescue, defined as in-hospital death after the development of 1 or more postoperative complications. RESULTS: Patients operated on by surgeons trained in residency programs that were ranked in the top tertile were significantly less likely to experience an adverse event than were patients operated on by surgeons trained in residency programs that were ranked in the bottom tertile. Adjusted adverse event rates for patients operated on by surgeons trained in programs that were ranked in the top tertile and those who were operated on by surgeons trained in programs that were ranked in the bottom tertile were, respectively, 0.483% vs 0.476% for death, 9.68% vs 10.79% for complications, 16.76% vs 17.60% for prolonged length of stay, and 2.68% vs 2.98% for failure to rescue (all P < .001). The differences remained significant in procedure-specific subset analyses. The rankings were significantly correlated among some but not all outcome measures. The magnitude of the effect of the residency program on the outcomes achieved by the graduates decreased with increasing years of practice. Within the analyses of surgeons within 20, 10, and 5 years of practice, the relative difference in adjusted adverse event rates across the individual models between the top and bottom tertiles ranged from 1.5% to 12.3% (20 years), 9.1% to 33.8% (10 years), and 8.0% to 44.4% (5 years). CONCLUSIONS AND RELEVANCE: Objective data were successfully used to rank the clinical outcomes achieved by graduates of general surgery residency programs. Program rankings differed by the outcome measured. The magnitude of differences across programs was small. Careful consideration must be used when identifying potential targets for payment-for-performance initiatives in graduate medical education.
IMPORTANCE: To evaluate and financially reward general surgery residency programs based on performance, performance must first be defined and measureable. OBJECTIVE: To assess general surgery residency program performance using the objective clinical outcomes of patients operated on by program graduates. DESIGN, SETTING, AND PARTICIPANTS: A retrospective cohort study was conducted of discharge records from 349 New York and Florida hospitals between January 1, 2008, and December 31, 2011. The records comprised 230,769 patients undergoing 1 of 24 general surgical procedures performed by 454 surgeons from 73 general surgery residency programs. Analysis was conducted from June 4, 2014, to June 16, 2015. MAIN OUTCOMES AND MEASURES: In-hospital death; development of 1 or more postoperative complications before discharge; prolonged length of stay, defined as length of stay greater than the 75th percentile when compared with patients undergoing the same procedure type at the same hospital; and failure to rescue, defined as in-hospital death after the development of 1 or more postoperative complications. RESULTS:Patients operated on by surgeons trained in residency programs that were ranked in the top tertile were significantly less likely to experience an adverse event than were patients operated on by surgeons trained in residency programs that were ranked in the bottom tertile. Adjusted adverse event rates for patients operated on by surgeons trained in programs that were ranked in the top tertile and those who were operated on by surgeons trained in programs that were ranked in the bottom tertile were, respectively, 0.483% vs 0.476% for death, 9.68% vs 10.79% for complications, 16.76% vs 17.60% for prolonged length of stay, and 2.68% vs 2.98% for failure to rescue (all P < .001). The differences remained significant in procedure-specific subset analyses. The rankings were significantly correlated among some but not all outcome measures. The magnitude of the effect of the residency program on the outcomes achieved by the graduates decreased with increasing years of practice. Within the analyses of surgeons within 20, 10, and 5 years of practice, the relative difference in adjusted adverse event rates across the individual models between the top and bottom tertiles ranged from 1.5% to 12.3% (20 years), 9.1% to 33.8% (10 years), and 8.0% to 44.4% (5 years). CONCLUSIONS AND RELEVANCE: Objective data were successfully used to rank the clinical outcomes achieved by graduates of general surgery residency programs. Program rankings differed by the outcome measured. The magnitude of differences across programs was small. Careful consideration must be used when identifying potential targets for payment-for-performance initiatives in graduate medical education.
Authors: Morgan M Sellers; Luke J Keele; Catherine E Sharoky; Christopher Wirtalla; Elizabeth A Bailey; Rachel R Kelz Journal: JAMA Surg Date: 2018-05-01 Impact factor: 14.766
Authors: Benjamin D Smith; Xiudong Lei; Kevin Diao; Ying Xu; Yu Shen; Grace L Smith; Sharon H Giordano; Sarah M DeSnyder; Kelly K Hunt; Mediget Teshome; Reshma Jagsi; Simona F Shaitelman; Susan K Peterson; Cameron W Swanick Journal: Ann Surg Oncol Date: 2020-01-08 Impact factor: 5.344
Authors: Angela E Thelen; Daniel E Kendrick; Xilin Chen; John Luckoski; Tanvi Gupta; Hoda Bandeh-Ahmadi; Michael Clark; Brian C George Journal: Am J Surg Date: 2021-10-21 Impact factor: 2.565
Authors: Benjamin Kinnear; Matthew Kelleher; Dana Sall; Daniel P Schauer; Eric J Warm; Andrea Kachelmeyer; Abigail Martini; Daniel J Schumacher Journal: J Gen Intern Med Date: 2020-10-26 Impact factor: 5.128