Karl Y Bilimoria1, Yaoming Liu, Jennifer L Paruch, Lynn Zhou, Thomas E Kmiecik, Clifford Y Ko, Mark E Cohen. 1. Division of Research and Optimal Patient Care, American College of Surgeons, Chicago, IL; Surgical Outcomes and Quality Improvement Center, Department of Surgery, Feinberg School of Medicine, Northwestern University, Chicago, IL. Electronic address: kbilimoria@facs.org.
Abstract
BACKGROUND: Accurately estimating surgical risks is critical for shared decision making and informed consent. The Centers for Medicare and Medicaid Services may soon put forth a measure requiring surgeons to provide patients with patient-specific, empirically derived estimates of postoperative complications. Our objectives were to develop a universal surgical risk estimation tool, to compare performance of the universal vs previous procedure-specific surgical risk calculators, and to allow surgeons to empirically adjust the estimates of risk. STUDY DESIGN: Using standardized clinical data from 393 ACS NSQIP hospitals, a web-based tool was developed to allow surgeons to easily enter 21 preoperative factors (demographics, comorbidities, procedure). Regression models were developed to predict 8 outcomes based on the preoperative risk factors. The universal model was compared with procedure-specific models. To incorporate surgeon input, a subjective surgeon adjustment score, allowing risk estimates to vary within the estimate's confidence interval, was introduced and tested with 80 surgeons using 10 case scenarios. RESULTS: Based on 1,414,006 patients encompassing 1,557 unique CPT codes, a universal surgical risk calculator model was developed that had excellent performance for mortality (c-statistic = 0.944; Brier score = 0.011 [where scores approaching 0 are better]), morbidity (c-statistic = 0.816, Brier score = 0.069), and 6 additional complications (c-statistics > 0.8). Predictions were similarly robust for the universal calculator vs procedure-specific calculators (eg, colorectal). Surgeons demonstrated considerable agreement on the case scenario scoring (80% to 100% agreement), suggesting reliable score assignment between surgeons. CONCLUSIONS: The ACS NSQIP surgical risk calculator is a decision-support tool based on reliable multi-institutional clinical data, which can be used to estimate the risks of most operations. The ACS NSQIP surgical risk calculator will allow clinicians and patients to make decisions using empirically derived, patient-specific postoperative risks.
BACKGROUND: Accurately estimating surgical risks is critical for shared decision making and informed consent. The Centers for Medicare and Medicaid Services may soon put forth a measure requiring surgeons to provide patients with patient-specific, empirically derived estimates of postoperative complications. Our objectives were to develop a universal surgical risk estimation tool, to compare performance of the universal vs previous procedure-specific surgical risk calculators, and to allow surgeons to empirically adjust the estimates of risk. STUDY DESIGN: Using standardized clinical data from 393 ACS NSQIP hospitals, a web-based tool was developed to allow surgeons to easily enter 21 preoperative factors (demographics, comorbidities, procedure). Regression models were developed to predict 8 outcomes based on the preoperative risk factors. The universal model was compared with procedure-specific models. To incorporate surgeon input, a subjective surgeon adjustment score, allowing risk estimates to vary within the estimate's confidence interval, was introduced and tested with 80 surgeons using 10 case scenarios. RESULTS: Based on 1,414,006 patients encompassing 1,557 unique CPT codes, a universal surgical risk calculator model was developed that had excellent performance for mortality (c-statistic = 0.944; Brier score = 0.011 [where scores approaching 0 are better]), morbidity (c-statistic = 0.816, Brier score = 0.069), and 6 additional complications (c-statistics > 0.8). Predictions were similarly robust for the universal calculator vs procedure-specific calculators (eg, colorectal). Surgeons demonstrated considerable agreement on the case scenario scoring (80% to 100% agreement), suggesting reliable score assignment between surgeons. CONCLUSIONS: The ACS NSQIP surgical risk calculator is a decision-support tool based on reliable multi-institutional clinical data, which can be used to estimate the risks of most operations. The ACS NSQIP surgical risk calculator will allow clinicians and patients to make decisions using empirically derived, patient-specific postoperative risks.
Authors: Bruce L Hall; Barton H Hamilton; Karen Richards; Karl Y Bilimoria; Mark E Cohen; Clifford Y Ko Journal: Ann Surg Date: 2009-09 Impact factor: 12.969
Authors: Mira Shiloach; Stanley K Frencher; Janet E Steeger; Katherine S Rowell; Kristine Bartzokis; Majed G Tomeh; Karen E Richards; Clifford Y Ko; Bruce L Hall Journal: J Am Coll Surg Date: 2009-11-22 Impact factor: 6.113
Authors: Mark E Cohen; Clifford Y Ko; Karl Y Bilimoria; Lynn Zhou; Kristopher Huffman; Xue Wang; Yaoming Liu; Kari Kraemer; Xiangju Meng; Ryan Merkow; Warren Chow; Brian Matel; Karen Richards; Amy J Hart; Justin B Dimick; Bruce L Hall Journal: J Am Coll Surg Date: 2013-04-28 Impact factor: 6.113
Authors: Ewout W Steyerberg; Andrew J Vickers; Nancy R Cook; Thomas Gerds; Mithat Gonen; Nancy Obuchowski; Michael J Pencina; Michael W Kattan Journal: Epidemiology Date: 2010-01 Impact factor: 4.822
Authors: John C Woodfield; Ross A Pettigrew; Lindsay D Plank; Michael Landmann; Andre M van Rij Journal: World J Surg Date: 2007-10 Impact factor: 3.282
Authors: Susan D Wherley; Graham C Chapman; Sangeeta T Mahajan; Adonis K Hijaz; Emily A Slopnick; Kasey Roberts; Sherif El-Nashar Journal: Int Urogynecol J Date: 2020-06-16 Impact factor: 2.894
Authors: Alex Hs Harris; Alfred C Kuo; Thomas Bowe; Shalini Gupta; David Nordin; Nicholas J Giori Journal: J Arthroplasty Date: 2017-12-13 Impact factor: 4.757