Kyle G Cologne1, Deborah S Keller2, Loriel Liwanag3, Bikash Devaraj3, Anthony J Senagore4. 1. Division of Colorectal Surgery, Keck School of Medicine of the University of Southern California, Los Angeles, CA. Electronic address: kyle.cologne@med.usc.edu. 2. Colorectal Surgical Associates, Houston, TX. 3. Division of Colorectal Surgery, Keck School of Medicine of the University of Southern California, Los Angeles, CA. 4. Division of Colorectal Surgery, Case Medical Center, Cleveland, OH.
Abstract
BACKGROUND: The American College of Surgeons NSQIP risk calculator was developed from multi-institutional clinical data to estimate preoperative risk. The impact of outliers has the potential to greatly affect predictions. Although the effect of outliers is minimized in large series, their impact on the individual provider or institution could be profound. No previous study has assessed the risk calculator for a single institution or provider, including outliers. Our goal was to evaluate the accuracy of the predicted outcomes at a single institution. STUDY DESIGN: Laparoscopic colectomies performed by two colorectal surgeons at a tertiary referral center were prospectively evaluated using the risk calculator. Predicted outcomes were compared with actual outcomes for length of stay (LOS), complications, return to the operating room, and death. Main outcomes measures were differences in actual vs predicted outcomes. RESULTS: One hundred and sixteen patients were included. Actual LOS was higher than predicted (mean ± SD 4.22 ± 5.49 days vs predicted 4.11 ± 1.18 days; p = 0.0001). Four outliers with multiple complications had an LOS >3 SDs from the mean. After removing these, observed LOS was significantly shorter than predicted (adjusted LOS mean ± SD 3.31 ± 2.30 days vs predicted 4.05 ± 1.14 days; p = 0.002). Occurrence of any complication was significantly lower than predicted (17.3% vs 19.4%; p = 0.05). Rates of major complications (13.2% vs 19.4%; p = 0.009) and surgical site infections (9.8% vs 11.8%; p = 0.006) were also significantly lower than predicted. There were no significant differences in death, urinary tract infection, renal failure, and reoperation rates. CONCLUSIONS: Although the risk calculator was effective for evaluating average surgical-risk patients, it does not accurately predict outcomes in a small percentage of patients when one or more serious complications occur. Addition of surgeon- and patient-specific data via the American College of Surgeons case-logging system could better adjust for these areas.
BACKGROUND: The American College of Surgeons NSQIP risk calculator was developed from multi-institutional clinical data to estimate preoperative risk. The impact of outliers has the potential to greatly affect predictions. Although the effect of outliers is minimized in large series, their impact on the individual provider or institution could be profound. No previous study has assessed the risk calculator for a single institution or provider, including outliers. Our goal was to evaluate the accuracy of the predicted outcomes at a single institution. STUDY DESIGN: Laparoscopic colectomies performed by two colorectal surgeons at a tertiary referral center were prospectively evaluated using the risk calculator. Predicted outcomes were compared with actual outcomes for length of stay (LOS), complications, return to the operating room, and death. Main outcomes measures were differences in actual vs predicted outcomes. RESULTS: One hundred and sixteen patients were included. Actual LOS was higher than predicted (mean ± SD 4.22 ± 5.49 days vs predicted 4.11 ± 1.18 days; p = 0.0001). Four outliers with multiple complications had an LOS >3 SDs from the mean. After removing these, observed LOS was significantly shorter than predicted (adjusted LOS mean ± SD 3.31 ± 2.30 days vs predicted 4.05 ± 1.14 days; p = 0.002). Occurrence of any complication was significantly lower than predicted (17.3% vs 19.4%; p = 0.05). Rates of major complications (13.2% vs 19.4%; p = 0.009) and surgical site infections (9.8% vs 11.8%; p = 0.006) were also significantly lower than predicted. There were no significant differences in death, urinary tract infection, renal failure, and reoperation rates. CONCLUSIONS: Although the risk calculator was effective for evaluating average surgical-risk patients, it does not accurately predict outcomes in a small percentage of patients when one or more serious complications occur. Addition of surgeon- and patient-specific data via the American College of Surgeons case-logging system could better adjust for these areas.
Authors: Kota Sahara; Anghela Z Paredes; Katiuscha Merath; Diamantis I Tsilimigras; Fabio Bagante; Francesca Ratti; Hugo P Marques; Olivier Soubrane; Eliza W Beal; Vincent Lam; George A Poultsides; Irinel Popescu; Sorin Alexandrescu; Guillaume Martel; Workneh Aklile; Alfredo Guglielmi; Tom Hugh; Luca Aldrighetti; Itaru Endo; Timothy M Pawlik Journal: J Gastrointest Surg Date: 2019-04-01 Impact factor: 3.452
Authors: Justin T Brady; Bona Ko; Samuel F Hohmann; Benjamin P Crawshaw; Jennifer A Leinicke; Scott R Steele; Knut M Augestad; Conor P Delaney Journal: Surg Endosc Date: 2017-12-27 Impact factor: 4.584
Authors: Brian M Cusworth; Bradley A Krasnick; Timothy M Nywening; Cheryl A Woolsey; Ryan C Fields; Maria M Doyle; Jingxia Liu; William G Hawkins Journal: HPB (Oxford) Date: 2016-12-08 Impact factor: 3.647
Authors: Cristina Soguero-Ruiz; Wang M E Fei; Robert Jenssen; Knut Magne Augestad; José-Luis Rojo Álvarez; Inmaculada Mora Jiménez; Rolv-Ole Lindsetmo; Stein Olav Skrøvseth Journal: AMIA Annu Symp Proc Date: 2015-11-05
Authors: Federico M Ghirimoldi; Susanne Schmidt; Richard C Simon; Chen-Pin Wang; Zhu Wang; Bradley B Brimhall; Paul Damien; Eric E Moffett; Laura S Manuel; Zaheer U Sarwar; Paula K Shireman Journal: J Gastrointest Surg Date: 2020-09-08 Impact factor: 3.452
Authors: Neel Chudgar; Shi Yan; Meier Hsu; Kay See Tan; Katherine D Gray; Daniela Molena; David R Jones; Valerie W Rusch; Gaetano Rocco; James M Isbell Journal: J Thorac Cardiovasc Surg Date: 2021-01-21 Impact factor: 5.209