Dominic E Sanford1, Cheryl A Woolsey1, Bruce L Hall2, David C Linehan1, William G Hawkins1, Ryan C Fields1, Steven M Strasberg3. 1. Section of Hepato-Pancreato-Biliary Surgery, Washington University in St Louis, and Barnes-Jewish Hospital, St Louis, MO. 2. Washington University in St Louis Department of Surgery, Olin Business School, and Center for Health Policy; St Louis VA Medical Center; BJC Healthcare Saint Louis, St Louis, MO. 3. Section of Hepato-Pancreato-Biliary Surgery, Washington University in St Louis, and Barnes-Jewish Hospital, St Louis, MO. Electronic address: strasbergs@wustl.edu.
Abstract
BACKGROUND: NSQIP and the Accordion Severity Grading System have recently been used to develop quantitative methods for measuring the burden of postoperative complications. However, other audit methods such as chart reviews and prospective institutional databases are commonly used to gather postoperative complications. The purpose of this study was to evaluate discordance between different audit methods in pancreatoduodenectomy--a common major surgical procedure. The chief aim was to determine how these different methods could affect quantitative evaluations of postoperative complications. STUDY DESIGN: Three common audit methods were compared with NSQIP in 84 patients who underwent pancreatoduodenectomy. The methods were use of a prospective database, a chart review based on discharge summaries only, and a detailed retrospective chart review. The methods were evaluated for discordance with NSQIP and among themselves. Severity grading was performed using the Modified Accordion System. RESULTS: Fifty-three complications were listed by NSQIP and 31 complications were identified that were not listed by NSQIP. There was poor agreement for NSQIP-type complications between NSQIP and the other audit methods for mild and moderate complications (kappa 0.381 to 0.744), but excellent agreement for severe complications (kappa 0.953 to 1.00). Discordance was usually due to variations in definition of the complications in non-NSQIP methods. There was good agreement among non-NSQIP methods for non-NSQIP complications for moderate and severe complications, but not for mild complications. CONCLUSIONS: There are important differences in perceived surgical outcomes based on the method of complication retrieval. The non-NSQIP methods used in this study could not be substituted for NSQIP in a quantitative analysis unless that analysis was limited to severe complications.
BACKGROUND: NSQIP and the Accordion Severity Grading System have recently been used to develop quantitative methods for measuring the burden of postoperative complications. However, other audit methods such as chart reviews and prospective institutional databases are commonly used to gather postoperative complications. The purpose of this study was to evaluate discordance between different audit methods in pancreatoduodenectomy--a common major surgical procedure. The chief aim was to determine how these different methods could affect quantitative evaluations of postoperative complications. STUDY DESIGN: Three common audit methods were compared with NSQIP in 84 patients who underwent pancreatoduodenectomy. The methods were use of a prospective database, a chart review based on discharge summaries only, and a detailed retrospective chart review. The methods were evaluated for discordance with NSQIP and among themselves. Severity grading was performed using the Modified Accordion System. RESULTS: Fifty-three complications were listed by NSQIP and 31 complications were identified that were not listed by NSQIP. There was poor agreement for NSQIP-type complications between NSQIP and the other audit methods for mild and moderate complications (kappa 0.381 to 0.744), but excellent agreement for severe complications (kappa 0.953 to 1.00). Discordance was usually due to variations in definition of the complications in non-NSQIP methods. There was good agreement among non-NSQIP methods for non-NSQIP complications for moderate and severe complications, but not for mild complications. CONCLUSIONS: There are important differences in perceived surgical outcomes based on the method of complication retrieval. The non-NSQIP methods used in this study could not be substituted for NSQIP in a quantitative analysis unless that analysis was limited to severe complications.
Authors: Mira Shiloach; Stanley K Frencher; Janet E Steeger; Katherine S Rowell; Kristine Bartzokis; Majed G Tomeh; Karen E Richards; Clifford Y Ko; Bruce L Hall Journal: J Am Coll Surg Date: 2009-11-22 Impact factor: 6.113
Authors: Shukri F Khuri; William G Henderson; Jennifer Daley; Olga Jonasson; R Scott Jones; Darrell A Campbell; Aaron S Fink; Robert M Mentzer; Leigh Neumayer; Karl Hammermeister; Cecilia Mosca; Nancy Healey Journal: Ann Surg Date: 2008-08 Impact factor: 12.969
Authors: Dominic E Sanford; Margaret A Olsen; Kerry M Bommarito; Manish Shah; Ryan C Fields; William G Hawkins; David P Jaques; David C Linehan Journal: J Am Coll Surg Date: 2014-07-18 Impact factor: 6.113
Authors: C Alston James; Gregory A Williams; Linda X Jin; Jingxia Liu; Dominic E Sanford; Ryan C Fields; Majella M B Doyle; Steven M Strasberg; William G Hawkins; Chet W Hammill Journal: Mo Med Date: 2020 Nov-Dec
Authors: Heidy Cos; Michael T LeCompte; Sanket Srinivasa; Jorge Zarate Rodriguez; Cheryl A Woolsey; Gregory Williams; Siddarth Patel; Adeel Khan; Ryan C Fields; Maria B Majella Doyle; William C Chapman; Steven M Strasberg; William G Hawkins; Chet W Hammill; Dominic E Sanford Journal: Surg Endosc Date: 2021-07-07 Impact factor: 3.453
Authors: Rony Takchi; Heidy Cos; Gregory A Williams; Cheryl Woolsey; Chet W Hammill; Ryan C Fields; Steven M Strasberg; William G Hawkins; Dominic E Sanford Journal: HPB (Oxford) Date: 2021-06-16 Impact factor: 3.842