Jacqueline M Soegaard Ballester1, Kristin E Goodsell2, Jae P Ermer1, Giorgos C Karakousis1,2, John T Miura1,2, Nicole M Saur1,2, Najjia N Mahmoud1,2, Ari Brooks1,2, Julia C Tchou1,2, Peter E Gabriel2,3,4, Lawrence N Shulman2,4, Heather Wachtel5,6. 1. Department of Surgery, University of Pennsylvania, Philadelphia, PA, 19104, USA. 2. University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA. 3. Department of Radiation Oncology, University of Pennsylvania, Philadelphia, PA, USA. 4. Abramson Cancer Center, University of Pennsylvania, Philadelphia, PA, USA. 5. Department of Surgery, University of Pennsylvania, Philadelphia, PA, 19104, USA. heather.wachtel@pennmedicine.upenn.edu. 6. University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA. heather.wachtel@pennmedicine.upenn.edu.
Abstract
BACKGROUND: The American College of Surgeons Commission on Cancer's (CoC) new operative standards for breast cancer, melanoma, and colon cancer surgeries will require that surgeons provide synoptic documentation of essential oncologic elements within operative reports. Prior to designing and implementing an electronic tool to support synoptic reporting, we evaluated current documentation practices at our institution to understand baseline concordance with these standards. METHODS: Applicable procedures performed between 1 January 2018 and 31 December 2018 were included. Two independent reviewers evaluated sequential operative notes, up to a total of 100 notes, for documentation of required elements. Complete concordance (CC) was defined as explicit documentation of all required CoC elements. Mean percentage CC and surgeon-specific CC were calculated for each procedure. Interrater reliability was assessed via Cohen's kappa statistic. RESULTS: For sentinel lymph node biopsy, mean CC was 66% (n = 100), with surgeon-specific CC ranging from 6 to 100%, and for axillary dissection, mean CC was 12% (n = 89) and surgeon-specific CC ranged from 0 to 47%. The single surgeon performing melanoma wide local excision had a mean CC of 98% (n = 100). For colon resections, mean CC was 69% (n = 96) and surgeon-specific CC ranged from 39 to 94%. Kappa scores were 0.77, 0.78, -0.15, and 0.78, respectively. CONCLUSIONS: We identified heterogeneity in current documentation practices. In our cohort, rates of baseline concordance varied across surgeons and procedures. Currently, documentation elements are interspersed within the operative report, posing challenges to chart abstraction with resulting imperfect interrater reliability. This presents an exciting opportunity to innovate and improve compliance by introducing an electronic synoptic documentation tool.
BACKGROUND: The American College of Surgeons Commission on Cancer's (CoC) new operative standards for breast cancer, melanoma, and colon cancer surgeries will require that surgeons provide synoptic documentation of essential oncologic elements within operative reports. Prior to designing and implementing an electronic tool to support synoptic reporting, we evaluated current documentation practices at our institution to understand baseline concordance with these standards. METHODS: Applicable procedures performed between 1 January 2018 and 31 December 2018 were included. Two independent reviewers evaluated sequential operative notes, up to a total of 100 notes, for documentation of required elements. Complete concordance (CC) was defined as explicit documentation of all required CoC elements. Mean percentage CC and surgeon-specific CC were calculated for each procedure. Interrater reliability was assessed via Cohen's kappa statistic. RESULTS: For sentinel lymph node biopsy, mean CC was 66% (n = 100), with surgeon-specific CC ranging from 6 to 100%, and for axillary dissection, mean CC was 12% (n = 89) and surgeon-specific CC ranged from 0 to 47%. The single surgeon performing melanoma wide local excision had a mean CC of 98% (n = 100). For colon resections, mean CC was 69% (n = 96) and surgeon-specific CC ranged from 39 to 94%. Kappa scores were 0.77, 0.78, -0.15, and 0.78, respectively. CONCLUSIONS: We identified heterogeneity in current documentation practices. In our cohort, rates of baseline concordance varied across surgeons and procedures. Currently, documentation elements are interspersed within the operative report, posing challenges to chart abstraction with resulting imperfect interrater reliability. This presents an exciting opportunity to innovate and improve compliance by introducing an electronic synoptic documentation tool.
Authors: Jason Park; Venu G Pillarisetty; Murray F Brennan; William R Jarnagin; Michael I D'Angelica; Ronald P Dematteo; Daniel G Coit; Maria Janakos; Peter J Allen Journal: J Am Coll Surg Date: 2010-07-14 Impact factor: 6.113
Authors: Shannon Stogryn; Krista M Hardy; Ahmed M Abou-Setta; Kathleen M Clouston; Jennifer Metcalfe; Ashley S Vergis Journal: Am J Surg Date: 2019-05-14 Impact factor: 2.565
Authors: Lawrence N Shulman; Amanda E Browner; Bryan E Palis; Katherine Mallin; Sumedh Kakade; Ned Carp; Ryan McCabe; David Winchester; Sandra L Wong; Daniel P McKellar Journal: Ann Surg Oncol Date: 2019-03-29 Impact factor: 5.344
Authors: Reagan L Maniar; David J Hochman; Debrah A Wirtzfeld; Andrew M McKay; Clifford S Yaffe; Benson Yip; Richard Silverman; Jason Park Journal: Ann Surg Oncol Date: 2014-05-05 Impact factor: 5.344
Authors: Arielle E Kanters; Joceline V Vu; Ari D Schuman; Inga Van Wieren; Ashley Duby; Karin M Hardiman; Samantha K Hendren Journal: Am J Surg Date: 2019-09-28 Impact factor: 2.565
Authors: Caro E Sluijter; Luc R C W van Lonkhuijzen; Henk-Jan van Slooten; Iris D Nagtegaal; Lucy I H Overbeek Journal: Virchows Arch Date: 2016-04-21 Impact factor: 4.064
Authors: Niall O'Connor; Michael Sugrue; Conor Melly; Gearoid McGeehan; Magda Bucholc; Aileen Crawford; Paul O'Connor; Fikri Abu-Zidan; Imtiaz Wani; Zsolt J Balogh; Vishal G Shelat; Giovanni D Tebala; Belinda De Simone; Hani O Eid; Mircea Chirica; Gustavo P Fraga; Salomone Di Saverio; Edoardo Picetti; Luigi Bonavina; Marco Ceresoli; Andreas Fette; Boris Sakakushe; Emmanouil Pikoulis; Raul Coimbra; Richard Ten Broek; Andreas Hecker; Ari Leppäniemi; Andrey Litvin; Philip Stahel; Edward Tan; Kaoru Koike; Fausto Catena; Michele Pisano; Federico Coccolini; Alison Johnston Journal: World J Emerg Surg Date: 2022-03-17 Impact factor: 5.469