Arjun S Sebastian1, Stephanie F Polites2, Amy E Glasgow3, Elizabeth B Habermann3, Robert R Cima2, Sanjeev Kakar4. 1. Department of Orthopedic Surgery, Mayo Clinic, Rochester, MN. 2. Department of General Surgery, Mayo Clinic, Rochester, MN. 3. Department of Health Care Policy and Research, Mayo Clinic, Rochester, MN. 4. Department of Orthopedic Surgery, Mayo Clinic, Rochester, MN. Electronic address: kakar.sanjeev@mayo.edu.
Abstract
PURPOSE: The American College of Surgeons National Surgical Quality Improvement Project (ACS-NSQIP) is a clinically-derived, validated tool to track outcomes in surgery. The Agency for Healthcare Research and Quality Patient Safety Indicators (AHRQ-PSI) are a set of computer algorithms run on administrative data to identify adverse events. The purpose of this study is to compare complications following orthopedic surgery identified by ACS-NSQIP and AHRQ-PSI. METHODS: Patients between 2010 and 2012 who underwent orthopedic procedures (arthroplasty, spine, trauma, foot and ankle, hand, and upper extremity) at our tertiary-care, academic institution were identified (n = 3,374). Identification of inpatient adverse events by AHRQ-PSI in the cohort was compared with 30-day events identified by ACS-NSQIP. Adverse events common to both AHRQ-PSI and ACS-NSQIP were infection, sepsis, venous thromboembolism, bleeding, respiratory failure, wound disruption, and renal failure. Concordance between AHRQ-PSI and ACS-NSQIP for identifying adverse events was examined. RESULTS: A total of 729 adverse events (21.6%) were identified in the cohort using ACS-NSQIP methodology and 35 adverse events (1.0%) were found using AHRQ-PSI. Only 12 events were identified by both methodologies. The most common complication was bleeding in ACS-NSQIP (18.1%) and respiratory failure in AHRQ-PSI (0.53%). The overlap was highest for venous thromboembolic events. There was no overlap in adverse events for 5 of the 7 categories of adverse events. CONCLUSIONS: A large discrepancy was observed between adverse events reported in ACS-NSQIP and AHRQ-PSI. A large percentage of clinically important adverse events identified in ACS-NSQIP were missed in AHRQ-PSI algorithms. The ability of AHRQ-PSI for detecting adverse events varied widely with ACS-NSQIP. CLINICAL RELEVANCE: AHRQ-PSI algorithms currently are insufficient to assess the quality of orthopedic surgery.
PURPOSE: The American College of Surgeons National Surgical Quality Improvement Project (ACS-NSQIP) is a clinically-derived, validated tool to track outcomes in surgery. The Agency for Healthcare Research and Quality Patient Safety Indicators (AHRQ-PSI) are a set of computer algorithms run on administrative data to identify adverse events. The purpose of this study is to compare complications following orthopedic surgery identified by ACS-NSQIP and AHRQ-PSI. METHODS:Patients between 2010 and 2012 who underwent orthopedic procedures (arthroplasty, spine, trauma, foot and ankle, hand, and upper extremity) at our tertiary-care, academic institution were identified (n = 3,374). Identification of inpatient adverse events by AHRQ-PSI in the cohort was compared with 30-day events identified by ACS-NSQIP. Adverse events common to both AHRQ-PSI and ACS-NSQIP were infection, sepsis, venous thromboembolism, bleeding, respiratory failure, wound disruption, and renal failure. Concordance between AHRQ-PSI and ACS-NSQIP for identifying adverse events was examined. RESULTS: A total of 729 adverse events (21.6%) were identified in the cohort using ACS-NSQIP methodology and 35 adverse events (1.0%) were found using AHRQ-PSI. Only 12 events were identified by both methodologies. The most common complication was bleeding in ACS-NSQIP (18.1%) and respiratory failure in AHRQ-PSI (0.53%). The overlap was highest for venous thromboembolic events. There was no overlap in adverse events for 5 of the 7 categories of adverse events. CONCLUSIONS: A large discrepancy was observed between adverse events reported in ACS-NSQIP and AHRQ-PSI. A large percentage of clinically important adverse events identified in ACS-NSQIP were missed in AHRQ-PSI algorithms. The ability of AHRQ-PSI for detecting adverse events varied widely with ACS-NSQIP. CLINICAL RELEVANCE: AHRQ-PSI algorithms currently are insufficient to assess the quality of orthopedic surgery.
Keywords:
Agency for Healthcare Research and Quality Patient Safety Indicators (AHRQ-PSI); American College of Surgeons National Surgical Quality Improvement Project (ACS-NSQIP); Quality
Authors: Daniel C Norvell; Jane B Shofer; Sigvard T Hansen; James Davitt; John G Anderson; Donald Bohay; J Chris Coetzee; John Maskill; Michael Brage; Michael Houghton; William R Ledoux; Bruce J Sangeorzan Journal: Foot Ankle Int Date: 2018-05-31 Impact factor: 2.827
Authors: Kenny Ling; Kevin I Kashanchi; Taylor VanHelmond; Alireza Nazemi; Matthew Kim; David E Komatsu; Edward D Wang Journal: JSES Int Date: 2022-03-07
Authors: Keaton F Piper; Samuel B Tomlinson; Gabrielle Santangelo; Joseph Van Galen; Ian DeAndrea-Lazarus; James Towner; Kristopher T Kimmell; Howard Silberstein; George Edward Vates Journal: Surg Neurol Int Date: 2017-11-01
Authors: Martin Magnéli; Maria Unbeck; Cecilia Rogmark; Ola Rolfson; Ami Hommel; Bodil Samuelsson; Kristina Schildmeijer; Desirée Sjöstrand; Max Gordon; Olof Sköldenberg Journal: BMJ Open Date: 2019-03-07 Impact factor: 2.692