Andrew T Schlussel1, Conor P Delaney, Justin A Maykel, Michael B Lustik, Madhuri Nishtala, Scott R Steele. 1. 1 Division of Colorectal Surgery, University of Massachusetts Memorial Medical Center, Worcester, Massachusetts 2 Digestive Disease Institute, Cleveland Clinic, Cleveland, Ohio 3 Department of Clinical Investigation, Tripler Army Medical Center, Honolulu, Hawaii 4 Division of Colorectal Surgery, University Hospitals Case Medical Center, Cleveland, Ohio.
Abstract
BACKGROUND: Clinical and administrative databases each have fundamental distinctions and inherent limitations that may impact results. OBJECTIVE: This study aimed to compare the American College of Surgeons National Surgical Quality Improvement Program and the Nationwide Inpatient Sample, focusing on the similarities, differences, and limitations of both data sets. DESIGN: All elective open and laparoscopic segmental colectomies from American College of Surgeons National Surgical Quality Improvement Program (2006-2013) and Nationwide Inpatient Sample (2006-2012) were reviewed. International Classification of Diseases, Ninth Revision, Clinical Modification coding identified Nationwide Inpatient Sample cases, and Current Procedural Terminology coding for American College of Surgeons National Surgical Quality Improvement Program. Common demographics and comorbidities were identified, and in-hospital outcomes were evaluated. SETTINGS: A national sample was extracted from population databases. PATIENTS: Data were derived from the Nationwide Inpatient Sample database: 188,326 cases (laparoscopic = 67,245; open = 121,081); and American College of Surgeons National Surgical Quality Improvement Program: 110,666 cases (laparoscopic = 54,191; open = 56,475). MAIN OUTCOME MEASURES: Colectomy data were used as an avenue to compare differences in patient characteristics and outcomes between these 2 data sets. RESULTS: Laparoscopic colectomy demonstrated superior outcomes compared with open; therefore, results focused on comparing a minimally invasive approach among the data sets. Because of sample size, many variables were statistically different without clinical relevance. Coding discrepancies were demonstrated in the rate of conversion from laparoscopic to open identified in the National Surgical Quality Improvement Program (3%) and Nationwide Inpatient Sample (15%) data sets. The prevalence of nonmorbid obesity and anemia from National Surgical Quality Improvement Program was more than twice that of Nationwide Inpatient Sample. Sepsis was statistically greater in National Surgical Quality Improvement Program, with urinary tract infections and acute kidney injury having a greater frequency in the Nationwide Inpatient Sample cohort. Surgical site infections were higher in National Surgical Quality Improvement Program (30-day) vs Nationwide Inpatient Sample (8.4% vs 2.6%; p < 0.01), albeit less when restricted to infections that occurred before discharge (3.3% vs 2.6%; p < 0.01). LIMITATIONS: This is a retrospective study using population-based data. CONCLUSION: This analysis of 2 large national databases regarding colectomy outcomes highlights the incidence of previously unrecognized data variability. These discrepancies can impact study results and subsequent conclusions/recommendations. These findings underscore the importance of carefully choosing and understanding the different population-based data sets before designing and when interpreting outcomes research.
BACKGROUND: Clinical and administrative databases each have fundamental distinctions and inherent limitations that may impact results. OBJECTIVE: This study aimed to compare the American College of Surgeons National Surgical Quality Improvement Program and the Nationwide Inpatient Sample, focusing on the similarities, differences, and limitations of both data sets. DESIGN: All elective open and laparoscopic segmental colectomies from American College of Surgeons National Surgical Quality Improvement Program (2006-2013) and Nationwide Inpatient Sample (2006-2012) were reviewed. International Classification of Diseases, Ninth Revision, Clinical Modification coding identified Nationwide Inpatient Sample cases, and Current Procedural Terminology coding for American College of Surgeons National Surgical Quality Improvement Program. Common demographics and comorbidities were identified, and in-hospital outcomes were evaluated. SETTINGS: A national sample was extracted from population databases. PATIENTS: Data were derived from the Nationwide Inpatient Sample database: 188,326 cases (laparoscopic = 67,245; open = 121,081); and American College of Surgeons National Surgical Quality Improvement Program: 110,666 cases (laparoscopic = 54,191; open = 56,475). MAIN OUTCOME MEASURES: Colectomy data were used as an avenue to compare differences in patient characteristics and outcomes between these 2 data sets. RESULTS: Laparoscopic colectomy demonstrated superior outcomes compared with open; therefore, results focused on comparing a minimally invasive approach among the data sets. Because of sample size, many variables were statistically different without clinical relevance. Coding discrepancies were demonstrated in the rate of conversion from laparoscopic to open identified in the National Surgical Quality Improvement Program (3%) and Nationwide Inpatient Sample (15%) data sets. The prevalence of nonmorbid obesity and anemia from National Surgical Quality Improvement Program was more than twice that of Nationwide Inpatient Sample. Sepsis was statistically greater in National Surgical Quality Improvement Program, with urinary tract infections and acute kidney injury having a greater frequency in the Nationwide Inpatient Sample cohort. Surgical site infections were higher in National Surgical Quality Improvement Program (30-day) vs Nationwide Inpatient Sample (8.4% vs 2.6%; p < 0.01), albeit less when restricted to infections that occurred before discharge (3.3% vs 2.6%; p < 0.01). LIMITATIONS: This is a retrospective study using population-based data. CONCLUSION: This analysis of 2 large national databases regarding colectomy outcomes highlights the incidence of previously unrecognized data variability. These discrepancies can impact study results and subsequent conclusions/recommendations. These findings underscore the importance of carefully choosing and understanding the different population-based data sets before designing and when interpreting outcomes research.
Authors: Andrea Balla; Gabriela Batista Rodríguez; Santiago Corradetti; Carmen Balagué; Sonia Fernández-Ananín; Eduard M Targarona Journal: Langenbecks Arch Surg Date: 2017-08-05 Impact factor: 3.445
Authors: Gabriela Batista Rodríguez; Andrea Balla; Santiago Corradetti; Carmen Martinez; Pilar Hernández; Jesús Bollo; Eduard M Targarona Journal: Int J Colorectal Dis Date: 2018-04-06 Impact factor: 2.571
Authors: Shikhar H Shah; Yi-Fan Chen; Heather E Moss; Daniel S Rubin; Charlotte E Joslin; Steven Roth Journal: Anesth Analg Date: 2020-04 Impact factor: 5.108
Authors: Tiago Gregório; Sara Pipa; Pedro Cavaleiro; Gabriel Atanásio; Inês Albuquerque; Paulo Castro Chaves; Luís Azevedo Journal: BMC Med Res Methodol Date: 2018-11-20 Impact factor: 4.615