Hillary J Mull1,2, Kamal M F Itani2,3,4, Steven D Pizer5,6, Martin P Charns1,6, Peter E Rivard1,7, Nathalie McIntosh8, Mary T Hawn9,10, Amy K Rosen1,2. 1. Center for Healthcare Organization and Implementation Research (CHOIR), VA Boston Healthcare System, Boston, MA. 2. Department of Surgery, Boston University School of Medicine, Boston, MA. 3. Department of Surgery, VA Boston Healthcare System, Boston, MA. 4. Harvard Medical School, Boston, MA. 5. Department of Veterans Affairs, Partnered Evidence-based Policy Resource Center (PEPReC), Boston, MA. 6. Department of Health Law, Policy and Management, Boston University School of Public Health, Boston, MA. 7. Healthcare Administration, Sawyer Business School Suffolk University, Boston, MA. 8. Massachusetts Health Quality Partners (MHQP), Boston, MA. 9. Palo Alto VA Medical Center, Palo Alto, CA. 10. Stanford University School of Medicine, Stanford, CA.
Abstract
OBJECTIVE: Develop and validate a surveillance model to identify outpatient surgical adverse events (AEs) based on previously developed electronic triggers. DATA SOURCES: Veterans Health Administration's Corporate Data Warehouse. STUDY DESIGN: Six surgical AE triggers, including postoperative emergency room visits and hospitalizations, were applied to FY2012-2014 outpatient surgeries (n = 744,355). We randomly sampled trigger-flagged and unflagged cases for nurse chart review to document AEs and measured positive predictive value (PPV) for triggers. Next, we used chart review data to iteratively estimate multilevel logistic regression models to predict the probability of an AE, starting with the six triggers and adding in patient, procedure, and facility characteristics to improve model fit. We validated the final model by applying the coefficients to FY2015 outpatient surgery data (n = 256,690) and reviewing charts for cases at high and moderate probability of an AE. PRINCIPAL FINDINGS: Of 1,730 FY2012-2014 reviewed surgeries, 350 had an AE (20 percent). The final surveillance model c-statistic was 0.81. In FY2015 surgeries with >0.8 predicted probability of an AE (n = 405, 0.15 percent), PPV was 85 percent; in surgeries with a 0.4-0.5 predicted probability of an AE, PPV was 38 percent. CONCLUSIONS: The surveillance model performed well, accurately identifying outpatient surgeries with a high probability of an AE. Published 2018. This article is a U.S. Government work and is in the public domain in the USA.
OBJECTIVE: Develop and validate a surveillance model to identify outpatient surgical adverse events (AEs) based on previously developed electronic triggers. DATA SOURCES: Veterans Health Administration's Corporate Data Warehouse. STUDY DESIGN: Six surgical AE triggers, including postoperative emergency room visits and hospitalizations, were applied to FY2012-2014 outpatient surgeries (n = 744,355). We randomly sampled trigger-flagged and unflagged cases for nurse chart review to document AEs and measured positive predictive value (PPV) for triggers. Next, we used chart review data to iteratively estimate multilevel logistic regression models to predict the probability of an AE, starting with the six triggers and adding in patient, procedure, and facility characteristics to improve model fit. We validated the final model by applying the coefficients to FY2015 outpatient surgery data (n = 256,690) and reviewing charts for cases at high and moderate probability of an AE. PRINCIPAL FINDINGS: Of 1,730 FY2012-2014 reviewed surgeries, 350 had an AE (20 percent). The final surveillance model c-statistic was 0.81. In FY2015 surgeries with >0.8 predicted probability of an AE (n = 405, 0.15 percent), PPV was 85 percent; in surgeries with a 0.4-0.5 predicted probability of an AE, PPV was 38 percent. CONCLUSIONS: The surveillance model performed well, accurately identifying outpatient surgeries with a high probability of an AE. Published 2018. This article is a U.S. Government work and is in the public domain in the USA.
Entities:
Keywords:
Modeling: multilevel; VA health care system; ambulatory/outpatient care; quality of care/ patient safety (measurement); surgery
Authors: Peter K Lindenauer; Denise Remus; Sheila Roman; Michael B Rothberg; Evan M Benjamin; Allen Ma; Dale W Bratzler Journal: N Engl J Med Date: 2007-01-26 Impact factor: 91.245
Authors: Hillary J Mull; Caitlin W Brennan; Tiffany Folkes; John Hermos; Jeffrey Chan; Amy K Rosen; Steven R Simon Journal: Qual Manag Health Care Date: 2015 Jul-Sep Impact factor: 0.926
Authors: Christopher P Landrigan; Gareth J Parry; Catherine B Bones; Andrew D Hackbarth; Donald A Goldmann; Paul J Sharek Journal: N Engl J Med Date: 2010-11-25 Impact factor: 91.245
Authors: Elise A Dasinger; Westyn Branch-Elliman; Steven D Pizer; Hassen Abdulkerim; Amy K Rosen; Martin P Charns; Mary T Hawn; Kamal M F Itani; Hillary J Mull Journal: Am J Surg Date: 2019-01-04 Impact factor: 2.565