Allan Fong1, Nicole Harriott2, Donna M Walters2, Hanan Foley2, Richard Morrissey2, Raj R Ratwani3. 1. National Center for Human Factors in Healthcare, MedStar Health, 3007 Tilden St. NW, Suite 7M, Washington, D.C. 20008, USA. Electronic address: allan.fong@medstar.net. 2. Georgetown University Medical Center, 3800 Reservoir Rd NW, Washington, D.C. 20007, USA. 3. National Center for Human Factors in Healthcare, MedStar Health, 3007 Tilden St. NW, Suite 7M, Washington, D.C. 20008, USA; Department of Emergency Medicine, Georgetown University School of Medicine, 3900 Reservoir Rd. NW Washington D.C. 20007, USA.
Abstract
OBJECTIVES: Many healthcare providers have implemented patient safety event reporting systems to better understand and improve patient safety. Reviewing and analyzing these reports is often time consuming and resource intensive because of both the quantity of reports and length of free-text descriptions in the reports. METHODS: Natural language processing (NLP) experts collaborated with clinical experts on a patient safety committee to assist in the identification and analysis of medication related patient safety events. Different NLP algorithmic approaches were developed to identify four types of medication related patient safety events and the models were compared. RESULTS: Well performing NLP models were generated to categorize medication related events into pharmacy delivery delays, dispensing errors, Pyxis discrepancies, and prescriber errors with receiver operating characteristic areas under the curve of 0.96, 0.87, 0.96, and 0.81 respectively. We also found that modeling the brief without the resolution text generally improved model performance. These models were integrated into a dashboard visualization to support the patient safety committee review process. CONCLUSIONS: We demonstrate the capabilities of various NLP models and the use of two text inclusion strategies at categorizing medication related patient safety events. The NLP models and visualization could be used to improve the efficiency of patient safety event data review and analysis.
OBJECTIVES: Many healthcare providers have implemented patient safety event reporting systems to better understand and improve patient safety. Reviewing and analyzing these reports is often time consuming and resource intensive because of both the quantity of reports and length of free-text descriptions in the reports. METHODS: Natural language processing (NLP) experts collaborated with clinical experts on a patient safety committee to assist in the identification and analysis of medication related patient safety events. Different NLP algorithmic approaches were developed to identify four types of medication related patient safety events and the models were compared. RESULTS: Well performing NLP models were generated to categorize medication related events into pharmacy delivery delays, dispensing errors, Pyxis discrepancies, and prescriber errors with receiver operating characteristic areas under the curve of 0.96, 0.87, 0.96, and 0.81 respectively. We also found that modeling the brief without the resolution text generally improved model performance. These models were integrated into a dashboard visualization to support the patient safety committee review process. CONCLUSIONS: We demonstrate the capabilities of various NLP models and the use of two text inclusion strategies at categorizing medication related patient safety events. The NLP models and visualization could be used to improve the efficiency of patient safety event data review and analysis.
Authors: Aleena Banerji; Kenneth H Lai; Yu Li; Rebecca R Saff; Carlos A Camargo; Kimberly G Blumenthal; Li Zhou Journal: J Allergy Clin Immunol Pract Date: 2019-12-16
Authors: Kristen M Crandall; Ahmed Almuhanna; Rebecca Cady; Lisbeth Fahey; Tara Taylor Floyd; Debbie Freiburg; Mary Anne Hilliard; Sonal Kalburgi; Nafis I Khan; DiAnthia Patrick; Padmaja Pavuluri; Kelvin Potter; Lisa Scafidi; Laura Sigman; Rahul K Shah Journal: Pediatr Qual Saf Date: 2018-04-06