E S Kirkendall1, W L Spires2, T A Mottes3, J K Schaffzin4, C Barclay5, S L Goldstein3. 1. Division of Biomedical Informatics, Cincinnati Children's Hospital Medical Center , Cincinnati, Ohio ; Department of Information Services, Cincinnati Children's Hospital Medical Center , Cincinnati, Ohio ; Division of Hospital Medicine, Cincinnati Children's Hospital Medical Center , Cincinnati, Ohio ; James M. Anderson Center for Health Systems Excellence, Cincinnati Children's Hospital Medical Center , Cincinnati, Ohio. 2. Department of Information Services, Cincinnati Children's Hospital Medical Center , Cincinnati, Ohio. 3. Center for Acute Care Nephrology, Cincinnati Children's Hospital Medical Center , Cincinnati, Ohio. 4. Division of Hospital Medicine, Cincinnati Children's Hospital Medical Center , Cincinnati, Ohio. 5. Division of Pharmacy, Cincinnati Children's Hospital Medical Center , Cincinnati, Ohio.
Abstract
BACKGROUND: Nephrotoxic medication-associated acute kidney injury (NTMx-AKI) is a costly clinical phenomenon and more common than previously recognized. Prior efforts to use technology to identify AKI have focused on detection after renal injury has occurred. OBJECTIVES: Describe an approach and provide a technical framework for the creation of risk-stratifying AKI triggers and the development of an application to manage the AKI trigger data. Report the performance characteristics of those triggers and the refinement process and on the challenges of implementation. METHODS: Initial manual trigger screening guided design of an automated electronic trigger report. A web-based application was designed to alleviate inefficiency and serve as a user interface and central workspace for the project. Performance of the NTMx exposure trigger reports from September 2011 to September 2013 were evaluated using sensitivity (SN), specificity (SP), positive and negative predictive values (PPV, NPV). RESULTS: Automated reports were created to replace manual screening for NTMx-AKI. The initial performance of the NTMx exposure triggers for SN, SP, PPV, and NPV all were ≥0.78, and increased over the study, with all four measures reaching ≥0.95 consistently. A web-based application was implemented that simplifies data entry and couriering from the reports, expedites results viewing, and interfaces with an automated data visualization tool. Sociotechnical challenges were logged and reported. CONCLUSION: We have built a risk-stratifying system based on electronic triggers that detects patients at-risk for NTMx-AKI before injury occurs. The performance of the NTMx-exposed reports has neared 100% through iterative optimization. The complexity of the trigger logic and clinical workflows surrounding NTMx-AKI led to a challenging implementation, but one that has been successful from technical, clinical, and quality improvement standpoints. This report summarizes the construction of a trigger-based application, the performance of the triggers, and the challenges uncovered during the design, build, and implementation of the system.
BACKGROUND:Nephrotoxic medication-associated acute kidney injury (NTMx-AKI) is a costly clinical phenomenon and more common than previously recognized. Prior efforts to use technology to identify AKI have focused on detection after renal injury has occurred. OBJECTIVES: Describe an approach and provide a technical framework for the creation of risk-stratifying AKI triggers and the development of an application to manage the AKI trigger data. Report the performance characteristics of those triggers and the refinement process and on the challenges of implementation. METHODS: Initial manual trigger screening guided design of an automated electronic trigger report. A web-based application was designed to alleviate inefficiency and serve as a user interface and central workspace for the project. Performance of the NTMx exposure trigger reports from September 2011 to September 2013 were evaluated using sensitivity (SN), specificity (SP), positive and negative predictive values (PPV, NPV). RESULTS: Automated reports were created to replace manual screening for NTMx-AKI. The initial performance of the NTMx exposure triggers for SN, SP, PPV, and NPV all were ≥0.78, and increased over the study, with all four measures reaching ≥0.95 consistently. A web-based application was implemented that simplifies data entry and couriering from the reports, expedites results viewing, and interfaces with an automated data visualization tool. Sociotechnical challenges were logged and reported. CONCLUSION: We have built a risk-stratifying system based on electronic triggers that detects patients at-risk for NTMx-AKI before injury occurs. The performance of the NTMx-exposed reports has neared 100% through iterative optimization. The complexity of the trigger logic and clinical workflows surrounding NTMx-AKI led to a challenging implementation, but one that has been successful from technical, clinical, and quality improvement standpoints. This report summarizes the construction of a trigger-based application, the performance of the triggers, and the challenges uncovered during the design, build, and implementation of the system.
Entities:
Keywords:
Electronic health record; acute kidney injury; clinical decision support systems; electronic medical record; patient safety
Authors: G M Chertow; J Lee; G J Kuperman; E Burdick; J Horsky; D L Seger; R Lee; A Mekala; J Song; A L Komaroff; D W Bates Journal: JAMA Date: 2001-12-12 Impact factor: 56.272
Authors: Allison B McCoy; Lemuel R Waitman; Cynthia S Gadd; Ioana Danciu; James P Smith; Julia B Lewis; Jonathan S Schildcrout; Josh F Peterson Journal: Am J Kidney Dis Date: 2010-08-14 Impact factor: 8.860
Authors: K Colpaert; E Hoste; S Van Hoecke; D Vandijck; C Danneels; K Steurbaut; F De Turck; J Decruyenaere Journal: Acta Clin Belg Date: 2007 Impact factor: 1.264
Authors: James M Naessens; Claudia R Campbell; Jeanne M Huddleston; Bjorn P Berg; John J Lefante; Arthur R Williams; Richard A Culbertson Journal: Int J Qual Health Care Date: 2009-08 Impact factor: 2.038
Authors: Stuart L Goldstein; Eric Kirkendall; Hovi Nguyen; Joshua K Schaffzin; John Bucuvalas; Tracey Bracke; Michael Seid; Marshall Ashby; Natalie Foertmeyer; Lori Brunner; Anne Lesko; Cynthia Barclay; Carole Lannon; Stephen Muething Journal: Pediatrics Date: 2013-08-12 Impact factor: 7.124
Authors: Kirk Roberts; Mary Regina Boland; Lisiane Pruinelli; Jina Dcruz; Andrew Berry; Mattias Georgsson; Rebecca Hazen; Raymond F Sarmiento; Uba Backonja; Kun-Hsing Yu; Yun Jiang; Patricia Flatley Brennan Journal: J Am Med Inform Assoc Date: 2017-04-01 Impact factor: 4.497
Authors: Jeremy Andrew Saban; Michael Pizzi; Jillian Caldwell; Ana Palijan; Michael Zappitelli Journal: Pediatr Nephrol Date: 2016-10-07 Impact factor: 3.714
Authors: Emily L Joyce; Dilhari R DeAlmeida; Dana Y Fuhrman; Priyanka Priyanka; John A Kellum Journal: Nephrol Dial Transplant Date: 2019-03-01 Impact factor: 5.992
Authors: Michelle N Rheault; Lei Zhang; David T Selewski; Mahmoud Kallash; Cheryl L Tran; Meredith Seamon; Chryso Katsoufis; Isa Ashoor; Joel Hernandez; Katarina Supe-Markovina; Cynthia D'Alessandri-Silva; Nilka DeJesus-Gonzalez; Tetyana L Vasylyeva; Cassandra Formeck; Christopher Woll; Rasheed Gbadegesin; Pavel Geier; Prasad Devarajan; Shannon L Carpenter; Bryce A Kerlin; William E Smoyer Journal: Clin J Am Soc Nephrol Date: 2015-10-08 Impact factor: 8.237
Authors: Justin B Searns; Katja M Gist; John T Brinton; Kaci Pickett; James Todd; Meghan Birkholz; Danielle E Soranno Journal: Pediatr Nephrol Date: 2020-01-15 Impact factor: 3.714