Barbara E Jones1,2, Candace Haroldsen1,3, Karl Madaras-Kelly4, Matthew B Goetz5, Jian Ying3, Brian Sauer1,3, Makoto M Jones1,3, Molly Leecaster1,3, Tom Greene1,3, Scott K Fridkin6, Melinda M Neuhauser7, Matthew H Samore1. 1. Informatics, Decision-Enhancement, and Analytic Sciences (IDEAS 2.0) Center of Innovation, VA SLC Health System. 2. Division of Pulmonary and Critical Care Medicine. 3. Division of Epidemiology, University of Utah, Salt Lake City, UT. 4. Boise VA Medical Center and Idaho State University College of Pharmacy, Pocatello, ID. 5. VA Greater Los Angeles Healthcare System and David Geffen School of Medicine at UCLA, Los Angeles, CA. 6. Emory University School of Medicine, Department of Medicine, Atlanta, GA. 7. Department of Veterans Affairs, VA Center for Medication Safety (MedSAFE), Pharmacy Benefits Management Services, Hines, IL.
Abstract
BACKGROUND: Electronic health records provide the opportunity to assess system-wide quality measures. Veterans Affairs Pharmacy Benefits Management Center for Medication Safety uses medication use evaluation (MUE) through manual review of the electronic health records. OBJECTIVE: To compare an electronic MUE approach versus human/manual review for extraction of antibiotic use (choice and duration) and severity metrics. RESEARCH DESIGN: Retrospective. SUBJECTS: Hospitalizations for uncomplicated pneumonia occurring during 2013 at 30 Veterans Affairs facilities. MEASURES: We compared summary statistics, individual hospitalization-level agreement, facility-level consistency, and patterns of variation between electronic and manual MUE for initial severity, antibiotic choice, daily clinical stability, and antibiotic duration. RESULTS: Among 2004 hospitalizations, electronic and manual abstraction methods showed high individual hospitalization-level agreement for initial severity measures (agreement=86%-98%, κ=0.5-0.82), antibiotic choice (agreement=89%-100%, κ=0.70-0.94), and facility-level consistency for empiric antibiotic choice (anti-MRSA r=0.97, P<0.001; antipseudomonal r=0.95, P<0.001) and therapy duration (r=0.77, P<0.001) but lower facility-level consistency for days to clinical stability (r=0.52, P=0.006) or excessive duration of therapy (r=0.55, P=0.005). Both methods identified widespread facility-level variation in antibiotic choice, but we found additional variation in manual estimation of excessive antibiotic duration and initial illness severity. CONCLUSIONS: Electronic and manual MUE agreed well for illness severity, antibiotic choice, and duration of therapy in pneumonia at both the individual and facility levels. Manual MUE showed additional reviewer-level variation in estimation of initial illness severity and excessive antibiotic use. Electronic MUE allows for reliable, scalable tracking of national patterns of antimicrobial use, enabling the examination of system-wide interventions to improve quality.
BACKGROUND: Electronic health records provide the opportunity to assess system-wide quality measures. Veterans Affairs Pharmacy Benefits Management Center for Medication Safety uses medication use evaluation (MUE) through manual review of the electronic health records. OBJECTIVE: To compare an electronic MUE approach versus human/manual review for extraction of antibiotic use (choice and duration) and severity metrics. RESEARCH DESIGN: Retrospective. SUBJECTS: Hospitalizations for uncomplicated pneumonia occurring during 2013 at 30 Veterans Affairs facilities. MEASURES: We compared summary statistics, individual hospitalization-level agreement, facility-level consistency, and patterns of variation between electronic and manual MUE for initial severity, antibiotic choice, daily clinical stability, and antibiotic duration. RESULTS: Among 2004 hospitalizations, electronic and manual abstraction methods showed high individual hospitalization-level agreement for initial severity measures (agreement=86%-98%, κ=0.5-0.82), antibiotic choice (agreement=89%-100%, κ=0.70-0.94), and facility-level consistency for empiric antibiotic choice (anti-MRSA r=0.97, P<0.001; antipseudomonal r=0.95, P<0.001) and therapy duration (r=0.77, P<0.001) but lower facility-level consistency for days to clinical stability (r=0.52, P=0.006) or excessive duration of therapy (r=0.55, P=0.005). Both methods identified widespread facility-level variation in antibiotic choice, but we found additional variation in manual estimation of excessive antibiotic duration and initial illness severity. CONCLUSIONS: Electronic and manual MUE agreed well for illness severity, antibiotic choice, and duration of therapy in pneumonia at both the individual and facility levels. Manual MUE showed additional reviewer-level variation in estimation of initial illness severity and excessive antibiotic use. Electronic MUE allows for reliable, scalable tracking of national patterns of antimicrobial use, enabling the examination of system-wide interventions to improve quality.
Authors: Barbara E Jones; Kevin Antoine Brown; Makoto M Jones; Benedikt D Huttner; Tom Greene; Brian C Sauer; Karl Madaras-Kelly; Michael A Rubin; Matthew Bidwell Goetz; Matthew H Samore Journal: Infect Control Hosp Epidemiol Date: 2017-06-21 Impact factor: 3.254
Authors: Joseph L Goulet; Joseph Erdos; Sue Kancir; Forrest L Levin; Steven M Wright; Stanlie M Daniels; Lynnette Nilan; Amy C Justice Journal: Med Care Date: 2007-01 Impact factor: 2.983
Authors: Eve A Kerr; Timothy P Hofer; Rodney A Hayward; John L Adams; Mary M Hogan; Elizabeth A McGlynn; Steven M Asch Journal: Health Serv Res Date: 2007-10 Impact factor: 3.402
Authors: Karl J Madaras-Kelly; Muriel Burk; Christina Caplinger; Jefferson G Bohan; Melinda M Neuhauser; Matthew Bidwell Goetz; Rongping Zhang; Francesca E Cunningham Journal: J Hosp Med Date: 2016-08-16 Impact factor: 2.960
Authors: Michael A Rubin; Jeanmarie Mayer; Tom Greene; Brian C Sauer; Bala Hota; William Trick; William E Trick; John A Jernigan; Matthew H Samore Journal: AMIA Annu Symp Proc Date: 2008-11-06
Authors: Shantini D Gamage; Martin E Evans; Brian P McCauley; Karen R Lipscomb; Linda Flarida; Makoto M Jones; Michael Baza; Jeremy Barraza; Loretta A Simbartl; Gary A Roselle Journal: Infect Control Hosp Epidemiol Date: 2022-03-30 Impact factor: 6.520
Authors: Barbara Ellen Jones; Jian Ying; Vanessa Stevens; Candace Haroldsen; Tao He; McKenna Nevers; Matthew A Christensen; Richard E Nelson; Gregory J Stoddard; Brian C Sauer; Peter M Yarbrough; Makoto M Jones; Matthew Bidwell Goetz; Tom Greene; Matthew H Samore Journal: JAMA Intern Med Date: 2020-04-01 Impact factor: 21.873