Michael S Phipps1,2, Jeff Fahner3, Danielle Sager3, Jessica Coffing3, Bailey Maryfield3, Linda S Williams3,4,5. 1. Department of Neurology, University of Maryland School of Medicine, 110 S. Paca St, 3rd floor, Baltimore, MD, 21201, USA. mphipps@som.umaryland.edu. 2. Baltimore VA Medical Center, Baltimore, MD, USA. mphipps@som.umaryland.edu. 3. Roudebush VA Medical Center, Indianapolis, IN, Indiana. 4. Department of Neurology, Indiana University School of Medicine, Indianapolis, IN, USA. 5. Regenstrief Institute Inc., Indianapolis, IN, USA.
Abstract
BACKGROUND: The Meaningful Use (MU) program has increased the national emphasis on electronic measurement of hospital quality. OBJECTIVE: To evaluate stroke MU and one VHA stroke electronic clinical quality measure (eCQM) in national VHA data and determine sources of error in using centralized electronic health record (EHR) data. DESIGN: Our study is a retrospective cross-sectional study of stroke quality measure eCQMs vs. chart review in a national EHR. We developed local SQL algorithms to generate the eCQMs, then modified them to run on VHA Central Data Warehouse (CDW) data. eCQM results were generated from CDW data in 2130 ischemic stroke admissions in 11 VHA hospitals. Local and CDW results were compared to chart review. MAIN MEASURES: We calculated the raw proportion of matching cases, sensitivity/specificity, and positive/negative predictive values (PPV/NPV) for the numerators and denominators of each eCQM. To assess overall agreement for each eCQM, we calculated a weighted kappa and prevalence-adjusted bias-adjusted kappa statistic for a three-level outcome: ineligible, eligible-passed, or eligible-failed. KEY RESULTS: In five eCQMs, the proportion of matched cases between CDW and chart ranged from 95.4 %-99.7 % (denominators) and 87.7 %-97.9 % (numerators). PPVs tended to be higher (range 96.8 %-100 % in CDW) with NPVs less stable and lower. Prevalence-adjusted bias-adjusted kappas for overall agreement ranged from 0.73-0.95. Common errors included difficulty in identifying: (1) mechanical VTE prophylaxis devices, (2) hospice and other specific discharge disposition, and (3) contraindications to receiving care processes. CONCLUSIONS: Stroke MU indicators can be relatively accurately generated from existing EHR systems (nearly 90 % match to chart review), but accuracy decreases slightly in central compared to local data sources. To improve stroke MU measure accuracy, EHRs should include standardized data elements for devices, discharge disposition (including hospice and comfort care status), and recording contraindications.
BACKGROUND: The Meaningful Use (MU) program has increased the national emphasis on electronic measurement of hospital quality. OBJECTIVE: To evaluate stroke MU and one VHA stroke electronic clinical quality measure (eCQM) in national VHA data and determine sources of error in using centralized electronic health record (EHR) data. DESIGN: Our study is a retrospective cross-sectional study of stroke quality measure eCQMs vs. chart review in a national EHR. We developed local SQL algorithms to generate the eCQMs, then modified them to run on VHA Central Data Warehouse (CDW) data. eCQM results were generated from CDW data in 2130 ischemic stroke admissions in 11 VHA hospitals. Local and CDW results were compared to chart review. MAIN MEASURES: We calculated the raw proportion of matching cases, sensitivity/specificity, and positive/negative predictive values (PPV/NPV) for the numerators and denominators of each eCQM. To assess overall agreement for each eCQM, we calculated a weighted kappa and prevalence-adjusted bias-adjusted kappa statistic for a three-level outcome: ineligible, eligible-passed, or eligible-failed. KEY RESULTS: In five eCQMs, the proportion of matched cases between CDW and chart ranged from 95.4 %-99.7 % (denominators) and 87.7 %-97.9 % (numerators). PPVs tended to be higher (range 96.8 %-100 % in CDW) with NPVs less stable and lower. Prevalence-adjusted bias-adjusted kappas for overall agreement ranged from 0.73-0.95. Common errors included difficulty in identifying: (1) mechanical VTE prophylaxis devices, (2) hospice and other specific discharge disposition, and (3) contraindications to receiving care processes. CONCLUSIONS:Stroke MU indicators can be relatively accurately generated from existing EHR systems (nearly 90 % match to chart review), but accuracy decreases slightly in central compared to local data sources. To improve stroke MU measure accuracy, EHRs should include standardized data elements for devices, discharge disposition (including hospice and comfort care status), and recording contraindications.
Entities:
Keywords:
electronic health records; meaningful use; process assessment; quality assessment; stroke
Authors: Greg Arling; Mathew Reeves; Joseph Ross; Linda S Williams; Salomeh Keyhani; Neale Chumbler; Michael S Phipps; Christianne Roumie; Laura J Myers; Amanda H Salanitro; Diana L Ordin; Jennifer Myers; Dawn M Bravata Journal: Circ Cardiovasc Qual Outcomes Date: 2011-12-06
Authors: Eve A Kerr; Dylan M Smith; Mary M Hogan; Sarah L Krein; Leonard Pogach; Timothy P Hofer; Rodney A Hayward Journal: Jt Comm J Qual Improv Date: 2002-10
Authors: Jennifer H Garvin; Peter L Elkin; Shuying Shen; Steven Brown; Brett Trusko; Enlai Wang; Linda Hoke; Ylenia Quiaoit; Joan Lajoie; Mark G Weiner; Pauline Graham; Theodore Speroff Journal: J Healthc Qual Date: 2013 Jul-Aug Impact factor: 1.095
Authors: William Gardner; Suzanne Morton; Aldo Tinoco; Sarah Hudson Scholle; Benjamin D Canan; Kelly J Kelleher Journal: J Healthc Qual Date: 2016 May-Jun Impact factor: 1.095
Authors: Lee H Schwamm; Gregg C Fonarow; Mathew J Reeves; Wenqin Pan; Michael R Frankel; Eric E Smith; Gray Ellrodt; Christopher P Cannon; Li Liang; Eric Peterson; Kenneth A Labresh Journal: Circulation Date: 2008-12-15 Impact factor: 29.690
Authors: Linda Williams; Virginia Daggett; James E Slaven; Zhangsheng Yu; Danielle Sager; Jennifer Myers; Laurie Plue; Heather Woodward-Hagg; Teresa M Damush Journal: BMJ Qual Saf Date: 2015-08-24 Impact factor: 7.035
Authors: Stephan D Fihn; Joseph Francis; Carolyn Clancy; Christopher Nielson; Karin Nelson; John Rumsfeld; Theresa Cullen; Jack Bates; Gail L Graham Journal: Health Aff (Millwood) Date: 2014-07 Impact factor: 6.301
Authors: Pashiera Barkhuysen; Wim de Grauw; Reinier Akkermans; José Donkers; Henk Schers; Marion Biermans Journal: J Am Med Inform Assoc Date: 2013-10-21 Impact factor: 4.497
Authors: Dawn M Bravata; Laura J Myers; Mathew Reeves; Eric M Cheng; Fitsum Baye; Susan Ofner; Edward J Miech; Teresa Damush; Jason J Sico; Alan Zillich; Michael Phipps; Linda S Williams; Seemant Chaturvedi; Jason Johanning; Zhangsheng Yu; Anthony J Perkins; Ying Zhang; Greg Arling Journal: JAMA Netw Open Date: 2019-07-03