Philomena Ngugi1,2, Ankica Babic1,3, James Kariuki4, Xenophon Santas5, Violet Naanyu6, Martin C Were2,7. 1. Department of Information Science and Media studies, University of Bergen, Bergen, Norway. 2. Institute of Biomedical Informatics, Moi University, Eldoret, Kenya. 3. Department of Biomedical Engineering, Linköping University, Linköping, Sweden. 4. Division of Global HIV & TB, Center for Global Health, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America. 5. Center for Global Health, Centers for Disease Control and Prevention, Atlanta, Georgia, United States of America. 6. School of Arts and Social Sciences, Moi University, Eldoret, Kenya. 7. Vanderbilt Institute of Global Health, Vanderbilt University Medical Center, Nashville, Tennessee, United States of America.
Abstract
BACKGROUND: Electronic Health Record Systems (EHRs) are being rolled out nationally in many low- and middle-income countries (LMICs) yet assessing actual system usage remains a challenge. We employed a nominal group technique (NGT) process to systematically develop high-quality indicators for evaluating actual usage of EHRs in LMICs. METHODS: An initial set of 14 candidate indicators were developed by the study team adapting the Human Immunodeficiency Virus (HIV) Monitoring, Evaluation, and Reporting indicators format. A multidisciplinary team of 10 experts was convened in a two-day NGT workshop in Kenya to systematically evaluate, rate (using Specific, Measurable, Achievable, Relevant, and Time-Bound (SMART) criteria), prioritize, refine, and identify new indicators. NGT steps included introduction to candidate indicators, silent indicator ranking, round-robin indicator rating, and silent generation of new indicators. 5-point Likert scale was used in rating the candidate indicators against the SMART components. RESULTS: Candidate indicators were rated highly on SMART criteria (4.05/5). NGT participants settled on 15 final indicators, categorized as system use (4); data quality (3), system interoperability (3), and reporting (5). Data entry statistics, systems uptime, and EHRs variable concordance indicators were rated highest. CONCLUSION: This study describes a systematic approach to develop and validate quality indicators for determining EHRs use and provides LMICs with a multidimensional tool for assessing success of EHRs implementations.
BACKGROUND: Electronic Health Record Systems (EHRs) are being rolled out nationally in many low- and middle-income countries (LMICs) yet assessing actual system usage remains a challenge. We employed a nominal group technique (NGT) process to systematically develop high-quality indicators for evaluating actual usage of EHRs in LMICs. METHODS: An initial set of 14 candidate indicators were developed by the study team adapting the Human Immunodeficiency Virus (HIV) Monitoring, Evaluation, and Reporting indicators format. A multidisciplinary team of 10 experts was convened in a two-day NGT workshop in Kenya to systematically evaluate, rate (using Specific, Measurable, Achievable, Relevant, and Time-Bound (SMART) criteria), prioritize, refine, and identify new indicators. NGT steps included introduction to candidate indicators, silent indicator ranking, round-robinindicator rating, and silent generation of new indicators. 5-point Likert scale was used in rating the candidate indicators against the SMART components. RESULTS: Candidate indicators were rated highly on SMART criteria (4.05/5). NGT participants settled on 15 final indicators, categorized as system use (4); data quality (3), system interoperability (3), and reporting (5). Data entry statistics, systems uptime, and EHRs variable concordance indicators were rated highest. CONCLUSION: This study describes a systematic approach to develop and validate quality indicators for determining EHRs use and provides LMICs with a multidimensional tool for assessing success of EHRs implementations.
Authors: Maxwell O Akanbi; Amaka N Ocheke; Patricia A Agaba; Comfort A Daniyam; Emmanuel I Agaba; Edith N Okeke; Christiana O Ukoli Journal: J Med Trop Date: 2012