Electronic health records (EHR) simulation-based training: a scoping review protocol.

INTRODUCTION: Effective electronic health record (EHR)-based training interventions facilitate improved EHR use for healthcare providers. One such training intervention is simulation-based training that emphasises learning actual tasks through experimentation in a risk-free environment without negative patient outcomes. EHR-specific simulation-based training can be employed to improve EHR use, thereby enhancing healthcare providers' skills and behaviours. Despite the potential advantages of this type of training, no study has identified and mapped the available evidence. To fill that gap, this scoping review will synthesise the current state of literature on EHR simulation-based training. METHODS AND ANALYSIS: The Arksey and O'Malley methodological framework will be employed. Three databases (PubMed, Embase and Cumulative Index to Nursing and Allied Health Literature) will be searched for published articles. ProQuest and Google Scholar will be searched to identify unpublished articles. Databases will be searched from inception to 29 January 2020. Only articles written in English, randomised control trials, cohort studies, cross-sectional studies and case-control studies will be considered for inclusion. Two reviewers will independently screen titles and abstracts against inclusion and exclusion criteria. Then, they will review full texts to determine articles for final inclusion. Citation chaining will be conducted to manually screen references of all included studies to identify additional studies not found by the search. A data abstraction form with relevant characteristics will be developed to help address the research question. Descriptive numerical analysis will be used to describe characteristics of included studies. Based on the extracted data, research evidence of EHR simulation-based training will be synthesised. ETHICS AND DISSEMINATION: Since no primary data will be collected, there will be no formal ethical review. Research findings will be disseminated through publications, presentations and meetings with relevant stakeholders. © Author(s) (or their employer(s)) 2020. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.

Identifies and maps available evidence on electronic health records simulation-based training.

Provides in-depth search strategy, elaborate eligibility criteria and clear data extraction framework to address research question.

Provides methodologically rigorous template for future scoping review studies that seek to identify and map early evidence for interventions.

Quality of evidence will not be assessed, and so robustness or generalisability of findings will not be evaluated.

Results will not answer a clinically meaningful question.

Introduction

Use of electronic health records (EHRs), digital form of the traditional patient and population health information,1 in the US healthcare system continues to grow.2 Despite their benefits, there are unintended consequences, including burnout and workflow disruption, associated with EHR use.2–4 Inadequate training and education of healthcare providers, among other reasons, may account for these unintended consequences.3 Effective EHR-based training, which closely mimics real-world clinical conditions while replicating the cognitive load that clinicians are subjected to,5 can improve healthcare quality and safety.6

Simulation is a methodology, not a technology, that substitutes real experiences with replicable guided experiences.7 In healthcare, these guided experiences may be physical or computer-based models, live actors or virtual reality platforms.7 8 Simulation seeks to replicate clinical scenarios without putting patients at risk.8 Simulation-based training (SBT), now a commonplace in healthcare,8 emphasises learning actual tasks through experimentation in a risk-free environment without negative patient outcomes. When applied properly, SBT creates a consistent, safe and replicable learning environment.9 SBT has been shown to enhance healthcare providers’ skills and behaviours,10 11 improve patient safety outcomes12 and provide valuable feedback.13 It has found utility in bridging the gap between medical students’ preclinical knowledge and care of real patients,14 enhancing surgical skills training,15 improving performance of emergency medicine residents during central venous catheterisation,16 and improving perceptual ability of critical care fellows.17

SBT can take many forms, including part-task simulators, human patient simulators, simulated clinical environments, computer screen-based simulators and virtual reality simulators.7 10 Of particular interest in the present study is EHR-specific SBT, a type of computer-screen based simulator, aimed at maximising the use of EHR as a clinical tool. Previous research6 18 19 shows that EHR-specific SBT facilitates improved use of EHRs for clinicians. It is worth noting that only one recent study20 has systematically reviewed educational interventions in the use of EHRs. The authors found that all the interventions involved data entry into a simulated EHR with none requiring extraction, aggregation or visualisation of clinical data. They suggested the need to address gaps in training medical students and residents. The study population for this study was only medical students and residents. However, EHR-specific SBT is not beneficial to this population only, but also to other healthcare professionals like physicians and surgeons. Despite the potential advantages of EHR-specific SBT,6 10 no study has identified and mapped the available evidence. To fill that gap, this study will synthesise the current state of literature on EHR SBT. We do not wish to use the results of this study to answer a clinically meaningful question. Rather, we are interested in identifying and mapping the available evidence, hence our choice of a scoping review.21

Methods and analysis

This protocol conforms to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols (PRISMA-P) checklist.22 We have included a copy of the PRISMA-P checklist as a supplementary file, completed with page numbers indicating where each item can be found in our manuscript. The final publication of this work will adhere to the PRISMA Extension for Scoping Reviews checklist.23 We will employ the Arksey and O’Malley24 methodological framework: (1) identifying the research question, (2) identifying relevant studies, (3) study selection, (4) charting the data, (5) collating, summarising and reporting the results, and (6) consultation.

Stage 1: identifying the research question

According to Arksey and O’Malley,24 the scoping review research question should be broad enough to summarise the breadth of evidence. In the present study, we seek to synthesise the available evidence by asking the question:

​What is known from the existing literature about EHR SBT?

We did not use a mnemonic to guide the construct of our research question. Rather, we consulted a group of healthcare educators to determine attributes of EHR SBT. Given the exploratory nature of the scoping review, we may refine this research question as we review the literature. We define an EHR as a digitised version of a patient's health information generated as a result of encounters in a healthcare delivery setting and maintained by authorised healthcare providers for planning and for delivering safe and proper treatment.25 Also, we define SBT as computer screen-based simulations intended for learners to acquire knowledge or assess learners’ competency of knowledge attainment and/or provide learners feedback related to clinical knowledge and critical-thinking skills.7 These definitions are needed to establish a clear scope to the study and guide the search strategy. We do not have a target population. Consequently, the target population may include students, residents, clerks, technicians, nurses, physicians, managers and regulators.

Stage 2: identifying relevant studies

To be as comprehensive as possible, we will search electronic databases and reference lists of included articles. We will search three databases from inception to 29 January 2020: PubMed, Embase and Cumulative Index to Nursing and Allied Health Literature. Since this is an exploratory study, we will also search ProQuest and Google Scholar to identify unpublished articles. A preliminary search on PubMed, with the help of a health sciences librarian, yielded 235 articles. We present the sample search strategy in table 1. We will use a similar search strategy to retrieve articles from the other databases. Only literature written in English, randomised control trials, cohort studies, cross-sectional studies and case-control studies will be considered for inclusion. We will download citations and remove duplications using the Zotero reference management software.

Table 1

Sample search strategy for PubMed

Search	Query	Items found
#1	((simulat*[tw] OR simulate[tw] OR simulated[tw] OR simulating[tw]) AND (train[tw] OR training[tw] OR trained[tw] OR educat*[tw]))	40 682
#2	Electronic Health Records[mesh] OR Electronic Health Records[tiab] OR Electronic Health Record[tiab] OR Medical Order Entry Systems[mesh] OR Medical Order Entry Systems[tiab] OR Medical Order Entry System[tiab] OR Computerized Provider Order Entry[tiab] OR Computerized Physician Order Entry[tiab] OR Medical Records Systems, Computerized[mesh] OR Electronic Medical Records[tiab] OR Electronic Medical Record[tiab] OR Electronic Health Record[tiab] OR Computerized Medical Record[tiab] OR Computerized Medical Records[tiab] OR electronic documentation[tiab] OR electronic charting[tiab]	59 024
#3	#1 AND #2	235

Stage 3: study selection

We will carry out article selection in two stages. First, two reviewers (JKN and KA) will independently screen titles and abstracts against inclusion and exclusion criteria (see table 2) with the aid of Covidence,26 a web-based screening and data extraction tool.

Table 2

Inclusion and exclusion criteria

Criterion	Inclusion	Exclusion
Technology used for simulation-based training	Computer screen-based	Part-task, human patient, simulated clinical environment, virtual reality
Language	English	Non-English
Text availability	Full text	Abstract only
Study design	Randomised control trial, cohort study, cross-sectional study, case-control study	Animal research study, systematic review, meta-analysis, literature review, scoping review

A third reviewer (LM) will assist in resolving disagreements regarding article eligibility. In the second stage, two reviewers will independently review the selected full-text articles to determine eligibility. Also, we will conduct citation chaining to manually screen references of all included studies to identify additional studies not found by the search. Figure 1 displays the flow of studies from stages 1 to 2.

Figure 1

Flow of studies within stages 1–2. CINAHL, Cumulative Index to Nursing and Allied Health Literature.

Stage 4: charting the data

Through an iterative process, we will develop a data abstraction form with relevant characteristics to help address the research question. Each researcher will independently pilot the data abstraction form about 7–10 studies to determine its consistency with the research question. For each study, variables will be extracted for each category—research, simulation study and EHR (see table 3). Together, these data will form the basis of our analysis.

Table 3

Overview of variables and related classification method

Category	Variable	Classification method
Research	Year of publication	Metadata
	Geolocation
	Number of participants
	Participants’ age group
	Specialty
Simulation study	Aim of simulation	Gaba7
	Unit of participation in simulation
	Experience level of simulation participants
	Knowledge, skill, attitudes addressed
	Site of simulation participation
	Extent of direct participation in simulation
	Feedback accompanying simulation
EHR	Health information and data	Institute of Medicine28
	Results management
	Order entry/management
	Decision support management
	Electronic communication and connectivity
	Patient support
	Administrative processes
	Reporting and population health management

Stage 5: collating, summarising and reporting the results

We will not evaluate the robustness or generalisability of our findings since we do not seek to assess the quality of evidence.24 Rather, we will collate, summarise and report our findings using descriptive numerical analysis. Two reviewers (JKN and KA) will conduct this analysis to present a summary of the nature and distribution of the studies included in the review. We will produce tables and charts mapping the distribution of studies. Based on the data extracted, we will synthesise research evidence of EHR SBT.

Stage 6: consultation

Stakeholder consultation is an essential component of scoping review methodology.27 This stage focuses on the development of a plan to consult with stakeholders to help identify potential studies to include in the review, interpretation of research findings and the dissemination of these findings. We propose to consult with two stakeholders—one with expertise in simulation training and another who has participated in SBT on one or more research projects. The aim is to integrate the experiences of SBT experts and participants to ensure that the design, conduct and knowledge translation of this scoping review is relevant to the population it involves—researchers and healthcare professionals.

Patient and public involvement

There was no patient or public involvement in the design of this protocol.

Anticipated outcome

The scoping review will synthesise the current state of the literature on EHR-specific SBT based on Gaba’s dimensions and the Institute of Medicine’s EHR functionalities. Anticipated outcomes include (1) mapping of the literature on the use of simulation-based EHR training in healthcare, (2) comparison of EHR functionalities across prior simulation-based EHR training studies and (3) outline areas where further research is needed.

Ethics and dissemination

Since no primary data will be collected, there will be no need for a formal ethical review. To our knowledge, this is the first scoping review to identify and map the evidence for EHR-specific SBT for healthcare professionals.

The strength of this scoping review protocol lies in its in-depth search strategy, elaborate eligibility criteria and clear data extraction plan. This protocol provides a methodologically rigorous template for future scoping review studies for identifying and mapping early evidence for interventions. Findings from the review will be submitted to relevant journals such as the British Medical Journal, and BMC Medical Informatics and Decision Making. Further, we aim to share our results with relevant key stakeholders including clinicians, health information managers, EHR vendors, policy-makers and healthcare organisations to provide a direction for future researchers seeking to develop and implement EHR-specific SBT.