Prevalence and Nature of Medication Errors and Preventable Adverse Drug Events in Paediatric and Neonatal Intensive Care Settings: A Systematic Review.

INTRODUCTION: Children admitted to paediatric and neonatal intensive care units may be at high risk from medication errors and preventable adverse drug events.
OBJECTIVE: The objective of this systematic review was to review empirical studies examining the prevalence and nature of medication errors and preventable adverse drug events in paediatric and neonatal intensive care units. DATA SOURCES: Seven electronic databases were searched between January 2000 and March 2019. STUDY SELECTION: Quantitative studies that examined medication errors/preventable adverse drug events using direct observation, medication chart review, or a mixture of methods in children ≤ 18 years of age admitted to paediatric or neonatal intensive care units were included. DATA EXTRACTION: Data on study design, detection method used, rates and types of medication errors/preventable adverse drug events, and medication classes involved were extracted.
RESULTS: Thirty-five unique studies were identified for inclusion. In paediatric intensive care units, the median rate of medication errors was 14.6 per 100 medication orders (interquartile range 5.7-48.8%, n = 3) and between 6.4 and 9.1 per 1000 patient-days (n = 2). In neonatal intensive care units, medication error rates ranged from 4 to 35.1 per 1000 patient-days (n = 2) and from 5.5 to 77.9 per 100 medication orders (n = 2). In both settings, prescribing and medication administration errors were found to be the most common medication errors, with dosing errors the most frequently reported error subtype. Preventable adverse drug event rates were reported in three paediatric intensive care unit studies as 2.3 per 100 patients (n = 1) and 21-29 per 1000 patient-days (n = 2). In neonatal intensive care units, preventable adverse drug event rates from three studies were 0.86 per 1000 doses (n = 1) and 0.47-14.38 per 1000 patient-days (n = 2). Anti-infective agents were commonly involved with medication errors/preventable adverse drug events in both settings.
CONCLUSIONS: Medication errors occur frequently in critically ill children admitted to paediatric and neonatal intensive care units and may lead to patient harm. Important targets such as dosing errors and anti-infective medications were identified to guide the development of remedial interventions.

Key Points

Introduction

Patients admitted to intensive care units (ICUs) may be more likely to be affected by medication errors (MEs) and preventable adverse drug events (ADEs)/adverse drug reactions than those admitted to other wards [1]. This may be due to factors related to the ICU environment (e.g. differences in staff workload and pharmacological interventions) and the nature of patients admitted to ICUs (e.g. rapidly changing physiological functions, deranged drug metabolism) [2]. Medication errors in paediatric ICUs (PICUs) have been reported to occur seven times more frequently than other paediatric inpatient units in one UK study that examined 441 MEs in 682 hospitalised children over 2 years [3]. Elsewhere, infants in neonatal ICUs (NICUs) were found to be at higher risk of preventable ADEs than children in other wards using data from two hospitals in the USA [4].

Potential contributory factors behind these events may include: frequent use of unlicensed or off-label medicines in NICUs and PICUs [5, 6], which may be associated with one third of preventable ADEs in hospitalised children. Other related factors may include lack of adequate dosing information for children [7-10]; children in ICUs are also often sedated or may be pre-verbal and therefore unable to prevent errors themselves [11]. There is a need for the use of ‘high-risk’ medications and/or those with narrow therapeutic indices in these settings (including opioids, benzodiazepines and anticoagulants), which may also be a possible related factor [12].

The World Health Organization has made reducing patient harm due to MEs its current global patient safety challenge with the aim of reducing severe harm associated with MEs by 50% within 5 years [13]. Specifically, young children were identified as being at high risk of drug-related preventable harm. To support this global campaign, it is important to examine and understand the burden of MEs and associated preventable ADEs, particularly in patient populations at high risk such as critically ill children admitted to PICUs/NICUs. This provides an opportunity to inform the development and optimisation of safe policies and practices to prevent patient harm.

Earlier systematic reviews have examined the nature and burden of MEs in a specific country [14], investigated non-preventable ADEs (adverse drug reactions) in paediatrics [9, 15, 16], or involved database searches that are now more than 10 years old and are in need of updating [2, 17–25]. Other more recent systematic reviews were not designed for all age groups of critically ill children [7, 26–28], did not focus on both MEs (including different stages of medication use process) and preventable ADEs [27, 29], or assessed errors at the drug administration or prescribing phase only [30-32]. Therefore, this systematic review aims to identify and summarise the available evidence on the global prevalence and nature of both MEs and preventable ADEs in PICUs and NICUs.

Methods

Search Strategy

The search strategy followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement [33]. This systematic review retrieved studies published from January 2000 through March 2019.

Seven electronic databases were searched without language restrictions including: MEDLINE, EMBASE, Cumulative Index to Nursing and Allied Health Literature, International Pharmaceutical Abstracts, Web of Science, Maternity and Infant Care Database, and Scopus. The search terms used fell into four groups to describe related terms to ME/preventable ADE, target population, setting and study design [Table 1 of the Electronic Supplementary Material (ESM)]. We did not search non-English literature databases and the different terms we used in our search strategy were only in English and may not have covered terms in other languages.

To identify relevant studies, EndNote™ X8 was utilised as a reference manager to import citations and also to identify and exclude duplicate citations. The lead author (AA) screened titles followed by abstracts against the study inclusion criteria [34]. Subsequently, full-text papers were assessed by AA to identify potentially relevant studies. During screening, uncertain cases were discussed amongst the research team and agreed by consensus. A hand search was performed on the reference lists of all identified studies and relevant review articles to identify any additional eligible studies. Abstracts from conferences were also included where they provided rates of MEs or preventable ADEs in PICUs/NICUs. When additional data were required in relation to study methods and/or results, authors were contacted by e-mail to provide more detailed information.

Inclusion and Exclusion Criteria

To reflect the population of interest, included studies focused on children from birth to 18 years of age and reported data that were attributable specifically to ICU settings. The review considered all quantitative studies that assessed the prevalence of ME/preventable ADE at any phase of the medication use process, or contained sufficient information to calculate the prevalence rate. Studies examining the impact of interventions on ME/preventable ADE rates were also included if data on the baseline prevalence rates before implementation of the intervention for this systematic review could be extracted.

This systematic review excluded studies only focussing on subtypes of prescribing, dispensing or administration errors, for instance, focussing only on ‘wrong dose’. The review also excluded studies that used an estimated denominator to calculate the prevalence of MEs/preventable ADEs or reporting MEs/preventable ADEs rates for a single or specific class of medication, or specific treatment or patient group with a particular illness. Studies that relied on spontaneous error reporting systems for data collection were also excluded as these are widely known to underestimate the rate of MEs/preventable ADEs [25, 35–39]. However, studies that collected incident report data alongside other methods (e.g. chart review) were included. The review also excluded studies reporting data only on irrational/potentially inappropriate prescribing or non-preventable ADEs/adverse drug reactions.

Data Extraction

Relevant data were extracted from each included study independently by two authors (AA and RK, DMA or AS) using a standardised form. Any disagreements were resolved within the team by consensus. Data were collected on year of publication, country of origin, study type, setting, detection method, definitions of ME/preventable ADE, severity assessment criteria and any methods used for validation of the detected events. Data extraction also included rates of MEs/preventable ADEs and their types, severity and medication classes involved. We also collected data regarding the type of prescribing system (paper based or electronic medication chart) from each of the included studies to compare error rates between the two systems.

Quality Assessment

Assessment criteria established by Allan and Barker [40], which have been used frequently in previous systematic reviews examining MEs [41-44], were adapted to evaluate the quality of each study that met the inclusion criteria of this systematic review. The quality appraisal included the following ten criteria:

Aims/objectives of the study clearly stated.

Definition of what constitutes a ME/preventable ADE.

ME/preventable ADE categories specified.

ME/preventable ADE categories defined.

Presence of a clearly defined denominator.

Data collection method described clearly.

Setting in which study conducted described.

Validity measure in place to confirm the occurrence of ME/preventable ADE.

Reliability measures.

Limitations of study listed.

Two authors (AA and RK, DMA or AS) calculated the quality of each included study independently and consensus was achieved through discussion for any inconsistencies in scoring items.

Data Analysis

Data were summarised descriptively in tables, including prevalence rates for overall ME/preventable ADEs as well as prevalence rates of ME types including prescribing error, and dispensing, transcription and administration errors. Where appropriate, studies were grouped using common denominators (e.g. medication orders or patient-days) and rates presented using medians with interquartile ranges (IQRs). Rates of events were calculated where sufficient information was provided by dividing the total number of MEs/preventable ADEs that occurred by the relevant denominator such as patients, medication orders or administrations and then multiplying by 100.

The most commonly observed drug classes involved with MEs/preventable ADEs in PICUs or NICUs were extracted. Common drugs presented in this systematic review were the frequently reported top three drug classes across studies. The most common ME subtype(s) (e.g. common subtypes of prescribing errors) reported in this systematic review were the most commonly reported error categories reported in each of included study. The median rates with IQRs of prescribing errors in PICU and NICU were calculated based on the type of prescribing system (electronic or paper based) in each ICU type where possible.

Results

Thirty-seven publications were eligible for inclusion in this systematic review including seven conference abstracts, as shown in Fig. 1. All eligible studies were published in English. Two of the included studies that focused on NICUs [45, 46] and two others that included data for both units [4, 47] reported on the same population of patients and were considered as single studies (using the reports that include more relevant information for this systematic review), resulting in a total of 35 unique studies being included.

Fig. 1

Flow diagram of articles included/excluded for the systematic literature review. ADEs adverse drug events, ADRs adverse drug reactions, ICU intensive care unit, MEs medication errors, NICU neonatal intensive care unit, pADEs preventable ADE, PICU paediatric intensive care unit

As the included studies were heterogeneous in setting and design, a meta-analysis could not be performed. For instance, sources of heterogeneity were in event measures such as error type and subtype (e.g. including/excluding dosing error in assessing prescribing errors) examined and denominators used in reporting event rates (e.g. per 100 patients, per 100 medication orders, per 100 or 1000 patient-days, or per 1000 occupied bed day). Clinical heterogeneity was also noted in included studies in specifying different age ranges (neonates/children) for patients admitted to these ICU types or not reporting this basic demographic data.

Summary of Study Characteristics

More than half of the included studies (20/35, 57.1%) were published from January 2010 onwards and the remaining 15 studies (15/35, 42.9%) between January 2000 and December 2009. Eighteen studies (17/35, 48.6%) were conducted in PICUs, and 13 studies (13/35, 37.1%) were conducted in NICUs. Five studies (5/35, 14.3%) were conducted across both ICU types [4, 18, 48–50]. The included PICU studies are summarised in Table 2 of the ESM, NICU studies in Table 3 of the ESM and studies in both ICU types in Table 4 of the ESM. These tables present extracted data from each study regarding country of origin, publication date, study design, detection method(s), setting(s), patient’s age, rates of MEs and preventable ADEs, and severity data.

Six (6/17, 35.3%) PICU studies were conducted in the USA [37, 51–55], and five studies (5/17, 29.4%) were undertaken in the UK [56-60]. The remainder included one study each from the Netherlands [61], Switzerland [20], Egypt [62], Israel [63], Iran [21] and Hong Kong [19]. The NICU studies included three studies (3/13, 23.1%) from the USA [64-66] and two studies from India (2/13, 15.4%) [22, 36]. The remainder included one study each from the UK [67], Spain [68], the Netherlands [69], New Zealand [45], Malaysia [70], Switzerland [25], Brazil [23] and South Africa [24]. The five studies involving both ICU settings were from the USA [4], Japan [50], Morocco [48], Argentina [18] and Malaysia [49].

The majority of studies that focused on one type of ICU were single-center studies [15/17 (88.2%) PICU, 13/13 (100%) NICU] while the combined PICU and NICU studies were almost all multi-centre (4/5, 80%). Many of the included studies were interventional [8/17 (47.1%) PICU, 7/13 (54%) NICU]; however, there was only one interventional study across both units [18]. There was variation in study design, with 11/18 (61.1%) PICU studies, 8/13 (61.5%) NICU and 3/5 (60%) combined settings collecting data prospectively, with the remainder being retrospective or cross-sectional studies.

Medication chart review was the most common method used for ME/preventable ADE detection in PICUs (15/17, 88.2%), in NICUs (10/13, 76.9%) and across both units (4/5, 80%). Pharmacists were the only data collectors in 12/35 (34.3%) studies, with a mixture of healthcare professionals used across the remaining studies. A total of five studies (5/35, 14.3%) did not provide any details on those involved in data collection [24, 53, 57, 59, 61].

The definition of ME/preventable ADE varied across studies (as reported in Tables 5–7 of the ESM). Almost half of the included studies (17/35, 48.6%) used locally developed definitions of ME/preventable ADE, while the remainder used a range of other definitions used previously (e.g. three studies [18, 23, 70] used the standard definition of MEs developed by the American Society of Health-System Pharmacists [71]). Nine studies (9/35, 25.7%) did not provide any operational ME/ADE definitions [22, 37, 57–59, 61, 66–68].

There was variation in the methods used for ensuring the validity (confirming causation) of identified MEs/preventable ADEs. For PICU studies, 11/17 (64.7%) reported a method for reassessment of some or all of the identified cases along with 3/5 (60%) joint studies, while only 4/13 (30.8%) NICU studies reported some mechanism to assure validity. The most common method to validate data across all studies involved a panel of healthcare professionals reassessing some or all detected outcome events (18/35 studies reporting validation method, 51.4%).

Some element of severity or impact assessment was described in 8/17 (47.1%) of PICU studies [19–21, 52–54, 62, 63], 4/5 (80%) of the joint studies [4, 48–50] and 4/13 (30.8%) of NICU studies [36, 45, 64, 69]. Severity assessment methods were variable, with some reporting expert panels convened to assign severity using a scale the researchers either developed internally, adapted from existing definitions used internally (n = 10) or from existing definitions (National Coordinating Council for Medication Error Reporting and Prevention (n = 5) [72], American Society of Health-System Pharmacists criteria (n = 1) [73]) being reported.

After applying the quality assessment criteria as shown in Supplemental Table 8, only six studies of the 35 included studies (17.1%) fulfilled all ten criteria and were considered as high-quality studies (Table 8 of the ESM) [48, 51, 53–55, 59]. Six studies met nine criteria, ten met eight criteria [4, 45, 49, 50, 52, 69], four met seven criteria [19, 60, 62, 70], two met six criteria [58, 68] and three met five criteria [57, 61, 67]. The remaining studies met less than five criteria [22, 37, 59, 66].

The data collection method and denominator used were described in all included studies. Nine of the 35 included studies (25.7%) did not provided any definition for MEs/preventable ADEs. Six studies did not specify categories of MEs/preventable ADEs and more than half of the studies (18/35, 51.4%) did not define ME categories. Many of the included studies did not describe any validity measures to confirm the occurrence of ME/preventable ADE (18/35, 51.4%) and did not assess inter-rater reliability (25/35, 71.4%).

Prevalence and Nature of Medication Errors and Preventable Adverse Drug Events in Paediatric Intensive Care Units

Data regarding rates and common types of MEs/preventable ADE rates in PICUs were provided in 21 (21/35, 60%) of the included studies (Table 1). The overall ME rate in PICUs was reported in five studies (5/21, 23.8%); three used medication orders as a denominator with a median prevalence of 14.6 per 100 medication orders (IQR 5.7–48.8) [4, 21, 52] and the remaining two studies, one which was rated as high quality [48], used patient-days as a denominator with the ME rate ranging from 6.4 to 9.1 per 1000 patient-days [48, 50]. Errors in prescribing and drug administration were the most commonly reported types of MEs in PICUs across all five studies.

Table 1

Rates and common types of medication errors (MEs) and preventable adverse drug events (ADEs) in paediatric intensive care units (PICUs)

PICU	Rate		Common typesc
	Same denominatora	Different denominatorsb
MEs	Median: 14.6 [IQR 5.7–48.8] (n = 3) [4, 21, 52] (Denominator: per 100 medication orders)		PEs (n = 3) MAEs (n = 2)
	Range: 6.4–9.1 per 1000 patient-days (n = 2) [48, 50]
PEs	Overall median: 13.25 [IQR 9.5–29.35] (n = 12) [18–21, 49, 51, 53, 57, 59–61, 63] (denominator: per 100 medication orders) PICUs using paper medication charts Median: 13 [IQR 10.9–37.4] per 100 medication orders (n = 6) [18–20, 51, 57, 60] PICUs using electronic medication charts Range: 8.3–27.1 per 100 medication orders (n = 2) [49, 53]	78.1% of total OEsd [62]	Dosing errors (n = 9) Documentation errors (n = 5)
		892 errors per 1000 PICU OBDsd [56]
		12.4 errors per patientd,e [58]
Dispensing errors	0.78 per 100 medication ordersd [21]
Transcription errors	4.88 per 100 medication ordersd [21]
MAEs		28.9 per 100 medication ordersd [21]	Wrong time or route of administration (n = 3)
		8.2 per 100 administrationsd [18]
Preventable ADEs	21–29 preventable ADEs per 1000 patient-dayse (n = 2) [54, 55]	2.3 preventable ADEs per 100 patientd,e [37]

IQR interquartile range, MAEs medication administration errors, OBDs observed occupied bed days, OEs opportunities for errors, PEs prescribing errors

aRange of rates or median of MEs/preventable ADEs rates and IQRs were calculated

bRange of rates or median rates of MEs/preventable ADEs and IQRs could not be calculated because of different denominators used and each rate was reported by only one study

cFrequently reported most common types across all included PICU studies

dOnly one study provided the event rate

eSelf-calculated

Prescribing errors were the most common ME type examined in PICUs. Sixteen studies (15/21, 71.4%) presented rates of prescribing errors; three used different denominators and further analysis could not be performed [56, 58, 62] with the remaining 12 studies (two of which were rated as high quality [51, 53]) using medication orders as the denominator yielding a median rate of 13.25 (IQR 9.5–29.35) per 100 medication orders. Six studies out of these 12 studies were conducted in PICUs that utilised paper-based medication chart systems with a median rate of prescribing errors calculated as 13 per 100 medication orders (IQR 10.9–37.4) [18–20, 51, 57, 60]. Two studies (2/12) assessed prescribing errors in PICUs using electronic prescribing systems and the rate of error ranged from 8.3 to 27.1 per 100 medication orders [49, 53]. The remaining four studies did not describe how their prescribing systems functioned [21, 59, 61, 63]. Dosing and documentation errors were the most frequently reported prescribing error subtypes.

One study presented rates of dispensing and transcription errors (0.78 and 4.88 per 100 orders, respectively) [21]. Two studies reported rates of medication administration errors using two different denominators [18, 21]; these rates were 28.9 per 100 orders and 8.2 per 100 drug administrations, with wrong time or wrong route errors being commonly reported medication administration errors.

A total of ten out of the 21 studies reported ME severity data in PICUs using different scales [19–21, 49, 50, 52, 53, 57, 62, 63], which could not be grouped into main categories to allow comparison between studies. Therefore, severity data of each study were summarised in Tables 2–4 of the ESM.

Three studies originating from the USA presented overall preventable ADE rates [37, 54, 55]. In two of these studies, which were rated to be of high quality, preventable ADEs ranged from 21 to 29 per 1000 patient-days [54, 55]. One of these studies reported a 4% increase in the risk of preventable ADE for each additional 1-year increase in age [54]. The rate of preventable ADEs in the remaining study was 2.3 per 100 patients [37].

The severity of harm from preventable ADEs was assessed in two studies [37, 54]. The majority of events in one study by Agarwal et al. were assigned a low level of severity using the National Coordinating Council for Medication Error Reporting and Prevention Scale [72]. Larsen et al. [37] in the other study categorised all detected harms as minor, but did not describe the assessment scale used. The most common drug classes associated with MEs/preventable ADEs in PICUs were reported in four studies (4/21, 19.04%) (Table 2) and involved anti-infective agents (n = 4), cardiovascular agents (n = 3), nervous system agents such as sedatives (n = 2), intravenous fluids (n = 1), respiratory agents (n = 1) and diuretics (n = 1) [19, 49, 52, 62].

Table 2

Common drug classes associated with medication errors and preventable adverse drug events in neonatal intensive care units (NICUs) and paediatric intensive care units (PICUs)

Setting	Author (year)	Common drug classes
PICU	Ewig et al. (2017) [19]	Anti-infective agents
		Cardiovascular agents
		Intravenous fluids
	Khoo et al. (2017) [49]	Anti-infective agents
		Nervous system agents
		Diuretics
	Alagha et al. (2011) [62]	Anti-infective agents
		Respiratory agents
		Cardiovascular agents
	Buckley et al. (2007) [52]	Anti-infective agents
		Nervous system agents
		Cardiovascular agents
NICU	Khoo et al. (2017) [49]	Anti-infective agents
		Folates
		Multi-vitamins
	Palmero et al. (2015) [25]	Anti-infective agents
		Intravenous fluids
		Respiratory agents
	Machado et al. (2015) [23]	Anti-infective agents
		Nervous system agents
		Cardiovascular agents

Prevalence and Nature of Medication Errors and Preventable Adverse Drug Events in Neonatal Intensive Care Units

Seventeen studies (17/35, 48.6%) provided data from NICUs to calculate the rates of MEs and preventable ADEs. Table 3 shows the rates and frequently occurring ME types as well as the rates of preventable ADEs.

Table 3

Rates and common types of medication errors (MEs) and preventable adverse drug events (ADEs) in neonatal intensive care units (NICUs)

NICU	Rate		Common typesc
	Same denominatora	Different denominatorsb
MEs	Range: 5.5–77.9 per 100 medication orders (n = 2) [4, 24]	69.5 MEs per 1000 dosese [64]	PEs (n = 6) MAEs (n = 5)
	Range: 4–35.1 per 1000 patient-days (n = 2) [48, 50]	26.4 per 100 case recordsd,e [22]
PEs	Overall median: 14.9 [IQR 4.25–29.9] (n = 6) [18, 25, 49, 66–68] (denominator: per 100 medication orders) NICUs using paper medication charts Median: 28.9 per 100 medication error [IQR 22.5–32.8] (n = 3) [18, 25, 68] NICUs using electronic medication charts 7.3 per 100 medication error (n = 1) [49]	43.5% of total prescribed drugse [23]	Dosing errors (n = 10) Absence of administration route or wrong diluent (n = 6)
		8.5% of total OEse [65]
Prescribing and dispensing errors	0.7 per patiente [36]		Dosing errors (n = 1)
MAEs	Median: 31.4 [IQR 8.2–84.8] (n = 3) [18, 69, 70] (denominator: per 100 administrations)		Dosing errors or omissions (n = 3) Wrong time (n = 2) Wrong rate (n = 2)
Preventable ADEs	Range: 0.47–14.38 per 1000 patient-days (n = 2) [45, 50]	0.86 preventable ADEs per 1000 dosese [64]

IQR interquartile range, MAEs medication administration errors, OEs opportunities for errors, PEs prescribing errors

aRange of rates or median of MEs/preventable ADEs rates and IQRs were calculated

bRange of rates or median rates of MEs/preventable ADEs and IQRs could not be calculated because of different denominators used and each rate was reported by only one study

cFrequently reported most common types across all included NICU studies

dSelf-calculated

eOnly one study provided the event rate

The overall rates of MEs in NICUs ranged from 4 to 35.1 per 1000 patient-days (two studies [48, 50], one was rated as high quality [48]) and from 5.5 to 77.9 per 100 medication orders (two studies) [4, 24]. A further two studies, one was rated to be of high quality [64], reported ME rates using different denominators; namely, 69.5 MEs per 1000 doses [64] and 26.4 per 100 case records [22]. Prescribing errors and medication administration errors were the most commonly reported ME types in NICUs. The severity of detected MEs in these studies was either not addressed [22, 24, 48] or addressed through preventable/potential ADEs; two preventable ADEs out of 148 MEs [50], 46 potential ADEs per 100 admissions [4] and 0.86 preventable ADEs per 1000 doses [64].

Six out of eight studies reporting prescribing error rates provided rates per medication orders with a median of 14.9% (IQR 4.25–29.9). Three of these six studies examined NICUs using paper-based prescribing systems and the median error rate was calculated as 28.9 per 100 medication orders (IQR 22.5–32.8) [18, 25, 68]. Neonatal ICUs with electronic medication chart systems were examined only in one study where the prescribing error rate was 7.3 per 100 medication orders [49]. The remaining two studies (2/6) did not describe their NICU prescribing systems [66, 67]. Dosing errors were the prevalent prescribing errors subtype [18, 25, 49, 66–68]. Only one of these studies reported prescribing error severity data finding that most errors were not significant. One study reported a combined rate of prescribing errors and dispensing errors, which was 0.7 per patient with no significant harm and dosing errors representing 48.1% of errors [36].

The median prevalence of medication administration errors was 31.4 per 100 administrations (IQR 8.2–84.8) across three studies; with severity addressed in only one study, which found that most observed errors were of moderate severity [18, 69, 70]. Commonly reported medication administration errors were dosing errors, omitted doses, wrong time and wrong administration rate errors.

Three studies (3/17, 17.6%) reported rates of preventable ADEs in NICUs across different countries [45, 50, 64]. Two of these studies used the same denominator (per 1000 patient-days) and preventable ADE rates ranged from 0.47 to 14.38 [45, 50]. These studies classified preventable ADE severity using different scales. One study [50] categorised all preventable ADEs as serious and another [45] found 14.3% of preventable ADEs resulted in persistent disability. The third study reported a preventable ADE rate of 0.86 per 1000 administered doses and no data were provided regarding the severity of these events [64]. Only three studies (3/17, 17.6%) reported the commonly observed drug classes associated with MEs/preventable ADEs in NICUs (Table 2) including anti-infective agents (n = 3), nervous system agents (n = 1), intravenous fluids (n = 1), cardiovascular agents (n = 1), respiratory agents (n = 1), folates (n = 1) and multi-vitamins (n = 1) [23, 25, 49].

Discussion

We present the findings from a comprehensive systematic review examining the frequency and nature of both MEs and preventable ADEs in critically ill neonates and children. We found that MEs are a common problem in PICUs (14.6 per 100 medication orders and 6.4–9.1 per 1000 patient-days) and NICUs (ranging from 4 to 35.1 per 1000 patient-days and from 5.5 to 77.9 per 100 medication orders). Medication error rates were reported in few studies that examined all stages of medication use process in PICUs (five studies) and NICUs (four studies). Anti-infective agents were found to be commonly associated with MEs/preventable ADEs across both PICUs and NICUs. Errors in prescribing and drug administration were found to be frequent types of MEs and dosing errors were a frequently reported error subtype in both ICU settings.

There are limited published data concerning the frequency and nature of harms due to MEs (preventable ADEs) in PICUs and NICUs and restricted mostly to one country [37, 52, 54, 64], which constitutes an important area for further research as this type of harm contributes to an extended length of hospital stay and additional healthcare costs [74]. In the UK, it was recently estimated that preventable ADEs cost the National Health Service an additional £14.8 million per year [75]. Understanding preventable harm has greater significance for identifying key challenges to improve patient care. This would enable the development of successful remedial interventions to reduce harmful MEs and associated costs, ultimately supporting the current World Health Organization’s safety global campaign to improve patient safety [13].

In most of the included studies in our review, dosing errors were reported as being a common subtype of MEs in PICUs and NICUs. This is similar to the findings of other systematic reviews conducted in the paediatric population [7, 14, 44, 76] and our findings therefore reinforce recommendations that have previously been made to prioritise interventions designed to reduce dosing errors in clinical practice [44, 77]. A previous systematic review published in 2004 demonstrated that some healthcare professionals were not competent in calculating correct doses (e.g. weight based) in paediatric patients, which could result in ten-fold errors [78]. Prevalent dosing errors also imply the use of off-label and unlicensed drugs in children as a common associated factor [79]. Safe and effective dosing of these medications has been reported to be difficult because of variable scientific recommendations and a lack of appropriate formulations for children [80, 81] and may thus lead to errors in prescribed/administered doses and ultimately harmful events [82, 83].

There are systematic reviews that have evaluated the effectiveness of existing interventions to reduce MEs in children; one focusing on PICUs published in 2014 [84], two on paediatrics including ICUs published in 2014 [85] and 2015 [86] and one on neonatal settings involving NICUs published in 2018 [87]. These reviews found that implementing technical innovations (e.g. computerised physician order entry or clinical decision support systems) might help in reducing MEs. However, all these reviews concluded that the evidence remains limited, with methodological variations identified across the reviewed studies, which prevented a more thorough assessment.

We compared error rates between ICUs using paper-based and electronic prescribing systems in PICUs and NICUs; however, available data on ICUs that use electronic prescribing systems were provided only by small number of studies (only two studies in PICUs and one in a NICU). We identified four studies with a pre-post-intervention design [51, 60, 63, 65], one of which was rated as high quality [51], that assessed the impact of introducing electronic medication charts on prescribing errors in paper-based ICUs. All these studies found a significant reduction in prescribing error rates (e.g. from 30.1 to 0.2 [51] and from 8.24 to 1.4 [63] per 100 medication orders) following the introduction of electronic prescribing systems.

Issues with study heterogeneity were also identified in our systematic review. There were marked differences in definitions and research methodologies used across studies in detecting MEs/preventable ADEs, which likely contributed to a wide variability in reported rates and made direct comparisons between different studies challenging. For instance, the highest overall ME rate (77.9% of medication orders) was reported in a NICU study [24], which employed a chart review for prescribing errors and direct observation of nurses preparing and administering medications for medication administration errors. This detailed two-stage screening could have resulted in an overall high rate of MEs. In addition, direct observation of nursing practice is known to identify more medication administration errors than other approaches such as reviewing medication administration records [88]. Similar issues in ME research have been noted in other systematic reviews [2, 7, 32].

Furthermore, the definitional variation may have an important impact on effect estimates. One study defined prescribing error according to the Institute of Medicine definition including any errors during the prescribing or transcribing phases in physicians’ orders containing pharmacological (e.g. medications) and non-pharmacological (e.g. nutritional supplements) items [19]. The broad definition used in this study that encapsulated transcription could have had influenced the rate of prescribing error (59.4%), which was higher than the rate reported in another study (8.24%) using a more specific prescribing error definition “incomplete or illegible prescription that required additional clarification to be executed” [63].

Lower prescribing error rates were also found in retrospective studies [36, 59, 63, 65, 66]. The limitations of this approach (such as risk of poor-quality documentation and missing data) are acknowledged [89]. This may lead to low accuracy of detection and underestimation of the prevailing error rate. Prospectively designed studies with pharmacists collecting data are associated with higher rates of prescribing errors [19, 25, 51, 61, 68]. Subsequently, this approach has been found to be sensitive in detecting MEs [2, 90].

Therefore, we highlight a need for researchers in the field to work towards greater standardisation to help ensure future ME and preventable ADE studies in critically ill children utilise more consistent study designs and definitions. This would facilitate greater comparability of studies and aligns with a call for greater standardisation that have been made in other ME/ADE systematic reviews [42, 91, 92].

Another possible reason for the variability of outcome rates may be related to differences in healthcare systems between countries, hospitals or even medical teams on hospital wards [93, 94]. For example, two studies conducted in Iran and the USA using the same study design, non-electronic prescribing systems, over a similar period time with a similar sample size reported notable differences in ME rates of 48.8% and 14.6%, respectively [21, 52]. Medication safety issues may require nationally coordinated interventions in which policymakers aim to create safer environments for patient care rather than efforts by individual teams [95].

Few studies included a robust assessment of severity of MEs and preventable ADEs in PICU and NICU settings. In the small number of studies that considered severity, the variation in scales used (e.g. using a panel of medical experts [62], criteria set out by the National Coordinating Council for Medication Error Reporting and Prevention [64] or the American Society of Health-System Pharmacists criteria [36]) made comparisons across these studies impractical. This also hindered judgement as to which patient group(s), stage(s) in the medication process or particular medication class(es) may be more vulnerable to preventable ADEs. Consequently, we recommend that future studies use a standardised approach to assess the severity of preventable medication-related events to help identify targets for serious adverse events.

Data regarding medications commonly associated with MEs/preventable ADEs were reported in four PICU and three NICU studies. The commonly reported prevalent drugs implicated in MEs/preventable ADEs in both settings were medicines used to treat infections followed by cardiovascular and nervous system agents as less frequently reported drug classes. This may be because anti-infective agents are more frequently prescribed in critically ill patients. Previous systematic reviews on paediatric patients have also reported that antibiotics were the most common drug class associated with MEs [44] and antimicrobials with medication administration errors [32], which suggests that future efforts in reducing MEs/preventable ADEs in critically ill paediatric patients could target this group of medications.

Among all phases of the medication use process, prescribing was examined more frequently in both settings with comparatively little focus on the drug dispensing and administration phases. However, in studies examining the whole medication use process, MEs were commonly associated with both prescribing and administration phases. Thus, we recommend the frequency, type, and severity of medication administration errors and dispensing errors as a priority area for further research to effectively guide efforts to reduce such events across both ICU settings. A systematic review published in 2015, which assessed the effectiveness of existing interventions to reduce medication administration errors in hospitalised children including PICU patients, found that the true impact of available approaches remains limited [32]. The review concluded that medication administration is a multi-faceted process, which includes, for example, preparation technique and the correct patient, drug and dose, which may need better understanding to target the most susceptible stage to errors.

It is apparent that MEs/preventable ADEs in patients admitted to PICUs/NICUs were more frequently examined in the USA (10/35, 28.6% of included studies) than other countries. There is still little focus on these patient populations in the rest of the world. For example, only three of included studies were undertaken in Africa and none from Australia. More work is needed in individual countries to understand the frequency and nature of MEs/preventable ADEs in PICUs and NICUs to support the current World Health Organization’s call to reduce these events.

The focus of future studies should also include investigating the underlying causes of prescribing errors. This is because high rates of such errors were found in a number of studies conducted across both ICU settings, with little change between recent studies and those 10 years previously [19, 25, 53, 68]. Paediatric and neonatal ICUs are complex and dynamic environments with a strong humanistic element. A recent qualitative study explored causative factors in prescribing errors in PICUs and identified that systems in PICUs to support safe medication practice were ineffective [96]. This study supported the findings of Manias et al.’s review, which also identified limited effectiveness of interventions to mitigate ME in PICUs [84]. The complex interplay of systems also means that the consideration of prescribing errors, dispensing errors and medication administration errors as separate processes and phenomena may be misleading and lead to tokenistic interpretation of the causes. Therefore, a multi-system approach (based on precise estimates that used robust definitions) to understanding the underlying causes of MEs in critically ill children may be an area for investigation. These recommendations would support efforts in the development of effective interventional approaches and successful prioritisation of their implementation.

The key strength of this review is the inclusion of both MEs and related preventable ADEs together providing a more complete overview of the risks associated with medication use in children’s intensive care settings. This will help to better target attention towards interventions that might reduce preventable events and associated harm.

The limitations of this systematic review include the limited ability to meta-analyse data across studies owing to marked levels of observed heterogeneity across included studies. We acknowledge that there might be some preventive policies/interventions already implemented in specific study settings to reduce MEs in our included studies [97, 98], which may have influenced the rates of MEs, including interventional research studies where we only extracted baseline rates. Unfortunately, detailed data on such policies/interventions were not routinely reported. In addition, this systematic review did not assess quantitatively the impact of differences in ME definitions, error detection methods and hospital context (differences in units examined) on the error rates across included studies.

Because of the marked variations in study methods we observed between included studies, we could not directly compare findings between high- and low-quality studies. In addition, several conference abstracts were included in our systematic review that only provided basic information, hence limiting our ability to assess study quality. High-quality research in the future is needed to acquire a better estimate of the prevalence and nature of these events in children’s intensive care settings.

Only English language publications were included in this systematic review. The search terms we used were limited to English and therefore terms used in other languages may have been missed.

Conclusions

To our knowledge, this is the first systematic review exploring the prevalence and nature of both MEs and preventable ADEs across neonatal and paediatric intensive care settings worldwide. We identified 35 unique studies and found that preventable medication-related events are an enduring threat to the safety of children in intensive care. We have identified potentially important targets such as dosing errors and anti-infective medications that could help set an improvement agenda for clinicians, healthcare leaders and researchers. However, we also acknowledge the pressing need for standardisation of study design and definitions owing to high levels of observed heterogeneity and we recognise a need for future research to explore issues such as medication administration errors and preventable ADEs in more detail as there is little attention to these in the current body of evidence.

Below is the link to the electronic supplementary material.

Supplementary material 1 (DOCX 20 kb)

Supplementary material 2 (DOCX 60 kb)

Supplementary material 3 (DOCX 63 kb)

Supplementary material 4 (DOCX 47 kb)

Medication errors (MEs) are common and persistent problems that may pose significant risk to critically ill children admitted to paediatric and neonatal intensive care units.

Prescribing and medication administration errors were the common types of MEs and dosing errors were the most frequent ME subtype in both paediatric and neonatal intensive care unit settings.

Anti-infective medications were the commonly reported drug class associated with MEs/preventable adverse drug events across both intensive care unit types.

Further research is needed to examine medication administration errors and preventable adverse drug events in children’s intensive care settings.