Does a Dose Calculator as an Add-On to a Web-Based Paediatric Formulary Reduce Calculation Errors in Paediatric Dosing? A Non-Randomized Controlled Study.

OBJECTIVES: The structured digital dosing guidelines of the web-based Dutch Paediatric Formulary provided the opportunity to develop an integrated paediatric dose calculator. In a simulated setting, we tested the ability of this calculator to reduce calculation errors.
METHODS: Volunteer healthcare professionals were allocated to one of two groups, manual calculation versus the use of the dose calculator. Professionals in both groups were given access to a web-based questionnaire with 14 patient cases for which doses had to be calculated. The effect of group allocation on the probability of making a calculation error was determined using generalized estimated equations (GEE) logistic regression analysis. The causes of all the erroneous calculations were evaluated.
RESULTS: Seventy-seven healthcare professionals completed the web-based questionnaire: thirty-seven were allocated to the manual group and 40 to the calculator group. Use of the dose calculator resulted in an estimated mean probability of a calculation error of 24.4% (95% CI 16.3-34.8) versus 39.0% (95% CI 32.4-46.1) with use of manual calculation. The mean difference of probability of calculation error between groups was 14.6% (95% CI 3.1-26.2; p = 0.013). In a secondary analysis where calculation error was defined as a 10% or greater deviation from the correct answer, the corresponding figures were 19.5% (95% CI 13-28.2) versus 26.5% (95% CI 21.6-32.1) with a mean difference of 7% between groups (95% CI 2.2-16.3; p = 0.137). Juxtaposition, typo/transcription errors and non-specified errors were more frequent as cause of error in the calculator group; exceeding the maximum dose and wrong correction for age were more frequent in the manual group. The percentage of tenfold errors was 3.1% in the manual group and 3.7% in the calculator group.
CONCLUSIONS: Our study shows that the use of a dose calculator as an add-on to a web-based paediatric formulary can reduce calculation errors. Furthermore, it shows that technologies may introduce new errors through transcription errors and wrongly selecting parameters from drop-down lists. Therefore, dosing calculators should be developed and used with special attention for selection and transcription errors.

Key Points

Introduction

Among all paediatric prescribing errors, dosing errors are the most common, accounting for 2.2–36.5% of all prescribing errors [1-7]. Incorrect dosing is thought to be caused by the complexity of paediatric prescribing, as nearly all drugs have varying dose recommendations based on the child’s age, weight or body surface area [8]. Furthermore, drugs are diluted and manipulated to meet the need for small doses. In addition, clear dosing guidance is lacking for off-label drugs [5-8]. Of all dosing errors, calculation errors are the most common in neonatal and paediatric patients. Davis et al. and Kirk et al. report error rates varying from 8.4 to 28.2% [4, 9]. Studies by Rowe et al. and Glover and Sussmane confirm that healthcare professionals have difficulties calculating the correct dose [10, 11]. Kaushal et al. show that 34% of all potential adverse drug events (ADEs) in paediatric inpatients involve incorrect dosing [6]. Therefore, there is an urgent need to reduce the number of calculating errors.

The availability of digitized paediatric dosing guidelines of the Dutch Paediatric Formulary [12] provided the opportunity to develop a website-integrated dose calculator that combines dosing recommendations of the formulary with patient variables. A manuscript describing the development of the calculator has been accepted for publication [13]. In a simulated setting, we tested the ability of the calculator to reduce calculation errors.

Methods

Study Setting

This performance study was designed as a non-randomized, comparative simulation trial comparing the odds ratios for calculation errors in a standardized calculation assessment in a control group versus an intervention group.

Participants

All users of the Dutch paediatric formulary were invited through the formulary’s homepage to voluntarily participate in a calculation assessment. Participants were categorized by their profession—physicians, pharmacists or other professionals (nurses/pharmacy technicians)—in order of date of registration.

Personal data other than age, profession and IP address were not collected. The simulation study was not subject to Institutional Review Board approval according to the Dutch Medical Research Involving Human Subjects Act (WMO).

Sample Size Calculation and Group Allocation

Although participants were not strictly randomly allocated to one of the groups, we applied equation 4 for cluster randomized trials described by Hayes and Bennett [14] to calculate the power of the study, in order to address the multiple dichotomous outcomes of each respondent. This calculation resulted in a minimum sample size of 34 per group to show a 50% reduction in overall error rate with a power of 80% and a significance level of 0.05, using a coefficient of variation of 0.6 when each subject performed 23 calculations. Based on the study of Rowe et al. we estimated the a priori error rate at 10% [10].

Two hundred and thirty-eight users registered to participate. Numbers 1–25 of each profession group were allocated to the control group; numbers 26–50 of each profession group were allocated to the calculator group. Numbers from 51 onwards of each group (88 out of 238) were excused. Anticipating a 50% non-response, we invited 75 participants per study group (25 physicians, 25 pharmacists and 25 other professionals) to achieve a minimal inclusion of 34 participants per study group.

Intervention

The control group was instructed to perform a calculation assessment with conventional tools (i.e. a pocket calculator) and the dosing recommendations as listed on the Dutch Paediatric Formulary website. The intervention group was instructed to perform the same calculation assessment using the website-integrated dose calculator of the Dutch Paediatric Formulary.

Calculation Assessment

The calculation assessment consisted of 14 case descriptions with either one or two calculations per case (23 calculation items in total). The cases covered the paediatric age range from neonate to adolescent; the selected drugs were regularly used drugs and different calculation challenges were presented: dosing based on milligrams per kilogram, on milligram per square meter of body surface area, on International Units (IU) per kilogram, respecting the maximum dose and using weight of a premature neonate in grams instead of kilograms. The control group and intervention group each completed the same assessment. The cases were presented in a random order. Participants were instructed to always use the lowest dose of a dose range and to provide the calculation result in the specified dose unit. Specific instructions on rounding were not provided. The calculation assessment was designed as an online questionnaire using the Survey Gizmo online platform. The survey could be completed at any place and time at the discretion of the respondent. To mimic daily practices with stressful circumstances and to prevent meticulous (re-)calculations, the time for the calculating tasks was limited to 2 min per case. If a calculation was not completed within 2 min, the participant was automatically directed to the next question. Participants in the calculator group were instructed to read the online instruction manual or watch the online instruction tutorial on the use of the calculator before starting the assessment. Participants in both groups were advised to open two different web browsers for the purpose of completing the assessment in Survey Gizmo and simultaneously consulting the Paediatric Formulary website. Participants were informed that the Survey Gizmo assessment could not be interrupted and completed afterwards. Multiple completions were identified by tracking of the IP address. To get accustomed to the procedure, the assessment started with a dummy question.

The control group completed the assessment prior to the online launch of the calculator (May–June 2015). The intervention group completed the assessment after the launch of the calculator on September 7, 2015 (September 25, 2015–February 04, 2016).

Data Analysis and Statistics

Survey results were included in the data analyses if six calculation items or more had been completed. Of duplicate IP addresses, the survey with the highest number of completed calculation items was included in the analysis.

The primary outcome parameter was a dichotomous variable indicating correct or erroneous calculation outcome. An erroneous calculation was defined as any deviation from the correct outcome plus or minus 0.05 units of dosing to account for minor rounding errors. Calculation outcomes not provided within the set time frame of 2 min qualified as missing data in the dataset. Any exceedance of the absolute maximum dose was considered to be an erroneous calculation.

The definition of error for the primary outcome was very strict and did not reflect clinical practice, where a 10% deviation from the calculated dose is usually accepted and often even needed to enable administration of specific formulations. Therefore, we performed a secondary analysis addressing the clinical relevance of the error. In this analysis, a calculation error was defined as a ≥ 10% deviation from the correct outcome.

The primary and secondary outcomes were analysed using generalized estimated equations (GEE) logistic regression analysis (i.e. a GEE model with a binomial error distribution and a logit link) to account for missing data and within-subject correlations. The independent variables in the GEE model were the calculation item (to account for the difficulty of the calculation), the group (manual or calculator) and the interaction effect between the independent variables. The results are reported as (a) the estimated marginal mean probabilities of a calculation error and (b) the odds ratios (ORs) for the correct outcome obtained with the website-integrated calculator compared with that obtained with manual calculation. The estimated marginal mean probabilities are the predicted probabilities of a calculation error adjusted for the effects of covariates and missing data. Due to the presence of an interaction effect, the ORs of group (calculator versus manual calculation) vary by calculation item.

Demographic data were analysed using percentages for categorical data (profession) and median and interquartile ranges for age. For each clinically relevant error, we tried to reproduce the erroneous calculation outcome by manual recalculation, thus retrieving the cause of the error. All causes for error were described and scored using percentages for categorical data. Furthermore, the number of tenfold errors per group and per cause of error were evaluated. Statistical analysis on the cause of errors was not performed, due to the limited numbers per cause of error.

IBM SPSS version 21 was used for all analyses.

Results

Participants and Assessment

The participant groups were similar in age and profession (Table 1). Participants who did not report their profession were listed as profession ‘unknown’.

Table 1

Characteristics of the study population

Group	Manual calculation	Calculator
Sample size, n	37	40
Age in years, median (IQR)	40 (16)	37 (14)
Profession, n (%)
Physician	11 (30)	7 (17.5)
Pharmacist	13 (35)	14 (35)
Pharmacy technicians and nurses	7 (19)	9 (22)
Unknown	6 (16)	10 (25)

IQR interquartile range

Reduction of Errors

The estimated mean difference in calculation error between the groups was 14.6% (95% CI 3.1–26.2; p = 0.013). In an analysis taking into account the clinical relevance of the error, the estimated mean difference decreased to 7% (95% CI 2.2–16.3; p = 0.137) (Table 2).

Table 2

Estimated marginal mean probability of a calculation error per group

Definition of correct outcome	Estimated marginal mean probability of a calculation error
	Manual	Calculator	Estimated mean difference between groups
Absolute correct outcome	39.0% (95% CI 32.4–46.1)	24.4% (95% CI 16.3–34.8)	14.6% (95% CI 3.1–26.2; p = 0.013)
Clinically relevant error (10% or greater deviation from the correct answer)	26.5% (95% CI 21.6–32.1)	19.5% (95% CI 13–28.2)	7.0% (95% CI 2.2–16.3; p = 0.137)

CI confidence interval

Due to the presence of an interaction effect, the ORs of the group (calculator versus manual calculation) varied by calculation item, thus representing the difficulty of the calculation item.

The OR for correct outcome when using the website-integrated dose calculator (instead of manual calculation) was statistically significant for eight items (items 1, 4, 8, 11, 12, 18, 19 and 20) (Table 3). These items may be labelled ‘difficult’ or error-prone calculations. Errors in items 1 and 19 were related to exceeding the maximum dose above a pre-specified weight. Items 4, 8, 12, 18 and 19 all required a conversion of a dose from milligrams to millilitres. In item 11, many participants in the manual group (27/31) entered the single dose instead of the requested daily dose. When corrected for clinical relevance (Table 3), the use of the website-integrated dose calculator was associated with significant ORs for items 1, 8, 11, 17 and 19 only. Item 17 (calculation of lactulose dose) shows a significant OR for correct calculation outcome in favour of manual calculation. Item 17 required participants to enter the outcome in milligrams while many participants in the website-integrated dose calculator group entered the outcome in grams, which was the unit of dosing provided by the website-integrated dose calculator.

Table 3

Odds ratios by calculation item for correct outcome using the calculator compared with manual calculation in a generalized estimated equations (GEE) model

Case description	N	Calculation instruction	Absolute correct outcome						Clinically relevant outcome (10% deviation accepted)
			Correct/total (%)c		Odds ratio	95% CIc		p value	Correct/total (%)c		Odds ratio	95% CI		p value
			Calc	Man		Lower	Upper		Calc	Man		Lower	Upper
Agea 13 years, weight 47 kg, underwent a surgical procedure and is in pain. Prescription for oral paracetamol (acetaminophen) QID Recommended dose: 90 mg/kg/day in 4 divided doses, max. 4 g/day and 1 g/dose	1	Daily dose of paracetamol in mg/day	31/35 (89)	22/35 (63)	4.58b	1.32	15.93	0.017	31/35 (89)	22/35 (63)	4.58	1.32	15.93	0.017
	2	Single dose of paracetamol in mg/dose	30/35 (89)	25/34 (74)	2.16	0.64	7.28	0.214	30/35 (89)	25/34 (74)	2.16	0.64	7.28	0.214
Agea 2 years, weight 18.5 kg, has an upper airway infection for which oral amoxicillin TIDc is prescribed Recommended dose: 40–90 mg/kg/day in 2–4 divided doses, max. 3 g/day	3	Daily dose of amoxicillin in mg/day	25/36 (69)	21/33 (64)	1.30	0.48	3.54	0.610	27/36 (75)	24/33 (73)	1.13	0.38	3.30	0.830
	4	Volume per single dose of amoxicillin suspension (25 mg/mL) in mL/dose	18/27 (67)	11/30 (37)	3.46	1.16	10.29	0.026	19/27 (70)	22/30 (73)	0.86	0.27	2.74	0.804
Agea 4 years, weight 15.5 kg, allergic to pollen, for which oral desloratadine once daily is prescribed Recommended dose: 1.25 mg/day in 1 dose	5	Daily dose in mg/day	32/35 (91)	34/36 (94)	0.63	0.10	4.00	0.622	32/35 (91)	34/36 (94)	0.63	0.10	4.00	0.622
	6	Volume per single dose of desloratadine syrup (0.5 mg/mL) in mL/dose	30/33 (91)	34/36 (94)	0.59	0.09	3.76	0.575	30/33 (91)	34/36 (94)	0.59	0.09	3.76	0.575
Agea PNA 2 weeks, weight 3250 g, serious GORD, for which oral ranitidine is prescribed Recommended dose: 5 mg/kg/day in 2 divided doses	7	Daily dose of ranitidine in mg/day	26/34 (76)	20/32 (63)	1.95	0.67	5.67	0.220	28/34 (82)	22/32 (69)	2.12	0.67	6.74	0.202
	8	Volume per single dose of ranitidine syrup (15 mg/mL) in mL/dose	26/30 (87)	16/31 (52)	6.09	1.72	21.63	0.005	26/30 (87)	16/31 (52)	6.09	1.72	21.63	0.005
Agea 11 years, weight 34.5 kg, epilepsy, for which oral phenytoin TID is prescribed Recommended dose: 4–5 mg/kg/day in 2–3 divided doses	9	Daily dose of phenytoin in mg/day	28/39 (72)	23/33 (70)	1.11	0.40	3.06	0.845	31/39 (79)	29/33 (88)	0.53	0.15	1.97	0.346
	10	Single dose phenytoin in mg/dose	24/38 (63)	18/32 (56)	1.33	0.51	3.48	0.557	28/38 (74)	22/32 (69)	1.27	0.45	3.60	0.649
Agea 9 years, weight 32.1 kg; iron deficiency anaemia for which iron supplementation is indicated. Oral ferrous fumarate is prescribed Recommended dose: 9 mg/kg/day in 3 divided doses, max. 600 mg/day and 200 mg/dose	11	Daily dose of ferrous fumarate in mg/day	24/34 (71)	4/31 (13)	16.20	4.49	58.46	< 0.001	32/34 (94)	13/31 (42)	22.15	4.49	109.38	< 0.001
	12	Volume per single dose of ferrous fumarate suspension (20 mg/mL) in mL/dose	26/33 (79)	15/28 (54)	3.22	1.05	9.84	0.040	28/33 (85)	20/28 (71)	2.24	0.64	7.87	0.208
Agea 10 years, weight 38 kg; ADHD for which oral methylphenidate is prescribed. Maintenance dose is given TID Recommended dose: Start 0.3 mg/kg/day in 2 divided doses Maintenance: 0.3–0.6 mg/kg/day in 2–3 divided doses	13	Daily maintenance dose of methylphenidate in mg/day	23/30 (77)	23/34 (68)	1.57	0.52	4.77	0.425	24/30 (80)	25/34 (74)	1.44	0.44	4.66	0.543
	14	Single maintenance dose of methylphenidate in mg/dose	20/28 (71)	14/29 (48)	2.68	0.89	8.02	0.078	20/28 (71)	14/29 (48)	2.68	0.89	8.02	0.078
Agea 11 years, weight 38 kg, height 1.49 m; admitted to ER with anaphylactic reaction to a wasp sting for which prednisolone IV is prescribed Recommended dose: 1 mg/kg/dose, max. 25 mg/dose	15	Volume per single dose of prednisolone IV (25 mg/mL) in mL/dose	24/36 (67)	18/33 (55)	1.67	0.63	4.42	0.304	24/36 (67)	18/33 (55)	1.67	0.63	4.42	0.304
Premature neonate born at 26 weeksa PMA, weight at birth 712 g, current weight 850 g, has an infection for which flucloxacillin IV is prescribed Recommended dose: 75 mg/kg/day in 3 divided doses	16	Volume per single dose of flucloxacillin IV (125 mg/50 mL) in mL/dose	8/16 (50)	12/26 (46)	1.17	0.34	4.06	0.809	10/16 (63)	16/26 (62)	1.04	0.29	3.76	0.950
Agea 2 years, weight 13.2 kg, Constipated for which oral lactulose BID is prescribed Recommended dose: 0.6–2 g/kg/day in 1–2 divided doses, max. 66 g/day	17	Daily dose of lactulose in mg/day	12/33 (36)	18/34 (53)	0.51	0.19	1.35	0.175	14/33 (42)	24/34 (71)	0.31	0.11	0.84	0.022
	18	Volume per single dose of lactulose oral solution (670 mg/mL) in mL/dose	20/28 (71)	9/27 (33)	5.00	1.59	15.72	0.006	21/28 (75)	17/27 (63)	1.76	0.55	5.62	0.337
Agea 10 years, weight 36.5 kg, prophylaxis of thrombotic episode, for which nadroparine is prescribed Recommended dose: 85.5 IU/kg/day in 1 dose, max. 2850 IU/dose	19	Volume per single dose of nadroparin injection (9500 IU/mL) in mL/dose	29/36 (81)	8/35 (23)	13.99	4.46	43.80	< 0.001	29/36 (81)	8/35 (23)	13.99	4.46	43.80	< 0.001
Agea 14 years, weight 52 kg, height 1.64 m, chemotherapy-related nausea for which prophylactic ondansetron IV is prescribed Recommended dose: 5–8 mg/m2/dose PRN 3 times daily, max. 16 mg/dose	20	Volume per single dose of ondansetron IV (2 mg/mL) in mL/dose	17/33 (52)	6/27 (22)	3.72	1.19	11.57	0.023	22/33 (67)	23/27 (85)	0.35	0.10	1.26	0.107
Agea 4 months, weight 6.5 kg, congenital hypothyroidism for which levothyroxine once daily is prescribed Recommended dose: 6–10 µg/kg/day in 1 dose	21	Volume per single dose of levothyroxine oral solution (25 µg/5 mL) in mL/dose	21/30 (70)	19/35 (54)	1.96	0.70	5.48	0.197	23/30 (77)	25/35 (71)	1.31	0.43	4.03	0.632
Agea 7 years, weight 24 kg. Admitted to OR, where remifentanil is administered as a continuous infusion Recommended dose: Induction: 0.5–1 µg/kg/dose bolus Maintenance: 0.1–2 µg/kg/min continuous infusion	22	Initial single dose of remifentanil in µg/dose	33/36 (92)	34/35 (97)	0.32	0.03	3.27	0.339	34/36 (94)	34/35 (97)	0.50	0.04	5.78	0.579
	23	Maintenance dose of remifentanil continuous infusion in µg/min	29/36 (81)	30/35 (86)	0.69	0.20	2.42	0.563	29/36 (81)	31/35 (89)	0.53	0.18	2.96	0.356

ADHD attention-deficit hyperactivity disorder, BID bis in die, two times a day, Calc calculation group, CI confidence interval, ER emergency room, GORD gastro-oesophageal reflux disease/disorder, IU international units, IV intravenous, Man manual group, OR operating room, PMA post-menstrual age, PNA post-natal age, PRN pro re nata, as needed, QID quarter in die, four times a day, TID ter in die, three times a day

aInstead of the actual age in years, the date of birth corresponding to the age in years was provided to the participants

bBold text highlights the significant results

cCorrect/total (%): number of participants with calculations and total number of participants that performed the calculation

Qualitative Aspects of the Calculation Errors

Missing data comprised 12.9% of the calculations in the manual group and 18.4% of the calculations in the calculator group; these had been completed within the set time limit of 2 min. Eleven respondents in the manual group completed all 23 calculation items versus nine respondents in the calculator group (Table 4).

Table 4

Comparison of completion rate of calculations per group

Group	Manual	Calculator
Total number of calculations performed	851	920
Number of correct calculations (clinically relevant)	518 (60.9%)	592 (64.3%)
Number of erroneous calculations (clinically relevant)	223 (26.2%)	159 (17.2%)
Number of tenfold errors (clinically relevant)	26 (3.1%)	34 (3.7%)
Number of missing calculations	110 (12.9%)	169 (18.4%)
Complete set of 23 calculation items	11 respondents	9 respondents
Number of calculations completed by respondents	Median 22 items (min. 6, max. 23; IQR 3)	Median 21 items (min. 6, max. 23; IQR 4)

IQR interquartile range

Causes of the erroneous calculations are presented in Table 5. Participants in both groups were likely to act by their clinical experience rather than instructions provided (‘incompliant with instructions’). For example, all respondents were instructed to always select the lowest dose of a dose range. For the amoxicillin case (Table 3, items 3 and 4), this would imply selection of 40 mg/kg/day out of the 40–90 mg/kg/day range. However, respondents tended to calculate the dose of amoxicillin based on the regularly used dose of 50 mg/kg/day. For some erroneous calculations, we could not retrieve the causes by manual recalculation (‘Calculation error not specified’). In line with the finding of significant ORs for calculation items, the percentage that exceeded the maximum dose in the calculator group was lower than that of the manual group (Table 5). Table 5 also confirms the number of errors in the calculator group originating from the use of the incorrect unit of dosing (item 17). The website-integrated dose calculator requires participants to select the indication and route of administration from a pre-specified list. Wrong selection from these drop-down lists (also known as juxtaposition error), typo/transcription errors and non-specified errors are more frequent in the calculator group, while exceeding the maximum dose and wrong correction for age are more frequent in the manual group.

Table 5

Comparison of rate of types of errors per group

Cause of error	Manual	Calculator
	n (% of all erroneous calculations)	n (% of all erroneous calculations)
Exceeding maximum dose	60 (26.9)	8 (5)a
Incompliant with instructions	38 (17.0)	35 (22.0)
Calculation error not specified	34 (15.2)	39 (24.5)
Daily vs single dose mix-up	32 (14.4)	17 (10.7)
Selected dose from wrong age group	18 (8.1)	3 (1.9)
Error converting mg to mL	15 (6.7)	8 (5)
Rounding error	7 (3.1)	2 (1.3)
Incorrect transcription of unit of dosing	7 (3.1)	21 (13.2)
Typo/other transcription error	5 (2.1)	10 (6.3)
Selected dose from different indication (juxtaposition error)	4 (1.8)	10 (6.3)
Multiplied fixed dose by weight	2 (0.9)	2 (1.3)a
Birthweight versus current weight incorrect use	1 (0.5)	1 (0.6)a
Wrong route of administration (juxtaposition error)	0 (0)	3 (1.9)

aErrors assumed to be caused by manual calculation instead of calculator-assisted calculation

The percentage of tenfold errors in the calculator group was higher than that in the manual group (Table 4). Wrong transcription of the dosing unit—12 out of 19 errors in item 17—and other transcription errors accounted for the 77% of tenfold errors in the calculator group (Table 6).

Table 6

Comparison of rate of types of tenfold errors per group

	Manual (n)	Calculator (n)
Calculation error not specified	4	6
Exceeding max. dose	3	0
Incorrect transcription of unit of dosing	6	19
Typo/other transcription error	5	7
Incompliant to instructions	4	0
Error converting mg to mL	2	0
Multiplied fixed dose by weight	2	2a
Total	26	34

aErrors assumed to be caused by manual calculation instead of calculator assisted calculation

Discussion

Our data show that in a simulated setting the probability of a calculation error made by healthcare professionals is significantly lower when they use a website-integrated dosing calculator instead of a pocket calculator. The ORs for correct calculation suggest that the use of the website-integrated dose calculator is most effective in preventing the absolute maximum daily dose being exceeded and in converting a dose in milligrams to a dose in millilitres. The qualitative analysis, however, did not show a large reduction in the percentage of milligram to millilitre conversion errors with the use of the website-integrated dosing calculator. Therefore, the conversion step may not be the primary cause of erroneous outcome in these calculation items. Instead, the error is likely to be caused by calculation steps prior to the milligram to millilitre conversion. Significant ORs, indicating difficulty of the calculations, were found for common drugs such as paracetamol, ferrous fumarate and ranitidine.

Published error rates for incorrect dosing in children vary from 11.3% of all prescription errors (n = 391) in paediatric inpatients [15] to 36.5% of all prescription errors (n = 192, concerning dosages that do not fall within 25% of the recommended dose) by junior doctors completing a prescribing competency assessment [4]. Our results for manual calculation suggest that percentages for incorrect dosing are more likely to be on the higher end of this range. The high error rate found in our study may be the consequence of the strict definition for erroneous calculation: any deviation exceeding the correct outcome by 0.05 mg or 0.05 mL in both directions was considered an error. In clinical practice, a 10% deviation from the calculated dose is usually accepted and often even needed to enable administration of specific formulations. In the secondary analysis, in which we took into account a 10% or greater deviation from the correct answer, the estimated mean probability decreased from 27 to 19%, but the mean difference between groups was no longer significant (p = 0.137).

Although the probability of error rate was reduced from 39 to 24% (and 27 to 19% when accepting 10% deviation) we are surprised to find a still high number of errors with the use of the website-integrated dose calculator. The error analyses reveal that the nature of errors is different in both groups. The website-integrated dose calculator provides a good technical solution to prevent the absolute maximum dose being exceeded, incorrect milligram to millilitre conversions and wrong correction for age. At the same time, however, it introduces dosing errors based on juxtaposition (wrong selection from drop-down lists) and transcription, explaining the remaining error rate of 24% in the calculator group. These errors occur despite the programmed corrective and preventive actions aimed at detection of erroneous selection of parameters and incorrect data entry. The high number of tenfold errors in the calculator group is explained by dosing unit errors and typo/transcription errors, together accounting for 77% of all tenfold errors. The tenfold dosing unit error is likely to be caused by the design of item 17 of the assessment, where the calculator provided the dose in grams, but the assessment required the outcome in milligrams. Differences in dosing units between systems and the need for transcription are likely to occur outside a simulation setting as well and may lead to major dosing errors.

The participants in the manual calculation group completed the survey before the website-integrated dose calculator was available on the Formulary’s website. Participants in the calculator group, however, might have used manual calculations instead of using the website-integrated dose calculator. Four participants in the calculator group provided erroneous answers that by no means could have been generated with the website-integrated dose calculator considering the technical specifications (exceeding the maximum dose, multiplication of a fixed dose by weight, Table 5), even when instructions were not followed or incorrect parameters were selected. These four participants accounted for 52 of the 159 calculation errors in the calculator group (33%), which may imply a greater favourable effect of using the website-integrated dose than our results suggest.

Limitations of our assessment may consist of the deviations from daily practice, the need to transcribe calculation results, the limited time in addition to the need to switch between multiple computer displays and the lack of supervision during the assessment. Furthermore, the written instructions on use of the calculator as well as the instructions for the assessment did not ensure the correct use of the calculator in the simulated assessment. The simulation setting therefore may have induced errors that are less likely to occur when using the calculator congruent to everyday clinical practice. From September 2015 to June 2017, a beta version was made available, and users were asked to use it cautiously and report any problems. Errors like the ones encountered in the study were not reported during this period. Still, underreporting is a recognized limitation of spontaneous reporting systems. Currently, the website-integrated dose calculator is being used more than 30,000 times a month. Having received several reports on suspected problems with the calculator, none of the reports identified a malfunction of the calculator. Therefore, we have confidence in the safety of the calculator in everyday practice.

Although computerized dose calculation is advocated as a major approach to prevent paediatric calculation errors [1, 16, 17], our study shows that this technology does not completely rule out dosing errors and in fact may generate new types of errors. Several other studies have identified similar unintended consequences of the implementation of health information technologies [18-22]. Healthcare professionals should, therefore, use these technologies with due caution. Nonetheless, our findings confirm the findings of Kirk et al., that the computerized dose calculation can help reduce calculation errors [9]. A print option for the calculation was installed to enable calculation checks. Connecting the website-integrated dose calculator to computerized physician order entry systems may further reduce calculation errors caused by transcription.

Conclusion

Our study shows that a dose calculator as an add-on to a web-based paediatric formulary can reduce calculation errors, but it may introduce new errors based on transcription errors and the wrong selection of parameters from drop-down lists. Therefore, dosing calculators should be developed and used with special attention paid to selection and transcription errors.

In a simulated setting, the use of a dose calculator integrated with a web-based paediatric formulary reduced the estimated marginal mean probability of a calculation error from 39 to 24%. Paediatric healthcare professionals therefore may benefit from using this technology.

At the same time, digital solutions for dose calculation should be used with due caution as they may introduce risks as well. Special attention is needed for correct selection of parameters and transferring the calculation results to other information systems.