Serious Adverse Events in Pediatric Procedural Sedation Before and After the Implementation of a Pre-Sedation Checklist.

OBJECTIVE: Procedural sedation is considered by the Joint Commission on Accreditation of Healthcare Organizations as a high-risk procedure when performed in the emergency department (ED). A pre-sedation checklist is a set of items checked before any sedation. We evaluated the impact of a pre-sedation checklist on the rate of serious adverse events (SAE) in a pediatric ED.
METHODS: We conducted a retrospective study comparing the rate of SAE in children treated with the combination of ketamine and propofol before and after the implementation of a pre-sedation checklist. The before-and-after periods lasted from 1.1.2013 to 30.6.2016 and from 1.7.2016 to 30.6.2019, respectively. Patient data were extracted from the electronic medical records using an integrated business intelligence information system.
RESULTS: The before-and-after cohorts included 1349 and 1846 patients, respectively. The two groups were similar with regard to age, sex, length and type of procedure, medications dosage, and level of physicians' training. A total of 183/1349 (13.5%) and 420/1846 (22.7%) SAE were recorded during the before-checklist and after-checklist periods, respectively (p<0.0001). The rates of laryngospasm, apnea, and oxygen saturation ≤90% at the before-and-after checklist periods were 9/1349 (0.6%) and 30/1846 (1.6%); p<0.05, 48/1349 (3.5%) and 77/1846 (4.2%); p=0.37, and 123/1349 (9.1%) and 312/1846 (16.9%); p< 0.0001, respectively. All the SAE were successfully managed by the emergency physicians and no patient required hospitalization due to a SAE.
CONCLUSION: In this large cohort of ED children who underwent deep sedation, the administration of a pre-sedation checklist was not associated with a reduction in SAE rate.

Introduction

The use of checklists to improve patient care in emergency medicine is increasing.1,2 Procedural sedation is a well-established and safe treatment when performed by emergency department (ED) physicians.3–5 However, serious adverse events (SAE) such as aspiration, apnea, and laryngospasm might occur, and because of that it is considered by the Joint Commission on Accreditation of Healthcare Organizations as a high-risk procedure.5–7 In 2012, a committee of the American College of Emergency Physicians Quality Improvement and Patient Safety Section recommended that pre-procedural check and procedure equipment check will be performed before sedation.7 Based on international standards for a safe practice of anesthesia, and by using the Revised Pre-anesthetic Set-Up as a conceptual framework, a group of pediatric emergency specialists from Rambam Health Care Campus (RHCC), Haifa, Israel, have created a pre-sedation checklist that meets the unique needs of patients undergoing procedural sedation in the pediatric ED (Figure 1).8,9 Since July 2016 the pre-sedation checklist has been incorporated into the department protocols. The objective of the current study was to evaluate the impact of a pre-sedation checklist on the rate of SAE in a pediatric ED. We hypothesized that by increasing adherence to the sedation protocol, and increasing the safety culture of the teams, the implementation of the checklist would result in a decrease in the rate of SAE.

Figure 1

Pediatric Emergency Department pre-sedation checklist protocol.

Methods

Setting and Study Design

RHCC is a tertiary trauma care center as well as a referral center for 12 district hospitals. The hospital serves a population of more than two million residents. The pediatric ED has an annual volume of approximately 28,000 patients, and the physicians of the department perform a large number of sedations with the combination of ketamine and propofol, mainly for trauma patients.

We conducted a retrospective study comparing the rate of SAE in children treated with the combination of ketamine and propofol in the ED, before and after the implementation of a pre-sedation checklist. The before-checklist period lasted 3.5 years, from 1 January 2013 to 30 June 2016, and the after-checklist period lasted 3 years, from 1 July 2016 to 30 June 2019. This study was conducted according to the guidelines outlined in the declaration of Helsinki. The patient records and information were anonymized and deidentified before analysis. The Institutional Review Board of Rambam Health Care Campus (No. 0439-19) approved this study without the requirement of obtaining informed consent.

Sedation Protocol

The combination of ketamine and propofol has gained popularity in recent years, because the drugs are thought to complement one another.6,10 The antiemetic and anxiolytic properties of propofol mitigate the vomiting and emergence reactions induced by ketamine, while the sympathomimetic effect of ketamine mitigates the hypotension induced by propofol.11 In the pediatric ED of RHCC children are treated with the combination of ketamine and propofol regularly as of 2012. According to ED protocol, if a patient undergoing painful procedure is older than 12 months, has an American Society of Anesthesiologists physical status classification ≤2, and has been fasting for ≥2 hours, s/he can be managed with deep sedation. Department protocol recommends using propofol and ketamine in separate doses, with ketamine given first to decrease the risk of injection-site pain with propofol.10 Ketamine is administered in a loading dose of 1 mg/kg followed by propofol in a loading dose of 1 mg/kg. Propofol boluses of 1 mg/kg are then administered every 0.5–2 min patient reaches a state of deep sedation, as defined by a University of Michigan Sedation Scale score of 3 (deep sleep/arouses to deeper physical stimuli).12

Design and Implementation of the Pre-Sedation Checklist

Results of a landmark paper conducted by the World Health Organization revealed that the introduction of a team-based surgical safety checklist reduced death and complication rates of adult patients undergoing noncardiac surgery.13 An important finding of this study was the fact that the checklist leads to changes in the behavior of individual surgical teams. This finding seems to suggest that the checklist may have affected the safety culture of these teams. A study that used a pre-anesthetic checklist revealed that in the intense environment of the operating room, preparatory steps may be missed by the anesthesiologists.9 The pre-anesthetic checklist is a set of items designed for anesthesiologists to check equipment adequately and to minimize missed steps in the preparation for anesthesia. Given the highly stressful work environment in which emergency physicians practice, key preparation steps for procedural sedation may be missed as well. Based on this knowledge, attending pediatric emergency physicians at RHCC have decided to embrace the concept of checklist and to create a pre-sedation checklist, aimed at reducing SAE related to procedural sedation. A panel of three anesthesiologists, expert in pediatric sedation, independently reviewed the pre-sedation checklist and unanimously endorsed the face validity of the instrument for ED procedural sedation. The checklist includes 15 items that seem conducive to safe patient outcome in the ED. The items cluster into four categories: patient identification, consent and information, patient risk assessment, procedure, and equipment and medications check (Figure 1). Pre-sedation recording is done before the sedation when the child and the caregivers are present in the procedures room. Each of the checklist items is scored “yes” or “done”. Only when the nurse verifies that all 15 checklist items are met, the sedation and the procedure can begin. Three months before implementing the pre-sedation checklist, the tool was tested by 5 ED nurses. The nurses evaluated 20 procedural sedations in the ED in a blinded fashion, and were satisfied with the instrument’s ease of use and the time required for it (5–10 minutes). On 1 July 2016, the pre-sedation checklist had been incorporated into the ED protocols and is being used since then before every sedation.

Data Collection and Selection of Participants

RHCC patient data management system (“Prometheus”, integrated electronic medical records system, Haifa, Israel) is a computerized mandatory working tool for all physicians, nursing staff and any ED healthcare personnel. All patients seen in RHCC have their episode of care recorded in the Prometheus.10 The Prometheus includes a sedation recording section that is used for procedural sedation data in the pediatric ED. Data is recorded in real-time by the sedation nurse during the sedation. The sedation section in the Prometheus includes procedure begin time, procedure end time, vital signs, medication administration, medication dose, and any SAE related to the sedation.14 Recording of SAE is based on standardized definitions from the Quebec guidelines, a consensus-based document developed by North American experts in ED pediatric procedural sedation, to report sedation data and adverse events requiring intervention.15 Based on Prometheus, the Information Technology department of the hospital developed a business intelligence information system (BIINS) that provides reporting and analytical functions across multiple datasets. The BIINS enables automatic extraction of patient data from the electronic medical records according to criteria set by researchers. The following data were extracted from the BIINS for each patient who was sedated with the combination of ketamine and propofol: demographics (age, sex), procedure begin time, procedure end time, medications dosage, sedation physicians’ name and level of training, and the following adverse events: aspiration, laryngospasm, apnea, and oxygen saturation ≤90%. Any unplanned hospital admission due to sedation was also extracted from the BIINS.

Study Outcome Measures

The outcome measures for the study were the rate of SAE defined as clinically suspected aspiration (coughing with decreased oxygen saturation), laryngospasm, apnea, and oxygen saturation ≤90%, and unplanned hospital admission due to sedation.

Statistical Analysis

Descriptive statistics were generated, including means and standard deviations (SD) for continuous variables and frequencies, medians, and interquartile ranges (IQR) for the categorical variables. Rate of adverse events before and after the implementation of the checklist was compared using the Chi-squared test and the Fisher’s Exact test. All statistics were calculated with StatsDirect (version 2.6.6; StatsDirect Limited, Cheshire, UK).

Results

Overall, 3195 patients with a mean age of 8.2 ± 4.6 years were sedated with the combination of ketamine and propofol in the ED during the 6.5 years of the study. Sedation checklist was used before all the procedures during the study period. The before and after cohorts included 1349 and 1846 patients, respectively. The two groups were similar with regard to age, sex, length of procedure, type of procedure, medications dosage, and level of physician training (Table 1). A total of 183/1349 (13.5%) and 420/1846 (22.7%) SAE were recorded during the before-checklist and after-checklist periods, respectively (p<0.0001). No cardiovascular events were recorded. All the procedures were successfully completed and the patients were safely discharged from the ED. All the SAE were successfully managed and no patient required hospitalization due to a SAE. The rates of laryngospasm, apnea, and oxygen saturation ≤90% at the before-and-after checklist periods were (9/1349 (0.6%) and 30/1846 (1.6%)); p<0.05 (48/1349 (3.5%) and 77/1846 (4.2%)); p=0.37, and (123/1349 (9.1%) and 312/1846 (16.9%)); p< 0.0001, respectively. There were 8 episodes of clinically suspected aspiration; 5 at the before-checklist period, and 3 at the after-checklist period (p=0.29).

Table 1

Characteristics of Procedures Performed in Patients Sedated with the Combination of Ketamine and Propofol Before and After the Administration of a Pre-Sedation Checklist

	Before-Checklist Period (n=1349)	After-Checklist Period (n=1846)
Age, mean ± SD	8.0 ± 4.5	8.3 ± 4.7
Males/Females	937/412	1252/594
Length of procedure, min, mean ± SD	17.2 ± 11.8	15.8 ± 10.9
Type of procedures
Fracture reduction or management of dislocation
-Upper limb, n (%)	702 (52.1)	948 (51.3)
-Lower Limb, n (%)	61 (4.6)	109 (5.9)
Complex or deep laceration repair, n (%)	361 (26.7)	402 (21.9)
Abscess incision and drainage, n (%)	73 (5.4)	148 (8.0)
Soft-tissue foreign-body extraction, n (%)	41 (3.0)	52 (2.9)
Intraoral procedure, n (%)	22 (1.6)	25 (1.3)
Arthrocentesis, n (%)	10 (0.8)	32 (1.7)
Percutaneous CSF sampling of ventriculoperitoneal shunt, n (%)	8 (0.6)	14 (0.7)
Other (eg, nail bed procedure, removal of K-wire, insertion of nasogastric tube), n (%)	71 (5.2)	116 (6.3)
Level of physician training
Attending physicians, n (%)	751 (55.7)	1065 (57.7)
Pediatric residents, n (%)	598 (44.3)	781 (42.3)
Dosage
Mean total ketamine dose, mg/kg	1.04	1.02
Mean total propofol dose, mg/kg	2.45	2.60

Abbreviations: SD, standard deviation; CSF, cerebrospinal fluid.

Discussion

In the current study, we tested the impact of a pre-sedation checklist on the incidence of SAE in a large cohort of children who were sedated with the combination of ketamine and propofol in a pediatric ED. The major finding of the study is that the rates of SAE increased after the administration of the checklist. All the patients were safely discharged from the ED after observation. Prior to the study, we assumed that the administration of a pre-sedation checklist would have reduced the number of SAE by improving the adherence to sedation protocols, and by positively affecting the safety culture of the ED team. The results clearly suggest that administration of pre-sedation checklist was not associated with a reduction in SAE rate. We speculate that the main reason for the surprising rise in SAE is a change in the work environment throughout the years of the study (2013–2019). It had been shown that ED crowding, and work pressure on the staff can affect the risk of procedures.7 In our study, there were 1349 sedations with the combination of ketamine and propofol during the first 3.5 years (before-checklist period), versus 1846 sedations with the combination of ketamine and propofol during the following 3 years (after-checklist period). This significant increase from 385 to 615 sedations per year is the result of an increase in the annual volume of patients in the ED; from 13,000 patients in 2013 to 28,000 patients in 2019. It is important to note that the staff in this department is responsible for a significant percentage of high-acuity patients (including major trauma) and regularly performs sedations in these relatively high-risk patients.16 A more loaded ED means more work, more tasks and more pressure on the emergency physicians. This environmental change might have a negative impact on the performance of the emergency physician who is working in a stressful environment and is expected to multitask effectively.17 During the shift and prior to the sedation, the physician treated other patients and had other tasks that he/she needed to return to once the sedation is completed. We believe that the increase in patient load led to a desire to complete the sedation as early as possible in order to return to the other tasks that were waiting for him/her. Our speculation of patient overload is backed by a survey of open questions we conducted among the 18 physicians of the department. Fourteen physicians mentioned “an urge to finish the sedation as early as possible so that they could see other patients”. The sedation protocol allows for propofol boluses every 0.5–2 min until patient reaches a state of deep sedation. However, some physicians admitted that the time of administering the medications were not always documented accurately, and propofol was administered in intervals of less than 30 seconds.

We found only one study that investigated the impact of a pre-sedation checklist on adverse events related to sedation. The investigators examined the use of a pre-sedation checklist in a mix cohort of 773 children in an Intensive Care Unit, an ED, and in-hospital wards. They did not find a reduction in the rate of SAE.18

A pre-sedation checklist has possible advantages that were not tested in our study. The fact that the team responsible for the sedation gather together with the child and his/her parents before the sedation and provided them appropriate explanation about the sedation, likely led to an improved parental satisfaction. It is also reasonable to believe that the pre-sedation checklist positively affected the collaboration between ED physicians, nurses, and surgeons.

This study has several limitations. Firstly, team-related checklists have well-known inherent limitations such as relying on good communication between team members, and cultural challenges, such as hierarchy and perceptions of professionalism.19 Secondly, this study has the inherent limitations of a retrospective study design, including dependence on the quality of documentation recording. The information was extracted using a business intelligence information system; therefore, misinterpretation or abstractor bias had no impact. Thirdly, although the pre-sedation checklist has face validity it has not been subjected to psychometric testing to determine reliability and validity. Fourthly, it is theoretically possible, that after checklist administration, recording of SAE by the nurses was more accurate than before checklist administration. We do not think that this is the case because the nurses in this department are well trained in sedation recording as of 2013 and had no incentive for increased recording of SAE after checklist implementation. Furthermore, the after-checklist period lasted three years, a long enough period to eliminate a possible effect of the introduction of a new instrument.

In conclusion, in this large cohort of ED children who underwent deep sedation, the administration of a pre-sedation checklist was not associated with a reduction in SAE rate.