Patient safety in pre-hospital emergency tracheal intubation: a comprehensive meta-analysis of the intubation success rates of EMS providers.

INTRODUCTION: Pre-hospital airway management is a controversial subject, but there is general agreement that a small number of seriously ill or injured patients require urgent emergency tracheal intubation (ETI) and ventilation. Many European emergency medical services (EMS) systems provide physicians to care for these patients while other systems rely on paramedics (or, rarely, nurses). The ETI success rate is an important measure of provider and EMS system success and a marker of patient safety.
METHODS: We conducted a systematic search of Medline and EMBASE to identify all of the published original English-language articles reporting pre-hospital ETI in adult patients. We selected all of the studies that reported ETI success rates and extracted information on the number of attempted and successful ETIs, type of provider, level of ETI training and the availability of drugs on scene. We calculated the overall success rate using meta-analysis and assessed the relationships between the ETI success rate and type of provider and between the ETI success rate and the types of drugs available on the scene.
RESULTS: From 1,070 studies initially retrieved, we identified 58 original studies meeting the selection criteria. Sixty-four per cent of the non-physician-manned services and 54% of the physician-manned services reported ETI success rates but the success rate reporting was incomplete in three studies from non-physician-manned services. Median success rate was 0.905 (0.491, 1.000). In a weighted linear regression analysis, physicians as providers were significantly associated with increased success rates, 0.092 (P=0.0345). In the non-physician group, the use of drug-assisted intubation significantly increased the success rates. All physicians had access to traditional rapid sequence induction (RSI) and, comparing these to non-physicians using muscle paralytics or a traditional RSI, there still was a significant difference in success rate in favour of physicians, 0.991 and 0.955, respectively (P=0.047).
CONCLUSIONS: This comprehensive meta-analysis suggests that physicians have significantly fewer pre-hospital ETI failures overall than non-physicians. This finding, which remains true when the non-physicians administer muscle paralytics or RSI, raises significant patient safety issues. In the absence of pre-hospital physicians, conducting basic or advanced airway techniques other than ETI should be strongly considered.

Introduction

Airway compromise has been identified as a preventable cause of poor outcomes and death in trauma and cardiac arrest patients for many years [1,2]. After arriving in a hospital, the critical and complex intervention of emergency tracheal intubation (ETI) is usually provided by appropriately trained physicians. Most of these physicians are trained anaesthesiologists or emergency physicians trained in anaesthesiology [3,4]. An in-hospital ETI intervention allows administration of drugs that optimize the conditions for tube insertion and minimize physiological derangement and other adverse events [4]. Unsuccessful or poorly conducted ETI can be life threatening and may result in significant complications, such as oesophageal intubation [5], hypoxemia [6], or post-induction cardiac arrest [7].

Rapid sequence induction (RSI) is generally accepted as the technique of choice for securing the airway in seriously ill or injured patients [3,4]. RSI contains three elements: sedation, analgesia and muscle paralysis, all of which are necessary for a safe and successful ETI. The drugs used to perform ETI produce a state of apnoea, can induce hypotension and increase the risk of regurgitation. Using them requires a high level of competence and the ability to deal with any adverse effects. In hospital settings, this requirement usually presupposes the educational level of a specialized physician.

In a pre-hospital setting, the situation is somewhat different. The first Medline- or EMBASE-indexed reports on pre-hospital ETI were published in the mid-to-late1960s [8-13]. Recently, the value of pre-hospital ETI has been seriously questioned [14-17]. Despite many published studies, the benefits of this practice in different patient groups, the skills required by the providers, the effect of different techniques and the alternatives to intubation are less clear now than ever before. The majority of the published papers are based on observational methodologies and are usually considered to be low-quality evidence [18]. Despite the publication of guidelines from Europe and the US that recognize the need for appropriately conducted pre-hospital RSI [19-21] in a small number of patients, the practice is still widely variable between and within countries. In many European countries in which specially trained physicians have participated in pre-hospital EMS services since the late 1950s, RSI is a core component of pre-hospital advanced life support [22-24]. In contrast, some pre-hospital EMS systems in developed countries base their advanced life support entirely on paramedics and/or nurses, and their ETI protocols and procedures depend far less on drug administration [25,26]. A recent systematic review extracted the Utstein airway template variables from studies pertaining to pre-hospital ETI [27]. The majority of the included studies (59.8%) were from North American EMS systems. Of these, 46 (78%) described services in which non-physicians conducted ETI. In contrast, physicians performed the pre-hospital ETIs in 13 (87%) of the 15 non-North American EMS systems. Of the 47 non-physician-manned systems, 25 (53%) performed drug-assisted ETI [27].

As a complex intervention performed by operators with different skill levels in different ways on different patient groups, the effect of pre-hospital ETI on patient outcome is difficult to assess. However, the rate of successful placement of a tracheal tube into the trachea after attempted intubation, particularly after the administration of a muscle paralytic, is recognized as a quality indicator for systems practicing ETI. Although muscle paralytics are administered to facilitate intubation they also render the patient apnoeic and, therefore, make the consequences of failed intubation much more serious.

The aim of this project was to establish whether the published literature indicates a difference in ETI success rates between physician- and non-physician-manned EMS systems. We compared the success rates of non-physicians and physicians and those of non-physicians using different levels of drug assistance. Further, we wanted to explore whether there was a difference in ETI success rates between physicians and the sub-group of non-physicians using a muscle paralytic or a standard RSI.

Materials and methods

Identification and selection of studies

We conducted a systematic search of Medline and EMBASE according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines [28]. We identified all original English-language articles published prior to 1 September 2009 that pertained to pre-hospital ETI in adult patients [27]. The studies that investigated paediatric cohorts, that focused on surgical airways and that compared ETI to other airway devices were excluded. The reference lists of the included studies and a recent relevant Cochrane review [17] were inspected to identify any additional relevant studies (see Table 1 for the search strategy).

Table 1

Search strategy for identification of relevant studies in Medline and EMBASE

Search terms 'keywords':
Medline	'Emergency Medical Services' AND 'Intubation, Intratracheal'
Embase	'emergency care' AND 'intubation/or respiratory tract intubation'
Search terms 'title':
Medline	'prehospital' AND 'intubation'
	'pre-hospital' AND 'intubation'
	'out-of-hospital' AND 'intubation'
	'prehospital' AND 'RSI' OR 'Rapid sequence induction'
	'pre-hospital' AND 'RSI' OR 'Rapid sequence induction'
	'out-of-hospital' AND 'RSI' OR 'Rapid sequence induction'
EMBASE	'prehospital' AND 'intubation'
	'pre-hospital' AND 'intubation'
	'out-of-hospital' AND 'intubation'
	'prehospital' AND 'RSI' OR 'Rapid sequence induction'
	'pre-hospital' AND 'RSI' OR 'Rapid sequence induction'
	'out-of-hospital' AND 'RSI' OR 'Rapid sequence induction'

Study eligibility criteria and data extraction

From the initial search, we selected all of the studies reporting ETI success rates. From these papers, we extracted information on the numbers of attempted ETIs and successful ETIs, type of provider, level of ETI training and drug availability on scene. The providers were categorized into two groups: physician and non-physician. The use of drugs was categorized into three groups: 1) no drugs available; 2) analgesics, anaesthetics, or a combination; and 3) muscle paralytics, with or without co-administration of analgesics and anaesthetics, or a standard RSI.

Statistical meta-analyses

The ETI success rates are reported as medians (range) unless stated otherwise. The individual and overall success rate is presented in a forest plot and the overall success rate was calculated using a random effects meta-analysis for proportions. The analysis did not consider the number of ETI attempts before success was achieved.

To assess the relationships between the ETI success rate and provider type, and between the ETI success rate and types of drugs available on the scene, we performed a weighted univariate linear regression analysis with the ETI success rate as the dependent variable and drug availability and provider type as categorical independent variables. The regression was weighted by the size of each study, that is, by the number of intubation attempts. As all physicians use RSI (drug group '3'), a multiple regression model would have been degenerate and was not performed. All the tests were two-tailed, and statistical significance was indicated by P < 0.05.

The data were analysed using R 2.12 (The R Foundation for Statistical Computing, Vienna, Austria) [29].

Study ethics

As a meta-analysis based on a systematic literature review, this study did not require approval from The Regional Committee for Research Ethics or the National Social Science Services.

Results

From 1,070 studies initially retrieved through the systematic search, we identified 58 original studies that met the inclusion criteria. Of these, 45 (78%) were studies of non-physician-manned services (paramedic- or paramedic/nurse-manned). Twenty-nine (64%) of the 45 non-physician-manned services and seven (54%) of the 13 physician-manned services reported ETI success rates. The success rate reporting was incomplete in three studies from non-physician-manned services, leaving 33 studies for the final analysis (Figure 1). An overview of the included studies is shown in Additional file 1.

Figure 1

Search diagram according to the PRISMA statement.

In total, ETI was attempted in 15,398 patients: 2,536 by physicians and 12,862 by non-physicians. The median (range) reported success rate was 0.905 (0.491, 1.000) (Figure 2). The estimated overall (95% CI) ETI success rate was 0.927 (0.882, 0.961). Figure 2 presents the individual study estimates and corresponding 95% CIs.

Figure 2

Forest plot of 33 studies reporting success rate after pre-hospital emergency tracheal intubation. Individual study estimates of success rates and corresponding 95% CIs.

When comparing physicians to non-physicians, the corresponding median (range) ETI success rates were 0.991 (0.973, 1.000) versus 0.849 (0.491, 0.990).

All seven physician-manned services reporting success rates also reported drugs available on the scene (all used standard RSI). Of the 26 non-physician-manned services reporting success rates, 19 (73%) reported drugs available on scene, leaving seven services reporting no use of drugs (drug group 1). Of the 19 services reporting use of drugs, six had analgesics, anaesthetics or a combination available (drug group 2), and 13 reported having muscle paralytics, with or without analgesics or anaesthetics, or standard RSI available (drug group 3). In drug groups 1, 2 and 3, the reported median (range) ETI success rates for non-physicians were 0.675 (0.491, 0.968), 0.810 (0.755, 0.905) and 0.967 (0.758, 1.000), respectively.

In weighted linear regression analysis, having physician providers was significantly associated with an increased success rate: 0.092 (0.007, 0.176), P = 0.0345. Similarly, drug groups 2 and 3 were significantly associated with an increased success rate: 0.108 (0.033, 0.183), P = 0.006 and 0.199 (0.147, 0.252), P < 0.001, respectively.

When comparing physician to drug group 3 (muscle paralytics, with or without analgesics or anaesthetics, or standard RSI available) non-physician success rates, there still was a significant difference in favour of physicians: 0.991 (0.974,1.000) and 0.955 (0.758,0.990), respectively (P = 0.047).

Discussion

Airway management in pre-hospital care is complex. Although ETI is only required in a small number of critically ill or injured patients [30,31], it is a well-established tool in pre-hospital EMS services. The procedure carries a risk of severe adverse events if not performed correctly [32] and its providers must be both technically competent to perform the procedure and capable of making decisions and initiating treatments to prevent or treat complications. The ETI success rate is only one component of successful pre-hospital airway management, but a system that performs ETI should strive for a high success rate.

This meta-analysis demonstrates that when non-physicians attempt pre-hospital ETI, they have significantly higher intubation failure rates than do physicians. The ETI failure rate of physician-manned services was on average one out of 100 patients, whereas services manned by non-physicians failed on average in 15 out of 100 patients.

This overall comparison between physician- and non-physician-manned services is important. There is undoubtedly considerable variation in the experience and skill levels covered by both the term 'physicians' and the term 'non-physicians'. The exposure to situations requiring ETI in the pre-hospital setting is, in most EMS services, relatively rare and it can be argued that it is often insufficient to maintain necessary skills. Nevertheless, physicians operating in pre-hospital EMS are likely to have had more training and have performed a greater number of intubations than non-physicians due to their in-hospital clinical activity. In the in-hospital setting, emergency physicians and anaesthesiologists often perform emergency and elective intubations on a regular basis.

Much more relevant to patient safety is the comparison between physicians and non-physicians when muscle paralytics have been administered to facilitate intubation. Failure to achieve intubation after rendering a patient apnoeic has major safety implications and carries a risk of hypoxic brain injury and death [33]. Reports of ETI failure rates of over 15% after administering muscle paralytics are not uncommon in non-physician systems [34-36]. This high failure rate has been previously highlighted [37]; it is not only unthinkable in hospital practice, but is unacceptable in any area of practice. Even though the inclusion of muscle paralytics in non-physician-manned EMS services providing ETI appears to significantly improve intubation success rates it also results in five patients in every100 being rendered apnoeic with an unsecured airway after failed intubation.

The precise clinical implications of our findings are difficult to assess. Failed intubations in hospitals have been subject to considerable analysis, which may give an indication of the consequences of failed pre-hospital intubation. A recent study [38] collected reports of major airway management complications during anaesthesia (death, brain injury, emergency surgical airway, and unanticipated intensive care unit admission) from all of the UK National Health Service hospitals over one year. Difficult or delayed intubation, failed intubation, and 'can't intubate, can't ventilate' accounted for 39% of all such events. In a US study of 179 closed claims arising from managing difficult airways, the majority (67%) of the incidents resulting in death or brain damage involved the induction phase of anaesthesia and were clearly associated with intubation difficulties [33]. It seems that failed intubation is closely associated with the most devastating complications of airway management. In healthcare risk assessment, the significance of a failed intubation and its consequences can be assessed by answering a few key questions [39]: what can go wrong; how bad is it; how likely is it to occur; and what can we do about it? We know what can go wrong in failed pre-hospital intubation and we know the consequences that fall into the potentially 'catastrophic' category (death or severe disability). When constructing a 'risk matrix', the only other key information required is the frequency or likelihood of the event occurring in a given system. The results of combining the potentially severe consequences from failed intubation assisted by muscle paralytics and our observed frequency of failed intubation in 'non-physician' systems falls into an 'extreme risk' category in the NHS National Patient Safety Agency's patient safety guidance risk matrix [39]. 'Extreme risk' requires urgent action by the highest level of an organization [39]. If the data presented in this review were used in the planning phase of a study comparing the outcomes of pre-hospital airway management in physician and non-physician systems, ethical approval would be difficult to obtain.

One of the principles of recent pre-hospital anaesthesia guidelines is that patients undergoing pre-hospital anaesthesia should have the same standards of care and safety that they would receive in an emergency department [20]. This review suggests that physician-conducted pre-hospital intubation is associated with high levels of success that are similar to those reported in US emergency departments [40]. ETI attempted without drugs has not been associated with improved outcomes in cardiac arrest patients [41] and is only likely to be achieved in trauma patients with a high probability of mortality [42].

In previous studies of failed intubations in paramedic systems [43], it has been suggested that insufficient training of the operators rather than their professional status may be responsible for the poor outcomes. Efforts have been made to train non-physicians in critical care [44,45]. Equipping non-physicians with drugs and training them to conduct RSI raises a number of difficulties that need to be overcome. Both training and skill retention are likely to be difficult, as using elective anaesthetic techniques without the need for intubation is becoming more frequent [45,46]. It is also important to ensure that the individuals trained to perform the complex RSI procedure are matched with the few patients that require it and to provide the considerable resources necessary to run such programs. If all of these obstacles are overcome and significant resources are provided to train non-physicians to a high level, what failure rates can be expected? We compared the success rates of non-physicians trained to perform RSI with the success rates of physician-manned services and found that there was still a significant difference. The 2009 study by Warner et al. [14] described an exceptionally high level of training, supervision and re-certification and reported on a relatively high number of ETIs. The paramedics were trained in a university training program with 2,500 hours of classroom, laboratory and field experience. Their ETI skills were developed through lectures, intensive mannequin training and experience with patients in the operating room. Field ETIs were then attempted with strict direct supervision and medical oversight. The paramedics also participated in a comprehensive recertification program every two years. A minimum of twelve uncomplicated tracheal intubations per year was required for recertification, and failure to achieve this standard resulted in returning to the operating room for further supervised training. Despite their high level of training, the paramedics in this program still failed to intubate 3 out of 100 patients after administering muscle paralytics (three times the failure rate of physicians), which raises significant patient safety issues.

Limitations

The results of the analysis in this study must be interpreted with caution due to the small numbers in the patient sub-groups, although the findings remain significant and have narrow CIs. Selection bias, missing cases, and reporting bias in publishing may be conducive to including studies not necessarily representative of real-time clinical activity and performance. The long time frame for including studies and the variance in the reported success rate may diminish this.

This review did not consider a number of other factors that may contribute to poor outcome. Sub-optimally performed ETI, such as multiple intubation attempts, hyper- or hypoventilation and unrecognized oesophageal intubation, may be critical to outcomes and not reflected by intubation success rates. A high rate of undetected oesophageal intubation has been reported in non-physician systems and continues even after introducing easily used carbon dioxide detection equipment [5]. We also did not examine whether non-physicians are better or worse than physicians at managing the consequences of failed ETI. Even in physician-manned services, lack of training and sub-optimal recognition of the indications for advanced airway management may influence outcomes [47-49]. A recent report from a European group of pre-hospital critical care researchers and physicians identified pre-hospital airway management as a prioritized area for future research [50].

Conclusions

The results of this review suggest that EMS systems in which non-physicians perform ETIs have significantly more failed intubations than systems in which physicians perform ETIs. This increase persists in non-physician systems where muscle paralytics are used and where comprehensive training is provided. If pre-hospital anaesthesia is to be conducted, it should be performed to the highest standards, which includes an intubation success rate close to 100%. This review suggests that this level of performance is currently found only in physician-manned services. Substituting existing physicians with even well-trained non-physicians brings with it significant patient safety issues. It may be that where pre-hospital EMS-physicians are not available, concentrating on basic and advanced airway management techniques other than ETI should be strongly considered in a highly performing EMS system.

Key messages

• Pre-hospital emergency tracheal intubation (ETI) is provided by both physicians and non-physicians, and the published studies report a wide range in success rates from different emergency medical service (EMS) systems.

• EMS-physicians have ETI success rates close to 100% and significantly higher than non-physicians.

• ETI is a potentially hazardous intervention, especially when conducted with muscle paralytics, and failed intubation increases the risk of severe adverse events and fatal outcome.

• In the absence of pre-hospital physicians, conducting basic and advanced airway techniques other than ETI should be strongly considered.

Abbreviations

ETI: emergency tracheal intubation; EMS: emergency medical services; RSI: rapid sequence induction

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

HML and DJL conceived and planned the study. HML performed the literature review and JR performed the meta-analysis. All authors contributed to writing a draft, and HML wrote the final manuscript, which was read and approved by all the authors.

Additional file 1

Overview of included studies. Aim of study, EMS manning, drugs available on scene, number of ETI attempts, number of ETI's successfully conducted, and reported success rate extracted from the 33 reviewed studies. EMS, emergency medical service; ETI, emergency tracheal intubation; RSI, rapid sequence induction.

Click here for file