Preparing for emergency: a valid, reliable assessment tool for emergency cricothyroidotomy skills.

OBJECTIVE: Emergency cricothyrodotomy (EC) is a lifesaving procedure. Evidence-based assessment of training effects and competency levels is relevant to all departments involved in emergency airway management. As most training uses low-fidelity models, the predictive value of good performance on such a model becomes relevant with regard to performance on a high-fidelity model (cadaver). This requires a valid assessment tool for EC performance. STUDY
DESIGN: Psychometric study on low-fidelity models and human cadavers.
SETTING: University hospital. SUBJECTS AND METHODS: An assessment tool was created. Sixteen physicians (7 experienced surgeons and 9 novice physicians) performed an EC on a low-fidelity model and a cadaver. Two blinded raters assessed video recordings of performances using the assessment tool.
RESULTS: We found a high interrater reliability, based on a Pearson's r (0.81), and good evidence for validity, based on successfully distinguishing the 2 groups, using an independent samples t test (P < .001). We found a good correlation between performance on a low-fidelity model and the cadaver with an R (2) = 0.78.
CONCLUSION: The tool for assessing EC competence proved reliable and valid. Performance on a low-fidelity model measured this way is a good predictor of performance in a more lifelike situation. © American Academy of Otolaryngology—Head and Neck Surgery Foundation 2014.