R Wuerz1, C M Fernandes, J Alarcon. 1. Center for Emergency Medical Services, Penn State College of Medicine, Hershey, USA.
Abstract
STUDY OBJECTIVE: To measure the interrater and intrarater agreement of existing emergency department triage systems. METHODS: This 2-phase experimental study of triage nurses' and EMTs ratings for 5 scripted patient scenarios used in-person interviews and follow-up written surveys. RESULTS: Eighty-seven participants (> 90% of those eligible) with 55 (63%) completed both phases of the study. Interrater agreement on triage category was poor (kappa = .347 overall). Only 13 of 55 (24%) participants rated the 5 cases the same severity in both phases; Kendall correlation (iota-B) comparing phases 1 and 2 varied from .145 to .554. Estimates of admission probability varied widely. Estimates of the appropriate time to physician evaluation (from immediate to 24 hours) was often incongruous with severity ratings (e.g., 54% of those participants rating a case the lowest severity recommended evaluation within 8 hours). There was good agreement on estimated need for an ED monitored bed or diagnostic studies. CONCLUSION: Triage assessments (both interrater and intrarater) by experienced personnel are inconsistent using these 5 standardized patient scenarios. These results challenge the reliability of current ED triage practice.
STUDY OBJECTIVE: To measure the interrater and intrarater agreement of existing emergency department triage systems. METHODS: This 2-phase experimental study of triage nurses' and EMTs ratings for 5 scripted patient scenarios used in-person interviews and follow-up written surveys. RESULTS: Eighty-seven participants (> 90% of those eligible) with 55 (63%) completed both phases of the study. Interrater agreement on triage category was poor (kappa = .347 overall). Only 13 of 55 (24%) participants rated the 5 cases the same severity in both phases; Kendall correlation (iota-B) comparing phases 1 and 2 varied from .145 to .554. Estimates of admission probability varied widely. Estimates of the appropriate time to physician evaluation (from immediate to 24 hours) was often incongruous with severity ratings (e.g., 54% of those participants rating a case the lowest severity recommended evaluation within 8 hours). There was good agreement on estimated need for an ED monitored bed or diagnostic studies. CONCLUSION: Triage assessments (both interrater and intrarater) by experienced personnel are inconsistent using these 5 standardized patient scenarios. These results challenge the reliability of current ED triage practice.
Authors: Michael Christ; Florian Grossmann; Daniela Winter; Roland Bingisser; Elke Platz Journal: Dtsch Arztebl Int Date: 2010-12-17 Impact factor: 5.594
Authors: Pierre Elias; Ash Damle; Michael Casale; Kim Branson; Chaitanya Churi; Ravi Komatireddy; Jamison Feramisco Journal: JMIR Med Inform Date: 2015-06-10