Ineke van der Wulp1, Henk F van Stel. 1. Department of Public Health, Julius Center for Health Sciences and Primary Care, UMC Utrecht, Utrecht, The Netherlands. I.vanderwulp@umcutrecht.nl
Abstract
OBJECTIVE: Mistriage can have serious consequences for patients with urgent complaints. We therefore reviewed the assessment of triage-reliability, and propose an alternative weighted kappa that accounts for severity of mistriage. STUDY DESIGN AND SETTING: A systematic literature search was performed in three online databases and a search engine. An alternative kappa weighting scheme was developed (triage-weighted kappa), and kappas of previous conducted reliability studies were recalculated. RESULTS: Kappa is the most frequently used statistic in triage-reliability studies (n=33). More than half of the studies did not report the type of kappa that was used. Linear and quadratically weighted kappa values do not reflect the seriousness of mistriage. Several studies reported almost perfect agreement, whereas percentages of mistriage ranged between 11.1% and 43.4%. In all studies, triage-weighted kappa was lower than reported kappas with a mean difference of 0.17 (range: 0.04-0.32). CONCLUSION: No existing studies on reliability of triage systems account for mistriage. Using triage-weighted kappa, which reflects severity of mistriage, shows that the reliability of triage systems is lower than reported.
OBJECTIVE: Mistriage can have serious consequences for patients with urgent complaints. We therefore reviewed the assessment of triage-reliability, and propose an alternative weighted kappa that accounts for severity of mistriage. STUDY DESIGN AND SETTING: A systematic literature search was performed in three online databases and a search engine. An alternative kappa weighting scheme was developed (triage-weighted kappa), and kappas of previous conducted reliability studies were recalculated. RESULTS: Kappa is the most frequently used statistic in triage-reliability studies (n=33). More than half of the studies did not report the type of kappa that was used. Linear and quadratically weighted kappa values do not reflect the seriousness of mistriage. Several studies reported almost perfect agreement, whereas percentages of mistriage ranged between 11.1% and 43.4%. In all studies, triage-weighted kappa was lower than reported kappas with a mean difference of 0.17 (range: 0.04-0.32). CONCLUSION: No existing studies on reliability of triage systems account for mistriage. Using triage-weighted kappa, which reflects severity of mistriage, shows that the reliability of triage systems is lower than reported.
Authors: Pierre Elias; Ash Damle; Michael Casale; Kim Branson; Chaitanya Churi; Ravi Komatireddy; Jamison Feramisco Journal: JMIR Med Inform Date: 2015-06-10
Authors: Yuncheol Kang; Melinda R Steis; Ann M Kolanowski; Donna Fick; Vittaldas V Prabhu Journal: BMC Med Inform Decis Mak Date: 2016-07-26 Impact factor: 2.796
Authors: Ayesha Khan; S V Mahadevan; Andrea Dreyfuss; James Quinn; Joan Woods; Koy Somontha; Matthew Strehlow Journal: Emerg Med J Date: 2016-07-27 Impact factor: 2.740
Authors: Elisabeth Sybilla Johanna van Gils-van Rooij; Sjoerd Michael Broekman; Dingenus Herman de Bakker; Berthold Rudy Meijboom; Christoffel Joris Yzermans Journal: BMC Health Serv Res Date: 2018-02-17 Impact factor: 2.655