BACKGROUND: Countries around the world are currently aiming to improve patient safety by means of the Institute for Healthcare Improvement global trigger tool (GTT), which is considered a valid tool for evaluating and measuring patient safety within organisations. So far, only few data on the measurement properties and utility of the GTT have been published. AIMS: To determine and evaluate the effect of interrater variation between review teams on the standard outcome measures of the GTT and to assess and quantify measurement error of the GTT. METHODS: Retrospective chart reviews were conducted on identical charts by two independent review teams in 2010 at a department of oncology in a university hospital. Standard GTT outcome measurements were obtained and compared between teams using statistical process control (SPC) charts. A Bland-Altman plot assessed measurement error and limits of agreement. RESULTS: Only 31% of adverse events (AE) were identified by both teams, and further differences in categorisation of identical events was found. Moderate interrater agreement (κ=0.45) between teams gave rise to different conclusions on the patient safety process when monitoring using SPC charts. The Bland-Altman plot suggests little systematic error but large random error. CONCLUSIONS: Review teams may identify different AE and reach different conclusions on the safety process when using the GTT on identical charts. Tracking true change in the safety level is difficult due to measurement error of the GTT. The results do not encourage further use of the GTT until additional evaluation studies on the measurement properties of the GTT have been conducted.
BACKGROUND: Countries around the world are currently aiming to improve patient safety by means of the Institute for Healthcare Improvement global trigger tool (GTT), which is considered a valid tool for evaluating and measuring patient safety within organisations. So far, only few data on the measurement properties and utility of the GTT have been published. AIMS: To determine and evaluate the effect of interrater variation between review teams on the standard outcome measures of the GTT and to assess and quantify measurement error of the GTT. METHODS: Retrospective chart reviews were conducted on identical charts by two independent review teams in 2010 at a department of oncology in a university hospital. Standard GTT outcome measurements were obtained and compared between teams using statistical process control (SPC) charts. A Bland-Altman plot assessed measurement error and limits of agreement. RESULTS: Only 31% of adverse events (AE) were identified by both teams, and further differences in categorisation of identical events was found. Moderate interrater agreement (κ=0.45) between teams gave rise to different conclusions on the patient safety process when monitoring using SPC charts. The Bland-Altman plot suggests little systematic error but large random error. CONCLUSIONS: Review teams may identify different AE and reach different conclusions on the safety process when using the GTT on identical charts. Tracking true change in the safety level is difficult due to measurement error of the GTT. The results do not encourage further use of the GTT until additional evaluation studies on the measurement properties of the GTT have been conducted.
Entities:
Keywords:
Adverse events, epidemiology and detection; Patient safety; Performance measures; Statistical process control; Trigger tools
Authors: Allison Lipitz-Snyderman; David Classen; David Pfister; Aileen Killen; Coral L Atoria; Elizabeth Fortier; Andrew S Epstein; Christopher Anderson; Saul N Weingart Journal: J Oncol Pract Date: 2017-01-17 Impact factor: 3.840
Authors: Maria das Dores Graciano Silva; Maria Auxiliadora Parreiras Martins; Luciana de Gouvêa Viana; Luiz Guilherme Passaglia; Renata Rezende de Menezes; João Antonio de Queiroz Oliveira; Jose Luiz Padilha da Silva; Antonio Luiz Pinho Ribeiro Journal: Br J Clin Pharmacol Date: 2018-07-08 Impact factor: 4.335
Authors: Allison Lipitz-Snyderman; Saul N Weingart; Christopher Anderson; Andrew S Epstein; Aileen Killen; David Classen; Camelia S Sima; Elizabeth Fortier; Coral L Atoria; David Pfister; Allison Lipitz-Snyderman; Saul N Weingart; Christopher Anderson; Andrew S Epstein; Aileen Killen; David Classen; Camelia S Sima; Elizabeth Fortier; Coral L Atoria; David Pfister Journal: J Oncol Pract Date: 2016-02 Impact factor: 3.840
Authors: Lipika Samal; Srijesa Khasnabish; Cathy Foskett; Katherine Zigmont; Arild Faxvaag; Frank Chang; Marsha Clements; Sarah Collins Rossetti; Anuj K Dalal; Kathleen Leone; Stuart Lipsitz; Anthony Massaro; Ronen Rozenblum; Kumiko O Schnock; Catherine Yoon; David W Bates; Patricia C Dykes Journal: J Patient Saf Date: 2022-07-21 Impact factor: 2.243
Authors: Donald A Kennerly; Rustam Kudyakov; Briget da Graca; Margaret Saldaña; Jan Compton; David Nicewander; Richard Gilder Journal: Health Serv Res Date: 2014-03-13 Impact factor: 3.402
Authors: Richard T Griffey; Ryan M Schneider; Brian R Sharp; Jeff Pothof; Marie C Vrablik; Nic Granzella; Alexandre A Todorov; Lee Adler Journal: J Patient Saf Date: 2021-12-01 Impact factor: 2.844