Kelly Ann Schmidtke1, Alan J Poots2, Juan Carpio1, Ivo Vlaev1, Ngianga-Bakwin Kandala3,4, Richard J Lilford5. 1. Warwick Business School, University of Warwick, Coventry, UK. 2. National Institute for Health Research (NIHR) Collaboration for Leadership in Applied Health Research and Care (CLAHRC) North West London (NWL), Imperial College London, London, UK. 3. Department of Mathematics and Information Sciences, Faculty of Engineering and Environment, Northumbria University, Newcastle upon Tyne, UK. 4. Health Economics and Evidence Synthesis Research Unit, Department of Population Health, Luxembourg Institute of Health, Strassen, Luxembourg. 5. Department of Public Health, University of Warwick, Coventry, UK.
Abstract
OBJECTIVES: Hospital board members are asked to consider large amounts of quality and safety data with a duty to act on signals of poor performance. However, in order to do so it is necessary to distinguish signals from noise (chance). This article investigates whether data in English National Health Service (NHS) acute care hospital board papers are presented in a way that helps board members consider the role of chance in their decisions. METHODS: Thirty English NHS trusts were selected at random and their board papers retrieved. Charts depicting quality and safety were identified. Categorical discriminations were then performed to document the methods used to present quality and safety data in board papers, with particular attention given to whether and how the charts depicted the role of chance, that is, by including control lines or error bars. RESULTS: Thirty board papers, containing a total of 1488 charts, were sampled. Only 88 (6%) of these charts depicted the role of chance, and only 17 of the 30 board papers included any charts depicting the role of chance. Of the 88 charts that attempted to represent the role of chance, 16 included error bars and 72 included control lines. Only 6 (8%) of the 72 control charts indicated where the control lines had been set (eg, 2 vs 3 SDs). CONCLUSIONS: Hospital board members are expected to consider large amounts of information. Control charts can help board members distinguish signals from noise, but often boards are not using them. We discuss demand-side and supply-side barriers that could be overcome to increase use of control charts in healthcare. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.
OBJECTIVES: Hospital board members are asked to consider large amounts of quality and safety data with a duty to act on signals of poor performance. However, in order to do so it is necessary to distinguish signals from noise (chance). This article investigates whether data in English National Health Service (NHS) acute care hospital board papers are presented in a way that helps board members consider the role of chance in their decisions. METHODS: Thirty English NHS trusts were selected at random and their board papers retrieved. Charts depicting quality and safety were identified. Categorical discriminations were then performed to document the methods used to present quality and safety data in board papers, with particular attention given to whether and how the charts depicted the role of chance, that is, by including control lines or error bars. RESULTS: Thirty board papers, containing a total of 1488 charts, were sampled. Only 88 (6%) of these charts depicted the role of chance, and only 17 of the 30 board papers included any charts depicting the role of chance. Of the 88 charts that attempted to represent the role of chance, 16 included error bars and 72 included control lines. Only 6 (8%) of the 72 control charts indicated where the control lines had been set (eg, 2 vs 3 SDs). CONCLUSIONS: Hospital board members are expected to consider large amounts of information. Control charts can help board members distinguish signals from noise, but often boards are not using them. We discuss demand-side and supply-side barriers that could be overcome to increase use of control charts in healthcare. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.
Entities:
Keywords:
Control charts, run charts; Decision making; Governance; Statistical process control
Authors: Samuel Pannick; Stephanie Archer; Susannah Jane Long; Fran Husson; Thanos Athanasiou; Nick Sevdalis Journal: BMJ Open Date: 2019-03-30 Impact factor: 2.692
Authors: Jenny Neuburger; Kate Walker; Chris Sherlaw-Johnson; Jan van der Meulen; David A Cromwell Journal: BMJ Qual Saf Date: 2017-09-25 Impact factor: 7.035
Authors: Ruth Baxter; Natalie Taylor; Ian Kellar; Victoria Pye; Mohammed A Mohammed; Rebecca Lawton Journal: BMJ Open Date: 2018-02-16 Impact factor: 2.692