Jamie John Kirkham1, Omar Bouamra. 1. Centre for Medical Statistics and Health Evaluation, Shelley's Cottage, University of Liverpool, Liverpool, United Kingdom. j.j.kirkham@liv.ac.uk
Abstract
BACKGROUND: In recent years, performance monitoring has gained increasing attention as a tool for evaluating the delivery of health care services and is a topic of increasing importance in trauma systems. The main objective of this article is to illustrate a proactive method for assessing the performance of trauma centers in England and Wales, while taking into account common causes of variation. The aim is to present a methodology that is easily interpretable and avoids the spurious ranking of hospitals which can often lead to the misinterpretation on what is perceived to be the best and worst performing hospital, as measured by a prespecified performance indicator. METHODS: The Ws statistic was introduced over 10 years ago to quantify the performance of trauma care systems through definitive outcome based evaluation (DEF) methods. Little advancement on this methodology has been made since its introduction. In this article, we highlight some of the limitations and problems associated with these DEF methods and introduce the funnel plot, a form of control chart to monitor hospital performance. RESULTS: The number of patients included in a Ws statistical analysis can seriously change the ranking of a hospital. These complex issues with ranking means that league tables (or standings charts), which form part of the DEF method are an unsatisfactory method to represent performance indicators. The funnel plot methodology is an alternative graphical method for monitoring hospital performance, which has no emphasis on ranking. We demonstrate the method using mortality data and length of stay as the performance indicators. CONCLUSION: The funnel plot is a flexible, attractively simple method for comparing hospital performance and avoids spurious ranking of hospitals in league tables. The method can be applied to any number of performance indicators and can help formulate hypotheses about individual hospital characteristics likely to improve performance.
BACKGROUND: In recent years, performance monitoring has gained increasing attention as a tool for evaluating the delivery of health care services and is a topic of increasing importance in trauma systems. The main objective of this article is to illustrate a proactive method for assessing the performance of trauma centers in England and Wales, while taking into account common causes of variation. The aim is to present a methodology that is easily interpretable and avoids the spurious ranking of hospitals which can often lead to the misinterpretation on what is perceived to be the best and worst performing hospital, as measured by a prespecified performance indicator. METHODS: The Ws statistic was introduced over 10 years ago to quantify the performance of trauma care systems through definitive outcome based evaluation (DEF) methods. Little advancement on this methodology has been made since its introduction. In this article, we highlight some of the limitations and problems associated with these DEF methods and introduce the funnel plot, a form of control chart to monitor hospital performance. RESULTS: The number of patients included in a Ws statistical analysis can seriously change the ranking of a hospital. These complex issues with ranking means that league tables (or standings charts), which form part of the DEF method are an unsatisfactory method to represent performance indicators. The funnel plot methodology is an alternative graphical method for monitoring hospital performance, which has no emphasis on ranking. We demonstrate the method using mortality data and length of stay as the performance indicators. CONCLUSION: The funnel plot is a flexible, attractively simple method for comparing hospital performance and avoids spurious ranking of hospitals in league tables. The method can be applied to any number of performance indicators and can help formulate hypotheses about individual hospital characteristics likely to improve performance.
Authors: Ida Füglistaler-Montali; Corinna Attenberger; Philipp Füglistaler; Augustinus L Jacob; Felix Amsler; Thomas Gross Journal: World J Surg Date: 2009-11 Impact factor: 3.352