G J Parry1, C R Gould, C J McCabe, W O Tarnow-Mordi. 1. Medical Care Research Unit, School of Health and Related Research, University of Sheffield, Sheffield S3 7XL. g.parry@sheffield.ac.uk
Abstract
OBJECTIVE: To assess whether crude league tables of mortality and league tables of risk adjusted mortality accurately reflect the performance of hospitals. DESIGN: Longitudinal study of mortality occurring in hospital. SETTING: 9 neonatal intensive care units in the United Kingdom. SUBJECTS: 2671 very low birth weight or preterm infants admitted to neonatal intensive care units between 1988 and 1994. MAIN OUTCOME MEASURES: Crude hospital mortality and hospital mortality adjusted using the clinical risk index for babies (CRIB) score. RESULTS: Hospitals had wide and overlapping confidence intervals when ranked by mortality in annual league tables; this made it impossible to discriminate between hospitals reliably. In most years there was no significant difference between hospitals, only random variation. The apparent performance of individual hospitals fluctuated substantially from year to year. CONCLUSIONS: Annual league tables are not reliable indicators of performance or best practice; they do not reflect consistent differences between hospitals. Any action prompted by the annual league tables would have been equally likely to have been beneficial, detrimental, or irrelevant. Mortality should be compared between groups of hospitals using specific criteria-such as differences in the volume of patients, staffing policy, training of staff, or aspects of clinical practice-after adjusting for risk. This will produce more reliable estimates with narrower confidence intervals, and more reliable and rapid conclusions.
OBJECTIVE: To assess whether crude league tables of mortality and league tables of risk adjusted mortality accurately reflect the performance of hospitals. DESIGN: Longitudinal study of mortality occurring in hospital. SETTING: 9 neonatal intensive care units in the United Kingdom. SUBJECTS: 2671 very low birth weight or preterm infants admitted to neonatal intensive care units between 1988 and 1994. MAIN OUTCOME MEASURES: Crude hospital mortality and hospital mortality adjusted using the clinical risk index for babies (CRIB) score. RESULTS: Hospitals had wide and overlapping confidence intervals when ranked by mortality in annual league tables; this made it impossible to discriminate between hospitals reliably. In most years there was no significant difference between hospitals, only random variation. The apparent performance of individual hospitals fluctuated substantially from year to year. CONCLUSIONS: Annual league tables are not reliable indicators of performance or best practice; they do not reflect consistent differences between hospitals. Any action prompted by the annual league tables would have been equally likely to have been beneficial, detrimental, or irrelevant. Mortality should be compared between groups of hospitals using specific criteria-such as differences in the volume of patients, staffing policy, training of staff, or aspects of clinical practice-after adjusting for risk. This will produce more reliable estimates with narrower confidence intervals, and more reliable and rapid conclusions.
Authors: R H de Courcy-Wheeler; C D Wolfe; A Fitzgerald; M Spencer; J D Goodman; H R Gamsu Journal: Arch Dis Child Fetal Neonatal Ed Date: 1995-07 Impact factor: 5.747
Authors: Nicole A B M Ketelaar; Marjan J Faber; Signe Flottorp; Liv Helen Rygh; Katherine H O Deane; Martin P Eccles Journal: Cochrane Database Syst Rev Date: 2011-11-09
Authors: Peter P Howley; Stephen J Hancock; Robert W Gibberd; Sheuwen Chuang; Frank A Tuyl Journal: World J Clin Cases Date: 2015-07-16 Impact factor: 1.337