OBJECTIVES: Hospitals are being required to report publically their adjusted mortality rates, which are then being used to rank hospitals. Our objectives were to assess the statistical reliability of the determination of a hospital's adjusted mortality rate, of comparisons of that rate with the rates of other hospitals, and of the use of those rates to rank the hospitals. METHODS: A cross-sectional study of 473 383 patients discharged from 42 US children's hospitals in 2008 was performed. Hospital-specific observed/expected (O/E) mortality rate ratios and corresponding hospital rankings, with 95% confidence intervals (CIs), were examined. RESULTS: Hospitals' O/E mortality rate ratios exhibited wide 95% CIs, and no hospital was clearly distinguishable from the other hospitals' aggregated mean mortality performance. Only 2 hospitals' mortality performance fell outside the comparator hospitals' 95% CI. Those hospitals' 95% CIs overlapped with the overall comparator set's 95% CI, which suggests that there were no statistically significant hospital outliers. Fourteen (33.3%) of the 42 hospitals had O/E ratios that were not statistically different from being in the 95% CI of the top 10% of hospitals. Hospital-specific mortality rate rankings displayed even broader 95% CIs; the typical hospital had a 95% CI range that spanned 22 rank-order positions. CONCLUSION: Children's hospital-specific measures of adjusted mortality rate ratios and rankings have substantial amounts of statistical imprecision, which limits the usefulness of such measures for comparisons of quality of care.
OBJECTIVES: Hospitals are being required to report publically their adjusted mortality rates, which are then being used to rank hospitals. Our objectives were to assess the statistical reliability of the determination of a hospital's adjusted mortality rate, of comparisons of that rate with the rates of other hospitals, and of the use of those rates to rank the hospitals. METHODS: A cross-sectional study of 473 383 patients discharged from 42 US children's hospitals in 2008 was performed. Hospital-specific observed/expected (O/E) mortality rate ratios and corresponding hospital rankings, with 95% confidence intervals (CIs), were examined. RESULTS: Hospitals' O/E mortality rate ratios exhibited wide 95% CIs, and no hospital was clearly distinguishable from the other hospitals' aggregated mean mortality performance. Only 2 hospitals' mortality performance fell outside the comparator hospitals' 95% CI. Those hospitals' 95% CIs overlapped with the overall comparator set's 95% CI, which suggests that there were no statistically significant hospital outliers. Fourteen (33.3%) of the 42 hospitals had O/E ratios that were not statistically different from being in the 95% CI of the top 10% of hospitals. Hospital-specific mortality rate rankings displayed even broader 95% CIs; the typical hospital had a 95% CI range that spanned 22 rank-order positions. CONCLUSION:Children's hospital-specific measures of adjusted mortality rate ratios and rankings have substantial amounts of statistical imprecision, which limits the usefulness of such measures for comparisons of quality of care.
Authors: Renato A Apolito; Mark A Greenberg; Mark A Menegus; April M Lowe; Lynn A Sleeper; Mark H Goldberger; Joshua Remick; Martha J Radford; Judith S Hochman Journal: Am Heart J Date: 2007-12-19 Impact factor: 4.749
Authors: Robert O Bonow; Frederick A Masoudi; John S Rumsfeld; Elizabeth Delong; N A Mark Estes; David C Goff; Kathleen Grady; Lee A Green; Ann R Loth; Eric D Peterson; Ileana L Piña; Martha J Radford; David M Shahian Journal: Circulation Date: 2008-11-12 Impact factor: 29.690
Authors: Michael B Rothberg; Elizabeth Morsi; Evan M Benjamin; Penelope S Pekow; Peter K Lindenauer Journal: Health Aff (Millwood) Date: 2008 Nov-Dec Impact factor: 6.301
Authors: Steven M Steinberg; Michael R Popa; Judith A Michalek; Matthew J Bethel; E Christopher Ellison Journal: Surgery Date: 2008-10 Impact factor: 3.982
Authors: Jay G Berry; Alan M Zaslavsky; Sara L Toomey; Alyna T Chien; Jisun Jang; Maria C Bryant; David J Klein; William J Kaplan; Mark A Schuster Journal: Pediatrics Date: 2015-07-13 Impact factor: 7.124
Authors: JoAnna K Leyenaar; Shawn L Ralston; Meng-Shiou Shieh; Penelope S Pekow; Rita Mangione-Smith; Peter K Lindenauer Journal: J Hosp Med Date: 2016-07-04 Impact factor: 2.960
Authors: Ryan P Barbaro; Philip S Boonstra; Matthew L Paden; Lloyd A Roberts; Gail M Annich; Robert H Bartlett; Frank W Moler; Matthew M Davis Journal: Intensive Care Med Date: 2016-03-23 Impact factor: 17.440