Daniel Henneman1, Annelotte C M van Bommel, Alexander Snijders, Heleen S Snijders, Rob A E M Tollenaar, Michel W J M Wouters, Marta Fiocco. 1. *Department of Surgery, Leiden University Medical Center, Leiden, The Netherlands †Faculty of Economics and Business, Department of Econometrics, University of Amsterdam, Amsterdam, The Netherlands ‡Department of Surgery, Netherlands Cancer Institute (NKI)-Antoni van Leeuwenhoek Hospital, Amsterdam, The Netherlands; and §Department of Medical Statistics and Bioinformatics, Leiden University Medical Center, Leiden, The Netherlands.
Abstract
OBJECTIVES: To examine to what extent random variation and variation in case-mix influence hospital rankings on the basis of mortality rates and to determine the suitability of mortality for ranking hospitals in colorectal surgery. BACKGROUND: Comparing and ranking postoperative mortality rates between hospitals becomes increasingly popular. Differences in hospital case-mix, and chance variation related to caseload, may influence rankings. The suitability of mortality for rankings remains unclear. METHODS: Data were derived from the Dutch Surgical Colorectal Audit. Hospital rankings based on fixed- and random-effects logistic regression models, unadjusted and adjusted for case-mix were compared with the percentile based on expected ranks (the chance that a hospital performs better than a random hospital). Rankability, measuring which part of variation between hospitals is not due to chance, was calculated. RESULTS: Some 25,591 patients undergoing colorectal resections in 92 hospitals were evaluated. Postoperative mortality rates ranged between 0% and 8.8%. Adjustment for case-mix with a fixed-effects model caused large changes in rankings. A smaller additional effect on changes in rankings occurred after adjusting with a random-effects model, with lower volume hospitals moving toward the mean. Percentile based on expected ranks ranged between 10% and 85%. Rankability was 38%, meaning that 62% of hospital variation in mortality was due to chance. CONCLUSIONS: Hospital ranks changed after case-mix adjustment and random-effects models, compared with unadjusted analysis. A large proportion of hospital variation in mortality was due to chance. Caution should be warranted when interpreting hospital rankings on the basis of postoperative mortality. Percentiles of expected ranks may help identify hospitals with exceptional performance.
OBJECTIVES: To examine to what extent random variation and variation in case-mix influence hospital rankings on the basis of mortality rates and to determine the suitability of mortality for ranking hospitals in colorectal surgery. BACKGROUND: Comparing and ranking postoperative mortality rates between hospitals becomes increasingly popular. Differences in hospital case-mix, and chance variation related to caseload, may influence rankings. The suitability of mortality for rankings remains unclear. METHODS: Data were derived from the Dutch Surgical Colorectal Audit. Hospital rankings based on fixed- and random-effects logistic regression models, unadjusted and adjusted for case-mix were compared with the percentile based on expected ranks (the chance that a hospital performs better than a random hospital). Rankability, measuring which part of variation between hospitals is not due to chance, was calculated. RESULTS: Some 25,591 patients undergoing colorectal resections in 92 hospitals were evaluated. Postoperative mortality rates ranged between 0% and 8.8%. Adjustment for case-mix with a fixed-effects model caused large changes in rankings. A smaller additional effect on changes in rankings occurred after adjusting with a random-effects model, with lower volume hospitals moving toward the mean. Percentile based on expected ranks ranged between 10% and 85%. Rankability was 38%, meaning that 62% of hospital variation in mortality was due to chance. CONCLUSIONS: Hospital ranks changed after case-mix adjustment and random-effects models, compared with unadjusted analysis. A large proportion of hospital variation in mortality was due to chance. Caution should be warranted when interpreting hospital rankings on the basis of postoperative mortality. Percentiles of expected ranks may help identify hospitals with exceptional performance.
Authors: Hans F Fuchs; Ryan C Broderick; Cristina R Harnsberger; David C Chang; Elisabeth C Mclemore; Sonia Ramamoorthy; Santiago Horgan Journal: Surg Endosc Date: 2014-12-25 Impact factor: 4.584
Authors: Keith A Lawson; Olli Saarela; Zhihui Liu; Luke T Lavallée; Rodney H Breau; Lori Wood; Michael A S Jewett; Anil Kapoor; Simon Tanguay; Ronald B Moore; Ricardo Rendon; Frederic Pouliot; Peter C Black; Jun Kawakami; Darrel Drachenberg; Antonio Finelli Journal: Can Urol Assoc J Date: 2017-08 Impact factor: 1.862
Authors: Patrick J Sweigert; Emanuel Eguia; Marshall S Baker; Christina M Link; J Madison Hyer; Anghela Z Paredes; Diamantis I Tsilimigras; Syed Husain; Timothy M Pawlik Journal: J Gastrointest Surg Date: 2020-08-10 Impact factor: 3.452
Authors: Geert A Simkens; Vic J Verwaal; Valery E Lemmens; Harm J Rutten; Ignace H de Hingh Journal: Medicine (Baltimore) Date: 2016-10 Impact factor: 1.889
Authors: Michael S Calderwood; Ken Kleinman; Susan S Huang; Michael V Murphy; Deborah S Yokoe; Richard Platt Journal: Med Care Date: 2017-01 Impact factor: 2.983
Authors: Marisa Baré; Manuel Jesús Alcantara; Maria José Gil; Pablo Collera; Marina Pont; Antonio Escobar; Cristina Sarasqueta; Maximino Redondo; Eduardo Briones; Paula Dujovne; Jose Maria Quintana Journal: BMC Health Serv Res Date: 2018-01-29 Impact factor: 2.655