Samuel Henry Howitt1,2, Camila Caiado3, Charles McCollum1, Michael Goldstein3, Ignacio Malagon2, Rajamiyer Venkateswaran4, Stuart William Grant1. 1. Institute of Cardiovascular Sciences, University of Manchester, Manchester, England, United Kingdom of Great Britain and Northern Ireland. 2. Department of Cardiothoracic Anaesthesia and Critical Care, University Hospital of South Manchester NHS Foundation Trust, Manchester, United Kingdom of Great Britain and Northern Ireland. 3. Department of Statistics, Durham University, Durham, United Kingdom of Great Britain and Northern Ireland. 4. Department of Cardiothoracic Surgery, University Hospital of South Manchester NHS Foundation Trust, Manchester, England, United Kingdom of Great Britain and Northern Ireland.
Abstract
BACKGROUND: Several cardiac surgery risk prediction models based on postoperative data have been developed. However, unlike preoperative cardiac surgery risk prediction models, postoperative models are rarely externally validated or utilized by clinicians. The objective of this study was to externally validate three postoperative risk prediction models for intensive care unit (ICU) mortality after cardiac surgery. METHODS: The logistic Cardiac Surgery Scores (logCASUS), Rapid Clinical Evaluation (RACE), and Sequential Organ Failure Assessment (SOFA) scores were calculated over the first 7 postoperative days for consecutive adult cardiac surgery patients between January 2013 and May 2015. Model discrimination was assessed using receiver operating characteristic curve analyses. Calibration was assessed using the Hosmer-Lemeshow (HL) test, calibration plots, and observed to expected ratios. Recalibration of the models was performed. RESULTS: A total of 2255 patients were included with an ICU mortality rate of 1.8%. Discrimination for all three models on each postoperative day was good with areas under the receiver operating characteristic curve of >0.8. Generally, RACE and logCASUS had better discrimination than SOFA. Calibration of the RACE score was better than logCASUS, but ratios of observed to expected mortality for both were generally <0.65. Locally recalibrated SOFA, logCASUS and RACE models all performed well. CONCLUSION: All three models demonstrated good discrimination for the first 7 days after cardiac surgery. After recalibration, logCASUS and RACE scores appear to be most useful for daily risk prediction after cardiac surgery. If appropriately calibrated, postoperative cardiac surgery risk prediction models have the potential to be useful tools after cardiac surgery. Georg Thieme Verlag KG Stuttgart · New York.
BACKGROUND: Several cardiac surgery risk prediction models based on postoperative data have been developed. However, unlike preoperative cardiac surgery risk prediction models, postoperative models are rarely externally validated or utilized by clinicians. The objective of this study was to externally validate three postoperative risk prediction models for intensive care unit (ICU) mortality after cardiac surgery. METHODS: The logistic Cardiac Surgery Scores (logCASUS), Rapid Clinical Evaluation (RACE), and Sequential Organ Failure Assessment (SOFA) scores were calculated over the first 7 postoperative days for consecutive adult cardiac surgery patients between January 2013 and May 2015. Model discrimination was assessed using receiver operating characteristic curve analyses. Calibration was assessed using the Hosmer-Lemeshow (HL) test, calibration plots, and observed to expected ratios. Recalibration of the models was performed. RESULTS: A total of 2255 patients were included with an ICU mortality rate of 1.8%. Discrimination for all three models on each postoperative day was good with areas under the receiver operating characteristic curve of >0.8. Generally, RACE and logCASUS had better discrimination than SOFA. Calibration of the RACE score was better than logCASUS, but ratios of observed to expected mortality for both were generally <0.65. Locally recalibrated SOFA, logCASUS and RACE models all performed well. CONCLUSION: All three models demonstrated good discrimination for the first 7 days after cardiac surgery. After recalibration, logCASUS and RACE scores appear to be most useful for daily risk prediction after cardiac surgery. If appropriately calibrated, postoperative cardiac surgery risk prediction models have the potential to be useful tools after cardiac surgery. Georg Thieme Verlag KG Stuttgart · New York.