J M Pons1, J M Borras, J A Espinas, V Moreno, M Cardona, A Granados. 1. Catalan Agency for Health Technology Assessment and Catalan Institute of Oncology, Catalan Health Service, Department of Health, Generalitat de Catalunya, Barcelona, Spain.
Abstract
BACKGROUND: The aim of this study was to compare the predictive accuracy for open heart surgical mortality between a statistical model based on collection of clinical data and surgeons' subjective risk assessment. METHODS: Predictive discrimination of both risk assessments (surgeons' and model) was compared through the area under the receiver operating characteristic curve. Logistic regression analysis was used to assess the relation between surgeons' and model predictions to actual outcomes. Calibration of the subjective estimates was evaluated with a chi2 test. RESULTS: Overall, the area under the receiver operating characteristic curve was 0.76 for the statistical model and 0.70 for the subjective assessment. Logistic regression analysis showed that the statistical model remained significant after accounting for the subjective assessment. Calibration of subjective mortality predictions was poor. CONCLUSIONS: Surgeons' risk assessment tends to cluster in the middle ranges of risk. Subjective assessment seems accurate in identifying the two extremes of risk but is inaccurate for intermediate risk levels. A multivariate statistical model improves the accuracy of subjective predictions.
BACKGROUND: The aim of this study was to compare the predictive accuracy for open heart surgical mortality between a statistical model based on collection of clinical data and surgeons' subjective risk assessment. METHODS: Predictive discrimination of both risk assessments (surgeons' and model) was compared through the area under the receiver operating characteristic curve. Logistic regression analysis was used to assess the relation between surgeons' and model predictions to actual outcomes. Calibration of the subjective estimates was evaluated with a chi2 test. RESULTS: Overall, the area under the receiver operating characteristic curve was 0.76 for the statistical model and 0.70 for the subjective assessment. Logistic regression analysis showed that the statistical model remained significant after accounting for the subjective assessment. Calibration of subjective mortality predictions was poor. CONCLUSIONS: Surgeons' risk assessment tends to cluster in the middle ranges of risk. Subjective assessment seems accurate in identifying the two extremes of risk but is inaccurate for intermediate risk levels. A multivariate statistical model improves the accuracy of subjective predictions.
Authors: Xinsong Du; Jae Min; Chintan P Shah; Rohit Bishnoi; William R Hogan; Dominick J Lemas Journal: Int J Med Inform Date: 2020-04-15 Impact factor: 4.046
Authors: Jared P Beller; Robert B Hawkins; J Hunter Mehaffey; William Z Chancellor; Clifford E Fonner; Alan M Speir; Mohammed A Quader; Jeffrey B Rich; Leora T Yarboro; Nicholas R Teman; Gorav Ailawadi Journal: J Thorac Cardiovasc Surg Date: 2019-02-11 Impact factor: 5.209
Authors: Christine E Haugen; Dayawa Agoons; Nadia M Chu; Luckimini Liyanage; Jane Long; Niraj M Desai; Silas P Norman; Daniel C Brennan; Dorry L Segev; Mara McAdams-DeMarco Journal: Transplantation Date: 2020-02 Impact factor: 5.385