| Literature DB >> 36157418 |
Xin Xue1,2, Zhiyong Liu1, Tao Xue1, Wen Chen3, Xin Chen2,3.
Abstract
Cardiac surgery-associated acute kidney injury (CSA-AKI) is the most prevalent major complication of cardiac surgery and exerts a negative effect on a patient's prognosis, thereby leading to mortality. Although several risk assessment models have been developed for patients undergoing cardiac surgery, their performances are unsatisfactory. In this study, a machine learning algorithm was employed to obtain better predictive power for CSA-AKI outcomes relative to statistical analysis. In addition, random forest (RF), logistic regression with LASSO regularization, extreme gradient boosting (Xgboost), and support vector machine (SVM) methods were employed for feature selection and model training. Moreover, the calibration capacity and differentiation ability of the model was assessed using net reclassification improvement (NRI) along with Brier scores and receiver operating characteristic (ROC) curves, respectively. A total of 44 patients suffered AKI after surgery. Fatty acid-binding protein (FABP), hemojuvelin (HJV), neutrophil gelatinase-associated lipocalin (NGAL), mechanical ventilation time, and troponin I (TnI) were correlated significantly with the incidence of AKI. RF was the best model for predicting AKI (Brier score: 0.137, NRI: 0.221), evidenced by an AUC value of 0.858 [95% confidence interval (CI): 0.792-0.923]. Overall, RF exhibited the best performance as compared to other machine learning algorithms. These results thus provide new insights into the early identification of CSA-AKI.Entities:
Keywords: acute kidney injury; cardiac surgery; machine learning; random forest; risk model
Year: 2022 PMID: 36157418 PMCID: PMC9490319 DOI: 10.3389/fsurg.2022.946610
Source DB: PubMed Journal: Front Surg ISSN: 2296-875X
Demographic and clinical characteristics of patients with or without AKI after cardiac surgery.
| Variable | non-AKI (N = 91) | AKI (N = 44) | P Value |
|---|---|---|---|
| Gender (%) | 0.106 | ||
| Male | 45 (49.5) | 29 (65.9) | |
| Female | 46 (50.5) | 15 (34.1) | |
| Age (mean (SD)) | 59.58 (11.33) | 62.52 (10.35) | 0.149 |
| Height (mean (SD)) | 163.51 (8.77) | 164.39 (8.79) | 0.585 |
| Weight (mean (SD)) | 65.03 (10.76) | 65.93 (10.13) | 0.644 |
| BMI (mean (SD)) | 1.79 (0.17) | 1.81 (0.16) | 0.593 |
| Smoke (%) | 0.148 | ||
| No | 72 (79.1) | 29 (65.9) | |
| Yes | 19 (20.9) | 15 (34.1) | |
| Drink (%) | 0.141 | ||
| No | 88 (96.7) | 39 (88.6) | |
| Yes | 3 (3.3) | 5 (11.4) | |
| Diabetes (%) | 1.000 | ||
| No | 69 (75.8) | 33 (75.0) | |
| Yes | 22 (24.2) | 11 (25.0) | |
| Hypertension (%) | 0.634 | ||
| No | 40 (44.0) | 22 (50.0) | |
| Yes | 51 (56.0) | 22 (50.0) | |
| CRF (%) | 0.141 | ||
| No | 88 (96.7) | 39 (88.6) | |
| Yes | 3 (3.3) | 5 (11.4) | |
| AF (%) | 1.000 | ||
| No | 75 (82.4) | 37 (84.1) | |
| Yes | 16 (17.6) | 7 (15.9) | |
| Hb (mean (SD)) | 131.65 (18.38) | 134.36 (21.74) | 0.453 |
| Wb (mean (SD)) | 39.99 (3.01) | 38.88 (3.26) | 0.052 |
| hCT (mean (SD)) | 25.38 (3.65) | 24.61 (4.90) | 0.307 |
| CVP (mean (SD)) | 8.32 (3.18) | 9.02 (3.94) | 0.268 |
| EF (mean (SD)) | 60.97 (7.89) | 58.14 (9.18) | 0.067 |
| TnI (mean (SD)) | 0.70 (1.62) | 2.06 (2.85) | 0.001 |
| FABP (mean (SD)) | 3.71 (2.35) | 6.28 (3.53) | <0.001 |
| NT-prBNP (mean (SD)) | 556.15 (1092.79) | 947.94 (735.79) | 0.033 |
| NGAL (mean (SD)) | 64.53 (18.77) | 85.04 (20.96) | <0.001 |
| HJV (mean (SD)) | 53.72 (15.52) | 65.31 (18.12) | <0.001 |
| DKK3 (mean (SD)) | 1073.72 (364.45) | 1265.71 (400.68) | 0.006 |
| CAG (%) | 0.509 | ||
| No | 13 (14.3) | 9 (20.5) | |
| Yes | 78 (85.7) | 35 (79.5) | |
| Interval Time (mean (SD)) | 6.15 (6.24) | 7.93 (15.98) | 0.355 |
| CPBT (mean (SD)) | 108.96 (33.15) | 123.41 (43.37) | 0.034 |
| Urine dropout (mean (SD)) | 254.51 (198.94) | 213.98 (173.72) | 0.25 |
| Ultrafiltration volume (mean (SD)) | 1586.37 (1014.57) | 1967.05 (1175.57) | 0.055 |
| Aortic occlusion time (mean (SD)) | 74.13 (25.55) | 80.93 (28.84) | 0.167 |
| Erythrocyte infusion (mean (SD)) | 0.10 (0.30) | 0.18 (0.39) | 0.176 |
| Hospitalization time (mean (SD)) | 17.38 (7.19) | 18.66 (5.85) | 0.308 |
| ICU length of stay (mean (SD)) | 1.48 (1.06) | 3.05 (3.65) | <0.001 |
| Mechanical ventilation time (mean (SD)) | 9.63 (4.87) | 21.27 (30.23) | <0.001 |
| Cleveland (mean (SD)) | 1.68 (1.39) | 2.02 (1.07) | 0.153 |
Note: Single operation is either coronary artery bypass grafting, heart valve surgery, great vascular surgery, valve replacement or valve plasty.
Univariate, multivariate logistic regression and ROC analysis.
| Variable | Univariate analysis | NA | Multivariate analysis | NA | Roc analysis |
|---|---|---|---|---|---|
| OR (95% CI) | OR (95% CI) | AUC (95% CI) | |||
| Gender | 0.506 (0.240–1.068) | 0.074 | NA | 0.582 (0.495–0.67) | |
| Age | 1.026 (0.991–1.062) | 0.150 | NA | 0.573 (0.467–0.678) | |
| Height | 1.012 (0.971–1.055) | 0.582 | NA | 0.537 (0.433–0.64) | |
| Weight | 1.008 (0.974–1.043) | 0.641 | NA | 0.536 (0.434–0.639) | |
| BMI | 1.824 (0.208–16.020) | 0.587 | NA | 0.542 (0.439–0.645) | |
| Smoke | 1.960 (0.878–4.373) | 0.100 | NA | 0.566 (0.484–0.648) | |
| Drink | 3.761 (0.856–16.523) | 0.079 | NA | 0.54 (0.489–0.591) | |
| Diabetes | 1.045 (0.454–2.408) | 0.917 | NA | 0.504 (0.426–0.583) | |
| Hypertension | 0.784 (0.381–1.614) | 0.509 | NA | 0.53 (0.44–0.621) | |
| CRF | 3.761 (0.856–16.523) | 0.079 | NA | 0.54 (0.489–0.591) | |
| AF | 0.887 (0.336–2.343) | 0.809 | NA | 0.492 (0.424–0.559) | |
| Hb | 1.007 (0.989–1.026) | 0.448 | NA | 0.525 (0.415–0.635) | |
| Wb | 0.891 (0.791–1.003) | 0.056 | NA | 0.623 (0.521–0.725) | |
| hCT | 0.953 (0.869–1.045) | 0.306 | NA | 0.574 (0.468–0.681) | |
| CVP | 1.062 (0.955–1.182) | 0.267 | NA | 0.544 (0.434–0.655) | |
| EF | 0.962 (0.922–1.003) | 0.072 | NA | 0.611 (0.51–0.712) | |
| TnI | 1.415 (1.106–1.810) | 0.006 | 1.619 (1.187–2.208) | 0.002 | 0.718 (0.626–0.811) |
| FABP | 1.336 (1.164–1.533) | <0.001 | 1.105 (0.925–1.320) | 0.273 | 0.771 (0.688–0.854) |
| NT-prBNP | 1.001 (1.000–1.001) | 0.077 | NA | 0.73 (0.634–0.826) | |
| NGAL | 1.057 (1.033–1.083) | <0.001 | 1.051 (1.021–1.082) | 0.001 | 0.772 (0.684–0.86) |
| HJV | 1.048 (1.021–1.076) | <0.001 | 1.034 (0.999–1.071) | 0.060 | 0.714 (0.616–0.812) |
| DKK3 | 1.001 (1.000–1.003) | 0.008 | 1.001 (0.999–1.002) | 0.267 | 0.669 (0.571–0.767) |
| CAG | 0.648 (0.253–1.657) | 0.365 | NA | 0.469 (0.399–0.539) | |
| Interval time | 1.015 (0.982–1.050) | 0.370 | NA | 0.471 (0.367–0.574) | |
| CPBT | 1.010 (1.001–1.020) | 0.037 | 1.012 (0.998–1.026) | 0.082 | 0.588 (0.481–0.696) |
| Urine dropout | 0.999 (0.997–1.001) | 0.253 | NA | 0.581 (0.478–0.685) | |
| Ultrafiltration volume | 1.000 (1.000–1.001) | 0.058 | NA | 0.597 (0.494–0.701) | |
| Aortic occlusion time | 1.010 (0.996–1.023) | 0.168 | NA | 0.558 (0.452–0.663) | |
| Erythrocyte infusion | 2.025 (0.723–5.670) | 0.179 | NA | 0.541 (0.476–0.607) | |
| Hospitalization time | 1.027 (0.975–1.082) | 0.314 | NA | 0.594 (0.492–0.696) | |
| ICU length of stay | 1.624 (1.178–2.239) | 0.003 | 0.989 (0.638–1.535) | 0.962 | 0.703 (0.613–0.793) |
| Mechanical ventilation time | 1.084 (1.015–1.157) | 0.016 | 1.087 (0.983–1.203) | 0.104 | 0.661 (0.554–0.769) |
| Cleveland | 1.223 (0.926–1.615) | 0.156 | NA | 0.609 (0.513–0.705) |
Figure 1Construction and evaluation of the CSA-AKI prediction model. (A) The five most important clinical features screened using four machine learning algorithms in the entire cohort; (B) schematic diagram of six machine learning algorithms in the training set trained and validated for stable clinical models by five-fold cross-validation; (C) comparison of AUC values among machine learning models, with RF having the largest AUC value; (D) confusion matrix of the best model (RF) in the entire cohort; (E) calibration curve for the RF model; (F) distribution of predicted patient risk of CSA-AKI. CSA-AKI: cardiac surgery-associated acute kidney injury.
Evaluation results of models for AKI risk of patients after cardiac surgery.
| Model | Precision | Recall | F1 score | Accuracy | KS | Error | NRI |
|---|---|---|---|---|---|---|---|
| Logistic regression with a forward selection | 0.765 | 0.591 | 0.667 | 0.807 | 0.577 | 0.193 | 0.000 |
| Logistic regression with a lasso regularization | 0.826 | 0.432 | 0.567 | 0.785 | 0.589 | 0.215 | 0.012 |
| Random forest | 0.812 | 0.591 | 0.684 | 0.822 | 0.600 | 0.178 | 0.221 |
| Support vector machine (linear kernel) | 0.735 | 0.568 | 0.641 | 0.793 | 0.469 | 0.207 | 0.001 |
| Support vector machine (radial basis function) | 0.758 | 0.568 | 0.649 | 0.800 | 0.471 | 0.200 | 0.002 |
| Extreme Gradient Boosting | 0.625 | 0.568 | 0.595 | 0.748 | 0.489 | 0.252 | −0.113 |
Note: KS: Kolmogorov-Smirnov; NRI: net reclassification improvement.
Figure 2Quantifying patients’ risk of CSA-AKI. (A) Nomogram used to quantify the risk of CSA-AKI in patients. Redline presents the detailed score of a certain patient, with a total of 101 points and a 29.1% risk of developing CSA-AKI; (B) calibration curve for the nomogram; (C) DCA curves for performance comparisons between clinical characteristics alone, the RF model, and the nomogram by plotting the net benefit of the prediction model and clinical predictors against the threshold probabilities, wherein the horizontal axis represents the threshold (the reference probability of the patient receiving treatment) and the vertical axis represents the net benefit rate after subtracting the disadvantage from the advantage. Using the model, under the same threshold probability, a larger net benefit indicates that the patient can obtain the greatest benefit. DCA: decision curve analysis.