Hao Cui1, Songren Shu1, Yuan Li2, Xin Yan1, Xiao Chen1, Zujun Chen3, Yuxuan Hu4, Yuan Chang1, Zhenliang Hu1, Xin Wang2,5, Jiangping Song1. 1. The Cardiomyopathy Research Group State Key Laboratory of Cardiovascular Disease Fuwai HospitalNational Center for Cardiovascular DiseasesChinese Academy of Medical Sciences and Peking Union Medical College Beijing China. 2. Department of Cardiovascular Surgery Fuwai HospitalNational Center for Cardiovascular DiseasesChinese Academy of Medical Sciences and Peking Union Medical College Beijing China. 3. Surgical Intensive Care Unit Fuwai HospitalNational Center for Cardiovascular DiseasesChinese Academy of Medical Sciences and Peking Union Medical College Beijing China. 4. Capital Normal University High School Beijing China. 5. Beijing Key Laboratory of Preclinical Research and Evaluation for Cardiovascular Implant Materials Center for Cardiovascular Experimental Study and Evaluation Fuwai HospitalNational Center for Cardiovascular DiseasesChinese Academy of Medical Sciences and Peking Union Medical College Beijing China.
Abstract
Background Cardiac surgery-associated acute kidney injury (CSA-AKI) is a common postoperative complication following cardiac surgery. Currently, there are no reliable methods for the early prediction of CSA-AKI in hospitalized patients. This study developed and evaluated the diagnostic use of metabolomics-based biomarkers in patients with CSA-AKI. Methods and Results A total of 214 individuals (122 patients with acute kidney injury [AKI], 92 patients without AKI as controls) were enrolled in this study. Plasma samples were analyzed by liquid chromatography tandem mass spectrometry using untargeted and targeted metabolomic approaches. Time-dependent effects of selected metabolites were investigated in an AKI swine model. Multiple machine learning algorithms were used to identify plasma metabolites positively associated with CSA-AKI. Metabolomic analyses from plasma samples taken within 24 hours following cardiac surgery were useful for distinguishing patients with AKI from controls without AKI. Gluconic acid, fumaric acid, and pseudouridine were significantly upregulated in patients with AKI. A random forest model constructed with selected clinical parameters and metabolites exhibited excellent discriminative ability (area under curve, 0.939; 95% CI, 0.879-0.998). In the AKI swine model, plasma levels of the 3 discriminating metabolites increased in a time-dependent manner (R2, 0.480-0.945). Use of this AKI predictive model was then confirmed in the validation cohort (area under curve, 0.972; 95% CI, 0.947-0.996). The predictive model remained robust when tested in a subset of patients with early-stage AKI in the validation cohort (area under curve, 0.943; 95% CI, 0.883-1.000). Conclusions High-resolution metabolomics is sufficiently powerful for developing novel biomarkers. Plasma levels of 3 metabolites were useful for the early identification of CSA-AKI.
Background Cardiac surgery-associated acute kidney injury (CSA-AKI) is a common postoperative complication following cardiac surgery. Currently, there are no reliable methods for the early prediction of CSA-AKI in hospitalized patients. This study developed and evaluated the diagnostic use of metabolomics-based biomarkers in patients with CSA-AKI. Methods and Results A total of 214 individuals (122 patients with acute kidney injury [AKI], 92 patients without AKI as controls) were enrolled in this study. Plasma samples were analyzed by liquid chromatography tandem mass spectrometry using untargeted and targeted metabolomic approaches. Time-dependent effects of selected metabolites were investigated in an AKI swine model. Multiple machine learning algorithms were used to identify plasma metabolites positively associated with CSA-AKI. Metabolomic analyses from plasma samples taken within 24 hours following cardiac surgery were useful for distinguishing patients with AKI from controls without AKI. Gluconic acid, fumaric acid, and pseudouridine were significantly upregulated in patients with AKI. A random forest model constructed with selected clinical parameters and metabolites exhibited excellent discriminative ability (area under curve, 0.939; 95% CI, 0.879-0.998). In the AKI swine model, plasma levels of the 3 discriminating metabolites increased in a time-dependent manner (R2, 0.480-0.945). Use of this AKI predictive model was then confirmed in the validation cohort (area under curve, 0.972; 95% CI, 0.947-0.996). The predictive model remained robust when tested in a subset of patients with early-stage AKI in the validation cohort (area under curve, 0.943; 95% CI, 0.883-1.000). Conclusions High-resolution metabolomics is sufficiently powerful for developing novel biomarkers. Plasma levels of 3 metabolites were useful for the early identification of CSA-AKI.
Three plasma metabolites, gluconic acid, fumaric acid, and pseudouridine, were significantly upregulated in patients with cardiac surgery–associated acute kidney injury.A random forest model with 3 plasma biomarkers (gluconic acid, fumaric acid, and pseudouridine) and 2 clinical parameters (preoperative creatinine and estimated glomerular filtration rate) achieved high accuracy for cardiac surgery–associated acute kidney injury prediction.In an acute kidney injury swine model, plasma levels of the 3 discriminating metabolites increased in a time‐dependent manner.
What Are the Clinical Implications?
A panel of 3 metabolites (gluconic acid, fumaric acid, and pseudouridine) in plasma taken within 24 hours following cardiac surgery is useful for predicting cardiac surgery–associated acute kidney injury.Acute kidney injury (AKI) is the most frequent complication following cardiac surgery, with an incidence of 5% to 43%.
Patients with AKI have increased postoperative mortality and mid‐ to long‐term morbidities, including heart failure, myocardial infarction, and accelerated progression to chronic kidney disease.
,
,
Early detection of potentially significant AKI in patients following cardiac surgery is important for the timely administration of appropriate clinical care.
,
Serum creatinine levels have served as a gold standard for the diagnosis of AKI; however, serum creatinine concentrations may be affected by age, sex, muscle mass, and medications, and abnormal creatinine levels may not be detectable until patients suffer a significant loss of kidney function.
The practice of measuring only serum creatinine may miss important opportunities for early treatment because of the time lag between kidney damage and the detection of elevated creatinine levels. In addition, AKI is associated with significantly increased inpatient costs of $5000 to $30 000.
,
Therefore, it is important to identify biomarkers for the early detection of AKI following cardiac surgery to reduce the burden of AKI‐associated morbidity and mortality.In recent years, several novel biomarkers, such as NGAL (neutrophil gelatinase–associated lipocalin), cystatin C, and KIM‐1 (kidney injury molecule‐1), have been associated with renal tubular injury. These biomarkers may be useful for the early diagnosis and screening of patients at high risk for AKI.
,
,
Although these biomarkers may prove to be useful, alone or in combination, for improving clinical diagnosis, the sensitivity, specificity, and repeatability remain insufficient for clinical implementation.
,
Hence, developing biomarkers and assessing their clinical applicability for predicting AKI following cardiac surgery are urgently needed.High‐throughput metabolomics is an efficient approach for identifying plasma small molecules (<1500 Da) that have significant potential for providing insight into pathological states.
The ability to measure metabolic alterations at the molecular level has become a powerful tool for defining the underlying pathophysiology and identifying novel treatment targets.
Plasma metabolites may, therefore, provide a relevant molecular signature for identifying cardiac surgery–associated AKI (CSA‐AKI). To date, only a few metabolomic studies have been published in the area of pediatric and adult AKI
,
,
; however, these studies were primarily discovery‐phase investigations with relatively small sample sizes and unsatisfactory predictive use.In this study, we performed a liquid chromatography tandem mass spectrometry–based metabolomic analysis to identify CSA‐AKI–related plasma metabolic signatures. We screened and identified metabolites in a discovery cohort and subsequently validated their potential as biomarkers for the early detection of CSA‐AKI using machine learning (ML) algorithms in a validation cohort. An AKI swine model was developed to dynamically monitor these biomarkers. The results of this study may be useful for improving early prediction and may offer insights into the pathophysiology of CSA‐AKI.
Methods
The data that support the findings of this study are available from the corresponding author on reasonable request. A detailed description of methods can be found in Data S1.
Study Design
This study was approved by the ethics committee of Fuwai Hospital and was conducted in accordance with the 1964 Declaration of Helsinki. Written informed consent was obtained from all participants included in this study. Plasma samples were prospectively collected from patients undergoing cardiac surgery with cardiopulmonary bypass (CPB) in the surgical intensive care unit of Fuwai Hospital. In total, 122 patients with CSA‐AKI and 92 patients without CSA‐AKI were eligible to participate in this study.
Outcomes
AKI was diagnosed according to the Acute Kidney Injury Network criteria
in patients who stayed in the intensive care unit longer than 48 hours.
Liquid Chromatography Tandem Mass Spectrometry Analysis
Metabolomic profiling analysis was performed using a Vanquish ultraperformance liquid chromatography system coupled to a Q‐Exactive HF mass spectrometer (Thermo Fisher Scientific). A Hypersil GOLD C18 column (100 × 2.1 mm, 1.9 μm; Thermo Fisher Scientific) was used for metabolite separation. For untargeted investigation, analysis was performed in the full‐MS and data‐dependent MS2 scan modes. For targeted determination, analysis was performed in the multiple reaction monitoring modes. Metabolite concentrations were calculated by area response from independent calibration curves.
,
AKI Swine Model
The experimental animal research protocol was approved by the institutional review board of Fuwai hospital. A swine model of AKI was developed using a modified method according to a published study.
Following surgical preparation, all swine (n=3) were subjected to midline laparotomy. Cross‐clamp (1 hour) of the right renal artery and vein was performed followed by left nephrectomy. Then the clamp was released, and the right kidney was observed for reperfusion. All swine were monitored for 8 hours after surgery, and 9 blood samples were collected at 1‐hour intervals from each swine via the venous catheter.
Machine Learning
We attempted 3 ML methods, namely random forest (RF), support vector machine (SVM), and logistic regression (LR) to develop the predictive models. All of the analyses were performed in R (version 4.0.5; R Foundation for Statistical Computing). RF models were fitted with the randomForest package, and SVM models were fitted with the e1071 package. The receiver operating characteristic (ROC) curve analysis was performed to evaluate the models’ performance, which was measured based on the area under the curve (AUC).
Statistical Analysis
Differences in metabolite levels between patients with AKI and without AKI were assessed with Mann‐Whitney U tests. A P value <0.05 was considered statistically significant. ROC analyses were used for individual biomarkers, and their predictive abilities were assessed using the AUC.
Results
Of the 214 subjects enrolled in our study, 122 patients were clinically diagnosed with AKI in the first 48 hours following cardiac surgery, and 92 patients without AKI were used as controls. To validate the potential applicability of the metabolomic biomarkers, patients were divided into a discovery cohort and a validation cohort as follows: (1) Patients who underwent only coronary artery bypass grafting or valve replacement surgery were assigned to the discovery cohort (47 patients with AKI and 48 patients without AKI). (2) To extend applicability of the biomarkers, patients who underwent other cardiac surgeries, such as aortic aneurysm repair, were assigned to the validation cohort (75 patients with AKI and 44 patients without AKI) (Table 1). Untargeted metabolomics was performed on the discovery cohort, followed by the discovery, identification, and verification of differentially expressed metabolites (Figure 1A). Potential biomarkers were combined into an ML model for improved predictive ability. Finally, the selected biomarkers were quantitatively analyzed in the independent validation cohort (Figure 1B).
Table 1
Clinical Characteristics of Patients
Discovery cohort
Validation cohort
AKI, n=47
Non‐AKI, n=48
P value
AKI, n=75
Non‐AKI, n=44
P value
Demographics
Male sex, n (%)
36 (76.6)
35 (72.9)
0.495
57 (76.0)
30 (68.2)
0.395
Age, y
57 (51–66)
57 (51–64)
0.483
57 (41–68)
55 (40–63)
0.116
BMI, kg/m2
25.5±2.8
25.0±3.4
0.414
25.0±3.6
24.8±3.2
0.797
Surgery type, n (%)
0.218
0.273
CABG
18 (38.3)
25 (52.0)
0
0
Valve
29 (61.7)
23 (48.0)
0
0
Aorta
0
0
27 (36.0%)
12 (27.3%)
CABG + valve
0
0
6 (8.0%)
7 (15.9%)
CABG + aorta
0
0
7 (9.3%)
4 (9.1%)
Valve + aorta
0
0
12 (16.0%)
8 (18.2%)
CABG + valve + aorta)
0
0
6 (8.0%)
0
Other
0
0
17 (22.7%)
13 (29.5%)
Surgery time, min
CPB
118.5±37.8
107.5±31.4
0.123
172.6±79.1
123.7±53.6
<0.001
ACCT
78.7±28.2
77.2±26.2
0.654
107.8±41.7
87.2±44.0
0.012
Preoperative renal function
Preoperative creatinine, μmol/L
89.7±17.7
83.7±13.5
0.066
90.3±17.7
86.9±19.6
0.330
Preoperative eGFR, mL/min per 1.73 m2
84.2±24.6
87.9±15.6
0.385
83.4±22.5
88.6±24.1
0.246
Fisher exact test for sex. Mann‐Whitney U test for age. Student t test for BMI, CPB, ACCT, preoperative creatinine, and eGFR. χ2 test for surgery type. ACCT indicates aortic cross‐clamp time; AKI, acute kidney injury; BMI, body mass index; CABG, coronary artery bypass graft; CPB, cardiopulmonary bypass; and eGFR, estimated glomerular filtration rate.
Figure 1
Schematic workflow of the present study.
(A) Biomarker identification. (B) The construction of predictive models. AKI indicates acute kidney injury; AUC, area under the curve; C&P, clinical parameters and plasma metabolites; FC, fold change; FDR, false discovery rate; LC, liquid chromatography; LR, logistic regression; MS, mass spectrometry; m/z, mass‐to‐charge ratio; OPLS‐DA, orthogonal projections to latent structures–discriminant analysis; P, plasma metabolites; RF, random forest; SVM, support vector machine; and VIP, variable importance in projection.
Clinical Characteristics of PatientsFisher exact test for sex. Mann‐Whitney U test for age. Student t test for BMI, CPB, ACCT, preoperative creatinine, and eGFR. χ2 test for surgery type. ACCT indicates aortic cross‐clamp time; AKI, acute kidney injury; BMI, body mass index; CABG, coronary artery bypass graft; CPB, cardiopulmonary bypass; and eGFR, estimated glomerular filtration rate.
Schematic workflow of the present study.
(A) Biomarker identification. (B) The construction of predictive models. AKI indicates acute kidney injury; AUC, area under the curve; C&P, clinical parameters and plasma metabolites; FC, fold change; FDR, false discovery rate; LC, liquid chromatography; LR, logistic regression; MS, mass spectrometry; m/z, mass‐to‐charge ratio; OPLS‐DA, orthogonal projections to latent structures–discriminant analysis; P, plasma metabolites; RF, random forest; SVM, support vector machine; and VIP, variable importance in projection.
Distinguishing Patients With AKI From Patients Without AKI Using Plasma Metabolomics
A total of 4004 and 3648 mass‐to‐charge ratio (m/z) features were detected in the positive and negative ion modes, respectively. In the positive mode, 1427 m/z features were significantly different between patients with AKI and patients without AKI; 156 m/z features showed a fold change (FC) >1.5, and 88 m/z features showed an FC <0.67, between patients with AKI and patients without AKI (Figure 2A). In the negative mode, 1342 m/z features were significantly different between patients with AKI and patients without AKI; 403 m/z features had an FC >1.5, and 145 m/z features had an FC <0.67, between patients with AKI and patients without AKI (Figure 2B).
Figure 2
Separation and classification of metabolic profiles in plasma from patients with AKI and patients without AKI.
(A) Volcano plot of positive‐ion‐mode results. (B) Volcano plot of negative‐ion‐mode results. (C) OPLS‐DA score plots based on the positive ion mode. (D) OPLS‐DA score plots based on the negative ion mode. AKI indicates acute kidney injury; and OPLS‐DA, orthogonal projections to latent structures‐discriminant analysis.
Separation and classification of metabolic profiles in plasma from patients with AKI and patients without AKI.
(A) Volcano plot of positive‐ion‐mode results. (B) Volcano plot of negative‐ion‐mode results. (C) OPLS‐DA score plots based on the positive ion mode. (D) OPLS‐DA score plots based on the negative ion mode. AKI indicates acute kidney injury; and OPLS‐DA, orthogonal projections to latent structures‐discriminant analysis.Orthogonal projections to latent structures‐discriminant analysis (OPLS‐DA) were used to identify potential biomarkers with the ability to distinguish patients with AKI from patients without AKI. The 4004 and 3648 m/z features detected in the positive and negative ion modes, respectively, were entered into SIMCA 15.0 (Sartorius) to establish an OPLS‐DA model. Optimum separation of the metabolic profiles for patients with AKI and patients without AKI was achieved from the OPLS‐DA score plots for the positive ion mode (R
2
Y, 0.996; Q
2, 0.788) and the negative ion mode (R
2
Y, 0.991; Q
2, 0.838) (Figures 2C and 2D). Two hundred permutation tests and cross‐validated residual ANOVA analyses were used to determine the risk of overfitting (positive mode: permQ
2, −0.257; cross‐validated ANOVA P value=2.83 × 10−23; negative mode: permQ, −0.278; cross‐validated ANOVA P value=4.70 × 10−29; Figure S1).
Identification of Potential Biomarkers
We screened the biomarkers through the following 4 steps: (1) False discovery rate (FDR) adjusted P value <0.05: A total of 1427 and 1342 m/z features met this criterion in the positive and negative ion modes, respectively. (2) FC >1.5 and OPLS‐DA variable importance in projection >1.5 (AKI versus non‐AKI): After this step, 66 and 183 m/z features were left in the positive and negative ion modes, respectively. These features were considered to be significantly different between the AKI and non‐AKI groups. (3) Selecting features that have been validated with database and standard compounds: The above 66 features (positive mode) and 183 features (negative mode) were then annotated using Compound Discoverer (Thermo Fisher Scientific) and their fragmentation spectra. Then, a total of 20 features in the positive mode and 58 features in the negative mode were successfully identified. (4) Selecting endogenous metabolites with AUC >0.8: We further excluded compounds that were not endogenous metabolites, such as pharmaceuticals and their metabolites. Only 3 metabolites with AUC >0.8 were left for further analysis (Figure 1A). Using strict screening criteria to assure the reliability of the selected compounds, we identified gluconic acid, fumaric acid, and pseudouridine as potential biomarkers with the AUC values (95% CIs) >0.8 (Figure 3A, 3B, S2). These 3 biomarkers also successfully recognized patients with early‐stage AKI (n=16) who had not been diagnosed with AKI at the time of plasma collection but progressed to AKI within 48 hours following cardiac surgery (AUC of gluconic acid, 0.730; 95% CI, 0.592–0.869; AUC of fumaric acid, 0.848; 95% CI, 0.750–0.945; and AUC of pseudouridine, 0.866; 95% CI, 0.750–0.982) (Figure 3C).
Figure 3
Abundance and use of selected metabolites for predicting CSA‐AKI in the discovery cohort.
(A) Box plots visualizing the abundance of each selected metabolite in patients with AKI and patients without AKI. (B) ROC curve generated by the individual metabolites for differentiating patients with AKI from patients without AKI. (C) ROC curve generated by the individual metabolites for differentiating patients with early‐stage AKI from patients without AKI. (D) ROC curve generated by RF‐, SVM‐, and LR‐based predictive models that used different input variables. (E) The calibration plot for each of the plasma biomarkers‐based ML models. (F) The calibration plot for each of C&P‐based ML models. AKI indicates acute kidney injury; AUC, area under the curve; C&P, clinical parameters and plasma metabolites; LR, logistic regression; P, plasma metabolites (gluconic acid, fumaric acid, and pseudouridine); RF, random forest; ROC, receiver operating characteristic; and SVM, support vector machine.
Abundance and use of selected metabolites for predicting CSA‐AKI in the discovery cohort.
(A) Box plots visualizing the abundance of each selected metabolite in patients with AKI and patients without AKI. (B) ROC curve generated by the individual metabolites for differentiating patients with AKI from patients without AKI. (C) ROC curve generated by the individual metabolites for differentiating patients with early‐stage AKI from patients without AKI. (D) ROC curve generated by RF‐, SVM‐, and LR‐based predictive models that used different input variables. (E) The calibration plot for each of the plasma biomarkers‐based ML models. (F) The calibration plot for each of C&P‐based ML models. AKI indicates acute kidney injury; AUC, area under the curve; C&P, clinical parameters and plasma metabolites; LR, logistic regression; P, plasma metabolites (gluconic acid, fumaric acid, and pseudouridine); RF, random forest; ROC, receiver operating characteristic; and SVM, support vector machine.
Biomarker Panel Improves the Prediction of CSA‐AKI Over a Single Metabolite
To further improve the predictive value of the 3 selected metabolites, we trained and validated several ML methods that could combine them into a predictive panel. We allocated 48 patients without AKI and 31 patients who had been diagnosed with AKI at the time of plasma collection to the training set, whereas 48 patients without AKI and the remaining 16 patients with early‐stage AKI were allocated to the test set. The former was used to tune parameters of ML algorithms, whereas the latter was used to evaluate the algorithms’ performance. Three ML algorithms, including RF, SVM, and LR were used to assess the 3 metabolites’ predictive performance of CSA‐AKI, and RF exhibited the larger AUC (0.922; 95% CI, 0.855–0.988) than SVM (0.884; 95% CI, 0.793–0.976) and LR (0.883; 95% CI, 0.803–0.963) (Figure 3D). The calibration plot for each of the plasma biomarkers‐based ML models is shown in Figure 3E. Model fit was acceptable for the RF and SVM model (Hosmer‐Lemeshow test: RF model, P=0.345; SVM model, P=0.206) but was poor for the LR model (Hosmer‐Lemeshow test: LR model, P<0.001). The partial dependence plots showed gluconic acid, fumaric acid, and pseudouridine have a strong impact on CSA‐AKI, and the probability of CSA‐AKI occurrence presented a nonlinear increase with 3 plasma biomarkers in the RF model but a linear increase in the SVM and LR models (Figure S3A).Then we investigated the AUC of clinical parameters to assess their predictive performance for CSA‐AKI. First, the predictive use of plasma creatinine was assessed: AUC of creatinine, 0.764; 95% CI, 0.667–0.860 (Figure S4). Conversely, the CPB and aortic cross‐clamp time (ACCT) exhibited a small AUC (0.612; 95% CI, 0.498–0.727 for CPB and 0.535; 95% CI, 0.418–0.653 for ACCT), indicating that CPB and ACCT were not predictive of CSA‐AKI. We next used RF, SVM, and LR models with the 7 clinical parameters (sex, age, body mass index, CPB, ACCT, preoperative creatinine, and estimated glomerular filtration rate) as input variables, and these predictive models exhibited a smaller AUC (RF: 0.549; 95% CI, 0.397–0.720; SVM: 0.534; 95% CI, 0.355–0.713; LR: 0.569; 95% CI, 0.391–0.747) than the predictive models conducted by 3 plasma markers (Table 1, Figure S5). Plasma gluconic acid, fumaric acid, pseudouridine, preoperative creatinine, and estimated glomerular filtration rate remained as independent predictors (P<0.05) for differentiating patients with AKI from patients without AKI after adjusting for age, sex, body mass index, CPB, and ACCT in the logistic regression analysis (P<0.05). Finally, we combined the aforementioned 2 clinical parameters and 3 plasma biomarkers (C&P) to improve the accuracy of the predictive model because they were also independent predictors of the occurrence of CSA‐AKI. The AUC of the RF, SVM, and LR model conducted by C&P was increased to 0.939 (95% CI, 0.879–0.998), 0.910 (95% CI, 0.839–0.982), and 0.902 (95% CI, 0.792–1.000), respectively (Figure 3D). Of note, the RF model showed satisfied sensitivity (0.875; 95% CI, 0.604–0.978) and specificity (0.938; 95% CI, 0.818–0.984), both of which were important for CSA‐AKI because it progressed rapidly, and interventive measures would largely increase the inpatient costs, respectively. The calibration plot for each of C&P‐based ML models is shown in Figure 3F. Model fit was acceptable for all 3 models (Hosmer‐Lemeshow test: RF model, P=0.458; SVM model, P=0.188; LR model, P=0.248). The partial dependence plot of each predictor in the C&P‐based ML models are shown in Figure S3B. For the discovery cohort, all of the results of ROC analysis including AUC value, sensitivity, specificity, and their 95% CIs were summarized in Table S1. The predictive ability of the panel constructed by C&P was further improved, with the C&P‐RF panel showing an optimal AUC value.
Variations in Potential Plasma Biomarkers Over Time in an AKI Swine Model
We constructed an AKI swine model and collected hourly plasma samples to investigate early‐stage kinetic changes in potential biomarkers. Plasma levels of gluconic acid, fumaric acid, and pseudouridine rose in a linear fashion over time (R
2 for linear fit, 0.823, 0.480, and 0.945, respectively) (Figure 4). The increased multiples of gluconic acid, fumaric acid, and pseudouridine relative to baseline levels were 1.59 per hour, 0.17 per hour, and 0.11 per hour, respectively. The increased multiple of creatinine relative to baseline was 0.06 per hour (R
2, 0.561). Using 1.5 times the baseline level as the diagnostic threshold (Acute Kidney Injury Network),19 the time to reach the diagnostic criteria of gluconic acid, fumaric acid, and pseudouridine was 0.31, 2.94, and 4.55 hours, respectively, which was significantly earlier than that of creatinine (8.33 hours).
Figure 4
Time‐dependent variation in plasma concentrations of the selected metabolites in an acute kidney injury swine model.
(A) Gluconic acid. (B) Fumaric acid. (C) Pseudouridine. (D) Creatinine. Data points are means of independent samples, and error bars represent the SEM (n=3). The red line is the trendline resulting from linear fitting, and the shadow is the 95% CI.
Time‐dependent variation in plasma concentrations of the selected metabolites in an acute kidney injury swine model.
(A) Gluconic acid. (B) Fumaric acid. (C) Pseudouridine. (D) Creatinine. Data points are means of independent samples, and error bars represent the SEM (n=3). The red line is the trendline resulting from linear fitting, and the shadow is the 95% CI.
Predictive Ability of the Potential Biomarkers in an Independent Validation Cohort
The potential biomarkers were subsequently confirmed by comparing their fragmentation spectra with standards using a quantitative analysis in an independent validation cohort. Gluconic acid, fumaric acid, and pseudouridine were measured by multiple reaction monitoring using the calibration curve of an external standard. Similar to the results from the discovery cohort, the concentrations of all 3 biomarkers were significantly different between the AKI and non‐AKI groups (Figure 5A). Results of the ROC analysis of plasma concentrations for each biomarker are shown in Figure 5B. The AUC of gluconic acid, fumaric acid, and pseudouridine was 0.878 (95% CI, 0.815–0.941), 0.747 (95% CI, 0.661–0.833), and 0.883 (95% CI, 0.823–0.943), respectively. The AUC of the 3 plasma biomarkers‐based RF, SVM, and LR models was 0.963 (95% CI, 0.934–0.992), 0.912 (95% CI, 0.861–0.964), and 0.910 (95% CI, 0.860–0.960), respectively (Figure 5C). The calibration plot for each of the plasma biomarkers‐based ML models is shown in Figure 5D. Model fit was acceptable for the RF and SVM model (Hosmer‐Lemeshow test: RF model, P=0.283; SVM model, P=0.179) but was not acceptable for the LR model (Hosmer‐Lemeshow test: LR model, P<0.001). For the validation cohort, the partial dependence plot of each predictor in the plasma biomarkers‐based ML models is shown in Figure S6A.
Figure 5
Absolute quantification of selected metabolites and their predictive use for CSA‐AKI in the validation cohort
(A) Box plots showing plasma concentrations of the 3 selected metabolites in patients with AKI and patients without AKI. (B) ROC curve generated by the individual metabolites for differentiating patients with AKI from patients without AKI. (C) ROC curve generated by RF‐, SVM‐, and LR‐based predictive models for differentiating patients with AKI from patients without AKI. (D) The calibration plot for each of the plasma biomarkers‐based ML models. (E) The calibration plot for each of C&P‐based ML models. (F) ROC curve generated by the individual metabolites for differentiating patients with early‐stage AKI from patients without AKI. (G) ROC curve generated by RF‐, SVM‐, and LR‐based predictive model for differentiating patients with early‐stage AKI from patients without AKI. AKI indicates acute kidney injury; AUC, area under the curve; C&P, clinical parameters and plasma metabolites; LR, logistic regression; P, plasma metabolites (gluconic acid, fumaric acid, and pseudouridine); RF, random forest; and SVM, support vector machine.
Absolute quantification of selected metabolites and their predictive use for CSA‐AKI in the validation cohort
(A) Box plots showing plasma concentrations of the 3 selected metabolites in patients with AKI and patients without AKI. (B) ROC curve generated by the individual metabolites for differentiating patients with AKI from patients without AKI. (C) ROC curve generated by RF‐, SVM‐, and LR‐based predictive models for differentiating patients with AKI from patients without AKI. (D) The calibration plot for each of the plasma biomarkers‐based ML models. (E) The calibration plot for each of C&P‐based ML models. (F) ROC curve generated by the individual metabolites for differentiating patients with early‐stage AKI from patients without AKI. (G) ROC curve generated by RF‐, SVM‐, and LR‐based predictive model for differentiating patients with early‐stage AKI from patients without AKI. AKI indicates acute kidney injury; AUC, area under the curve; C&P, clinical parameters and plasma metabolites; LR, logistic regression; P, plasma metabolites (gluconic acid, fumaric acid, and pseudouridine); RF, random forest; and SVM, support vector machine.Compared with the discovery cohort, the AUC of both CPB (AUC, 0.705; 95% CI, 0.606–0.804) and ACCT (AUC, 0.656; 95% CI, 0.549–0.762) was increased in the validation cohort (Figure S7). The more complex composition of surgery species may have led to differences in CPB and ACCT between the AKI and non‐AKI groups in the validation cohort (Table 1). The AUC of the RF, SVM, and LR model constructed with C&P was increased to 0.972 (95% CI, 0.947–0.996), 0.927 (95% CI, 0.882–0.972), and 0.926 (95% CI, 0.883–0.969), respectively (Figure 5C). It is noteworthy that the RF model still showed great sensitivity (0.893; 95% CI, 0.795–0.950) and specificity (0.977; 95% CI, 0.865–0.999) in the validation cohort. The calibration plot for each of C&P‐based ML models is shown in Figure 5E. Model fit was acceptable for the RF and SVM model (Hosmer‐Lemeshow test: RF model, P=0.221; SVM model, P=0.187) but was poor for the LR model (Hosmer‐Lemeshow test: LR model, P<0.001). For the validation cohort, the partial dependence plot of each predictor in the C&P‐based ML models was also shown in Figure S6b. Of note, the consecutive parameters have a definite threshold. It may be a reason that the RF model was better suited than the SVM model for probability of CSA‐AKI occurrence.The predictive performance of these biomarkers was also validated in patients with early‐stage AKI (16 of 75 AKI patients) (Figure 5F). The AUC of the RF, SVM, and LR model with the 3‐marker panel was 0.935 (95% CI, 0.855–1.000), 0.828 (95% CI, 0.720–0.936), and 0.811 (95% CI, 0.705–0.917), respectively (Figure 5G). The accuracy was further improved when using the RF, SVM, and LR model conducted by C&P (RF: AUC, 0.943; 95% CI, 0.883–1.000; SVM: AUC, 0.849; 95% CI, 0.737–0.962; LR: AUC, 0.830; 95% CI, 0.721–0.938). The selected biomarkers showed an increased predictive ability in the validation cohort compared with biomarkers that have been previously reported
,
,
,
,
,
,
,
,
(Table 2). The AUC of CPB (0.589; 95% CI, 0.422–0.757) and ACCT (0.605; 95% CI, 0.444–0.766) showed neither of them could accurately predict the occurrence of AKI at an early stage. Gluconic acid, fumaric acid, and pseudouridine remained as significant predictors that could differentiate patients with AKI from patients without AKI after adjusting for the clinical parameters in a logistic regression analysis (P<0.05). These results indicate that the potential biomarkers had excellent stability and reproducibility and therefore may be suitable for the early diagnosis of CSA‐AKI. For the validation cohort, all of the results of ROC analysis, including AUC value, sensitivity, specificity, and their 95% CI are summarized in Table S2. The contribution of variables to the models are shown in Table S3, including the variable importance of the RF and LR model, and P values from the LR model.
Table 2
Reported Plasma Biomarkers for Cardiac Surgery–Associated Acute Kidney Injury
Blood biomarkers
Time point
Sensitivity
(95% CI)
Specificity (95% CI)
AUC* (95% CI)
References
Cyclophilin A
Within 6 h after cardiac surgery
0.76 (0.66–0.84)
0.59 (0.48–0.69)
0.69 (0.62–0.76)
23
SLPI
At 24 h after cardiac surgery
0.70(45.7–88.1)
67.6 (57.8–76.4)
0.69 (0.58–0.80)
24
SLPI
At 48 h after cardiac surgery
77.8 (52.4–93.6)
71.2 (61.4–79.9)
0.79 (0.69–0.90)
24
Alpha 1‐antitrypsin
At 2 h after CPB
0.66 (—)
0.57(—)
0.628 (0.550–0.705)
25
NGAL
Preoperation
…
…
0.57 (0.54‐0.61)
26
TIMP‐2, IGFBP7
ICU admission after cardiac surgery
0.60 (—)
0.88 (—)
0.744 (—)
27
Creatinine
Immediate postoperation/preoperation
0.24 (0.16–0.24)
0.99 (0.99–0.99)
0.77 (0.75–0.79)
28
GDF‐15
Preoperation
…
…
0.750 (—)
29
Syndecan‐1
Within 2 h after cardiac surgery
0.757(—)
0.691 (—)
0.77 (0.68–0.85)
30
Endogenous ouabain
Preoperation
…
…
0.73 (0.65–0.81)
31
(—) indicates not mentioned; AUC, area under the curve; CPB, cardiopulmonary bypass; GDF‐15, growth‐differentiation factor‐15; ICU, intensive care unit; IGFBP7, insulin‐like growth factor‐binding protein 7; NGAL, neutrophil gelatinase‐associated lipocalin; SLPI, secretory leukocyte protease inhibitor; and TIMP‐2, metalloproteinase‐2.
Logistic regression model includes other variables, including Euroscore, age, plasma creatinine, diabetes, and duration of cardiopulmonary bypass.
Reported Plasma Biomarkers for Cardiac Surgery–Associated Acute Kidney InjurySensitivity(95% CI)(—) indicates not mentioned; AUC, area under the curve; CPB, cardiopulmonary bypass; GDF‐15, growth‐differentiation factor‐15; ICU, intensive care unit; IGFBP7, insulin‐like growth factor‐binding protein 7; NGAL, neutrophil gelatinase‐associated lipocalin; SLPI, secretory leukocyte protease inhibitor; and TIMP‐2, metalloproteinase‐2.Logistic regression model includes other variables, including Euroscore, age, plasma creatinine, diabetes, and duration of cardiopulmonary bypass.
Discussion
In this observational study, we used untargeted and targeted metabolomic approaches to develop biomarkers of CSA‐AKI. Plasma metabolic profiles were noticeably different between patients with AKI and patients without AKI. The targeted quantitative approach confirmed that levels of gluconic acid, fumaric acid, and pseudouridine were elevated in the plasma of patients with CSA‐AKI. The predictive ability of these markers remained strong for patients with early‐stage AKI, indicating that the 3‐marker panel could predict the development of CSA‐AKI in the early postoperative period.A strength to our study was the prospective inclusion of patients who experienced cardiac surgery, which reduced potential bias attributable to medications. OPLS‐DA analysis identified a significant difference between patients with AKI and patients without AKI and showed that patients with AKI had a unique metabolic pattern. Previous AKI‐related studies reported a variety of potential metabolite biomarkers primarily in urine.
,
Martin‐Lorenzo and collaborators found that urinary levels of acetylneuraminic acid, phosphoethanolamine, and serine were significantly upregulated during AKI.
Similarly, urinary levels of leucine and valine were elevated in pediatric patients with AKI.
A dopamine metabolite named homovanillic acid sulfate has been identified as a potential urinary biomarker of pediatric patients with AKI undergoing CPB
; however, homovanillic acid sulfate was not found in this study. Few studies based on plasma/serum metabolomics have investigated AKI biomarkers.
A pilot study showed that serum levels of acylcarnitines, methionine, homocysteine, pyroglutamate, asymmetric dimethylarginine, and phenylalanine were elevated in patients with AKI.
Interestingly, there was no overlap between the metabolite biomarkers reported in previous studies and those identified in this study, which may be attributable to our use of patients without AKI as controls rather than healthy individuals or to the small sample size in the previous study.Potential biomarkers have rarely been identified in both human and animal studies. In this study, we observed rapidly increasing plasma levels of the potential biomarkers, which were also present in a swine AKI model. Previous studies have shown that AKI may occur within hours following cardiac surgery,
,
necessitating continuous monitoring and dense sampling in the early phase following surgery, which is difficult for clinical implementation. Therefore, we constructed a large animal model (AKI swine model) to simulate the early phase of the AKI process. Following surgery in the AKI swine model, hourly kinetic changes in levels of these biomarkers were significantly greater than changes in creatine levels. These biomarkers may respond more rapidly to renal injury than creatine.Metabolites of the tricarboxylic acid cycle are common biomarkers of AKI.
Previous studies have shown that urinary levels of tricarboxylic acid intermediates decreased significantly during AKI.
This decrease in levels of tricarboxylic acid intermediates was associated with the upregulation of fumaric acid levels in plasma, similar to our findings in this study. These observations suggest that carboxylic acid levels may reflect a reduction in renal clearance during AKI rather than tissue‐specific production. Gluconic acid has been associated with a deterioration in renal function in patients with end‐stage chronic kidney disease.
In a previous study of an aristolochic acid–induced nephrotoxicity rat model, gluconic acid exhibited time‐ and dose‐dependent changes, which suggested that this metabolite may be associated with the extent of kidney impairment.
CSA‐AKI has been related to oxidative stress because of unique characteristics such as CPB and ischemia‐reperfusion injury.
One study has shown that gluconic acid may be an indicator of oxidative stress in keratoconus.
Gluconic acid is a byproduct of glucose oxidation; therefore, elevated plasma levels of gluconic acid may result from oxidative stress in patients with AKI. Pseudouridine is a modified nucleoside that originates from the catabolism of tRNA. When pseudouridine is released from tRNA, it is not involved in RNA synthesis and is gradually excreted from the body in the urine.
Enhanced plasma levels and reduced urine levels of pseudouridine have been detected in many nephropathies, including chronic kidney disease and diabetic nephropathies.
,
,
To our knowledge, our study is the first to report a marked increase in plasma levels of pseudouridine in patients with AKI . Pseudouridine may be useful as a marker of acute and chronic kidney damage. Pseudouridine was used as an endogenous renal filtration marker decades ago; however, its use was abandoned because of its reabsorption from renal tubules.
Consequently, the accumulation of pseudouridine in plasma may be attributable to decreased renal excretion and increased tubular reabsorption.The ideal biomarker for AKI would have high specificity and sensitivity for detecting AKI in a rapid and stable manner. At present, however, few biomarkers fulfill these criteria. Although levels of serum creatinine may be affected by multiple factors such as muscle mass, chronic disease, and drug use, creatinine is the most widely used biomarker for AKI diagnosis because it reflects changes in the glomerular filtration rate.
However, it requires many hours to many days to diagnose AKI after renal damage when using serum creatinine.
Our metabolites‐based predictive model may be useful for early AKI prediction. These metabolites increased in a linear fashion and have a significantly steeper slope than creatine in a renal ischemia‐reperfusion swine model, indicating that they may be more sensitive for quantifying renal clearance in early‐stage AKI. Other biomarkers have been examined for potential use in the early detection of AKI.
A previous study reported that the AUCs of plasma or serum NGAL, cystatin C, and uric acid were 0.62 to 0.83, 0.68 to 0.76, and 0.77 to 0.86, respectively, for the diagnosis of AKI.
The most frequently investigated biomarkers were proteins released from the kidney because of several theoretical advantages over serum creatinine. Because of the complexity of AKI pathogenesis, however, the predictive accuracy of these biomarkers varies extensively among different studies. Therefore, these biomarkers have not been widely used in clinical practice.Although this study identified an independent predictive panel that may be useful for early and effective diagnosis of CSA‐AKI and confirmed the generalizability of this panel in different types of cardiac surgery, limitations of the study warrant attention. First, our study was based on a small‐sized patient population treated at a single center. Studies with larger patient populations from multiple treatment centers are needed. Second, we constructed an ischemic AKI pig model instead of a CSA‐AKI model because of the technical barriers to construct the latter model. Therefore, future clinical studies are needed to determine if these markers are specific to CSA‐AKI or for all kinds of AKI. Third, we identified 3 biomarkers in a CSA‐AKI cohort and tested their predictive value of AKI in a porcine ischemic AKI model, but the metabolic kinetics of these markers is not clear and needs to be examined in either animal or clinical studies. Fourth, variations in the elapsed time between surgery and collection of patient samples may introduce bias. Although fasting plasma samples were uniformly collected in the morning of the day following surgery, different surgery times during the previous day led to variation in the time interval between surgery and sample collection. Future studies should collect samples at an earlier and more consistent time point following cardiac surgery to monitor the progress of early‐stage AKI and assess the correlation between biomarkers and outcomes of patients with CSA‐AKI. In addition, further studies are warranted to determine the 3 biomarkers’ significance, such as the primary source for these markers, the correlation of these marker with the prognosis, and the possibility of detection of these markers in the urine as a noninvasive diagnostic method.
Conclusions
In summary, the application of MS‐based metabolomic techniques can reflect the specific metabolic perturbation in patients with CSA‐AKI. The nontargeted metabolomic strategy is an effective approach that could be applied to screen potential differential features, which were subsequently identified by their fragment ion spectra and quantified by chemical standards in multiple reaction monitoring mode for validation of the diagnostic performance of CSA‐AKI. Early dynamic monitoring of AKI can be achieved by a large animal model. Earlier diagnosis of AKI would enable intensive care unit physicians to administer supportive treatments, such as catheters and renal replacement therapy, in a timely manner. We hope to provide a framework that will guide development of novel biomarkers for postoperative complications.
Sources of Funding
This work was supported by the Shanghai Municipal Science and Technology Major Project (grant number 2017SHZDZX01) and by Fuwai hospital funding (2019‐F04).
Disclosures
None.Data S1, Tables S1–S3, Figures S1–S7Click here for additional data file.
Authors: Jinchun Sun; Melissa Shannon; Yosuke Ando; Laura K Schnackenberg; Nasim A Khan; Didier Portilla; Richard D Beger Journal: J Chromatogr B Analyt Technol Biomed Life Sci Date: 2012-03-06 Impact factor: 3.205
Authors: Mehmet Oezkur; Attila Magyar; Phillip Thomas; Tabea Stork; Reinhard Schneider; Constanze Bening; Stefan Störk; Peter U Heuschmann; Rainer G Leyh; Martin Wagner Journal: Kidney Blood Press Res Date: 2017-07-27 Impact factor: 2.687
Authors: Mira Küllmar; Khaschayar Saadat-Gilani; Raphael Weiss; Christina Massoth; Anas Lagan; Manuel Núñez Cortés; Joachim Gerss; Lakhmir S Chawla; Danilo Fliser; Melanie Meersch; Alexander Zarbock Journal: Am J Respir Crit Care Med Date: 2021-05-01 Impact factor: 21.405
Authors: Anja Haase-Fielitz; Rinaldo Bellomo; Prasad Devarajan; David Story; George Matalanis; Duska Dragun; Michael Haase Journal: Crit Care Med Date: 2009-02 Impact factor: 7.598
Authors: Ravindra L Mehta; John A Kellum; Sudhir V Shah; Bruce A Molitoris; Claudio Ronco; David G Warnock; Adeera Levin Journal: Crit Care Date: 2007 Impact factor: 9.097
Authors: Matthias Heringlake; Efstratios I Charitos; Kira Erber; Astrid Ellen Berggreen; Hermann Heinze; Hauke Paarmann Journal: Crit Care Date: 2016-10-08 Impact factor: 9.097
Authors: Mitra K Nadim; Lui G Forni; Azra Bihorac; Charles Hobson; Jay L Koyner; Andrew Shaw; George J Arnaoutakis; Xiaoqiang Ding; Daniel T Engelman; Hrvoje Gasparovic; Vladimir Gasparovic; Charles A Herzog; Kianoush Kashani; Nevin Katz; Kathleen D Liu; Ravindra L Mehta; Marlies Ostermann; Neesh Pannu; Peter Pickkers; Susanna Price; Zaccaria Ricci; Jeffrey B Rich; Lokeswara R Sajja; Fred A Weaver; Alexander Zarbock; Claudio Ronco; John A Kellum Journal: J Am Heart Assoc Date: 2018-06-01 Impact factor: 5.501
Authors: Jesse A Davidson; Justin Robison; Ludmila Khailova; Benjamin S Frank; James Jaggers; Richard J Ing; Scott Lawson; John Iguidbashian; Eiman Ali; Amy Treece; Danielle E Soranno; Suzanne Osorio-Lujan; Jelena Klawitter Journal: Am J Physiol Renal Physiol Date: 2022-05-09