Bedside risk score for prediction of acute kidney injury after transcatheter aortic valve replacement.

Background: Acute kidney injury (AKI) is a common post-transcatheter aortic valve replacement (TAVR) complication associated with a poor prognosis. We sought to create a risk calculator using information that would be available during the work-up period.
Methods: Data were obtained from a multicentre TAVR registry (n=1993) with cases from 1 January 2012 to 31 December 2015. We used logistic regression to create a risk calculator to predict AKI as defined by the Valve Academic Research Consortium Guidelines. We internally validated our risk calculator using bootstrapping, and evaluated model discrimination and calibration.
Results: A simple risk score was derived with six variables, including New York Heart Association functional classification class 4, non-femoral access site, valve-in-valve procedure, haemoglobin, creatinine clearance and weight in kilograms. The score was able to predict the absolute risk of AKI from 1% to 72%. The model showed good discrimination with c-statistic 0.713, with good agreement between predicted and observed AKI rates across quintiles of risk. Conclusions: This is the first risk calculator to assess post-TAVR risk of AKI. We found that information known pre-procedurally can be used to predict AKI. This may allow for more informed decision-making as well as identifying high-risk patients.

Acute kidney injury (AKI) is a common complication following transcatheter aortic valve replacement, occurring in an estimated 22.1±11.2% of patients. It is associated with a very poor prognosis.

We derived a simple to use risk score with six pre-procedurally known variables. The score was able to predict the absolute risk of AKI from 1% to 72%.

A pre-procedure risk score identifies high-risk patients. It can help patients and clinicians in informed decision-making.

Introduction

Acute kidney injury (AKI) is a common complication following transcatheter aortic valve replacement (TAVR) that is associated with a very poor prognosis. Using the Valve Academic Research Consortium 2 (VARC-2) definition, the incidence of post-procedural AKI is 12%–45%,1–12 with a meta-analysis estimation of 22.1±11.2% (13). AKI is associated with an increased risk of both short-term and long-term mortality, independent of whether renal function returns to baseline levels,1–4 9 11–17 and it increases the risk of other adverse events such as early myocardial infarction and dialysis.13

Previous studies evaluating the association between TAVR and AKI have identified various explanatory baseline, peri-procedural and procedural factors. However, there are no risk calculators in the literature to predict the absolute risk of AKI post-TAVR. A risk score to quantify the AKI risk that can be used during the work-up phase would aid clinicians and patients in the decision-making process. Indeed, such risk prediction tools are available for various cardiac procedures including cardiac surgery and percutaneous coronary interventions.18 19 These tools may be used in shared decision-making, in particular when TAVR is potentially futile due to multiple comorbidities. In such a setting, a risk of AKI that is sufficiently high to preclude a safe procedure would further reinforce the decision to avoid proceeding with TAVR. Alternatively, these tools would aid clinicians to identify patients who may benefit from prophylactic strategies to reduce the risk of AKI or who may require closer monitoring and care post-procedure.

Accordingly, to address this gap in knowledge, the purpose of our study was to create a well-validated risk calculator using information that would be routinely available to clinicians during the TAVR work-up period. We hypothesise that such a model would accurately predict the risk of post-TAVR renal deterioration.

Methods

We conducted a retrospective cohort study using patient data from six tertiary hospitals, three of which were located in Canada and three in Israel. Research ethics board approval was obtained from all centres. The need for individual patient consent was waived by all the institutional review boards.

Each site routinely maintains a TAVR registry prospectively, collecting detailed information on patients’ baseline characteristics, procedure information and complications. We identified all patients receiving a TAVR procedure from 1 January 2012 to 31 December 2015. This time period was chosen in order to study a contemporary cohort, and after all sites had mature programmes and were beyond their learning curve phase. Patients were excluded if they were receiving dialysis at baseline, if they required emergency open heart surgery or if our main outcome of interest AKI could not be classified due to procedural death or missing data on creatinine. Patients who underwent emergency open heart surgery immediately post-TAVR were excluded because this complication would not be known during the diagnostic work-up phase.

The primary outcome of interest was stage 1, 2 or 3 AKI as defined by VARC-2 guidelines based on the difference between pre-procedural and highest post-procedural (within 7 days) creatinine values.20 Using the most liberal definition, any patient whose baseline creatinine increased by ≥0.3 mg/dL post-procedurally was classified as having AKI.

Potential covariates were chosen based on data availability and the previous AKI literature. Given our goal was to develop a tool that would be used in the work-up phase, we restricted covariates to only those that would be known pre-procedurally. This included patients’ baseline characteristics, baseline comorbidities, blood laboratory measurements and echocardiographic readings. All baseline characteristics were collected as closely as possible prior to the procedure date. Creatinine clearance (CRCL) was calculated using the Cockroft-Gault equation.21 We used CRCL instead of estimated glomerular filtration rate (eGFR) because we did not have information on race, which is necessary for the calculation of eGFR. The only procedural characteristics were those that would be pre-planned, such as access site, and previous surgical aortic valve replacement resulting in a valve-in-valve procedure. Although we recorded contrast dye volume in millilitres, this was not used in the final calculator as it would not be available during the diagnostic phase of the TAVR work-up.

Chi-squared tests and t-tests were used to compare baseline characteristics of patients with and without AKI. For the list of potential covariates considered for model selection, please see table 1. We excluded any variable with >10% missing values and contrast dye volume. Using logistic regression, univariable associations were first determined for all potential covariates. Covariates with a p value less than 0.1 on univariate analyses were considered potential candidates for the final multivariable logistic regression model. For variable selection, we used an automated approach, by generating 200 bootstrapped datasets, with patients chosen with replacement so that each bootstrapped dataset had the full sample size as our full cohort. Backward logistic regression models were performed on each individual dataset; covariates needed a p value of <0.05 to remain in the model. This resulted in 200 different multivariable models. We then determined the frequency by which each potential variables were in the 200 different multivariable models. Any covariate that was in >50% of models was retained in the final model. Having selected the final covariates, we determined the parameter estimates in a complete dataset developed by multiple imputation. For any variables with <10% missing data, we assumed that data were missing completely at random and created 200 imputed datasets using a fully conditional specification method.22 To convert the parameter estimates in the final model to score-based prediction rules, we used the methodology described by Sullivan and colleagues to obtain integer scores for each parameter.23

Table 1

Patient and procedure characteristics of all patients and stratified by acute kidney injury

Patient characteristics	All patients (n=1993)	AKI (n=318)	No AKI (n=1675)	P values
Age	82.0±7.4	82.4±6.9	81.9±7.5	0.24
Female	1013 (51.1%)	157 (49.5%)	856 (51.4%)	0.55
Male	971 (48.9%)	160 (50.5%)	811 (48.7%)
NYHA class 4	346 (18.9%)	77 (25.8%)	269 (17.6%)	0.001
Atrial fibrillation	641 (32.2%)	126 (39.6%)	515 (30.8%)	0.002
COPD	351 (17.6%)	64 (21.1%)	287 (17.2%)	0.20
Diabetes	712 (35.7%)	142 (44.8%)	570 (34.0%)	<0.001
Hypertension	1714 (86.0%)	275 (86.5%)	1439 (85.9%)	0.79
Lipids	1442 (72.6%)	237 (74.5%)	1205 (72.2%)	0.40
PVD	301 (15.1%)	51 (16.0%)	250 (15.0%)	0.63
Stroke or TIA	323 (16.2%)	55 (17.3%)	268 (16.0%)	0.57
Prior open heart surgery	404 (24.4%)	51 (19.8%)	353 (25.2%)	0.062
STS score	5.8±5.0	7.0±6.3	5.6±5.4	<0.001
EuroSCORE	7.2±7.3	8.8±8.8	6.8±6.9	<0.001
Pre-mean PG	44.7±16.6	43.0±15.7	45.1±16.8	0.043
LVEF <40%	217 (11.2%)	47 (15.3%)	170 (10.5%)	0.015
BMI	27.2±5.6	28.2±27.5	27.1±26.8	0.002
Weight (kg)	73.0±16.2	75.8±17.1	72.5±15.9	<0.001
CRCL	50.6±22.7	44.6±21.4	51.7±22.8	<0.001
Pre-TAVR creatinine (µmol/L)	106.7±43.0	127.1±53.7	102.8±39.5	<0.001
Haemoglobin	119.4±16.1	114.2±15.5	120.3±16.1	<0.001
Valve size	26.5±2.4	26.5±2.5	26.4±2.4	0.59
Conscious sedation	790 (47.3%)	119 (44.8%)	497 (47.8%)	0.38
Non-femoral access site	290 (14.6%)	76 (23.9%)	214 (12.8%)	<0.001
Valve in valve procedure	106 (5.3%)	8 (2.5%)	98 (5.9%)	0.015
Contrast dye (mL)	125.3±63.5	131.0±73.7	124.2±61.3	0.173

AKI, acute kidney injury; BMI, body mass index; COPD, chronic obstructive pulmonary disease; CRCL, creatinine clearance; EuroSCORE, European System for Cardiac Operative Risk Evaluation; LVEF, left ventricle ejection fraction; NYHA, New York Heart Association functional classification; PG, peak gradient; PVD, peripheral vascular disease; STS score, Society of Thoracic Surgeons adult cardiac surgery risk score; TAVR, transcatheter aortic valve replacement; TIA, transient ischaemic attack.

Internal validation of the model was performed using bootstrapping with unrestricted random sampling for 200 iterations. The c-statistic (ie, area under the receiver operating curve) was used to assess model discrimination while model calibration was evaluated with the Hosmer and Lemeshow χ2 statistic, as well as graphically by comparing predicted with observed risks by quintile. A 95% CI was calculated for both the c-statistic and Hosmer and Lemeshow χ2 statistic. All analyses were completed using SAS V.9.3 (SAS Institute, Cary, North Carolina, USA).

Results

As seen in figure 1, a total of 2128 patients underwent TAVR at the six different hospitals between 1 January 2012 and 31 December 2015. We excluded 59 patients who were on dialysis pre-procedure and an additional 24 who had emergent open heart surgery. A total of 17 patients died during the procedure, and 35 had missing AKI data. The final cohort consisted of 1993 patients, of whom 318 (15.9%) of patients had AKI, with 271 (13.6%) having stage 1 AKI while 33 (1.7%) and 14 (0.7%) had stage 2 and 3, respectively.

Figure 1

Patient selection flow chart. AKI, acute kidney injury; TAVR, transcatheter aortic valve replacement.

The patient and procedure characteristics of the cohort are shown in table 1. The average age of the cohort was 82.0% and 51.1% were women. A minority of patients (14.6%) had a non-femoral TAVR procedure and 106 (5.3%) received a valve-in-valve procedure. About half (790 patients, 47.3%) received conscious sedation. As seen in table 1, there were important differences between the patients with AKI and those without.

Univariable associations between AKI and candidate covariates are shown in table 2. The final multivariable model is shown in table 3. Baseline kidney function, as measured by creatinine and CRCL, were both potential variables based on our a priori selection criteria. We elected to include only CRCL in our final model, as it had a stronger relationship, and it incorporates information about age and sex. The remaining variables in the final multivariable model were New York Heart Association functional classification (NYHA) class 4, non-femoral access site, valve-in-valve procedure, haemoglobin and weight measured in kilograms. Higher CRCL, higher haemoglobin and a valve-in-valve procedure all decreased the risk of AKI, while NYHA class 4, non-femoral access site and heavier weight were associated with higher risk.

Table 2

Univariable associations of baseline characteristics and acute kidney injury

Comorbidity	OR (95% CI)	P values
Age	1.01 (0.99 to 1.03)	0.24
Male	1.08 (0.85 to 1.37)	0.55
NYHA class 4	1.27 (1.1 to 1.47)	0.001
Atrial fibrillation	1.48 (1.15 to 1.89)	0.002
COPD	1.22 (0.89 to 1.64)	0.20
Diabetes	1.57 (1.23 to 2.01)	<0.001
Hypertension	1.05 (0.75 to 1.50)	0.79
Lipids	1.12 (0.86 to 1.48)	0.40
PVD	1.09 (0.78 to 1.5)	0.63
Stroke or TIA	1.1 (0.79 to 1.5)	0.57
Prior open heart surgery	0.73 (0.53 to 1.02)	0.063
STS score	1.04 (1.02 to 1.07)	<0.001
EuroSCORE	1.03 (1.02 to 1.05)	<0.001
Pre-mean PG	0.99 (0.98 to 1.00)	0.048
LVEF <40%	1.54 (1.09 to 2.18)	0.016
BMI	1.03 (1.01 to 1.05)	0.002
Weight (kg)	1.01 (1.01 to 1.02)	0.001
CRCL	0.98 (0.98 to 0.99)	<0.001
Pre-TAVR creatinine	1.01 (1.01 to 1.01)	<0.001
Haemoglobin	0.98 (0.97 to 0.98)	<0.001
Valve size	1.01 (0.97 to 1.07)	0.58
Conscious sedation	0.83 (0.64 to 1.08)	0.17
Transapical access site	2.00 (1.40 to 2.81)	<0.001
Non-femoral access site	2.14 (1.59 to 2.87)	<0.001
Valve in valve	0.42 (0.18 to 0.81)	0.019

BMI, body mass index; COPD, chronic obstructive pulmonary disease; CRCL, creatinine clearance; EuroSCORE, European System for Cardiac Operative Risk Evaluation; LVEF, left ventricle ejection fraction; NYHA, New York Heart Association functional classification; PG, peak gradient; PVD, peripheral vascular disease; STS score, Society of Thoracic Surgeons adult cardiac surgery risk score; TAVR, transcatheter aortic valve replacement; TIA, transient ischaemic attack.

Table 3

Final multivariable model for predictors of acute kidney injury

Model parameter	OR (95% CI)	P values
NYHA class 4	1.18 (1.01 to 1.40)	0.041
Non-femoral access site	1.52 (1.30 to 1.77)	<0.001
Valve-in-valve procedure	0.58 (0.40 to 0.84)	0.004
Haemoglobin	0.98 (0.97 to 0.99)	<0.001
CRCL	0.98 (0.97 to 0.98)	<0.001
Weight (kg)	1.03 (1.02 to 1.04)	<0.001

CRCL, creatinine clearance; NYHA, New York Heart Association functional classification.

The final risk scores for the model are shown in table 4, as are the absolute risks of post-TAVR AKI. Scores can in theory range from −3 to 35 points, which corresponds to a 1% to 72% risk of AKI. In our cohort of 1993 patients, the actual scores observed ranged from 0 to 33 points, with an associated risk of post-TAVR AKI ranging from 1% to 65%.

Table 4

Score calculator for acute kidney injury

Risk factor	Categories	Points
NYHA class	Class 1–3	0
	Class 4	1
Non-femoral access site	No	0
	Yes	3
Valve-in-valve procedure	No	0
	Yes	-3
Haemoglobin	<100	7
	100–109	6
	110–119	4
	120–129	3
	130–139	2
	140+	0
Creatinine clearance	<25	13
	25–34	12
	35–44	11
	45–54	9
	55–64	7
	65–74	6
	75–84	4
	85+	0
Weight (kg)	<55	0
	55–59	2
	60–64	3
	65–69	4
	70–74	5
	75–80	6
	80–84	7
	85–89	8
	90+	11

NYHA, New York Heart Association functional classification.

The c-statistic showed a good discrimination with a mean value of 0.713. The χ2 statistic showed a mean of 0.195 but a large range from 0 to 0.905. When calibration was assessed graphically, there was excellent agreement between observed and predicted values (figure 2). The mean predicted risk for each quintile was 6.0%, 10.1%, 14.3%, 19.4% and 31.1% compared with mean observed risks of 6.3%, 8.7%, 13.6%, 18.9% and 32.2%, respectively.

Figure 2

Expected versus observed percentage of patients with acute kidney injury stratified by predicted risk quintile.

Discussion

In this study, we derived a simple six-factor risk score in order to predict post-TAVR AKI accurately. The score calculator incorporates information that is readily available in the diagnostic phase of the TAVR work-up, including procedure information about non-femoral access site and valve in valve as well pre-procedure haemoglobin, weight (kg), CRCL and the presence of dyspnoea at rest (NYHA class 4). The predicted absolute risk for post-TAVR AKI based on the calculator can range from very low to extremely high risk (1% to 72%) and as such provides important information to clinicians and patients as they make decisions about proceeding with the procedure or to institute prophylactic strategies.24

Our findings were consistent with the previous literature on drivers of post-TAVR renal dysfunction. Low haemoglobin and worse baseline kidney function have been associated with AKI in multiple studies.4 8 15 25–29 One study found higher BMI is a key predictor of kidney function decline28; although this was consistent in our univariable analysis, we found that weight was a stronger predictor in the multivariable model. We found that transapical access site increased risk of AKI,1 14 26 as did any non-femoral access sites in our cohort. Based on this, we grouped all non-femoral access sites as a single category. Previous studies have also found an association with diabetes, EuroSCORE and poor left ventricular function.6 8 17 30 To the best of our knowledge, ours is the only study to find that a valve-in-valve procedure, weight and NYHA class 4 are predictors of AKI post-TAVR. Notably, weight and NYHA class have previously been found to predict AKI or renal failure in cardiac surgery.19 31 32 Prior cardiac surgery increased risk of acute renal failure among patients undergoing open heart surgery.28 33 34 In contrast, we found valve-in-valve procedure was protective against AKI in TAVR.

The predictors we identified have face validity based on proposed pathophysiological mechanisms of AKI. A combination of haemodynamic, inflammatory, nephrotoxic and embolic factors may impair renal function and lead to a systemic injury.35 Having worse kidney function at baseline, as captured by a lower CRCL, increases kidney susceptibility to toxic peri-procedural events. Hypoperfusion to kidneys causing ischaemia may lead to AKI, explaining why a patient with poorer baseline cardiac function (NYHA class 4) or lower values of haemoglobin may be at higher risk.

Damage to kidneys via atherosclerotic plaque has also been previously described, and peripheral vascular disease has been a well-known cause of AKI in open heart surgery.32 Although we did not find that patients with peripheral vascular disease were at increased risk of TAVR, we did identify non-transfemoral TAVR access as a strong predictor of AKI. It is likely that the underlying mechanism for this observation was that the non-femoral access patients had severe peripheral vascular disease precluding a transfemoral TAVR, putting them at higher risk for AKI.

Weight has a complex relationship with AKI, in that it was an important predictor, despite being part of the CRCL calculation, suggesting that its relationship is non-linear. Although our work does not suggest an underlying pathophysiological mechanism for the relationship between AKI with weight, as noted, this has been observed with cardiac surgery also.32 Finally, valve-in-valve procedure reduces the risk of AKI. We hypothesise that this may be because valve-in-valve procedures are generally shorter and likely require less contrast media.

Our risk score was designed to be independent of factors that would only be known after the TAVR, such as contrast volume. This design allows for broader use, specifically during the decision-making time period for both clinicians and patients. We elected to group AKI stage 1–3, given the relatively small number of events. However, it is likely that information specific to the most severe forms of AKI, including the need for dialysis, would have the greatest impact on decision-making. Less than 1% of patients with AKI were in this most severe category, and thus our study was underpowered to evaluate this particular population. Nonetheless, further research to develop risk scores for severe post-TAVR AKI is warranted.

Our study must be interpreted in the context of several limitations that merit discussion. This is a retrospective study, so we cannot imply causality, nor can we be certain that all confounding factors were accounted for. Concomitant mitral regurgitation and myocardial infarction have previously been identified as independent predictors, but we did not have the data to explore this.30 In addition, we have a very small sample size of non-femoral or non-transapical access sites, so there should be caution in interpreting the effects of alternative access sites. We did not include certain factors such as contrast volume, which likely impact AKI incidence, as that would not be known at the time of decision-making. Nonetheless, minimising contrast in patients with a higher risk of AKI would undoubtedly impact post-TAVR AKI. Finally, although we used the VARC-2 definition of AKI,20 we were unable to measure urine output. A reduced urine output, with no increase in creatinine, is sufficient to classify AKI in the VARC-2 criteria. VARC-2 also allows for the change in creatinine to take place of the course of 7 days post-TAVR. Although we recorded all creatinine data that were available first week while patients were still in hospital, it is possible that some patients developed AKI in this time frame after they were discharged. Because of these diagnostic considerations, we may have misclassified some patients who had AKI.

Our study shows that it is possible to create an AKI calculator using only pre-procedurally known variables. We believe that this risk calculator will be of interest to the general TAVR community for use in the diagnostic work-up phase, by allowing a better understanding of the risks and rewards offered by TAVR during the decision-making process.