Literature DB >> 29725641

Proton Pump Inhibitor Usage and the Risk of Mortality in Hemodialysis Patients.

Angel L M de Francisco1, Javier Varas2, Rosa Ramos2, Jose Ignacio Merello2, Bernard Canaud3, Stefano Stuard3, Julio Pascual4, Pedro Aljama5,6,7.   

Abstract

INTRODUCTION: Long-term inappropriate proton pump inhibitors use (PPIs) is a matter of concern because of the risks associated with their long-term use in older patients with chronic conditions. The risk of PPI treatment in hemodialysis patients remains unexplored.
METHODS: We assessed the relationship between the use of PPIs and the risk of death in hemodialysis patients throughout a retrospective multicenter propensity score-matched study. Information about demographic, hemodialysis treatment, laboratory data, and concomitant medication was obtained from the EuCliD database (Fresenius Medical Care). We studied 1776 hemodialysis patients on PPI therapy compared to 466 patients not receiving PPIs. The resulting population comprising 2 groups of 410 matched patients was studied.
RESULTS: PPI use was associated with hypomagnesemia (Mg <1.8 mg/dl (0.75 mmol/l); odds ratio [OR] = 2.70, 95% confidence interval [CI] = 1.38-5.27, P < 0.01). The exposure to PPIs in the full patient cohort was identified as an independent predictor for all-cause mortality in both univariate (HR = 3.16, 95% CI = 1.69-5.90, P < 0.01) and multivariate (HR = 2.70, 95% CI = 1.38-5.27, P < 0.01) Cox regression models. Moreover PPI use was identified as a predictor of CV mortality (HR = 1.51, 95% CI = 1.05-2.20, P = 0.03) Of the 820 patients matched throughout the propensity score analysis, the hazard ratios for all-cause mortality (HR = 1.412, 95% CI = 1.04-1.93, P = 0.03) and CV mortality (HR = 1.67, 95% CI = 1.03-2.71, P = 0.04) were higher among patients on PPIs versus those not on PPIs.
CONCLUSION: The study data suggest that the PPI treatment should be regularly monitored and prescribed only when indicated.

Entities:  

Keywords:  hemodialysis; magnesium; mortality risk; proton pump inhibitors

Year:  2017        PMID: 29725641      PMCID: PMC5932134          DOI: 10.1016/j.ekir.2017.11.001

Source DB:  PubMed          Journal:  Kidney Int Rep        ISSN: 2468-0249


Proton pump inhibitors (PPI) are among the most commonly prescribed drugs. However the uncritical use of PPIs to treat symptoms that are not caused by an underlying acid-related disease is a widespread problem. Recent findings suggest that PPIs may be inappropriately prescribed in 50% to 80% of patients who are admitted to geriatric and internal medicine wards in acute care hospitals. Strid et al. concluded that PPIs were prescribed to 41% of chronic kidney disease (CKD) patients who lacked an adequate indication; this figure was 13% in hospitalized patients and 18% in patients with chronic lung disease. Although there may have been some confounding factors, recent studies have associated PPI use with complications such as vitamin B12 deficiency, neurological disturbances, impaired magnesium absorption, fracture risk, Clostridium difficile infection, and community-acquired pneumonia. Other studies have shown increased hazards of cardiovascular (CV) disease and death with PPI use,9, 10, 11 and it is also associated with a higher risk of incident CKD. Recently Xie et al. studied the risk of renal outcomes in 1:1 propensity score−matched cohorts of patients taking H2 blockers versus patients taking PPIs and in patients taking PPIs versus controls. The authors concluded that PPI exposure is associated with increased risk of incident CKD, CKD progression, and ESRD. Both CV problems and PPI use are very prevalent in hemodialysis (HD) patients. Notably, CV diseases are the leading cause of death among HD patients. Risk factors for CV diseases include hypertension, diabetes mellitus, hyperlipidemia, anemia, left ventricular hypertrophy, and chronic inflammation.14, 15 In the prospective observational Dialysis Outcomes and Practice Patterns Study, PPI prescribing patterns were investigated in 8628 HD patients from 7 countries. That study found that PPI use was very prevalent and that PPIs were more likely to be prescribed in France (25.7% of HD patients), Spain (26.9%), and the United Kingdom (27.3%) than in the United States (19.3%). PPI use has been associated with hypomagnesemia,5, 17 and lower serum magnesium levels are associated with higher mortality in HD patients, including those with hypoalbuminemia.18, 19 The aim of this study was to investigate associations among the use of PPIs, hypomagnesemia, and the risk of CV and all-cause mortality in a large, unselected cohort of HD patients. By mimicking the randomization used in clinical trials, propensity score matching (PSM) aims to achieve balance between treatment groups with regard to measured confounders and thus to minimize bias when estimating the effect of therapies. This study aimed to use PSM to control for systematic differences between HD patients on PPIs and those not on PPIs, and to investigate the effect of PPI therapy on mortality.

Methods

Patients and Study Design

This retrospective, multicenter, intention-to-treat, PSM study analyzed the effects of PPIs on all-cause mortality and CV mortality in HD patients. As a secondary outcome, it evaluated the effects of these drugs on serum magnesium levels. The study population comprised prevalent and stable outpatients who received HD treatment from 1 January 2014 to 30 March 2014. This was considered the baseline period. Patients were followed up until 30 September 2016 at any of the Fresenius Medical Care (FMC) NephroCare dialysis clinics in Spain. Patients were included in the study if they maintained a HD regimen of 3 sessions per week. The exclusion criteria were age less than 18 years and having a prescription for diuretics, which meant any drug in the C03 subgroup of the Anatomical Therapeutic Chemical (ATC) Classification System, or magnesium-containing compounds, which meant any drug with A12CC or A12AX ATC codes. The study included a total of 2242 patients from 40 different HD units. All patients completed informed written consent forms for the use of their clinical and demographical data in accordance with the corresponding Data Protection Agency standards and also to introduce them to the EuCliD database, the FMC clinical data system that has been used in other epidemiological studies20, 21, 22 and that was described previously for the Spanish population.

Treatment Protocol

The attending nephrologist at each center provided routine patient care and managed medication prescriptions. Standard HD (HD) and OL-HDF treatments were performed with FX-class High-Flux Dialysers and High-Flux Hemodiafilters with 4008S or 5008 monitors (Fresenius Medical Care, Bad Homburg, Germany). The treatment targets were determined according to Spanish FMC guidelines, which recommends a target weekly treatment length of 720 minutes and a dialysis dose goal of Kt/V>1.4. Patients were dialyzed 3 times per week with ultrapure dialysate containing less than 0.1 colony forming units per milliliter and less than 0.03 endotoxin units per milliliter. The dialysate included sodium (140 mmol/l), magnesium (0.50 mmol/l), glucose (1 g/l), customized potassium (1.5–3 mmol/l), and calcium (1.25–1.75 mmol/l) according to the clinical characteristics of each patient.

Study Variables

We recorded the following baseline data: age (years), gender (female), dialysis vintage (months), diabetes mellitus status (categorized as yes/no) and Charlson Comorbidity Index. We recorded the following HD treatment clinical characteristics: vascular access (categorized as arteriovenous fistula [AVF] or catheter; prosthetic AVF was included in the AVF category); treatment technique, that is, HD or postdilution OL-HDF dialysis mode; Kt/v; effective treatment time (Td, minutes); and systolic blood pressure (SBP), measured before the HD session and calculated as the average of the baseline period measurements. We also measured the average relative overhydration (AvROH) with a body composition monitor, which was calculated as the average during the baseline period. Blood samples for laboratory assessments were drawn routinely, and the following were determined: albumin, hemoglobin (Hb), C-reactive protein (CRP), magnesium, calcium, and 25-hydroxycholecalciferol (VitD). Medication prescriptions during the baseline period were recorded as “yes” or “no” for each studied drug for each patient. We recorded the prescription of any PPI (i.e., any drug in the A02BC ATC subgroup). To look at potential drug−drug interactions between PPIs and some anticoagulant agents, we recorded prescriptions of vitamin K antagonists (drugs in the B01AA ATC subgroup, including acenocoumarol [Sintrom; Madrid, Spain] or warfarin), platelet aggregation inhibitors, excluding heparin (drugs in the B01AC ATC subgroup, including clopidogrel or acetylsalicylic acid), and systemic corticosteroids (drugs in the H01 ATC subgroup).

Statistical Analysis

Continuous variables are reported as means and standard deviations (SD) or as medians and 25th and 75th percentiles, as appropriate. Categorical variables are reported as percentages. Bivariate comparisons between cohorts were performed using the t test for normally distributed variables, the Wilcoxon rank-sum test for continuous parameters that were not normally distributed, or the χ2 test for categorical variables. Factors that influence serum magnesium levels were studied 6 months after the individual’s baseline data were recorded. To build these subanalyses, we selected those patients with a complete 6-month follow-up period. Univariate and multivariate logistic regression analyses were performed to identify factors that predicted hypomagnesemia, which was defined as total serum magnesium levels lower than 1.8 mg/dl (0.75 mmol/l). The corresponding odds ratios (ORs) and 95% confidence intervals (CIs) were calculated for each variable recorded in the study. For survival analyses, follow-up time was defined as the period between the baseline and the last confirmed follow-up or the date of death. For all-cause mortality, we used several Kaplan−Meier survival curves that were compared using log-rank tests. To investigate possible independent predictors of mortality, univariate and multivariate Cox regression models were used to calculate the corresponding hazard ratios (HRs) and to estimate the 95% CIs. The linear effects of the continuous variables for both risk models that were used in the study and described above were investigated using several univariate models. The corresponding cut-off values were chosen to ensure balanced groups that were clinically relevant. For age, the cut-offs were ≤55, 56 to 65, 66 to 75, and >76 years. For dialysis vintage, the cut-offs were ≤24, 24.01 to 48.00, 48.01 to 72, and >72.01 months. For SBP, the cut-offs were ≤115, 115.01 to 125.00, 125.01 to 140.0, 140.01 to 155.00, and >155.01 mm Hg. For AvROH, the cut-offs were ≤4.00, 4.01 to 10.00, 10.01 to 15.00, and >15%. For albumin, the cut-offs were ≤3.50, 3.51 to 4.00, and >4.00 g/dl. For Hb, the cut-offs were ≤10.00, 10.01 to 11.00, 11.01 to 12.00, 12.01 to 13.00, and >13.00 g/dl. For CRP, the cut-offs were ≤2.0, 2.01 to 5.0, 5.01 to 13.00, and >13.0 mg/l. For calcium, the cut-offs were ≤8.40, 8.41 to 9.00, 9.01 to 9.50, and 9.51 mg/dl. For VitD, the cut-offs were ≤10.0, 10.01 to 15.00, 15.01 to 30.00, and >30.01 ng/dl. In the Cox models, magnesium levels were introduced as a split covariate with the following cut-off values: ≤2.09, 2.1 to 2.30, 2.31 to 2.50, and >2.51 mg/dl. On the contrary, Kt/V and Td were introduced as continuous variables. The other covariates that were included in the corresponding risk models were gender (reference: female), diabetes mellitus (reference: none), Charlson Comorbidity Index (excluding age and diabetes mellitus); vascular access (reference AVF); treatment mode (reference: HD); Kt/V, Td, vitamin K antagonists (including acenocoumarol or warfarin; reference: none); platelet aggregation inhibitors, excluding heparin (including clopidogrel or acetylsalicylic acid; reference none); and systemic corticosteroid use. An additional approach was performed to study the relation between the PPI exposure and the outcomes, considering a competing risks scenario. This consists of constructing several adjusted competing risks regression models to calculate the corresponding subdistribution hazard ratios (SHR) for all-cause mortality following the approach proposed by Fine and Gray. This was an observational study, so patients were not randomly assigned to receive or not to receive PPIs. Thus, we used PSM to minimize confounding by indication as a sensitivity analysis. Then we calculated the propensity score for each patient by modeling the probability of receiving or not receiving PPIs by the subsequent multivariate logistic regression models. Demographic features, HD clinical parameters, laboratory values, and concomitant antithrombotic medication were included for the proper estimation of the propensity scores. The resulting scores were used to match the groups on a 1:1 basis using a caliper-matching algorithm. We performed PSM by fixing a caliper parameter that was the equivalent of 0.2 of the pooled SD of the logit of the propensity scores. After conducting the PSM, there were 1422 unmatched patients, leaving 820 matched patients for statistical analysis (410 in each group). Finally, to ensure the quality of the pairings from the PSM, we evaluated the balance in the covariates using the standardized differences before and after matching between the groups, considering that differences <0.1 were of negligible imbalance and by making the appropriate bivariate comparisons. Analyses were performed with IBM SPSS Statistics 23.0 (IBM Corp., Armonk, NY). The Fine and Gray competing risks regression models were run using the SPSS extension command COMPRISK, which uses the R “cmprsk” package. The PSM was performed using SPSS R-Menu using in both cases the R statistical free software version R3.1.1. Statistical significance was set at P < 0.05.

Results

Demographic and Laboratory Data

This study included 2242 patients who were treated at 40 HD facilities in Spain, 1776 (79.2%) of whom were on PPI therapy. Table 1 shows the baseline characteristics of the patients in this cohort. The patients on PPIs had been treated longer with HD, had more catheters for vascular access, had lower SBP, had lower serum albumin, had lower serum magnesium levels (no PPI mean and 95% CI = 2.41 mg/dl (2.37−2.44)/PPI: 2.30 mg/dl (2.27−2.31), and a lower percentage had online hemodiafiltration (OL-HDF) as a treatment option. In addition, the percentage of patients using antithrombotic agents was higher in the group of patients on PPI therapy compared to the group not on PPI therapy.
Table 1

Baseline characteristics of the entire study population (N = 2242)

No PPI (n = 466)PPI (n = 1776)P
Demographics
 Age, yr68.50 (56–76)68.00 (57–76)0.69
 Gender, female33.92%38.14%0.09
 Dialysis vintage, mo32.19 (16.56–67.96)45.60 (21.77–79.15)<0.01
 Diabetes mellitus31.94%33.06%0.65
 Charlson Comorbidity Indexa2 (2–3)2 (2–3)0.24
HD clinical parameters
 AVF74.45%69.65%0.05
 OL-HDF53.74%44.84%<0.01
 Kt/v1.9 ± 0.381.93 ± 0.40.17
 Td, min245.92 ± 11.87246.22 ± 130.65
 SBP pre-HD, mm Hg134.91 ± 21.72132.58 ± 230.04
 AvROH9.79 (4.23–14.39)9.7 (4.26–14.54)0.88
Laboratory values
 Albumin, g/dl3.89 ± 0.363.85 ± 0.360.03
 Hemoglobin, g/dl11.71 ± 1.3611.75 ± 1.380.62
 CRP, mg/l5.00 (1.80–12.48)5.92 (2.00–13.58)0.14
 Magnesium, mg/dl2.41 ± 0.382.30 ± 0.36<0.01
 Calcium, mg/dl9.02 ± 0.538.96 ± 0.850.15
 VitD, ng/dl15.7 (10.9–24)15.5 (10.1–25)0.89
Antithrombotic agents
 Vitamin K antagonistsb7.73%11.71%0.01
 Platelet aggregation inhibitors excluding heparinc40.13%55.07%<0.01
 Systemic corticosteroids3.43%7.55%<0.01

AVF, arteriovenous fistula; AvROH, average relative overhydration; CRP, C-reactive protein; HD, hemodialysis; OL-HDF, online hemodiafiltration; PPI, proton-pump inhibitor; SBP pre-HD, systolic blood pressure measured before hemodialysis session; Td, effective treatment time; VitD, 25-hydroxycolecalciferol.

Charlson Comorbidity Index: excluding age and diabetes mellitus.

Vitamin K antagonists: including acenocoumarol or warfarin.

Platelet aggregation inhibitors excluding heparin: including clopidogrel or acetylsalicylic acid.

Baseline characteristics of the entire study population (N = 2242) AVF, arteriovenous fistula; AvROH, average relative overhydration; CRP, C-reactive protein; HD, hemodialysis; OL-HDF, online hemodiafiltration; PPI, proton-pump inhibitor; SBP pre-HD, systolic blood pressure measured before hemodialysis session; Td, effective treatment time; VitD, 25-hydroxycolecalciferol. Charlson Comorbidity Index: excluding age and diabetes mellitus. Vitamin K antagonists: including acenocoumarol or warfarin. Platelet aggregation inhibitors excluding heparin: including clopidogrel or acetylsalicylic acid.

Identifying Hypomagnesemia Predictors

Total serum hypomagnesemia was defined as magnesium levels <1.8 mg/dl (<0.75 mmol/l). In all, 137 (6.1%) of the 2242 included patients had hypomagnesemia. The PPI use was higher in the hypomagnesemia group (92.0% vs. 78.4%; P < 0.01). Univariate and multivariate logistic regression models were used to identify predictors that might have an impact on hypomagnesemia (Table 2). PPI use was significantly associated with hypomagnesemia, by both univariate (OR = 3.16; 95% CI = 1.69–5.90, P < 0.01) and multivariate (OR = 2.70; 95% CI = 1.38–5.27, P < 0.01) analysis. Moreover, OL-HDF, pre-HD SBP, and serum calcium levels were independent predictors for hypomagnesemia in HD patients.
Table 2

Logistic regression models to identify predictors with a potential impact on hypomagnesemia (<1.8 mg/dl or <0.75 mmol/l)

Univariate analysis
Multivariate analysis
OR95% CI
POR95% CI
P
LowerUpperLowerUpper
 PPI
 Ref: no3.161.695.90<0.012.701.385.27<0.01
Demographics
 Age, yr
 Ref: ≤55--------
 56–650.630.351.130.120.490.250.980.04
 66–750.700.401.200.190.690.351.370.29
 >760.510.300.850.010.400.210.760.01
 Gender
 Ref: female0.880.611.270.490.750.491.150.19
 Dialysis vintage, mo
 Ref: ≤24.0--------
 24.01–48.000.600.380.960.030.570.340.950.03
 48.01–72.000.750.441.280.300.920.491.720.080
 >72.010.920.561.490.730.910.521.590.73
 Diabetes mellitus
 Ref: no0.880.611.260.490.860.561.310.49
 Charlson Comorbidity Indexa0.910.781.060.220.950.801.130.58
HD clinical parameters
 VCC
 Ref: AVF0.740.521.060.110.980.631.530.92
 OL-HDF
 Ref: HD1.801.252.60<0.011.711.142.550.01
 Kt/V0.990.971.00.0860.800.441.430.44
 Td, min0.990.971.00.0860.980.971.000.04
 SBP pre-HD, mm Hg
 ≤115.001.290.802.09.2941.961.103.480.02
 115.01–125.001.160.691.96.5821.140.642.040.65
 Ref: 125.01–140.0--------
 140.01–155.01.941.153.260.011.851.043.300.04
 >155.011.791.013.180.051.941.023.680.04
 AvROH
 ≤4.000.900.551.480.680.870.491.570.65
 Ref: 4.01–10.00--------
 10.01–15.000.720.451.150.170.620.371.060.08
 >15.010.920.551.540.761.000.551.810.99
Laboratory values
 Albumin, g/dl
 <3.50.570.380.870.010.660.421.070.09
 3.5–4.0--------
 Ref: >4.01.911.223.010.011.330.792.250.28
 Hemoglobin, g/dl
 <10.00.680.381.200.180.660.331.300.28
 10.0–11.00.870.541.420.580.880.501.550.67
 Ref: 11.0–12.0--------
 12.0–13.01.330.792.240.281.210.682.170.52
 >13.00.890.531.490.660.950.521.730.86
 CRP, mg/l
 Ref: <2--------
 2.01–5.01.160.671.990.601.200.652.220.56
 5.01–13.01.060.651.720.831.230.702.180.47
 >13.00.760.481.210.250.980.571.700.95
 Calcium, mg/dl
 Ref: <8.40--------
 8.41–9.001.500.982.310.061.801.092.970.02
 9.01–9.502.581.574.21<0.012.961.655.30<0.01
 >9.517.743.0019.94<0.018.933.0126.47<0.01
 VitD, ng/dl
 ≤10.001.350.752.40.3151.250.642.450.52
 10.01–15.001.450.802.62.2261.260.662.390.48
 15.01–30.001.120.661.89.6700.960.551.680.89
 >30.01--------
Antithrombotic agents
 Vitamin K antagonistsb
 Ref: no0.520.330.820.010.610.361.030.06
 Platelet aggregation inhibitors excluding heparinc
 Ref: no1.140.811.610.461.150.751.760.51
 Systemic corticosteroids
 Ref: no0.900.461.760.771.620.634.190.31

AVF, arteriovenous fistula; AvROH, average relative overhydration; CI, confidence interval; CRP, C-reactive protein; HD, hemodialysis; OL-HDF, online hemodiafiltration; OR, odds ratio; PPI, proton pump inhibitor; Ref, reference; SBP pre-HD, systolic blood pressure measured before the hemodialysis session; Td, effective treatment time; VCC, venous central catheter; VitD, 25-hydroxycolecalciferol.

Charlson Comorbidity Index: excluding age and diabetes mellitus.

Vitamin K antagonists: including acenocoumarol or warfarin.

Platelet aggregation inhibitors excluding heparin: including clopidogrel or acetylsalicylic acid.

Logistic regression models to identify predictors with a potential impact on hypomagnesemia (<1.8 mg/dl or <0.75 mmol/l) AVF, arteriovenous fistula; AvROH, average relative overhydration; CI, confidence interval; CRP, C-reactive protein; HD, hemodialysis; OL-HDF, online hemodiafiltration; OR, odds ratio; PPI, proton pump inhibitor; Ref, reference; SBP pre-HD, systolic blood pressure measured before the hemodialysis session; Td, effective treatment time; VCC, venous central catheter; VitD, 25-hydroxycolecalciferol. Charlson Comorbidity Index: excluding age and diabetes mellitus. Vitamin K antagonists: including acenocoumarol or warfarin. Platelet aggregation inhibitors excluding heparin: including clopidogrel or acetylsalicylic acid.

Proton Pump Inhibitors and Mortality

Patients were followed up until they left the FMC clinics for any reason or until death. The overall mean follow-up time was 22.81 ± 9.18 months. During the follow-up period, 560 patients dropped out of the study because of kidney transplantation (45.17%), changes in HD unit (n = 43.77%), or other reasons (11.09%). All of these patients were censored at the time that they dropped out of the study. There were 515 deaths during the study, including 433 patients who were on PPIs and 82 patients who were not on PPIs. The causes of mortality were CV related (43.30%), infection (19.22%), sudden death (16.12%), oncological disease (7.38%), and other causes (13.98%). The resulting 90% and 80% survival time and the corresponding 95% CIs were 10.97 (10.94−10.98) and 20.23 (20.20−20.25) months for the PPI group and 14.27 (14.23−14.29) and 26.81(26.75−26.86) months for the non-PPI group, respectively. The Kaplan–Meier analysis of the entire patient cohort showed significantly worse survival (log-rank = 7.44; P = 0.01) for patients on PPI therapy (Figure 1). The Kaplan–Meier analysis of the entire patient cohort that considered only CV-related disease also showed significantly worse survival (log-rank = 4.889; P = 0.03) for patients on PPI therapy (Figure 1).
Figure 1

Kaplan–Meier survival plots for (upper panels) all-cause mortality and (lower panels) cardiovascular (CV) mortality, both (left panels) in the entire population and (right panels) after the propensity score−matching adjustment. The resultant survival curves for patients on proton pump inhibitors (PPIs) are shown in gray, whereas the curves for patients not on PPIs are shown in black. Corresponding log-rank test results and survival tables are also shown.

Kaplan–Meier survival plots for (upper panels) all-cause mortality and (lower panels) cardiovascular (CV) mortality, both (left panels) in the entire population and (right panels) after the propensity score−matching adjustment. The resultant survival curves for patients on proton pump inhibitors (PPIs) are shown in gray, whereas the curves for patients not on PPIs are shown in black. Corresponding log-rank test results and survival tables are also shown. The independent predictors of all-cause mortality in the entire patient cohort were identified throughout several Cox regression models using the original scale for each variable (Supplementary Table S1) and also by analyzing the nonlinear effects of the continuous variables (Table 3). PPI exposure was identified as an independent predictor of all-cause mortality in the univariate analysis (HR = 1.39, 95% CI = 1.10–1.76, P = 0.01) and both multivariate (HR = 1.34, 95% CI = 1.03–1.75 P = 0.03; HR nonlinear effects = 1.37, 95% CI = 1.05–1.78, P = 0.02) regression models. Also the PPI exposure was also a significant factor in CV mortality (HR = 1.51, 95% CI = 1.05–2.20, P = 0.03). Other independent predictors of all-cause mortality were age, dialysis vintage, diabetes mellitus, Charlson Comorbidity Index, vascular access, pre-HD SBP, AvROH, albumin, C-reactive protein level, serum calcium level, and exposure to vitamin K antagonists or platelet aggregation inhibitors.
Table 3

Univariate and multivariate Cox regression analysis of all-cause mortality in the entire study population

Univariate analysis
Multivariate Cox analysis
HR95% CI
PHR95% CI
P
LowerUpperLowerUpper
 PPI
 Ref: no1.391.101.760.011.371.051.780.02
Demographics
 Age, yr
 Ref: ≤55--------
 56–651.761.232.52<0.011.410.942.120.10
 66–752.611.903.58<0.012.141.493.08<0.01
 > 763.712.725.05<0.013.412.374.90<0.01
 Gender
 Ref: female1.040.871.250.071.110.901.360.33
 Dialysis vintage, mo
 Ref: ≤24.0--------
 24.01–48.001.170.911.500.211.040.791.380.76
 48.01–72.001.341.031.740.031.381.031.840.03
 >72.011.301.031.640.031.651.272.15<0.01
 Diabetes mellitus
 Ref: no1.481.251.77<0.011.541.261.90<0.01
 Charlson Comorbidity Indexa1.151.071.24<0.011.121.041.220.01
HD clinical parameters
 VCC
 Ref: AVF1.501.261.80<0.011.291.061.580.01
 OL-HDF
 Ref: HD0.930.781.100.400.900.721.110.31
 Kt/V1.020.821.270.861.030.771.390.83
 Td, min0.990.991.000.010.990.991.000.15
 SBP pre-HD, mm Hg
 ≤115.001.250.991.590.061.100.831.440.51
 115.01–125.000.930.701.240.640.910.661.240.54
 Ref: 125.01–140.0--------
 140.01–155.00.790.611.020.070.790.591.050.11
 >155.010.760.561.010.060.810.591.120.20
 AvROH
 ≤4.001.230.951.600.121.411.051.880.02
 Ref: 4.01–10.00--------
 10.01–15.001.431.121.830.011.501.141.970.01
 >15.011.721.342.20<0.011.741.322.29<0.01
Laboratory values
 Albumin, g/dl
 <3.51.681.362.09<0.011.401.101.790.01
 3.5–4.0--------
 Ref: >4.00.620.500.77<0.010.710.550.910.01
 Hb, g/dl
 <10.01.681.252.25<0.011.350.971.890.08
 10.0–11.01.270.991.620.061.120.851.480.41
 Ref: 11.0–12.0--------
 12.0–13.01.130.881.440.331.060.801.390.68
 >13.01.060.811.390.680.980.731.340.92
 CRP, mg/l
 Ref: <2--------
 2.01–5.01.611.212.16<0.011.691.222.330.01
 5.01–13.01.851.422.42<0.011.851.362.51<0.01
 >13.02.531.953.28<0.012.371.773.17<0.01
 Magnesium, mg/dl
 <2.091.541.211.96<0.010.910.681.220.52
 2.10–2.301.401.081.83<0.011.000.751.350.99
 2.31–2.501.230.931.610.151.060.791.430.71
 Ref: >2.51--------
 Calcium, mg/dl
 Ref: <8.40--------
 8.41–9.000.870.631.200.400.610.410.920.02
 9.01–9.500.940.731.230.670.730.540.980.04
 >9.511.050.801.370.720.990.741.330.94
 VitD, ng/dl
 ≤10.001.270.951.700.101.140.841.540.40
 10.01–15.001.080.801.460.601.070.791.460.67
 15.01–30.000.860.641.140.290.880.651.170.37
 >30.01--------
Antithrombotic agents
 Vitamin K antagonistsb
 Ref: no1.611.282.04<0.011.501.151.96<0.01
 Platelet aggregation inhibitors excluding heparinc
 Ref: no1.331.121.59<0.011.311.071.620.01
 Systemic corticosteroids
 Ref: no1.120.801.560.521.451.002.110.05

AVF, arteriovenous fistula; AvROH, average relative overhydration; CI, confidence interval; CRP, C-reactive protein; HD, hemodialysis; OL-HDF, online hemodiafiltration; PPI, proton pump inhibitor; Ref, reference; SBP pre-HD, systolic blood pressure measured before hemodialysis session; Td, effective treatment time; VCC, venous central catheter; VitD, 25-hydroxycolecalciferol.

Charlson Comorbidity Index: excluding age and diabetes mellitus.

Vitamin K antagonists: including acenocoumarol or warfarin.

Platelet aggregation inhibitors excluding heparin: including clopidogrel or acetylsalicylic acid.

Univariate and multivariate Cox regression analysis of all-cause mortality in the entire study population AVF, arteriovenous fistula; AvROH, average relative overhydration; CI, confidence interval; CRP, C-reactive protein; HD, hemodialysis; OL-HDF, online hemodiafiltration; PPI, proton pump inhibitor; Ref, reference; SBP pre-HD, systolic blood pressure measured before hemodialysis session; Td, effective treatment time; VCC, venous central catheter; VitD, 25-hydroxycolecalciferol. Charlson Comorbidity Index: excluding age and diabetes mellitus. Vitamin K antagonists: including acenocoumarol or warfarin. Platelet aggregation inhibitors excluding heparin: including clopidogrel or acetylsalicylic acid. Further examination for CV mortality as the outcome of interest was performed using competing risks methods to account for non-CV mortality as a competing event. Moreover, as this study was conducted in a routine clinical practice scenario, both the “other” drop-out reasons as well as the independent predictors of all-cause mortality previously isolated were considered to build these multivariate competing risks regression analysis. Again, the PPI exposure was identified as an independent predictor of all-cause mortality (SHR = 1.33, 95% CI = 1.09–1.56, P < 0.01) and CV mortality (SHR = 1.432, 95% CI = 1.05–1.81, P = 0.04) in both cases. Because of the observational nature of this study, we used PSM for the sensitivity analysis for the main outcome to minimize the effects of confounding. We then tried to balance these populations for every covariate. The baseline characteristics after PSM are shown in Table 4. After PSM, mortality was compared in the 410 patients who were on PPIs versus the 410 patients who were not on PPIs. The results were consistent with our findings for the entire patient cohort. Kaplan–Meier analysis for all-cause mortality and CV mortality in the adjusted cohort showed significantly worse survival for patients on PPI therapy (log-rank = 4.785, P = 0.03, and log-rank = 4.264, P = 0.04, respectively) (Figure 1). Cox models identified PPI exposure as an independent predictor of all-cause mortality (HR = 1.41, 95% CI = 1.04–1.93, P = 0.03) and CV mortality (HR = 1.67, 95% CI = 1.03–2.71, P = 0.04). The corresponding Fine and Gray regression models performed in the PSM-adjusted population showed the same results as the Cox models for all-cause mortality (SHR = 1.41, 95% CI = 1.11–1.73, P = 0.03) and CV mortality (SHR = 1.64, 95% CI = 1.24–2.24, P = 0.03) in both cases.
Table 4

Baseline characteristics in the propensity-matched cohort (n = 820)

CharacteristicNo PPI (n = 410)PPI (n = 410)Standardized differences
P
Before PSMAfter PSM
Demographics
 Age, yr70 (56–76)68 (59–77)0.650.090.89
 Gender, female33.66%38.05%0.050.000.19
 Dialysis vintage, mo32.48 (17.18–70.75)41.02 (21.1–76.35)0.100.020.07
 Diabetes mellitus32.93%36.10%0.140.020.34
 Charlson Comorbidity Indexa2 (2–3)2 (2–3)0.060.030.32
HD clinical parameters
 AVF74.63%71.71%0.050.040.35
 OL-HDF57.56%56.34%0.100.040.75
 Kt/v1.92 ± 0.381.92 ± 0.390.140.080.90
 Td, min245.79 ± 11.39246.6 ± 11.760.090.030.32
 SBP pre-HD, mm Hg134.98 ± 21.61134.08 ± 22.510.030.010.56
 AvROH10.01 (4.78–14.42)10.02 (4.09–14.81)0.070.010.78
Laboratory values
 Albumin, g/dl3.89 ± 0.353.85 ± 0.350.070.040.08
 Hemoglobin, g/dl11.74 ± 1.3611.75 ± 1.40.130.030.96
 CRP, mg/l5.13 (1.9–12.95)5.97 (2.11–12.25)0.060.020.37
 Magnesium, mg/dl2.41 ± 0.372.37 ± 0.420.080.030.19
 Calcium, mg/dl9.04 ± 0.528.97 ± 0.540.320.020.07
 VitD, ng/dl15.7 (10.98–24)15.35 (10–25.28)0.070.050.75
Antithrombotic agents
 Vitamin K antagonistsb8.05%9.51%0.030.010.46
 Platelet aggregation inhibitors excluding heparinc37.32%42.68%0.120.020.12
 Systemic corticosteroids3.41%3.66%0.340.060.85

AVF, arteriovenous fistula; AvROH, average relative overhydration; CRP, C-reactive protein; HD, hemodialysis; OL-HDF, online hemodiafiltration; PPI, proton pump inhibitor; PSM, propensity score matching; SBP pre-HD, systolic blood pressure measured before hemodialysis session; Td, effective treatment time; VitD, 25-hydroxycolecalciferol.

Charlson Comorbidity Index: excluding age and diabetes mellitus.

Vitamin K antagonists: including acenocoumarol or warfarin.

Platelet aggregation inhibitors excluding heparin: including clopidogrel or acetylsalicylic acid.

Baseline characteristics in the propensity-matched cohort (n = 820) AVF, arteriovenous fistula; AvROH, average relative overhydration; CRP, C-reactive protein; HD, hemodialysis; OL-HDF, online hemodiafiltration; PPI, proton pump inhibitor; PSM, propensity score matching; SBP pre-HD, systolic blood pressure measured before hemodialysis session; Td, effective treatment time; VitD, 25-hydroxycolecalciferol. Charlson Comorbidity Index: excluding age and diabetes mellitus. Vitamin K antagonists: including acenocoumarol or warfarin. Platelet aggregation inhibitors excluding heparin: including clopidogrel or acetylsalicylic acid.

Discussion

In this observational study, we used PSM to examine the effects of PPI therapy on the mortality of HD patients in Spain. Our data suggest an overall trend toward hypomagnesemia and increased all-cause mortality and CV mortality in HD patients on PPIs. Our findings are consistent with those of previous studies that also found increased hazards of CV disease and death with PPI use in other populations. Maggio et al. investigated the relationship between PPI use and study outcomes in patients 65 years or older who were discharged from acute care medical wards. The authors concluded that high-dose PPI use was associated with increased 1-year mortality. Charlot et al. studied aspirin-treated patients with first-time myocardial infarction and found that treatment with PPIs was associated with an increased risk of adverse CV events. Bell et al. observed that baseline PPI use was associated with all-cause mortality in 2 cohorts of institutionalized older persons. Two factors may be associated with the risk of death in HD patients: the high prevalence of CV disease14, 15 and the high use of PPIs. Bailie et al. investigated HD patients from 7 countries in the prospective observational Dialysis Outcomes and Practice Patterns Study and found that 0.8% to 26.9% were on PPI treatment, depending upon the country. In the present study, performed 16 years later using data collected at 40 HD facilities in Spain, 1776 of 2242 HD patients (79%) were on PPI therapy. This is an extremely high percentage and should be kept in mind when considering medical management of HD patients. In fact, PPIs are very often prescribed outside of the approved indications. PPIs are associated with an increased risk of vitamin and mineral deficiencies, including vitamin B12, vitamin C, calcium, iron, and magnesium deficiencies, particularly in elderly and malnourished patients and in those on chronic HD and concomitant PPI therapy. There are several case reports of hypomagnesemia detected in patients who use PPIs; their serum magnesium levels normalized once PPI treatment was stopped. Gau et al. showed that serum magnesium levels were lower in hospitalized patients who use PPIs versus those who did not use them. Hypomagnesemia was reported to be linked to PPI use in HD patients. Specifically, lower levels of serum magnesium were associated with a higher rate of PPI use in hypomagnesemic patients compared to normomagnesemic patients. The report concluded that hypomagnesemia might occur with PPI use in HD patients with dialysate magnesium levels of 0.5–0.375 mmol/l. In a systematic review that included a meta-analysis of 9 studies with a total of 115,455 patients, hypomagnesemia was more frequent in patients using PPIs (OR = 1.775), although there was significant heterogeneity among the included studies. The U.S. Food and Drug administration has issued a warning that the prolonged use of PPIs may cause low serum magnesium levels, and recommends obtaining serum magnesium levels prior to prescribing PPI treatment in patients who are expected to use these drugs long term. The mechanism underlying hypomagnesemia that is associated with PPI use is still under investigation. PPIs may decrease intestinal magnesium absorption by interfering with both active absorption via transient receptor potential melastatin (TRPM) protein channels and with passive absorption through the paracellular pores.33, 34 PPIs may also affect the absorption of magnesium in the colon. The pH in the cecum is usually acidic due to the fermentation of carbohydrates, so PPI inhibition of colonic proton pumps may increase the pH of the distal colon and indirectly decrease active magnesium absorption in the colon by TRPM6 and by passive paracellular transport. There are several possible mechanisms that could explain the relationship between PPIs and the risk of death. We speculate that hypomagnesemia could be considered for CV events and mortality. Low serum magnesium was associated with an increased risk of CHD mortality and sudden cardiac death in a prospective, population-based cohort study. Hypomagnesemia was also significantly associated with an increased risk of mortality in HD patients. In an FMC North American HD center, Lacson et al. found a clear increase in mortality rates in the 2 patient groups with the lowest serum magnesium levels (<0.65 and 0.65–0.8 mmol/l) compared to the group with the highest serum magnesium levels. There is sufficient evidence to indicate that hypomagnesemia significantly exacerbates the proarrhythmic effect of hypokalemia, particularly if it occurs in the presence of digoxin toxicity. Potassium and magnesium depletion are commonly concomitant and are associated with higher prevalence rates of ventricular arrhythmias.38, 39 Rapid changes in electrolyte levels that occur during HD, including low magnesium, low potassium, low calcium, and a pH shift from acidotic to alkaline conditions, create the perfect conditions for acute arrhythmia and sudden death or for subacute cardiac events. However our multivariate analysis did not identify magnesium levels as an independent all-cause mortality predictor. Another factor that links PPIs to the risk of death relates to liver metabolism of clopidogrel and PPIs. This metabolic process may explain the reduction of efficacy of antithrombotics. Clinical studies of the risk of adverse CV events associated with the dual use of clopidogrel and PPIs show conflicting results. Clopidogrel and PPIs are metabolized by the same hepatic isoenzyme, CYP2C19, and PPIs might interfere with the conversion of clopidogrel to its active metabolite and thereby reduce its clinical benefit. However, PPIs also diminish the benefits of ticagrelor, a drug that does not require hepatic activation. In our study, dual PPI and clopidogrel use was associated with a higher risk of all-cause mortality in the univariate and multivariate Cox regression analyses. This finding could be an example of reverse causality due to the observational nature of the study. A higher CV disease index could explain the higher rate of clopidogrel prescription. Nevertheless, in the PSM analysis, in which the compared groups did not differ according to clopidogrel therapy, PPI use was an independent factor for mortality. Finally, another mechanism that connects PPIs and mortality relates to plasma asymmetrical dimethylarginine (ADMA) degradation. ADMA is an endogenous inhibitor of nitric oxide synthase, and elevated plasma ADMA is associated with increased risk of CV disease, likely because of its attenuation of the vasoprotective effects of endothelial nitric oxide synthase. Ghebremariam et al. found that PPIs elevate plasma ADMA levels and reduce nitric oxide levels and endothelium-dependent vasodilation in a murine model and in ex vivo human tissues. PPIs increase ADMA levels because they bind to and inhibit the enzyme dimethylarginine dimethylaminohydrolase, which degrades ADMA. Notably, ADMA levels were found to predict renal disease progression and death in patients with moderate to severe renal insufficiency. ADMA may be involved in the atherosclerosis process and may be an important factor in determining the risk of renal insufficiency. As a consequence, PPI usage induces the dysregulation of vascular NOS, which may explain how PPIs increase long-term CV risk even in individuals who are not taking clopidogrel. This study has several limitations. One limitation is the lack of information about duration of exposure to PPIs and therefore its intention-to-treat nature. In addition, the measurement of total magnesium may have overestimated the incidence of hypomagnesemia when significant hypoalbuminemia was present. Moreover, this could be more pronounced in the non-PPI patient group with low magnesium levels if this group had less opportunity to complete 6 months of follow-up. In this regard, a hypomagnesemia predictor analysis was not possible to perform using a full 6-month follow-up period for all the patients or further Cox regression models. It should also be noted that only total serum magnesium was measured in this study, and because ionized magnesium is the active state in membrane and cell transport, cell polarization effects, and other mechanisms, the hypomagnesemia numbers may be biased. Unmeasured confounders such as the residual renal function or other factors that are linked to poor prognosis in older patients, such as malnutrition, might also affect our results. Our only information about nutrition was the serum albumin level, which was significantly lower in patients on PPI treatment before PSM. It is also possible that PPI use is a marker of a frail population that has more comorbidities and polypharmacotherapy. Therefore, bias by indication cannot be wholly excluded. Moreover, in our study, nonincident PPI users were examined, and our analysis did not include a possible H2 blocker group as (negative) controls or consider the type of PPI, the duration of exposure, adherence, serum magnesium level before starting PPIs, or the proportion of patients with previous PPI use before enrollment. Despite previous PPI use, some patients in the PPI group may consistently have had magnesium levels in the normal range during the study period. On the other hand, our study of the interactions between PPI and hypomagnesemia in relation to mortality outcomes has several strengths, including the several adjustments performed in the different multivariate models and the use of PSM and robust findings that support our conclusion. However, despite the PSM apparently having resolved the imbalance between the 2 populations studied, we cannot exclude the possibility that it failed to produce 2 well-matched groups, and the analysis derived from this population could be affected by bias resulting from indication, reverse causality, or residual confounding phenomena. On the contrary, our data were derived from a large validated database that includes integrated clinical and biochemical data, which minimizes selection bias. In conclusion, our results suggest that PPI use is associated with hypomagnesemia and with excess mortality risk in HD patients. Nevertheless our findings need to be confirmed in further randomized controlled trials analyzing the differences in mortality between patients who are new users in the drug and also by magnesium levels. In any case, balance between positive and possible negative effects should be considered before long-term exposure of HD patients to PPIs. In this population, the long-term use of PPIs may not often be warranted.

Disclosure

The Optimizing Results in Dialysis (ORD) group is a scientific advisory board funded by FMC Spain. JV, RR, JIM, BC, and SS are employees of FMC. ALM received speaker honoraria from Amgen, GE, and Vifor Freseius Medical Care. All the other authors declared no competing interests.
  42 in total

1.  Proton pump inhibitor use, hip fracture, and change in bone mineral density in postmenopausal women: results from the Women's Health Initiative.

Authors:  Shelly L Gray; Andrea Z LaCroix; Joseph Larson; John Robbins; Jane A Cauley; JoAnn E Manson; Zhao Chen
Journal:  Arch Intern Med       Date:  2010-05-10

2.  Proton pump inhibitors and risk for recurrent Clostridium difficile infection.

Authors:  Amy Linsky; Kalpana Gupta; Elizabeth V Lawler; Jennifer R Fonda; John A Hermos
Journal:  Arch Intern Med       Date:  2010-05-10

3.  Use of proton pump inhibitors and mortality among institutionalized older people.

Authors:  J Simon Bell; Timo E Strandberg; Mariko Teramura-Gronblad; Jouko V Laurila; Reijo S Tilvis; Kaisu H Pitkälä
Journal:  Arch Intern Med       Date:  2010-09-27

4.  A comparison of the ability of different propensity score models to balance measured variables between treated and untreated subjects: a Monte Carlo study.

Authors:  Peter C Austin; Paul Grootendorst; Geoffrey M Anderson
Journal:  Stat Med       Date:  2007-02-20       Impact factor: 2.373

5.  Hypomagnesemia and Mortality in Incident Hemodialysis Patients.

Authors:  Lin Li; Elani Streja; Connie M Rhee; Rajnish Mehrotra; Melissa Soohoo; Steven M Brunelli; Csaba P Kovesdy; Kamyar Kalantar-Zadeh
Journal:  Am J Kidney Dis       Date:  2015-07-14       Impact factor: 8.860

6.  Serum Magnesium and Mortality in Hemodialysis Patients in the United States: A Cohort Study.

Authors:  Eduardo Lacson; Weiling Wang; Lin Ma; Jutta Passlick-Deetjen
Journal:  Am J Kidney Dis       Date:  2015-07-17       Impact factor: 8.860

7.  Serum ionized versus total magnesium in patients with intestinal or liver disease.

Authors:  H Saha; A Harmoinen; A L Karvonen; J Mustonen; A Pasternack
Journal:  Clin Chem Lab Med       Date:  1998-09       Impact factor: 3.694

8.  Proton pump inhibitors and risk of 1-year mortality and rehospitalization in older patients discharged from acute care hospitals.

Authors:  Marcello Maggio; Andrea Corsonello; Gian Paolo Ceda; Chiara Cattabiani; Fulvio Lauretani; Valeria Buttò; Luigi Ferrucci; Stefania Bandinelli; Angela Marie Abbatecola; Liana Spazzafumo; Fabrizia Lattanzio
Journal:  JAMA Intern Med       Date:  2013-04-08       Impact factor: 21.873

9.  Proton pump inhibitor use and risk of adverse cardiovascular events in aspirin treated patients with first time myocardial infarction: nationwide propensity score matched study.

Authors:  Mette Charlot; Erik L Grove; Peter Riis Hansen; Jonas B Olesen; Ole Ahlehoff; Christian Selmer; Jesper Lindhardsen; Jan Kyst Madsen; Lars Køber; Christian Torp-Pedersen; Gunnar H Gislason
Journal:  BMJ       Date:  2011-05-11

10.  Hypomagnesaemia associated with long-term use of proton pump inhibitors.

Authors:  James Wei Tatt Toh; Evonne Ong; Robert Wilson
Journal:  Gastroenterol Rep (Oxf)       Date:  2014-08-19
View more
  8 in total

Review 1.  Use of proton pump inhibitors in dialysis patients: a double-edged sword?

Authors:  Geoffroy Desbuissons; Lucile Mercadal
Journal:  J Nephrol       Date:  2020-07-24       Impact factor: 3.902

2.  Trabecular bone score may indicate chronic kidney disease-mineral and bone disorder (CKD-MBD) phenotypes in hemodialysis patients: a prospective observational study.

Authors:  Hyo Jin Yun; Soo Ryeong Ryoo; Jung-Eun Kim; Yong Jun Choi; Inwhee Park; Gyu-Tae Shin; Heungsoo Kim; Jong Cheol Jeong
Journal:  BMC Nephrol       Date:  2020-07-25       Impact factor: 2.388

3.  Proton pump inhibitors and 180-day mortality in the elderly after Clostridium difficile treatment.

Authors:  Evan Stuart Bradley; Emily Howe; Xun Wu; John P Haran
Journal:  Gut Pathog       Date:  2019-06-13       Impact factor: 4.181

4.  Prognostic impact of polypharmacy by drug essentiality in patients on hemodialysis.

Authors:  Mineaki Kitamura; Kosei Yamaguchi; Yuki Ota; Satoko Notomi; Maya Komine; Rika Etoh; Takashi Harada; Satoshi Funakoshi; Hiroshi Mukae; Tomoya Nishino
Journal:  Sci Rep       Date:  2021-12-20       Impact factor: 4.379

5.  Associations between the serum magnesium and all-cause or cardiovascular mortality in chronic kidney disease and end-stage renal disease patients: A meta-analysis.

Authors:  Hongyan Liu; Rui Wang
Journal:  Medicine (Baltimore)       Date:  2021-11-12       Impact factor: 1.817

6.  Proton pump inhibitor usage is associated with higher all-cause mortality and CV events in peritoneal dialysis patients.

Authors:  Yingsi Zeng; Lingling Liu; Liya Zhu; Xiaojiang Zhan; Fenfen Peng; Xiaoran Feng; Qian Zhou; Yujing Zhang; Zebin Wang; Jianbo Liang; Jiao Li; Yueqiang Wen
Journal:  Ren Fail       Date:  2022-12       Impact factor: 2.606

7.  The Impact of Occupational Noise on Hypertension Risk: A Case-Control Study in Automobile Factory Personnel.

Authors:  Xiaomei Wu; Chaoxiu Li; Xiaohong Zhang; Yumeng Song; Dan Zhao; YueYan Lan; Bo Zhou
Journal:  Front Cardiovasc Med       Date:  2022-02-17

8.  The association between use of proton-pump inhibitors and excess mortality after kidney transplantation: A cohort study.

Authors:  Rianne M Douwes; António W Gomes-Neto; Michele F Eisenga; Elisabet Van Loon; Joëlle C Schutten; Rijk O B Gans; Maarten Naesens; Else van den Berg; Ben Sprangers; Stefan P Berger; Gerjan Navis; Hans Blokzijl; Björn Meijers; Stephan J L Bakker; Dirk Kuypers
Journal:  PLoS Med       Date:  2020-06-15       Impact factor: 11.069

  8 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.