Literature DB >> 27333022

High Serum Immunoglobulin G and M Levels Predict Freedom From Adverse Cardiovascular Events in Hypertension: A Nested Case-Control Substudy of the Anglo-Scandinavian Cardiac Outcomes Trial.

Ramzi Y Khamis1, Alun D Hughes2, Mikhail Caga-Anan1, Choon L Chang3, Joseph J Boyle1, Chiari Kojima1, Paul Welsh4, Naveed Sattar4, Michael Johns1, Peter Sever3, Jamil Mayet3, Dorian O Haskard5.   

Abstract

AIMS: We aimed to determine whether the levels of total serum IgM and IgG, together with specific antibodies against malondialdehyde-conjugated low-density lipoprotein (MDA-LDL), can improve cardiovascular risk discrimination. METHODS AND
RESULTS: The Anglo-Scandinavian Cardiac Outcomes Trial (ASCOT) randomized 9098 patients in the UK and Ireland into the Blood Pressure-Lowering Arm. 485 patients that had cardiovascular (CV) events over 5.5years were age and sex matched with 1367 controls. Higher baseline total serum IgG, and to a lesser extent IgM, were associated with decreased risk of CV events (IgG odds ratio (OR) per one standard deviation (SD) 0.80 [95% confidence interval, CI 0.72,0.89], p<0.0001; IgM 0.83[0.75,0.93], p=0.001), and particularly events due to coronary heart disease (CHD) (IgG OR 0.66 (0.57,0.76); p<0.0001, IgM OR 0.81 (0.71,0.93); p=0.002). The association persisted after adjustment for a basic model with variables in the Framingham Risk Score (FRS) as well as following inclusion of C-reactive protein (CRP) and N-terminal pro-B-type natriuretic peptide (NtProBNP). IgG and IgM antibodies against MDA-LDL were also associated with CV events but their significance was lost following adjustment for total serum IgG and IgM respectively. The area under the receiver operator curve for CV events was improved from the basic risk model when adding in total serum IgG, and there was improvement in continuous and categorical net reclassification (17.6% and 7.5% respectively) as well as in the integrated discrimination index.
CONCLUSION: High total serum IgG levels are an independent predictor of freedom from adverse cardiovascular events, particularly those attributed to CHD, in patients with hypertension.
Copyright © 2016. Published by Elsevier B.V.

Entities:  

Keywords:  Anti-oxidized-LDL antibodies; Cardiovascular risk stratification; Immunoglobulins

Mesh:

Substances:

Year:  2016        PMID: 27333022      PMCID: PMC4972545          DOI: 10.1016/j.ebiom.2016.06.012

Source DB:  PubMed          Journal:  EBioMedicine        ISSN: 2352-3964            Impact factor:   8.143


Introduction

Efforts to improve the predictive capacity of existing cardiovascular risk-scoring models have been intense and have included the study of both novel blood and imaging biomarkers (Hoefer et al., 2015). Despite this, better and affordable tools to predict cardiovascular risk are still needed to avoid misclassification of “high risk” patients and resultant over- or under-treatment (Yeboah et al., 2015). Atherosclerosis, the main pathological entity that leads to cardiovascular events, is a chronic inflammatory disease in which the innate and adaptive immune systems can play pathological or protective roles, depending on context (Hansson and Libby, 2006). Although total serum immunoglobulins (Igs) are not normally considered as relevant to clinical CV disease, there is abundant evidence in the preclinical literature to suggest links with atherosclerosis. Our group established that mice deficient in IgM develop marked acceleration of atherosclerosis (Lewis et al., 2009). Moreover, passive immunization of mice with polyclonal IgM or IgG, or adoptive transfer of IgM-secreting B-1 cells, retards atherosclerosis progression (Nicoletti et al., 1998, Yuan et al., 2003, Kyaw et al., 2011, Cesena et al., 2012, Rosenfeld et al., 2015). On the other hand, depletion of IgG-secreting B cells reduces atherosclerosis and their adoptive transfer accelerates it (Ait-Oufella et al., 2010, Kyaw et al., 2010). Whilst the weight of evidence favors IgM being protective, there is still uncertainty as to how IgG antibodies influence atherosclerosis, in view of the pathogenic potential of IgG Fc-mediated pro-inflammatory effector functions. A previous study found that serum IgG but not IgM was associated with a higher risk of myocardial infarction in dyslipidemic patients (Kovanen et al., 1998), whilst another failed to show any association between IgG or IgM and risk of myocardial infarction in a general population (Muscari et al., 1995). However, the roles of specific antibodies as biomarkers in atherosclerosis have been more extensively studied. These include antibodies directed against epitopes induced by oxidative modifications of low-density lipoprotein (LDL), in particular antibodies reacting with phosphorylcholine or adducted malondialdehyde (MDA), as well as many less well-defined epitopes (Leibundgut et al., 2013, Tsiantoulas et al., 2014). In the Bruneck study, IgG antibodies against copper-oxidized LDL (heavily-oxidized LDL that includes MDA-LDL epitopes) were associated with higher risk of CV events, whilst IgM antibodies were associated with lower risk (Rosenfeld et al., 1990, Tsimikas et al., 2012). In contrast, the EPIC Norfolk study implicated IgG and IgM anti-MDA-LDL antibodies as possible modifiers of the risk associated with oxidative biomarkers, rather than independent predictors of coronary artery disease events (Ravandi et al., 2011). Recently, a study from Sweden has reported that individuals with low levels of antibodies against MDA-adducted LDL peptides are associated with significantly higher coronary acute event rate (Bjorkbacka et al., 2016). The Anglo-Scandinavian Cardiac Outcomes Trial (ASCOT) was an independent, investigator-led, multicenter, randomized trial designed to compare two anti-hypertensive treatment strategies for the prevention of CV events in more than 19,000 hypertensive patients without a clinical history of CHD. Using a nested case-control substudy of ASCOT, we set out to test the hypothesis that total serum IgM and IgG levels, as well as antibodies to MDA-LDL, are negative risk factors for cardiovascular events in a hypertensive population. Our analyses incorporated adjustments for levels of C-reactive protein (CRP) and N-terminal pro-B-type natriuretic peptide (NtProBNP), which have previously been studied in the ASCOT population (Sever et al., 2012, Welsh et al., 2014).

Material and Methods

Study Design and Subjects

ASCOT was an independent, investigator-led, multicenter, randomized trial designed to compare two anti-hypertensive treatment strategies for the prevention of CV events in more than 19,000 hypertensive patients without a clinical history of CHD (9098 were randomized in the UK or Ireland). Hypertensive patients with three or more other risk factors for CV disease were eligible for inclusion in ASCOT. The detailed ASCOT protocol has been published previously and further information is available at http://www.ascotstudy.org (Sever et al., 2001). Informed consent was obtained from each patient and the study protocol conforms to the ethical guidelines of the 1975 Declaration of Helsinki as reflected in a prior approval by the participating institutions research ethics committees. In the main cohort, the ASCOT-Blood Pressure-Lowering Arm (BPLA), subjects received a beta-blocker with a thiazide diuretic as required or a dihydropyridine calcium channel blocker (CCB) with an angiotensin-converting enzyme inhibitor as required (Sever et al., 2006). In addition to randomization into ASCOT-BPLA, those with a fasting total cholesterol of ≤ 6.5 mmol/L (250 mg/dL) were further randomized, using a factorial design, to either 10 mg atorvastatin daily or matching placebo (ASCOT-LLA) (Sever et al., 2003, Dahlof et al., 2005). Baseline characteristics of participants and primary outcomes of each arm of the trial have been reported previously (Sever et al., 2001, Dahlof et al., 2005). For the purposes of this case-control study (CCS), all events of fatal coronary heart disease (CHD), symptomatic non-fatal myocardial infarction (MI), coronary revascularization, and fatal and non-fatal stroke occurring in the UK and Ireland during the ASCOT-BPLA study period between February 1998 and October 2005 were identified as cases. Subjects with established cardiovascular disease (CVD) at baseline (including peripheral vascular disease and previous history of stroke, transient ischemic attack and recorded other relevant CVD) were excluded from this CCS. Hence, the present report is based on a nested CCS drawn from ASCOT participants in the UK and Ireland, 485 of whom developed CV events (355 CHD and 130 strokes) during a median follow-up period of 5.5 years. Further details of the selection process into the study are shown in Fig. 1.
Fig. 1

ASCOT immunoglobulin nested CCS profile.

Subjects who were alive and free from CV events during the study period were selected from the same study population as controls. Up to three controls were matched to each case by age (± 1 year), sex and study entry time (± 90 days), with one control being used with two different cases to facilitate matching. The study population was restricted to those self-defined as of white European ethnicity.

Endpoint Adjudication

All cases suspected of fulfilling criteria for the fatal and non-fatal events were classified by the Endpoint Committee. This included endpoints notified by investigators and potential silent MIs identified by the core ECG laboratory. All the documentation for each potential endpoint was reviewed independently by two of the Endpoint Committee members. In the event of disagreement, a third member the Endpoint Committee adjudicated. Final classification required agreement between two members of the Endpoint Committee. The Endpoint Committee met to resolve such disagreements and “grey cases.”

Measurements

All major cardiovascular disease (CVD) risk factors incorporated in the FRS were determined at baseline (Sever et al., 2001). Sera were prepared and aliquoted at entry to the study, and stored at − 70 °C prior to analysis. Serum IgM and IgG, and anti-MDA-LDL antibodies, were measured by enzyme-linked immunosorbent assay (ELISA) (see below). Other laboratory tests (including CRP and NtProBNP) were performed as previously described (www.ascotstudy.org) (Sever et al., 2012, Welsh et al., 2014).

Immunoglobulin and Anti-MDA-LDL Antibody Level Measurements by ELISA

All ELISAs were conducted blindly with both cases and controls mixed according to random laboratory sample number. Personnel conducting assays were blind to patient-specific data and not aware of the statistical analysis plan. The intra-plate variability for all assays was below 3% and inter-plate variability below 13%, with assay ranges that span well above and below expected normal ranges for total IgG and IgM and well below and above the study range for IgG and IgM anti-MDA-LDL (Supplementary Methods Table 1). Total IgG and IgM antibody levels were measured using capture ELISA. Briefly, either goat anti-human IgG or mouse anti-human IgM (Southern Biotech, Birmingham AL) was used to capture either IgG or IgM respectively. Detection antibodies used were either biotinylated goat F(ab')² anti-human IgG or biotinylated mouse anti-human IgM (both Southern Biotech). Detection was with HRP-conjugated streptavidin (R&D Systems, Minneapolis, MN) followed by 3,3′,5,5′-tetramethylbenzidine (TMB) (Sigma Aldrich, UK), and the reaction was stopped with 0.5 M H2SO4. Optical densities were measured with a Synergy HT microplate reader (BioTek, USA) at wavelength 450 nm. Once background was subtracted, results were expressed in Units (U). Cut off and tertile as well as interquartile values in mg/mL for total IgG and IgM were interpolated via standard curve fit using standard ELISA methodology in PRISM 6 (GraphPad, La Jolla, Ca). IgG and IgM anti-MDA-LDL antibody levels were estimated by ELISA against solid phase MDA-LDL. Briefly, MDA-LDL was prepared as described (Palinski et al., 1990). The extent of modification was determined by the relative electrophoretic mobility of the LDL using pre-cast 0.6% agarose, 1.0% barbital buffer gels (Beckman Coulter, Fullerton, Ca) and with a carbonyl assay (Chang et al., 2012). IgG and IgM antibody binding to solid phase antigens was identified by mouse anti-human IgG (Cambridge Bioscience, Cambridge, UK) or biotinylated mouse anti-human IgM (Cambridge Bioscience) followed by horse radish peroxidase (HRP) conjugated rabbit anti-mouse Ig (Dako, Cambridgeshire, UK) or as above with HRP-conjugated streptavidin. The plates were read as above at an optical density of 450 nm (OD450), after which the background was subtracted. All serum anti-MDA-LDL sample values were corrected to a reference serum with a standard curve used on all plates and results expressed in Units (U). All assays were optimized for serum concentration, secondary antibody concentration and timing of TMB reactions using representative sera. Standard curves were established for each of the assays on several representative sera and selected serum dilution was at the steepest part of the curve to achieve the highest sensitivity. Furthermore, standard curves were included for a control serum on each ELISA plate for quality control. The lower and higher limit of assay sensitivity for all assays are shown in Supplementary Methods Table 1. The intra-plate and inter-plate coefficients of variation (CoV) for all assays are in Supplementary Methods Table 2.

Statistical Methods

Continuous variables are presented as means ± standard deviation (SD), and non-normally distributed variables as medians with interquartile range (IQR). Crude comparisons between cases and controls with regard to baseline characteristics were explored by t-tests, Mann-Whitney U or χ2 tests. Age- and sex-adjusted correlations between continuous variables were assessed using the Spearman rank-correlation coefficient (rho). The association between each of the antibodies and the risk of CV events was reported as an odds ratio (OR) obtained from a conditional logistic regression model: first by treating each log-transformed baseline antibody as a continuous variable giving an odds with 95% confidence intervals (CI) of having an event per 1 SD change; and, secondly, by categorizing variables into tertiles with the low tertile as reference. To assess the predictive role of Igs and specific antibodies beyond conventional risk factors, we established five statistical models. Model 1 was matched for age and sex but was otherwise unadjusted; model 2 was adjusted for traditional CV risk factors based on an extended Framingham risk model (smoking, baseline systolic blood pressure (SBP), high-density lipoprotein (HDL), total cholesterol (TC), body mass index (BMI), creatinine), as well as randomized anti-hypertensive and statin treatment; model 3 included paired antibody levels and serum Ig (i.e. IgM anti-MDA-LDL with IgM and IgG anti-MDA-LDL with IgG) to assess the effect of adjustment for total serum Ig; model 4 adjusted for log CRP and log NtProBNP in addition to the covariates in model 2. Collinearity was tested using the variance inflation factor (VIF), and model goodness-of-fit and calibration was assessed using a likelihood ratio test and the Hosmer Lemeshow statistic. To examine the extent to which baseline log-transformed variable improved discrimination and reclassified participants over risk thresholds, model 2 plus further adjustment for age and sex was used in an unconditional logistic model. This reference model was compared with models including each log-transformed variable using area under receiver operator curves (AUROC), net reclassification index (NRI) and integrated discrimination index (IDI) (Pencina et al., 2011). All statistics were conducted independently by a statistician that is blinded to the laboratory techniques, using SAS version 9.3 (SAS Institute Inc., Cary, NC) and Stata release 12 (Stata Corp, College Station, TX). A two-tailed p value < 0.05 was considered to indicate statistical significance. Discrimination of the different risk models was assessed by the areas under the receiver operating characteristic curves (AUROC) using the nonparametric approach of DeLong et al. (DeLong et al., 1988). Likelihood ratio tests were performed to evaluate whether the global model fit improved after the addition of each of the antibody in turn. Model calibration was assessed with the Hosmer–Lemeshow goodness-of-fit test. We also computed the NRI as a continuous and category-based NRI and an integrated discrimination improvement (IDI) analysis. IDI is defined as the difference in the mean predicted probability of being a case and being a control in the model with the addition of antibody minus the difference in the mean predicted probability of being a case and being a control in the model without the antibody level included. We also investigated whether the use of combinations of total serum Igs and anti-MDA-LDL antibodies would improve risk prediction. In these analyses, each of these study antibodies was treated as a continuous variable. Further NRI analyses for the most significant independent markers was undertaken to test reclassification within FRS with categories (< 10%, 10–20% and > 20% risk) were selected to define as low, intermediate and high risk of CVD.

Results

Baseline Characteristics

1753 subjects (mean age 65.3 ± 7.62 years; 1486, 84.8% male) were included in this nested case-control analysis (Fig. 1 and Table 1) and had a median follow-up of 5.5 years (interquartile range, 5.0–6.0). Of the 470 cases that were analyzed (Fig. 1), there were 343 with CHD and 127 who had a stroke (see breakdown in Table 1 footnote). Those with a CV event had a worse cardiovascular profile, including traditional risk factors (SBP, diastolic blood pressure [DBP] and LDL), as well as higher CRP and NtProBNP as previously shown (Table 1) (Sever et al., 2012, Welsh et al., 2014). Significantly higher total serum IgG and IgM levels were found in controls compared to cases (Table 2). Levels of anti-MDA-LDL antibodies were also higher in controls, although this was not as pronounced as with total serum Igs, and indeed was only significant at p < 0.05 for IgG anti-MDA-LDL antibodies (Table 2).
Table 1

Characteristics of the study population.

Controls(n = 1283)Cases(n = 470)p values
Male1089 (84.9%)397 (84.5%)0.83
Age (years)65.30 (7.57)65.34 (7.80)0.93
Current smokers272 (21.2%)121 (25.7%)0.043
Alcohol: never279 (21.7%)121 (25.7%)0.21
Alcohol: ≤ 14 (F)/21(M) units/week753 (58.7%)260 (55.3%)
Alcohol: > 14 (F)/21(M) units/week251 (19.5%)89 (18.9%)
Completed education age (years):0.004
≤ 12425 (33.2%)176 (37.4%)
≤ 15590 (46.0%)227 (48.3%)
≤ 18144 (11.2%)45 (9.6%)
> 18123 (9.6%)22 (4.7%)
SBP (mm Hg)161.82 (17.39)164.63 (17.75)0.003
DBP (mm Hg)92.12 (9.72)92.99 (10.41)0.10
Heart rate (bpm)70.27 (11.78)69.74 (12.75)0.42
BMI (kg/m2)28.97 (4.51)28.70 (4.03)0.25
Total cholesterol (mmol/L)5.91 (1.07)5.99 (1.07)0.15
LDL cholesterol (mmol/L)3.79 (0.95)3.92 (0.97)0.012
HDL cholesterol (mmol/L)1.30 (0.35)1.25 (0.32)0.011
Triglyceride (mmol/L)1.60 (1.20–2.30)1.70 (1.20–2.20)0.35ǂ
Glucose (mmol/L)5.60 (5.10–6.50)5.60 (5.10–6.80)0.17ǂ
Creatinine (μmol/L)99.20 (16.13)102.63 (19.45)0.0002
CRP (mg/L)2.53 (1.27–4.97)3.04 (1.55–5.53)0.001ǂ
NtProBNP (pg/mL)84.50 (44.0–166.0)111.00 (52.0–241.0)< 0.0001ǂ
Diabetes337 (26.3%)145 (30.9%)0.06
Family history of coronary disease218 (17.0%)81 (17.2%)0.90
Amlodipine646 (50.4%)220 (46.8%)0.18
BP treatment at baseline1161 (90.5%)429 (91.3%)0.62

Values are mean (SD) or n (%). Missing: Triglyceride: 75, LDL-cholesterol, creatinine: 42, glucose: 79, CRP and NtProBNP: 4 each. Details of the 470 CV event cases: 343 CHD cases (108 non-fatal MI, 85 fatal CHD, 134 coronary revascularization and 16 had both revascularization and non-fatal MI); 127 stroke cases (100 ischemic strokes, 21 hemorrhagic strokes and 6 unspecified strokes).

Values are presented in median (interquartile range), p values by Wilcoxon–Mann–Whitney test.

p values for alcohol and education are χ2 statistics.

Table 2

Median and interquartile range values of total serum IgM, total serum IgG and anti-MDA-LDL antibodies at baseline.

Controls(n = 1283)Cases(n = 470)p value
Total serum IgG (U)(g/L)0.42 (0.37–0.47)15.88 (12.18–20.95)0.40 (0.35–0.45)14.35 (10.96–18.71)< 0.0001
Total serum IgM (U)(g/L)0.44 (0.31–0.60)1.31 (0.84–2.06)0.40 (0.29–0.56)1.16 (0.78–1.86)0.003
IgG anti-MDA-LDL (U)0.44 (0.33–0.58)0.42 (0.31–0.55)0.02
IgM anti-MDA-LDL (U)0.89 (0.59–1.20)0.86 (0.56–1.13)0.06

Expressed as g/L as interpolated from standard curves. p values obtained by using Wilcoxon–Mann–Whitney test.

Correlations and Interactions Between Variables

IgM anti-MDA-LDL antibody levels correlated strongly with total serum IgM (rho = 0.78, p < 0.0001), and there was a weaker but still highly significant correlation for IgG anti-MDA-LDL with total serum IgG (rho = 0.36, p < 0.0001) (Table 3). Though statistically significant, correlations between serum IgM and IgG and between IgM anti-MDA-LDL and IgG anti-MDA-LDL were modest (Table 3). Total IgG and IgG anti-MDA-LDL antibodies correlated weakly with CRP (rho = 0.13 and rho = 0.09 respectively). There was also a weak inverse correlation of IgG anti-MDA-LDL antibodies with LDL cholesterol (rho = − 0.085, p < 0.001).
Table 3

Spearman Partial Correlation (rho) between total serum IgM and IgG, IgM and IgG anti-MDA-LDL antibodies, CRP and NtProBNP.

IgG anti-MDA-LDLIgM anti-MDA-LDLTotal IgGTotal IgMLDL-cCRPNtProBNP
IgG anti-MDA-LDL1.000
IgM anti-MDA-LDL0.233⁎⁎⁎1.000
Total serum IgG0.363⁎⁎⁎0.151⁎⁎⁎1.000
Total serum IgM0.149⁎⁎⁎0.779⁎⁎⁎0.185⁎⁎⁎1.000
LDL-c− 0.085⁎⁎0.002− 0.0330.0101.000
CRP0.129⁎⁎⁎0.0310.089⁎⁎0.0280.094⁎⁎1.000
NtProBNP0.005− 0.0730.023− 0.070− 0.0080.0461.000

All data apart from LDL cholesterol (LDL-c) were log-transformed before correlation. Adjusted for age and sex.

p < 0.05.

p < 0.001.

p < 0.0001.

Serum Ig and anti-MDA-LDL antibodies among the controls did not strongly correlate with age, SBP, DBP or mean arterial pressure (MAP) (Supplementary Table S1). Interestingly, there was a clear correlation with sex, with total serum IgM and IgG, as well as IgM anti-MDA-LDL antibodies, being higher in women than in men (p < 0.05 for each) (Supplementary Table S2).

Total Serum IgG and IgM Are Inversely Associated With CV Events

Unadjusted, all Ig and specific antibody levels measured were inversely associated with risk of CV events (Table 4, model 1). In the highest third compared with the lowest, total serum IgG levels had the strongest association with CV events (OR = 0.62 [95% confidence interval, CI 0.47, 0.81]; p = 0.0004), and the weakest association was seen with IgM anti-MDA-LDL (OR 0.76 [0.58, 0.98]; p = 0.037). Trends were similar when the data were evaluated as continuous variables per 1 SD. Associations between IgM anti-MDA-LDL antibodies and CV events were modestly attenuated by adjustment for the basic risk variables and were no longer statistically significant, but associations with total serum IgG and IgM, or with IgG anti-MDA-LDL, were little affected and retained significance (Table 4, model 2). Thus, for total serum IgG, there was an OR of 0.62 (0.46, 0.82) comparing highest and lowest total IgG levels (p = 0.0007) or an OR of 0.81 (0.72, 0.91) per 1 SD increase in total IgG levels (p = 0.0003). Associations between IgG and IgM anti-MDA-LDL antibody levels and CV events were abolished after adjustment for total serum IgG and IgM levels respectively (Table 4, model 3). The significant inverse associations of total serum Ig levels with events remained even after adjustment for the basic risk variables plus log-transformed CRP and NtProBNP (Table 4, model 4). Total serum IgG remained the strongest predictor of protection after full adjustment in model 4 (OR 0.81 [0.72, 0.91] per one increase in SD, p = 0.003; OR 0.61 [0.46, 0.82] comparing upper and lower thirds, p = 0.0008).
Table 4

Odds ratios of cardiovascular events (coronary heart disease or stroke) in relation to baseline total serum Igs and anti-MDA-LDL antibodies (per SD increase in log-transformed antibodies and in antibody tertiles).

Cases/controlsModel 1
Model 2
Model 3
Model 4
OR (95% CI)p valueOR (95% CI)p valueOR (95% CI)p valueOR (95% CI)p value
Per 1 SD increase in loge total IgG0.80 (0.72,0.89)< 0.00010.81 (0.72,0.91)0.00030.81 (0.72,0.91)0.0003
Total serum IgGLow180/4061.00 (Ref)1.00 (Ref)1.00 (Ref)
Mid162/4200.86 (0.67,1.11)0.260.92 (0.70,1.20)0.520.97 (0.74,1.28)0.83
High128/4580.62 (0.47,0.81)0.00040.62 (0.46,0.82)0.00070.61 (0.46,0.82)0.0008
Trendp = 0.0004p = 0.0008p = 0.0009
Per 1 SD increase in loge total IgM0.83 (0.75,0.93)0.0010.84 (0.75,0.94)0.0030.85 (0.76,0.96)0.006
Total serum IgMLow177/4041.00 (Ref)1.00 (Ref)1.00 (Ref)
Mid160/4290.82 (0.63,1.06)0.130.82 (0.62,1.07)0.150.85 (0.65,1.13)0.26
High133/4510.65 (0.49,0.85)0.0020.67 (0.51,0.89)0.0050.70 (0.53,0.93)0.014
Trendp = 0.0016p = 0.005p = 0.014
Per 1 SD increase in loge IgG anti-MDA-LDL0.88 (0.79,0.98)0.0160.89 (0.79,0.99)0.0400.96 (0.85,1.08)0.460.87 (0.78,0.98)0.021
IgG anti-MDA-LDLLow179/4051.00 (Ref)1.00 (Ref)1.00 (Ref)1.00 (Ref)
Mid147/4380.75 (0.58,0.97)0.0300.74 (0.57,0.97)0.0300.81 (0.61,1.07)0.130.74 (0.57,0.98)0.034
High144/4410.74 (0.57,0.96)0.0220.76 (0.58,1.00)0.0480.90 (0.67,1.20)0.460.74 (0.56,0.97)0.030
Trendp = 0.02p = 0.044p = 0.43p = 0.027
Per 1 SD increase in loge IgM anti-MDA-LDL0.88 (0.79,0.98)0.0230.90 (0.80,1.00)0.0591.09 (0.90,1.32)0.380.91 (0.81,1.02)0.10
IgM anti-MDA-LDLLow166/4181.00 (Ref)1.00 (Ref)1.00 (Ref)1.00 (Ref)
Mid163/4220.95 (0.73,1.23)0.690.93 (0.71,1.21)0.581.16 (0.84,1.59)0.370.94 (0.71,1.24)0.66
High141/4440.76 (0.58,0.98)0.0370.81 (0.61,1.06)0.131.18 (0.80,1.75)0.400.84 (0.64,1.11)0.22
Trendp = 0.038p = 0.10p = 0.41p = 0.22

Model 1: unadjusted but matched for age and sex; model 2: adjusted for smoking status, diabetic status, baseline SBP, baseline total cholesterol, HDL, baseline creatinine, BMI, family history of coronary disease, randomized BP and statin treatments; model 3: adjusted as in model 2 plus either total IgG or IgM; model 4: adjusted in model 2 plus loge CRP and NtProBNP. Immunoglobulin and specific antibody tertile levels in Units (U) as measured by ELISA and (in g/L as interpolated per standard curves for total Ig levels) were: total IgG: Low < 0.384 (< 13.11 g/L), Mid 0.3845–0.4465 (13.12–18.40 g/L), High > 0.4465 (18.4 g/L); total IgM Low < 0.3440 (< 0.95 g/L), Mid 0.3445–0.5305 (0.96–1.71 g/L), High > 0.5305 (> 1.71 g/L); IgG anti-MDA-LDL Low < 0.3626, Mid 0.3637–0.5205, High > 0.05205; IgM anti-MDA-LDL: Low < 0.6825, Mid 0.6835–1.0628, High > 1.0628.

When exploring the ability of Igs and specific antibodies to predict events linked to either CHD or stroke, it became clear that the relationships described above for total serum Ig levels are only significant for CHD (Table 5) and not stroke (Supplementary Table S3). The unadjusted OR for the highest tertiles in predicting CHD was 0.42 for total IgG (p < 0.0001) and 0.57 for total IgM (p = 0.001) (Table 5). Further adjustments in models 2, 3 and 4 demonstrated that again anti-MDA-LDL antibodies were dependent on total IgG and IgM, and that total serum Ig levels are independent of basic risk variables, CRP and NtProBNP as predictors. A further analysis of all CV events excluding hemorrhagic stroke did not appreciably alter the results shown in Table 4 (Supplementary Table S4).
Table 5

Odds ratios of events due to coronary heart disease in relation to baseline total serum Igs and anti-MDA-LDL antibodies (per SD increase in log-transformed antibodies and in antibody tertiles).

Cases/controlsModel 1
Model 2
Model 3
Model 4
OR (95% CI)p valueOR (95% CI)p valueOR (95% CI)p valueOR (95% CI)p value
Per 1 SD increase in loge total IgG343/9390.66 (0.57,0.76)< 0.00010.68 (0.58,0.79)< 0.00010.68 (0.58,0.79)< 0.0001
Total serum IgGLow153/3091.00 (Ref)1.00 (Ref)1.00 (Ref)
Mid120/3010.79 (0.59,1.06)0.120.83 (0.61,1.13)0.230.89 (0.64,1.22)0.45
High70/3290.42 (0.30,0.59)< 0.00010.43 (0.30,0.61)< 0.00010.43 (0.30,0.62)< 0.0001
Trendp < 0.0001p < 0.0001p < 0.0001
Per 1 SD increase in loge total IgM343/9390.81 (0.71,0.93)0.0020.82 (0.71,0.94)0.0050.83 (0.72,0.95)0.008
Total serum IgMLow134/2961.00 (Ref)1.00 (Ref)1.00 (Ref)
Mid124/3260.82 (0.61,1.11)0.190.84 (0.61,1.15)0.280.88 (0.64,1.22)0.44
High85/3170.57 (0.41,0.80)0.0010.59 (0.42,0.83)0.0030.62 (0.43,0.87)0.007
Trendp = 0.001p = 0.003p = 0.007
Per 1 SD increase in loge IgG anti-MDA-LDL343/9390.83 (0.73,0.94)0.0030.85 (0.74,0.98)0.0200.98 (0.84,1.13)0.770.83 (0.72,0.95)0.008
IgG anti-MDA-LDLLow142/3021.00 (Ref)1.00 (Ref)1.00 (Ref)1.00 (Ref)
Mid106/3200.70 (0.52,0.94)0.0180.67 (0.49,0.91)0.0120.81 (0.59,1.13)0.220.67 (0.49,0.92)0.015
High95/3170.64 (0.47,0.87)0.0050.70 (0.50,0.97)0.0310.95 (0.66,1.35)0.760.66 (0.47,0.93)0.016
Trendp = 0.004p = 0.023p = 0.71p = 0.012
Per 1 SD increase in loge IgM anti-MDA-LDL343/9390.88 (0.77,0.99)0.0380.89 (0.78,1.02)0.091.12 (0.89,1.40)0.330.90 (0.78,1.03)0.12
IgM anti-MDA-LDLLow123/3081.00 (Ref)1.00 (Ref)1.00 (Ref)1.00 (Ref)
Mid123/3100.97 (0.72,1.31)0.860.96 (0.70,1.32)0.801.20 (0.83,1.73)0.330.96 (0.69,1.33)0.80
High97/3210.72 (0.53,0.99)0.0430.78 (0.56,1.09)0.141.18 (0.74,1.86)0.490.81 (0.58,1.13)0.22
Trendp = 0.046p = 0.15p = 0.49p = 0.22

Model 1: unadjusted but matched for age and sex; model 2: adjusted for smoking status, diabetic status, baseline SBP, baseline total cholesterol, HDL, baseline creatinine, BMI, family history of coronary disease, randomized BP and statin treatments; model 3: adjusted as in model 2 plus either total IgG or IgM; model 4: adjusted in model 2 plus loge CRP and NtProBNP. Immunoglobulin and specific antibody tertile levels in Units (U) as measured by ELISA and (in g/L as interpolated per standard curves for total Ig levels) were: total IgG: Low < 0.384 (< 13.11 g/L), Mid 0.3845–0.4465 (13.12–18.40 g/L), High > 0.4465 (18.4 g/L); total IgM Low < 0.3440 (< 0.95 g/L), Mid 0.3445–0.5305 (0.96–1.71 g/L), High > 0.5305 (> 1.71 g/L); IgG anti-MDA-LDL Low < 0.3626, Mid 0.3637–0.5205, High > 0.05205; IgM anti-MDA-LDL: Low < 0.6825, Mid 0.6835–1.0628, High > 1.0628.

Total Serum IgG Significantly Improves Prediction of CV Risk

Addition of each of total serum IgG, total serum IgM and IgG anti-MDA-LDL antibodies significantly improved model fit (Table 6). The AUROC was significantly improved by total serum IgG (0.6391 vs. 0.6213, p = 0.009), whereas IgG anti-MDA, IgM anti-MDA or total serum IgM did not significantly increase AUROC. Addition of all four measures to the basic model improved model fit and AUROC (0.6421 vs. 0.6213, p = 0.011), but there was no difference in AUROCs between the basic model including just total serum IgG and the basic model containing all four measures (Table 6).
Table 6

Measures of model fit and reclassification by adding each variable in turn to the basic CV events model using unconditional logistic regression model.

BasicǂTotal serum IgGTotal serum IgMIgG anti-MDA-LDLIgM anti-MDA-LDLAll 4§
Goodness of fit
LR χ2 (df)65.77 (13)79.57 (14)75.17 (14)70.12 (14)68.97 (14)87.78 (17)
p valueRef0.00020.0020.040.070.0002
Calibration
Hosmer-Lemeshow8.177.073.987.78.743.96
χ2, decilesp = 0.420.530.860.460.360.86



Discrimination
AUROC0.6213(0.5921,0.6505)0.6391(0.6096,0.6686)0.6293(0.6000,0.6586)0.6270(0.5978,0.6563)0.6241(0.5948,0.6533)0.6421(0.6127,0.6715)
p (difference)Ref0.0090.180.160.450.011
p (total IgG vs. all 4)Ref0.54



Reclassification
IDIRef0.90% p < 0.00010.59% p = 0.0030.27% p = 0.030.20% p = 0.0661.38% p < 0.0001
Continuous NRIRef17.59% p = 0.00116.67% p = 0.0028.65% p = 0.116.05% p = 0.2617.40% p = 0.001
Categorical NRIRef7.54% p < 0.00011.18% p = 0.474.52% p < 0.00011.14% p = 0.328.27% p < 0.0001

Adjusted for age, sex, smoking status, diabetic status, baseline SBP, baseline total cholesterol, HDL, baseline creatinine values, BMI, family history of CHD, randomized BP and statin treatments.

Basic model plus IgG anti-MDA-LDL, IgM anti-MDA-LDL, total serum IgG and total serum IgM.

The addition of total serum IgG to the basic model resulted in an absolute IDI of 0.9 (p < 0.0001), and the highest NRI (17.6% and 7.5% for continuous and category-based NRI, respectively) (Table 6). Total serum IgG also led to the greatest absolute number of subjects with CV events correctly reclassified: 52 (11.1%) to a higher risk category and 25 (5.3%) to a lower risk category (Fig. 2). Of the 1284 controls, 71 (5.5%) were correctly reclassified using total serum IgG to a higher risk category and 94 (7.3%) to a lower risk category (Fig. 2). Fig. 3 demonstrates the clinically relevant reclassification into and out of the < 10% risk category for CVD, with a clear advantage of adding in total serum IgG to the model. Total serum IgG also performed best for CV event risk reclassification (18.6 and 8.3%, for continuous and category-based NRI, respectively) in the extended basic model (basic model + CRP and NtProBNP) (Supplementary Table S5).
Fig. 2

The number of subjects in different CV event risk categories with reclassification after inclusion of total serum IgG. The figure shows estimates of probabilities using the basic risk factor model without (vertical axis) and with (horizontal axis) inclusion of total serum IgG. Each cell includes the number of cases (clear background) and controls (shaded background). The basic risk factor model included age, sex, smoking status, diabetic status, baseline SBP, baseline TC, HDL, baseline creatinine values, BMI, family history of CHD, randomized BP and statin treatment.

Fig. 3

Percentage change in cardiovascular event cases and controls within the < 10% risk and > 10% CVD risk categories when total serum IgG added to the basic risk model.

There was a much more pronounced improvement in model performance when studying CHD alone. The most significant increase in AUROC, and highest NRI and IDI were after the addition of total IgG to either the basic model or the extended model (Supplementary Tables S6 and S7). The finding that total serum IgG results in a continuous NRI of a 29.6% (p < 0.0001) despite adjustment for the basic model, log CRP and log NtProBNP puts this measurement in the forefront of risk prediction of CHD in this hypertensive population (Supplementary Table S7). Basic models with addition of the other immunoglobulins did not perform better than the basic model plus only total IgG (Supplementary Table S6).

Discussion

The main novel finding in this paper is that in patients with hypertension the total IgG serum level, and to a lesser extent the total serum IgM level, is an independent predictor of freedom from CV events in general and from CHD in particular. Furthermore, total serum Ig levels significantly improved risk classification for CV events. High IgG and IgM levels were not associated with freedom from stroke, probably reflecting its more heterogeneous underlying pathology. Although IgG and IgM anti-MDA-LDL antibodies were also significantly associated with freedom from CV events, these correlated significantly with their respective total serum Ig levels. Indeed, total serum IgM and IgG were much stronger indicators of freedom from events, and the univariate significance of anti-MDA-LDL antibodies was lost after adjusting for total serum levels of the respective Ig class. It is clear however that our comparison of specific antibodies with total IgG and IgM levels was restricted to those against just one form of oxidized LDL (i.e. MDA-LDL) and it remains possible that other specific autoantibodies against modified LDL or other antigens could have greater negative or positive predictive ability. Nevertheless, our results indicate that adjustment for total Ig levels will need to form part of further analyses investigating specific antibodies as prognostic markers of CVD. We postulate that the greater predictive power of total Ig levels reflects a broad role of the polyreactive antibody repertoire in cardiovascular protection. On the one hand, the composite antibody repertoire can be expected to contribute to the safe disposal of a variety of other endogenous atherogenic autoantigens besides modified LDL, including apoptotic cells and microparticles (Chang et al., 1999, Chou et al., 2009, Tsiantoulas et al., 2015). On the other hand, the conventional role of antibodies in preventing bacterial infection may also be important for reducing the rate of atherosclerosis progression and reducing infection-triggered acute cardiac events (Smeeth et al., 2004). In this light, the greater predictive capacity of the total IgG level compared to IgM argues for the importance of a robust adaptive immune response. Certainly the relative roles of genetic and environmental influences in setting Ig levels merits further study (Chen et al., 2011, Paavola et al., 2012), and in this light it is interesting that serum IgG and IgM levels in our study were significantly higher in women, consistent with previous observations (Gonzalez-Quintela et al., 2008). The strong negative association between IgG and IgM levels and CHD events needs to be considered in the context of other biomarkers that have been evaluated as adjuncts to traditional risk assessments. Although the ASCOT-CRP substudy concluded that measuring CRP had little utility in refining CV risk assessment beyond classical risk factors in the study population (Sever et al., 2012), a meta-analysis concluded that adding CRP to the risk assessment led to predicting one additional event over a period of 10 years for every 400–500 people screened (Kaptoge et al., 2012). Not only did IgG levels remain highly significant in predicting protection from events after adjustment for CRP, they were also independent from NtProBNP which was previously shown to be a predictor of events in ASCOT (Welsh et al., 2014). A particularly important outcome of the study was the reclassification of more cases and less controls into the clinically relevant > 10% risk categories and more controls with less cases in the < 10% risk category by incorporating total serum IgG in the analysis. If confirmed in further cohorts, this has the potential to be used for more robust risk stratification in hypertension, thus redirecting primary prevention therapies towards those who would benefit the most. Our findings are at odds with those of Kovanen et al. who showed that serum IgG levels (as well as IgA and IgE), but not IgM, were predictive of MI (Kovanen et al., 1998). However the two studies differ in entrance requirements, with that of Kovanen et al. being selected for dyslipidemia whilst ours was based on hypertension. It is possible that IgG levels in our study population might have been affected by hypertension, although we did not detect any correlations with SBP, DBP or MAP (Chan et al., 2014). It therefore remains to be seen to what degree our findings on the ASCOT population generalize to wider populations. In particular, raised Ig levels are probably not associated with freedom from CV events in patients with autoimmune conditions such rheumatoid arthritis and systemic lupus erythematosus in which there is a disease-related increase in risk of CV events and in which a polyclonal expansion of Ig levels signifies disease activity. Furthermore, our study has focused on the prediction of first adverse cardiovascular incidents in a high risk population, and does not address the relevance of immunoglobulins or specific antibodies during and after acute coronary events.

Conclusion

In conclusion, our study suggests total serum IgG levels are strongly and independently associated with lower risk of CHD events in individuals with hypertension. Furthermore, IgG levels appear to significantly improve prediction beyond established risk predictors, even when including CRP and NtProBNP. As the measurement of total serum IgG is readily available to clinicians and relatively cheap, our findings have high potential for future clinical translation.

Author Contributions

RYK, JM, ADH and DOH designed the current study, wrote the protocol and the analysis plan, supervised the analyses, interpreted the results and wrote the report. RYK supervised the laboratory work and the statistical analysis. M C-A undertook the technical laboratory work with contribution from CK. CLC conducted statistical analyses for the study. MJ, JJB, NS, PW and PS reviewed the protocol and commented upon the manuscript. PS designed and coordinated the original ASCOT study.

Conflict of Interest

None to declare.
  38 in total

1.  Monoclonal antibodies against oxidized low-density lipoprotein bind to apoptotic cells and inhibit their phagocytosis by elicited macrophages: evidence that oxidation-specific epitopes mediate macrophage recognition.

Authors:  M K Chang; C Bergmark; A Laurila; S Hörkkö; K H Han; P Friedman; E A Dennis; J L Witztum
Journal:  Proc Natl Acad Sci U S A       Date:  1999-05-25       Impact factor: 11.205

2.  Immune-modulation by polyclonal IgM treatment reduces atherosclerosis in hypercholesterolemic apoE-/- mice.

Authors:  Fernando H Y Cesena; Paul C Dimayuga; Juliana Yano; Xiaoning Zhao; Jonathan Kirzner; Jianchang Zhou; Lai Fan Chan; Wai Man Lio; Bojan Cercek; Prediman K Shah; Kuang-Yuh Chyu
Journal:  Atherosclerosis       Date:  2011-10-12       Impact factor: 5.162

3.  Low Levels of Apolipoprotein B-100 Autoantibodies Are Associated With Increased Risk of Coronary Events.

Authors:  Harry Björkbacka; Ragnar Alm; Margaretha Persson; Bo Hedblad; Jan Nilsson; Gunilla Nordin Fredrikson
Journal:  Arterioscler Thromb Vasc Biol       Date:  2016-02-25       Impact factor: 8.311

Review 4.  The immune response in atherosclerosis: a double-edged sword.

Authors:  Göran K Hansson; Peter Libby
Journal:  Nat Rev Immunol       Date:  2006-06-16       Impact factor: 53.106

5.  Potential synergy between lipid-lowering and blood-pressure-lowering in the Anglo-Scandinavian Cardiac Outcomes Trial.

Authors:  Peter Sever; Björn Dahlöf; Neil Poulter; Hans Wedel; Gareth Beevers; Mark Caulfield; Rory Collins; Sverre Kjeldsen; Arni Kristinsson; Gordon McInnes; Jesper Mehlsen; Markku Nieminem; Eoin O'Brien; Jan Ostergren
Journal:  Eur Heart J       Date:  2006-12-04       Impact factor: 29.983

6.  Determinants of binding of oxidized phospholipids on apolipoprotein (a) and lipoprotein (a).

Authors:  Gregor Leibundgut; Corey Scipione; Huiyong Yin; Matthias Schneider; Michael B Boffa; Simone Green; Xiaohong Yang; Edward Dennis; Joseph L Witztum; Marlys L Koschinsky; Sotirios Tsimikas
Journal:  J Lipid Res       Date:  2013-07-04       Impact factor: 5.922

7.  Utility of Nontraditional Risk Markers in Individuals Ineligible for Statin Therapy According to the 2013 American College of Cardiology/American Heart Association Cholesterol Guidelines.

Authors:  Joseph Yeboah; Tamar S Polonsky; Rebekah Young; Robyn L McClelland; Joseph C Delaney; Farah Dawood; Michael J Blaha; Michael D Miedema; Christopher T Sibley; J Jeffrey Carr; Gregory L Burke; David C Goff; Bruce M Psaty; Philip Greenland; David M Herrington
Journal:  Circulation       Date:  2015-07-29       Impact factor: 29.690

8.  Evaluation of C-reactive protein prior to and on-treatment as a predictor of benefit from atorvastatin: observations from the Anglo-Scandinavian Cardiac Outcomes Trial.

Authors:  Peter S Sever; Neil R Poulter; Choon L Chang; Aroon Hingorani; Simon A Thom; Alun D Hughes; Paul Welsh; Naveed Sattar
Journal:  Eur Heart J       Date:  2011-07-28       Impact factor: 29.983

Review 9.  Antibodies in the pathogenesis of hypertension.

Authors:  Christopher T Chan; Maggie Lieu; Ban-Hock Toh; Tin S Kyaw; Alexander Bobik; Christopher G Sobey; Grant R Drummond
Journal:  Biomed Res Int       Date:  2014-06-23       Impact factor: 3.411

10.  The value of N-terminal pro-B-type natriuretic peptide in determining antihypertensive benefit: observations from the Anglo-Scandinavian Cardiac Outcomes Trial (ASCOT).

Authors:  Paul Welsh; Neil R Poulter; Choon L Chang; Peter S Sever; Naveed Sattar
Journal:  Hypertension       Date:  2013-12-09       Impact factor: 10.190

View more
  22 in total

Review 1.  Opportunities for an atherosclerosis vaccine: From mice to humans.

Authors:  Payel Roy; Amal J Ali; Kouji Kobiyama; Yanal Ghosheh; Klaus Ley
Journal:  Vaccine       Date:  2020-01-19       Impact factor: 3.641

Review 2.  Readapting the adaptive immune response - therapeutic strategies for atherosclerosis.

Authors:  Andrew P Sage; Ziad Mallat
Journal:  Br J Pharmacol       Date:  2017-02-01       Impact factor: 8.739

3.  Class switching and high-affinity immunoglobulin G production by B cells is dispensable for the development of hypertension in mice.

Authors:  Yuhan Chen; Bethany L Dale; Matthew R Alexander; Liang Xiao; Mingfang Ao; Arvind K Pandey; Charles D Smart; Gwendolyn K Davis; Meena S Madhur
Journal:  Cardiovasc Res       Date:  2021-03-21       Impact factor: 10.787

4.  HSP25 Vaccination Attenuates Atherogenesis via Upregulation of LDLR Expression, Lowering of PCSK9 Levels and Curbing of Inflammation.

Authors:  Yong-Xiang Chen; Chunhua Shi; Jingti Deng; Catherine Diao; Nadia Maarouf; Matthew Rosin; Vipul Shrivastava; Angie A Hu; Sonya Bharadwa; Ayinuer Adijiang; Annegret Ulke-Lemee; Brenig Gwilym; Alexandria Hellmich; Christopher Malozzi; Zarah Batulan; Jonathan L E Dean; F Daniel Ramirez; Jingwen Liu; William T Gerthoffer; Edward R O'Brien
Journal:  Arterioscler Thromb Vasc Biol       Date:  2021-04-01       Impact factor: 10.514

5.  Can Antibodies Protect Us Against Cardiovascular Disease?

Authors:  Jan Nilsson
Journal:  EBioMedicine       Date:  2016-06-28       Impact factor: 8.143

6.  Inverse association of ApoB and HSP60 antibodies with coronary artery disease in Indian population.

Authors:  Thiruvelselvan Ponnusamy; Srikanth K Venkatachala; Manjunatha Ramanjappa; Vijay V Kakkar; Lakshmi A Mundkur
Journal:  Heart Asia       Date:  2018-06-26

Review 7.  Anti-inflammatory and Immunomodulatory Therapies in Atherosclerosis.

Authors:  Justine Deroissart; Florentina Porsch; Thomas Koller; Christoph J Binder
Journal:  Handb Exp Pharmacol       Date:  2022

Review 8.  Hypertension: Do Inflammation and Immunity Hold the Key to Solving this Epidemic?

Authors:  Meena S Madhur; Fernando Elijovich; Matthew R Alexander; Ashley Pitzer; Jeanne Ishimwe; Justin P Van Beusecum; David M Patrick; Charles D Smart; Thomas R Kleyman; Justin Kingery; Robert N Peck; Cheryl L Laffer; Annet Kirabo
Journal:  Circ Res       Date:  2021-04-01       Impact factor: 17.367

9.  High Levels of (Un)Switched Memory B Cells Are Associated With Better Outcome in Patients With Advanced Atherosclerotic Disease.

Authors:  John A L Meeuwsen; Amerik van Duijvenvoorde; Aisha Gohar; Maria O Kozma; Sander M van de Weg; Crystel M Gijsberts; Saskia Haitjema; Harry Björkbacka; Gunilla N Fredrikson; Gert J de Borst; Hester M den Ruijter; Gerard Pasterkamp; Christoph J Binder; Imo E Hoefer; Saskia C A de Jager
Journal:  J Am Heart Assoc       Date:  2017-09-07       Impact factor: 5.501

10.  Data-Independent Acquisition Proteomics Reveals Long-Term Biomarkers in the Serum of C57BL/6J Mice Following Local High-Dose Heart Irradiation.

Authors:  Omid Azimzadeh; Christine von Toerne; Vikram Subramanian; Wolfgang Sievert; Gabriele Multhoff; Michael J Atkinson; Soile Tapio
Journal:  Front Public Health       Date:  2021-07-02
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.