Literature DB >> 29784908

Integration of multi-omics data and deep phenotyping enables prediction of cytokine responses.

Olivier B Bakker1, Raul Aguirre-Gamboa1, Serena Sanna1, Marije Oosting2, Sanne P Smeekens2, Martin Jaeger2, Maria Zorro1, Urmo Võsa1, Sebo Withoff1, Romana T Netea-Maier3, Hans J P M Koenen4, Irma Joosten4, Ramnik J Xavier5,6, Lude Franke1, Leo A B Joosten2, Vinod Kumar1,2, Cisca Wijmenga7,8, Mihai G Netea9,10, Yang Li11.   

Abstract

The immune response to pathogens varies substantially among people. Whereas both genetic and nongenetic factors contribute to interperson variation, their relative contributions and potential predictive power have remained largely unknown. By systematically correlating host factors in 534 healthy volunteers, including baseline immunological parameters and molecular profiles (genome, metabolome and gut microbiome), with cytokine production after stimulation with 20 pathogens, we identified distinct patterns of co-regulation. Among the 91 different cytokine-stimulus pairs, 11 categories of host factors together explained up to 67% of interindividual variation in cytokine production induced by stimulation. A computational model based on genetic data predicted the genetic component of stimulus-induced cytokine production (correlation 0.28-0.89), and nongenetic factors influenced cytokine production as well.

Entities:  

Mesh:

Substances:

Year:  2018        PMID: 29784908      PMCID: PMC6022810          DOI: 10.1038/s41590-018-0121-3

Source DB:  PubMed          Journal:  Nat Immunol        ISSN: 1529-2908            Impact factor:   25.606


Variability in baseline immune response influences an individual’s susceptibility to immune-mediated diseases such as infection, autoimmune and inflammatory diseases, as well as their severity1–5. Both environmental and host factors are responsible for this variation in immune response6–9, which makes deciphering their interaction crucial for understanding their influence on susceptibility and instrumental for building quantitative predictors of disease. The Human Functional Genomics Project (HFGP) aims to identify the factors responsible for variability in immune response in the general population and upon perturbations, such as disease state. Within the HFGP, the 500 Human Functional Genomics (500FG) consortium has collected extensive molecular and phenotypic measurements from approximately 500 healthy volunteers of Western-European descent. Earlier 500FG studies assessed the separate impacts of host-related factors, genetic variation or microbiome on cytokine-production capacity7–9. However, an integrated understanding of the effect of these factors and of additional host-related factors, such as endocrine hormones, circulating metabolites, platelet-mediated effects or transcriptional profiles of immune cells on stimulus induced cytokine levels has been lacking. Here, we used a comprehensive systems biology approach to integrate the large-scale genomic, metagenomic and metabolomic data available within the 500FG consortium with the immune cell composition, hormone levels and platelet activation profiles of each person analyzed. This allowed us to describe the baseline heterogeneity of immunological parameters, identify inter-correlated immune components, infer functional connections within the immune system and build predictive models of cytokine-production capacity upon stimulation. Using transcriptome data from a subset of samples, we showed that expression of genes after stimulation explained the variation in cytokine-production better than baseline expression. By integrating multi-omics layers, we showed that cytokine production was regulated by multiple genetic and non-genetic host factors, that production of cytokines after stimulation could be moderately predicted using multiple baseline profiles and that inter-individual variation in immune responses correlated with an individual’s genetic risk for (auto)immune disease.

Results

Baseline immune parameters are inter-correlated

To understand inter-individual variation in human immune response, we previously generated a database of immunological measurements, multi-omics data (cytokine response profiles, genetics, gene expression, immune cell frequencies, immune modulators, immunoglobulins, hormone levels, blood platelets, circulating metabolites, gut microbiome composition) and classical phenotypes (age, gender and BMI) from volunteers in the 500FG cohort (Supplementary Fig. 1 a,b and Supplementary Table 1). Cytokine production capacity of individuals was assessed using previously generated ELISA profiles on the production of 6 cytokines (IL-1β, IL-17, IL-22, IL-6, TNF-α and IFN-γ), by peripheral blood mono-nuclear cells (PBMC), whole blood and PBMC derived macrophages derived from blood after stimulation with 20 pathogens (Supplementary Table 2) 7–9. IL-1β, IL-6 and TNF-α levels were measured 24 hours after stimulation and IL-22, IL-17 and IFN-γ seven days after stimulation in PBMC and PBMC derived macrophages. In whole blood IL-1β, IL-6 and TNF-α levels were measured 48 hours after stimulation. To map the relationships between these different molecular and immune parameters, we first performed clustering analysis of all immunological measurements besides cytokine production. To reduce the dimensionality of the dataset, the first ten principal components (PCs), covering >75% of variance in each dataset, were individually extracted from the cell count, metabolite and microbiome datasets. These PCs were then combined with the measurements of immune modulators (IL-18, IL-18BP, resistin, leptin, adiponectin, α-1 antitripsyn), immunoglobulins (IgG1-4, IgA, IgM), platelet activation profiles (p-selectin expression, fibrinogen binding, coagulation markers, β-Thromboglobulin) and hormone levels (androsteendion, cortisol, 11 deoxy cortisol, 17 hydroxy progesterone, progesterone, testosterone, 25 hydroxy vitamin D3, TSH, T4) (Supplementary Table 1). Subsequent unsupervised clustering analysis revealed several clusters (Fig. 1) that were consistent with previous observations, validating the current correlations. As such, we observed a negative correlation between the amount of the hormone leptin and the levels of progesterone and testosterone in peripheral blood (Fig. 1), consistent with an inhibitory effect of leptin on progesterone and on testosterone in humans10–13. We also observed a negative correlation of expression of p-selectin (whole blood flow cytometry) and fibrinogen activation profiles in peripheral blood (Fig. 1), consistent with evidence that they are under shared control14,15. Similarly, the hormone levels of 17 hydroxy-progesterone and testosterone were positively correlated with progesterone, androsteendion and 11 deoxy cortisol levels in peripheral blood (Fig. 1), consistent with these molecules having a common synthesis pathways. Finally, we observed the cluster of α1- antitrypsin with adiponectin and the association of 2 immune cell frequency PC’s with total platelet count, as well as a negative association between IL-18 and IgM abundance (Fig. 1). These results show that baseline immune parameters in healthy individuals are correlated and likely to be influenced by co-regulatory pathways.
Figure 1

Analysis of baseline immune parameters and molecular profiling shows baseline parameters are inter-correlated.

Spearman’s Rank correlations between both immune traits and baseline molecular profiles show that they are inter-correlated (n = 282). For the cell count and omics datasets, the first 10 principal components were extracted and used for calculating the correlation. Colors beside the cluster dendrogram indicate the type of measurements. Every sample represents an individual.

Baseline molecular profiles show substantial variation

Next, we examined the baseline (unstimulated) inter-individual variation in the immunological and molecular profiles described above and found a wide range of variation for the majority of immunological parameters analyzed (Supplementary Fig. 1c-e). Because some variation is known to result from differences in age, gender and season9,16–19, we corrected for these effects, when applicable. Among the immune-cell populations with high variability, effector T cell subpopulations showed the largest inter-individual variation compared to the other immune cell subpopulations (Supplementary Fig. 1c), in agreement with previous observations6. Baseline transcript abundance in whole blood also showed substantial inter-individual variation (Supplementary Fig. 1d). The top 75 most-variable transcripts were significantly enriched in 23 innate immune gene ontology (GO) terms (P <0.05 using an online tool20) (Supplementary Table 3), suggesting that the innate immune response was a major contributor to variations in transcript abundance. This analysis demonstrates that the baseline molecular profiles vary substantially between healthy individuals.

Genetics contributes the most to immune variation

To address to what extent responses to a perturbation were affected by the pre-existing immune status, we first assessed the effect of host factors at baseline on cytokine production. Using a multivariate linear model (MVLM) to examine the percent of variance explained by these factors21, we found that genetic variation, as measured by single nucleotide polymorphisms (SNP), collectively explained most of the variation in stimulated cytokine production (avg. adj. R = 0.18) (Fig. 2a). In contrast, the gut microbiome, immune-cell counts, circulating metabolites and seasons displayed only moderate effects (avg. adj. R = 0.061, 0.057, 0.047 and 0.041, respectively) on most cytokine-stimulation pairs (Fig. 2a), while the concentration of circulating immunoglobulins, inflammatory mediators or hormones, and platelet activation (whole blood flow cytometry) generally had negligible effects (Fig. 2a,b). To evaluate the significance of the estimates of variation explained by genetics (VG), we performed 1000 permutations of sample labels in the cytokine data and applied the analysis pipeline on the permuted data to obtain the empirical distribution of the estimates of VG (null distribution). We subsequently compared the estimate of VG from the 500FG data with the estimate of VG from the permuted data. In total the estimates of VG in the 500FG were significant in 59 of 91 cases (P <0.05, Supplementary Table 4). For example, we found that the cytokine stimulation pairs explained the best by genetics (Poly I:C and C.Burnetti induced IL-6 levels in PBMC) showed significance.
Figure 2

Contribution of baseline immune parameters and multi-omics to cytokine variation.

(a) Percentage of variation in stimulated cytokine production explained by each category of measurements. The distribution indicates the adjusted R2 of a set multivariate linear models (MVLM) representing cytokine stimulation pairs from PBMC (n=67 models), whole blood (n=16 models) and PBMC derived macrophages (n=8 models). Each dot represents the adjusted R2 of a MVLM for a specific cytokine stimulation pair. (b) Contribution of each category to inter-individual cytokine variation. X-axis denotes the adjusted R values for the MVLMs. Bars indicate the adjusted R2 estimated on the full dataset. Error bars indicate the standard deviation in adjusted R2 of 10 MVLMs trained on a random subset of samples from the full data (90% of all samples). Y-axis denotes the cytokine-stimulation pairs. Colors indicate different stimulations applied in the experiments. Sample sizes differ between the different categories with the platelet, immune modulator, immunoglobulin and classical phenotypes having n = 489, the immune cell counts n = 472, the metabolites n = 377, microbial pathways n = 384, microbial taxonomy n = 411, hormones n = 486 and SNPs n = 392 samples. Every sample represents an individual.

Furthermore, we assessed several specific baseline categories that show cytokine- or pathogen-specificity in explaining the inter-individual variation (Fig. 2b). We observed that the abundance of circulating metabolites, including acetate and HDL cholesterol, showed a moderate negative effect on influenza-stimulated cytokine production by PBMC (avg. adjusted R = 0.19) (Fig. 2b), suggesting that these factors modulate susceptibility to viral infections. The production of the lymphocyte-derived cytokines IL-17, IL-22 and IFN-γ by PBMC in response to Aspergillus fumigatus (A. fumigatus) conidia was driven more by non-genetic host factors (cell counts, platelet amounts, circulating metabolites, gut microbiome composition and season) than by genetic factors (Fig. 2b), which was in contrast to the genetic-component-driven cytokine production in response to all other stimulations used (Fig. 2b). More specifically, individuals with high concentration of HDL cholesterol or α1- antitrypsin in the circulation showed lower cytokine production in response to A. fumigatus. To validate the link between HDL cholesterol and cytokine production, we cultured PBMCs collected from 6 healthy volunteers in medium containing lipoprotein-deficient plasma (LPDP) and LPDP+HDL cholesterol and measured cytokine production for TNF-α, IL-1β and IL-6 in response to A. fumigatus conidia after 24 hours. We observed lower production of all the cytokines assessed in PBMCs cultured with HDL compared to the LPDP control (Supplementary Fig. 2 a), indicating that HDL cholesterol modulates immune responses to A. fumigatus conidia. Next, we compared the stimulus-dependent cytokine production data from the three different types of stimulation assays (PBMC, whole blood and PBMC derived macrophages) from the same individuals. We found that season, platelet-activation profiles, concentration of immune modulators, and age had a higher impact on stimulus-dependent cytokine production in PBMCs than in macrophages (Fig. 2a,b). In contrast, stimulus-dependent cytokine production correlated less with baseline metabolite levels in PBMC and whole blood then it did in macrophages (Fig. 2a,b). This analysis shows that genetics contribute substantially to the observed inter-individual variation in cytokine level upon stimulation, and the non-genetic molecular profiles and immune parameters contribute as well.

Baseline molecules associate differentially to cytokine response

We next assessed which baseline immune and molecular components contribute most to variation in stimulus-induced cytokine production. We extracted the top five immune modulators (i.e. A-1 antitrepsin, IL18-BP, adiponecting, resistin and leptin) and metabolites (i.e. the total cholesterol level in HDL3, glutamine, free cholesterol and α-1 acid glycoprotein) in the analysis of explained variance. They are the molecules that show strong association with most of the cytokine measurements in the analysis of explained variance (Fig. 3, Supplementary Fig. 3). For example, circulating IL-18BP concentrations negatively correlate with lymphocyte-derived cytokine production (IL-17, IL-22, and IFN-γ) by PBMC after stimulation, but this pattern is not observed for the monocyte-derived cytokine production (IL-1β, IL-6, and TNF-α) by PBMC after stimulation (Fig. 3). IL-18BP is an inhibitor of IL-1822 and IL-18 induces cytokine production in natural killer (NK) cells and T helper cells23. The known function of IL-18BP in vitro and the observed correlations suggested IL-18BP could potentially be a biomarker for reduced T cell activity in vivo. To validate the divergent effect between IL-18BP concentrations and cytokine production by lymphocytes, we tested for this association in an independent cohort of 300 volunteers of Western-European descent with BMI >25 (300OB), for which we have obtained cytokine production profiles (ELISA) after stimulation of PBMC using the same pathogens and protocols as used in 500FG. In addition, circulating baseline (unstimulated) measurements for IL-18BP were determined. Because this cohort is comprised of mainly obese (BMI >25) and older (age >55) individuals, we limited the analysis to a subset of (n=51) 300-OB volunteers with BMI <28, to bring this distribution more in line with the 500FG cohort. We tested for association (Spearman correlation) between the cytokine production profiles after stimulation and circulating IL-18BP levels (Supplementary Fig. 2 b). We could replicate the negative effect of IL-18BP on lymphocyte cytokines.
Figure 3

Examples of baseline molecules which associate differentially to cytokine responses

IL-18BP, a circulating inhibitor of IL-18, displays negative Spearman correlations with general cytokine production capacity of lymphocytes after correcting for age and gender effects (n=489). The metabolite acetate positively correlates with stimulated cytokine production in response to influenza and displays a mostly positive effect on lymphocyte-derived cytokines after correcting for age and gender effects (n=377). Each sample represents an individual.

The short chain fatty acid (SCFA) acetate showed the strongest correlation (negative correlation between -0.25 and -0.20) with influenza-induced monocyte–derived IL-1β, IL-6 and TNF-α cytokine production capacity (Fig. 3). Cytokine response to bacterial and fungal stimulations showed either positive or negative effects for monocyte-derived cytokine production capacity. In contrast, lymphocyte-derived IL-17, IL-22 and IFN-γ cytokine production showed consistently positive effects in response to most of the bacterial and fungal stimulations. This agrees with previous findings that SCFAs, including acetate, influence cytokine production capacity24–26. The negative correlation between acetate and stimulus-induced production of IL-1β, IL-6 and TNF-α was also observed when assessed in PBMC derived macrophages, but not in whole blood (Fig. 3). To further investigate the association between acetate and stimulus-induced cytokine production, we cultured PBMC derived macrophages obtained from whole blood of 6 healthy Dutch volunteers in vitro in the presence of acetate in the medium, stimulated them with MTB, C. albicans, S. aureus and E. coli, and assessed the cytokine production of TNF-α and IL-6 after 24 hours. We observed an association between acetate and cytokine production in macrophages where the production of TNF-α and IL-6 in PBMC derived macrophages upon two of the stimuli (E. coli and S. aureus) were lower in the presence of acetate, but this effect was not observed for C. albicans (Supplementary Fig. 2 c). Glutamine is known to negatively regulate IL-6 production in human intestinal mucosa27 and decreases IL-6, TNF-α and IL-1β production in biopsies from Crohn’s disease patients28. We observed that glutamine, consistently correlated negatively with all monocyte- and lymphocyte-derived cytokines assessed after stimulation (Supplementary Fig. 3), suggesting it could be used as an anti-inflammatory biomarker. These results show that baseline molecules are differentially associated with cytokine production between stimuli, as well as between cell types.

Host factors explain up to 67% variation in cytokine level

To determine the collective contribution of genetic variation and immune components at baseline to cytokine production in response to pathogens, a multivariate linear model was used. We constructed a MVLM for each cytokine stimulation pair where we added relevant features from each category of dataset sequentially and subsequently evaluated the increase in variance explained by each added dataset. This integrated approach indicated that a combination of genetic, baseline molecular profiles and immune parameters can explain up to 67% of the inter-individual variation in cytokine production capacity (Fig. 4). Because cytokine production is a highly complex phenotype, and many factors that influence it are associated to each other, we tested if changing the order in which specific datasets were added into the models generated different results. When we compared MVLM containing all datasets, to the partial MVLMs, in which each of the 10 datasets were omitted once, we found similar estimates of explained variation as in the sequential analysis (Supplementary Fig. 4). For example, regardless of the order the factors were added, genetics remained the largest individual contributor to explaining inter-individual variation (Supplementary Fig. 4). This indicated that the order in which various factors were added into the model did not influence the results to a large extent.
Figure 4

Cumulative contribution of multiple baseline traits to the variation in stimulated cytokine production.

Adjusted R values (x-axis) obtained from multivariate linear models (MVLM) increase when measurements from 10 categories are added sequentially. Each colored bar represents how much additional variation (on top of the preceding colors) the MVLM for that category explains. The order in which features from a dataset were added is from left to right. The combined dataset consisted of 266 samples. Each sample represents an individual. Gene expression was not included in this analysis because of the relatively small sample size of the RNA-seq experiment after overlapping with the other datasets (n = 69). X-axis denotes adjusted R values. Y-axis denotes different cytokine-stimulation pairs.

Gene expression correlates with cytokine response

Next we integrated baseline transcript abundance with stimulus-induced cytokine expression. We made use of whole genome gene expression profiles obtained using RNA-Seq both before and after stimulation of peripheral blood with C.albicans conidia from a subset of volunteers (n = 64) from an independent Dutch cohort (Genome of The Netherlands cohort29). We used measurements of the production of TNF-α, IL-6 and IL-1β by PBMC upon stimulation with C.albicans conidia after 24 hours in the same individuals. We then applied the same MVLM based analysis approach used earlier to obtain estimates of how much inter-individual variation in cytokine production capacity could be explained by gene expression. We observed that baseline gene expression could explain a substantial portion of the inter-individual variation in production of TNF-α, IL-6 and IL-1β (Fig. 5). Production of TNF-α, IL-6 and IL-1β by PBMC stimulated with C. albicans conidia showed significantly higher correlations with gene expression induced by stimulation (adj. R reaching up to 0.75) than with baseline gene expression (Wilcox test, P=1.08e-05, P=8.93e-03, P=1.08e-05, for TNF-α, IL-6 and IL-1β respectively). Using GO enrichment (online tool20), we found that the genes selected during modelling (Supplementary Table 5) showed enrichment for several GO terms related to immune responses. For example the genes associated to C.albicans induced TNF-α levels were nominally enriched for negative regulation of mast cell cytokine production (P=1.28e-3), negative regulation of isotype switching to IgE isotypes (P=1.71e-3) and negative regulation of T-helper 2 cell differentiation (P=2.15e-3). These results imply a strong correlation between gene expression and functional responses upon stimulation by pathogens, and thus they present gene expression as a target for future studies into the prediction of immune responses.
Figure 5

Integrating gene expression profiles and cytokine production in response to C. albicans.

Percentage of inter-individual variation (y-axis, adjusted R2) in stimulated cytokine level of TNF-α, IL-6 and IL-1β explained by gene expression measured at baseline and upon C. albicans stimulation (denoted by CA) is significantly (Wilcox rank sum test, * P < 0.05, ** P < 0.01, *** P < 0.001) higher in the multivariate linear models (MVLM) fitted on stimulated gene expression data. Exact P values of the Wilcox rank sum test are as follows: IL-1β (P = 1.08e-05), TNF-α (P = 8.93e-04) and IL6 (P = 1.08e-05). The distribution shows adjusted R (y-axis) of 10 MVLMs fitted after re-sampling using a random subset of samples (90% of all samples each time). Each dot represents the adjusted R2 of a MVLM. The dataset consisted of 64 samples from the GoNL cohort. Each sample represents an individual.

Immune disease risk is associated with stimulated cytokine level

Many complex diseases appear to result from multiple genetic variants exerting small effects on disease risk30, which implies that complex diseases conform closely to a classical polygenic model. Using publicly available summary statistics from GWAS we calculated polygenic risk scores (PRS) for 15 immune mediated diseases (Supplementary Table 6) for all the volunteers in the 500FG cohort as a measure of relative disease risk between individuals We then tested whether volunteers with a higher risk for an immune mediated disease displayed higher or lower stimulus-induced cytokine production compared to the lower risk individuals. For this analysis, we focused those immune mediated diseases that showed both a significant change (two tailed, two sample t-test, Bonferroni P <0.05, Supplementary Table 7) compared to a permutation-based null distribution, and a consistent pattern at different thresholds used for PRS calculation (Fig. 6a-c, Supplementary Fig. 5a,b). We found that volunteers with higher risk for inflammatory bowel disease, multiple sclerosis, psoriasis and ulcerative colitis had significantly higher (P < 0.05) stimulus-induced production of lymphocyte-derived IL-17, IL-22 and IFN-γ compared to monocyte-derived TNF-α, IL-6 and IL-1β cytokines (Fig. 6). In contrast, higher risk for type 1 diabetes (T1D) and rheumatoid arthritis was associated with increased stimulus-induced production of monocyte-derived TNF-α, IL-6 and IL-1β compared to lymphocyte-derived cytokines (Fig. 6c). Higher risk for Crohn’s disease, eczema and type 2 diabetes was associated with a significant increase (compared to their respective null distributions, P < 0.05) in both monocyte- and lymphocyte-derived cytokines compared to the permutation-based null distribution, with no significant differences between the monocyte and lymphocyte derived groups (Fig. 6b). These observations suggest that the genetic basis for immune-mediated diseases could influence the functionality of the immune system even in otherwise healthy individuals.
Figure 6

Stimulated cytokine production correlates with genetic risk score for autoimmune diseases.

(a) Example individuals with high genetic risk for (auto)immune disease tend to be high producers of cytokines in response to pathogens. * indicates the significance of the Wilcox rank sum test between low- and high-risk groups for T1D (P=0.011). Low- and high-risk groups (x-axis) were selected by taking the top and bottom quantile of the PRS for T1D. Y-axis indicates the IL-6 level after stimulation of PBMCs with influenza. (b) Distribution mean correlations between T1D risk in monocyte-derived cytokines (left panel) and lymphocyte cytokines (right panel) for 1000 permutations. The measured estimate is indicated by the red arrow. T1D shows significance for monocyte derived cytokines (left) but not for the lymphocyte derived cytokines (right). (c) Distribution of Spearman correlation coefficients between stimulated cytokine production and genetic risk score for immune disease in 430 individuals, shown for PBMC. Genetic risk scores calculated based on genome-wide association studies for different diseases. Significant differences in mean correlation between the lymphocyte- and monocyte-derived cytokines are shown by Wilcox rank sum test (* P < 0.05, ** P < 0.01, *** P < 0.001). Exact p-values are as follows Crohns disease P=7.28E-01, Eczema P=2.55E-01, Inflammatory Bowel Disease P=9.34E-06, Multiple sclerosis P=4.85E-11, Psoriasis P=1.40E-04, Rheumatoid Arthritis P=1.41E-02, Type P=1 Diabetes P=1.00E-05, Type P=2 Diabetes P=1.65E-01, Ulcerative colitis P=1.34E-05.

Stimulated cytokine level predicted by genetics

Finally, we integrated both genetics and other molecular features to construct MVLMs to predict each cytokine stimulation pair in PBMC, whole blood and macrophages. To achieve the best prediction of ex vivo stimulus-induced cytokine production, we tested several linear prediction methods (Elastic Net, RR-BLUP and PLS) and compared them using both genetic and non-genetic factors to train the MVLMs for each cytokine stimulation pair. Predictive performance was quantified by Spearman’s correlation between the measured and the predicted stimulus-induced cytokine production in multiple randomly selected subsets of the volunteers from 500FG. While the prediction performances of the different methods are similar (Supplementary Fig. 6a-c), Elastic Net marginally outperformed the others, so we used it for subsequent analyses. We first tested if SNP data could predict cytokine production. Among the 91 stimulation-cytokine pairs, the correlations between predicted and measured stimulus-induced cytokine production were, on average, 0.69 (range 0.28-0.89) (Fig. 7a). Inclusion of the baseline immune parameters and multi-omics data significantly increased the predictive power and stability of the model (two tailed student t-test, P=1.36e-09, t-statistic=6.09, degrees of freedom = 1792) and most predictions for cytokine production increased to, on average, 0.72 (range 0.35-0.90) (Fig. 7b). Additional inclusion of the gene expression data from the RNA-seq analysis decreased the predictive power (avg. 0.60, range 0-1) (Supplementary Fig. 6d), most likely due to the reduced number of samples for which both RNA-seq and the other factors were available (n = 69).
Figure 7

Cytokine production in response to pathogens can be predicted using genetics and baseline immune profiles.

Spearman correlation between predicted and measured cytokine levels (y-axis) are shown for each of the 10 multivariate linear models from cross validation for all available cytokine stimulation pairs. Cytokine production in response to pathogens can be predicted using SNPs (n = 392 individuals). Prediction accuracy increases when baseline immune parameters and molecular profiles (immune cell frequencies, immune modulators, immunoglobulins, hormone levels, blood platelets, circulating metabolites, gut microbiome composition) are added to the model (n = 353 individuals).

We then tested the predictive capabilities of the Elastic net trained MVLMs using only SNPs as input and applying it to independent subset of 500FG individuals were new cytokine stimulation experiments were performed (50FG). We found prediction accuracies up to 0.56 for some cytokine stimulation pairs (Fig.8), although the MVLMs performed poorly for most stimulations. Among the best-performing stimulus-cytokine pairs, C.burnetti stimulated IL-1β and Poly I:C-stimulated IL-6 gave prediction accuracies of on average 0.56 and 0.46 respectively (Fig. 8). Because both pathways are known to have a large genetic component31 this indicated that the MVLMs could predict cytokine production for stimulus-induced cytokines whose mechanism of induction are primarily driven by genetics.
Figure 8

Prediction using the genetic model in an independent dataset. shows some cytokine stimulation pairs can be predicted successfully.

Spearman correlations between predicted cytokine level by the multivariate linear models (MVLM) built using genetics (n = 336) and the measured values in an independent set of stimulation experiments (n = 56). The boxplots show the variation in Spearman correlations from each of the 10 MVLMs predictions from the cross validation strategy.

By applying MVLMs to genetics data, we were able to predict the cytokine production upon stimulation, with varying degrees of accuracy.

Discussion

In this study we assessed the combined contribution of genetic and non-genetic factors to the inter-individual variation in cytokine production in response to pathogens by examining the cytokine production of immune cells following stimulation with 20 different pathogens or TLR ligands ex vivo in PBMC, whole blood and PBMC derived macrophages. This analysis identified new modulators of cytokine production, including circulating inflammatory mediators and metabolites. We found that volunteers with increased genetic risk for immune mediated diseases were more likely to be high responders in terms of stimulus-induced cytokine production. Finally, we trained MVLMs that could predict human stimulus-induced cytokine production for Poly I:C induced IL-6 and C.burnetti IL-1β levels in PBMC using only the genetic profiles or a combination of genetic and other molecular profiles. A recent study on the heritability of immune phenotypes in 210 twins suggested that variations in circulating cytokine concentrations are mostly driven by non-heritable influences32. Although we observed here that genetics was the largest single contributor to inter-individual variation (avg. adj. R = 0.18), this still leaves room for the majority of the variation to be explained by non-genetic influences. Any differences we observed in estimates of heritability are likely due to differences in the experimental design between the two studies. As such, we assessed cytokine profiles upon stimulation ex vivo, whereas the above study32 measured baseline circulating concentrations in vivo. This strongly suggests that it is the response to pathogens during infection that is under stronger genetic pressure rather than the background level of mediators in the circulation. Our study thus agrees with the idea that infections have a strong selective impact on the genetic control of immune responses33–40. The present study has potentially important implications for our understanding of the human immune response. We found out that acetate, a circulating metabolites, was associated with changes in stimulus-induced cytokine production and especially in the modulation of TH1 and TH17 responses. SCFA such as acetate, propionate and succinate are released by the gut microbiome and current literature suggests that SCFA have important immunomodulatory properties24–27. We show here that acetate has similar effects in humans in vivo. It appears important to further investigate the broader impact of SCFA and identify which microbiome profiles modify their concentration in the circulation. We found a strong inhibitory effect of acetate on influenza-stimulated cytokine production, a phenomenon that deserves further scrutiny. Another important metabolic pathway that strongly influenced cytokine responses was the cholesterol and lipoprotein synthesis pathway. Cholesterol pathways have been described to have important immune-modulating effects, with the levels of cholesterol sulfate, a derivative of membrane cholesterol, shown to influence immune processes such as TCR signalling and thymic selection41. Here we showed that HDL cholesterol negatively impacted influenza and Aspergillus-stimulated cytokine production, possibly with important effects on the pathophysiology of these infections. The ability to calculate prediction scores for specific immune mediated diseases and to link them to cytokine production shows that certain stimulus-induced cytokine profiles may contribute to particular diseases, e.g. the capacity to release high amounts of monocyte-derived cytokines in T1D. Although we acknowledge that our power to detect these smaller associations is relatively limited, our approach can be used to link any given phenotype to disease scores when individual-level data is available. This offers the opportunity to identify immune pathways important in disease, which may represent new therapeutic targets. A second limitation of the 500FG cohort is that it contains a higher proportion of young people than the general population9, which could introduce age bias into the MVLM’s predictions. While we acknowledge that the performance of the MVLMs prediction may vary in a population with a different range in age, BMI or ancestry, our study represents a proof-of-concept that stimulus-induced cytokine production can be moderately predicted. Future studies in larger general population cohorts with greater ranges of age and ethnicity will contribute to the generation of models with improved predictive potential for a general population. Future studies should also aim to extend the current analysis, which was limited to common SNP polymorphisms (MAF >0.1), to include rare variants and mutations, a broadening of scope likely to further increase the observed impact of genetics on cytokine production upon stimulation. In conclusion, we present the most comprehensive assessment to date of the host factors that influence cytokine production. We show that genetics was a major contributor to the inter-individual variation in cytokine production upon pathogen stimulation. However, other non-genetic factors also influenced cytokine production in response to most stimuli, including gut microbiome composition, immune cell numbers in circulation and circulating metabolite concentrations. Individuals with increased genetic risk for a given immune disease tended to have increased cytokine production, and stimulus-induced cytokine production could be predicted for Poly I:C induced IL-6 and C. burnetti IL-1β levels. This study provides the fundamentals for predicting components of cytokine production based on genetics and baseline host factor profiles, paving the way towards personalized immune-based therapies.

Methods

Study cohort

The main analyses were performed in the 500FG cohort, which is part of the Human Functional Genomics Project. This cohort consists of 534 healthy individuals (237 males and 296 females) of Caucasian origin. Volunteers range from 18 to 75 years of age, with the majority (421 individuals) being 30 years or younger (Supplementary Fig. 1A). BMI is within normal limits (15 to 35) with the majority (380 individuals) having a BMI between 20 and 25 (Supplementary Fig. 1B). Of these 534 original volunteers, 45 were excluded based on genetic background and questionnaire results (medication usage, chronic disease) leaving 489 individuals.

Replication cohort

Validation experiments were performed in the 300-OB cohort. This cohort consists of ~300 Dutch individuals. All individuals had a BMI >25, with an average BMI of 31, and range in age from 55 to 80 years, with an average age of 67 years. Validations were performed in a subset of the 300-OB cohort with an BMI <28 (N=55). Circulating metabolites and mediators as well as stimulated cytokine levels were measured in the same way as in 500FG.

Experimental procedures

The experimental procedures used to measure levels of cytokines, modulators, immunoglobulins and hormones have been described previously9. Genotyping, metagenomic sequencing of the gut microbiome, FACS sorting of PBMCs and determination of platelet activation profiles have also been described previously7,8,42. We selected a representative subset of 89 samples from the 500FG cohort for RNASeq (balanced for age and sex to match the original distribution in the cohort). These samples were processed for sequencing using the Illumina TruSeq version 2 library preparation kit. Paired-end sequencing of 2×50-bp reads was performed using the Illumina HiSeq 2000 platform. The quality of the raw reads was checked using FastQC (http://www.bioinformatics.babraham.ac.uk/projects/fastqc/). Read alignment was performed using STAR 2.3.043, and aligned reads sorted using SAMTools. Gene level quantification of reads was done using HTSeq44. Circulating metabolites were measured and analysed using the BrainShake Biomarker Analysis Platform that is based on nuclear magnetic resonance (NMR) spectroscopy (BrainShake, Finland)

Statistical methods

Data pre-filtering

After pre-processing, the gene expression, SNP, metabolite and microbiome datasets were filtered to remove any non-significantly-associated features. This was done to increase the efficiency of downstream analysis. The gene expression metabolite and microbiome datasets were correlated to all of the cytokine measurements, and all features showing a Spearman correlation with a Benjamini-Hochberg adjusted P <0.05 to at least one cytokine were kept. This resulted in a dataset of 4,499 genes, 205 metabolites, 509 microbial pathways and 162 microbial taxonomies. The genetic variants were filtered using previously generated cytokine QTL profiles7 by setting the P-value cut-off at various thresholds depending on the application. To calculate the variance explained by genetics, a P-value threshold of P <5×10-6 was chosen. For prediction using the Elastic Net model, various thresholds were evaluated after which all SNPs with a P <5×10-5 were included in the analysis.

Estimation of explained variance

The estimation of variance explained by each of the data levels on the different stimulated cytokine production profiles was performed by applying a correlation-based feature selection approach. In this approach, we built a model for each stimulated cytokine measurement in which only features associated to this measurement are included in the model. We select these features by first regressing out the effects of age and gender, then associating the features in a data level to the current cytokine stimulation pair. If a feature showed a significant association (Spearman P-value <0.05), the feature was included in the set of potential predictors. Once all the associations had been computed, the set of potential predictors was correlated to itself to identify collinearity among this predictor set. If features within this predictor set showed an association (Spearman correlation >0.4), the feature which showed the least association (based on the correlation P-values) to the cytokine stimulation pair is removed. This yielded a unique set of predictors for every cytokine stimulation pair, which was then used to fit a multivariate linear model to estimate the variance explained by these features for that cytokine stimulation pair. To account for the inflation that adding predictors has on the explained variation, the adjusted R was taken as the measure of explained variance.

Permutation of cytokine GWAS

The baseline cytokine GWAS was performed as described previously 7. We randomly permuted the cytokine and covariate datasets 1000 times then ran the GWAS using these datasets to obtain 1000 random profiles for each cytokine stimulation pair. For each run we obtained the QTL profile and estimated the explained variance using the permuted cytokine and covariate dataset and the pipeline described above. This yielded a distribution of 1000 estimates of explained variance for each cytokine stimulation pair. A measured estimate was considered significant if it was in the top 5% of the permuted distribution of estimates for that cytokine stimulation pair.

Estimation of age and gender effects

Age and gender effects on cytokine production were assessed by fitting univariate linear models for each cytokine stimulation pair with age and gender as the independent variables, respectively. The R was taken as the measure of explained variation of these models.

Estimation of seasonal effect

The effect of season on stimulated cytokine production was assessed using a linear combination of sine and cosine terms with the same period (equation 1) as described by ter Horst et al9: Where y represents the response (cytokine level), β the estimated intercept, α the estimated predictor effect, x the day of the year the sample was taken in, and ϵ the residual effect.

Estimation of cumulative explained variance

To assess the proportion of variance that can be explained by all levels cumulatively, individual levels were added to a multivariate linear model one by one, and the total model adjusted R calculated for each step. If adding a level showed an increase in the total adjusted R of the model, this value was extracted. To assess the contribution of each level conditional upon the others, the full model was fit first. Subsequently several reduced models were fit where one data level was missing. The adjusted R for this full model was then compared against the model with the missing level. The difference between the reduced model and the full model was taken as a measure of the variance explained by that level when accounting for the effects of the other levels.

Cytokine level prediction

Our objectives were to investigate whether genetic variants can reveal predictive insights into the cytokine production upon stimulation and whether baseline immune parameters, which are treated as quantitative phenotypes that are continuously distributed over a population, can improve predictive power for cytokine production upon stimulation. Using our population-based study, we searched for those subsets of genetic variants and immune components that are most predictive of the various stimulated cytokine production profiles, rather than using exclusively those variants meeting a stringent level of statistical significance. We assessed the validity of this approach by applying multiple methods, each of which is discussed in detail below. In total three datasets were evaluated: one for predicting stimulated cytokine production using only SNPs, one containing all levels except gene expression, and one with all levels including gene expression. Firstly, features with little association with cytokine production levels (Spearman P >0.05) were removed for building the prediction models. For the SNP dataset, all SNPs with an association to a cytokine stimulation pair with P <5x10-5 were used as input for feature selection. No filtering for collinearity was applied because Elastic Net accounts for potential collinearity among predictors45.

Elastic Net

Prediction of the cytokine levels was facilitated by training an Elastic Net model. A 2×10-fold cross-validation approach was used, where the data was first split up into 10 random training and test sets to validate the prediction, and the training set was then split up once more for feature selection. Prediction accuracy was evaluated by calculating Spearman correlations between the measured cytokine levels and the predictions of the Elastic Net model on the test sets.

RR BLUP

To show that the prediction results are not influenced to a large extent by the methodology, a mixed linear model (equation 2), as implemented in the package rrBLUP 46, was applied: Where y represents the response (cytokine level), 1 a vector of 1s, μ the overall mean of the training set, Z the matrix of predictors (traits), u the random effect of the predictors, and ϵ a vector of residual effects. Predictions were made using 10-fold cross-validation. Spearman correlation was then calculated between predicted and measured values. We applied this model as was described previously47.

Partial least squares regression

In addition to the Elastic Net and rrBLUP a partial least squares model was applied. Models were validated using 10-fold cross-validation. Prediction of cytokine levels on the test set was done using a linear model (equation 3): Where y represents the response (cytokine level), β the intercept, α a vector containing the coefficients from the model, X the matrix of predictors (immune traits), and ϵ the residual error.

Polygenic risk scores

We carried out polygenic scoring of disease risk using publically available GWAS results. Quantitative scores were computed for each trait in this study based on the set of SNPs with P-values lower than predefined P-value thresholds (pT) in the GWAS. Multiple pT were evaluated (pT <5e--8, 1e-5, 1e-4, 1e-3, and pT < 1e-2). Throughout this work, we refer to the scores defined at pT <1e-5 as Polygenic Risk Scores (PRS). Full association summary statistics were downloaded from several publicly available resources indicated in Supplementary Table 6 48–60,. Studies done exclusively in non-European cohorts were omitted. Filters applied to the separate data sources are indicated below. All the dbSNP rs numbers were standardized to match GIANT 1kG p1v3 and the directions of the effects were standardized to correspond to the GIANT 1kG p1v3 minor allele. SNPs with different opposite-strand alleles compared to GIANT alleles were flipped. SNPs with A/T and C/G SNPs and SNPs with different alleles GIANT 1kG p1v3 (tri-allelic SNPs, indels, unknown alleles) were removed from the analysis. Genomic control was applied to all P-values for the datasets not genotyped by Immunochip or Metabochip. We calculated PRS by first clumping variants based on the threshold pT, linkage-disequilibrium (R < 0.2) and a 250kb window using the PLINK 1.9 option “clump” and exclusively European samples from 1000 genomes data as a reference for linkage disequilibrium calculation. PRS were subsequently obtained for each threshold pT by calculating them using the linkage-disequilibrium-clumped subset of SNPs using the PLINK 1.9 option “score”.

Association between polygenic risk scores and cytokine production

The association between the PRS and cytokine production capacity upon stimulation was determined by calculating the Spearman correlation between each of the PRS profiles and each of the stimulated cytokine profiles. To evaluate the statistical significance of association, a permutation method was used. The cytokine data was permuted 1000 times and the correlation was calculated for each of these permuted datasets. Both the measured and permuted distributions were separated into the lymphocyte and monocyte groups, and a student t-test was applied between the measured distribution and the permuted distribution. When either the monocyte or lymphocyte group showed a significant deviation from the permuted distribution (Bonferroni adjusted two sample t-test P <0.05) the disease was selected for interpretation.
  58 in total

1.  Gene ontology: tool for the unification of biology. The Gene Ontology Consortium.

Authors:  M Ashburner; C A Ball; J A Blake; D Botstein; H Butler; J M Cherry; A P Davis; K Dolinski; S S Dwight; J T Eppig; M A Harris; D P Hill; L Issel-Tarver; A Kasarskis; S Lewis; J C Matese; J E Richardson; M Ringwald; G M Rubin; G Sherlock
Journal:  Nat Genet       Date:  2000-05       Impact factor: 38.330

2.  Cytomegalovirus infection enhances the immune response to influenza.

Authors:  David Furman; Vladimir Jojic; Shalini Sharma; Shai S Shen-Orr; Cesar J L Angel; Suna Onengut-Gumuscu; Brian A Kidd; Holden T Maecker; Patrick Concannon; Cornelia L Dekker; Paul G Thomas; Mark M Davis
Journal:  Sci Transl Med       Date:  2015-04-01       Impact factor: 17.956

Review 3.  Genetics of immune-mediated disorders: from genome-wide association to molecular mechanism.

Authors:  Vinod Kumar; Cisca Wijmenga; Ramnik J Xavier
Journal:  Curr Opin Immunol       Date:  2014-10-14       Impact factor: 7.486

4.  Plasma leptin levels in healthy children and adolescents: dependence on body mass index, body fat mass, gender, pubertal stage, and testosterone.

Authors:  W F Blum; P Englaro; S Hanitsch; A Juul; N T Hertel; J Müller; N E Skakkebaek; M L Heiman; M Birkett; A M Attanasio; W Kiess; W Rascher
Journal:  J Clin Endocrinol Metab       Date:  1997-09       Impact factor: 5.958

5.  Differential effects of short-chain fatty acids on proliferation and production of pro- and anti-inflammatory cytokines by cultured lymphocytes.

Authors:  Claudia R Cavaglieri; Anita Nishiyama; Luis Claudio Fernandes; Rui Curi; Elizabeth A Miles; Philip C Calder
Journal:  Life Sci       Date:  2003-08-15       Impact factor: 5.037

6.  Genetic adaptation of the antibacterial human innate immunity network.

Authors:  Ferran Casals; Martin Sikora; Hafid Laayouni; Ludovica Montanucci; Aura Muntasell; Ross Lazarus; Francesc Calafell; Philip Awadalla; Mihai G Netea; Jaume Bertranpetit
Journal:  BMC Evol Biol       Date:  2011-07-11       Impact factor: 3.260

7.  Fine mapping of type 1 diabetes susceptibility loci and evidence for colocalization of causal variants with lymphoid gene enhancers.

Authors:  Suna Onengut-Gumuscu; Wei-Min Chen; Oliver Burren; Nick J Cooper; Aaron R Quinlan; Josyf C Mychaleckyj; Emily Farber; Jessica K Bonnie; Michal Szpak; Ellen Schofield; Premanand Achuthan; Hui Guo; Mary D Fortune; Helen Stevens; Neil M Walker; Lucas D Ward; Anshul Kundaje; Manolis Kellis; Mark J Daly; Jeffrey C Barrett; Jason D Cooper; Panos Deloukas; John A Todd; Chris Wallace; Patrick Concannon; Stephen S Rich
Journal:  Nat Genet       Date:  2015-03-09       Impact factor: 38.330

8.  HTSeq--a Python framework to work with high-throughput sequencing data.

Authors:  Simon Anders; Paul Theodor Pyl; Wolfgang Huber
Journal:  Bioinformatics       Date:  2014-09-25       Impact factor: 6.937

9.  Differential Effects of Environmental and Genetic Factors on T and B Cell Immune Traits.

Authors:  Raul Aguirre-Gamboa; Irma Joosten; Paulo C M Urbano; Renate G van der Molen; Esther van Rijssen; Bram van Cranenbroek; Marije Oosting; Sanne Smeekens; Martin Jaeger; Maria Zorro; Sebo Withoff; Antonius E van Herwaarden; Fred C G J Sweep; Romana T Netea; Morris A Swertz; Lude Franke; Ramnik J Xavier; Leo A B Joosten; Mihai G Netea; Cisca Wijmenga; Vinod Kumar; Yang Li; Hans J P M Koenen
Journal:  Cell Rep       Date:  2016-11-03       Impact factor: 9.423

10.  A Polygenic Approach to the Study 
of Polygenic Diseases.

Authors:  D Lvovs; O O Favorova; A V Favorov
Journal:  Acta Naturae       Date:  2012-07       Impact factor: 1.845

View more
  37 in total

1.  An evolutionary recent IFN/IL-6/CEBP axis is linked to monocyte expansion and tuberculosis severity in humans.

Authors:  Murilo Delgobo; Daniel Agb Mendes; Edgar Kozlova; Edroaldo Lummertz Rocha; Gabriela F Rodrigues-Luiz; Lucas Mascarin; Greicy Dias; Daniel O Patrício; Tim Dierckx; Maíra A Bicca; Gaëlle Bretton; Yonne Karoline Tenório de Menezes; Márick R Starick; Darcita Rovaris; Joanita Del Moral; Daniel S Mansur; Johan Van Weyenbergh; André Báfica
Journal:  Elife       Date:  2019-10-22       Impact factor: 8.140

2.  Application of Artificial Intelligence to Clinical Practice in Inflammatory Bowel Disease - What the Clinician Needs to Know.

Authors:  David Chen; Clifton Fulmer; Ilyssa O Gordon; Sana Syed; Ryan W Stidham; Niels Vande Casteele; Yi Qin; Katherine Falloon; Benjamin L Cohen; Robert Wyllie; Florian Rieder
Journal:  J Crohns Colitis       Date:  2022-03-14       Impact factor: 10.020

Review 3.  Evolutionary and population (epi)genetics of immunity to infection.

Authors:  Luis B Barreiro; Lluis Quintana-Murci
Journal:  Hum Genet       Date:  2020-04-13       Impact factor: 4.132

Review 4.  Nature and nurture of tissue-specific macrophage phenotypes.

Authors:  Marten A Hoeksema; Christopher K Glass
Journal:  Atherosclerosis       Date:  2018-10-06       Impact factor: 5.162

5.  Rewilding Nod2 and Atg16l1 Mutant Mice Uncovers Genetic and Environmental Contributions to Microbial Responses and Immune Cell Composition.

Authors:  Jian-Da Lin; Joseph C Devlin; Frank Yeung; Caroline McCauley; Jacqueline M Leung; Ying-Han Chen; Alex Cronkite; Christina Hansen; Charlotte Drake-Dunn; Kelly V Ruggles; Ken Cadwell; Andrea L Graham; P'ng Loke
Journal:  Cell Host Microbe       Date:  2020-03-24       Impact factor: 21.023

6.  Mapping immune variation and var gene switching in naive hosts infected with Plasmodium falciparum.

Authors:  Kathryn Milne; Alasdair Ivens; Adam J Reid; J Alexandra Rowe; Philip J Spence; Magda E Lotkowska; Aine O'Toole; Geetha Sankaranarayanan; Diana Munoz Sandoval; Wiebke Nahrendorf; Clement Regnault; Nick J Edwards; Sarah E Silk; Ruth O Payne; Angela M Minassian; Navin Venkatraman; Mandy J Sanders; Adrian Vs Hill; Michael Barrett; Matthew Berriman; Simon J Draper
Journal:  Elife       Date:  2021-03-02       Impact factor: 8.140

7.  An integrative model of cardiometabolic traits identifies two types of metabolic syndrome.

Authors:  Amit Frishberg; Inge van den Munckhof; Niels P Riksen; Irit Gat-Viks; Rob Ter Horst; Kiki Schraa; Leo Ab Joosten; Joost Hw Rutten; Adrian C Iancu; Ioana M Dregoesc; Bogdan A Tigu; Mihai G Netea
Journal:  Elife       Date:  2021-01-28       Impact factor: 8.140

8.  Impact of rare and common genetic variation in the interleukin-1 pathway on human cytokine responses.

Authors:  Rosanne C van Deuren; Peer Arts; Giulio Cavalli; Martin Jaeger; Marloes Steehouwer; Maartje van de Vorst; Christian Gilissen; Leo A B Joosten; Charles A Dinarello; Musa M Mhlanga; Vinod Kumar; Mihai G Netea; Frank L van de Veerdonk; Alexander Hoischen
Journal:  Genome Med       Date:  2021-05-25       Impact factor: 15.266

Review 9.  Multi-Omics Approaches in Immunological Research.

Authors:  Xiaojing Chu; Bowen Zhang; Valerie A C M Koeken; Manoj Kumar Gupta; Yang Li
Journal:  Front Immunol       Date:  2021-06-11       Impact factor: 7.561

10.  Integration of metabolomics, genomics, and immune phenotypes reveals the causal roles of metabolites in disease.

Authors:  Xiaojing Chu; Martin Jaeger; Cisca Wijmenga; Mihai G Netea; Yang Li; Joep Beumer; Olivier B Bakker; Raul Aguirre-Gamboa; Marije Oosting; Sanne P Smeekens; Simone Moorlag; Vera P Mourits; Valerie A C M Koeken; Charlotte de Bree; Trees Jansen; Ian T Mathews; Khoi Dao; Mahan Najhawan; Jeramie D Watrous; Irma Joosten; Sonia Sharma; Hans J P M Koenen; Sebo Withoff; Iris H Jonkers; Romana T Netea-Maier; Ramnik J Xavier; Lude Franke; Cheng-Jian Xu; Leo A B Joosten; Serena Sanna; Mohit Jain; Vinod Kumar; Hans Clevers
Journal:  Genome Biol       Date:  2021-07-06       Impact factor: 13.583

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.