Literature DB >> 20100356

PCA-based bootstrap confidence interval tests for gene-disease association involving multiple SNPs.

Qianqian Peng1, Jinghua Zhao, Fuzhong Xue.   

Abstract

BACKGROUND: Genetic association study is currently the primary vehicle for identification and characterization of disease-predisposing variant(s) which usually involves multiple single-nucleotide polymorphisms (SNPs) available. However, SNP-wise association tests raise concerns over multiple testing. Haplotype-based methods have the advantage of being able to account for correlations between neighbouring SNPs, yet assuming Hardy-Weinberg equilibrium (HWE) and potentially large number degrees of freedom can harm its statistical power and robustness. Approaches based on principal component analysis (PCA) are preferable in this regard but their performance varies with methods of extracting principal components (PCs).
RESULTS: PCA-based bootstrap confidence interval test (PCA-BCIT), which directly uses the PC scores to assess gene-disease association, was developed and evaluated for three ways of extracting PCs, i.e., cases only(CAES), controls only(COES) and cases and controls combined(CES). Extraction of PCs with COES is preferred to that with CAES and CES. Performance of the test was examined via simulations as well as analyses on data of rheumatoid arthritis and heroin addiction, which maintains nominal level under null hypothesis and showed comparable performance with permutation test.
CONCLUSIONS: PCA-BCIT is a valid and powerful method for assessing gene-disease association involving multiple SNPs.

Entities:  

Mesh:

Substances:

Year:  2010        PMID: 20100356      PMCID: PMC2825231          DOI: 10.1186/1471-2156-11-6

Source DB:  PubMed          Journal:  BMC Genet        ISSN: 1471-2156            Impact factor:   2.797


Background

Genetic association studies now customarily involve multiple SNPs in candidate genes or genomic regions and have a significant role in identifying and characterizing disease-predisposing variant(s). A critical challenge in their statistical analysis is how to make optimal use of all available information. Population-based case-control studies have been very popular[1] and typically involve contingency table tests of SNP-disease association[2]. Notably, the genotype-wise Armitage trend test does not require HWE and has equivalent power to its allele-wise counterpart under HWE[3,4]. A thorny issue with individual tests of SNPs for linkage disequilibrium (LD) in such setting is multiple testing, however, methods for multiple testing adjustment assuming independence such as Bonferroni's[5,6] is knowingly conservative[7]. It is therefore necessary to seek alternative approaches which can utilize multiple SNPs simultaneously. The genotype-wise Armitage trend test is appealing since it is equivalent to the score test from logistic regression[8] of case-control status on dosage of disease-predisposing alleles of SNP. However, testing for the effects of multiple SNPs simultaneously via logistic regression is no cure for difficulty with multicollinearity and curse of dimensionality[9]. Haplotype-based methods have many desirable properties[10] and could possibly alleviate the problem[11-14], but assumption of HWE is usually required and a potentially large number of degrees of freedom are involved[7,11,15-18]. It has recently been proposed that PCA can be combined with logistic regression test (LRT)[7,16,17] in a unified framework so that PCA is conducted first to account for between-SNP correlations in a candidate region, then LRT is applied as a formal test for the association between PC scores (linear combinations of the original SNPs) and disease. Since PCs are orthogonal, it avoids multicollinearity and at the meantime is less computer-intensive than haplotype-based methods. Studies have shown that PCA-LRT is at least as powerful as genotype- and haplotype-based methods[7,16,17]. Nevertheless, the power of PCA-based approaches vary with ways by which PCs are extracted, e.g., from genotype correlation, LD, or other kinds of metrics[17], and in principle can be employed in frameworks other than logistic regression[7,16,17]. Here we investigate ways of extracting PCs using genotype correlation matrix from different types of samples in a case-control study, while presenting a new approach testing for gene-disease association by direct use of PC scores in a PCA-based bootstrap confidence interval test (PCA-BCIT). We evaluated its performance via simulations and compared it with PCA-LRT and permutation test using real data.

Methods

PCA

Assume that p SNPs in a candidate region of interest have coded values (X1, X2, ⋯, X) according to a given genetic model (e.g., additive model) whose correlation matrix is C. PCA solves the following equation, where = 1, i = 1,2, ⋯, p, l= (l, l, ⋯, l)' are loadings of PCs. The score for an individual subject is where cov (F, F) = 0, i ≠ j, and var(F1) ≥ var(F2) ≥ ⋯ ≥ var(F).

Methods of extracting PCs

Potentially, PCA can be conducted via four distinct extracting strategies (ES) using case-control data, i.e., 0. Calculate PC scores of individuals in cases and controls separately (SES), 1. Use cases only (CAES) to obtain loadings for calculation of PC scores for subjects in both cases and controls, 2. Use controls only (COES) to obtain the loadings for both groups, and 3. Use combined cases and controls (CES) to obtain the loadings for both groups. It is likely that in a case-control association study, loadings calculated from cases and controls can have different connotations and hence we only consider scenarios 1-3 hereafter. More formally, let (X1, X2, ⋯, X) and (Y1, Y2, ⋯, Y) be p-dimension vectors of SNPs at a given candidate region for cases and controls respectively, then we have, Strategy 1 (): where Cis the correlation matrix of (X1, X2, ⋯, X), and = 1, i = 1,2, ⋯, p. The iPC for cases is calculated by and for controls Strategy 2 (): where Cis the correlation matrix of (Y1, Y2, ⋯, Y). The iPC for controls is calculated by And for cases, the iPC, i = 1,2, ⋯, p, is calculated by Strategy 3 (): where C is the correlation matrix obtained from the pooled data of cases and controls, and . The iPC of cases is calculated by The iPC of controls is calculated by

PCA-BCIT

Given a sample of N cases and M controls with p-SNP genotypes (X1, X2, ⋯, X), (Y1, Y2, ⋯, Y), and X= (X1, X2, ⋯, x) for the icase, Y= (Y1, Y2, ⋯, y) for the icontrol, a PCA-BCIT is furnished in three steps:

Step 1: Sampling

Replicate samples of cases and controls are obtained with replacement separately from (X1(, X2(, ⋯, X()and (Y1(, Y2(, ⋯, Y(), b = 1,2, ⋯, B (B = 1000).

Step 2: PCA

For each replicate sample obtained at Step 1, PCA is conducted and a given number of PCs retained with a threshold of 80% explained variance for all three strategies[16], expressed as and .

Step 3: PCA-BCIT

3a) For each replicate, the mean of the kPC in cases is calculated by and that of the kPC in controls is calculated by 3b) Given confidence level (1 - α ), the confidence interval of is estimated by percentile method, with form where is the percentile of , and is the percentile. The confidence interval of is estimated by where is the percentile of , and is the percentile. 3c) Confidence intervals of cases and controls are compared. The null hypothesis is rejected if and do not overlap, which is and are statistically different[19], indicating the candidate region is significantly associated with disease at level α. Otherwise, the candidate region is not significantly associated with disease at level α.

Simulation studies

We examine the performance of PCA-BCIT through simulations with data from the North American Rheumatoid Arthritis (RA) Consortium (NARAC) (868 cases and 1194 controls)[20], taking advantage of the fact that association between protein tyrosine phosphatase non-receptor type 22 (PTPN22) and the development of RA has been established[21-24]. Nine SNPs have been selected from the PNPT22 region (114157960-114215857), and most of the SNPs are within the same LD block (Figure 1). Females are more predisposed (73.85%) and are used in our simulation to ensure homogeneity. The corresponding steps for the simulation are as follows.
Figure 1

LD (. The nine PTPN22 SNPs are rs971173, rs1217390, rs878129, rs11811771, rs11102703, rs7545038, rs1503832, rs12127377, rs11485101. The triangle marks a single LD block within this region: (rs878129, rs11811771, rs11102703, rs7545038, rs1503832, rs12127377, rs11485101).

LD (. The nine PTPN22 SNPs are rs971173, rs1217390, rs878129, rs11811771, rs11102703, rs7545038, rs1503832, rs12127377, rs11485101. The triangle marks a single LD block within this region: (rs878129, rs11811771, rs11102703, rs7545038, rs1503832, rs12127377, rs11485101). The observed genotype frequencies in the study sample are taken to be their true frequencies in populations of infinite sizes. Replicate samples of cases and controls of given size (N, N = 100, 200, ⋯, 1000) are generated whose estimated genotype frequencies are expected to be close to the true population frequencies while both the allele frequencies and LD structure are maintained. Under null hypothesis, replicate cases and controls are sampled with replacement from the controls. Under alternative hypothesis, replicate cases and controls are sampled with replacement from the cases and controls respectively.

Step 2: PCA-BCITing

For each replicate sample, PCA-BCITs are conducted through the three strategies of extracting PCs as outlined above on association between PC scores and disease (RA).

Step 3: Evaluating performance of PCA-BCITs

Repeat steps 1 and 2 for K ( K = 1000 ) times under both null and alternative hypotheses, and obtain the frequencies (P) of rejecting null hypothesis at level α (α = 0.05).

Applications

PCA-BCITs are applied to both the NARAC data on PTPN22 in 1493 females (641 cases and 852 controls) described above and a data containing nine SNPs near μ-opioid receptor gene (OPRM1) in Han Chinese from Shanghai (91 cases and 245 controls) with endophenotype of heroin-induced positive responses on first use[25]. There are two LD blocks in the region of gene OPRM1 (Figure 2).
Figure 2

LD (. The nine OPRM1 SNPs are rs1799971, rs510769, rs696522, rs1381376, rs3778151, rs2075572, rs533586, rs550014, rs658156. The triangles mark the LD block 1 (rs696522, rs1381376, rs3778151) and LD block 2 (rs550014, rs658156).

LD (. The nine OPRM1 SNPs are rs1799971, rs510769, rs696522, rs1381376, rs3778151, rs2075572, rs533586, rs550014, rs658156. The triangles mark the LD block 1 (rs696522, rs1381376, rs3778151) and LD block 2 (rs550014, rs658156).

Results

Simulation study

The performance of PCA-BCIT is shown in Table 1 for the three strategies given a range of sample sizes. It can be seen that strategies 2 and 3 both have type I error rates approaching the nominal level (α = 0.05), but those from strategy 1 deviate heavily. When sample size larger than 800, the power of PCA-BCIT is above 0.8, and strategies 2 and 3 outperform strategy 1 slightly.
Table 1

Performance of PCA-BCIT at level 0.05 with strategies 1-3†

Sample sizeType I errorPower

123123
1000.0140.0360.0370.1560.1630.176
2000.0160.0440.0360.2490.2780.292
3000.0170.0280.0290.3830.4260.368
4000.0140.040.020.5080.4850.516
5000.0090.0350.0420.6130.5950.597
6000.0060.0320.0420.6770.6620.683
7000.0070.0610.040.7330.7580.73
8000.0040.0430.0450.8010.7910.819
9000.0050.0570.0510.8260.8550.858
10000.010.0560.050.8710.9010.889

†1 case-only extracting strategy (CAES), 2 control-only extracting strategy (COES), 3 case-control extracting strategy (CES)

Performance of PCA-BCIT at level 0.05 with strategies 1-3† †1 case-only extracting strategy (CAES), 2 control-only extracting strategy (COES), 3 case-control extracting strategy (CES) For the NARAC data, Armitage trend test reveals none of the SNPs in significant association with RA using Bonferroni correction (Table 2), but the results of PCA-BCIT with strategies 2 and 3 show that the first PC extracted in region of PTPN22 is significantly associated with RA. The results are similar to that from permutation test (Table 3).
Table 2

Armitage trend test on nine PTPN22 SNPs and RA susceptibility

SNPGenotypeFemaleMale

CaseControlP-valueCasecontrolP-value
rs971173CC3343810.0251161690.779
AC23636385134
AA711062639
rs1217390AA2683190.333991120.108
AG27239289175
GG981383855
rs878129GG3385070.0091311870.384
AG25129183130
AA52541325
rs11811771AA2242720.090781110.717
AG303411104168
GG1121694562
rs11102703CC3124690.0241211740.418
AC26931490137
AA60691631
rs7545038GG3214280.6961091860.417
AG26534298114
AA52802040
rs1503832AA3244870.0131291850.249
AG26230686127
GG55591230
rs12127377AA3495210.0171391970.230
AG24328278121
GG49481024
rs11485101AA5647380.6562063050.430
AG721122135
GG5202

None of the P-values is significant after Bonferroni Correction.

Table 3

PCA-BCIT, PCA-LRT and permutation test on real data

StudyStrategy†99%CI95%CIP-value‡

PCA-LRTPermutation test
PTPN222(-5.4E-01,-4.7E-03)**(-7.5E-16,6.9E-16)(-4.8E-01,-8.6E-02)*(-4.6E-16,4.2E-16)0.006**0.002**
3(1.7E-02,3.3E-01)**(-2.5E-01,-1.3E-02)(4.9E-02,3.0E-01)*(-2.2E-01,-3.7E-02)0.007**0.002**
OPRM12(-1.2E+00,-1.1E-02)**(-4.7E-16,5.0E-16)(-1.1E+00,-1.8E-01)*(-3.7E-16,3.4E-16)0.1070.002**
3(5.3E-02,1.4E+00)**(-4.9E-01,-1.7E-02)(2.4E-01,1.2E+00)*(-4.2E-01,-8.0E-02)0.012*0.004**

†2 control-only extracting strategy (COES), 3 case-control extracting strategy (CES)

‡* significant at levels α = 0.05(*) and α = 0.01 (**).

Armitage trend test on nine PTPN22 SNPs and RA susceptibility None of the P-values is significant after Bonferroni Correction. PCA-BCIT, PCA-LRT and permutation test on real data †2 control-only extracting strategy (COES), 3 case-control extracting strategy (CES) ‡* significant at levels α = 0.05(*) and α = 0.01 (**). For the OPRM1 data, the sample characteristics are comparable between cases and controls (Table 4), and three SNPs (rs696522, rs1381376 and rs3778151) are showed significant association with the endophenotype (Table 5). The results of PCA-BCIT with strategies 2 and 3 and permutation test are all significant at level α = 0.01. In contrast, result from PCA-LRT is not significant at level α = 0.05 with strategy 2 (Table 3). The apparent separation of cases and controls are shown in Figure 3 for PCA-BCIT with strategy 3, suggesting an intuitive interpretation.
Table 4

Sample characteristics of heroin-induced positive responses on first use

Cases (N = 91)Controls (N = 245)P-value
Age (yrs)30.42 ± 7.6530.93 ± 8.180.6057
Women (%)26.429.80.5384
Age at onset (yrs)26.29 ± 7.4126.97 ± 7.890.4760
Reason for first use of heroin0.7173
Curiousness79.175.1
Peer pressure6.64.9
Physical disease7.710.2
Trouble5.56.1
Other reasons1.13.8
Table 5

Armitage trend tests on nine OPRM1 SNPs and heroin-induced positive responses on first use

SNPGenotypeCount and frequencyArmitage trend test

CasesControlsChi-squareP-value
rs1799971AA550.6041500.6220.0030.9537
AG270.297640.266
GG90.099240.112
rs510769TT560.6671670.7492.7440.0976
TC240.286530.237
CC40.04840.018
rs696522AA640.7622150.90711.0970.0009*
AG190.226210.089
GG10.01210.004
rs1381376CC700.7692210.91313.4090.0003*
CT200.220210.087
TT10.01100.000
rs3778151GG660.7332150.89614.6550.0001*
GA230.256250.104
AA10.01100.000
rs2075572GG500.5561490.6421.5740.2096
GC330.367820.353
CC70.078110.047
rs533586TT680.8402030.8680.7610.3830
TC120.148310.132
CC10.01200.000
rs550014TT780.8572030.8320.0930.7602
TC120.132410.168
CC10.01100.000
rs658156GG650.7141920.7872.0410.1531
GA240.264520.213
AA10.01100.000

* significant after Bonferroni Correction.

Figure 3

Real data analyses by . The horizontal axis denotes studies and vertical axis mean(PC1), the statistic used to calculate confidence intervals for cases and controls. PCA-BCITs with strategy 3 were significant at confidence level 0.95.

Sample characteristics of heroin-induced positive responses on first use Armitage trend tests on nine OPRM1 SNPs and heroin-induced positive responses on first use * significant after Bonferroni Correction. Real data analyses by . The horizontal axis denotes studies and vertical axis mean(PC1), the statistic used to calculate confidence intervals for cases and controls. PCA-BCITs with strategy 3 were significant at confidence level 0.95.

Discussion

In this study, a PCA-based bootstrap confidence interval test[19,26-28] (PCA-BCIT) is developed to study gene-disease association using all SNPs genotyped in a given region. There are several attractive features of PCA-based approaches. First of all, they are at least as powerful as genotype- and haplotype-based methods[7,16,17]. Secondly, they are able to capture LD information between correlated SNPs and easy to compute with needless consideration of multicollinearity and multiple testing. Thirdly, BCIT integrates point estimation and hypothesis testing as a single inferential statement of great intuitive appeal[29] and does not rely on the distributional assumption of the statistic used to calculate confidence interval[19,26-29]. While there have been several different but closely related forms of bootstrap confidence interval calculations[28], we focus on percentiles of the asymptotic distribution of PCs for given confidence levels to estimate the confidence interval. PCA-BCIT is a data-learning method[29], and shown to be valid and powerful for sufficiently large number of replicates in our study. Our investigation involving three strategies of extracting PCs reveals that strategy 1 is invalid, while strategies 2 and 3 are acceptable. From analyses of real data we find that PCA-BCIT is more favourable compared with PCA-LRT and permutation test. It is suggested that a practical advantage of PCA-BCIT is that it offers an intuitive measure of difference between cases and controls by using the set of SNPs (PC scores) in a candidate region (Figure 3). As extraction of PCs through COES is more in line with the principle of a case-control study, it will be our method of choice given that it has a comparable performance with CES. Nevertheless, PCA-BCIT has the limitation that it does not directly handle covariates as is usually done in a regression model.

Conclusions

PCA-BCIT is both a valid and a powerful PCA-based method which captures multi-SNP information in study of gene-disease association. While extracting PCs based on CAES, COES and CES all have good performances, it appears that COES is more appropriate to use.

Abbreviations

SNP: single nucleotide polymorphism; HWE: Hardy-Weinberg Equilibrium; LD: linkage disequilibrium; LRT: logistic regression test; PCA: principle component analysis; PC: principle component; ES: extracting strategy; SES: separate case and control extracting strategy (strategy 0); CAES: case-based extracting strategy (strategy 1); COES: control-based extracting strategy (strategy 2); CES: combined case and control extracting strategy (strategy 3); BCIT: bootstrap confidence interval test.

Authors' contributions

QQP, JHZ, and FZX conceptualized the study, acquired and analyzed the data and prepared for the manuscript. All authors approved the final manuscript.
  22 in total

1.  Inference on haplotype effects in case-control studies using unphased genotype data.

Authors:  Michael P Epstein; Glen A Satten
Journal:  Am J Hum Genet       Date:  2003-11-20       Impact factor: 11.025

2.  Nonparametric tests of association of multiple genes with human disease.

Authors:  Daniel J Schaid; Shannon K McDonnell; Scott J Hebbring; Julie M Cunningham; Stephen N Thibodeau
Journal:  Am J Hum Genet       Date:  2005-03-22       Impact factor: 11.025

3.  Improved power by use of a weighted score test for linkage disequilibrium mapping.

Authors:  Tao Wang; Robert C Elston
Journal:  Am J Hum Genet       Date:  2006-12-21       Impact factor: 11.025

4.  Tests and estimates of allelic association in complex inheritance.

Authors:  N E Morton; A Collins
Journal:  Proc Natl Acad Sci U S A       Date:  1998-09-15       Impact factor: 11.205

5.  Gene-gene and gene-environment interactions involving HLA-DRB1, PTPN22, and smoking in two subsets of rheumatoid arthritis.

Authors:  Henrik Kallberg; Leonid Padyukov; Robert M Plenge; Johan Ronnelid; Peter K Gregersen; Annette H M van der Helm-van Mil; Rene E M Toes; Tom W Huizinga; Lars Klareskog; Lars Alfredsson
Journal:  Am J Hum Genet       Date:  2007-04-02       Impact factor: 11.025

6.  Replication of putative candidate-gene associations with rheumatoid arthritis in >4,000 samples from North America and Sweden: association of susceptibility with PTPN22, CTLA4, and PADI4.

Authors:  Robert M Plenge; Leonid Padyukov; Elaine F Remmers; Shaun Purcell; Annette T Lee; Elizabeth W Karlson; Frederick Wolfe; Daniel L Kastner; Lars Alfredsson; David Altshuler; Peter K Gregersen; Lars Klareskog; John D Rioux
Journal:  Am J Hum Genet       Date:  2005-11-01       Impact factor: 11.025

7.  Modeling and E-M estimation of haplotype-specific relative risks from genotype data for a case-control study of unrelated individuals.

Authors:  Daniel O Stram; Celeste Leigh Pearce; Phillip Bretsky; Matthew Freedman; Joel N Hirschhorn; David Altshuler; Laurence N Kolonel; Brian E Henderson; Duncan C Thomas
Journal:  Hum Hered       Date:  2003       Impact factor: 0.444

8.  TRAF1-C5 as a risk locus for rheumatoid arthritis--a genomewide study.

Authors:  Robert M Plenge; Mark Seielstad; Leonid Padyukov; Annette T Lee; Elaine F Remmers; Bo Ding; Anthony Liew; Houman Khalili; Alamelu Chandrasekaran; Leela R L Davies; Wentian Li; Adrian K S Tan; Carine Bonnard; Rick T H Ong; Anbupalam Thalamuthu; Sven Pettersson; Chunyu Liu; Chao Tian; Wei V Chen; John P Carulli; Evan M Beckman; David Altshuler; Lars Alfredsson; Lindsey A Criswell; Christopher I Amos; Michael F Seldin; Daniel L Kastner; Lars Klareskog; Peter K Gregersen
Journal:  N Engl J Med       Date:  2007-09-05       Impact factor: 91.245

9.  A missense single-nucleotide polymorphism in a gene encoding a protein tyrosine phosphatase (PTPN22) is associated with rheumatoid arthritis.

Authors:  Ann B Begovich; Victoria E H Carlton; Lee A Honigberg; Steven J Schrodi; Anand P Chokkalingam; Heather C Alexander; Kristin G Ardlie; Qiqing Huang; Ashley M Smith; Jill M Spoerke; Marion T Conn; Monica Chang; Sheng-Yung P Chang; Randall K Saiki; Joseph J Catanese; Diane U Leong; Veronica E Garcia; Linda B McAllister; Douglas A Jeffery; Annette T Lee; Franak Batliwalla; Elaine Remmers; Lindsey A Criswell; Michael F Seldin; Daniel L Kastner; Christopher I Amos; John J Sninsky; Peter K Gregersen
Journal:  Am J Hum Genet       Date:  2004-06-18       Impact factor: 11.025

10.  Association tests based on the principal-component analysis.

Authors:  Sohee Oh; Taesung Park
Journal:  BMC Proc       Date:  2007-12-18
View more
  6 in total

1.  Gene- or region-based association study via kernel principal component analysis.

Authors:  Qingsong Gao; Yungang He; Zhongshang Yuan; Jinghua Zhao; Bingbing Zhang; Fuzhong Xue
Journal:  BMC Genet       Date:  2011-08-26       Impact factor: 2.797

2.  A machine learning-based framework to identify type 2 diabetes through electronic health records.

Authors:  Tao Zheng; Wei Xie; Liling Xu; Xiaoying He; Ya Zhang; Mingrong You; Gong Yang; You Chen
Journal:  Int J Med Inform       Date:  2016-10-01       Impact factor: 4.046

3.  SNP set association analysis for genome-wide association studies.

Authors:  Min Cai; Hui Dai; Yongyong Qiu; Yang Zhao; Ruyang Zhang; Minjie Chu; Juncheng Dai; Zhibin Hu; Hongbing Shen; Feng Chen
Journal:  PLoS One       Date:  2013-05-03       Impact factor: 3.240

4.  A latent variable partial least squares path modeling approach to regional association and polygenic effect with applications to a human obesity study.

Authors:  Fuzhong Xue; Shengxu Li; Jian'an Luan; Zhongshang Yuan; Robert N Luben; Kay-Tee Khaw; Nicholas J Wareham; Ruth J F Loos; Jing Hua Zhao
Journal:  PLoS One       Date:  2012-02-27       Impact factor: 3.240

5.  Molecular mechanical differences between isoforms of contractile actin in the presence of isoforms of smooth muscle tropomyosin.

Authors:  Lennart Hilbert; Genevieve Bates; Horia N Roman; Jenna L Blumenthal; Nedjma B Zitouni; Apolinary Sobieszek; Michael C Mackey; Anne-Marie Lauzon
Journal:  PLoS Comput Biol       Date:  2013-10-24       Impact factor: 4.475

6.  Heritability of objectively assessed daily physical activity and sedentary behavior.

Authors:  Marcel den Hoed; Søren Brage; Jing Hua Zhao; Kate Westgate; Ayrun Nessa; Ulf Ekelund; Tim D Spector; Nicholas J Wareham; Ruth J F Loos
Journal:  Am J Clin Nutr       Date:  2013-09-18       Impact factor: 7.045

  6 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.