Literature DB >> 24358113

Development and application of genomic control methods for genome-wide association studies using non-additive models.

Yakov A Tsepilov1, Janina S Ried2, Konstantin Strauch3, Harald Grallert4, Cornelia M van Duijn5, Tatiana I Axenovich1, Yurii S Aulchenko6.   

Abstract

Genome-wide association studies (GWAS) comprise a powerful tool for mapping genes of complex traits. However, an inflation of the test statistic can occur because of population substructure or cryptic relatedness, which could cause spurious associations. If information on a large number of genetic markers is available, adjusting the analysis results by using the method of genomic control (GC) is possible. GC was originally proposed to correct the Cochran-Armitage additive trend test. For non-additive models, correction has been shown to depend on allele frequencies. Therefore, usage of GC is limited to situations where allele frequencies of null markers and candidate markers are matched. In this work, we extended the capabilities of the GC method for non-additive models, which allows us to use null markers with arbitrary allele frequencies for GC. Analytical expressions for the inflation of a test statistic describing its dependency on allele frequency and several population parameters were obtained for recessive, dominant, and over-dominant models of inheritance. We proposed a method to estimate these required population parameters. Furthermore, we suggested a GC method based on approximation of the correction coefficient by a polynomial of allele frequency and described procedures to correct the genotypic (two degrees of freedom) test for cases when the model of inheritance is unknown. Statistical properties of the described methods were investigated using simulated and real data. We demonstrated that all considered methods were effective in controlling type 1 error in the presence of genetic substructure. The proposed GC methods can be applied to statistical tests for GWAS with various models of inheritance. All methods developed and tested in this work were implemented using R language as a part of the GenABEL package.

Entities:  

Mesh:

Year:  2013        PMID: 24358113      PMCID: PMC3864791          DOI: 10.1371/journal.pone.0081431

Source DB:  PubMed          Journal:  PLoS One        ISSN: 1932-6203            Impact factor:   3.240


Introduction

Genome-wide association studies (GWAS) are a powerful tool for mapping genes of complex traits. Standard statistical methods used for GWAS, such as linear regression, assume that the correlation between a phenotype and a genotypic marker exists because of the marker itself or a strong linkage disequilibrium with the causative locus. This assumption holds when the sample consists of representatives of one panmictic population. However, other correlations caused by confounding factors that influence both phenotypes and genotypes of various loci are possible. In GWAS, the genetic substructure of the studied samples is among the most important confounders. If the analysis is not accounted for confounding by population substructure, the test statistic is inflated [1], which makes its statistical interpretation difficult and may lead to false-positive findings. If information on a large number of genetic markers is available, the analysis results can be adjusted by accounting for the influence of non-specific effects by using the genomic control (GC) method. Several methods have been proposed for GC adjustment [1]–[5]. Devlin and Roeder [1] suggested the use of a correction coefficient, denoted as variance inflation factor (VIF), to correct the distribution of the test statistic. In general, the VIF has been demonstrated to be a function of marker allele frequencies and population parameters [1]. It has also been deduced that for an additive model, the VIF does not depend on allele frequency. Thus, for an additive model, the “GC inflation factor” constant, λ, can be empirically estimated from null (not associated) loci. Note, however, that for smaller allele frequencies and smaller samples asymptotic assumptions will not hold, and, consequently, the inflation of the test statistic will depend on allele frequencies even for additive model. Several estimators of the Genomic Control inflation constant λ could be used. For example, the mean test statistic is an estimator of λ, which, however, suffers from being strongly affected by outliers (e.g., from true association signals). The median estimator (λ), which is defined as ratio of the median of the observed distribution of the test statistic and 0.455 (the median of the distribution) [1], is probably the one used most. Another estimator can be defined as regression coefficient of the observed test statistic onto the statistic expected for the null loci (regression estimator λ). This estimator arises from the simple observation that the covariance between two ordered random variables one of which is distributed as and another as λ* is equal to 2*λ, while the variance of the expected distribution is 2. All of these estimators are constants that we can use as indicators of statistical bias or as coefficients allowing correction of the observed test statistic. The general formulation of the VIF [2], in principle, allows for extension of GC to dominant and recessive models. However, for the non-additive model, the VIF depends on allele frequency and a number of parameters that describe the genetic structure of the sample. Thereby, it is possible to estimate the VIF empirically (as for additive model) if the allele frequency of null loci is the same as for the test locus (specific VIF for each allele group), but in this case the number of available null markers is limited and thus limits the applicability of the GC method. An alternative way requires estimation of the population structure parameters. The methods, which infer population structure and assign individuals to populations [6] are computationally extensive. Another method for empirical VIF estimation was suggested by Zheng et al. [3] for .a two degrees of freedom (2df) model, which does not constrain the relation of phenotypes and genotypes and does not impose severe restrictions on the weight of the heterozygous genotype. This “robust GC” method was based on combining the corrected test statistics from dominant and recessive models [3]. Yet another method of correction – delta decentralization (based on centralization of the non-central chi-square) – was proposed by Gorroochurn et al [7], but was later invalidated by Dadd et. al. [8]. In this work, we aimed to develop and evaluate existing methods for GC correction of results of GWAS using non-additive (recessive, dominant, over-dominant, and 2df genotypic) models. Therefore, we concentrate on several points: formulation of VIF expressions for various models with one degree of freedom (1df) and development of VIF-based procedures for GC correction of the results of these models; estimation of model parameters describing the population substructure for VIF estimation; development of a new “polynomial” GC (PGC) method based on a polynomial approximation of the correction coefficient that can be applied for both one- and two-degree tests. All methods were tested using simulated and real data.

Results

VIF for non-additive models

We derived the VIF as function of allele frequency (p), model of inheritance (x indicates the effect of the heterozygous genotype; for recessive, additive, and dominant model, x is equal to 0, 0.5, and 1, respectively), sample size (N), and population parameters. The over-dominant model (effect of genotype is equal to 0 for homozygotes and to 1 for heterozygotes) is described separately. Population parameters include the Wright's coefficient of inbreeding F (ranging from 0 to 1) [9] and a coefficient that describes the population substructure, (), where and are numbers of representatives of each of the subpopulations in case and control samples, respectively. In reality, the mean inbreeding F takes a values of <0.01 for most populations, but can reach values of 0.04 for highly consanguineous populations [10]. The value of K/N approaches zero when the design is balanced (e.g. case:control ratio is 1∶1 in each subpopulation) and approaches its maximum of 1/2 when either cases or controls only are sampled from each subpopulation. The VIF is obtained as , where G is the marker genotype of the i-th case (G∈ {0,1,2}). and is defined as:and respectively. The derivations and detailed formulas for the VIF are provided in the Supplementary Note S1. Figure 1 presents the VIF function for a set of population parameters (F = 0.05; N = 1,000; K = 11,000). This figure shows that the VIF is independent of allele frequency only for the additive model (x = ½), which has been demonstrated previously [2]. The function is point symmetric at x = ½ - recessive model is mirror image of dominant. Also for x tending to infinity, it approaches – as expected – the function for the over-dominant model of inheritance.
Figure 1

Dependence of VIF function on allele frequency p and model parameter x (F = 0.05; N = 1,000; K = 11,000).

(A) p: {0,1}, x: {−1,2}; (B) p: {0,1}, x = 0 (R, recessive), x = 1 (D, dominant), x = 1/2 (A, additive), x = 100 (O, over-dominant).

Dependence of VIF function on allele frequency p and model parameter x (F = 0.05; N = 1,000; K = 11,000).

(A) p: {0,1}, x: {−1,2}; (B) p: {0,1}, x = 0 (R, recessive), x = 1 (D, dominant), x = 1/2 (A, additive), x = 100 (O, over-dominant). Several conclusions could be drawn from the analysis of the VIF function (Figure 1). First, the VIF of an additive model is always greater than the one of non-additive models, which we also observed in the analysis of simulated data for uncorrected tests (Table 1). Second, the application of a naive correction by a constant to the results obtained from the non-additive model GWAS can fix the “average” type 1 error to the nominal level; however, for several markers, the test will be conservative and for others, it will be liberal. For example, for the dominant model, such a ”correction” will lead to a liberal test for low frequency SNPs (single nucleotide polymorphisms) and to a conservative test for common SNPs. These results are confirmed by our simulations for constant correction tests (Table 1). Although the correction by a constant generally keeps the type 1 error rate to a pre-defined threshold, this is not true for SNPs in a particular frequency group.
Table 1

Type 1 error for one degree of freedom tests.

Not correctedConstant correctedVIFGC correctedPGC corrected
ModelFrequency λmedian λregress E λmedian λregress E λmedian λregress E λmedian λregress E
Reccessive all1.3011.3050.0861.0001.0030.0511.0001.0000.0500.9990.9990.050
[0.05,0.25)1.1751.1700.0690.9050.9000.0380.9900.9830.0481.0040.9980.049
[0.25,0.4)1.2451.2450.0790.9570.9570.0450.9950.9950.0491.0001.0000.050
[0.4,0.6)1.3201.3220.0881.0141.0150.0521.0021.0040.0510.9980.9990.050
[0.6,0.75)1.3771.3810.0951.0571.0600.0571.0061.0090.0510.9960.9990.050
[0.75,0.95]1.4121.4160.1001.0841.0870.0601.0071.0100.0510.9971.0000.050
Additive all1.4531.4580.1041.0001.0030.0510.9971.0000.0500.9911.0340.050
[0.05,0.25)1.4511.4550.1040.9981.0010.0500.9950.9980.0500.9911.0330.050
[0.25,0.4)1.4551.4600.1051.0011.0050.0510.9981.0020.0500.9911.0350.050
[0.4,0.6)1.4561.4610.1051.0021.0060.0510.9991.0020.0510.9901.0350.050
[0.6,0.75)1.4541.4580.1041.0001.0030.0510.9971.0000.0500.9901.0340.050
[0.75,0.95]1.4521.4560.1040.9991.0020.0510.9960.9980.0500.9921.0360.050
Dominant all1.3021.3060.0861.0001.0030.0510.9991.0000.0500.9991.0000.050
[0.05,0.25)1.4131.4160.0991.0841.0860.0601.0071.0090.0510.9970.9990.050
[0.25,0.4)1.3791.3830.0951.0581.0610.0571.0071.0100.0510.9971.0000.050
[0.4,0.6)1.3201.3230.0881.0131.0160.0521.0021.0040.0510.9981.0010.050
[0.6,0.75)1.2441.2450.0790.9560.9560.0450.9930.9930.0491.0001.0000.050
[0.75,0.95]1.1741.1710.0700.9030.9000.0390.9880.9840.0481.0030.9990.050
Over-dominant all1.1761.1810.0721.0001.0040.0510.9991.0000.0500.9991.0000.050
[0.05,0.25)1.2811.2820.0831.0881.0890.0611.0071.0080.0510.9960.9970.050
[0.25,0.4)1.1431.1460.0670.9720.9740.0470.9981.0000.0501.0061.0080.051
[0.4,0.6)1.0601.0580.0570.9020.9010.0390.9870.9850.0480.9910.9900.049
[0.6,0.75)1.1421.1430.0670.9710.9720.0470.9980.9990.0501.0061.0070.051
[0.75,0.95]1.2791.2820.0831.0861.0890.0601.0071.0080.0510.9960.9970.050

Type 1 error was estimated in three ways: λ, which is the ratio of observed distribution's median and expected median; λ, which is the regression coefficient between observed statistic's distribution and theoretically expected Chi-square statistic; and E, which is the proportion of the tests with p-value≤0.05. The values are given for all SNPs as well as for stratified frequency groups.

Type 1 error was estimated in three ways: λ, which is the ratio of observed distribution's median and expected median; λ, which is the regression coefficient between observed statistic's distribution and theoretically expected Chi-square statistic; and E, which is the proportion of the tests with p-value≤0.05. The values are given for all SNPs as well as for stratified frequency groups.

Estimation of VIF parameters

Methods for VIF estimation require knowledge about parameters that describe the population substructure. If these parameters, such as F and K, are not known, estimates can be utilized. Estimation is based on the idea that the distribution of the analysis test statistic should follow after correction. Thereby, estimating unknown function parameters is possible by minimizing a chosen error function that indicates the deviation of the observed distribution from the expected one. We used a sum of squared deviations of the ordered corrected statistics (Z) and the theoretically expected distribution as an error function: Note that only the population parameters F and K should be estimated, whereas N (sample size), M (number of SNPs), and p and x are defined by the data and the analysis model. This method was denoted as VIFGC.

Polynomial GC

We also propose a polynomial GC for non-additive models, which approximates the correction function via an l-degree polynomial of allele frequency p: For estimation of the coefficients , we used the same idea as with the estimation of parameters F and K in method VIFGC, that is that the corrected statistic should be distributed as . We denote this method as PGC. Empirically, we decided to use third degree polynomials during the optimization. These two refined strategies, VIFGC and PGC, were compared with the standard GC method of dividing test statistics by a constant λ. We used simulated and real data to evaluate the type 1 error and power of the methods. Type 1 error was characterized in three ways: λ, which is the ratio of the observed distribution's median and the expected median (0.455); λ, which is the regression coefficient between the observed statistic's distribution and the theoretically expected statistic; and E, which is the proportion of tests with p-value ≤ nominal level. We also characterized the type 1 error in five specific marker allele frequency groups: [0.05,0.25), [0.25,0.4), [0.4,0.6), [0.6,0.75), and [0.75,0.95].

Simulation results

Simulation details could be found in the “Materials and methods section”. Simulation results for type 1 error for 1df tests are presented in Table 1. As discussed above, constant corrected tests have significant deviations from expected values of type 1 error for several allele frequency groups for non-additive models. Unlike the constant correction method, the PGC and VIFGC methods have a type 1 error close to expected values both for all SNPs together and for specific frequency groups. Simulation results for type 1 error for 2df tests are presented in Table 2. This table shows that constant corrected tests have slightly liberal type 1 error with a behavior similar to the additive model, and the inflation does not depend on allele frequencies. The method based on 1df VIFGC-corrected tests is strongly conservative (the type 1 error is lower than the nominal level). PGC corrected tests have type 1 error levels close to the nominal level.
Table 2

Type 1 error for two degrees of freedom tests.

Not correctedConstant correcteddf1 based (VIFGC corrected)* PGC corrected
Frequency λmedian λregress E λmedian λregress E λmedian λregress E λmedian λregress E
all 1.2391.2500.0921.0001.0090.0530.9510.9570.0450.9911.0000.051
[0.05,0.25) 1.2391.2480.0911.0001.0070.0520.9590.9620.0450.9921.0000.051
[0.25,0.4) 1.2411.2520.0921.0011.0100.0530.9480.9550.0450.9911.0000.051
[0.4,0.6) 1.2401.2520.0921.0011.0100.0530.9420.9510.0440.9901.0000.051
[0.6,0.75) 1.2391.2510.0921.0001.0090.0530.9460.9550.0450.9901.0000.052
[0.75,0.95] 1.2391.2490.0921.0001.0080.0530.9590.9630.0450.9921.0000.051

The abbreviations are as in Table 1. The values are given for all SNPs as well as for stratified frequency groups.

* 2df test based on 1df corrected tests (here, 1df tests were corrected by VIFGC) [3].

The abbreviations are as in Table 1. The values are given for all SNPs as well as for stratified frequency groups. * 2df test based on 1df corrected tests (here, 1df tests were corrected by VIFGC) [3]. The power of different methods is shown in Table 3. It showed that all methods for correction including VIFGC and PGC have optimal power when the correct model (the one used in the simulations) is also used for analysis. As expected, the 2df genotypic test has less power but is robust compared with the model used for simulation.
Table 3

Power (% of test with p-value≤0.05) for different tests.

Simulated modelRecessiveAdditiveDominantOver-dominant
Analised modelradogradogradogradog
Not corrected 0.870.710.260.440.780.600.780.640.420.670.200.740.840.390.780.370.320.400.830.76
Constant corrected 0.790.590.150.430.640.480.670.580.380.620.150.630.800.350.720.310.260.330.780.60
VIF corrected * 0.800.590.160.410.620.500.660.550.380.580.150.630.800.350.680.300.260.320.770.57
PGC corrected 0.810.580.160.410.630.500.670.560.380.620.150.640.800.360.720.300.260.320.770.59

* genotypic model for VIFGC corrected tests is a two degrees of freedom test based on recessive and dominant tests corrected by VIFGC [3].

r, a, d, o, and g are recessive, additive, dominant, over-dominant, and genotypic models, respectively.

* genotypic model for VIFGC corrected tests is a two degrees of freedom test based on recessive and dominant tests corrected by VIFGC [3]. r, a, d, o, and g are recessive, additive, dominant, over-dominant, and genotypic models, respectively.

Application to real data

Real data application on two independent cohorts, namely, Cooperative Health Research in the region of Augsburg (KORA) and Erasmus Rucphen Family (ERF), provided the opportunity to test our methods in situations that are not reflected in our simulation study. In both studies, we analyzed imputed genotypes (expressed as estimated probabilities) and quantitative traits using linear regression methods. While our previous derivations and results concern binary traits, an important previous observation for the GC was that the method can be applied in the framework of quantitative trait regression analysis models as well [11]. It should be noted, that for genome-wide analyses in ERF, mixed model based methods are used [12]; here, however, we use ERF as an example of highly genetically structured population, and analyze it using fixed effects-only model. In KORA, we analyzed uric acid levels, and in ERF, levels of high-density lipoprotein (HDL) (see “Materials and Methods” section for more details). Table 4 shows the results of type 1 error analysis in ERF, a family-based study where the association is strongly confounded by the genetic structure if naïve analysis is applied. When an additive model is used without correcting for genetic structure via mixed models, λ for HDL is 1.2. For non-additive models, we reproduced the same principal findings that we obtained from simulated data by using these real data. Correction by a constant factor results in a conservative test for some frequency groups and in a liberal test for other frequency groups, whereas VIFGC and PGC corrections yield accurate levels independent of the marker allele frequency.
Table 4

Type 1 error in ERF data analysis.

Not correctedConstant correctedVIFGC corrected* PGC corrected
ModelFrequency λmedian λregress E λmedian λregress E λmedian λregress E λmedian λregress E
Recessive all1.2011.2000.0741.0001.0000.0501.0011.0000.0501.0001.0000.050
[0.05,0.25)1.1051.1090.0630.9210.9240.0420.9930.9970.0500.9981.0020.051
[0.25,0.5)1.1881.1800.0720.9890.9830.0481.0050.9990.0500.9980.9920.050
[0.5,0.75)1.2401.2520.0791.0331.0430.0551.0041.0130.0510.9961.0060.051
[0.75,0.95]1.2731.2610.0811.0611.0510.0561.0010.9910.0491.0080.9990.050
Additive all1.2981.3020.0861.0001.0030.0510.9971.0000.0500.9961.0000.050
[0.05,0.25)1.2991.2900.0851.0010.9940.0500.9980.9910.0491.0081.0000.050
[0.25,0.5)1.2981.3130.0881.0011.0120.0520.9971.0080.0520.9860.9970.050
[0.5,0.75)1.3011.3200.0881.0031.0170.0531.0001.0140.0520.9891.0030.051
[0.75,0.95]1.2921.2860.0840.9950.9910.0490.9920.9880.0491.0030.9990.050
Dominant all1.2021.2030.0741.0001.0010.0501.0001.0000.0501.0001.0000.050
[0.05,0.25)1.2771.2650.0811.0631.0530.0561.0010.9910.0491.0080.9990.050
[0.25,0.5)1.2431.2520.0791.0351.0420.0541.0031.0110.0510.9971.0050.051
[0.5,0.75)1.1901.1830.0720.9900.9850.0491.0051.0000.0500.9990.9940.050
[0.75,0.95]1.1041.1120.0640.9190.9250.0420.9910.9980.0500.9951.0020.051
Over-dominant all1.1331.1230.0641.0000.9910.0491.0111.0000.0501.0111.0000.050
[0.05,0.25)1.2031.1930.0721.0611.0530.0561.0171.0100.0511.0111.0030.050
[0.25,0.5)1.0761.0600.0570.9500.9350.0431.0110.9950.0491.0130.9980.049
[0.5,0.75)1.0641.0530.0560.9390.9290.0421.0000.9890.0491.0040.9930.049
[0.75,0.95]1.2041.1900.0721.0621.0500.0561.0171.0070.0511.0141.0040.051
Genotypic (df = 2) all1.1571.1620.0771.0001.0040.0520.9640.9660.0460.9961.0000.051
[0.05,0.25)1.1631.1590.0771.0051.0020.0520.9730.9690.0471.0041.0010.051
[0.25,0.5)1.1521.1650.0770.9961.0060.0520.9540.9640.0450.9880.9990.051
[0.5,0.75)1.1511.1640.0770.9951.0060.0520.9530.9630.0460.9891.0000.051
[0.75,0.95]1.1631.1590.0771.0051.0010.0520.9730.9700.0471.0041.0000.052

* for VIFGC corrected genotypic (2df) tests, we used the 1df based test by performing VIFGC-corrected tests for recessive and dominant models [3].

The abbreviations are as in Table 1. The values are given for all SNPs as well as for stratified frequency groups.

* for VIFGC corrected genotypic (2df) tests, we used the 1df based test by performing VIFGC-corrected tests for recessive and dominant models [3]. The abbreviations are as in Table 1. The values are given for all SNPs as well as for stratified frequency groups. Type 1 error results in KORA, a population-based study where stratification is minimal, are presented in Table 5. When an additive model is used, we observe that λ is only 1.03 for the quantitative trait uric acid. For non-additive models, where the genetic structure is close to absent in this data set, we still reproduced the same principal findings as observed in our simulations and analysis of ERF data.
Table 5

Type 1 error of KORA data tests.

Not correctedConstant correctedVIFGC corrected* PGC corrected
ModelFrequency λmedian λregress E λmedian λregress E λmedian λregress E λmedian λregress E
Recessive all1.0161.0200.0531.0001.0040.0510.9961.0000.0500.9961.0000.050
[0.05,0.25)1.0151.0160.0520.9981.0000.0501.0041.0050.0511.0001.0010.050
[0.25,0.5)1.0141.0230.0530.9981.0060.0510.9961.0050.0510.9921.0010.050
[0.5,0.75)1.0171.0210.0531.0011.0050.0510.9930.9970.0500.9930.9970.050
[0.75,0.95]1.0201.0200.0531.0041.0040.0510.9930.9930.0501.0001.0010.051
Additive all1.0191.0240.0531.0001.0050.0510.9951.0000.0500.9951.0000.050
[0.05,0.25)1.0241.0300.0531.0051.0110.0511.0001.0060.0510.9971.0030.050
[0.25,0.5)1.0201.0240.0531.0011.0040.0510.9960.9990.0500.9940.9980.050
[0.5,0.75)1.0171.0190.0520.9981.0000.0500.9930.9950.0500.9940.9960.050
[0.75,0.95]1.0161.0240.0530.9971.0050.0510.9921.0000.0500.9951.0030.051
Dominant all1.0211.0250.0531.0001.0040.0510.9961.0000.0500.9961.0000.050
[0.05,0.25)1.0241.0260.0531.0021.0050.0510.9890.9920.0490.9991.0020.050
[0.25,0.5)1.0251.0280.0541.0041.0070.0510.9950.9990.0500.9940.9980.050
[0.5,0.75)1.0151.0260.0530.9941.0050.0510.9921.0030.0500.9870.9970.050
[0.75,0.95]1.0221.0210.0531.0001.0000.0501.0071.0070.0511.0031.0020.050
Over-dominant all1.0271.0270.0531.0001.0000.0501.0001.0000.0501.0001.0000.050
[0.05,0.25)1.0271.0270.0541.0001.0010.0510.9870.9880.0490.9991.0000.050
[0.25,0.5)1.0291.0270.0531.0031.0000.0501.0161.0130.0511.0031.0010.050
[0.5,0.75)1.0281.0250.0531.0020.9980.0501.0141.0110.0511.0020.9990.050
[0.75,0.95]1.0211.0280.0540.9951.0010.0510.9820.9880.0490.9941.0000.051
Genotypic (df = 2) all1.0211.0240.0541.0001.0030.0510.9991.0020.0510.9971.0000.051
[0.05,0.25)1.0211.0220.0541.0001.0010.0510.9970.9980.0501.0001.0010.051
[0.25,0.5)1.0221.0260.0551.0011.0050.0510.9971.0010.0510.9961.0000.051
[0.5,0.75)1.0201.0240.0540.9991.0030.0510.9960.9990.0500.9940.9980.050
[0.75,0.95]1.0211.0250.0551.0001.0040.0521.0061.0090.0520.9971.0010.051

* for VIFGC corrected genotypic (2df) tests, we used the 1df based test by performing VIFGC-corrected tests for recessive and dominant models [3].

The abbreviations are as in Table 1. The values are given for all SNPs as well as for stratified frequency groups.

* for VIFGC corrected genotypic (2df) tests, we used the 1df based test by performing VIFGC-corrected tests for recessive and dominant models [3]. The abbreviations are as in Table 1. The values are given for all SNPs as well as for stratified frequency groups.

Discussion

We demonstrated by simulations and the analysis of real data that the proposed GC methods (VIFGC and PGC) could be used for the correction of non-additive test statistics in the context of GWAS assuming different models of inheritance. For additive models, widely used in GWAS, there are two applications of GC methods. Firstly, the inflation coefficient λ can be used to correct the test statistic, thereby making an interpretation of p-values statistically valid. Secondly, λ serves as an important indicator of goodness of the model used for association analysis. Although no specific threshold is available, as a rule, if the inflation of the test statistics is relatively large, this reflects the fact that the model chosen for analysis poorly accounts for the genetic structure present in the sample. In that case, the analysis model should be revised, e.g., instead of standard linear regression, the use of a such methods as structured association, EIGENSTRAT [13] or mixed models [14]–[16] should be considered. Note that even after the most advanced analysis model is used, some residual inflation may be expected. This residual inflation is usually corrected by the GC, because even minor inflation still can lead to much increased false positive rate in GWAS. For example, at λ = 1.05, when the test statistic is not corrected, the χ threshold of 29.72 (p-value = 5*10−8 in case the statistic is not inflated) corresponds to p-value = 1*10−7, that is the false positive rate is increased by more than two times. This correction is also very important when meta-analysis of multiple GWAS is performed [17] because a small residual inflation, when not corrected, can lead to very large inflation in the final meta-analysis test statistic. In our examples involving analysis of real phenotypes, the main use of GC in ERF is the use as indicator. Although nominal type I error can be achieved with the GC, GWAS should be performed with mixed models in this population, and GC should be used only to correct residual inflation. Analysis of KORA, which is a carefully designed population-based study with little stratification, provides a more realistic example of a case when the GC method should be used “directly”. Most GWAS performed up-to-date have used an additive model, and GC is an essential part of the analysis procedure. Methods for GC for non-additive models are much less developed. This obstructs correct analysis, meta-analysis, and interpretation of the results of such GWAS. Despite weaker development of the methodological base, some works reported interesting findings based on the analysis of non-additive models [18]–[21]. In this work, we proposed new and study existing methods of GC for non-additive models. We demonstrated that the VIFGC and the PGC method can be used to correct the results of GWAS obtained by using dominant, recessive, over-dominant (one degree of freedom), and genotypic (two degrees of freedom) models. We show that in general, for 1df models, both VIFGC and PGC perform equally well, whereas for the 2df model, the test based on a 1df VIFGC-corrected statistic results in a conservative test. Thus, for the genotypic model, the PGC correction may be preferred. These methods have a variance of the type 1 error in all frequency groups that is significantly less than that observed when constant correction GC is applied (p<10−20, see Table S4). It should be noted that for the PGC method we could in principle use an exponential function instead of a polynomial, but using of exponential function restricts the available models to the recessive and dominant only. Using polynomial functions eliminates restrictions for using PGC for other models, such as overdominant and the 2df genotypic ones. However, the quality of approximation comes at the costs of time whereas the correction of the additive model's results is computationally very simple, the VIFGC and PGC corrections include parameter optimization steps. Still, even PGC that requires optimization of four parameters and uses the data from 2.5 million tests finishes within minutes on a standard PC. In our methods, we estimated the parameters by using the regression loss function. This loss function is sensitive to possible heavy tails of the distribution (these may reflect real strong association signals). Therefore, we decided to use the lower 95% of the distribution, which is similar to the method suggested in [22]. Other solutions are possible by using different loss functions, which are less sensitive to outliers. Examples include loss functions defined by the sum of absolute deviations or the square root thereof and the difference between obtained and expected medians. For additive models, the GC inflation factor λ is an important indicator of goodness of the model used for association analysis. For recessive, dominant, and over-dominant models, we have demonstrated that the test inflation is always smaller than the inflation for the additive model (Figure 1). Therefore, we suggest that the use of analytical method that appropriately reflects the genetic structure of the underlying data should be decided based on λ for an additive model or based on the maximal value of the VIF function from the non-additive model. For the GC method, an important previous observation was that the method is not specific for the Cochran-Armitage test. Bacanu et. al. [11] have demonstrated earlier that the GC method can be applied in the framework of quantitative trait regression analysis models as well, including models with gene-gene interaction. We confirmed this principle by analyzing real quantitative trait in two different populations. All methods developed and tested in this work were implemented in R language in the GenABEL-package [23], part of the GenABEL project for statistical genomics (http://www.genabel.org). In summary, we proposed and tested several methods for GC for various models of inheritance and compared these methods by using real and simulated data. We demonstrated that the VIFGC and the PGC method can be successfully used in adjusting the test statistic for different non-additive models in the framework of GWAS.

Materials and Methods

ERF study

Simulations were based on real genetic data collected in the framework of the Erasmus Rucphen Family (ERF) study. All study protocols were approved by the Medical Ethics Committee of Erasmus University, and all participants gave written informed consent in accordance with the Declaration of Helsinki. The ERF study is a cross-sectional study embedded in genetically isolated population located in southwest Netherlands. The study participants are members of a single large pedigree that can be traced in 23 generations and contains thousands of cycles [24]. The sample used for simulations included 3,235 people, for whom the genotypes of 54,000 SNP markers were available. All SNPs included had a coding allele frequency (CAF) 0.05≤CAF (coded allele frequency) ≤0.95 and a call rate ≥0.95. In the example where real phenotypic data was used, we analyzed levels of high-density lipoprotein (HDL) on imputed genotypic data. This data set included 2,699 people, who were genotyped and imputed (using HapMap2 as reference panel) at 2,093,818 SNP markers. All SNPs in the subset had 0.05≤CAF≤0.95 and a call rate ≥0.95. More detailed description of phenotyping and sample can be found in [25].

KORA study

As an example of a carefully designed population-based study, we used KORA (Cooperative Health Research in the region of Augsburg) F4, which is a study from the KORA cohorts [26]. KORA F4 is a follow-up (from 2006 to 2008) of the population-based KORA S4 study that was conducted in the region of Augsburg in Southern Germany from 1999 to 2001. All study protocols were approved by the ethics committee of the Bavarian Medical Chamber (Bayerische Landesärztekammer), and all participants gave written informed consent. In our application, we analyzed levels of uric acids in a data set including 1,788 people who were genotyped with the Affymetrix 6.0 SNP array (730,525 SNP markers after quality control) with further imputation using HapMap2 (release 22) as reference panel resulting in a total of 2,210,193 SNPs. All SNPs in the study had 0.05≤CAF≤0.95 and a call rate ≥0.95. A more detailed description of study design, genotyping, and phenotyping is reported in [27].

Simulations

The phenotypes for analysis of type 1 error and the power were simulated based on real genetic data from the ERF study by using the scheme described below. We used binary traits for simulations because in our own derivation of VIF as well as in previous derivations, binary traits were used in the same way as demonstrated in [2]. Results can be generalized to quantitative traits as well [11]. Liability values were simulated as a sum of independent quantitative trait loci (QTLs) and polygenic effects. The heritability coefficient was set to be equal to a random number coming from a uniform distribution bounded by 0.5 and 0.8. To model the QTL effect, an SNP was randomly chosen. Based on its minor allele frequency (MAF), the effect was assigned in a way that the SNP was accounted for 0% of total liability variance for type 1 error and 0.35% for power simulations. To model the polygenic effect, 500 markers were randomly chosen (excluding the chromosome harboring the QTL), and based on their allele frequencies, effects were assigned in such way that each of the SNPs explained the same fraction of non-QTL heritability. The quantitative phenotype was transformed into a binary trait following a threshold model (the “case” phenotype was assigned if liability was below the threshold corresponding to 1/3 of the distribution). To study type 1 error, 1,000 simulation cycles were performed. To study the power, 100 simulation cycles were performed.

Association analysis

For the analysis of simulated and real data, we used standard tests implemented in the GWFGLS (genome-wide feasible generalized least squares) function of the MixABEL package, which is a part of the GenABEL suite of programs [23] for statistical genomics (option “score,” so the output from GWFGLS for binary traits was completely the same as for Cochran-Armitage trend test of chi-square for binary traits). GWAS were calculated for five different (additive, dominant, recessive, over-dominant, and genotypic) models of SNP effect. For quantitative trait analysis, we used regression and score test as implemented in MixABEL. For the analysis of imputed data, the regression was performed onto probabilities. GWAS results were corrected using different methods for GC. The standard method, which corrects test statistic by dividing it by the estimated λ, was applied as well as two refined methods. The qualities of the GC correction methods were compared with one another in terms of type 1 error with three characteristics: λ: ratio of distribution's median and expected median (0.455) λ: regression coefficient between statistic's distribution and theoretically expected Chi-square statistic E: proportion of the tests with p-value less then declared level (0.05). In addition to the comparison of the performance for all SNPs, five allele frequency groups were compared separately: [0.05,0.25), [0.25,0.4), [0.4,0.6), [0.6,0.75), and [0.75,0.95]. Derivation of VIF for non-additive models. (DOC) Click here for additional data file. The distribution of genotypes of biallelic markers in the “case-control” design. (DOC) Click here for additional data file. Formalization of the 1df models of inheritance using different genotype coding . (DOC) Click here for additional data file. Joint probability distribution of genotype frequencies. (DOC) Click here for additional data file. of Levene's test for homogeneity of variance between two correction methods of E* (proportion of the tests with p-value≤0.05) - in simulations for type 1 error. Var1 and Var2 – total variance of E* in all frequency groups for the first and second method, respectively. Ratio – ratio of Var1 and Var2. (DOC) Click here for additional data file.
  27 in total

1.  Delta-centralization fails to control for population stratification in genetic association studies.

Authors:  Tony Dadd; Cathryn M Lewis; Michael E Weale
Journal:  Hum Hered       Date:  2010-04-14       Impact factor: 0.444

2.  Practical aspects of imputation-driven meta-analysis of genome-wide association studies.

Authors:  Paul I W de Bakker; Manuel A R Ferreira; Xiaoming Jia; Benjamin M Neale; Soumya Raychaudhuri; Benjamin F Voight
Journal:  Hum Mol Genet       Date:  2008-10-15       Impact factor: 6.150

3.  Family-based association tests for genomewide association scans.

Authors:  Wei-Min Chen; Goncalo R Abecasis
Journal:  Am J Hum Genet       Date:  2007-09-18       Impact factor: 11.025

Review 4.  Interrogating the major histocompatibility complex with high-throughput genomics.

Authors:  Paul I W de Bakker; Soumya Raychaudhuri
Journal:  Hum Mol Genet       Date:  2012-09-12       Impact factor: 6.150

5.  ProbABEL package for genome-wide association analysis of imputed data.

Authors:  Yurii S Aulchenko; Maksim V Struchalin; Cornelia M van Duijn
Journal:  BMC Bioinformatics       Date:  2010-03-16       Impact factor: 3.169

6.  A study of the SORL1 gene in Alzheimer's disease and cognitive function.

Authors:  Fan Liu; M Arfan Ikram; A Cecile J W Janssens; Maaike Schuur; Inge de Koning; Aaron Isaacs; Maksim Struchalin; Andre G Uitterlinden; Johan T den Dunnen; Kristel Sleegers; Karolien Bettens; Christine Van Broeckhoven; John van Swieten; Albert Hofman; Ben A Oostra; Yurii S Aulchenko; Monique M B Breteler; Cornelia M van Duijn
Journal:  J Alzheimers Dis       Date:  2009       Impact factor: 4.472

7.  Genome-wide association study of sensory disturbances in the inferior alveolar nerve after bilateral sagittal split ramus osteotomy.

Authors:  Daisuke Kobayashi; Daisuke Nishizawa; Yoshito Takasaki; Shinya Kasai; Takashi Kakizawa; Kazutaka Ikeda; Ken-ichi Fukuda
Journal:  Mol Pain       Date:  2013-07-08       Impact factor: 3.395

8.  Correcting for cryptic relatedness by a regression-based genomic control method.

Authors:  Ting Yan; Bo Hou; Yaning Yang
Journal:  BMC Genet       Date:  2009-12-02       Impact factor: 2.797

9.  New genetic loci implicated in fasting glucose homeostasis and their impact on type 2 diabetes risk.

Authors:  Josée Dupuis; Claudia Langenberg; Inga Prokopenko; Richa Saxena; Nicole Soranzo; Anne U Jackson; Eleanor Wheeler; Nicole L Glazer; Nabila Bouatia-Naji; Anna L Gloyn; Cecilia M Lindgren; Reedik Mägi; Andrew P Morris; Joshua Randall; Toby Johnson; Paul Elliott; Denis Rybin; Gudmar Thorleifsson; Valgerdur Steinthorsdottir; Peter Henneman; Harald Grallert; Abbas Dehghan; Jouke Jan Hottenga; Christopher S Franklin; Pau Navarro; Kijoung Song; Anuj Goel; John R B Perry; Josephine M Egan; Taina Lajunen; Niels Grarup; Thomas Sparsø; Alex Doney; Benjamin F Voight; Heather M Stringham; Man Li; Stavroula Kanoni; Peter Shrader; Christine Cavalcanti-Proença; Meena Kumari; Lu Qi; Nicholas J Timpson; Christian Gieger; Carina Zabena; Ghislain Rocheleau; Erik Ingelsson; Ping An; Jeffrey O'Connell; Jian'an Luan; Amanda Elliott; Steven A McCarroll; Felicity Payne; Rosa Maria Roccasecca; François Pattou; Praveen Sethupathy; Kristin Ardlie; Yavuz Ariyurek; Beverley Balkau; Philip Barter; John P Beilby; Yoav Ben-Shlomo; Rafn Benediktsson; Amanda J Bennett; Sven Bergmann; Murielle Bochud; Eric Boerwinkle; Amélie Bonnefond; Lori L Bonnycastle; Knut Borch-Johnsen; Yvonne Böttcher; Eric Brunner; Suzannah J Bumpstead; Guillaume Charpentier; Yii-Der Ida Chen; Peter Chines; Robert Clarke; Lachlan J M Coin; Matthew N Cooper; Marilyn Cornelis; Gabe Crawford; Laura Crisponi; Ian N M Day; Eco J C de Geus; Jerome Delplanque; Christian Dina; Michael R Erdos; Annette C Fedson; Antje Fischer-Rosinsky; Nita G Forouhi; Caroline S Fox; Rune Frants; Maria Grazia Franzosi; Pilar Galan; Mark O Goodarzi; Jürgen Graessler; Christopher J Groves; Scott Grundy; Rhian Gwilliam; Ulf Gyllensten; Samy Hadjadj; Göran Hallmans; Naomi Hammond; Xijing Han; Anna-Liisa Hartikainen; Neelam Hassanali; Caroline Hayward; Simon C Heath; Serge Hercberg; Christian Herder; Andrew A Hicks; David R Hillman; Aroon D Hingorani; Albert Hofman; Jennie Hui; Joe Hung; Bo Isomaa; Paul R V Johnson; Torben Jørgensen; Antti Jula; Marika Kaakinen; Jaakko Kaprio; Y Antero Kesaniemi; Mika Kivimaki; Beatrice Knight; Seppo Koskinen; Peter Kovacs; Kirsten Ohm Kyvik; G Mark Lathrop; Debbie A Lawlor; Olivier Le Bacquer; Cécile Lecoeur; Yun Li; Valeriya Lyssenko; Robert Mahley; Massimo Mangino; Alisa K Manning; María Teresa Martínez-Larrad; Jarred B McAteer; Laura J McCulloch; Ruth McPherson; Christa Meisinger; David Melzer; David Meyre; Braxton D Mitchell; Mario A Morken; Sutapa Mukherjee; Silvia Naitza; Narisu Narisu; Matthew J Neville; Ben A Oostra; Marco Orrù; Ruth Pakyz; Colin N A Palmer; Giuseppe Paolisso; Cristian Pattaro; Daniel Pearson; John F Peden; Nancy L Pedersen; Markus Perola; Andreas F H Pfeiffer; Irene Pichler; Ozren Polasek; Danielle Posthuma; Simon C Potter; Anneli Pouta; Michael A Province; Bruce M Psaty; Wolfgang Rathmann; Nigel W Rayner; Kenneth Rice; Samuli Ripatti; Fernando Rivadeneira; Michael Roden; Olov Rolandsson; Annelli Sandbaek; Manjinder Sandhu; Serena Sanna; Avan Aihie Sayer; Paul Scheet; Laura J Scott; Udo Seedorf; Stephen J Sharp; Beverley Shields; Gunnar Sigurethsson; Eric J G Sijbrands; Angela Silveira; Laila Simpson; Andrew Singleton; Nicholas L Smith; Ulla Sovio; Amy Swift; Holly Syddall; Ann-Christine Syvänen; Toshiko Tanaka; Barbara Thorand; Jean Tichet; Anke Tönjes; Tiinamaija Tuomi; André G Uitterlinden; Ko Willems van Dijk; Mandy van Hoek; Dhiraj Varma; Sophie Visvikis-Siest; Veronique Vitart; Nicole Vogelzangs; Gérard Waeber; Peter J Wagner; Andrew Walley; G Bragi Walters; Kim L Ward; Hugh Watkins; Michael N Weedon; Sarah H Wild; Gonneke Willemsen; Jaqueline C M Witteman; John W G Yarnell; Eleftheria Zeggini; Diana Zelenika; Björn Zethelius; Guangju Zhai; Jing Hua Zhao; M Carola Zillikens; Ingrid B Borecki; Ruth J F Loos; Pierre Meneton; Patrik K E Magnusson; David M Nathan; Gordon H Williams; Andrew T Hattersley; Kaisa Silander; Veikko Salomaa; George Davey Smith; Stefan R Bornstein; Peter Schwarz; Joachim Spranger; Fredrik Karpe; Alan R Shuldiner; Cyrus Cooper; George V Dedoussis; Manuel Serrano-Ríos; Andrew D Morris; Lars Lind; Lyle J Palmer; Frank B Hu; Paul W Franks; Shah Ebrahim; Michael Marmot; W H Linda Kao; James S Pankow; Michael J Sampson; Johanna Kuusisto; Markku Laakso; Torben Hansen; Oluf Pedersen; Peter Paul Pramstaller; H Erich Wichmann; Thomas Illig; Igor Rudan; Alan F Wright; Michael Stumvoll; Harry Campbell; James F Wilson; Richard N Bergman; Thomas A Buchanan; Francis S Collins; Karen L Mohlke; Jaakko Tuomilehto; Timo T Valle; David Altshuler; Jerome I Rotter; David S Siscovick; Brenda W J H Penninx; Dorret I Boomsma; Panos Deloukas; Timothy D Spector; Timothy M Frayling; Luigi Ferrucci; Augustine Kong; Unnur Thorsteinsdottir; Kari Stefansson; Cornelia M van Duijn; Yurii S Aulchenko; Antonio Cao; Angelo Scuteri; David Schlessinger; Manuela Uda; Aimo Ruokonen; Marjo-Riitta Jarvelin; Dawn M Waterworth; Peter Vollenweider; Leena Peltonen; Vincent Mooser; Goncalo R Abecasis; Nicholas J Wareham; Robert Sladek; Philippe Froguel; Richard M Watanabe; James B Meigs; Leif Groop; Michael Boehnke; Mark I McCarthy; Jose C Florez; Inês Barroso
Journal:  Nat Genet       Date:  2010-01-17       Impact factor: 38.330

10.  Meta-analysis of 28,141 individuals identifies common variants within five new loci that influence uric acid concentrations.

Authors:  Melanie Kolz; Toby Johnson; Serena Sanna; Alexander Teumer; Veronique Vitart; Markus Perola; Massimo Mangino; Eva Albrecht; Chris Wallace; Martin Farrall; Asa Johansson; Dale R Nyholt; Yurii Aulchenko; Jacques S Beckmann; Sven Bergmann; Murielle Bochud; Morris Brown; Harry Campbell; John Connell; Anna Dominiczak; Georg Homuth; Claudia Lamina; Mark I McCarthy; Thomas Meitinger; Vincent Mooser; Patricia Munroe; Matthias Nauck; John Peden; Holger Prokisch; Perttu Salo; Veikko Salomaa; Nilesh J Samani; David Schlessinger; Manuela Uda; Uwe Völker; Gérard Waeber; Dawn Waterworth; Rui Wang-Sattler; Alan F Wright; Jerzy Adamski; John B Whitfield; Ulf Gyllensten; James F Wilson; Igor Rudan; Peter Pramstaller; Hugh Watkins; Angela Doering; H-Erich Wichmann; Tim D Spector; Leena Peltonen; Henry Völzke; Ramaiah Nagaraja; Peter Vollenweider; Mark Caulfield; Thomas Illig; Christian Gieger
Journal:  PLoS Genet       Date:  2009-06-05       Impact factor: 5.917

View more
  10 in total

1.  Nonadditive Effects of Genes in Human Metabolomics.

Authors:  Yakov A Tsepilov; So-Youn Shin; Nicole Soranzo; Tim D Spector; Cornelia Prehn; Jerzy Adamski; Gabi Kastenmüller; Rui Wang-Sattler; Konstantin Strauch; Christian Gieger; Yurii S Aulchenko; Janina S Ried
Journal:  Genetics       Date:  2015-05-14       Impact factor: 4.562

2.  Risk of false positive genetic associations in complex traits with underlying population structure: a case study.

Authors:  Carrie J Finno; Monica Aleman; Robert J Higgins; John E Madigan; Danika L Bannasch
Journal:  Vet J       Date:  2014-09-21       Impact factor: 2.688

3.  Genome-wide association mapping for adult resistance to powdery mildew in common wheat.

Authors:  Yichen Kang; Karen Barry; Fangbing Cao; Meixue Zhou
Journal:  Mol Biol Rep       Date:  2019-12-07       Impact factor: 2.316

4.  Genome-wide association analysis on normal hearing function identifies PCDH20 and SLC28A3 as candidates for hearing function and loss.

Authors:  Dragana Vuckovic; Sally Dawson; Deborah I Scheffer; Taina Rantanen; Anna Morgan; Mariateresa Di Stazio; Diego Vozzi; Teresa Nutile; Maria P Concas; Ginevra Biino; Lisa Nolan; Aileen Bahl; Anu Loukola; Anne Viljanen; Adrian Davis; Marina Ciullo; David P Corey; Mario Pirastu; Paolo Gasparini; Giorgia Girotto
Journal:  Hum Mol Genet       Date:  2015-07-17       Impact factor: 6.150

5.  The effect of rare variants on inflation of the test statistics in case-control analyses.

Authors:  Ailith Pirie; Angela Wood; Michael Lush; Jonathan Tyrer; Paul D P Pharoah
Journal:  BMC Bioinformatics       Date:  2015-02-20       Impact factor: 3.169

6.  Genetically defined elevated homocysteine levels do not result in widespread changes of DNA methylation in leukocytes.

Authors:  Pooja R Mandaviya; Roby Joehanes; Dylan Aïssi; Brigitte Kühnel; Riccardo E Marioni; Vinh Truong; Lisette Stolk; Marian Beekman; Marc Jan Bonder; Lude Franke; Christian Gieger; Tianxiao Huan; M Arfan Ikram; Sonja Kunze; Liming Liang; Jan Lindemans; Chunyu Liu; Allan F McRae; Michael M Mendelson; Martina Müller-Nurasyid; Annette Peters; P Eline Slagboom; John M Starr; David-Alexandre Trégouët; André G Uitterlinden; Marleen M J van Greevenbroek; Diana van Heemst; Maarten van Iterson; Philip S Wells; Chen Yao; Ian J Deary; France Gagnon; Bastiaan T Heijmans; Daniel Levy; Pierre-Emmanuel Morange; Melanie Waldenberger; Sandra G Heil; Joyce B J van Meurs
Journal:  PLoS One       Date:  2017-10-30       Impact factor: 3.240

7.  Copy number variation underlies complex phenotypes in domestic dog breeds and other canids.

Authors:  Aitor Serres-Armero; Brian W Davis; Inna S Povolotskaya; Carlos Morcillo-Suarez; Jocelyn Plassais; David Juan; Elaine A Ostrander; Tomas Marques-Bonet
Journal:  Genome Res       Date:  2021-04-16       Impact factor: 9.043

8.  Genome wide association studies using a new nonparametric model reveal the genetic architecture of 17 agronomic traits in an enlarged maize association panel.

Authors:  Ning Yang; Yanli Lu; Xiaohong Yang; Juan Huang; Yang Zhou; Farhan Ali; Weiwei Wen; Jie Liu; Jiansheng Li; Jianbing Yan
Journal:  PLoS Genet       Date:  2014-09-11       Impact factor: 5.917

9.  The GenABEL Project for statistical genomics.

Authors:  Lennart C Karssen; Cornelia M van Duijn; Yurii S Aulchenko
Journal:  F1000Res       Date:  2016-05-19

10.  Genetic dissection of bull fertility in US Jersey dairy cattle.

Authors:  F M Rezende; G O Dietsch; F Peñagaricano
Journal:  Anim Genet       Date:  2018-08-14       Impact factor: 3.169

  10 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.