Literature DB >> 28107349

Using Breast Cancer Risk Associated Polymorphisms to Identify Women for Breast Cancer Chemoprevention.

Elad Ziv1,2,3, Jeffrey A Tice1,4, Brian Sprague5, Celine M Vachon6, Steven R Cummings7, Karla Kerlikowske1,4,8.   

Abstract

BACKGROUND: Breast cancer can be prevented with selective estrogen receptor modifiers (SERMs) and aromatase inhibitors (AIs). The US Preventive Services Task Force recommends that women with a 5-year breast cancer risk ≥3% consider chemoprevention for breast cancer. More than 70 single nucleotide polymorphisms (SNPs) have been associated with breast cancer. We sought to determine how to best integrate risk information from SNPs with other risk factors to risk stratify women for chemoprevention.
METHODS: We used the risk distribution among women ages 35-69 estimated by the Breast Cancer Surveillance Consortium (BCSC) risk model. We modeled the effect of adding 70 SNPs to the BCSC model and examined how this would affect how many women are reclassified above and below the threshold for chemoprevention.
RESULTS: We found that most of the benefit of SNP testing a population is achieved by testing a modest fraction of the population. For example, if women with a 5-year BCSC risk of >2.0% are tested (~21% of all women), ~75% of the benefit of testing all women (shifting women above or below 3% 5-year risk) would be derived. If women with a 5-year risk of >1.5% are tested (~36% of all women), ~90% of the benefit of testing all women would be derived.
CONCLUSION: SNP testing is effective for reclassification of women for chemoprevention, but is unlikely to reclassify women with <1.5% 5-year risk. These results can be used to implement an efficient two-step testing approach to identify high risk women who may benefit from chemoprevention.

Entities:  

Mesh:

Year:  2017        PMID: 28107349      PMCID: PMC5249071          DOI: 10.1371/journal.pone.0168601

Source DB:  PubMed          Journal:  PLoS One        ISSN: 1932-6203            Impact factor:   3.240


Introduction

Breast cancer risk can be reduced in women with the use of selective estrogen receptor modifiers (SERMs) such as tamoxifen[1] and raloxifene [2]or with the use of aromatase inhibitors (AIs)[3]. However, these drugs can also cause significant side effects and increase the risk of adverse events such as venous thromboembolic disease in the case of SERMs or osteoporosis in the case of AIs. Thus, they are only recommended for women at elevated risk of breast cancer and, currently, they are not widely used in the prevention setting[4]. Recently, the US Preventive Services Task Force (USPSTF) issued a recommendation that women at ≥3% 5 year risk of breast cancer consider preventive therapy for breast cancer[5]. To target these preventive medications to the women most likely to benefit, physicians need to be able to estimate a woman’s risk for breast cancer[6]. A variety of models exist to risk stratify women for breast cancer including the Gail model[7], the Tyrer-Cuzick model[8] and the Breast Cancer Surveillance Consortium (BSCC) model[9]. These models combine family history, reproductive risk factors, history of benign breast disease and mammographic density to risk stratify women. Genome wide association studies have identified >80 genetic variants or single nucleotide polymorphisms (SNPs) associated with breast cancer risk[10-17]. Each variant only modestly alters breast cancer risk; however, together they add substantial risk information to current risk predictors[18]. Thus, when added to traditional risk models, a combination of genetic risk factors could be used to enhance risk stratification. As with any clinical test, genetic risk factors should only be ordered if the result is likely to affect clinical management. In the context of chemoprevention, genetic risk factors would need to either increase the risk of breast cancer above the threshold to initiate therapy, or decrease the risk substantially so that women who are above the threshold for therapy are reclassified as being below the threshold. Here we use a modeling approach to consider different strategies for joint non-genetic and genetic risk stratification for breast cancer. In particular, we simulate the combination of risk in a population of women being screened for breast cancer, starting with their BCSC model estimated risk and adding genetic information on 70 risk SNPs.

Materials and Methods

Data

We used data from the BCSC to generate the risk distributions for women, including all Caucasian women between the ages of 35–69 years who received screening mammograms and had risk factors available to calculate a BCSC 5-year risk estimate. The BCSC risk model includes age, race/ethnicity, family history of breast cancer, mammographic density and history of breast biopsy[9]. We used an upper threshold of age 69 since the benefit of tamoxifen for prevention takes several years to realize and therefore, we assumed that it is more likely to be initiated in younger women where long term benefits would be more likely to outweigh harms. We did not model the risk of women from other racial/ethnic groups since the odds ratios with the SNPs are not well-described in those populations. For each woman a 5-year risk was calculated using the BCSC model. We then categorized women in increasing categories of risk, with each category representing a 0.2% increase in 5- year risk (i.e. category 1: 0–0.2%, category 2: 0.21–0.4%,….). We calculated the fraction of women in each risk category(S1 Table). The calculation was performed for all non-Hispanic White women in the BCSC database (N = 796,294), since the odds ratios for the risk SNPs are best characterized in that population. Women estimated to have >6% 5-year risk were grouped as one category. We also calculated the risk categories for the following subsets of women: ages 35–49 and women 50–69 years; with and without family history of breast cancer; women with mammographic density considered almost entirely fatty, scattered fibroglandular densities, heterogeneously dense, and extremely dense.

SNP Selection

We selected SNPs (S2 Table) discovered by GWAS[10–12, 14–17, 19–26]. We used the allele frequencies and odds ratios for breast cancer from Caucasian populations for each SNP. To eliminate the possibility that the SNPs are giving redundant risk information, we calculated the linkage disequilibrium (LD) between SNPs that are in the same locus using LDlink[27] and dropped SNPs in linkage disequilibrium. We used a conservative threshold (R2>0.2 or D’>0.2) to minimize the possibility of bias in our risk calculation. To select SNPs among any set of SNP in LD we selected the SNP with the highest product between allele frequency and odds ratio. After removing SNPs in LD, we were left with 70 SNPs (S2 Table). The vast majority of these SNPs have previously been validated empirically to predict independently of each other[28, 29] and to be independent of the BCSC risk model[18].

Modeling Genetic Risk

Simulating genotypes

For a screening population we used the published allele frequencies in Caucasian populations. We then simulated genotypes based on the assumption that each risk allele is in Hardy Weinberg equilibrium and that the genotypes are inherited independently. To simulate the genotypes by age and other categories, we assumed independence of the genotypes and these risk factors except for family history where we explicitly modeled the expected effect of family history on the distribution of family history on genotypes (S1 Table). We simulated 10,000 individuals for each scenario.

Outline of the polygenic risk calculation score

Our approach to calculating the polygenic risk score is based on a Bayesian approach. Each woman starts with a prior probability (based on a risk model without SNPs such as the BCSC). For each genotype at each SNP we calculate the probability of having that genotype among patients with breast cancer and use that to update the probability of having breast cancer in a particular woman.

Calculating polygenic risk score

The probability of breast cancer for women with a particular genotype, Gi, can be calculated using Bayes’ Theorem as shown in[30]: Where P(D+) is the prior probability (prior to genotyping) of developing breast cancer, P(Gi) is the frequency of the particular Gi in the population and P(Gi|D+) is the probability of having a genotype Gi among breast cancer cases. A related, commonly used measure of the effect of a clinical test, the likelihood ratio (LR) associated with the genotype, can be represented as[31, 32]: For any genotype Gi genotypes then the probability of having the genotype Gi among patients with the disease state (D+) can be approximated by given a disease with relatively low prevalence (<10%). The probability of having genotype Gi among people without disease (D−) is given by where P(Gi) is the probability of the genotype in the general population, γi is the relative risk associated with that genotype and K is the prevalence of the disease. Assuming all of the SNPs are inherited independently (in linkage equilibrium) and that there are no interactions between them, then the LR for each multi-SNP genotype, Gi is the product of the likelihood ratios for the genotype, gi of each of the n SNPs. Additional details for calculating P(gi|D+) and P(gi|D-) are given in S1 File. For any person with genotype Gi, the 5 year risk of breast cancer can be estimated as: Where P(D+)i is the 5-year risk probability projected by the BCSC model for the individual. Since the relative risk associated with genotype γ is not directly measured in studies, we assume that γ is approximately equivalent to the odds ratio for breast cancer calculated from case-control studies, which is generally considered a good approximation when the prevalence of the disease is low. While the lifetime risk of disease is ~12%, the prevalence of disease in the general population remains <10%.

Modeling family history and SNPs

For family history, there is an expectation that the polygenic risk score will underlie some of the risk associated with family history. To correct for the effect of family history, we modified the calculation of risk by calculating the proportion of the risk associated with family history that is accounted for by the SNPs and accounting for that in the calculation of the posterior probability for women with a family history (see S1 File).

Assessing discrimination of the SNPs

To assess the discrimination of the SNPs together, we simulated genotypes for each of the SNPs based on the expected distribution of SNP in 5000 cases and 5000 controls (see equations in S1 File section A). We then calculated the likelihood ratios for each simulated case and control using the approach described above. We determined the receiver operating characteristic (ROC) area under the curve (AUC) All simulations and calculations were performed using Stata Version 14.

Results

Distribution of Risk by BCSC Model

Approximately 54% of the women were age 50 or older, and 11.4% had a family history of breast cancer in at least one first degree relative (Table 1). The most common category of mammographic density was scattered fibroglandular (~42% of women) followed by heterogeneously dense (41%), extremely dense (10%) and almost entirely fatty (7.5%).
Table 1

Proportion of each risk group with >3% probability of breast cancer before and after SNP testing.

% of population% of risk group >3% Risk Pre-SNP with BCSC model alone% of risk group >3% Risk with BCSC model and SNPs
All Women6.89.6
Density
Almost Entirely Fatty7.50.41.2
Scattered Fibroglandular41.82.36.4
Heterogeneously Dense41.011.413.1
Extremely Dense10.011.614.8
Ages
35–4946.00.21.5
50–6954.012.216.7
Family History
negative73.34.57.6
positive11.424.925.6
missing15.4
Of the entire screened population, 6.9% had a 5-year risk of ≥3% according to the BCSC model prior to consideration of genetic risk, qualifying them for consideration for chemoprevention from breast cancer (Table 1). The fraction of women above that risk threshold was <0.5% among women younger than age 50 and among women with almost entirely fatty breasts (Table 1). In contrast, ~11–12% of women with heterogeneously dense or extremely dense breasts are above the threshold for consideration of chemoprevention. Among women with family history of a first degree relative with breast cancer, approximately 25% of women exceed the threshold of 3% risk.

Assessment of Polygenic Risk Discrimination

We evaluated the overall discrimination of the SNPs by simulating the SNPs in cases and controls (S1 Fig). To assess the discrimination of the SNPS, we calculated polygenic risk score in simulated cases and controls and determined the receiver operating characteristic (ROC) area under the curve (AUC) for predicting case vs. control status. The ROC AUC was approximately 0.63, a value that is consistent with previous studies[28, 33].

Distribution of Risk Combining BCSC and Genotypes

We evaluated the utility of adding SNPs to the BCSC model. Overall, adding risk information from the SNPs increased the variation in predicted risk, increasing the number of women at the lowest risk and the highest risk groups (Fig 1). At the threshold of chemoprevention, adding risk information from the SNPs increased the percentage of women who are candidates for chemoprevention from 6.9 to 9.6% (Table 1). However, the SNPs tend to have a greater impact on the highest category of risk (>4.0% risk) increasing the percentage of women in this group from 2.3% to 4.7% of the population (Table 2 and Fig 1). In addition, we found that the SNPs also reclassify a substantial proportion of women below the threshold for chemoprevention. Of the women who are classified by the BCSC model alone as ≥3% risk in 5 years, 40% (2.7% of 6.8%) are reclassified below that threshold after SNP testing (Table 2).
Fig 1

Distribution of risk in the BCSC pre- and post-genetic testing.

The X-axis described the 5-year calculated probabilities for breast cancer. The Y-axis describes the fraction of the population at each interval of risk for women using just the BCSC model (yellow bars) and the BCSC model with SNPs (red bars.) The last vertical bar represents the fraction of the population with ≥ 6% risk of breast cancer in the next 5 years.

Table 2

Reclassification of risk with genetic testing.

Percentages in each cell represent the percentage of the total population. Sections shaded in lighter gray and darker gray represent the group of women reclassified above and below the threshold for chemoprevention, respectively.

Pre-SNP Testing RiskPost –SNP testing risk
<1.0%1.0–1.4%1.5–1.9%2.0–2.4%2.5–2.9%3.0–3.9%>4.0%Total
<1.0%35.4%4.5%1.4%0.3%0.1%0.1%0.0%41.7%
1.0–1.4%9.7%6.1%3.1%1.4%0.8%0.6%0.2%21.8%
1.5–1.9%3.3%4.6%3.3%2.1%1.2%0.7%0.5%15.7%
2.0–2.4%0.8%1.9%2.2%1.6%1.1%1.1%0.7%9.4%
2.5–2.9%0.2%0.6%0.8%0.7%0.6%0.9%0.8%4.6%
3.0–3.9%0.1%0.2%0.6%0.6%0.7%1.0%1.5%4.6%
>4.0%0.0%0.1%0.2%0.2%0.3%0.5%1.1%2.3%
Total49.4%18.0%11.4%6.9%4.7%4.9%4.7%

Distribution of risk in the BCSC pre- and post-genetic testing.

The X-axis described the 5-year calculated probabilities for breast cancer. The Y-axis describes the fraction of the population at each interval of risk for women using just the BCSC model (yellow bars) and the BCSC model with SNPs (red bars.) The last vertical bar represents the fraction of the population with ≥ 6% risk of breast cancer in the next 5 years.

Reclassification of risk with genetic testing.

Percentages in each cell represent the percentage of the total population. Sections shaded in lighter gray and darker gray represent the group of women reclassified above and below the threshold for chemoprevention, respectively. For all categories of risk, more women were re-classified as above the threshold of ≥3% for chemoprevention after SNP testing (Table 1). Women with no family history of breast cancer and women with mammograms that had scattered fibroglandular tissue were the most likely to be reclassified above threshold for chemoprevention. Women with a positive family history were most likely to be above the threshold before testing and were least likely to be reclassified above the threshold after testing.

Testing Strategies Using SNPs on Subsets of Women

We evaluated the application of SNP genotyping at different thresholds of risk to determine at what threshold testing may be most informative (Table 3). In general, testing women who are already above the 3% risk threshold was an efficient strategy since this group is relatively small and a large proportion of them are reclassified below the threshold for chemoprevention after SNP testing. Among women below the threshold, testing was most efficient for women near the threshold, as expected, while testing women who are far from the threshold (<1.0% BCSC model risk) yielded little additional benefit. Thus, strategies that test SNPs on a relatively modest fraction of women generally yield most of the benefit of reclassification. For example, a strategy that tests all women above a BCSC model calculated risk threshold of 2.0% 5-year risk (testing strategy 3, Table 3) would test 21% of women and yield 75% of the total reclassification from SNPs (Fig 2). A strategy that tests all women above a BCSC model calculated risk threshold of 1.5% 5-year risk (testing strategy 4, Table 3) would test 36% of women, yielding 90% of the total reclassification from SNPs (Fig 2). Finally, a testing strategy that includes all women with baseline risk of >1% would test ~58% of the entire population and yield 99% of all of the reclassification of testing the entire population.
Table 3

Strategies for adding genetic testing and yield of reclassification in terms of fraction of women tested and fraction of women reclassified.

Testing strategyRange of Pre-test probabilities testedPercent of population TestedPercent who are reclassified to >3%Percent who are reclassified to <3%
12.5–3.9% risk9.2%1.7%2.1%
2>2.5% risk11.4%1.7%2.7%
3>2% risk20.8%3.4%2.7%
4>1.5% risk36.4%4.6%2.7%
5>1% risk58.3%5.4%2.7%
6All100.0%5.5%2.7%
Fig 2

Percent of total benefit derived by SNP testing as a function of testing different percent of population.

The X-axis represents the percent of the population tested in each scenario. The Y-axis represents the percent of the benefit derived from testing for reclassification of women. The values on the Y-axis are derived from each scenario in Table 3. Light gray lines with squares represents the percent of reclassification that occurs to below the treatment threshold out of the total that can be reclassified if everyone is tested. Medium gray line with diamonds represents the percent of reclassification that occurs to above the treatment threshold. The black gray line with triangles represents the percent of any reclassification (above or below the treatment threshold) out of the total possible reclassification if everyone were tested. For example in scenario 1, 9.2% of women are tested (X-axis) and 1.7% out of a possible 5.5% (30.6%) are reclassified above the treatment threshold (first medium diamond), 2.1% out of a possible 2.7% (75.5%) are reclassified below the treatment threshold (light gray square), and 3.8% out of a total possible 8.2% (45.5%) are reclassified either above or below the treatment threshold (black triangle).

Percent of total benefit derived by SNP testing as a function of testing different percent of population.

The X-axis represents the percent of the population tested in each scenario. The Y-axis represents the percent of the benefit derived from testing for reclassification of women. The values on the Y-axis are derived from each scenario in Table 3. Light gray lines with squares represents the percent of reclassification that occurs to below the treatment threshold out of the total that can be reclassified if everyone is tested. Medium gray line with diamonds represents the percent of reclassification that occurs to above the treatment threshold. The black gray line with triangles represents the percent of any reclassification (above or below the treatment threshold) out of the total possible reclassification if everyone were tested. For example in scenario 1, 9.2% of women are tested (X-axis) and 1.7% out of a possible 5.5% (30.6%) are reclassified above the treatment threshold (first medium diamond), 2.1% out of a possible 2.7% (75.5%) are reclassified below the treatment threshold (light gray square), and 3.8% out of a total possible 8.2% (45.5%) are reclassified either above or below the treatment threshold (black triangle).

Discussion

We combined data from the BCSC with a modeling approach to examine the utility of common SNP testing for risk stratifying women in the context of making decisions about chemoprevention. We found that testing only a fraction of the women below the threshold for chemoprevention yields most of the benefit of testing all women below the threshold. In contrast, we found that testing all of the women above the threshold for chemoprevention is a useful strategy since a large fraction are reclassified below the threshold after SNP testing. Strategies that tested all women above 2.0% or above 1.5% BCSC model risk were relatively efficient and captured the majority of benefit of testing the entire population. However, the ultimate thresholds for testing will be determined by the cost of testing as well as by the potential other benefits of testing. For example, if the risk from SNPs can be used to make recommendations about age of onset of breast cancer screening and/or intensity of breast cancer screening or screening modality then SNP testing may be more useful in a larger number of women. Previous studies have also used modeling approaches to combine the risk of traditional breast cancer risk factors and genetic information. Studies of risk prediction from the first 7 SNPs identified by GWAS suggested that the risk stratification with these SNPs alone was modest[34]. An empirical study of 10 SNPs found that the SNPs were insufficient for risk stratification in the general population[35]. Subsequently, Darabi et al showed that adding 18 SNPs demonstrated substantial additional risk stratification with SNPs when they are added to risk factors from the Gail model and to mammographic density[36]. Most recently, Brentnall et al. showed that addition of 67 SNPs from GWAS increased the distribution of risk in the population[37]. Garcia-Closas et al have modeled the combination of using non-genetic factors and SNPs to predict breast cancer risk, and used it to predict impact on screening and chemoprevention[38]. They used the UK NICE guidelines which recommend women lifetime risk >30% receive chemoprevention and women with a risk 17–30% as range to consider chemoprevention. These thresholds are difficult to directly compare to our analyses with 5 year risk; however we note that overall Garcia-Closas predicted ~10% of women would be recommended for chemoprevention which is very close to our results of 9.6%. Our study differs from from Garcia-Closas et al, since we also seek to define what fraction of the population would need to be tested to derive the benefits in terms of reclassification. Our study also differs from Garcia-Closas and other previous studies since we model women with a family history separately. We use an approach that models the expectation of increased frequency of risk alleles among women with a family history and also incorporates the empirically observed attenuation of family history after accounting for the polygenic risk score. So et al have developed a different approach to incorporating family history and SNPs by determining using an assumption that genetic risk follows a normal distribution in the population [39]. Such an approach would not require any empirical data about the attenuation of family history by SNPs. While the set of common risk SNPs only account for a modest fraction of the increased risk associated with family history, as more risk variants are identified, especially less common variants with a higher relative risk, the fraction of family history explained by these SNPs will increase and this correction will become more important. Our approach was formulated around the question of chemoprevention for women with a 5 year risk of ≥3% based on the USPSTF recommendations. However, individual considerations for patients may alter that threshold. For example, for women who are older and at higher risk of thromboembolic disease, the threshold may be higher; conversely, younger women who are at lower risk for thromboembolic disease and uterine cancer, may have a better benefit to risk ratio at a lower breast cancer risk. Our modeling made an assumption of independence of the SNPs. If there are substantial interactions between the SNPs, then this approach would not be accurate. In particular, if negative interactions occur between SNPs, then this approach would overestimate risk. Conversely, if some SNPs have positive interactions, this approach would underestimate risk. Previous studies which have empirically examined interactions between SNPs for breast cancer have not identified significant interactions after adjusting for multiple hypothesis testing[28, 29]. In order to assess how our model using an independence assumption across the unlinked SNPs works in comparison to real data, we simulated cases and controls and found a receiver operating characteristic (ROC) area under the curve (AUC) of 0.63. Previous reports have found an ROC AUC for the PRS in a range of 0.61[33] to 0.68[18]. The largest study by Mavaddat et al[28], with a dataset with over 33,000 cases and 33,000 controls, found an ROC AUC of 0.62 (95% CI: 0.62–0.63), consistent with our simulations. Furthermore, Mavaddat et al specifically tested for SNP by SNP interactions and ultimately chose to use the assumption of independence across SNPs as we did. Our modeling approach cannot directly address the question of how much risk prediction improves with the addition of SNPs to traditional risk factors and mammographic density since empirical data is required to determine the overlap in model in risk prediction between SNPs and other risk factors. Vachon et al [18] have previously addressed this directly using the BCSC model and adding a polygenic risk score using 76 SNPs. They found that the polygenic risk was independent of the BCSC risk model and that adding the polygenic risk to the BCSC model improved the receiver operating characteristic area under the curve from ~0.66 to 0.69, a significant (p<0.001) improvement. They found that adding polygenic risk score to the BCSC model reclassified an additional ~10% of cases and ~10% of controls. We used the common breast cancer risk variants that have been published to date and only considered SNPs that have genome-wide significant evidence. It is likely that other SNPs may be added to this list as more fine-mapping is done at the known loci and/or more GWAS is pursued. In addition, rare variants that cannot be detected by GWAS but are being found by sequencing studies could also be added to genetic testing panels for breast cancer risk. Additional risk variants should increase the predictive power of genetic testing and would likely change the thresholds for testing that we found. However, the general principles and modeling we used should still be applicable to defining new thresholds for testing. We eliminated all SNPs with even modest linkage disequilibrium (D’>0.2) a conservative requirement. As a result, we used only 70 SNPs in our simulations, which is a bit fewer than other modeling efforts have used[38]. In practice, as fine mapping improves the causal variant/s at each locus, a more precise risk estimate can be achieved, by entering only causal variant/s at each locus and accounting for the linkage disequilibrium between them. We used the assumption that the risk SNPs are independent of each other and independent of all other factors in the BCSC model except for family history. Several of these SNPs should not be independent of mammographic density, since they are known to increase density. However, the effect of these SNPs on mammographic density is very modest; to date less than 2% of the variance of mammographic density has been explained[40]; therefore, in practice density and the SNPs included in our study can be considered nearly independent consistent with recent observations where a model using density was independent of polygenic risk[18]. We focused on breast cancer risk in Caucasian women since the information about SNPs is based on far larger sample sizes for both discovery and replication compared to other populations. Our analyses should be repeated for other racial/ethnic groups as the SNP and rare variant lists in these populations is improved. Our analyses focused on the risk of all invasive breast cancer since our approach was centered around the USPSTF recommendations, which are based on the risk for all invasive breast cancer. Therefore, we used BCSC 5-year risk, which is based on the risk of all invasive breast cancer and we used the SNP risk for any invasive breast cancer, rather than risk for specific breast cancer subtypes. However, the current chemoprevention agents reduce estrogen receptor (ER)-positive breast cancer but do not affect ER-negative breast cancer risk. In principle, the risks and benefits and risk threshold for chemoprevention could be modified to focus on ER-positive breast cancer risk. In addition, breast cancer risk models and SNP based risk stratification could also be focused on ER-positive breast cancer. However, since most breast tumors are ER-positive, SNP-based models designed for overall breast cancer perform well for ER-positive breast cancer[41]. Another assumption behind our approach is that the women who are identified as high risk by SNPs will be protected from breast cancer by chemoprevention to the same degree that women who were included in the breast cancer prevention trials. Recent data from breast cancer prevention trials re-analyzed to include SNP-based risk, suggests that SNPs can be used to find women who would benefit from chemoprevention with SERMs[41]. If women identified as high risk based on SNPs have an intrinsically different response to preventive treatments, the risk/benefits would need to be reconsidered. The decision of whether to use a risk model and to add genetic information to the model in the context of decision making about preventive therapy depends on each woman’s perception of the benefits and harms of therapy. Currently, prevention with tamoxifen or other endocrine therapies remains low. A survey of health records in 2010 estimated that over 20,000 women are taking tamoxifen for prevention in the U.S. and nearly 100,000 post-menopausal women are taking raloxifene, but noted this is a very small fraction of the women estimated to potentially benefit[4]. However, willingness to consider tamoxifen may be considerably higher with studies finding that 40–50% of women who are at risk may be willing to take the medication [42]. Thus, the low uptake may, at least in part, be due to physician lack of awareness or willingness to prescribe endocrine therapies in the preventive setting. Improved risk stratification with SNPs should lead to better selection of patients for chemoprevention and could increase physicians’ willingness to prescribe preventive therapies[43]. Risk stratification with SNPs and other genetic variants may also be useful to aid in other decisions for breast cancer prevention and screening. For example, in deciding whether to initiate mammography at age 40 or age 50. The thresholds for SNP testing we developed in this paper are only useful in the context of the USPSTF guidelines for chemoprevention; however, the approach we describe could also be used to define a testing approach with SNPs for when to initiate mammography screening and whether to use MRI using the risk threshold for those interventions. In summary, we found that testing ~21–36% of women for genetic variants would derive the vast majority of benefit in terms of identifying women for primary breast cancer risk prevention. As information on genomic risk factors becomes more readily available, individualized risk assessment integrating the genomic and non-genomic risk information for patients and clinicians should enhance risk counseling and medical decision making.

The distribution of polygenic risk scores in cases and controls.

This histogram represents the distribution of the log (base 10) of the likelihood ratios of the polygenic risk scores in 5000 simulated breast cancer cases and 5000 simulated women without breast cancer. Each case was simulated using the genotype probabilities described for breast cancer cases and for unaffected women from section A of S1 File. The likelihood ratio was then calculated as described in the methods section. We also calculated the ROC AUC for the likelihood ratio for breast cancer cases vs. unaffected women, finding an AUC of 0.63. (PDF) Click here for additional data file.

Supplementary Methods.

This file includes details of the modeling. Section A includes all of the equations for each of the conditional probabilities for each genotype used in the calculation of the likelihood ratios described in the method section. Section B includes details of the modeling of the SNPs conditional on family history. (DOCX) Click here for additional data file.

The distribution of Pre-genotyping risk.

The distribution of the percentage of women in each 5 year risk category is displayed. The 5 year risk was calculated in 796,294 women undergoing screening mammography using the Breast Cancer Surveillance Consortium. The risk distribution is displayed separately for all women (first column) and for subsets of the population by different risk factors. These risk distributions were used to simulate the pre- genotyping risk scores. (XLSX) Click here for additional data file.

Single nucleotide polymorphisms list.

This list includes the final list of 70 SNPs used in the modeling. (XLSX) Click here for additional data file.
  43 in total

1.  Exemestane for breast-cancer prevention in postmenopausal women.

Authors:  Paul E Goss; James N Ingle; José E Alés-Martínez; Angela M Cheung; Rowan T Chlebowski; Jean Wactawski-Wende; Anne McTiernan; John Robbins; Karen C Johnson; Lisa W Martin; Eric Winquist; Gloria E Sarto; Judy E Garber; Carol J Fabian; Pascal Pujol; Elizabeth Maunsell; Patricia Farmer; Karen A Gelmon; Dongsheng Tu; Harriet Richardson
Journal:  N Engl J Med       Date:  2011-06-04       Impact factor: 91.245

2.  Using the optimal receiver operating characteristic curve to design a predictive genetic test, exemplified with type 2 diabetes.

Authors:  Qing Lu; Robert C Elston
Journal:  Am J Hum Genet       Date:  2008-03       Impact factor: 11.025

3.  Combined associations of genetic and environmental risk factors: implications for prevention of breast cancer.

Authors:  Montserrat Garcia-Closas; Necdet Burak Gunsoy; Nilanjan Chatterjee
Journal:  J Natl Cancer Inst       Date:  2014-11-12       Impact factor: 13.506

4.  The contributions of breast density and common genetic variation to breast cancer risk.

Authors:  Celine M Vachon; V Shane Pankratz; Christopher G Scott; Lothar Haeberle; Elad Ziv; Matthew R Jensen; Kathleen R Brandt; Dana H Whaley; Janet E Olson; Katharina Heusinger; Carolin C Hack; Sebastian M Jud; Matthias W Beckmann; Ruediger Schulz-Wendtland; Jeffrey A Tice; Aaron D Norman; Julie M Cunningham; Kristen S Purrington; Douglas F Easton; Thomas A Sellers; Karla Kerlikowske; Peter A Fasching; Fergus J Couch
Journal:  J Natl Cancer Inst       Date:  2015-03-04       Impact factor: 13.506

5.  Genome-wide association study identifies a new breast cancer susceptibility locus at 6q25.1.

Authors:  Wei Zheng; Jirong Long; Yu-Tang Gao; Chun Li; Ying Zheng; Yong-Bin Xiang; Wanqing Wen; Shawn Levy; Sandra L Deming; Jonathan L Haines; Kai Gu; Alecia Malin Fair; Qiuyin Cai; Wei Lu; Xiao-Ou Shu
Journal:  Nat Genet       Date:  2009-02-15       Impact factor: 38.330

6.  A meta-analysis of genome-wide association studies of breast cancer identifies two novel susceptibility loci at 6q14 and 20q11.

Authors:  Afshan Siddiq; Fergus J Couch; Gary K Chen; Sara Lindström; Diana Eccles; Robert C Millikan; Kyriaki Michailidou; Daniel O Stram; Lars Beckmann; Suhn Kyong Rhie; Christine B Ambrosone; Kristiina Aittomäki; Pilar Amiano; Carmel Apicella; Laura Baglietto; Elisa V Bandera; Matthias W Beckmann; Christine D Berg; Leslie Bernstein; Carl Blomqvist; Hiltrud Brauch; Louise Brinton; Quang M Bui; Julie E Buring; Saundra S Buys; Daniele Campa; Jane E Carpenter; Daniel I Chasman; Jenny Chang-Claude; Constance Chen; Françoise Clavel-Chapelon; Angela Cox; Simon S Cross; Kamila Czene; Sandra L Deming; Robert B Diasio; W Ryan Diver; Alison M Dunning; Lorraine Durcan; Arif B Ekici; Peter A Fasching; Heather Spencer Feigelson; Laura Fejerman; Jonine D Figueroa; Olivia Fletcher; Dieter Flesch-Janys; Mia M Gaudet; Susan M Gerty; Jorge L Rodriguez-Gil; Graham G Giles; Carla H van Gils; Andrew K Godwin; Nikki Graham; Dario Greco; Per Hall; Susan E Hankinson; Arndt Hartmann; Rebecca Hein; Judith Heinz; Robert N Hoover; John L Hopper; Jennifer J Hu; Scott Huntsman; Sue A Ingles; Astrid Irwanto; Claudine Isaacs; Kevin B Jacobs; Esther M John; Christina Justenhoven; Rudolf Kaaks; Laurence N Kolonel; Gerhard A Coetzee; Mark Lathrop; Loic Le Marchand; Adam M Lee; I-Min Lee; Timothy Lesnick; Peter Lichtner; Jianjun Liu; Eiliv Lund; Enes Makalic; Nicholas G Martin; Catriona A McLean; Hanne Meijers-Heijboer; Alfons Meindl; Penelope Miron; Kristine R Monroe; Grant W Montgomery; Bertram Müller-Myhsok; Stefan Nickels; Sarah J Nyante; Curtis Olswold; Kim Overvad; Domenico Palli; Daniel J Park; Julie R Palmer; Harsh Pathak; Julian Peto; Paul Pharoah; Nazneen Rahman; Fernando Rivadeneira; Daniel F Schmidt; Rita K Schmutzler; Susan Slager; Melissa C Southey; Kristen N Stevens; Hans-Peter Sinn; Michael F Press; Eric Ross; Elio Riboli; Paul M Ridker; Fredrick R Schumacher; Gianluca Severi; Isabel Dos Santos Silva; Jennifer Stone; Malin Sund; William J Tapper; Michael J Thun; Ruth C Travis; Clare Turnbull; Andre G Uitterlinden; Quinten Waisfisz; Xianshu Wang; Zhaoming Wang; Joellen Weaver; Rüdiger Schulz-Wendtland; Lynne R Wilkens; David Van Den Berg; Wei Zheng; Regina G Ziegler; Elad Ziv; Heli Nevanlinna; Douglas F Easton; David J Hunter; Brian E Henderson; Stephen J Chanock; Montserrat Garcia-Closas; Peter Kraft; Christopher A Haiman; Celine M Vachon
Journal:  Hum Mol Genet       Date:  2012-09-13       Impact factor: 6.150

7.  Prediction of breast cancer risk based on profiling with common genetic variants.

Authors:  Nasim Mavaddat; Paul D P Pharoah; Kyriaki Michailidou; Jonathan Tyrer; Mark N Brook; Manjeet K Bolla; Qin Wang; Joe Dennis; Alison M Dunning; Mitul Shah; Robert Luben; Judith Brown; Stig E Bojesen; Børge G Nordestgaard; Sune F Nielsen; Henrik Flyger; Kamila Czene; Hatef Darabi; Mikael Eriksson; Julian Peto; Isabel Dos-Santos-Silva; Frank Dudbridge; Nichola Johnson; Marjanka K Schmidt; Annegien Broeks; Senno Verhoef; Emiel J Rutgers; Anthony Swerdlow; Alan Ashworth; Nick Orr; Minouk J Schoemaker; Jonine Figueroa; Stephen J Chanock; Louise Brinton; Jolanta Lissowska; Fergus J Couch; Janet E Olson; Celine Vachon; Vernon S Pankratz; Diether Lambrechts; Hans Wildiers; Chantal Van Ongeval; Erik van Limbergen; Vessela Kristensen; Grethe Grenaker Alnæs; Silje Nord; Anne-Lise Borresen-Dale; Heli Nevanlinna; Taru A Muranen; Kristiina Aittomäki; Carl Blomqvist; Jenny Chang-Claude; Anja Rudolph; Petra Seibold; Dieter Flesch-Janys; Peter A Fasching; Lothar Haeberle; Arif B Ekici; Matthias W Beckmann; Barbara Burwinkel; Frederik Marme; Andreas Schneeweiss; Christof Sohn; Amy Trentham-Dietz; Polly Newcomb; Linda Titus; Kathleen M Egan; David J Hunter; Sara Lindstrom; Rulla M Tamimi; Peter Kraft; Nazneen Rahman; Clare Turnbull; Anthony Renwick; Sheila Seal; Jingmei Li; Jianjun Liu; Keith Humphreys; Javier Benitez; M Pilar Zamora; Jose Ignacio Arias Perez; Primitiva Menéndez; Anna Jakubowska; Jan Lubinski; Katarzyna Jaworska-Bieniek; Katarzyna Durda; Natalia V Bogdanova; Natalia N Antonenkova; Thilo Dörk; Hoda Anton-Culver; Susan L Neuhausen; Argyrios Ziogas; Leslie Bernstein; Peter Devilee; Robert A E M Tollenaar; Caroline Seynaeve; Christi J van Asperen; Angela Cox; Simon S Cross; Malcolm W R Reed; Elza Khusnutdinova; Marina Bermisheva; Darya Prokofyeva; Zalina Takhirova; Alfons Meindl; Rita K Schmutzler; Christian Sutter; Rongxi Yang; Peter Schürmann; Michael Bremer; Hans Christiansen; Tjoung-Won Park-Simon; Peter Hillemanns; Pascal Guénel; Thérèse Truong; Florence Menegaux; Marie Sanchez; Paolo Radice; Paolo Peterlongo; Siranoush Manoukian; Valeria Pensotti; John L Hopper; Helen Tsimiklis; Carmel Apicella; Melissa C Southey; Hiltrud Brauch; Thomas Brüning; Yon-Dschun Ko; Alice J Sigurdson; Michele M Doody; Ute Hamann; Diana Torres; Hans-Ulrich Ulmer; Asta Försti; Elinor J Sawyer; Ian Tomlinson; Michael J Kerin; Nicola Miller; Irene L Andrulis; Julia A Knight; Gord Glendon; Anna Marie Mulligan; Georgia Chenevix-Trench; Rosemary Balleine; Graham G Giles; Roger L Milne; Catriona McLean; Annika Lindblom; Sara Margolin; Christopher A Haiman; Brian E Henderson; Fredrick Schumacher; Loic Le Marchand; Ursula Eilber; Shan Wang-Gohrke; Maartje J Hooning; Antoinette Hollestelle; Ans M W van den Ouweland; Linetta B Koppert; Jane Carpenter; Christine Clarke; Rodney Scott; Arto Mannermaa; Vesa Kataja; Veli-Matti Kosma; Jaana M Hartikainen; Hermann Brenner; Volker Arndt; Christa Stegmaier; Aida Karina Dieffenbach; Robert Winqvist; Katri Pylkäs; Arja Jukkola-Vuorinen; Mervi Grip; Kenneth Offit; Joseph Vijai; Mark Robson; Rohini Rau-Murthy; Miriam Dwek; Ruth Swann; Katherine Annie Perkins; Mark S Goldberg; France Labrèche; Martine Dumont; Diana M Eccles; William J Tapper; Sajjad Rafiq; Esther M John; Alice S Whittemore; Susan Slager; Drakoulis Yannoukakos; Amanda E Toland; Song Yao; Wei Zheng; Sandra L Halverson; Anna González-Neira; Guillermo Pita; M Rosario Alonso; Nuria Álvarez; Daniel Herrero; Daniel C Tessier; Daniel Vincent; Francois Bacot; Craig Luccarini; Caroline Baynes; Shahana Ahmed; Mel Maranian; Catherine S Healey; Jacques Simard; Per Hall; Douglas F Easton; Montserrat Garcia-Closas
Journal:  J Natl Cancer Inst       Date:  2015-04-08       Impact factor: 13.506

8.  Newly discovered breast cancer susceptibility loci on 3p24 and 17q23.2.

Authors:  Shahana Ahmed; Gilles Thomas; Maya Ghoussaini; Catherine S Healey; Manjeet K Humphreys; Radka Platte; Jonathan Morrison; Melanie Maranian; Karen A Pooley; Robert Luben; Diana Eccles; D Gareth Evans; Olivia Fletcher; Nichola Johnson; Isabel dos Santos Silva; Julian Peto; Michael R Stratton; Nazneen Rahman; Kevin Jacobs; Ross Prentice; Garnet L Anderson; Aleksandar Rajkovic; J David Curb; Regina G Ziegler; Christine D Berg; Saundra S Buys; Catherine A McCarty; Heather Spencer Feigelson; Eugenia E Calle; Michael J Thun; W Ryan Diver; Stig Bojesen; Børge G Nordestgaard; Henrik Flyger; Thilo Dörk; Peter Schürmann; Peter Hillemanns; Johann H Karstens; Natalia V Bogdanova; Natalia N Antonenkova; Iosif V Zalutsky; Marina Bermisheva; Sardana Fedorova; Elza Khusnutdinova; Daehee Kang; Keun-Young Yoo; Dong Young Noh; Sei-Hyun Ahn; Peter Devilee; Christi J van Asperen; R A E M Tollenaar; Caroline Seynaeve; Montserrat Garcia-Closas; Jolanta Lissowska; Louise Brinton; Beata Peplonska; Heli Nevanlinna; Tuomas Heikkinen; Kristiina Aittomäki; Carl Blomqvist; John L Hopper; Melissa C Southey; Letitia Smith; Amanda B Spurdle; Marjanka K Schmidt; Annegien Broeks; Richard R van Hien; Sten Cornelissen; Roger L Milne; Gloria Ribas; Anna González-Neira; Javier Benitez; Rita K Schmutzler; Barbara Burwinkel; Claus R Bartram; Alfons Meindl; Hiltrud Brauch; Christina Justenhoven; Ute Hamann; Jenny Chang-Claude; Rebecca Hein; Shan Wang-Gohrke; Annika Lindblom; Sara Margolin; Arto Mannermaa; Veli-Matti Kosma; Vesa Kataja; Janet E Olson; Xianshu Wang; Zachary Fredericksen; Graham G Giles; Gianluca Severi; Laura Baglietto; Dallas R English; Susan E Hankinson; David G Cox; Peter Kraft; Lars J Vatten; Kristian Hveem; Merethe Kumle; Alice Sigurdson; Michele Doody; Parveen Bhatti; Bruce H Alexander; Maartje J Hooning; Ans M W van den Ouweland; Rogier A Oldenburg; Mieke Schutte; Per Hall; Kamila Czene; Jianjun Liu; Yuqing Li; Angela Cox; Graeme Elliott; Ian Brock; Malcolm W R Reed; Chen-Yang Shen; Jyh-Cherng Yu; Giu-Cheng Hsu; Shou-Tung Chen; Hoda Anton-Culver; Argyrios Ziogas; Irene L Andrulis; Julia A Knight; Jonathan Beesley; Ellen L Goode; Fergus Couch; Georgia Chenevix-Trench; Robert N Hoover; Bruce A J Ponder; David J Hunter; Paul D P Pharoah; Alison M Dunning; Stephen J Chanock; Douglas F Easton
Journal:  Nat Genet       Date:  2009-03-29       Impact factor: 38.330

9.  Genome-wide association study identifies novel breast cancer susceptibility loci.

Authors:  Douglas F Easton; Karen A Pooley; Alison M Dunning; Paul D P Pharoah; Deborah Thompson; Dennis G Ballinger; Jeffery P Struewing; Jonathan Morrison; Helen Field; Robert Luben; Nicholas Wareham; Shahana Ahmed; Catherine S Healey; Richard Bowman; Kerstin B Meyer; Christopher A Haiman; Laurence K Kolonel; Brian E Henderson; Loic Le Marchand; Paul Brennan; Suleeporn Sangrajrang; Valerie Gaborieau; Fabrice Odefrey; Chen-Yang Shen; Pei-Ei Wu; Hui-Chun Wang; Diana Eccles; D Gareth Evans; Julian Peto; Olivia Fletcher; Nichola Johnson; Sheila Seal; Michael R Stratton; Nazneen Rahman; Georgia Chenevix-Trench; Stig E Bojesen; Børge G Nordestgaard; Christen K Axelsson; Montserrat Garcia-Closas; Louise Brinton; Stephen Chanock; Jolanta Lissowska; Beata Peplonska; Heli Nevanlinna; Rainer Fagerholm; Hannaleena Eerola; Daehee Kang; Keun-Young Yoo; Dong-Young Noh; Sei-Hyun Ahn; David J Hunter; Susan E Hankinson; David G Cox; Per Hall; Sara Wedren; Jianjun Liu; Yen-Ling Low; Natalia Bogdanova; Peter Schürmann; Thilo Dörk; Rob A E M Tollenaar; Catharina E Jacobi; Peter Devilee; Jan G M Klijn; Alice J Sigurdson; Michele M Doody; Bruce H Alexander; Jinghui Zhang; Angela Cox; Ian W Brock; Gordon MacPherson; Malcolm W R Reed; Fergus J Couch; Ellen L Goode; Janet E Olson; Hanne Meijers-Heijboer; Ans van den Ouweland; André Uitterlinden; Fernando Rivadeneira; Roger L Milne; Gloria Ribas; Anna Gonzalez-Neira; Javier Benitez; John L Hopper; Margaret McCredie; Melissa Southey; Graham G Giles; Chris Schroen; Christina Justenhoven; Hiltrud Brauch; Ute Hamann; Yon-Dschun Ko; Amanda B Spurdle; Jonathan Beesley; Xiaoqing Chen; Arto Mannermaa; Veli-Matti Kosma; Vesa Kataja; Jaana Hartikainen; Nicholas E Day; David R Cox; Bruce A J Ponder
Journal:  Nature       Date:  2007-06-28       Impact factor: 49.962

10.  Genome-wide association analysis in East Asians identifies breast cancer susceptibility loci at 1q32.1, 5q14.3 and 15q26.1.

Authors:  Qiuyin Cai; Ben Zhang; Hyuna Sung; Siew-Kee Low; Sun-Seog Kweon; Wei Lu; Jiajun Shi; Jirong Long; Wanqing Wen; Ji-Yeob Choi; Dong-Young Noh; Chen-Yang Shen; Keitaro Matsuo; Soo-Hwang Teo; Mi Kyung Kim; Ui Soon Khoo; Motoki Iwasaki; Mikael Hartman; Atsushi Takahashi; Kyota Ashikawa; Koichi Matsuda; Min-Ho Shin; Min Ho Park; Ying Zheng; Yong-Bing Xiang; Bu-Tian Ji; Sue K Park; Pei-Ei Wu; Chia-Ni Hsiung; Hidemi Ito; Yoshio Kasuga; Peter Kang; Shivaani Mariapun; Sei Hyun Ahn; Han Sung Kang; Kelvin Y K Chan; Ellen P S Man; Hiroji Iwata; Shoichiro Tsugane; Hui Miao; Jiemin Liao; Yusuke Nakamura; Michiaki Kubo; Ryan J Delahanty; Yanfeng Zhang; Bingshan Li; Chun Li; Yu-Tang Gao; Xiao-Ou Shu; Daehee Kang; Wei Zheng
Journal:  Nat Genet       Date:  2014-07-20       Impact factor: 38.330

View more
  8 in total

1.  Breast Cancer Risk Model Requirements for Counseling, Prevention, and Screening.

Authors:  Mitchell H Gail; Ruth M Pfeiffer
Journal:  J Natl Cancer Inst       Date:  2018-09-01       Impact factor: 13.506

2.  Combining quantitative and qualitative breast density measures to assess breast cancer risk.

Authors:  Karla Kerlikowske; Lin Ma; Christopher G Scott; Amir P Mahmoudzadeh; Matthew R Jensen; Brian L Sprague; Louise M Henderson; V Shane Pankratz; Steven R Cummings; Diana L Miglioretti; Celine M Vachon; John A Shepherd
Journal:  Breast Cancer Res       Date:  2017-08-22       Impact factor: 6.466

3.  A Polygenic Risk Score for Breast Cancer in US Latinas and Latin American Women.

Authors:  Yiwey Shieh; Laura Fejerman; Paul C Lott; Katie Marker; Sarah D Sawyer; Donglei Hu; Scott Huntsman; Javier Torres; Magdalena Echeverry; Mabel E Bohórquez; Juan Carlos Martínez-Chéquer; Guadalupe Polanco-Echeverry; Ana P Estrada-Flórez; Christopher A Haiman; Esther M John; Lawrence H Kushi; Gabriela Torres-Mejía; Tatianna Vidaurre; Jeffrey N Weitzel; Sandro Casavilca Zambrano; Luis G Carvajal-Carmona; Elad Ziv; Susan L Neuhausen
Journal:  J Natl Cancer Inst       Date:  2020-06-01       Impact factor: 13.506

4.  Is risk-stratified breast cancer screening economically efficient in Germany?

Authors:  Matthias Arnold; Katharina Pfeifer; Anne S Quante
Journal:  PLoS One       Date:  2019-05-23       Impact factor: 3.240

5.  Towards a more precise and individualized assessment of breast cancer risk.

Authors:  Marie E Wood; Nicholas H Farina; Thomas P Ahern; Melissa E Cuke; Janet L Stein; Gary S Stein; Jane B Lian
Journal:  Aging (Albany NY)       Date:  2019-02-20       Impact factor: 5.682

6.  Copy number alterations associated with clinical features in an underrepresented population with breast cancer.

Authors:  Raquel M Rodrigues-Peres; Benilton de S Carvalho; Meenakshi Anurag; Jonathan T Lei; Livia Conz; Rodrigo Gonçalves; Cássio Cardoso Filho; Susana Ramalho; Geisilene R de Paiva; Sophie F M Derchain; Iscia Lopes-Cendes; Matthew J Ellis; Luis O Sarian
Journal:  Mol Genet Genomic Med       Date:  2019-05-16       Impact factor: 2.183

7.  Feasibility of personalized screening and prevention recommendations in the general population through breast cancer risk assessment: results from a dedicated risk clinic.

Authors:  Mahasti Saghatchian; Marc Abehsera; Amina Yamgnane; Caroline Geyl; Emilien Gauthier; Valérie Hélin; Matéo Bazire; Laure Villoing-Gaudé; Cécile Reyes; David Gentien; Lisa Golmard; Dominique Stoppa-Lyonnet
Journal:  Breast Cancer Res Treat       Date:  2022-01-07       Impact factor: 4.624

8.  Mammography screening and mortality by risk status in the California teachers study.

Authors:  Hannah Lui Park; Jenny Chang; Vikram Haridass; Sophia S Wang; Argyrios Ziogas; Hoda Anton-Culver
Journal:  BMC Cancer       Date:  2021-12-18       Impact factor: 4.430

  8 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.