Literature DB >> 35027648

Polygenic risk modeling for prediction of epithelial ovarian cancer risk.

Eileen O Dareng1, Jonathan P Tyrer2, Daniel R Barnes1, Michelle R Jones3, Xin Yang1, Katja K H Aben4,5, Muriel A Adank6, Simona Agata7, Irene L Andrulis8,9, Hoda Anton-Culver10, Natalia N Antonenkova11, Gerasimos Aravantinos12, Banu K Arun13, Annelie Augustinsson14, Judith Balmaña15,16, Elisa V Bandera17, Rosa B Barkardottir18,19, Daniel Barrowdale1, Matthias W Beckmann20, Alicia Beeghly-Fadiel21, Javier Benitez22,23, Marina Bermisheva24, Marcus Q Bernardini25, Line Bjorge26,27, Amanda Black28, Natalia V Bogdanova11,29,30, Bernardo Bonanni31, Ake Borg32, James D Brenton33, Agnieszka Budzilowska34, Ralf Butzow35, Saundra S Buys36, Hui Cai21, Maria A Caligo37, Ian Campbell38,39, Rikki Cannioto40, Hayley Cassingham41, Jenny Chang-Claude42,43, Stephen J Chanock44, Kexin Chen45, Yoke-Eng Chiew46,47, Wendy K Chung48, Kathleen B M Claes49, Sarah Colonna36, Linda S Cook50,51, Fergus J Couch52, Mary B Daly53, Fanny Dao54, Eleanor Davies55, Miguel de la Hoya56, Robin de Putter49, Joe Dennis1, Allison DePersia57,58, Peter Devilee59,60, Orland Diez61,62, Yuan Chun Ding63, Jennifer A Doherty64, Susan M Domchek65, Thilo Dörk30, Andreas du Bois66,67, Matthias Dürst68, Diana M Eccles69, Heather A Eliassen70,71, Christoph Engel72,73, Gareth D Evans74,75, Peter A Fasching20,76, James M Flanagan77, Renée T Fortner42, Eva Machackova78, Eitan Friedman79,80, Patricia A Ganz81, Judy Garber82, Francesca Gensini83, Graham G Giles84,85,86, Gord Glendon8, Andrew K Godwin87, Marc T Goodman88, Mark H Greene89, Jacek Gronwald90, Eric Hahnen91,92, Christopher A Haiman93, Niclas Håkansson94, Ute Hamann95, Thomas V O Hansen96, Holly R Harris97,98, Mikael Hartman99,100, Florian Heitz66,67,101, Michelle A T Hildebrandt102, Estrid Høgdall103,104, Claus K Høgdall105, John L Hopper85, Ruea-Yea Huang106, Chad Huff102, Peter J Hulick57,58, David G Huntsman107,108,109,110, Evgeny N Imyanitov111, Claudine Isaacs112, Anna Jakubowska90,113, Paul A James39,114, Ramunas Janavicius115,116, Allan Jensen103, Oskar Th Johannsson117, Esther M John118,119, Michael E Jones120, Daehee Kang121,122,123, Beth Y Karlan124, Anthony Karnezis125, Linda E Kelemen126, Elza Khusnutdinova24,127, Lambertus A Kiemeney4, Byoung-Gie Kim128, Susanne K Kjaer103,105, Ian Komenaka129, Jolanta Kupryjanczyk34, Allison W Kurian118,119, Ava Kwong130,131,132, Diether Lambrechts133,134, Melissa C Larson135, Conxi Lazaro136, Nhu D Le137, Goska Leslie1, Jenny Lester124, Fabienne Lesueur138,139,140, Douglas A Levine54,141, Lian Li45, Jingmei Li142, Jennifer T Loud89, Karen H Lu143, Jan Lubiński90, Phuong L Mai144, Siranoush Manoukian145, Jeffrey R Marks146, Rayna Kim Matsuno147, Keitaro Matsuo148,149, Taymaa May25, Lesley McGuffog1, John R McLaughlin150, Iain A McNeish151,152, Noura Mebirouk138,139,140, Usha Menon153, Austin Miller154, Roger L Milne84,85,86, Albina Minlikeeva155, Francesmary Modugno156,157, Marco Montagna7, Kirsten B Moysich155, Elizabeth Munro158,159, Katherine L Nathanson65, Susan L Neuhausen63, Heli Nevanlinna160, Joanne Ngeow Yuen Yie161,162, Henriette Roed Nielsen163, Finn C Nielsen96, Liene Nikitina-Zake164, Kunle Odunsi165, Kenneth Offit166,167, Edith Olah168, Siel Olbrecht169, Olufunmilayo I Olopade170, Sara H Olson171, Håkan Olsson14, Ana Osorio23,172, Laura Papi83, Sue K Park121,122,123, Michael T Parsons173, Harsha Pathak87, Inge Sokilde Pedersen174,175,176, Ana Peixoto177, Tanja Pejovic158,159, Pedro Perez-Segura56, Jennifer B Permuth178, Beth Peshkin112, Paolo Peterlongo179, Anna Piskorz33, Darya Prokofyeva180, Paolo Radice181, Johanna Rantala182, Marjorie J Riggan183, Harvey A Risch184, Cristina Rodriguez-Antona22,23, Eric Ross185, Mary Anne Rossing97,98, Ingo Runnebaum68, Dale P Sandler186, Marta Santamariña172,187,188, Penny Soucy189, Rita K Schmutzler91,92,190, V Wendy Setiawan93, Kang Shan191, Weiva Sieh192,193, Jacques Simard194, Christian F Singer195, Anna P Sokolenko111, Honglin Song196, Melissa C Southey84,86,197, Helen Steed198, Dominique Stoppa-Lyonnet199,200,201, Rebecca Sutphen202, Anthony J Swerdlow120,203, Yen Yen Tan195, Manuel R Teixeira177,204, Soo Hwang Teo205,206, Kathryn L Terry70,207, Mary Beth Terry208, Mads Thomassen163, Pamela J Thompson88, Liv Cecilie Vestrheim Thomsen26,27, Darcy L Thull209, Marc Tischkowitz210,211, Linda Titus212, Amanda E Toland213, Diana Torres95,214, Britton Trabert28, Ruth Travis215, Nadine Tung216, Shelley S Tworoger70,178, Ellen Valen26,27, Anne M van Altena4, Annemieke H van der Hout217, Els Van Nieuwenhuysen169, Elizabeth J van Rensburg218, Ana Vega172,219,220, Digna Velez Edwards221, Robert A Vierkant135, Frances Wang222,223, Barbara Wappenschmidt91,92, Penelope M Webb224, Clarice R Weinberg225, Jeffrey N Weitzel226, Nicolas Wentzensen28, Emily White98,227, Alice S Whittemore118,228, Stacey J Winham135, Alicja Wolk94,229, Yin-Ling Woo230, Anna H Wu93, Li Yan231, Drakoulis Yannoukakos232, Katia M Zavaglia37, Wei Zheng21, Argyrios Ziogas10, Kristin K Zorn144, Zdenek Kleibl233, Douglas Easton1,2, Kate Lawrenson3,234, Anna DeFazio46,47, Thomas A Sellers235, Susan J Ramus236,237, Celeste L Pearce238,239, Alvaro N Monteiro178, Julie Cunningham240, Ellen L Goode240, Joellen M Schildkraut241, Andrew Berchuck183, Georgia Chenevix-Trench173, Simon A Gayther3, Antonis C Antoniou1, Paul D P Pharoah242,243.   

Abstract

Polygenic risk scores (PRS) for epithelial ovarian cancer (EOC) have the potential to improve risk stratification. Joint estimation of Single Nucleotide Polymorphism (SNP) effects in models could improve predictive performance over standard approaches of PRS construction. Here, we implemented computationally efficient, penalized, logistic regression models (lasso, elastic net, stepwise) to individual level genotype data and a Bayesian framework with continuous shrinkage, "select and shrink for summary statistics" (S4), to summary level data for epithelial non-mucinous ovarian cancer risk prediction. We developed the models in a dataset consisting of 23,564 non-mucinous EOC cases and 40,138 controls participating in the Ovarian Cancer Association Consortium (OCAC) and validated the best models in three populations of different ancestries: prospective data from 198,101 women of European ancestries; 7,669 women of East Asian ancestries; 1,072 women of African ancestries, and in 18,915 BRCA1 and 12,337 BRCA2 pathogenic variant carriers of European ancestries. In the external validation data, the model with the strongest association for non-mucinous EOC risk derived from the OCAC model development data was the S4 model (27,240 SNPs) with odds ratios (OR) of 1.38 (95% CI: 1.28-1.48, AUC: 0.588) per unit standard deviation, in women of European ancestries; 1.14 (95% CI: 1.08-1.19, AUC: 0.538) in women of East Asian ancestries; 1.38 (95% CI: 1.21-1.58, AUC: 0.593) in women of African ancestries; hazard ratios of 1.36 (95% CI: 1.29-1.43, AUC: 0.592) in BRCA1 pathogenic variant carriers and 1.49 (95% CI: 1.35-1.64, AUC: 0.624) in BRCA2 pathogenic variant carriers. Incorporation of the S4 PRS in risk prediction models for ovarian cancer may have clinical utility in ovarian cancer prevention programs.
© 2021. The Author(s).

Entities:  

Mesh:

Year:  2022        PMID: 35027648      PMCID: PMC8904525          DOI: 10.1038/s41431-021-00987-7

Source DB:  PubMed          Journal:  Eur J Hum Genet        ISSN: 1018-4813            Impact factor:   5.351


Introduction

Rare variants in known high and moderate penetrance susceptibility genes (BRCA1, BRCA2, BRIP1, PALB2, RAD51C, RAD51D and the mis-match repair genes) account for about 40% of the inherited component of EOC disease risk [1, 2]. Common susceptibility variants, reviewed in Kar et al. and Jones et al., explain about 6% of the heritability of EOC [1, 3]. Polygenic risk scores (PRS) provide an opportunity for refined risk stratification in the general population and in carriers of rare moderate or high risk alleles. A PRS is calculated as the weighted sum of the number of risk alleles carried for a specified set of variants. The best approach to identify the variant set and their weights to optimize the predictive power of a PRS is unknown. A common approach involves selecting a set of variants that reach a threshold for association based on the p-value for each variant with or without pruning to remove highly correlated variants [4, 5]. More complex machine learning approaches that do not assume variant independence have also been used [6, 7], but these methods have produced only modest gains in predictive power for highly polygenic phenotypes [6, 8]. Penalized regression approaches such as the lasso, elastic net and the adaptive lasso have also been used with individual level data [9], but a major drawback is the computational burden required to fit the models [9, 10]. We present novel, computationally efficient PRS models using two approaches: (1) penalized regression models including the lasso, elastic net and minimax concave penalty (MCP) for use with individual genotype data; and (2) a Bayesian regression model with continuous shrinkage priors for use where only summary statistics are available—referred to as the “select and shrink with summary statistics” (S4) method. We compare these models with two commonly used methods, stepwise regression with p-value thresholding and LDPred.

Materials (subjects) and methods

Model development study population

EOC is a highly heterogeneous phenotype with five major histotypes for invasive disease—high-grade serous, low-grade serous, endometrioid, clear cell, and mucinous histotype. The mucinous histotype is the least common and its origin is the most controversial with up to 60% of diagnosed cases of mucinous ovarian cancer often being misdiagnosed metastasis from non-ovarian sites [11]. Therefore, in this study, we performed PRS modeling and association testing for all cases of invasive, non-mucinous EOC. We used genotype data from 23,564 invasive non-mucinous EOC cases and 40,138 controls with >80% European ancestries from 63 case-control studies included in the Ovarian Cancer Association Consortium (OCAC) for model development. The distribution of cases by histotype was high-grade serous (13,609), low-grade serous (2,749), endometrioid (2,877), clear cell (1,427), and others (2,902). Sample collection, genotyping, and quality control have been previously described [12]. Genotype data were imputed to the Haplotype Reference Consortium reference panel using 470,825 SNPs that passed quality control. Of the 32 million SNPs imputed, 10 million had imputation r2 > 0.3 and were included in this analysis.

Model validation study populations

We validated the best-fitting PRS models developed in the OCAC data in 657 prevalent and incident cases of invasive, non-mucinous EOC and 198,101 female controls of European ancestries from the UK Biobank. Samples were genotyped using either the Affymetrix UK BiLEVE Axiom Array or Affymetrix UK Biobank Axiom Array (which share 95% marker content), and then imputed to a combination of the Haplotype Reference Consortium, the 1000 Genomes phase 3 and the UK10K reference panels [13]. We restricted analysis to genetically confirmed females of European ancestries. We excluded individuals if they were outliers for heterozygosity, had low genotyping call rate <95%, had sex chromosome aneuploidy, or if they were duplicates (cryptic or intended) [12]. All SNPs selected in the model development phase were available in the UK Biobank. We investigated transferability of the best-fitting PRS models to populations of non-European ancestries using genotype data from females of East Asian and African ancestries genotyped as part of the OCAC OncoArray Project [14, 15]. Women of East Asian ancestries—2,841 non-mucinous invasive EOC and 4,828 controls—were identified using a criterion of >80% Asian ancestries. This included samples collected from studies in China, Japan, Korea, and Malaysia as well as samples collected from women of Asian ancestry in studies conducted in the US, Europe and Australia [14]. Similarly, women of African ancestries—368 cases of non-mucinous invasive EOC and 704 controls—mainly from studies conducted in the US, were identified using a criterion of >80% African ancestries as described previously [15]. We also assessed the performance of the best-fitting PRS models in women of European ancestries (>80% European ancestries) with the pathogenic BRCA1 and BRCA2 variants from the Consortium of Investigators of Modifiers of BRCA1/2 (CIMBA). We used genotype data from 18,915 BRCA1 (2,053 invasive EOC cases) and 12,337 BRCA2 (717 invasive EOC cases) pathogenic variant carriers from 63 studies contributing to CIMBA [16]. Genotyping, data quality control measures, intercontinental ancestries assessment and imputation to the HRC reference panel are as described for the OCAC study population.

Statistical analysis

Polygenic risk models

For all PRS models, we created scores as linear functions of the allele dosage in the general form where genotypes are denoted as x (taking on the minor allele dosages of 0, 1, and 2), with x representing the ith individual for the jth SNP (out of p SNPs) on an additive log scale and β represents the weight—the log of the odds ratio—of the jth SNP. We used different approaches to select and derive the optimal weights, β, in models as described below.

Penalized logistic regression models

A penalized logistic regression model for a set of SNPs aims to identify a set of regression coefficients that minimize the regularized loss function given bywhere x is the effect estimate of a SNP, λ is the tuning parameter and κ is the threshold (penalty) for different regularization paths. λ and κ are parameters that need to be chosen during model development to optimize performance. The lasso, elastic net, MCP, and p-value thresholds are instances of the function with different κ values. We minimized the winner’s curse effect on inflated effect estimates for rare SNPs by penalizing rarer SNPs more heavily than common SNPs. Details are provided in the Supplementary Methods. We used a two-stage approach to reduce computational burden without a corresponding loss in predictive power. The first stage was a SNP selection stage using a sliding windows approach, with 5.5 Mb data blocks and a 500 kb overlap between blocks. SNP selection was performed for each block and selected SNPs were collated. Single SNP association analyses were then run, and all SNPs with a χ2 test statistic of less than 2.25 were excluded. The 2.25 cutoff was arbitrary and selected to maximize computational efficiency without loss in predictive power. Penalized regression models were applied to the remaining SNPs using λ values of 3.0 and κ values of 0.0, 0.2, 0.4, 0.6, 0.8 and 1.0. SNPs selected in any of these models were included in subsequent analyses. In the second stage, we fit penalized regression models to the training dataset with λ values ranging from 3.0 to 5.5 in increments of 0.1 iterated over κ values from −3.0 to 1 in increments of 0.1. The lasso model (κ = 0) for each value of λ was fitted first, to obtain a unique maximum. From the fitted maximum the κ value was changed, and the model refitted. We applied this two-stage approach with five-fold cross-validation (Fig. 1). In each iteration, the data set was split into five, with one part constituting the test data and the other four constituting the training data. The variants and their weights from the two-stage penalized logistic regression modeling in the training data were used to calculate the area under the receiver operating characteristic curve (AUC) in the test data in each iteration. AUC estimates for each combination of λ and κ were obtained. We repeated this process for each cross-validation iteration to obtain a mean AUC for each combination of λ and κ. Finally, we selected the tuning and threshold parameters from the lasso, elastic net and MCP models with the maximum mean cross-validated AUC and fitted penalized logistic regression models with these parameters to the entire OCAC dataset to obtain SNP weights for PRS scores.
Fig. 1

PRS model development using penalized regression and LDPred Bayesian approach.

Shown in the left panel is the two-stage approach with five-fold cross validation used for individual level genotype data while the right panel shows the LDPred approach used for summary level data.

PRS model development using penalized regression and LDPred Bayesian approach.

Shown in the left panel is the two-stage approach with five-fold cross validation used for individual level genotype data while the right panel shows the LDPred approach used for summary level data.

Stepwise logistic regression with variable P-value threshold

This model is a general PLR model with κ = 1. As with the other PLR models, we investigated various values for λ values (corresponding to a variable P-value threshold for including a SNP in the model). However, we observed that the implementation of this model on individual level data was more difficult than for other κ values because the model would sometimes converge to a local optimum rather than the global optimum. Therefore, we applied an approximate conditional and joint association analysis using summary level statistics correcting for estimated LD between SNPs, and utilizing  a reference panel of 5,000 individual level genotype OCAC data as described in Yang et al. [17]. Details are provided in the Supplementary Methods.

LDPred

LDPred is a Bayesian approach that shrinks the posterior mean effect size of each marker based on a point-normal prior and LD information from an external reference panel. We derived seven candidate PRSs assuming the fractions of associated variants were 0.001, 0.003, 0.01, 0.03, 0.1, 0.3, and 1.0 respectively using the default parameters as detailed in Vilhjálmsson et al. [18] and an LD reference panel of 503 samples of European ancestries from the 1000 Genomes phase 3 release with effect estimates from the OCAC model development data.

Select and shrink using summary statistics (S4)

The S4 algorithm is similar to the PRS-CS algorithm [19]—a Bayesian method that uses summary statistics and between-SNP correlation data from a reference panel to generate the PRS scores by placing a continuous shrinkage prior on effect sizes. We adapted this method with penalization of rarer SNPs by correcting for the standard deviation resulting in the selection of fewer SNPs. We varied three parameters, a, b, φ, which control the degree of shrinkage of effect estimates. Φ, the overall shrinkage parameter, is influenced by values of a which controls shrinkage of effect estimates around 0 and b which control shrinkage of larger effect estimates. We generated summary statistics for each cross-validation training set and selected the parameters that gave the best results on average from the cross-validation and applied these to the set of summary statistics for the complete OCAC data set to obtain the final set of weights.

PRS based on meta-analysis of OCAC-CIMBA summary statistics

We conducted a meta-analysis of the EOC associations in BRCA1 variant carriers, BRCA2 variant carriers and the participants participating in OCAC (see Supplementary Methods) and constructed two PRS models. An S4 PRS was generated by applying the a, b and φ parameters from the S4 model described above. A stepwise PRS was generated by selecting all SNPs that were genome-wide significant (p < 5 × 10−8) in the meta-analysis, along with any independent signals in the same region with p < 10−5 from the histotype specific analyses for low-grade serous, high-grade serous, endometrioid, clear cell ovarian cancer and non-mucinous invasive EOC.

Polygenic risk score performance

The best lasso, elastic net, stepwise and S4 models from the model development stage were validated using two independent data sources: the UK Biobank data and BRCA1/BRCA2 pathogenic variant carriers from the CIMBA. In the UK Biobank data, we evaluated discriminatory performance of the models using the AUC and examined the association between standardized PRS and risk of non-mucinous EOC using logistic regression analysis. For the CIMBA data, we assessed associations for each version of the PRS and invasive non-mucinous EOC risk using weighted Cox regression methods [20]. PRSs in the CIMBA data were scaled to the same PRS standard deviations as the OCAC data, meaning that per standard deviation hazard ratios estimated on CIMBA data are comparable to PRS associations in the OCAC and UK Biobank data. The regression models were adjusted for birth cohort (<1920, 1920–1929, 1930–1939, 1940–1949, ≥1950) and the first four ancestries informative principal components (calculated separately by iCOGS/OncoArray genotyping array) and stratified by Ashkenazi Jewish ancestries and country. Absolute risks by PRS percentiles adjusting for competing risks of mortality from other causes were calculated as described in the Supplementary Material.

Transferability of PRS scores to non-European ancestries

We implemented two straightforward approaches to disentangle the role of ancestries on polygenic risk scoring. We selected homogenous ancestral samples by using a high cut-off criterion of 80% ancestries and we standardized the PRSs by mean-centering within each population. These approaches led to a more uniform distribution of PRSs within each ancestral population. Further adjustments using principal components of ancestries did not attenuate risk estimates.

Results

Model development

The results for the models based on individual level genotype data are shown in Table 1. The elastic net model had the best predictive accuracy (AUC = 0.586). The optimal value of λ obtained from regularization paths for the MCP model was 3.3 meaning the best MCP model was equivalent to the lasso model. The best-fitting model based on summary statistics was the S4 (AUC = 0.593) and the LDPred model had the poorest performance of the methods tested (AUC = 0.552). Therefore, the LDPred model was not considered for further validation in other datasets. All SNPs selected and the associated weights for each model are provided in Supplementary Tables 1–6.
Table 1

Performance of different PRS models in five-fold cross-validation of OCAC data.

ModelNumber of SNPsaTuning parameter for best performanceAUCOR per 1 SD of PRS95% CI
(a) Models based on individual level genotype data
Lasso1403λ = 3.30.5831.351.30–1.39
Elastic net10,797λ = 3.3, κ = −2.20.5861.361.31–1.40
MCP1403λ = 3.30.5831.351.30–1.39
(b) Models based on summary statistics
LDPred5,291,719ρ = 0.0010.5521.211.13–1.29
Stepwise22λ = 5.40.5721.301.26–1.34
Select and Shrink (OCAC)27,240a = 2.75, b = 2, φ = 3e−60.5931.391.34–1.44

AUC area under the receiver operating characteristic (ROC) curve AUC), OR odds ratio, SD standard deviation, PRS polygenic risk score, CI confidence interval, NA not applicable.

aNumber of SNPs in PRS model run on full OCAC data set after selection of model parameters.

Performance of different PRS models in five-fold cross-validation of OCAC data. AUC area under the receiver operating characteristic (ROC) curve AUC), OR odds ratio, SD standard deviation, PRS polygenic risk score, CI confidence interval, NA not applicable. aNumber of SNPs in PRS model run on full OCAC data set after selection of model parameters.

Model validation in women of European ancestries

Overall the PLR models performed slightly better in the UK Biobank data than the model development data (Table 2). Of the models developed using the OCAC model development data, the association was strongest with the S4 PRS. In BRCA1 and BRCA2 variant carriers, prediction accuracy was generally higher among BRCA2 carriers than BRCA1 carriers. Consistent with results from the general population in the UK Biobank, the S4 PRS model also had the strongest association and predictive accuracy for invasive EOC risk in both BRCA1 and BRCA2 carriers. Sensitivity analyses were conducted in which the unadjusted models for BRCA1 and BRCA2 carriers were progressively adjusted for birth cohort and 6 principal components. There was little difference in HR estimates and association P-values going from the unadjusted model to the model adjusting for six principal components (Supplementary Table 7). The PRS models developed using the OCAC-CIMBA meta-analysis results had better discriminative ability in the UK Biobank than the PRS models developed using only OCAC data. Compared with the S4 PRS using only OCAC data, the S4 PRS model derived from the meta-analysis had fewer SNPs, a stronger association with invasive EOC risk and better predictive accuracy. Similarly, the stepwise model from the OCAC-CIMBA meta-analysis performed better than the stepwise model from only OCAC data, but included more SNPs.
Table 2

External validation of PRS models in European populations using data from UK Biobank and CIMBA.

Model (data set)SNPsUK BiobankCIMBA BRCA1 carriersaCIMBA BRCA2 carriersa
AUCOR95% CIAUCHR95% CIAUCHR95% CI
(a) PRS models based on OCAC data
Lasso (OCAC)14030.5871.371.27–1.480.5731.271.21–1.340.6271.481.33–1.63
Elastic net (OCAC)10,7970.5881.361.26–1.470.5831.321.26–1.390.6171.471.33–1.63
Stepwise (OCAC)220.5881.351.26–1.460.5631.211.16–1.260.6051.391.26–1.54
Select and shrink (OCAC)27,2400.5881.381.28–1.480.5921.361.29–1.430.6241.491.35–1.64
(b) PRS models based on meta-analysis of OCAC and CIMBA data
Stepwise (OCAC-CIMBA)b360.5951.391.29–1.50NANANANANANA
Select and shrink (OCAC-CIMBA)18,0070.5961.421.32–1.54NANANANANANA

AUC area under the receiver operating characteristic curve, OR odds ratio, HR hazards ratio.

aEstimates are from unadjusted models.

bResults in CIMBA are overfitted as the CIMBA data was used for model development.

External validation of PRS models in European populations using data from UK Biobank and CIMBA. AUC area under the receiver operating characteristic curve, OR odds ratio, HR hazards ratio. aEstimates are from unadjusted models. bResults in CIMBA are overfitted as the CIMBA data was used for model development. The observed distribution of the OR estimates within centiles of the PRS distribution were consistent with ORs from predicted values under the assumption that all SNPs interact multiplicatively (Fig. 2), with all 95% confidence intervals intersecting with the theoretical estimates for women of European ancestries. Compared with women in the middle quintile, women of European ancestry (UK Biobank) in the top 95th percentile of the lasso derived PRS model had a 2.23-fold increased odds of non-mucinous EOC (95% CI: 1.64 - 3.02) (Table 3).
Fig. 2

Association between the PLR PRS models and non-mucinous ovarian cancer by PRS percentiles.

Shown are estimated odds ratios (OR) and confidence intervals for women of European ancestries by percentiles of polygenic risk scores derived from lasso (A), elastic net (B), stepwise (C) and S4 (D) models relative to the middle quintile.

Table 3

Association between polygenic risk scores and non-mucinous EOC by PRS percentiles and ancestry.

UK BiobankEast AsianAfrican
PercentileControls (n)Cases (n)OR (95% CI)Controls (n)Cases (n)OR (95% CI)Controls (n)Cases (n)OR (95% CI)
(a) Lasso
0–59880120.42 (0.22–0.72)2781060.65 (0.51–0.83)35190.89 (0.47–1.65)
5–109870240.83 (0.52–1.27)2711120.71 (0.55–0.90)41130.52 (0.25–1.01)
10–2019,733530.92 (0.66–1.27)4872800.98 (0.82–1.18)81260.53 (0.31–0.88)
20–4039,4681040.90 (0.69–1.18)9935410.93 (0.80–1.08)154600.64 (0.42–0.99)
40–6039,45711519675661133811
60–8039,4251471.28 (1.00–1.64)9415931.08 (0.93–1.25)136780.94 (0.64–1.39)
80–9019,699871.52 (1.14–2.00)4663011.10 (0.92–1.32)63441.15 (0.71–1.84)
90–959842511.78 (1.27–2.46)2141691.35 (1.07–1.69)34200.97 (0.51–1.78)
95–1009830642.23 (1.64–3.02)2111731.40 (1.12–1.76)27271.64 (0.90–3.00)
(b) Elastic net
0–59876170.67 (0.39–1.09)2771070.72 (0.56–0.92)35190.90 (0.47–1.64)
5–109876170.67 (0.39–1.09)2711120.78 (0.61–0.99)41130.52 (0.25–1.01)
10–2019,740450.89 (0.62–1.26)4972701.02 (0.85–1.22)81260.53 (0.31–0.88)
20–4039,4531201.19 (0.91–1.55)9675671.10 (0.95–1.28)154600.64 (0.42–0.96)
40–6039,471101110005331133811
60–8039,4131591.58 (1.23–2.03)9266081.23 (1.06–1.43)136780.94 (0.64–1.39)
80–9019,695911.80 (1.36–2.40)4573101.27 (1.06–1.52)63441.15 (0.71–1.84)
90–959841522.07 (1.47–2.87)2261571.30 (1.04–1.64)34200.97 (0.51–1.78)
95–1009839552.18 (1.56–3.02)2071771.60 (1.28–2.01)27271.64 (0.90–3.00)
(c) Stepwise
0–59880130.39 (0.21–0.67)2541300.90 (0.71–1.14)40140.75 (0.37–1.44)
5–109874190.57 (0.34–0.91)2681150.76 (0.59–0.96)43110.55 (0.26–1.10)
10–2019,742440.67 (0.47–0.93)4942730.98 (0.81–1.17)80270.72 (0.42–1.21)
20–4039,4701020.77 (0.60–1.00)9705641.03 (0.89–1.19)142721.09 (0.73–1.63)
40–6039,44013219795641146681
60–8039,4141581.20 (0.95–1.51)9515831.08 (0.94–1.25)130841.39 (0.93–2.07)
80–9019,697881.33 (1.02–1.75)4563111.21 (1.01–1.44)61461.62 (1.00–2.61)
90–959853411.24 (0.86–1.75)2361471.10 (0.87–1.38)35191.17 (0.61–2.17)
95–1009834601.82 (1.33–2.46)2201641.32 (1.04–1.65)27272.15 (1.17–3.95)
(d) Select and shrink
0–59957160.54 (0.31–0.89)2791050.63 (0.49–0.81)38160.71 (0.36–1.33)
5–109888150.51 (0.29–0.85)2541290.85 (0.67–1.08)41130.53 (0.26–1.03)
10–2019,812510.87 (0.62–1.20)4892780.96 (0.80–1.14)81260.54 (0.32–0.90)
20–4039,4351130.97 (0.75–1.25)10135210.86 (0.75–1.00)156580.62 (0.41–0.94)
40–6039,51211719615721134801
60–8039,3161581.36 (1.07–1.73)9505841.03 (0.89–1.20)137770.94 (0.63–1.40)
80–9019,718771.32 (0.98–1.76)4343331.29 (1.08–1.54)61461.26 (0.79–2.02)
90–959791451.55 (1.09–2.17)2331501.08 (0.86–1.36)30241.34 (0.73–2.45)
95–1009775652.25 (1.65–3.03)2151691.32 (1.05–1.66)26281.80 (0.99–3.31)

OR odds ratio, CI confidence interval.

Association between the PLR PRS models and non-mucinous ovarian cancer by PRS percentiles.

Shown are estimated odds ratios (OR) and confidence intervals for women of European ancestries by percentiles of polygenic risk scores derived from lasso (A), elastic net (B), stepwise (C) and S4 (D) models relative to the middle quintile. Association between polygenic risk scores and non-mucinous EOC by PRS percentiles and ancestry. OR odds ratio, CI confidence interval.

Absolute risk of developing ovarian cancer by PRS percentiles

We estimated cumulative risk of EOC within PRS percentiles for women in the general population (Fig. 3), by applying the odds ratio from the PRS models to age-specific population incidence and mortality data for England in 2016. For BRCA1 and BRCA2 pathogenic variant carriers, we applied the estimated hazard ratios from PRS models to age-specific incidence rates obtained from Kuchenbaecker et al. [21]. For women in the general population, the estimated cumulative risks of EOC by age 80 for women at the 99th centile of the PRS distribution were 2.24%, 2.18%, 2.54%, and 2.81% for the lasso, elastic net, stepwise and S4 models, respectively. In comparison, the absolute risks of EOC by age 80 for women at the 1st centile were 0.76%, 0.78%, 0.64%, and 0.56% for the lasso, elastic net, stepwise and S4 models, respectively.
Fig. 3

Cumulative risk of ovarian cancer between birth and age 80 by PRS percentiles and PRS models.

Shown are the cumulative risk of ovarian cancer risk in UK women by polygenic risk score percentiles. The lasso (A) and elastic net (B) penalized regression models were applied to individual level genotype data, while the stepwise (C) and S4 (D) models were applied to summary level statistics. Note that the median and the mean risk differ because the distribution of the relative risk in the population is left-skewed (the log relative risk is a Normal distribution).

Cumulative risk of ovarian cancer between birth and age 80 by PRS percentiles and PRS models.

Shown are the cumulative risk of ovarian cancer risk in UK women by polygenic risk score percentiles. The lasso (A) and elastic net (B) penalized regression models were applied to individual level genotype data, while the stepwise (C) and S4 (D) models were applied to summary level statistics. Note that the median and the mean risk differ because the distribution of the relative risk in the population is left-skewed (the log relative risk is a Normal distribution). The absolute risks of developing EOC in BRCA1 and BRCA2 pathogenic variant carriers were considerably higher than for women in the general population (Figs. S1 and S2). The estimated absolute risk of developing ovarian cancer by age 80 for BRCA1 carriers at the 99th PRS centiles were 63.2%, 66.3%, 59.0%, and 68.4% for the lasso, elastic net, stepwise and S4 models, respectively. The corresponding absolute risks for women at the 1st PRS centile were 27.7%, 25.6%, 30.8%, and 24.2%. For BRCA2 carriers the absolute risks for women at the 99th centile were 36.3%, 36.3%, 33.0%, and 36.9%; and 7.10%, 7.12%, 8.24%, and 6.92% at the 1st centile for the lasso, elastic net, stepwise and S4 models, respectively.

PRS distribution and ancestries

To investigate the transferability of the PRS to other populations, we applied the scores to women of African (N = 1,072) and Asian (N = 7,669) ancestries genotyped as part of the OncoArray project. In general, the distributions of the raw PRS were dependent on both the statistical methods used in SNP selection and ancestral group. PRS models that included more variants had less dispersion, such that the elastic net models had the least between individual variation in all ancestral groups (standard deviation = 0.15, 0.19, and 0.22 for individuals of Asian, African and European ancestries respectively), while the distributions from the stepwise models were the most dispersed (standard deviation = 0.23, 0.27, and 0.30 for individuals of Asian, African and European ancestries respectively). As expected, given the variation in variant frequencies by population, the distribution of polygenic scores was significantly different across the three ancestral groups, with the least dispersion among women of Asian ancestries and the most variation in women of European ancestries. The difference in PRS distribution was minimized after correction for ancestry by standardizing the PRS to have unit standard deviation using the control subjects for each ancestral group. High PRSs were significantly associated with risk of non-mucinous EOC in both Asian and African ancestries (Table 4), although the effects were weaker than in women of European ancestries. For example, with the lasso model, the odds ratio per unit standard deviation increment in polygenic score was 1.16 (95% CI: 1.11–1.22) in women of East Asian ancestries, 1.28 (95% CI: 1.13–1.45) in women of African ancestries and 1.37 (95% CI: 1.27–1.48) in women of European ancestries (p for heterogeneity <0.0001). Variability in effect sizes among ancestral groups was highest for the stepwise model (I2 = 92%) versus 84% and 83% for elastic net and lasso derived polygenic scores respectively. The best discriminative model among women of East Asian and African ancestries were the elastic net PRS (AUC = 0.543) and the S4 PRS derived from OCAC-CIMBA meta-analysis (AUC = 0.596) respectively. Women of African ancestries in the top 5% of the PRS had about two-fold increased risk compared to women in the middle quintile (lasso OR: 1.64, 95% CI: 0.90–3.00; elastic net OR: 1.64, 95% CI: 0.90–3.00; stepwise OR: 2.15, 95% CI: 1.17–3.95; S4 OR: 1.80, 95% CI: 0.99–3.31) (Table 3). Effect estimates were smaller in women of East Asian ancestries with women in the top 5% of the PRS, having about a 1.5 fold increased risk compared to women in the middle quintile (lasso OR: 1.40, 95% CI: 1.12–1.76; elastic net OR: 1.60, 95% CI: 1.28–2.01; stepwise OR: 1.32, 95% CI: 1.04–1.65; S4 OR: 1.32, 95% CI: 1.05–1.66) (Table 3).
Table 4

External validation of PRS models in East Asian and African Populations.

ModelEast Asian ancestriesAfrican ancestries
AUCOR95% CIAUCOR95% CI
Lasso0.5411.16(1.11–1.22)0.5761.28(1.13–1.45)
Elastic net0.5431.17(1.12–1.23)0.5741.29(1.14–1.47)
Stepwise (OCAC)0.5281.11(1.06–1.16)0.5811.34(1.18–1.52)
Select and shrink (OCAC)0.5381.14(1.08–1.19)0.5931.38(1.21–1.58)
Stepwise (OCAC-CIMBA)0.5421.17(1.11–1.23)0.5941.37(1.20–1.56)
Select and shrink (OCAC-CIMBA)0.5371.14(1.08–1.19)0.5961.41(1.23–1.61)
External validation of PRS models in East Asian and African Populations.

Discussion

Genetic risk profiling with PRSs has led to actionable outcomes for cancers such as breast and prostate [22, 23]. Previous PRS scores for invasive EOC risk in the general population and BRCA1/BRCA2 pathogenic variant carriers have been based on genetic variants for which an association with EOC risk had been established at nominal genome-wide significance [20, 24, 25]. Here, we explored the predictive performance of computationally efficient, penalized, regression methods in modeling joint SNP effects for EOC risk prediction in diverse populations and compared them with common approaches. By leveraging the correlation between SNPs which do not reach nominal genome-wide thresholds and including them in PRS models, the PRSs derived from penalized regression models provide stronger evidence of association with risk of non-mucinous EOC than previously published PRSs in both the general population and in BRCA1/BRCA2 pathogenic variant carriers. Recently, Barnes et al. derived a PRS score using 22 SNPs that were significantly associated with high-grade serous EOC risk (PRSHGS) to predict EOC risk in BRCA1/BRCA2 pathogenic variant carriers [20]. To make effect estimates obtained in this analysis comparable to the effect estimates obtained from the PRSHGS, we standardized all PRSs using the standard deviation from unaffected BRCA1/BRCA2 carriers and provide estimates which are directly comparable to the PRSHGS in Supplementary Table 9. All PRS models in this analysis except the Stepwise (OCAC only) had higher effect estimates [20]. The AUC estimates from the adjusted PLR methods implemented in this analysis, are higher than the corresponding PRSHGS estimates for BRCA1 carriers (0.604). In BRCA2 carriers, the AUC estimates for the lasso and S4 models did slightly better than the PRSHGS AUC estimate (0.667), while the stepwise did slightly worse and the elastic net estimate was comparable. The AUC estimates for women in the general population, as estimated from the UK Biobank, are slightly higher than estimates from previously published PRS models for overall EOC risk by Jia et al. (AUC = 0.57) and Yang et al. (AUC = 0.58) [25, 26]. The level of risk for women above the 95th percentile of the PRS is similar to that conferred by pathogenic variants in moderate penetrance genes such as FANCM (RR = 2.1, 95% CI = 1.1–3.9) and PALB2 (RR = 2.91 95% CI = 1.40–6.04) [27, 28]. The inclusion of other risk factors such as family history of ovarian cancer, presence of rare pathogenic variants, age at menarche, oral contraceptive use, hormone replacement therapy, parity, and endometriosis in combination with the PRS could potentially improve risk stratification as implemented in the CanRisk tool (www.canrisk.org), which currently uses a 36-SNP PRS with the potential to use other PRS models [29, 30]. We found that the discrimination of the PRS varied by ancestry with greater discrimination in women of European ancestries than in women of African and East Asian ancestries. The better performance in African than East Asian populations is in contrast to what one would expect given human demographic history, and the performance of PRS for other phenotypes in African populations. This may simply be the play of chance given the small number of samples of African ancestries. Alternatively it reflects the fact that the allele frequencies of the PRS SNPs were more similar between the African and European populations than they were with the East Asian population (Supplementary Tables 10–14). Further optimization of the models could be achieved by varying the penalization function based on prior knowledge. For example, varying the penalty function to select more SNPs from genomic regions with known susceptibility variants given that susceptibility variants tend to cluster together. Alternatively, the penalty functions could be modified to incorporate information about functionally active regions of the genome such a promoters, enhancers, and transcription factor binding sites. However, incorporating functional annotation has resulted in limited gains in prediction accuracy for complex traits such as breast cancer, celiac disease, type 2 diabetes, and rheumatoid arthritis [31]. Machine/deep learning approaches are alternative ways to constructing PRS, but methods such as the neural net, support vector machine, and random forest have been shown to be computationally prohibitive or produce inferior results to other approaches [32, 33]. Other machine learning methods, such as those based on gradient boosting do not perform well in genomic regions where strong genetic interactions are present, for which alternative approaches such as the LDPred may perform better [18]. Our approach has several benefits over alternative machine learning methods, including its simplicity, and intrinsic robustness to minor misspecification of LD or association strength. In conclusion, our results indicate that using the lasso model for individual level genotype data and the S4 model for summary level data in PRS construction provide an improvement in risk prediction for non-mucinous EOC over more common approaches. Our approach overcomes the computational limitations in the use of penalized methods for large-scale genetic data, particularly in the presence of highly correlated SNPs and when the use of cross-validation for parameter estimation is preferred. In practical terms, the PRS provides sufficient discrimination, particularly for women of European ancestries, to be considered for inclusion in risk prediction and prevention approaches for EOC in the future. Further studies are required to optimize these PRSs in ancestrally diverse populations and to validate their performance with the inclusion of other genetic and lifestyle risk factors. Supplementary Material FigureS1: Cumulative risk of ovarian cancer risk in BRCA1 carriers by polygenic risk score percentiles. The lasso (A) and elastic net (B) penalized regression models were applied to individual level g Figure S2:Cumulative risk of ovarian cancer risk in BRCA2 carriers by polygenic risk score percentiles. The lasso (A) and elastic net (B) penalized regression models were applied to individual level g Table S1- Lasso Weights Table S2- Elastic Net Weights Table S3- Stepwise Weights Table S4-Select and Shrink OCAC Weights Table S5-Stepwise OCAC CIMBA Weights Table S6- Select and Shrink OCAC CIMBA Weights Table S7- Hazard Ratios BRCA Carriers Table S8-Absolute Risks BRCA Carriers 10th and 90th Percentile Table S9-Adjusted and Unadjusted Models in BRCA Carriers Table S10- Mean Allele Frequency Ancestries Lasso Model Table S11 - Mean Allele Frequency Ancestries Elastic Net Model Table S12 - Mean Allele Frequency Ancestries Stepwise Model Table S13- Mean Allele Frequency Ancestries Select and Shrink OCAC Model Table S14- Mean Allele Frequency Ancestries Select and Shrink OCAC CIMBA Model
  30 in total

1.  Machine learning in genome-wide association studies.

Authors:  Silke Szymczak; Joanna M Biernacka; Heather J Cordell; Oscar González-Recio; Inke R König; Heping Zhang; Yan V Sun
Journal:  Genet Epidemiol       Date:  2009       Impact factor: 2.135

Review 2.  Mucinous epithelial ovarian carcinoma.

Authors:  T J Perren
Journal:  Ann Oncol       Date:  2016-04       Impact factor: 32.976

3.  Conditional and joint multiple-SNP analysis of GWAS summary statistics identifies additional variants influencing complex traits.

Authors:  Jian Yang; Teresa Ferreira; Andrew P Morris; Sarah E Medland; Pamela A F Madden; Andrew C Heath; Nicholas G Martin; Grant W Montgomery; Michael N Weedon; Ruth J Loos; Timothy M Frayling; Mark I McCarthy; Joel N Hirschhorn; Michael E Goddard; Peter M Visscher
Journal:  Nat Genet       Date:  2012-03-18       Impact factor: 38.330

Review 4.  Common Genetic Variation and Susceptibility to Ovarian Cancer: Current Insights and Future Directions.

Authors:  Siddhartha P Kar; Andrew Berchuck; Simon A Gayther; Ellen L Goode; Kirsten B Moysich; Celeste Leigh Pearce; Susan J Ramus; Joellen M Schildkraut; Thomas A Sellers; Paul D P Pharoah
Journal:  Cancer Epidemiol Biomarkers Prev       Date:  2017-06-14       Impact factor: 4.254

5.  Extension of the bayesian alphabet for genomic selection.

Authors:  David Habier; Rohan L Fernando; Kadir Kizilkaya; Dorian J Garrick
Journal:  BMC Bioinformatics       Date:  2011-05-23       Impact factor: 3.169

6.  Identification of novel epithelial ovarian cancer loci in women of African ancestry.

Authors:  Ani Manichaikul; Lauren C Peres; Xin-Qun Wang; Mollie E Barnard; Deanna Chyn; Xin Sheng; Zhaohui Du; Jonathan Tyrer; Joseph Dennis; Ann G Schwartz; Michele L Cote; Edward Peters; Patricia G Moorman; Melissa Bondy; Jill S Barnholtz-Sloan; Paul Terry; Anthony J Alberg; Elisa V Bandera; Ellen Funkhouser; Anna H Wu; Celeste Leigh Pearce; Malcom Pike; Veronica Wendy Setiawan; Christopher A Haiman; Julie R Palmer; Loic LeMarchand; Lynne R Wilkens; Andrew Berchuck; Jennifer A Doherty; Francesmary Modugno; Roberta Ness; Kirsten Moysich; Beth Y Karlan; Alice S Whittemore; Valerie McGuire; Weiva Sieh; Kate Lawrenson; Simon Gayther; Thomas A Sellers; Paul Pharoah; Joellen M Schildkraut
Journal:  Int J Cancer       Date:  2019-10-08       Impact factor: 7.316

7.  Evaluation of polygenic risk scores for ovarian cancer risk prediction in a prospective cohort study.

Authors:  Xin Yang; Goska Leslie; Aleksandra Gentry-Maharaj; Andy Ryan; Maria Intermaggio; Andrew Lee; Jatinderpal K Kalsi; Jonathan Tyrer; Faiza Gaba; Ranjit Manchanda; Paul D P Pharoah; Simon A Gayther; Susan J Ramus; Ian Jacobs; Usha Menon; Antonis C Antoniou
Journal:  J Med Genet       Date:  2018-05-05       Impact factor: 6.318

8.  Evaluating the Utility of Polygenic Risk Scores in Identifying High-Risk Individuals for Eight Common Cancers.

Authors:  Guochong Jia; Yingchang Lu; Wanqing Wen; Jirong Long; Ying Liu; Ran Tao; Bingshan Li; Joshua C Denny; Xiao-Ou Shu; Wei Zheng
Journal:  JNCI Cancer Spectr       Date:  2020-03-12

9.  Risks of Breast, Ovarian, and Contralateral Breast Cancer for BRCA1 and BRCA2 Mutation Carriers.

Authors:  Karoline B Kuchenbaecker; John L Hopper; Daniel R Barnes; Kelly-Anne Phillips; Thea M Mooij; Marie-José Roos-Blom; Sarah Jervis; Flora E van Leeuwen; Roger L Milne; Nadine Andrieu; David E Goldgar; Mary Beth Terry; Matti A Rookus; Douglas F Easton; Antonis C Antoniou; Lesley McGuffog; D Gareth Evans; Daniel Barrowdale; Debra Frost; Julian Adlard; Kai-Ren Ong; Louise Izatt; Marc Tischkowitz; Ros Eeles; Rosemarie Davidson; Shirley Hodgson; Steve Ellis; Catherine Nogues; Christine Lasset; Dominique Stoppa-Lyonnet; Jean-Pierre Fricker; Laurence Faivre; Pascaline Berthet; Maartje J Hooning; Lizet E van der Kolk; Carolien M Kets; Muriel A Adank; Esther M John; Wendy K Chung; Irene L Andrulis; Melissa Southey; Mary B Daly; Saundra S Buys; Ana Osorio; Christoph Engel; Karin Kast; Rita K Schmutzler; Trinidad Caldes; Anna Jakubowska; Jacques Simard; Michael L Friedlander; Sue-Anne McLachlan; Eva Machackova; Lenka Foretova; Yen Y Tan; Christian F Singer; Edith Olah; Anne-Marie Gerdes; Brita Arver; Håkan Olsson
Journal:  JAMA       Date:  2017-06-20       Impact factor: 56.272

10.  BOADICEA: a comprehensive breast cancer risk prediction model incorporating genetic and nongenetic risk factors.

Authors:  Andrew Lee; Nasim Mavaddat; Amber N Wilcox; Alex P Cunningham; Tim Carver; Simon Hartley; Chantal Babb de Villiers; Angel Izquierdo; Jacques Simard; Marjanka K Schmidt; Fiona M Walter; Nilanjan Chatterjee; Montserrat Garcia-Closas; Marc Tischkowitz; Paul Pharoah; Douglas F Easton; Antonis C Antoniou
Journal:  Genet Med       Date:  2019-01-15       Impact factor: 8.822

View more
  3 in total

1.  Good genotype-phenotype relationships in rare disease are hard to find.

Authors:  Alisdair McNeill
Journal:  Eur J Hum Genet       Date:  2022-03       Impact factor: 4.246

2.  Comprehensive epithelial tubo-ovarian cancer risk prediction model incorporating genetic and epidemiological risk factors.

Authors:  Andrew Lee; Xin Yang; Jonathan Tyrer; Aleksandra Gentry-Maharaj; Andy Ryan; Nasim Mavaddat; Alex P Cunningham; Tim Carver; Stephanie Archer; Goska Leslie; Jatinder Kalsi; Faiza Gaba; Ranjit Manchanda; Simon Gayther; Susan J Ramus; Fiona M Walter; Marc Tischkowitz; Ian Jacobs; Usha Menon; Douglas F Easton; Paul Pharoah; Antonis C Antoniou
Journal:  J Med Genet       Date:  2021-11-29       Impact factor: 5.941

Review 3.  Gynecologic Cancer Risk and Genetics: Informing an Ideal Model of Gynecologic Cancer Prevention.

Authors:  Lauren C Tindale; Almira Zhantuyakova; Stephanie Lam; Michelle Woo; Janice S Kwon; Gillian E Hanley; Bartha Knoppers; Kasmintan A Schrader; Stuart J Peacock; Aline Talhouk; Trevor Dummer; Kelly Metcalfe; Nora Pashayan; William D Foulkes; Ranjit Manchanda; David Huntsman; Gavin Stuart; Jacques Simard; Lesa Dawson
Journal:  Curr Oncol       Date:  2022-06-30       Impact factor: 3.109

  3 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.