BACKGROUND: Concerns regarding potential endocrine-disrupting chemicals (EDCs) have led to a need for methods to evaluate candidate estrogenic chemicals. Our previous evaluations of two such EDCs revealed a response similar to that of estradiol (E2) at 2 hr, but a less robust response at 24 hr, similar to the short-acting estrogen estriol (E3). OBJECTIVES: Microarray analysis using tools to recognize patterns of response have been utilized in the cancer field to develop biomarker panels of transcripts for diagnosis and selection of treatments most likely to be effective. Biological effects elicited by long- versus short-acting estrogens greatly affect the risks associated with exposures; therefore, we sought to develop tools to predict the ability of chemicals to maintain estrogenic responses. METHODS: We used biological end points in uterine tissue and a signature pattern-recognizing tool that identified coexpressed transcripts to develop and test a panel of transcripts in order to classify potentially estrogenic compounds using an in vivo system. The end points used are relevant to uterine tissue, but the resulting classification of the compounds is important for other sensitive tissues and species. RESULTS: We evaluated biological and transcriptional end points with proven short- and long-acting estrogens and verified the use of our approach using a phytoestrogen. With our model, we were able to classify the diarylheptanoid D3 as a short-acting estrogen. CONCLUSIONS: We have developed a panel of transcripts as biomarkers which, together with biological end points, might be used to screen and evaluate potentially estrogenic chemicals and infer mode of activity.
BACKGROUND: Concerns regarding potential endocrine-disrupting chemicals (EDCs) have led to a need for methods to evaluate candidate estrogenic chemicals. Our previous evaluations of two such EDCs revealed a response similar to that of estradiol (E2) at 2 hr, but a less robust response at 24 hr, similar to the short-acting estrogen estriol (E3). OBJECTIVES: Microarray analysis using tools to recognize patterns of response have been utilized in the cancer field to develop biomarker panels of transcripts for diagnosis and selection of treatments most likely to be effective. Biological effects elicited by long- versus short-acting estrogens greatly affect the risks associated with exposures; therefore, we sought to develop tools to predict the ability of chemicals to maintain estrogenic responses. METHODS: We used biological end points in uterine tissue and a signature pattern-recognizing tool that identified coexpressed transcripts to develop and test a panel of transcripts in order to classify potentially estrogenic compounds using an in vivo system. The end points used are relevant to uterine tissue, but the resulting classification of the compounds is important for other sensitive tissues and species. RESULTS: We evaluated biological and transcriptional end points with proven short- and long-acting estrogens and verified the use of our approach using a phytoestrogen. With our model, we were able to classify the diarylheptanoid D3 as a short-acting estrogen. CONCLUSIONS: We have developed a panel of transcripts as biomarkers which, together with biological end points, might be used to screen and evaluate potentially estrogenic chemicals and infer mode of activity.
The ovariectomized mouse uterus exhibits rapid biochemical and biological responses to estrogens that have been extensively studied and characterized (Katzenellenbogen et al. 1979). Using this mouse model, we previously evaluated transcript responses by microarray and identified several thousand genes with transcripts that are increased or decreased following estrogen treatment (Hewitt et al. 2003). Natural and synthetic estrogenic substances are known to exhibit characteristic degrees of activity. For example, long-acting estrogens, such as estradiol (E2) and diethylstilbestrol (DES), elicit biological responses early (within 1–2 hr) and persist, resulting in later responses (24–72 hr) that lead to maximal uterine growth. In contrast, short-acting estrogens, such as estriol (E3), match long-acting estrogens in eliciting the early responses, but because of their pharmacokinetics they do not persist, and thus in vivo responses characteristic of later end points are blunted (Clark and Markaverich 1984; Katzenellenbogen 1984). However, E3 is able to match E2 in in vitro systems: For example, E3 is able to stimulate MCF-7 cell growth because culture conditions lack E3 metabolic clearing (Katzenellenbogen 1984). The xenoestrogens bisphenol A (BPA) and 2,2-bis(p-hydroxyphenyl)-1,1,1-trichloroethane (HPTE) elicited uterine transcription patterns similar to those of the proven short-acting estrogen E3 (Hewitt and Korach 2011; Klotz et al. 2000). Responses were highly correlated to those of E2 at 2 hr but were attenuated and less correlated to E2 at 24 hr (Hewitt and Korach 2011). We confirmed the short-acting estrogen-like activities of BPA and HPTE by observing uterine biological responses that were characteristic of short-acting estrogens. These end points included uterine weight increases that were attenuated after 72 hr (3 days) and decreased induction of epithelial cell DNA synthesis after 24 hr (Hewitt and Korach 2011).Recognizing not only the potential estrogenic activity of endocrine-disrupting chemicals (EDCs) but also determining whether they have short-acting or sustained actions is important for evaluation of risks to humans and wildlife. Because of their more sustained activity (Hewitt and Korach 2011; Safe et al. 2001), long-acting estrogens are more likely to affect estrogen-sensitive tissues and thus might be considered of greater risk in terms of their impacts on exposed populations (Safe et al. 2001). In contrast, individuals who lack endogenous long-acting estrogens, including prepubertal girls and postmenopausal women, might also exhibit susceptibility to short-acting estrogens. It is therefore important to develop tools predicting estrogenicity and also potential to elicit sustained responses. In the study of cancer, biomarker panels of transcripts have been developed as tools for diagnosis and for selection of treatments most likely to be effective (Gormley et al. 2007). In the present study, we aimed to use the well-characterized ovariectomized mouse uterus model to generate a screen that incorporates phenotypic estrogen-response end points and transcriptional biomarkers that distinguish estrogenic characteristics. We hope our approach will allow more detailed assessment of substances than do in vitro high throughput screens but without undertaking extensive animal studies or comprehensive genomic analyses. We developed panels of transcripts for use as biomarkers and phenotypic uterine responses to assess the activity of candidate compounds in terms of estrogenic activity and classification as short- versus long-acting estrogen. We analyzed uterine microarray data sets using the EPIG tool (Extracting Patterns and Identifying co-expressed Genes; Chou et al. 2007), and we identified patterns characteristic of short-acting (only 2 hr) or long-acting (both 2 hr and 24 hr) estrogen response. To increase the power of validation of potential biomarker transcripts, we used biological end points including uterine weight, proliferation and/or apoptosis of epithelial cells, increase in luminal epithelial cell height, and induction of apoptosis inhibitor, thus providing phenotypic anchoring to support transcriptional responses. We identified panels of 50 genes each at 2 or 24 hr using a combined analysis of variance (ANOVA) and principal component analysis (PCA) approach, and we validated the panels by establishing activity of a candidate compound. The use of these biomarkers and response end points (summarized in Table 1) will allow evaluation of potential estrogenic mechanisms for chemicals of environmental concern in a biological system. The diarylheptanoid D3 [(3R)-1,7-diphenyl-(4E,6E)-4,6-heptadien-3-ol], a natural phytoestrogen isolated from an indigenous plant [Curcuma comosa Roxb. (Zingiberaceae family)] used by postmenopausal women in Thailand, was previously characterized to exhibit estrogen-like activity in the uterus with a short-acting biological action compared with E2 (Winuthayanon et al. 2009, 2013). Therefore, we used D3 as a candidate to test our panel.
Table 1
Scheme for screening potential estrogenic substances using phenotypic and transcriptional end points.
Type of compound
2-hrRNA panela
24-hrEdUa
24-hrweighta
72-hrweightb
24-hrRNA panela
72-hrTUNELb
72-hrBirc1ab
72-hrLtfb
72-hrEpi cell heightb
Non-E
–
–
–
–
–
–
–
–
–
Short-acting E
+
+
–/+
–/+
–/+
+
–/+
–/+
–/+
Long-acting E
+
++
+
++
++
–
++
++
++
Abbreviations: –, no response; –/+, some or inconsistent response; +, moderate response; ++, strong response; E, estrogen; Epi, epithelial. aTime after a single injection. bSeventy-two hours after the first of three daily injections.
Scheme for screening potential estrogenic substances using phenotypic and transcriptional end points.
Materials and Methods
Uterine bioassays. Mice were housed three to five per cage in static microisolator solid-bottom cages (Super Mouse 750™ cages; Lab Products) on autoclaved hardwood bedding (Sani-chips; PJ Murphy Forest Products Corp.) and maintained on a 12:12-hr light:dark cycle at 22 ± 0.5°C and relative humidity of 40–60%. Mice were provided with autoclaved rodent diet (NIH31; Zeigler Brothers) and reverse-osmosis–treated deionized water ad libitum. All procedures were reviewed and approved by the National Institute of Environmental Health Sciences Animal Care and Use Committee. All animals were housed, cared for, and used in compliance with the Guide for the Care and Use of Laboratory Animals (National Research Council 2011) in a program accredited by the Association for Assessment and Accreditation of Laboratory Animal Care. Animals were treated humanely and with regard for alleviation of suffering according to NIEHS Animal Care and Use Committee Guidelines and in compliance with a NIEHS-approved animal protocol. Ovariectomized adult C57BL/6 mice (n = 211; 8–10 weeks of age) were obtained from Charles River Laboratories and shipped to the NIEHS facility. Animals were then housed five per cage for 10–14 days after surgery to clear circulating ovarian hormones before treatment began. Mice were assigned to treatment groups by cage mates, or in cases where fewer than five per goup were used, mice were divided by randomly removing some mice and combining them in a new cage.For 2- and 24-hr samples [24 hr for uterine weight, 5-ethynyl-2´-deoxyuridine (EdU) incorporation, and reverse-transcription polymerase chain reaction (RT-PCR); 2 hr for RT-PCR], mice were injected with vehicle [100 μL sterile saline (0.85% NaCl) plus 0.1% ethanol (n = 5)]; E2 (Steraloids; 2 hr, n = 4; 24 hr, n = 5), E3 (Steraloids; 2 hr, n = 4; 24 hr, n =5), or DES (Sigma; 24 hr only; n = 3), 1-mg/mL 100% ethanol (EtOH) stock solution diluted in saline to a concentration of 250 ng/100 μL; or 4,4´,4´´-(4-propyl-[1H]-pyrazole-1,3,5-triyl)trisphenol (PPT; Tocris Bioscience; 24 hr only, n = 3) 50-mg/mL 100% EtOH stock solution diluted to a concentration of 250 μg in 100 μL saline + 10% Cremaphor EL (Sigma). Treatments were administered by intraperitoneal injection.The diarylheptanoid D3 was isolated and administered as previously described (Suksamrarn et al. 2008; Winuthayanon et al. 2009, 2013). For the D3 experiments, mice were treated with sesame oil (Sigma) plus 10% EtOH (vehicle; n = 5); D3 [250-mg/mL 100% EtOH stock solution diluted to a concentration of 2.5 mg/100 μL sesame oil (2 hr, n = 4; 24 hr, n = 7)]; or E2 [1-mg/mL 100% EtOH stock solution diluted in sesame oil with added ethanol to a concentration of 250 ng E2 in 100 μL sesame oil plus 10% ethanol (2 hr, n = 4; 24 hr, n = 7)]. Treatments were administered by subcutaneous injection. Doses of all compounds were selected based on the minimum dose required to induce optimal uterine responses. For E2, DES, E3, and D3, see Supplemental Material, Figure S1. The PPT dose is based on responses reported by Sinkevicius et al. (2008).For 2-hr experiments, treatments were given without regard to time of day. For all 24-hr experiments, all injections and collections were done in the morning. EdU (2 mg in 100 μL phosphate-buffered saline; Life Technologies) was injected intraperitoneally 22 hr after hormone injections, and uterine tissue was collected 2 hr later (24 hr after hormone treatment). For 72-hr (3-day) end points (vehicle, n = 7; E2, n = 7; E3, n = 4; DES, n = 4; PPT, n = 4; and for D3 experiments (vehicle, n = 8; E2, n = 8; D3, n = 8), the same concentrations were used as for 24-hr end points, but all were diluted in sesame oil (Sigma) and injected subcutaneously each day for 3 days. Injections for 72-hr experiments were initiated without regard for time of day, but were always administered 24 hr apart, and uterine tissues were collected on the fourth day. For both 24-hr and 72-hr experiments, uterine tissue was weighed, with a portion of one horn fixed in 10% formalin (Fisher) and the remainder snap frozen in liquid nitrogen. For 2-hr experiments, uterine tissue was snap frozen in liquid nitrogen. Frozen uterine tissue was processed for RNA analysis by real-time RT-PCR as previously described (Hewitt et al. 2003). We used at least three animals per group based on previous studies indicating that significant changes in end points are likely to be detected (Hewitt and Korach 2011).Fixed tissue was processed either to detect incorporated EdU using the ClickIT Kit (Life Technologies) or to indicate terminal deoxynucleotidyl transferase dUTP nick end labeling (TUNEL)-positive apoptotic cells using the ApopTag Plus Peroxidase In Situ Apoptosis Kit (catalog no. S7101; Millipore), both methods described previously by Winuthayanon et al. (2010). Image analysis to evaluate cell proliferation and apoptosis was completed on transverse sections of EdU and TUNEL slides scanned with an Aperio Scanscope XT Digital Slide Scanner (Leica Biosystems) and viewed using an Aperio® ImageScope v. 12.0.1.5027 (Aperio Technologies Inc.). We determined percent positive EdU staining by counting total and EdUAlexafluor 488–positive uterine luminal cells within the total uterine luminal area. The total uterine luminal area was selected by outlining the basement membrane of the uterine luminal epithelium. The percentage of luminal cells that were TUNEL positive was determined by counting the number of TUNEL-positive cells per total epithelial cells in six regions of the uterine lumen (300–800 cells per slide). Luminal epithelial cell height (LEH) was measured in five areas per transverse section using the Ruler tool in ImageScope™. Data files were exported to Excel™ (v.14.3.9; Microsoft) and compiled into a single worksheet.Microarray analyses. We used data from previous microarray studies for pattern analysis [Gene Expression Omnibus (GEO; http://www.ncbi.nlm.nih.gov/geo/) accession numbers GSE24525, GSE18168, GSE23072, GSE23241, and GSE61921S; see summary in Supplemental Material, Tables S1 and S2]. Data from the GEO database included vehicle controls (11 samples), E2 (13 samples), E3 (6 samples), DES (4 samples), and PPT (4 samples) for 2 or 24 hr. All were generated using Agilent mouse 4 × 44K array chips (Agilent Technologies), and data were acquired and analyzed as described previously (Hewitt and Korach 2011; Hewitt et al. 2009, 2010, 2012).EPIG analysis and derivation of biomarker panels. Batch-corrected microarray data sets (see Supplemental Material, “EPIG Analysis” and Figure S4) were analyzed using the EPIG tool (Chou et al. 2007) resulting in 16 patterns (Figure 1A,B). Probes that could distinguish estrogenic from nonestrogenic treatments (2 hr; 50 probes) or long-acting from short-acting estrogens (24 hr; 50 probes) were derived as described in Supplemental Material, “Deriving biomarker panels.” Hierarchical clustering of the expression of the 2-hr or 24-hr probes with estrogens validated their selection (see Supplemental Material, Figure S2 and Tables S3 and S4).
Figure 1
Microarray data sets analyzed by EPIG to extract expression patterns. Mice were treated with either saline vehicle, 24 hr (11 samples); E3, 2 hr or 24 hr (3 samples each), PPT, 2 hr or 24 hr (2 samples each), E2, 2 hr (5 samples) or 24 hr (8 samples); or DES, 2 hr or 24 hr (2 samples each). (A) Microarray data sets with coregulation patterns identified; numbers across the bottom indicate the 16 patterns that were extracted. Green boxes outline patterns 5 and 9; blue boxes outline patterns 3, 7, and 14; and red boxes outline patterns 1 and 16. (B) Sixteen patterns extracted by EPIG. The inset in the lower right corner describes information shown in each box. Abbreviations: Max, maximum; Min, minimum.
Microarray data sets analyzed by EPIG to extract expression patterns. Mice were treated with either saline vehicle, 24 hr (11 samples); E3, 2 hr or 24 hr (3 samples each), PPT, 2 hr or 24 hr (2 samples each), E2, 2 hr (5 samples) or 24 hr (8 samples); or DES, 2 hr or 24 hr (2 samples each). (A) Microarray data sets with coregulation patterns identified; numbers across the bottom indicate the 16 patterns that were extracted. Green boxes outline patterns 5 and 9; blue boxes outline patterns 3, 7, and 14; and red boxes outline patterns 1 and 16. (B) Sixteen patterns extracted by EPIG. The inset in the lower right corner describes information shown in each box. Abbreviations: Max, maximum; Min, minimum.RT-PCR and NanoString screen. We selected probes to test the 2-hr and 24-hr biosets by RT-PCR by first combining the 50 probe panels validated above (see Supplemental Material, Figure S2) with 26 additional 2-hr probes or 12 additional 24-hr probes covering RT-PCR primer sets for previously studied estrogen-responsive transcripts, and these probes were analyzed using Ingenuity Pathway Analysis (http://www.ingenuity.com/products/ipa). Probes that duplicated gene names and genes that represented the same biological function were consolidated. Genes for RT-PCR validation were then selected using a random number generator. For NanoString analysis, 129 biomarker probes plus 9 housekeeping probes were submitted to NanoString Technologies for CodeSet design, and RNA samples were shipped to NanoString for processing and analysis. Briefly, 100 ng of each RNA sample was added to the CodeSet in hybridization buffer and incubated at 65°C for 16 hr. The CodeSet consists of Reporter and Capture probes that hybridize to the target sequences of interest, forming a tripartite complex. Assays were purified using the Prep Station software (High Sensitivity Protocol; NanoString), and data were collected using the GEN2 Digital Analyzer (NanoString), and raw counts were provided. Raw counts were then were normalized using nSolver software (NanoString) and exported into Partek Genomics Suite 6.6 (Partek Inc.) for clustering. Normalized values are presented in Supplemental Material, Supplemental XLSX, Table S5.Statistical analysis for biological end points. Data for real-time RT-PCR as well as quantification of EdU and TUNEL-positive cells and uterine LEH are presented as mean ± SE. GraphPad Prism 6.0 for Windows (http://www.graphpad.com/scientific-software/prism/) was used for statistical analysis. Differences were considered significant when p < 0.05, using ANOVA with Tukey multiple comparisons post hoc, unless otherwise indicated.
Results
Biological end points. We compared proliferation of uterine epithelial cells—a hallmark of estrogenic response—in ovariectomized mice treated with E2, E3, DES (a synthetic estrogen), or PPT [a synthetic estrogen receptor α (ERα)–selective agonist]. Treatment with all of the estrogens resulted in an increase in epithelial cells in S phase, as reflected by incorporation of the thymidine triphosphate analog EdU (Figure 2A,B). At the 24-hr time point, uterine wet weights were increased by E2, E3, or DES (p < 0.05), but not significantly by PPT (Figure 2C). However, after 3 days of treatment, uterine weight was not significantly increased by E3; however, E2 or DES treatment led to a robust uterine weight increase (p < 0.0001), whereas PPT caused an increase (p < 0.001) that was significantly lower than the increase induced by E2 or DES (p < 0.001) (Figure 2D). In the 72-hr bioassay, E2, E3, DES, and PPT treatment resulted in increased epithelial thickness and cell height (p < 0.001; Figure 2E); however, PPT and E3 increased the epithelial thickness significantly less than did E2 (p < 0.001 vs. E2; Figure 2E). Three days of E3 treatment did not induce transcripts of either the apoptosis inhibitor Birc1a (baculoviral IAP repeat-containing protein 1a) or the epithelial cell secretory protein Ltf (lactoferrin), whereas E2, DES, and PPT induced both of these (Figure 2F,G). In addition, E3 and PPT exhibited significantly more TUNEL-positive epithelial cells than E2 or DES (p < 0.05; Figure 2H,I), indicating increased apoptosis.
Figure 2
Phenotypic end points of estrogenic response in the uterus of mice treated with saline vehicle (V), E2, E3, DES, or PPT for 24 (A–C) or 72 hr (D–I). (A) Representative photomicrographs showing cell proliferation 24 hr after treatment, indicated by incorporation of EdU (green); blue indicates Hoescht staining of DNA. Uterine epithelial cells show active DNA synthesis, and basal EdU incorporation is present in vehicle-treated mice; bar = 0.1 mm. (B) Percentage of EdU-positive cells in uterine tissue 24 hr after injection (mean ± SE; n = 5–9 mice/group). **p < 0.01 compared with V by one-way ANOVA with multiple comparisons and uncorrected Fisher’s least significant difference (LSD). (C) Uterine weight 24 hr after injection (mean ± SE; n = 3–5 mice/group). *p < 0.05, ***p < 0.001, and ****p < 0.0001, compared with V by one-way ANOVA, with multiple comparisons, with Tukey’s multiple test correction. (D) Uterine weight in the 72 hr (3 day) bioassay, with uteri collected 24 hr after the last of three daily injections (mean ± SE; n = 4–7 mice/group). **p < 0.001 for PPT compared with DES or E2; and ****p < 0.0001 compared with V, by one-way ANOVA, with multiple comparisons, with Tukey’s multiple test correction. (E) Luminal epithelial cell height (LEH) in the 72‑hr bioassay (mean ± SE; n = 4–7 mice/group). ***p <0.001, and ****p < 0.0001 compared with V; +p < 0.0001 compared with E2 or DES; and #p < 0.001 compared with E2 by one-way ANOVA, with multiple comparisons, with Tukey’s multiple test correction. (F) Level of RNA for the apoptosis inhibitor Birc1a measured by RT‑PCR in uteri from the 72‑hr bioassay (mean ± SE; n = 4–7 mice/group).***p < 0.001, and ****p < 0.0001 compared with V by one-way ANOVA with multiple comparisons and uncorrected Fisher’s LSD. (G) Ltf transcript measured by RT-PCR in uteri from the 72‑hr bioassay (mean ± SE; n = 4–7 mice/group). **p < 0.01, ***p < 0.001, and **** p < 0.0001 compared with V; and +p < 0.01 for PPT compared with E2 by one-way ANOVA, with multiple comparisons, with Tukey’s multiple test correction. (H) Representative photomicrographs showing apoptotic cells in uteri from the 72‑hr bioassay as indicated by the TUNEL assay; bar = 0.1 mm. Each arrowhead points to a TUNEL-positive cell. (I) Percent TUNEL-positive luminal epithelial cells (mean ± SE; n = 4–10 mice/group.
Phenotypic end points of estrogenic response in the uterus of mice treated with saline vehicle (V), E2, E3, DES, or PPT for 24 (A–C) or 72 hr (D–I). (A) Representative photomicrographs showing cell proliferation 24 hr after treatment, indicated by incorporation of EdU (green); blue indicates Hoescht staining of DNA. Uterine epithelial cells show active DNA synthesis, and basal EdU incorporation is present in vehicle-treated mice; bar = 0.1 mm. (B) Percentage of EdU-positive cells in uterine tissue 24 hr after injection (mean ± SE; n = 5–9 mice/group). **p < 0.01 compared with V by one-way ANOVA with multiple comparisons and uncorrected Fisher’s least significant difference (LSD). (C) Uterine weight 24 hr after injection (mean ± SE; n = 3–5 mice/group). *p < 0.05, ***p < 0.001, and ****p < 0.0001, compared with V by one-way ANOVA, with multiple comparisons, with Tukey’s multiple test correction. (D) Uterine weight in the 72 hr (3 day) bioassay, with uteri collected 24 hr after the last of three daily injections (mean ± SE; n = 4–7 mice/group). **p < 0.001 for PPT compared with DES or E2; and ****p < 0.0001 compared with V, by one-way ANOVA, with multiple comparisons, with Tukey’s multiple test correction. (E) Luminal epithelial cell height (LEH) in the 72‑hr bioassay (mean ± SE; n = 4–7 mice/group). ***p <0.001, and ****p < 0.0001 compared with V; +p < 0.0001 compared with E2 or DES; and #p < 0.001 compared with E2 by one-way ANOVA, with multiple comparisons, with Tukey’s multiple test correction. (F) Level of RNA for the apoptosis inhibitor Birc1a measured by RT‑PCR in uteri from the 72‑hr bioassay (mean ± SE; n = 4–7 mice/group).***p < 0.001, and ****p < 0.0001 compared with V by one-way ANOVA with multiple comparisons and uncorrected Fisher’s LSD. (G) Ltf transcript measured by RT-PCR in uteri from the 72‑hr bioassay (mean ± SE; n = 4–7 mice/group). **p < 0.01, ***p < 0.001, and **** p < 0.0001 compared with V; and +p < 0.01 for PPT compared with E2 by one-way ANOVA, with multiple comparisons, with Tukey’s multiple test correction. (H) Representative photomicrographs showing apoptotic cells in uteri from the 72‑hr bioassay as indicated by the TUNEL assay; bar = 0.1 mm. Each arrowhead points to a TUNEL-positive cell. (I) Percent TUNEL-positive luminal epithelial cells (mean ± SE; n = 4–10 mice/group.Bioinformatic analysis to develop transcript panels. Toward our goal of developing panels of biomarker transcripts, which, in combination with these biological end points, might be used to screen for potential estrogenic activity of candidate chemicals, we used the EPIG tool (Chou et al. 2007) to identify patterns of gene expression in our microarray data sets. Because our data sets did not include sufficient numbers of test compounds for derivation of training and validation nor did they include test data sets to appropriately perform a prediction, we utilized a phenotypic anchoring approach. We correlated gene expression according to the samples defined by the strength of estrogen response. The statistical framework of this correlation has been well described (Chou et al. 2007) and has statistical properties that are similar to an ANOVA model (sample variances), t-test (group comparisons), and signal processing (signal-to-noise thresholding). However, our approach also leverages the biological responses of the samples within a group, and correlation of gene expression among the groups, to extract patterns of genes that have a low probability of being detected by chance. Hence, the statistical rigor in our methodology supports the selection of these biomarker transcripts combined with these biological end points as a potential screen for estrogenic activity of candidate chemicals (Table 1). Figure 1A shows patterns of transcript profiles in uterine tissue from mice treated with vehicle, PPT, E3, DES, or E2 for 2 or 24 hr. Each plot in Figure 1B represents one of the 16 response patterns extracted by EPIG. For example, the estrogenic compounds (E3, PPT, E2, and DES) increased the levels of the 2,481 probes in pattern 5 relative to vehicle after 2 hr, but the level of these probes returned to baseline by 24 hr. Similarly, the estrogenic compounds decreased the levels of the 2,002 probes in pattern 9 after 2 hr. The probes in these patterns could thus be used to examine whether a substance has estrogenic activity by evaluating the levels of these transcripts 2 hr after treatment. After 24 hr of treatment, E2 or DES more robustly increased the 4,467 probes in pattern 3 relative to vehicle than did PPT or E3. Only E2 or DES, but not PPT or E3, increased the 691 probes in pattern 7. After 24 hr of treatment, both E2 and DES repressed the 3,311 probes in pattern 14 relative to vehicle, whereas PPT and E3 were less effective. Therefore, long-acting versus short-acting estrogens could be distinguished by evaluating the levels of transcripts from patterns 3, 7, or 14 at 24 hr after treatment. After 2 hr of treatment, all of the compounds increased the levels of the 2,191 probes in pattern 1. However, after 24 hr, only DES and E2 maintained the increased levels of the probes, whereas the levels were lower for the short-acting estrogens. After 2 hr of treatment, all of the compounds decreased the levels of the 2,751 probes in pattern 16; however, after 24 hr, only DES and E2 maintained the repressed levels of the probes, but the short-acting estrogens returned to the vehicle level. Therefore, probes in patterns 1 and 16 could demonstrate estrogenic response at 2 hr and distinguish short-acting from long-acting estrogens at 24 hr.Two panels, each comprising 50 probes, were selected using a combined ANOVA and PCA approach, detailed in the Supplemental Material, “Deriving biomarker panels.” The first panel could be used to indicate potentially estrogenic substances based on their transcriptional response after 2 hr compared with vehicle-treated samples. The second panel could be used to indicate whether the estrogenic substance was short acting or long acting, based on the response at 24 hr. Our previous work indicated that BPA and HPTE are short-acting estrogens (Hewitt and Korach 2011). We used our previous microarray data sets (E2, E3, DES, BPA, HPTE, and PPT) to examine the expression of the probes in the biomarker panels. Supplemental Material, Figure S2A shows the level of the 50 probes 2 hr after treatment with E2, E3, DES, BPA, HPTE, or PPT relative to vehicle (see Supplemental Material, Supplemental XLSX, Table S6); all of the compounds showed responses distinct from vehicle at this time point. Supplemental Material, Figure S2B (see also Supplemental Material, Supplemental XLSX, Table S7) shows the 50 probes selected to distinguish long-acting estrogens (E2 and DES) from short-acting estrogens (E3, BPA, and HPTE). PPT was not included in the short- versus long-acting 24-hr panel analysis, because it is an ERα selective agonist but has not been classified as short- or long-acting. The biological data (Figure 2) indicated that PPT exhibited a response between long- and short-acting estrogens.RT-PCR and validation of transcript panels. To validate our potential screening strategy, as shown in Table 1, we evaluated a diarylheptanoid, D3 (Figure 3A) (Suksamrarn et al. 2008), which has traditionally been used by women in Thailand to relieve postmenopausal symptoms. Studies by Winuthayanon et al. (2009, 2013) have suggested that this compound has estrogenic properties. As a test of this concept, we used biological response end points together with probes selected from each biomarker panel. Treatment with D3 resulted in the entry of uterine epithelial cells into S phase, and EdU incorporation and uterine weight was increased to a level comparable with E2 after 24 hr (Figure 3B–D). However, the uterine weight after 72 hr was lower than that reached by E2 (Figure 3D) and was not statistically significant (p = 0.054), as reported in earlier studies (Winuthayanon et al. 2009, 2013). The lower weight increase after 72 hr of treatment was reflected in increased TUNEL-positive cells (Figure 3E,F) as well as in an attenuated LEH increase (Figure 3G). These biological observations are consistent with short-acting estrogenic activity. Therefore, we evaluated transcriptional responses of selected biomarker panel transcripts after 2 or 24 hr of treatment (Figure 4A,B). Of the 10 transcripts from the 2-hr panel we tested, 8 showed similar responses with E2, E3, or D3, but D3 did not significantly induce two of the transcripts (Cdkn1a and Stat5a) and induced Nup50 less robustly than did E2 or E3 (Figure 4A). In the 24-hr panel, 2 transcripts (Ndufab1 and Gfm1) showed no regulation with any of the tested substances (Figure 4B). The remaining 7 transcripts either showed no response with D3 (Kifc2, Rorc, Sox4, Ccnb1, Nubp1, and Aurkb) or a response that was significant but was blunted compared with the E2 response (Ccnb2) (Figure 4B). Depending on the transcript, E3 exhibited responses similar to those of D3 (Kifc2, Rorc, and Sox4) but in some cases the response was between those of D3 and E2 (Aurkb and Ccnb2).
Figure 3
Effects of saline vehicle (V), E2, and D3 after treatment for 24‑hr (B–D) or 72 hr (E–G). (A) Structure of D3. (B) Representative photomicrographs showing EdU incorporation in uterine epithelial cells 24 hr after treatment bar = 0.1 mm. (C) Percentage of EdU-positive cells in uterine epithelial cells 24 hr after treatment (mean ± SE; n = 5–7 mice/group). ***p < 0.001 compared with V by one-way ANOVA with uncorrected Fisher’s least significant difference (LSD). (D) Uterine weight (mean ± SE) at 24 hr after treatment (top; n = 9 mice/group) or 72 hr (24 hr after the last of three daily injections; bottom; n = 5 mice/group). ***p < 0.001, and ****p < 0.0001 compared with V, and +p < 0.01 compared with D3 by one-way ANOVA with uncorrected Fisher’s LSD. (E) Representative photomicrographs showing apoptotic cells in uteri collected at 72 hr (24 hr after the last of three daily injections) as determined by the TUNEL assay (bar = 0.2 mm; the arrowhead points to a TUNEL-positive cell. (F) Percentage of TUNEL-positive cells in uteri collected at 72 hr (24 hr after the last of three daily injections; mean ± SE; n = 8 mice/group). ***p < 0.001 by unpaired t-test. (G) LEH in uteri collected at 72 hr (24 hr after the last of three daily injections; mean ± SE; n = 8 mice/group). ****p < 0.0001 compared with V, and +p < 0.001 compared with E2 by one-way ANOVA with Tukey’s multiple comparison test.
Figure 4
RT-PCR of RNA samples from mice treated for 2 or 24 hr with saline vehicle (V), E2, E3, or D3 to validate biomarker panels. Values were calculated relative to V and normalized to Rpl7 (mean ±SE; n = 3–6/group). *p < 0.05, **p < 0.01, ***p < 0.001, ****p < 0.0001, and +p < 0.05 compared with E2 by one-way ANOVA, with multiple comparisons, with Tukey’s multiple test correction, except for Cdkn1a, with no multiple test correction (Fisher’s least signicant difference test). (A) Transcripts selected from the 2-hr panel to indicate estrogenic response after 2 hr: Cdkn1a,cyclin-dependent kinase inhibitor 1A; Synpo, synaptopodin; Cyr61, cysteine rich protein 61; Inhbb, Inhibin beta-B; Socs3, suppressor of cytokine signaling 3, Stat5a, signal transducer and activator of transcription 5A; Txnip, thioredoxin interacting protein; Btbd10, BTB (POZ) domain containing 10; Cdc42se, CDC42 small effector 1; Nup50, nucleoporin 50. (B) Transcripts selected from the 24-hr panel to distinguish long‑ from short-acting estrogens after 24 hr: Kifc2, kinesin family member C2; Rorc, RAR-related orphan receptor gamma; Sox4, SRY-box containing gene 4; Aurkb, aurora kinase B; Ccnb1, cyclin B1; Ccnb2, cyclin B2; Nubp1, nucleotide binding protein 1; Ndufab1, NADH dehydrogenase (ubiquinone) 1, alpha/beta subcomplex, 1 precursor; Gfm1, G elongation factor, mitochondrial 1 precursor.
Effects of saline vehicle (V), E2, and D3 after treatment for 24‑hr (B–D) or 72 hr (E–G). (A) Structure of D3. (B) Representative photomicrographs showing EdU incorporation in uterine epithelial cells 24 hr after treatment bar = 0.1 mm. (C) Percentage of EdU-positive cells in uterine epithelial cells 24 hr after treatment (mean ± SE; n = 5–7 mice/group). ***p < 0.001 compared with V by one-way ANOVA with uncorrected Fisher’s least significant difference (LSD). (D) Uterine weight (mean ± SE) at 24 hr after treatment (top; n = 9 mice/group) or 72 hr (24 hr after the last of three daily injections; bottom; n = 5 mice/group). ***p < 0.001, and ****p < 0.0001 compared with V, and +p < 0.01 compared with D3 by one-way ANOVA with uncorrected Fisher’s LSD. (E) Representative photomicrographs showing apoptotic cells in uteri collected at 72 hr (24 hr after the last of three daily injections) as determined by the TUNEL assay (bar = 0.2 mm; the arrowhead points to a TUNEL-positive cell. (F) Percentage of TUNEL-positive cells in uteri collected at 72 hr (24 hr after the last of three daily injections; mean ± SE; n = 8 mice/group). ***p < 0.001 by unpaired t-test. (G) LEH in uteri collected at 72 hr (24 hr after the last of three daily injections; mean ± SE; n = 8 mice/group). ****p < 0.0001 compared with V, and +p < 0.001 compared with E2 by one-way ANOVA with Tukey’s multiple comparison test.RT-PCR of RNA samples from mice treated for 2 or 24 hr with saline vehicle (V), E2, E3, or D3 to validate biomarker panels. Values were calculated relative to V and normalized to Rpl7 (mean ±SE; n = 3–6/group). *p < 0.05, **p < 0.01, ***p < 0.001, ****p < 0.0001, and +p < 0.05 compared with E2 by one-way ANOVA, with multiple comparisons, with Tukey’s multiple test correction, except for Cdkn1a, with no multiple test correction (Fisher’s least signicant difference test). (A) Transcripts selected from the 2-hr panel to indicate estrogenic response after 2 hr: Cdkn1a,cyclin-dependent kinase inhibitor 1A; Synpo, synaptopodin; Cyr61, cysteine rich protein 61; Inhbb, Inhibin beta-B; Socs3, suppressor of cytokine signaling 3, Stat5a, signal transducer and activator of transcription 5A; Txnip, thioredoxin interacting protein; Btbd10, BTB (POZ) domain containing 10; Cdc42se, CDC42 small effector 1; Nup50, nucleoporin 50. (B) Transcripts selected from the 24-hr panel to distinguish long‑ from short-acting estrogens after 24 hr: Kifc2, kinesin family member C2; Rorc, RAR-related orphan receptor gamma; Sox4, SRY-box containing gene 4; Aurkb, aurora kinase B; Ccnb1, cyclin B1; Ccnb2, cyclin B2; Nubp1, nucleotide binding protein 1; Ndufab1, NADH dehydrogenase (ubiquinone) 1, alpha/beta subcomplex, 1 precursor; Gfm1, G elongation factor, mitochondrial 1 precursor.The RNA samples were then analyzed using a NanoString CodeSet that included 129 biomarkers and 9 housekeeping probes. Most of the probes in each of the panels confirmed the expected patterns (see Supplemental Material, Figure S3), with the 2-hr probes indicating regulation relative to vehicle by E2, E3 or D3 (see Supplemental Material, Figure S3A) and the 24-hr panel confirming differential regulation by long- versus short-acting estrogens (see Supplemental Material, Figure S3B).
Discussion
Endocrine disruption describes a property of exogenous chemicals, either natural or man-made, that leads to perturbation of biological function via endogenous endocrine systems. These chemicals have the potential to greatly impact human health and the environment. However, endocrine disruption encompasses broad classes of chemicals that individually affect diverse biological signaling pathways. Thus, there is a need to focus on identifying which substances can affect which molecular events. In the present study, we designed a multipronged approach that combines transcriptional and phenotypic end points in order to evaluate chemicals suspected to affect estrogen signaling. As summarized in Table 1, our study design included treatment of ovariectomized mice with various chemicals and collecting uteri 2 hr or 24 hr after a single injection, or 24 hr after last of three daily injections (72 hr). Substances that are estrogenic increased epithelial cell DNA synthesis at the 24-hr end point and regulated transcripts in the 2-hr panel relative to vehicle or a nonestrogenic chemical at the 2-hr end point. Evaluation of uterine weights at the 24-hr and 72-hr end points could then be used to indicate whether an estrogenic substance is long-acting (weight increases observed) or short-acting (weight increase is attenuated or absent). At the 24-hr end point, regulation of transcripts in the 24-hr panel by long- versus short-acting estrogens was distinct, because short-acting estrogens exhibited impeded regulation of these transcripts. Although the end points utilized in our approach are most relevant to uterine responses, the resulting classification of compounds as short- or long-acting estrogens is important when evaluating potential impacts on other estrogen-sensitive tissues and species. In addition, our approach specifically evaluated ERα-mediated effects; ERα is essential for mouse uterine responses, revealed by the full spectrum of estrogen responsiveness exhibited by ERβ-null mice (Hewitt et al. 2003). Once substances are classified by this approach as short- or long-acting estrogens, subsequent analyses could gauge ERα- and ERβ-mediated activities, as well as responses in other estrogen-sensitive tissues and selective agonist versus antagonist activities. Thus, further analyses subsequent to these screens would be the next steps to evaluate whether xenoestrogens behave as selective estrogen receptor modulators such as tamoxifen (antagonistic in breast cells; agonist activity in endometrial tissue).A previous study revealed a role for ERα in protecting epithelial cells from undergoing apoptosis subsequent to the initial proliferation response (Winuthayanon et al. 2010). Here, we observed apoptosis of uterine epithelial cells as reflected by ineffective induction of the apoptosis inhibitor Birc1a, as well as increased detection of TUNEL-positive cells after 72 hr of treatment with short-acting estrogens (Table 1). This suggests that, similar to what we saw after ablation of epithelial ERα (Winuthayanon et al. 2010), short-acting estrogens are unable to maintain epithelial cell ERα activity following initial proliferation, and thus apoptosis occurs. This selective ability of long-acting estrogens to induce Birc1a can initially be seen after 24 hr (data not shown) but is most apparent after 72 hr.PPT is a known ERα selective agonist but has not previously been classified as short or long acting. In this study, some end points confirmed the estrogenic activity of PPT [DNA synthesis (Figure 2A) and 2-hr transcript regulation (see Supplemental Material, Figure S2A)]. However, on the basis of end points, it was difficult to pin down the activity as short or long acting. Uterine weight did not increase after 24 hr, but a significant uterine weight increase occurred after 72 hr; however, this increase was attenuated compared with that of long-acting estrogens (Figure 2D). In addition, PPT was significantly less effective at inducing Ltf (Figure 2G), but it induced the Birc1a apoptosis inhibitor equally as well as long-acting estrogens (Figure 2F), which likely explains the observed weight increase after 72 hr. Birc1a was not significantly increased by PPT after 24 hr (data not shown), and PPT-treated uteri exhibited TUNEL-positive cells at a level similar to that of E3 (Figure 2H,I). At 24 hr PPT increased Ltf less effectively than E2 or DES (not shown). On all the basis of the observed end points, we classify PPT as an intermediate compound that is not a long- or short-acting estrogen. We anticipate that other compounds tested in future analyses could also exhibit intermediate characteristics, and this will be vital in predicting the risks of harmful effects, because less severe effects would be predicted for a shorter-acting estrogen, but one with intermediate characteristics might need closer consideration.Our use of a diarylheptanoid (D3) compound isolated from a traditional Thai medicinal plant validated the approach outlined in Table 1. Most, but not all, transcripts from the biomarker panel probes tested by RT-PCR produced the expected transcript regulation patterns with E3 or D3. A more comprehensive analysis using the NanoString code set indicated that our biomarker panel shows promise for distinguishing estrogenicity and relative strength of endocrine disruptors. The regulation of three of the transcripts selected from the 24-hr panel (Nubp1, Ndufab1, Gfm1) could not be confirmed by RT-PCR. In the NanoString analysis, Nubp1 showed slight induction by E2, Ndufab1 was minimally regulated, and E2 selective induction of Gfm1 regulation was readily apparent (see Supplemental Material, Supplemental XLSX, Table S5). Differences may reflect disparities between the probes used on the microarray platform, NanoString probes, and the primer sets employed for RT-PCR.Other approaches have focused on high throughput screens to identify potential endocrine disruptors, such as the ambitious Tox21 project at the National Toxicology Program. Tox21 aims to evaluate toxicants using robotic screens based on in vitro end points (Huang et al. 2011). Initial efforts include focus on nuclear receptor interactions using ligand binding domains (LBD) of 10 different nuclear receptors in a Gal4-based response screen of a library containing approximately 3,000 environmentally relevant chemicals (Huang et al. 2011). The objective of the Tox21 approach is a broad, high throughput initial evaluation to identify chemicals for further consideration. The approach we have outlined here would be a logical next step for additional evaluation of chemicals that are positive in the Tox21 nuclear receptor assay and interact with ERα. The primary information obtained from the initial Tox21 screen reflects the chemical’s ability to bind to and modulate the activity of the LBD of the ERα (the assay included only this portion of the receptor) and measures regulation of exogenous reporter gene activity. Such an approach lacks the inter- and intramolecular interactions mediated in the context of the full-length ERα molecule and representation of in vivo responses of endogenous genes. In addition, the Tox21 assay will not capture subtleties of estrogenic response, such as those typified by long- versus short-acting estrogenic activities. Our assay scheme is useful in the context of a “second step” after an initial broad screen because the Tox21 approach is more realistic for evaluating thousands of chemicals. Our approach focuses on end points observed in mouse uterine tissue and thus may not reflect effects in other estrogen target tissues, such as breast or liver, or effects in other species. However, our panel of phenotypic and transcription response is an appropriate partner to the broad Tox 21 approach and could be used to fine tune and finesse the mechanistic particulars and biological effects in a real whole animal context.Moggs et al. (2004) combined bioinformatics and phenotypic anchoring approaches to a similar model, the immature mouse uterus. Although their approach is very useful toward defining transcriptional profiles that underlie phenotypic observations, it is not designed for the type of evaluation of mechanisms of action we focused on in our study. Watanabe et al. (2004) also used the ovariectomized mouse model to compare transcriptional responses of uterine tissue 6 hr after injection of E2 or 2,3,7,8-tetrachlorodibenzo-p-dioxin (TCDD). In their study, some uterine transcripts were regulated in a similar manner by E2 or TCDD, suggesting estrogenic activity of TCDD. Many of the estrogen-responsive transcripts showed a weaker response with TCDD. Unlike our approach, however, their screen was not a comprehensive attempt to select probes for screening. In another study Hong et al. (2006) used the immature rat model to evaluate uterine transcript profiles 24 hr after the last of three daily injections of E2, DES, or the endocrine disruptors BPA, genistein, and octylphenol or nonylphenol. Unlike the present study, the transcript profile for each substance was distinct, with few commonly regulated probes. This is especially surprising in the case of DES- versus E2-regulated transcripts, which revealed only 126 common probes out of 555 E2-regulated and 674 DES-regulated probes (Hong et al. 2006), whereas we observed similar uterine responses to 72-hr E2 or DES in our model (Figure 1). RT-PCR analysis of several transcripts revealed responses consistent with our observations, with E2 and DES inducing transcripts at the 72-hr time point and BPA showing no induction (Hong et al. 2006). Naciff et al. (2002) developed a gestational exposure model to evaluate uterine transcripts in gestational day (GD) 20 rat pups 2 hr after the last daily injection of ethynyl E2, BPA, or genistein on GDs 11–20. The approach of Naciff et al. is complementary to ours: They sought to develop a transcriptional profile “fingerprint” as evidence of gestational exposures and we focused on discerning potential modes of action reflecting biochemical characteristics.In vitro models have also been developed utilizing Ishikawa cells, a humanendometrial cancer cell line. Boehme et al. (2009) compared transcriptional profiles of ERα-positive and -negative Ishikawa cells dosed for 24 hr with the estrogenic chemicals DES, BPA, genistein, zearalenone, resveratrol, or o,p´-dichlorodiphenyltrichlorethane (DDT), or with the ER antagonist ICI 182,780. From their analysis, they derived a panel of estrogen-responsive transcripts as candidates for screening of estrogenic activity. Similar to our observations, BPA showed weaker activity (Boehme et al. 2009). Naciff et al. (2010) compared transcriptional profiles of ERα-positive Ishikawa cells treated with ethynyl E2 or BPA for 8 hr, 24 hr, or 48 hr, with the focus on developing a relevant in vitro estrogen response model. These authors identified 307 commonly regulated probes as candidate biomarkers of potential estrogenic activity. They further compared their BPA-responsive Ishikawa transcripts with uterine transcriptional profiles from juvenile rats dosed with estrogen for 8, 24, or 48 hr and observed 362 commonly regulated transcripts (Naciff et al. 2010). Using another approach, Bredhult et al. (2009) reported transcriptional analysis of primary cultures of human endometrial endothelial cells (HEEC) 24 hr after treatment with BPA, which led to decreased HEEC growth. They did not observe effects on known estrogen-responsive transcripts; however, because HEECs are ERα negative and express ERβ, responses might reflect, in part, ERβ targets. Abot et al. (2013) derived a panel of 40 estrogen-responsive transcripts from published mouse uterus microarray data sets and also included evaluation of phenotypic end points, including uterine weights and the proliferative marker Ki67. Their study was focused on the role of the AF1 domain of ERα in the uterus, which has been shown to be an AF1-stimulated tissue (Arao et al. 2011). Abot et al. (2013) were able to use tamoxifen (an AF1-dependent estrogenic ligand) and mutations that disabled AF1 activity of the ERα to demonstrate roles of AF1 as illustrated by changes in transcription or biological end points. However, these useful studies are not designed to further screen mechanisms underlying activity or potential biological outcomes.
Conclusion
The approach presented here (outlined in Table 1) could be used to evaluate potentially estrogenic chemicals and could indicate possible biological mechanisms that would improve our understanding of the potential impacts on human health.Click here for additional data file.Click here for additional data file.
Authors: Wipawee Winuthayanon; Sylvia C Hewitt; Grant D Orvis; Richard R Behringer; Kenneth S Korach Journal: Proc Natl Acad Sci U S A Date: 2010-10-25 Impact factor: 11.205
Authors: Sylvia C Hewitt; Grace E Kissling; Karen E Fieselman; Friederike L Jayes; Kevin E Gerrish; Kenneth S Korach Journal: FASEB J Date: 2010-07-28 Impact factor: 5.191
Authors: Jorge M Naciff; M Lynn Jump; Suzanne M Torontali; Gregory J Carr; Jay P Tiesman; Gary J Overmann; George P Daston Journal: Toxicol Sci Date: 2002-07 Impact factor: 4.849
Authors: Ruili Huang; Menghang Xia; Ming-Hsuang Cho; Srilatha Sakamuru; Paul Shinn; Keith A Houck; David J Dix; Richard S Judson; Kristine L Witt; Robert J Kavlock; Raymond R Tice; Christopher P Austin Journal: Environ Health Perspect Date: 2011-05-04 Impact factor: 9.031
Authors: Laurel A Coons; Sylvia C Hewitt; Adam B Burkholder; Donald P McDonnell; Kenneth S Korach Journal: Endocrinology Date: 2017-10-01 Impact factor: 4.736
Authors: Sylvia C Hewitt; Rong Li; Nyssa Adams; Wipawee Winuthayanon; Katherine J Hamilton; Lauren J Donoghue; Sydney L Lierz; Marleny Garcia; John P Lydon; Francesco J DeMayo; Karen Adelman; Kenneth S Korach Journal: FASEB J Date: 2018-10-17 Impact factor: 5.191
Authors: Wendy N Jefferson; Elizabeth Padilla-Banks; Alisa A Suen; Lindsey J Royer; Sharon M Zeldin; Ripla Arora; Carmen J Williams Journal: Environ Health Perspect Date: 2020-03-18 Impact factor: 9.031