Literature DB >> 20209125

Integrative meta-analysis of differential gene expression in acute myeloid leukemia.

Brady G Miller1, John A Stamatoyannopoulos.   

Abstract

BACKGROUND: Acute myeloid leukemia (AML) is a heterogeneous disease with an overall poor prognosis. Gene expression profiling studies of patients with AML has provided key insights into disease pathogenesis while exposing potential diagnostic and prognostic markers and therapeutic targets. A systematic comparison of the large body of gene expression profiling studies in AML has the potential to test the extensibility of conclusions based on single studies and provide further insights into AML. METHODOLOGY/PRINCIPAL
FINDINGS: In this study, we systematically compared 25 published reports of gene expression profiling in AML. There were a total of 4,918 reported genes of which one third were reported in more than one study. We found that only a minority of reported prognostically-associated genes (9.6%) were replicated in at least one other study. In a combined analysis, we comprehensively identified both gene sets and functional gene categories and pathways that exhibited significant differential regulation in distinct prognostic categories, including many previously unreported associations.
CONCLUSIONS/SIGNIFICANCE: We developed a novel approach for granular, cross-study analysis of gene-by-gene data and their relationships with established prognostic features and patient outcome. We identified many robust novel prognostic molecular features in AML that were undetected in prior studies, and which provide insights into AML pathogenesis with potential diagnostic, prognostic, and therapeutic implications. Our database and integrative analysis are available online (http://gat.stamlab.org).

Entities:  

Mesh:

Year:  2010        PMID: 20209125      PMCID: PMC2830886          DOI: 10.1371/journal.pone.0009466

Source DB:  PubMed          Journal:  PLoS One        ISSN: 1932-6203            Impact factor:   3.240


Introduction

Acute myeloid leukemia (AML) is a heterogeneous disease with overall poor survival. The prognosis of AML is highly conditioned on the presence of specific cytogenetic and molecular abnormalities. Among AMLs with abnormal cytogenetics, the presence of t(8;21), t(15;17) or inv(16) is widely recognized as conferring favorable prognosis, while a variety of other chromosomal aberrations define a poor prognostic group.[1] However, the majority of AMLs are cytogenetically normal (CN) and collectively define an intermediate prognostic group. Within the CN group, several molecular abnormalities have been associated with prognosis. For example, FLT3-ITD carries a unfavorable prognosis, while both NPM1 and CEBPA mutations confer a favorable prognosis.[2] Systematic application of gene expression profiling to AML samples has revealed that major prognostic subgroups based on cytogenetics and molecular markers are recapitulated in large-scale gene expression patterns.[3] A large body of AML gene expression profiling studies has emerged together with reported correlations with pathogenesis, diagnosis, risk classification, and outcome prediction.[4], [5], [6], [7], [8], [9], [10], [11], [12], [13], [14], [15], [16], [17], [18], [19], [20], [21], [22], [23], [24], [25], [26], [27], [28], [29], [30], [31], [32], [33] However, these studies have not been systematically compared. Such a comparison has the potential to test the extensibility of conclusions based on single studies, and may provide further insights into AML pathogenesis while exposing potential diagnostic and prognostic markers and therapeutic targets. A priori, there are two general approaches to comparing gene expression profiling studies. The first and most rigorous approach requires normalization and re-analysis of raw expression data. However, this approach is not practical in cases where raw data are not available from a significant number of studies or is in an unusable form. Indeed, a recent review revealed that only one third of published papers have deposited raw data that are considered robust enough to allow valid multi-study comparisons.[34] An alternative approach focuses on comparative analysis of the published lists of significantly over-expressed or under-expressed genes.[35] This type of analysis involves discovery of gene intersections in published lists, and has been effectively utilized in a variety of contexts such as identification of biomarkers in thyroid and colorectal cancer.[36], [37] Although several tools and repositories have been developed to facilitate identification of significant gene intersections[38], [39], [40], the heterogeneity of the published gene lists for AML require development of a novel approach that will allow a fine-grained comparison and analysis. In this paper we describe a systematic, fine-grained multi-study comparison of heterogeneous differentially expressed gene sets emerging from 25 expression profiling studies of AML published between 1999 and 2008. Our approach includes collection of the published gene lists, standardized annotation of each listed gene with identification tags, and a functional analysis of the gene lists that are associated with each identification tag ( ). We identified high interest genes in AML along with genes and functional gene ontology (GO) categories associated with prognosis and common AML subtypes. We discovered many robust novel prognostic molecular features that were undetected in prior studies. Our results provide novel insights into AML pathogenesis with potential diagnostic, prognostic, and therapeutic implications.
Figure 1

Tag-based classification method flowchart.

Results

Categorization of Differentially Expressed Genes

A total of 15,809 expression features were available from 25 studies, utilizing 10 different microarray platforms, and comprising a total of 2,744 patient samples ( ). Of the 15,809 expression features, 7,416 were classified as up-regulated, 6,419 were classified as down-regulated, and 1,974 were not classified with respect to an expression direction. A total of 14,385 (91%) expression features could be mapped to a gene symbol in the UCSC hg18 database, which comprised a total of 4,918 genes.
Table 1

Acute Myelogenous Leukemia expression profiling studies included in analysis.

ReferencePlatformDiseaseNo. of samplesNo. of differentially expressed featuresNo. of differentially expressed mapped features
Golub et al, 19994 Affymetrix HU6000AML/ALL7210078
Okutsu et al, 20026 Custom cDNA 23,040 clonesAML76491355
Schoch et al, 20027 Affymetrix U95Av2AML37150140
Debernardi et al, 20038 Affymetrix U95Av2AML287775
Kohlmann et al, 20039 Affymetrix U95Av2 Affymetrix U133AAML/ALL90156147
Yagi et al, 200310 Affymetrix U95Av2AML541,9101,753
Bullinger et al, 200411 Custom cDNA 39,711 clonesAML1161,040855
Lacayo et al, 200412 Custom cDNA 42,749 clonesAML100436329
Neben et al, 200413 Custom cDNA 4211 clonesAML29170162
Ross et al, 200414 Affymetrix U133AAML150713682
Valk et al, 2004 * 15 Affymetrix U133AAML293779745
Vey et al, 200416 DiscoveryChip cDNA 9,039 clonesAML55197119
Alcalay et al, 200517 Affymetrix U133AAML78554541
Gutierrez et al, 200518 Affymetrix U133AAML43181167
Heuser et al, 200520 Custom cDNA 41,424 clonesAML137178146
Haferlach et al, 200519 Affymetrix U133AAML352019
Neben et al, 200521 Custom cDNA 4,211 clonesAML110250250
Verhaak et al, 200522 Affymetrix U133AAML275568555
Radmacher et al, 200625 Affymetrix U133plus2.0AML64314304
Wilson et al, 200626 Affymetrix U95Av2AML170705674
Gal et al, 200623 Affymetrix U133AAML5822724
Bullinger et al, 200727 Custom cDNA 39,711 clonesAML934,1203,828
Eisele et al, 200728 Affymetrix U133AAML118282
Mullighan et al, 200733 Affymetrix U133AAML931,1881,095
Wouters et al, 200731 Affymetrix U133plus2.0AML530608560
Total 10 platforms2,74415,80914,385

*Included further analysis of data by Verhaak 200522 and Wilson 200626.

*Included further analysis of data by Verhaak 200522 and Wilson 200626.

Standardized Annotation of Gene Expression Features

We annotated each expression feature with standardized identification tags and comparison conditions. The identification tags are a set of descriptors that describe the context of the expression feature, such as the experiment type (RT-PCR or microarray) and the results including prognostic category associations. The database contained 91 unique identification tags (). The comparison conditions describe the samples that are compared in each experiment and the database contained 78 unique comparison conditions ().

Genes Associated with AML

We then identified genes that were reported in multiple studies. Of the total 4,918 genes, 1,686 (34.3%) were reported in more than one study. We ranked genes that were listed in at least 8 studies by number of references, number of expression platforms, and number of expression features ( ). Although most of these genes have been associated with AML elsewhere in the literature, several genes (VCAN and PGDS) were only described in AML cell lines and a surprising number of the genes (HLA-DPA1, ITM2A, RBPMS, RGS10, RNASE2 and TRH) were not specifically described in AML. VCAN is a component of the extracellular matrix modulating cell adhesion, cell proliferation, cell migration, and extracellular matrix assembly.[41] High expression of VCAN has been found in many malignancies, such as melanomas, ovarian, breast, and lung tumors,[41] and in the acute monocytic leukemia cell line, THP-1.[42] PGDS is an enzyme that catalyzes the conversion of PGH2 to PGD2, which is a prostaglandin involved in vasodilation, bronchoconstriction, inhibition of platelet aggregation, and recruitment of inflammatory cells.[43] PGDS expression has been reported in two megakaryoblastic cell lines, CMK and Dami.[43] TRH is a neurotransmitter/neuromodulator in the central and peripheral nervous system and is released by the hypothalamus to regulate the biosynthesis of TSH in the anterior pituitary gland.[44] HLA-DPA1 is a HLA class II gene involved in antigen presentation, and has been associated with esophageal squamous dysplasia[45] and pilocytic astrocytomas[46]. RNASE2 is a cationic ribonuclease toxin found in eosinophil granules[47] and reported to have chemotactic[48] and antiviral[49] activities. RBPMS is a RNA-binding protein with an unclear specific function and at least 12 different splice variants.[50] ITM2A is a type II transmembrane glycoprotein expressed in vesicles and on the cell surface and has been noted to be up-regulated during T-cell activation.[51] ITM2A has been associated with chrondrogenic[52] and myogenic differentiation[53]. RGS10 acts as a GTPase-activating protein via modulation of Gαi and Gαz signaling[54], and promotes chrondrogenic differentiation in mice.[55] Expression of RGS10 has been noted in lymphocytes[56] and rat platelets[57].
Table 2

Genes most frequently published in AML expression studies.

RankGene symbolNo. of referencesNo. of platformsNo. of differentially expressed featuresGene name
1 HOXB2 12632homeobox B2
2 PBX3 12531pre-B-cell leukemia homeobox 3
3 HOXA9 11435homeobox A9
4 POU4F1 11329POU class 4 homeobox 1
5 TSPAN7 10516tetraspanin 7
6 MYH11 10338myosin, heavy chain 11, smooth muscle
7 RUNX1T1 10334runt-related transcription factor 1; translocated to, 1 (cyclin D-related)
8 TRH 10321thyrotropin-releasing hormone
9 HLA-DPA1 10320major histocompatibility complex, class II, DP alpha 1
10 HOXB5 9532homeobox B5
11 SPARC 9516secreted protein, acidic, cysteine-rich (osteonectin)
12 HOXA10 9434homeobox A10
13 RNASE2 9418ribonuclease, RNase A family, 2 (liver, eosinophil-derived neurotoxin)
14 CD34 9316CD34 molecule
15 MEIS1 9316Meis homeobox 1
16 RUNX3 8523runt-related transcription factor 3
17 VCAN 8522versican proteoglycan
18 RBPMS 8421RNA binding protein with multiple splicing
19 HOXA4 8418homeobox A4
20 MN1 8416meningioma (disrupted in balanced translocation) 1
21 PRAME 8411preferentially expressed antigen in melanoma
22 JAG1 8320jagged 1 (Alagille syndrome)
23 ITM2A 8318integral membrane protein 2A
24 RGS10 8317regulator of G-protein signaling 10
25 PGDS * 8212prostaglandin D2 synthase, hematopoietic

The genes reported in at least eight independent studies are presented here. In order of preference, the genes are ranked by the number of independent studies, the number of unique platforms, and the total number of differentially expressed features.

*Gene symbol is not approved by HUGO Gene Nomenclature Committee.

The genes reported in at least eight independent studies are presented here. In order of preference, the genes are ranked by the number of independent studies, the number of unique platforms, and the total number of differentially expressed features. *Gene symbol is not approved by HUGO Gene Nomenclature Committee.

Concordant Gene Expression Identified in Multiple Studies

We then identified prognostic categories that were reported in greater than 3 independent studies and stratified these by number of genes, differential expression direction, and number of independent studies ( ). This analysis revealed the existence of genes in categories of AML that were strictly up-regulated or down-regulated across multiple studies.
Table 3

Number of genes and independent publications with selected prognostic categories.

Tag (total genes) (total references)No. genes in 1 studyNo. genes in 2 studiesNo. genes in 3 studiesNo. genes in 4 studiesNo. genes in 5 studiesNo. genes in 6 studiesNo. genes in 7 studiesNo. genes in 8 studies
poor prog (1727) (12)all genes1559138273
up-regulated586282
down-regulated94355101
good prog (1638) (11)all genes14841341811
up-regulated9256291
down-regulated528242
NPM1 mut (1169) (5)all genes97814732111
up-regulated541421871
down-regulated43696132
t(15;17) (230) (9)all genes18825971
up-regulated1151756
down-regulated568411
inv(16) (1322) (9)all genes11978823761
up-regulated5334412721
down-regulated2851541
t(8;21) (1195) (9)all genes10579223154121
up-regulated25332134121
down-regulated5522752
11q23 (482) (5)all genes459194
up-regulated651
down-regulated453
FLT3-ITD (235) (4)all genes224101
up-regulated1352
down-regulated67
normal cyto (519) (6)all genes480363
up-regulated1731
down-regulated2066

The AML prognosis and subtype identification tags reported in greater than 3 independent studies are shown with the number of genes listed by number of independent studies and differential expression direction. Identification tag descriptions can be found in Table S1. Note that the following tags are abbreviated: poor prog is poor prognosis, good prog is good prognosis, NPM1 mut is NPM1 mutation, and normal cyto is normal cytogenetics.

The AML prognosis and subtype identification tags reported in greater than 3 independent studies are shown with the number of genes listed by number of independent studies and differential expression direction. Identification tag descriptions can be found in Table S1. Note that the following tags are abbreviated: poor prog is poor prognosis, good prog is good prognosis, NPM1 mut is NPM1 mutation, and normal cyto is normal cytogenetics.

Hierarchical Cluster Analyses of Differentially Expressed Genes

We next performed hierarchical clustering of differentially expressed genes associated with AML prognostic categories ( ). We identified 5 major clusters. Cluster 1 includes aneuploid, abnormal cytogenetics, CD34+CD38+ AML fraction, high centrosome aberrations and poor prognosis. Cluster 2 includes FAB-M4, FAB-M5, inv(16) and monocytic. Cluster 3 includes a large group of heterogeneous identification tags. Cluster 4 identifies FLT3-TKD, euploid, FAB-M7, CEBPA silenced, and NRAS-PM. Cluster 5 includes FLT3 mutation, FLT3-ITD, normal cytogenetics and NPM1 mutation. Cluster 1 corresponds to features noted in poor prognosis AML, cluster 2 corresponds to features found in monocytic differentiated AML, while cluster 5 includes AML subtypes that are found in cytogenetically normal (CN) AML.
Figure 2

Hierarchical cluster analyses.

Strict up-regulation is green and strict down-regulation is red, while light blue represents no reported specific direction. Identification tag descriptions can be found in Table S1. (A) Hierarchical cluster analysis of the 3998 differentially expressed genes (x-axis) of AML prognostic categories (y-axis). For illustration purposes, we notated and manually separated 5 major clusters. Cluster 1 includes aneuploid, abnormal cytogenetics, CD34+CD38+ AML fraction, high centrosome aberrations and poor prognosis. Cluster 2 includes FAB-M4, FAB-M5, inv(16) and monocytic. Cluster 3 includes a large group of heterogenous identification tags. Cluster 4 identifies FLT3-TKD, euploid, FAB-M7, CEBPA silenced, and NRAS-PM. Cluster 5 includes FLT3 mutation, FLT3-ITD, normal cytogenetics and NPM1 mutation. (B) Hierarchical cluster analysis of the 541 differential GO categories (x-axis) of AML prognostic categories (y-axis). For illustration purposes, we notated and manually separated 6 major clusters. Cluster 1 includes NPM1 mutation, good prognosis and normal cytogenetics. Cluster 2 includes NRAS-PM and MLL fusion gene. Cluster 3 includes inv(16), high centrosome aberrations, abnormal cytogenetics, 11q23, aneuploid, CEBPA silenced, FAB-M7, and poor prognosis. Cluster 4 includes FLT3 mutation, FLT3-ITD and t(11;19). Cluster 5 includes CD34+CD38+ AML fraction, CBF, FAB-M4, FAB-M5, monocytic, and normal patient controls. Cluster 6 includes a large group of heterogenous identification tags.

Hierarchical cluster analyses.

Strict up-regulation is green and strict down-regulation is red, while light blue represents no reported specific direction. Identification tag descriptions can be found in Table S1. (A) Hierarchical cluster analysis of the 3998 differentially expressed genes (x-axis) of AML prognostic categories (y-axis). For illustration purposes, we notated and manually separated 5 major clusters. Cluster 1 includes aneuploid, abnormal cytogenetics, CD34+CD38+ AML fraction, high centrosome aberrations and poor prognosis. Cluster 2 includes FAB-M4, FAB-M5, inv(16) and monocytic. Cluster 3 includes a large group of heterogenous identification tags. Cluster 4 identifies FLT3-TKD, euploid, FAB-M7, CEBPA silenced, and NRAS-PM. Cluster 5 includes FLT3 mutation, FLT3-ITD, normal cytogenetics and NPM1 mutation. (B) Hierarchical cluster analysis of the 541 differential GO categories (x-axis) of AML prognostic categories (y-axis). For illustration purposes, we notated and manually separated 6 major clusters. Cluster 1 includes NPM1 mutation, good prognosis and normal cytogenetics. Cluster 2 includes NRAS-PM and MLL fusion gene. Cluster 3 includes inv(16), high centrosome aberrations, abnormal cytogenetics, 11q23, aneuploid, CEBPA silenced, FAB-M7, and poor prognosis. Cluster 4 includes FLT3 mutation, FLT3-ITD and t(11;19). Cluster 5 includes CD34+CD38+ AML fraction, CBF, FAB-M4, FAB-M5, monocytic, and normal patient controls. Cluster 6 includes a large group of heterogenous identification tags.

Hierarchical Cluster Analyses of Gene Functional Categories

Next, we performed hierarchical cluster analyses of functional categories associated with AML related identification tags ( ). We identified 6 clusters. Cluster 1 includes NPM1 mutation, good prognosis and normal cytogenetics. Cluster 2 includes NRAS-PM and MLL fusion gene. Cluster 3 includes inv(16), high centrosome aberrations, abnormal cytogenetics, 11q23, aneuploid, CEBPA silenced, FAB-M7, and poor prognosis. Cluster 4 includes FLT3 mutation, FLT3-ITD and t(11;19). Cluster 5 includes CD34+CD38+ AML fraction, CBF, FAB-M4, FAB-M5, monocytic, and normal patient controls. Cluster 6 includes a large group of heterogeneous identification tags. Cluster 1 corresponds to features noted in good prognosis AML while cluster 3 corresponds to several features noted in poor prognosis AML.

Analysis of HOX and TALE Gene Families

The HOX/TALE genes encode transcription factors regulating pattern formation, differentiation, and proliferation, and there is considerable evidence in the literature associating dysregulation of HOX/TALE genes in AML. [58] We identified 24 homeodomain (HOX/TALE) genes that were listed in at least one study (). We observed an overall increase in HOX/TALE expression in AML with normal cytogenetics, NPM1 mutations, FLT3 mutations, and 11q23 abnormalities involving the MLL gene. Overall decreases in HOX/TALE expression were observed in normal CD34+ cells, AML with CEBPA mutations and AML with abnormal cytogenetics, specifically t(15;17), t(8;21), and inv(16). This pattern is consistent with previous RT-PCR studies screening HOX/TALE genes expression levels[59], [60], [61], [62], [63], [64], although the association of CEBPA mutations with decreased HOX/TALE expression has not been reported previously.

Analysis and Replication of Prognostic Categories

Next, we focused on genes associated with good and poor prognosis. We defined ‘good prognosis’ as a relatively increased overall survival or disease free survival or response to therapy. We defined ‘poor prognosis’ as a relatively decreased overall survival or disease free survival or response to therapy. The good prognosis and poor prognosis gene sets are largely reciprocal. Surprisingly, only 9.6% of these genes were replicated with concordant expression directions in more than one study. The top ranked up-regulated and down-regulated genes associated with poor prognosis are shown in and respectively. The top ranked up-regulated and down-regulated genes associated with good prognosis are shown in .
Table 4

Top ranked up-regulated genes associated with poor prognosis.

RankGene symbolNo. of specific referencesTotal no. of referencesTotal no. of platformsTotal no. of differentially expressed featuresGene name
1 BCL11A 35419B-cell CLL/lymphoma 11A (zinc finger protein)
2 TBXAS1 35411thromboxane A synthase 1 (platelet, cytochrome P450, family 5, subfamily A)
3 HOXB5 29532homeobox B5
4 HOXA10 29434homeobox A10
5 CD34 29316CD34 molecule
6 RBPMS 28421RNA binding protein with multiple splicing
7 HOXA4 28418homeobox A4
8 MN1 28416meningioma (disrupted in balanced translocation) 1
9 GNAI1 26312guanine nucleotide binding protein (G protein), alpha inhibiting, activity polypeptide 1
10 SKAP2 25421src kinase associated phosphoprotein 2
11 MCM3 2549minichromosome maintenance complex component 3
12 CLIP2 2538CAP-GLY domain containing linker protein 2
13 DAPK1 2538death-associated protein kinase 1
14 GUCY1A3 2448guanylate cyclase 1, soluble, alpha 3
15 ANGPT1 24311angiopoietin 1
16 MTHFD1 2436methylenetetrahydrofolate dehydrogenase (NADP+ dependent) 1, methenyltetrahydrofolate cyclohydrolase, formyltetrahydrofolate synthetase
17 MAP7 23314microtubule-associated protein 7
18 UGCGL2 23311UDP-glucose ceramide glucosyltransferase-like 2
19 SH2B3 2336SH2B adaptor protein 3
20 FLT3 2335fms-related tyrosine kinase 3

In order of preference, the genes are ranked by the number of poor prognosis related independent studies, the total number of independent studies, the total number of unique platforms, and the total number of features. Genes that were also associated with good prognosis with the same expression direction are not shown.

Table 5

Top ranked down-regulated genes associated with poor prognosis.

RankGene symbolNo. of specific referencesTotal no. of referencesTotal no. of platformsTotal no. of differentially expressed featuresGene name
1 EML4 44322echinoderm microtubule associated protein like 4
2 C3AR1 3629complement component 3a receptor 1
3 SMG1 * 35426phosphatidylinositol 3-kinase-related protein kinase
4 FOXO1 35415forkhead box O1
5 IL6ST 34318interleukin 6 signal transducer (gp130, oncostatin M receptor)
6 UGCG 34312UDP-glucose ceramide glucosyltransferase
7 ADFP 34212adipose differentiation-related protein
8 AZU1 3428azurocidin 1 (cationic antimicrobial protein 37)
9 SNX9 33214sorting nexin 9
10 PIK3R4 3328phosphoinositide-3-kinase, regulatory subunit 4, p150
11 SEMA3F 3326sema domain, immunoglobulin domain (Ig), short basic domain, secreted, (semaphorin) 3F
12 JAG1 28320jagged 1 (Alagille syndrome)
13 CD3D 27421CD3d molecule, delta (CD3-TCR complex)
14 SLC7A7 26514solute carrier family 7 (cationic amino acid transporter, y+ system), member 7
15 ENDOD1 26413endonuclease domain containing 1
16 GYPC 26411glycophorin C (Gerbich blood group)
17 ISG20 26317interferon stimulated exonuclease gene 20 kDa
18 EZR 25413Ezrin
19 AGRN 25412Agrin
20 NRP1 2539neuropilin 1

In order of preference, the genes are ranked by the number of poor prognosis related independent studies, the total number of independent studies, the total number of unique platforms, and the total number of features. Genes that were also associated with good prognosis with the same expression direction are not shown.

*Gene symbol is not approved by HUGO Gene Nomenclature Committee.

In order of preference, the genes are ranked by the number of poor prognosis related independent studies, the total number of independent studies, the total number of unique platforms, and the total number of features. Genes that were also associated with good prognosis with the same expression direction are not shown. In order of preference, the genes are ranked by the number of poor prognosis related independent studies, the total number of independent studies, the total number of unique platforms, and the total number of features. Genes that were also associated with good prognosis with the same expression direction are not shown. *Gene symbol is not approved by HUGO Gene Nomenclature Committee.

Genes Associated with Prognosis

The majority of the top-ranked genes up-regulated in poor and good prognosis, which are listed in , , and , have not been described elsewhere in human AML literature. Although not associated elsewhere with prognosis, HOXB5 [65], DAPK1 [66], ANGPT1 [67], TCF4 [68], C3AR1 [69], CAT [70], IL6ST [71], JAG1 [32], EZR [32], TP53BP2 [72] and TNFAIP2 [73] have been described in AML. HOXA10, CD34, HOXA4, MN1, NME1, FOXO1, NRP1, UGCG and FLT3 are the only genes listed that have been associated with prognosis of AML in other studies. These studies have described up-regulation of MN1 [74], NME1 [75], HOXA10 [59], and FLT3[76] in poor prognosis AML which correlates with our comparison, while there are conflicting reports of HOXA4 [59], [60] and CD34 gene expression in poor prognosis AML. CD34 is notable and likely represents a false positive result in our comparison. Although up-regulation of CD34 was initially described to correlate with a decreased response to therapy,[77] it is has since been shown that up-regulation of this gene actually correlates with abnormal cytogenetics, including t(8;21), and is not associated with a decrease in overall survival or disease-free survival.[78] Phosphorylation of FOXO1 has been reported to correlate with decreased overall survival in AML, although transcript expression levels have not been reported as having any correlation with overall survival.[79] Up-regulation of both NRP1 [80] and UGCG [81] have been previously correlated with decreased survival and chemoresistance in AML respectively, which both contradict the results of our comparison.

Functional Categories and Prognosis

We then identified the functional categories associated with poor prognosis and good prognosis. The specific over-represented functional categories of the up-regulated genes and down-regulated genes associated with poor prognosis and good prognosis are summarized in . Detailed tables describing the over-represented functional categories of up-regulated genes and down-regulated genes associated with poor prognosis and good prognosis are listed in , , and respectively. Interestingly, many of the over-represented functional categories of up-regulated genes associated with poor prognosis were shared with up-regulated genes in aneuploidy, high centrosome aberrations and CD34+CD38+ AML fraction, and down-regulated genes in euploidy, low centrosome aberrations, NPM1 mutations, good prognosis AML, CD34+CD38- AML fraction, and FLT3-ITD. These results are consistent with increased expression of genes involved in differentiation and apoptosis dysregulation in good prognosis AML and increased expression of genes involved in proliferation in poor prognosis AML.
Figure 3

Functional category comparisons.

(A) Significantly over-represented functional gene ontology (GO) categories of interest in up-regulated and down-regulated genes found in poor prognosis and good prognosis are compared; the comprehensive functional gene ontology listings can be found in Table S5, Table S6, Table S7, and Table S8. (B) Significantly over-represented functional gene ontology (GO) categories of interest in up-regulated and down-regulated genes found in AML with NPM1 mutation, t(15;17), t(8;21) and inv(16) are compared; the comprehensive functional gene ontology listings can be found in Table S13, Table S14, Table S15, Table S16, Table S17, Table S18, Table S19, Table S20. Corrected p-value is the Bonferroni multiple hypothesis.

Functional category comparisons.

(A) Significantly over-represented functional gene ontology (GO) categories of interest in up-regulated and down-regulated genes found in poor prognosis and good prognosis are compared; the comprehensive functional gene ontology listings can be found in Table S5, Table S6, Table S7, and Table S8. (B) Significantly over-represented functional gene ontology (GO) categories of interest in up-regulated and down-regulated genes found in AML with NPM1 mutation, t(15;17), t(8;21) and inv(16) are compared; the comprehensive functional gene ontology listings can be found in Table S13, Table S14, Table S15, Table S16, Table S17, Table S18, Table S19, Table S20. Corrected p-value is the Bonferroni multiple hypothesis.

Analysis of Molecular and Cytogenetic Subtypes

We then surveyed specific molecular and cytogenetic subtypes of AML that reported genes in greater than 3 independent studies. This includes NPM1 mutations, t(15;17), inv(16), and t(8;21), which are all known to portend a good prognosis. [1], [82] The top-ranked up-regulated and down-regulated genes associated with NPM1 mutations, t(15;17), inv(16), and t(8;21) are shown in , , and respectively. The specific over-represented functional categories of the up-regulated genes and down-regulated genes associated with NPM1 mutations, t(15;17), inv(16), and t(8;21) are summarized in . Notably, NPM1 mutation's functional categories were concordant with good prognosis AML. AML with t(15;17) illustrated down-regulation of genes involved in the immune system. Interestingly, t(8;21) and inv(16) mirrored each other in terms of direction of their common functional categories because of the significant proportion of studies that directly compared these two entities. Detailed tables describing the over-represented functional categories of up-regulated genes and down-regulated genes associated with NPM1 mutations, t(15;17), inv(16), and t(8;21) are listed in , , , , , , and respectively.

Discussion

We developed a methodology for the comparison of published heterogeneous gene lists, and we developed a web application (http://gat.stamlab.org) to facilitate access to the study data. This approach permitted a granular multi-study comparison of gene lists and functional gene ontology classifications. To our knowledge, the body of published AML gene expression profiling studies in the form of published gene lists has not been systematically compared. We extracted a list of 4918 genes that were reported in 25 gene expression profiling studies of AML. We found that a considerable amount of the genes (32.7%) were published in more than one study, and we described a list of 25 genes that were reported in greater than 8 studies. Although most of these genes have been associated with AML elsewhere in the literature, several genes (VCAN and PGDS) have only been described in AML cell lines and a surprising number of the genes (HLA-DPA1, ITM2A, RBPMS, RGS10, RNASE2 and TRH) have not been specifically described in AML. We identified gene sets that were associated with good prognosis and poor prognosis (overall survival, disease free survival, or response to therapy) in AML across multiple studies. Surprisingly, only 9.6% of these genes were replicated with concordant expression directions in more than one study. We surveyed the higher ranked genes that were reported in multiple studies, and noted the majority of these genes were not described elsewhere in human AML. We also identified functional gene ontology categories that are associated with prognosis in AML, which are consistent with increased expression of genes involved in differentiation and apoptosis dysregulation in good prognosis AML and increased expression of genes involved in proliferation in poor prognosis AML. A study included in our comparison that examined survival in CBF AML also associated up-regulation of proliferation GO categories with decreased survival and associated up-regulation of RNA metabolism and apoptosis dysregulation GO categories with increased survival.[27] We identified differentially expressed genes across multiple studies that were associated with specific subtypes of AML including t(15;17), inv(16), t(8;21), and NPM1 mutations. For example, there were 5 papers in our comparison that reported gene lists associated with NPM1 mutations, and all 5 of these papers reported up-regulation of SMC4. Additionally, we also identified functional gene ontology categories that were associated with each of these AML subtypes. Interestingly, the functional gene ontology sets of AML with the NPM1 mutation were similar to good prognosis AML, which is expected considering NPM1 mutations impart a favorable prognosis. Our comparison included 24 homeodomain (HOX/TALE) genes with 7 listed in more than 7 papers. The HOX/TALE genes encode transcription factors regulating pattern formation, differentiation, and proliferation. Orderly HOX gene activation is essential for normal hematopoiesis with HOX genes preferentially expressed in the hematopoietic stem cell compartment and then down-regulated following differentiation and maturation.[58] There is considerable evidence in the literature associating dysregulation of HOX/TALE genes in AML.[58] Constitutive expression of HOXA7, HOXA9, HOXA10, HOXB3, and HOXB8 in mice results in acute leukemia,[83], [84], [85], [86] and recurrent chromosomal translocations in humans involving HOXA9 [87], PBX1 [88], and HOX11 [89] results in leukemia. The MLL gene is a known positive regulator of HOX/TALE expression and translocations involving the MLL gene have been associated with increased expression of HOXA4-11, MEIS1, and PBX1.[58] Our comparison showed a general increase in HOX/TALE expression in AML with normal cytogenetics, NPM1 mutations, FLT3 mutations, and 11q23 abnormalities involving the MLL gene while showing an overall decrease in HOX/TALE expression in normal patient CD34+ cells, AML with CEBPA mutations and AML with abnormal cytogenetics, specifically t(15;17), t(8;21), and inv(16). All of the above trends, except for CEBPA mutations, have been reported and confirmed in several RT-PCR studies.[59], [60], [61], [62], [63], [64] To our knowledge, the association of CEBPA mutations with decreased HOX/TALE expression has not been reported previously. Several of the HOX/TALE genes, specifically HOXB2, PBX3 and MEIS1, were also shown in our comparison to have increased expression in inv(16) when compared to t(8;21), which is supported by two recent RT-PCR studies[59], [60]. Exceptions to the above trends in our comparison include decreased expression of HOXB2 with MLL translocations, decreased expression of PBX2 with MLL translocations and NPM1 mutations, and decreased expression of HOXC4 with NPM1 mutations. Several RT-PCR studies have associated increased expression of HOXA1-10 and MEIS1 with decreased overall survival in AML,[59], [61] although recently a RT-PCR study did associate decreased expression of HOXA4 with decreased overall survival in CN AML[60]. Several RT-PCR studies have also associated high risk cytogenetics with increased expression of HOX/TALE genes[58], [61] and an RT-PCR study has associated increased expression of FLT3 or FLT3 mutations in CN AML with increased expression of HOX/TALE genes[63]. In poor prognosis (includes decreased overall survival, disease free survival, or response to therapy) AML, our comparison showed increased expression of several HOX/TALE genes, specifically HOXA4, HOXA10, HOXB5 and PBX1, while showing decreased expression of MEIS1 and contradictory expression directions of HOXB2 and PBX3. Although an overall increase of HOX/TALE expression in poor prognosis AML has been reported, there are several contradictions to this including MEIS1, HOXB2 and PBX3 in our comparison and HOXA4 in an outside RT-PCR study[60]. Additionally, the overall trend of increased HOX/TALE expression in poor prognosis AML does not appear specific because our comparison and the literature also report increased expression of HOX/TALE genes in CN AML and AML with NPM1 mutations. This point is well illustrated by an RT-PCR study using a classifier with 17 homeodomain genes that was able to differentiate favorable cytogenetics from intermediate/unfavorable cytogenetics, however unable to differentiate intermediate from unfavorable cytogenetics.[59] There were several intriguing potential targets of therapy uncovered during our analysis. TBXAS1 is an enzyme that converts prostaglandin H2 into thromboxane A2.[90] Thromboxane A2 induces platelet aggregation, smooth muscle contraction, and possibly modulates mitogenesis and apoptosis.[91] Although there have been no previous reports describing TBXAS1 expression in AML, our comparison included three papers that associated increased expression of TBXAS1 with a poor prognosis. In bladder cancer cells, pharmacologic inhibition of TBXAS1 with furegrelate or ozagrel induced apoptosis and enhanced sensitivity to chemotherapy,[92] which does suggest that pharmacologic inhibition of this enzyme has potential for treatment in AML. SEMA3F is a secreted protein that has been reported to function as a axon guidance factor, a tumor suppressor gene in small cell lung cancer, a inhibitor of angiogenesis, and a possible direct inhibitor of tumor cell migration and attachment.[93] Although there have been no previous reports describing SEMA3F expression in AML, our comparison included three papers that associated increased expression of SEMA3F with a good prognosis, which suggest that a SEMA3F analog could have potential for treatment in AML. Our methodology was shown to be especially useful in systematically identifying commonly reported genes and pathways in the heterogeneous disease of AML. Our method is flexible and ensures the inclusion of all pertinent studies into the analysis and is accompanied by an online analysis and database querying tool for other investigators. To ensure the inclusion of all possible pertinent studies, our methodology does not require raw data and can incorporate both published differential gene lists that are not quantified and published gene lists with no reported direction of expression (12% of the published expression features were not associated with a direction). Another strategy that utilizes gene list comparisons across studies has been published by Griffith et al. and Chan et al.[36], [37] Their method successfully identified biomarkers in thyroid and colorectal cancer, however, we chose not to employ their method because each feature requires an explicit expression direction and a quantified expression value. A potential disadvantage of our methodology is the wide variety of methods employed by the individual studies, which include sample populations, sample sizes, microarray platform types, statistical analysis methods, and the ultimate decisions of which gene lists the authors decide to publish. This heterogeneity in methods can also be viewed as an advantage. For example, a gene that is listed in two studies that employ different microarray platforms and statistical methods could be considered more meaningful than a gene that is listed in two studies that employ the same microarray platform and statistical methodology. Another potential disadvantage with our methodology is publication bias, because our results are dependent on gene lists the authors have decided to publish within their respective studies. To avoid the introduction of any further bias into our results, we do not attempt to weigh the importance of each study by quality metrics, such as sample size or data quality, thus the resulting gene rankings are simply primarily based on the number of applicable studies the gene was reported in. In the future, our methodology could be applied to perform comparisons of other malignancies and disease states. The main limitations include the tedious process required to collect the gene lists and the potential for publication bias. However, despite these limitations, our methodology is especially powerful in systematically identifying commonly reported genes and pathways in heterogeneous diseases, such as AML, and is especially useful in cases where the raw gene expression datasets are not available.

Materials and Methods

Data Collection and Curation

We queried Pubmed for acute myeloid leukemia expression profiling studies published between 1999 and early 2008. We excluded studies that predominantly examined non-leukemia cells and studies that contained less than 5 patient samples. In total, published gene lists were collected from 25 independent studies ( ). The published gene lists were processed to obtain the following information: gene symbol; unique identifiers (Accession ID, Affymetrix probe ID, LocusLink ID, UniGene ID); comparison conditions; differential expression; microarray platform; number of samples; PubMed ID; and identification tags. The identification tags are a set of descriptors that describe each expression feature. If two conditions were being compared, then two separate expression features were created with opposite differential expression and opposing identification tags. The notation of the comparison conditions and the identification tags in the database were standardized to allow the gene expression summary analysis and gene ontology analysis, which are both described below. The above processing was accomplished with a combination of parsing with custom Perl scripts, manual transcription, and copying/pasting. This information was then enumerated and formatted with custom Perl scripts to create a flat file database.

Gene Mapping

The expression features in the collected published lists were referenced by one or more of the following: gene symbol, accession ID, Affymetrix probe ID, LocusLink ID, and/or UniGene ID. These references were mapped to the Gene Symbol in the UCSC human genome hg18 database [94] with custom Perl scripts. If we were unable to map the reference to a Gene Symbol in the UCSC database, then the expression feature was not included in further analysis.

Tag-Based Classification of Expression with Prognostic Features

We used an integrative approach to assign identification “tags” to gene expression and prognostic categories. A flow chart of the approach is illustrated in . We assigned identification tags to each datapoint and used a strict nomenclature for comparison conditions.

Gene Expression Summary

We developed a customized Perl script that incorporates the comparison conditions and identification tags in an algorithm to summarize the expression directions of each mapped gene. These expression summaries can be viewed in an online Browser (http://gat.stamlab.org).(B.G.M and J.A.S., manuscript in preparation)

Functional Classification of Gene Lists

For functional classification of the gene lists, we used GO::TermFinder[95] for gene ontology (GO)[96]analysis. We downloaded the GO v1.0 OBO database 2/22/2008 release from http://www.geneontology.org. We downloaded the human annotation file version 60.0 and human cross-reference file version 3.39 from the GOA website http://www.ebi.ac.uk/GOA/. We developed custom Perl scripts to create a list of genes that was associated with each identification tag and differential expression direction. These lists of genes were then mapped to the appropriate Swiss-Prot ID with the above mentioned GOA human cross-reference file. To avoid an over-representation bias, we only allowed one Swiss-Prot ID per gene. Statistically significant over-represented GO categories of the Swiss-Prot ID lists were identified with GO:TermFinder; we used the entire GO annotation as the background, and statistical significance was calculating by the Bonferroni multiple hypothesis with a p-value cutoff of 0.01.

Clustering Analysis

Hierarchical clustering was used to compare the differential expression of elements (genes or gene ontology categories) associated with each identification tag. For each identification tag, strictly up-regulated elements were assigned the value 1, while strictly down-regulated elements were assigned the value 0. Hierarchical clustering was then calculated in the R software package, which employed the method of complete linkage and Canberra distance. List of identification tags and descriptions (0.01 MB PDF) Click here for additional data file. List of comparison conditions (0.01 MB PDF) Click here for additional data file. Expression summaries of HOX and TALE genes (0.03 MB PDF) Click here for additional data file. Top ranked genes associated with good prognosis (0.03 MB PDF) Click here for additional data file. Functional categories of up-regulated genes associated with poor prognosis (0.02 MB PDF) Click here for additional data file. Functional categories of down-regulated genes associated with poor prognosis (0.03 MB PDF) Click here for additional data file. Functional categories of up-regulated genes associated with good prognosis (0.03 MB PDF) Click here for additional data file. Functional categories of down-regulated genes associated with good prognosis (0.02 MB PDF) Click here for additional data file. Top ranked genes associated with NPM1 mutations (0.03 MB PDF) Click here for additional data file. Top ranked genes associated with t(15;17) (0.01 MB PDF) Click here for additional data file. Top ranked genes associated with inv(16) (0.03 MB PDF) Click here for additional data file. Top ranked genes associated with t(8;21) (0.03 MB PDF) Click here for additional data file. Functional categories of up-regulated genes associated with NPM1 mutations (0.03 MB PDF) Click here for additional data file. Functional categories of down-regulated genes associated with NPM1 mutations (0.02 MB PDF) Click here for additional data file. Functional categories of up-regulated genes associated with t(15;17) (0.02 MB PDF) Click here for additional data file. Functional categories of down-regulated genes associated with t(15;17) (0.02 MB PDF) Click here for additional data file. Functional categories of up-regulated genes associated with inv(16) (0.03 MB PDF) Click here for additional data file. Functional categories of down-regulated genes associated with inv(16) (0.02 MB PDF) Click here for additional data file. Functional categories of up-regulated genes associated with t(8;21) (0.01 MB PDF) Click here for additional data file. Functional categories of down-regulated genes associated with t(8;21) (0.03 MB PDF) Click here for additional data file.
  96 in total

1.  Venn Mapping: clustering of heterologous microarray data based on the number of co-occurring differentially expressed genes.

Authors:  Marcel Smid; Lambert C J Dorssers; Guido Jenster
Journal:  Bioinformatics       Date:  2003-11-01       Impact factor: 6.937

2.  Identification of a gene expression signature associated with pediatric AML prognosis.

Authors:  Tomohito Yagi; Akira Morimoto; Mariko Eguchi; Shigeyoshi Hibi; Masahiro Sako; Eiichi Ishii; Shuki Mizutani; Shinsaku Imashuku; Misao Ohki; Hitoshi Ichikawa
Journal:  Blood       Date:  2003-05-08       Impact factor: 22.113

3.  Eosinophil-derived neurotoxin (EDN), an antimicrobial protein with chemotactic activities for dendritic cells.

Authors:  De Yang; Helene F Rosenberg; Qian Chen; Kimberly D Dyer; Kahori Kurosaka; Joost J Oppenheim
Journal:  Blood       Date:  2003-07-10       Impact factor: 22.113

4.  Aberrant methylation of DAP-kinase in therapy-related acute myeloid leukemia and myelodysplastic syndromes.

Authors:  Maria Teresa Voso; Alessandra Scardocci; Francesco Guidi; Gina Zini; Antonella Di Mario; Livio Pagano; Stefan Hohaus; Giuseppe Leone
Journal:  Blood       Date:  2003-09-22       Impact factor: 22.113

Review 5.  Hematopoietic prostaglandin D synthase.

Authors:  Yoshihide Kanaoka; Yoshihiro Urade
Journal:  Prostaglandins Leukot Essent Fatty Acids       Date:  2003 Aug-Sep       Impact factor: 4.006

6.  Biologic and clinical significance of the FLT3 transcript level in acute myeloid leukemia.

Authors:  Kazutaka Ozeki; Hitoshi Kiyoi; Yuka Hirose; Masanori Iwai; Manabu Ninomiya; Yoshihisa Kodera; Shuichi Miyawaki; Kazutaka Kuriyama; Chihiro Shimazaki; Hideki Akiyama; Miki Nishimura; Toshiko Motoji; Katsuji Shinagawa; Akihiro Takeshita; Ryuzo Ueda; Ryuzo Ohno; Nobuhiko Emi; Tomoki Naoe
Journal:  Blood       Date:  2003-11-06       Impact factor: 22.113

7.  Large matrix proteoglycans, versican and perlecan, are expressed and secreted by human leukemic monocytes.

Authors:  Evdokia Makatsori; Fotini N Lamari; Achilleas D Theocharis; Stavros Anagnostides; Anders Hjerpe; Theodore Tsegenidis; Nikos K Karamanos
Journal:  Anticancer Res       Date:  2003 Jul-Aug       Impact factor: 2.480

8.  Constitutive phosphorylation of FKHR transcription factor as a prognostic variable in acute myeloid leukemia.

Authors:  June-Won Cheong; Ju In Eom; Ho-Young Maeng; Seung Tae Lee; Jee Sook Hahn; Yun Woong Ko; Yoo Hong Min
Journal:  Leuk Res       Date:  2003-12       Impact factor: 3.156

9.  Molecular characterization of acute leukemias by use of microarray technology.

Authors:  Alexander Kohlmann; Claudia Schoch; Susanne Schnittger; Martin Dugas; Wolfgang Hiddemann; Wolfgang Kern; Torsten Haferlach
Journal:  Genes Chromosomes Cancer       Date:  2003-08       Impact factor: 5.006

10.  Constitutive overexpression of the integral membrane protein Itm2A enhances myogenic differentiation of C2C12 cells.

Authors:  Dave Van den Plas; Joseph Merregaert
Journal:  Cell Biol Int       Date:  2004       Impact factor: 3.612

View more
  19 in total

1.  Constitutive IRF8 expression inhibits AML by activation of repressed immune response signaling.

Authors:  A Sharma; H Yun; N Jyotsana; A Chaturvedi; A Schwarzer; E Yung; C K Lai; F Kuchenbauer; B Argiropoulos; K Görlich; A Ganser; R K Humphries; M Heuser
Journal:  Leukemia       Date:  2014-05-20       Impact factor: 11.528

2.  GSMA: an approach to identify robust global and test Gene Signatures using Meta-Analysis.

Authors:  Adib Shafi; Tin Nguyen; Azam Peyvandipour; Sorin Draghici
Journal:  Bioinformatics       Date:  2020-01-15       Impact factor: 6.937

Review 3.  Not Only Mutations Matter: Molecular Picture of Acute Myeloid Leukemia Emerging from Transcriptome Studies.

Authors:  Luiza Handschuh
Journal:  J Oncol       Date:  2019-07-30       Impact factor: 4.375

4.  Identification of predictive markers of cytarabine response in AML by integrative analysis of gene-expression profiles with multiple phenotypes.

Authors:  Jatinder K Lamba; Kristine R Crews; Stanley B Pounds; Xueyuan Cao; Varsha Gandhi; William Plunkett; Bassem I Razzouk; Vishal Lamba; Sharyn D Baker; Susana C Raimondi; Dario Campana; Ching-Hon Pui; James R Downing; Jeffrey E Rubnitz; Raul C Ribeiro
Journal:  Pharmacogenomics       Date:  2011-03       Impact factor: 2.533

5.  FLT3-ITD-associated gene-expression signatures in NPM1-mutated cytogenetically normal acute myeloid leukemia.

Authors:  Liang Huang; Kuangguo Zhou; Yunfan Yang; Zhen Shang; Jue Wang; Di Wang; Na Wang; Danmei Xu; Jianfeng Zhou
Journal:  Int J Hematol       Date:  2012-06-12       Impact factor: 2.490

6.  Ontology-based meta-analysis of global collections of high-throughput public data.

Authors:  Ilya Kupershmidt; Qiaojuan Jane Su; Anoop Grewal; Suman Sundaresh; Inbal Halperin; James Flynn; Mamatha Shekar; Helen Wang; Jenny Park; Wenwu Cui; Gregory D Wall; Robert Wisotzkey; Satnam Alag; Saeid Akhtari; Mostafa Ronaghi
Journal:  PLoS One       Date:  2010-09-29       Impact factor: 3.240

7.  Exact statistical tests for the intersection of independent lists of genes.

Authors:  Loki Natarajan; Minya Pu; Karen Messer
Journal:  Ann Appl Stat       Date:  2012-06       Impact factor: 2.083

8.  Independent validation test of the vote-counting strategy used to rank biomarkers from published studies.

Authors:  Brad A Rikke; Murry W Wynes; Leslie M Rozeboom; Anna E Barón; Fred R Hirsch
Journal:  Biomark Med       Date:  2015-07-30       Impact factor: 2.851

9.  A four-gene LincRNA expression signature predicts risk in multiple cohorts of acute myeloid leukemia patients.

Authors:  D Beck; J A I Thoms; C Palu; T Herold; A Shah; J Olivier; L Boelen; Y Huang; D Chacon; A Brown; M Babic; C Hahn; M Perugini; X Zhou; B J Huntly; A Schwarzer; J-H Klusmann; W E Berdel; B Wörmann; T Büchner; W Hiddemann; S K Bohlander; L B To; H S Scott; I D Lewis; R J D'Andrea; J W H Wong; J E Pimanda
Journal:  Leukemia       Date:  2017-07-04       Impact factor: 11.528

10.  Using bioinformatic approaches to identify pathways targeted by human leukemogens.

Authors:  Reuben Thomas; Jimmy Phuong; Cliona M McHale; Luoping Zhang
Journal:  Int J Environ Res Public Health       Date:  2012-07-12       Impact factor: 3.390

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.