Literature DB >> 21483481

Exploring off-targets and off-systems for adverse drug reactions via chemical-protein interactome--clozapine-induced agranulocytosis as a case study.

Lun Yang1, Kejian Wang, Jian Chen, Anil G Jegga, Heng Luo, Leming Shi, Chunling Wan, Xizhi Guo, Shengying Qin, Guang He, Guoyin Feng, Lin He.   

Abstract

In the era of personalized medical practice, understanding the genetic basis of patient-specific adverse drug reaction (ADR) is a major challenge. Clozapine provides effective treatments for schizophrenia but its usage is limited because of life-threatening agranulocytosis. A recent high impact study showed the necessity of moving clozapine to a first line drug, thus identifying the biomarkers for drug-induced agranulocytosis has become important. Here we report a methodology termed as antithesis chemical-protein interactome (CPI), which utilizes the docking method to mimic the differences in the drug-protein interactions across a panel of human proteins. Using this method, we identified HSPA1A, a known susceptibility gene for CIA, to be the off-target of clozapine. Furthermore, the mRNA expression of HSPA1A-related genes (off-target associated systems) was also found to be differentially expressed in clozapine treated leukemia cell line. Apart from identifying the CIA causal genes we identified several novel candidate genes which could be responsible for agranulocytosis. Proteins related to reactive oxygen clearance system, such as oxidoreductases and glutathione metabolite enzymes, were significantly enriched in the antithesis CPI. This methodology conducted a multi-dimensional analysis of drugs' perturbation to the biological system, investigating both the off-targets and the associated off-systems to explore the molecular basis of an adverse event or the new uses for old drugs.

Entities:  

Mesh:

Substances:

Year:  2011        PMID: 21483481      PMCID: PMC3068927          DOI: 10.1371/journal.pcbi.1002016

Source DB:  PubMed          Journal:  PLoS Comput Biol        ISSN: 1553-734X            Impact factor:   4.475


Introduction

Clozapine (CLZ) provides one of the most effective therapeutic treatments for schizophrenia [1]. It is classified as an atypical antipsychotic drug because of its binding to serotonergic and dopamine receptors. However, its usage is limited due to potential life-threatening adverse drug reaction, mainly agranulocytosis [2], [3], [4]. FDA therefore requires blood testing for patients taking CLZ, complicating the clinical use of the drug. A recent high impact clinical study demonstrated the necessity of moving CLZ from a 3rd line drug to a 1st line drug based on its overall benefit/risk ratio [1]. Thus the identification of the biomarkers for clozapine induced agranulocytosis (CIA) could greatly broaden the usage of this drug. Organizations such as the severe adverse event consortium (SAEC) and Duke University are collaborating on identifying genetic risk factors for CIA via genetic association studies (http://www.genomeweb.com/dxpgx/saec-duke-collaborate-rare-variants-adverse-events-research). However, due to the rarity of suitable patients, such an approach requires global collaboration. Even if some statistically significant SNPs are identified by using genome wide association studies [5], [6], identifying the causal mechanism of such SNPs and using them in prediction models still presents a challenge. Instead of the traditional association study, we proposed an alternative computational methodology to identify the genetic risk factors for CIA, by identifying the known risk genes, explaining the relevant mechanism by observing chemical-protein interactions and providing a “most likely” candidate list [7] for pharmacogenetic and pharmacogenomic studies [8]. Drug-induced agranulocytosis is a form of idiosyncratic drug reaction (IDR). It is dose independent and is a form of serious adverse drug reaction [9], [10], [11]. One of the major causes of IDR is unexpected drug-protein interactions in human proteins [12], [13], [14], [15], [16], [17], [18]. Olanzapine (OLZ) is a CLZ analog, but has inferior efficacy in treating schizophrenia. It is reported to cause much less agranulocytosis compared with CLZ [19], [20], [21], a fact that is also confirmed in our statistical test (Fisher's exact test p = 8.2E-21, Table 1). Differences in their interaction profile towards human proteins (off-targets) might explain the etiology of CIA. Hence we hypothesized that if a human protein tends to be targeted by CLZ but not OLZ, the protein should be regarded as the candidate mediator of CIA, and the genes sharing a biological function with the off-targets (off-system, short for ‘off-target associated system’) should also display expression perturbation in cell lines treated by the drug. For example, we identified from a 410 protein target set retrospectively that Hsp70 protein as the off-target of CLZ but not OLZ, and that genes sharing the biological function with HSPA1A (Hsp70's gene) or acting as neighbors in Human Protein Reference Database (HPRD), a protein-protein interaction (PPI) database, with HSPA1A were found up-regulated in cell lines treated by CLZ. Another hypothesis is that if a protein target is preferably targeted by all drugs causing agranulocytosis (case) but not targeted by the agranulocytosis- drugs (control), the protein is a candidate mediator of the agranulocytosis. Using this hypothesis, we identified NQO2 gene as the candidate gene of agranulocytosis.
Table 1

Test for the difference of the agranulocytosis report rate between clozapine and olanzapine in the FDA adverse event reporting system (AERS).

ClozapineOlanzapine
Agranulocytosis Reports18516
Total Reports1681311304
Ratio of Agranulocytosis Report (%)1.10.14
pCLZ-OLZ * 8.2E-21

*Chi-square test for the equal rate of agranulocytosis between CLZ and OLZ. AERS records were updated in September, 2009.

*Chi-square test for the equal rate of agranulocytosis between CLZ and OLZ. AERS records were updated in September, 2009.

Results

Preparing proteins and chemicals for chemical-protein interactome

To identify unexpected drug-protein interactions, we utilized chemical-protein interactome (CPI) [13], [22], [23], which gives a score array generated by docking a panel of drug molecules across a set of human proteins. A CPI delivers two types of information, the binding conformation and the binding strength (Fig. 1a). It can be constructed via wet lab techniques [24], [25], [26], [27], but the most convenient way is to generate an in silico CPI. We used the DOCK [28] program to evaluate the chemical-protein interaction strength because it is an open-source software and had been widely used along with its success in identifying the unexpected chemical-protein interactions.
Figure 1

Workflow of construction and mining of the binomial antithesis chemical-protein interactome (CPI).

(a) Binding conformations and raw docking scores were derived from the CPI with each column representing the drug molecule and each row representing the protein. (b) The 2DIZ transformation was applied to the CPI comprising 255 drugs and 410 protein pockets. (c) The OLZ and CLZ columns were extracted from the CPI where their Z′ score differences for each protein were measured by A-scores. The p values for each achieved A-score were calculated by simulating a random background. (d) Proteins were ranked according to their p values. In this case, Hsp70 was selected, proteins belonging to the same biological function (anti-apoptosis system or Hsp70's neighbor in HPRD network) were selected and then their expression changes in CLZ treatment were investigated (green bars indicated the rankings of the Hsp70 related genes when ordered by the change after CLZ treatment) and tested for significance by randomly selecting the same probe number in the genome background for permutation.

Workflow of construction and mining of the binomial antithesis chemical-protein interactome (CPI).

(a) Binding conformations and raw docking scores were derived from the CPI with each column representing the drug molecule and each row representing the protein. (b) The 2DIZ transformation was applied to the CPI comprising 255 drugs and 410 protein pockets. (c) The OLZ and CLZ columns were extracted from the CPI where their Z′ score differences for each protein were measured by A-scores. The p values for each achieved A-score were calculated by simulating a random background. (d) Proteins were ranked according to their p values. In this case, Hsp70 was selected, proteins belonging to the same biological function (anti-apoptosis system or Hsp70's neighbor in HPRD network) were selected and then their expression changes in CLZ treatment were investigated (green bars indicated the rankings of the Hsp70 related genes when ordered by the change after CLZ treatment) and tested for significance by randomly selecting the same probe number in the genome background for permutation. To prepare an unbiased protein set, we utilized a pocket set comprising 410 human protein pockets (381 unique proteins, Table S1), representing all the available human protein structure models from third-party target structural databases. The ligand binding pockets on each protein were then processed manually for docking preparation (see ). We then mined from literature and the FDA adverse event reporting system (AERS) the drugs that were reported to cause agranulocytosis (case) or not cause agranulocytosis (control, Fig. S1a), aiming at identifying proteins tend to be targeted by case but not control drugs (red dashed rectangle in Fig. S1b). According to our criteria ( ), there were 39 case and 15 control drug molecules selected for agranulocytosis, including the parent drug and their major metabolites and isomers. The control drugs did not share significant 2D structure similarity (Fig. S2), their indications covering a broad therapeutic categories (covering nine 1st level of ATC codes). To generate a comprehensive distribution of docking scores for each protein across many drug molecules, we also incorporated other drug molecules. Although for effective performance and classification, a larger data set should be used [22], e.g., all the FDA approved drugs), we restricted our analysis to drug molecules from our former studies because of the CPU time for array docking. Thus, a total of 255 drug molecules, including the CLZ and OLZ, were selected for docking (Table S2).

Constructing the chemical-protein interactome

Here 255 chemicals were docked into the 410 human proteins using DOCK, generating a docking score matrix of 255×410 elements. A 2-directional Z-transformation (2DIZ) [23] was then applied to transform the raw docking score into a Z′-score, extending the multiple active site corrections concept [29]. The docking scores were normalized by each drug and then by each protein (Fig. 1b), thus the “endogenous” variance among proteins, such as the free energy variation across the binding pockets, has been normalized and contribute almost zero to the variance of the Z′-scores (Table S3). The major contributions of the variance are from the chemical effects and the chemical-protein interactive effects after the 2DIZ, which means that each chemical can ‘fish’ its targets only based on Z′-score without noises from the “endogenous” variance among proteins.

Binomial antithesis CPI between CLZ and OLZ

A basic assumption in using antithesis binding profile from CPI between CLZ and OLZ is that, 1) the two drugs are broadly similar in their effects, except for some side-effects, such as agranulocytosis, and that therefore, apart from some minor differences, their overall protein binding profile should be similar; 2) these minor differences in protein binding profile are highly likely to be associated with CIA. To verify the comparability between CLZ and OLZ, we calculated the Pearson's correlation coefficients (PCC) between Z′-score vectors of CLZ and OLZ across all 410 human proteins (with missing values removed). All four CLZ-OLZ pairs (2 CLZ ionization states×2 OLZ ionization states) obtained high positive PCC values (Fig. S3a). Their mean PCC value was distinctly higher (p = 0.0009 for permutation test in Fig. S3b). The high correlated protein binding profiles of CLZ and OLZ underlined their structural and pharmacological similarity, which also indicated the structural variability of all 255 drug molecules in the construction of the CPI. We therefore hypothesized that the proteins exhibiting different binding affinity against CLZ and OLZ might account for the agranulocytosis risk of these two analogs. In order to identify the minor distinctions, we defined the antithesis score (A-score) for protein i as the Z′-score difference between CLZ and OLZ towards protein i, We also calculated the probability of an A-score less than between two randomly selected drug molecules among 255 molecules at protein i (Fig. 1c), which could be expressed as, We performed permutations for each target by randomly selecting drug-pairs and calculating their A-scores 10,000 times. Here the p value was the one-tailed probability when the A-score of the drug-pair was less than that of the CLZ-OLZ pair. Targets with p value less than the 0.05 cutoff are shown in Table 2. For the four CLZ-OLZ pairs, we chose only the pair that recalled most known CIA related genes reported in the genetic association studies.
Table 2

Candidate off-targets/-systems prioritized from binomial antithesis CPI between CLZ and OLZ.

PDB ID# Target NameGene NameZ′ (CLZ)* Z′ (OLZ)A-scorep value for CPIRoleSys. Regulationp value for Sys. perturbation
1CBSCellular retinoic acid-binding protein 2CRABP2−0.9221.653−2.5750.000
1D1TAlcohol dehydrogenase class 4 mu/sigma chainADH7−1.1911.525−2.7160.000OR
1IHI_1Aldo-keto reductase family 1 member C2AKR1C2−0.7812.545−3.3260.000OR
1IHI_2Aldo-keto reductase family 1 member C2AKR1C2−1.6051.023−2.6280.000OR
1OIZAlpha-tocopherol transfer proteinTTPA−1.2691.171−2.4400.000
2E8AHeat shock 70 kDa protein 1HSPA1A/HSPA1B−1.3810.150−1.5310.001up0.0289
1D2VMyeloperoxidaseMPO−2.753−0.646−2.1070.005OR
1DB1Vitamin D3 receptorVDR−0.6600.748−1.4090.012up0.0139
1MRQ_2Aldo-keto reductase family 1 member C1AKR1C1−2.0340.123−2.1580.016OR
1MRQ_1Aldo-keto reductase family 1 member C1AKR1C1−1.0360.601−1.6370.021OR
1DHTEstradiol 17-beta-dehydrogenase 1HSD17B1−1.8220.158−1.9800.021OR
1MUOSerine/threonine-protein kinase 6AURKA−1.1360.529−1.6650.027up0.0749
1VJ5Epoxide hydrolase 2EPHX2−1.0880.228−1.3150.027
4GTUGlutathione S-transferase Mu 4GSTM4−0.7491.060−1.8090.036GTdown0.2758
1HDRDihydropteridine reductaseQDPR−1.4690.561−2.0300.038OR
1YB5Quinone oxidoreductaseCRYZ−1.2120.284−1.4960.039OR
1CM8Mitogen-activated protein kinase 12MAPK12−1.2020.301−1.5030.039up0.1238
1XF0_2Aldo-keto reductase family 1 member C3AKR1C3−0.8650.441−1.3060.041ORup0.0113
1HMRFatty acid-binding protein, heartFABP3−0.8260.270−1.0950.046down0.1968

An entry name that ends with a number represents the pocket number of its PDB structure.

*The smaller Z′-score represents a higher theoretical interaction strength.

In the “Role” column, OR and GT indicate oxidoreductases and gluthathione metabolism related proteins, respectively.

An entry name that ends with a number represents the pocket number of its PDB structure. *The smaller Z′-score represents a higher theoretical interaction strength. In the “Role” column, OR and GT indicate oxidoreductases and gluthathione metabolism related proteins, respectively.

Multiple antitheses CPI between case and control drugs

A chemical-protein interaction with a Z′-score less or greater than −0.48 was defined as interactive or not interactive, respectively. As indicated in our previous training set [22], Z′-scores above such cutoff captured 70% of the true bindings and were enriched more than three-fold as compared with the false binding. For protein i, a i, b i, c i, and d i, denoting the number of interactive (a i or b i) and not interactive (c i or d i) by case or control drug molecules, respectively, were counted and the relative ratio (RR) was calculated as follows, To identify proteins preferentially interacting with the case drugs, we performed Fisher's exact tests for each protein. The significance (one-sided) for each of the protein pockets with RR value exceeding one were computed and were used as a measure to prioritize the potential protein mediating agranulocytosis. Table 3 shows protein targets with p values less than 0.05.
Table 3

Targets selected from multiple antitheses CPI between case and control drugs with p value less than 0.05.

PDB IDa Target NameGene NameabcdRRp valueRole
1I10L-lactate dehydrogenase A chainLDHA21118141.6970.002OR
2HGS_2Glutathione synthetaseGSS24215131.7230.002GT
2HRBCarbonyl reductase NADPH 3CBR317022151.6820.002OR
1KBQNAD(P)H dehydrogenase quinone 1NQO116023151.6520.002OR
1EEMGlutathione S-transferase omega-1GSTO119120141.6150.004GT
1SG0_2Ribosyldihydronicotinamide dehydrogenase quinoneNQO214022151.6820.005OR
1G0XLeukocyte immunoglobulin-like receptor subfamily B member 1LILRB115024151.6250.005
2AHEChloride intracellular channel protein 4CLIC414024151.6250.005
1DIAFormyltetrahydrofolate synthetaseMTHFD114025151.6000.006OR
11GSGlutathione S-transferase PGSTP118121141.5790.009GT
1FIECoagulation factor XIII A chainF13A112023151.6520.010
1Q4OSerine/threonine-protein kinase PLK1PLK113025151.6000.011
1LJRGlutathione S-transferase theta-2GSTT2B8012142.1670.011GT
1FPRTyrosine-protein phosphatase non-receptor type 6PTPN613026151.5770.011
1HSOAlcohol dehydrogenase 1AADH1A13026151.5770.011OR
1IHI_1Aldo-keto reductase family 1 member C2AKR1C220219131.5310.014OR
1SG0_1Ribosyldihydronicotinamide dehydrogenase quinoneNQO216122141.5400.020OR
1IHI_2Aldo-keto reductase family 1 member C2AKR1C216123141.5140.021OR
1D5RPhosphatidylinositol-3,4,5-trisphosphate 3-phosphatase and dual-specificity protein phosphatase PTENPTEN11026151.5770.022
1XWKGlutathione S-transferase Mu 1GSTM111026151.5770.022GT
1TDIGlutathione S-transferase A3GSTA311027151.5560.023GT
5GALGalectin-7LGALS7 | LGALS7B11027151.5560.023
1W7NKynurenine–oxoglutarate transaminase 1CCBL111028151.5360.024
2AB6Glutathione S-transferase Mu 2GSTM211028151.5360.024GT
1MQ0Cytidine deaminaseCDA15124141.4840.024
1OATOrnithine aminotransferase, mitochondrialOAT15124141.4840.024
1ANGAngiogeninANG12027151.5560.024
1J8FNAD-dependent deacetylase sirtuin-2SIRT212027151.5560.024
2J0DCytochrome P450 3A4CYP3A412027151.5560.024OR
1XF0_1Aldo-keto reductase family 1 member C3AKR1C319219131.5240.027OR
1I0ZL-lactate dehydrogenase B chainLDHB19220131.4930.028OR
2BX8_3Serum albuminALB17219131.5070.028
1GOS_2Amine oxidase flavin-containing BMAOB20316121.5220.030OR
1UKIMitogen-activated protein kinase 8MAPK818221131.4570.031
2BXFSerum albuminALB18221131.4570.031
5P21GTPase HRasHRAS14124141.4780.041
1PINPeptidyl-prolyl cis-trans isomerase NIMA-interacting 1PIN19024151.6250.041
1H0CSerine–pyruvate aminotransferaseAGXT14125141.4560.043
1A5YTyrosine-protein phosphatase non-receptor type 1PTPN114124131.4390.043
1QMVPeroxiredoxin-2PRDX29027151.5560.044OR
1BJ4Serine hydroxymethyltransferase, cytosolicSHMT110029151.5170.046
2CYKInterleukin-4IL410029151.5170.046
3DYDTyrosine aminotransferaseTAT10029151.5170.046
1HE5_2Flavin reductaseBLVRB9030151.5000.049OR

An entry name that ends with a number represents the pocket number of its PDB structure.

In the last column, OR and GT indicate oxidoreductases and gluthathione metabolism related proteins, respectively.

An entry name that ends with a number represents the pocket number of its PDB structure. In the last column, OR and GT indicate oxidoreductases and gluthathione metabolism related proteins, respectively.

Retrospective study of the genetic risk factors of CIA

Besides human leucocytes antigen (HLA) markers, three CIA susceptible genes have been identified in genetic association studies [30], namely HSPA1A [31], TNF [32] and NQO2 [33]. None of the HLA proteins were included in our pocket set since they did not meet our criteria of choosing protein pockets. Proteins coded by these three susceptibility genes all happen to be included in our pocket set comprising third party targetable protein databases (Table S1). HSPA1A codes the heat shock 70 kD protein 1 (Hsp70 protein, PDB ID: 2E8A) and has been reported in a high profile journal to be associated with CIA with its causality in CIA discussed [31]. It is also well known for its druggability in antitumor drugs [34], which in general, cause the death of the cell. The gene was prioritized in our binomial antithesis CPI (Table 2). Significant binding strength differences between CLZ and OLZ towards Hsp70 were identified with the binding conformations visualized in Fig. 2. The CLZ molecule fits deeply into the Hsp70 pocket (Fig. 2b). By contrast, the methyl group of OLZ was difficult to accommodate in the narrow pocket using the similar binding pose as CLZ (Fig. 2c).
Figure 2

Structural comparison of clozapine and olanzapine towards HSP70 protein.

(a) The structural difference between CLA and OLZ. (b, c) Binding conformation of CLZ and OLZ towards the Hsp70 ligand binding pocket. The whole molecule of CLZ binds deep into the pocket, leaving the chlorine atom at the surface. However, the major part of the OLZ molecule is not accommodated in the deep pocket due to the steric hindrance of the methyl on the heterocycle of OLZ. The figures were drawn using PyMOL.

Structural comparison of clozapine and olanzapine towards HSP70 protein.

(a) The structural difference between CLA and OLZ. (b, c) Binding conformation of CLZ and OLZ towards the Hsp70 ligand binding pocket. The whole molecule of CLZ binds deep into the pocket, leaving the chlorine atom at the surface. However, the major part of the OLZ molecule is not accommodated in the deep pocket due to the steric hindrance of the methyl on the heterocycle of OLZ. The figures were drawn using PyMOL. We further performed the site-moiety map analysis [35] of the Hsp70 pocket by examining the moiety preferences of the docked ligands and the physicochemical properties of the pocket. One van der Waals-interacting anchor site was identified with three essential residues (R272, R342 and G339, Fig. 3a). Among the docked drug molecules, most used the aromatic moiety or conjugated bonds to interact with this center (Fig. 3b). Theoretically, both CLZ (Fig. 3c) and OLZ (Fig. 3d) should have been capable of insertion into this pocket, however, the methyl on the OLZ molecule made it difficult to hold the same binding direction as that of the CLZ (see molecule structures in Fig. 3c, d). The CLZ molecule was inserted deep into the pocket and used most of its conjugated ring system to interact with the R272 and R342 via π-π interaction. Compared with CLZ, OLZ could not use the majority of its conjugated system due to steric hindrance caused by his methyl group. The above findings add evidence to the hypothesis that the Hsp70 protein was the off-target of CLZ but not of OLZ.
Figure 3

Site-moiety map analysis of the Hsp70 pocket.

(a) The van der Waals-interacting anchor site with three essential residues (R272, R342 and G339). (b) Percentages of the functional group among all docked drug molecules. The binding conformation of CLZ (c) and OLZ (d) towards this site. The molecule directions are also indicated in the 2D molecule structures at the top right corner of (c, d). Bottom left of (d) shows the direction of the OLZ as if it wants to interact using the same pattern as CLZ but significant steric hindrance makes insertion into the pocket in this way difficult.

Site-moiety map analysis of the Hsp70 pocket.

(a) The van der Waals-interacting anchor site with three essential residues (R272, R342 and G339). (b) Percentages of the functional group among all docked drug molecules. The binding conformation of CLZ (c) and OLZ (d) towards this site. The molecule directions are also indicated in the 2D molecule structures at the top right corner of (c, d). Bottom left of (d) shows the direction of the OLZ as if it wants to interact using the same pattern as CLZ but significant steric hindrance makes insertion into the pocket in this way difficult. Ribosyldihydronicotinamide quinone dehydrogenase (coded by NQO2; PDB ID: 1SG0), the known risk gene for CIA, was prioritized from the multiple antitheses CPI (Table 3), together with other 44 proteins with p value less than 0.05. The protein was preferably targeted by the case but not the control drugs. The Kolmogorov-Smirnov test of the Z′-scores between cases and controls showed significant differences on two pockets (p = 0.002 and p = 0.004 for pocket 1 and 2, respectively). As for the binomial antithesis CPI, NQO2 protein ranked 37th among the 410 proteins (top 9%) when ordered by p value. Although the p value did not exceed the 0.05 threshold, the A-score was −1.18, indicating that there were still differences between the interaction strength of CLZ and OLZ towards this protein. Myeloperoxidase and NADPH-oxidase are functionally involved in the pathogenesis of the drug-induced agranulocytosis [36], [37]. Myeloperoxidase (PDB ID: 1D2V) was found in Table 2 whereas two oxidoreductases using NADPH as the co-enzyme, namely Carbonyl reductase NADPH 3 (2HRB) and NAD(P)H dehydrogenase quinone 1 (1KBQ) were found in Table 3. We also investigated the genetic polymorphisms of genes coding Hsp70, NQO2 protein, Myeloperoxidase and NADPH-oxidase. Some nonsynonymous single nucleotide polymorphisms (SNPs) were identified but none of these was found to affect the ligand binding pockets.

Clozapine perturbation on the Hsp70-associated system

Besides bindings between chemicals and proteins, the drug-target relationship may also be reflected in the expression changes of genes related to the off-target associated system [38] after chemical treatment. If the mRNA expression of a set of genes related to off-target X is significantly changed after drug treatment, both target X and the associated system X could corroborate each other for their roles in the adverse reaction. Since Hsp70 was identified as the putative off-target of CLZ, we sought to investigate whether the CLZ treatment resulted in perturbation of Hsp70 and the related gene system. We analyzed the data from Connectivity Map (cMAP) [39], a collection of gene expression data from drug-treated human cell lines on Affymetrix U133A microarrays. Cells were treated by particular drug and vehicle respectively to measure the change of gene expression. One such drug-vehicle pair was defined as an instance. For all 6,100 instances, 22,283 probes were ranked by fold-change values with higher fold-change ranked at the top (close to rank 1), forming a 22283×6100 matrix. We recruited all four instances (instance 1170, 1289, 2689 and 6188) performed on the human promyelocytic leukemia (HL60) cell line to specifically address the drug effect of CLZ on the leukocytes. Instances performed on other cell lines were also investigated. We then manually extracted genes related to HSPA1A in Gene Ontology (GO) (Fig. 1d) [40]. HSPA1A was associated with 7 GO terms in the biological process. As agranulocytosis is basically the death of neutrophil and is known to be correlated to apoptosis pathways [41], we choose the term “anti-apoptosis” (GO:0006916) to characterize the role of HSPA1A in CIA. We selected all human genes linked to this term that collectively represented the Hsp70 off-system. These genes were mirrored to probes on microarray (439 probes corresponding to 235 genes). For each probe, we calculated the average rank of the probe across four CLZ instances (R′ rank), with higher R′ (closer to rank 1) indicating generally up regulated status and lower R′ down regulated status. We compared the R′ of the Hsp70 system and other genes on the U133A probe set. The anti-apoptosis system exhibits an R′ distribution quite distinct from that of the genome background (Fig. 4a), with significantly higher mean R′ than the random 235 gene set (258 out of 10000 sets showed higher R′, p = 0.0258 for permutation test, Fig. 4b). The general up regulation of Hsp70 related genes indicates that CLZ treatment clearly changes the bioactivity of the Hsp70 system in human HL60 promyelocytic leukemia cells. The Hsp70 off-system's perturbation was further confirmed using HSP1A1's ‘neighbor’ in HPRD [42] network) following the same procedure as for investigating the anti-apoptosis system (Fig. 4c,d). Both GO term-based off-system and the PPI-based off-system corroborate the important role of Hsp70 in CIA. The cMAP also contains breast cancer cell line MCF7 and human prostate cancer cell line PC3, however, none of the perturbation of the Hsp70 system could be detected in these two cell lines. The significant perturbation could not be detected on other six GO terms of HSP1A1.
Figure 4

Clozapine disturbance effect towards the Hsp70 systems.

Compared with the genome background, genes related to anti-apoptosis (a) or Hsp70's neighbor in HPRD network (c) were generally up regulated in CLZ treated HL60 cell lines, in terms of higher R′ value. The mean R′ of anti-apoptosis (b) or Hsp70's neighbor in HPRD network (d) related gene system was significantly higher than randomly selected genes in the genome background simulated by permutation test.

Clozapine disturbance effect towards the Hsp70 systems.

Compared with the genome background, genes related to anti-apoptosis (a) or Hsp70's neighbor in HPRD network (c) were generally up regulated in CLZ treated HL60 cell lines, in terms of higher R′ value. The mean R′ of anti-apoptosis (b) or Hsp70's neighbor in HPRD network (d) related gene system was significantly higher than randomly selected genes in the genome background simulated by permutation test.

Two-dimensional elucidation of the off-targets and the off-systems after clozapine treatment

The drug-(off) targets interaction and the gene expression change are the molecular events at two different dimensions after drug treatment. To get an overview of the systems perturbation of the off-targets prioritized in Table 2, we investigated the PPI-based off-systems for them. We did not choose the GO term-based off-systems because each gene was related to multiple GO terms, and it was difficult to objectively choose the appropriate GO terms related to agranulocytosis. Furthermore, using PPI-based off-systems to study the drug's perturbation on the biosystems has been proved to be applicable [43]. Among 17 off-systems, three were found to be significant perturbed with a permutation p value less than 0.05 (Table 2), including Hsp70 off-system. The PPI-based off-systems were then visualized in Fig. 5, where the gene expression perturbation ‘landscape’ of the off-systems was shown. These off-systems were found to be connected by several hub nodes, such as apoptosis associated gene (TP53), the gene coding Bcl-2-binding protein (BAG1) and the transcriptional regulator of vitamin D3 receptor (TRIM24) et al. Interestingly, NQO2 was also found to be involved in HSPA1A off-system and significantly up-regulated after CLZ treatment. Besides preferably inhibited by CLZ, most of the oxidoreductases were found down-regulated or remain unchanged after CLZ treatment. The whole picture demonstrated that the impact of CLZ on the HL60 cell line is reflected on the up-regulation of the anti-apoptosis systems and the inhibition or the down-regulation of the oxidoreductases.
Figure 5

Off-targets and their off-systems' perturbation after clozapine treatment.

The off-targets, the genes involved in the PPI-based off-systems and the hub genes are in diamond, circle and hexagon shape, respectively. The PPI information from HPRD contains binary PPI and protein complex, and only the former information is visualized in this figure for brief. Red/green indicates the up-/down-regulation of the gene expression after clozapine treatment. Oxidoreductases and gluthathione metabolism related protein are in yellow and purple edges, respectively. The interaction between HSPA1A and NQO1 was highlighted in red line.

Off-targets and their off-systems' perturbation after clozapine treatment.

The off-targets, the genes involved in the PPI-based off-systems and the hub genes are in diamond, circle and hexagon shape, respectively. The PPI information from HPRD contains binary PPI and protein complex, and only the former information is visualized in this figure for brief. Red/green indicates the up-/down-regulation of the gene expression after clozapine treatment. Oxidoreductases and gluthathione metabolism related protein are in yellow and purple edges, respectively. The interaction between HSPA1A and NQO1 was highlighted in red line.

Perspective investigation of the predicted genetic risk factors of CIA

Interestingly, oxidoreductases were found to be significantly enriched in prioritized proteins. For example, quinone oxidoreductase (PDB ID: 1YB5), an isozyme of the NQO2 protein, also appears in Table 2. Seventy out of 410 protein pockets (17%) were oxidoreductases (Table S1). However, as Table 2 shows, oxidoreductases were significantly enriched (10 out of 19, 53%, Fisher's exact test p = 6.6E-4). Among targets prioritized by multiple antitheses CPI (Table 3), 15 out of 44 pockets (34%) belonged to oxidoreductases (p = 7.9E-3). In addition, only 12 out of 410 protein pockets (3%) were related to glutathione metabolite, which plays key role in antioxidation. However, as Table 3 shows, 7 out of 45 (16%) were significantly enriched (p = 1.2E-3).

Discussion

Identification of off-targets has potential application in drug repurposing [44], [45] and personalized medicine [13], [46]. Compared with the similarity ensemble approach [47] and the naive Bayesian classifiers approach [48] to off-target identification, both of which build new drug-protein connections within the space of the known therapeutic target, the chemical-protein interactome approach is a step towards analyzing the entire human proteome, although the available human protein structrome is limited. Several of the pocket comparison algorithms have also tried to explore the off-target spaces facing the entire human proteome [15], [17], or tried to map the off-targets onto the pathways [49] or the metabolic network [50], but our study is the first one examining the system's perturbation in terms of both the off-target identification and the off-system's gene expression change, providing candidates for pharmacogenetic and pharmacogenomic studies, respectively. Further work may combine the off-target and the off-system in elucidating and predicting adverse drug reactions. In the retrospective studies, the antitheses CPI recalled the accredited susceptible genes for CIA. As a complement to genetic association studies [6], the CPI reveals the possible mechanism of the CIA based on the drug-protein interaction, the primary step in drug reaction. The difference between the interaction conformation and the interaction strength of CLZ and OLZ towards the off-targets could account for the difference in patients' susceptibility to agranulocytosis. Since none of the nonsynonymous SNPs was found around the ligand binding pocket of the four proteins reported to be involved in CIA, we deduced that individual differences in CIA susceptibility could be explained by a variation in the expression level of the protein. In fact, NQO2 was found to have lower expression levels in CIA susceptible patients [33]. The lower expression level in this detoxification enzyme could make the patient more sensitive to the drug. It is also reasonable to expect subsequent discoveries (e.g. some genotypes correlated to Hsp70 or NQO2 expression level) supporting the CLZ off-target hypothesis, which could lead to biomarker development at genotype and gene expression level [51] in CLZ therapy. The reactive oxygen hypothesis is one of the major hypotheses of agranulocytosis etiology [37]. In our results, CLZ and other drugs causing agranulocytosis tended to affect the oxidoreductases, which play an important role in reactive oxygen clearance. For example, NQO2 protein and myeloperoxidase are key enzymes in the detoxification of active radicals thus protecting the cells from drug-induced oxidative and electrophilic stress [52]. Furthermore, alpha-tocopherol transfer protein is a prioritized target of clozapine (Table 2). Blocking the transferring of tocopherol, which is a strong endogenous antioxidant [53], may also explain clozapine's impact on the detoxification system. Clozapine can be oxidized to reactive nitrenium ions [54], which preferably reacts with sulfhydryl and is detoxified by glutathione. In our results, glutathione related enzymes were significantly enriched in the CPI, implying that the drug causing agranulocytosis not only affected the detoxification system of oxidoreductases, but might also interfered in the glutathione system, which is essential to the detoxification of the major metabolites of CLZ. Besides the unexpected drug-protein interactions, the expression change of the off-system may explain CIA etiology. The perturbation of anti-apoptosis genes by CLZ treatment reflects the fact that CLZ disturbs cell death pathways by binding with Hsp70, and the general up regulation of anti-apoptosis genes can be explained as a feedback towards elevated apoptotic stress mediated by Hsp70 and the anti-oxidation system, since the inhibition of oxidoreductases and the perturbation of oxidoreductase system is a well known mediator of apoptosis [55]. By breaking the balance of oxidation and reduction, CLZ can stimulate apoptosis via Hsp70 inhibition and enhanced oxidative stress. Along with the CPI results, biological effects of CLZ further support the hypothesis that Hsp70 and oxidoreductases together with their respective system serve as the off-targets(-systems) of CLZ and potentially mediate CIA. Since HL60 is derived from peripheral blood leukocytes, which is a representative cell model for the immune system, the finding of the systems perturbation in HL60 cells but not in MCF7 (breast cancer) and PC3 (prostate cancer) cell lines strengthens the antiapoptosis and the oxidoreductases systems' function in immune related events. In summary, 53% and 34% of prioritized proteins from the CPI are oxidoreductases, and 16% of the proteins are related to gluthathione metabolism. These findings suggest a much higher participation of the detoxification/antioxidant systems in drug-induced agranulocytosis than previously thought and the off-targets/-systems identified in this study can represent candidates for biomarker development in wet-lab experiments and pharmacogenetic/pharmacogenomic screening in the future. However, the 410 binding pocket set is a limited representation of the entire human proteome. For instance, it does not include any HLA proteins according to our target preparation criteria, which may be involved in agranulocytosis as a mediator of the immune etiology. Drug-HLA interaction was reported to be an important step determining the drug-HLA specificity in IDR [56]. In our previous study, we have built the abacavir-HLA-B*5701 interaction models for abacavir-induced hypersensitivity [13]. The identification of the drug-HLA interaction at the F-pocket of HLA molecules has been cited by several immunologists [57], [58]. Since HLAs have been identified as the key factors in IDRs [5], [6], [59], [60], the drug-HLA interactome will be systematically studied in future. Identification of the related genes and the systems is the first step towards understanding and more importantly, predicting the IDR. The IDRs were regarded as unpredictable in response to compounds [61]. In this study, we argue that the IDRs are predictable, and the challenge of personalized medicine is not to predict adverse reaction for a compound but for a patient. The biomarkers could be either the genetic variations causing a binding affinity change of the drug towards the off-targets [62], [63], the expression level alteration of one gene [33], or the off-systems' perturbation. Our study demonstrates that beside polymorphisms around the binding pocket that alter the drug efficacy via a change in the binding affinity [64], [65], the off-system expression change could also determine individual variability towards the same drug, suggesting a new way of identifying biomarkers or constructing a prediction model for personalized medicine. Such an approach could also be applied to personalized drug repurposing [66], [67], [68], where the off-targets and the off-systems accounting for the new therapeutic area could also be patient specific. Adverse drug reaction and the new indication are two ‘off-effects’ of the drug towards human being. So this study will also illuminate the drug repositioning by, 1) helping explain the mode-of-action of the serendipitous repositioned drugs via identifying their off-targets/-systems; 2) predicting the new use for existing drugs based on their interaction profiles with the off-targets and their perturbations on the off-systems. For example, one can recruit the case and the control molecular set for a particular indication. After identifying the off-targets/-systems using the methodology in this study, one can predict the indication of a new compound based on its impact on these newly identified off-targets/-systems.

Methods

Analysis of the adverse drug reaction report

The reports were downloaded from the FDA's AERS (http://www.fda.gov/Drugs/GuidanceComplianceRegulatoryInformation/Surveillance/AdverseDrugEffects/default.htm). This system tracks adverse events that are voluntarily reported but only the records from 2004 were freely available. All reports bearing CLZ and OLZ as the primary or secondary suspected drug were counted. The numbers of agranulocytosis cases were then counted for each drug. We performed Fisher's exact test to examine the frequency difference.

Preparing the target set

Protein targets were obtained from third-party protein structure databases, including a drug adverse reaction target database [69], a drug-induced toxicity related protein database [70], a therapeutic target database [71] and a protein database for drug target identification [72]. Every pocket was examined manually when constructing the target set for DOCK according to the following criteria. First, the species should be confined to Homo sapiens; secondly, a co-crystallized ligand must be contained to indicate the targetable state of the protein; thirdly, the pocket should not contain missing residues. Spheres whose radii ranged from 1.1–1.4 Å were generated to fill in the pocket. A grid box was constructed 3–5 Å from the spheres. EC classifications of the enzymes were taken from the annotations of UniProt [73]. Finally, we achieved 410 protein pockets from 384 PDB entries, 74% of which have the resolution less than 2.5 Å.

Choosing the cases and controls for multiple antitheses CPI

Drugs reported in the PubMed literature (up to September, 2009) as being associated with agranulocytosis were chosen as candidates and further examined in the AERS administered by the FDA/Center for Drug Evaluation and Research (http://www.fda.gov/Drugs/GuidanceComplianceRegulatoryInformation/Surveillance/AdverseDrugEffects/default.htm). All AERS raw data were downloaded from the FDA website and then placed in a relational database (MySQL 5.1). Accessible data were limited to the period from Jan 2004 to March 2009. In any adverse event report, only the primary or the secondary suspected drugs were regarded as linked to agranulocytosis. The candidates were only included if the number of reports exceeded 3. The candidates for control drugs were collected from AERS data, on condition that there were no reports of agranulocytosis. Candidates were then confirmed as control drugs only if they had never been co-cited with agranulocytosis in PubMed literature and the first 10 results of a Google search (up to September, 2009; with drug name AND “agranulocytosis” as query term). The major metabolites and the isomers of the drugs were also included. In the end, 39 case and 15 control drug molecules were selected for agranulocytosis endpoint. These 15 controls do not share significant 2D structure similarities. The SMILES code of the drugs and their derivatives was retrieved from PubChem. The 3D conformations of chemicals were simulated using CORINA. Charges and hydrogens of proteins and chemicals were added using Chimera [74].

Choosing the background drug molecules

The background drugs were chosen from the molecules prepared in our previous studies, including anti-Alzheimer drugs [22], drugs referred to in the study by Lamb et al [39] on using the cMap, case and control drugs for rhabdomyolysis, cholestasis, deafness and Stevens-Johnson syndrome and QT prolongation [13]. A total of 255 drug molecules, including case and control drugs for agranulocytosis, were involved in constructing the CPI.

Constructing the CPI

A CPI comprising 255 drugs towards 410 protein pockets was constructed using the DOCK [28] program controlled by Bash shell scripts. The parameters for docking corresponded to the default settings. The 2DIZ transformation [23] was performed where the docking score matrix was normalized first by one drug towards the 410 proteins then by one protein pocket towards the 255 drugs. The empirical threshold −0.48 of the Z′-score was set to distinguish binding and non-binding, based on the findings of the previous studies [22], [23].

Permutation test for the PCC of CLZ-OLZ pairs

To determine the significance level of similarity between four CLZ-OLZ pairs (2 CLZ ionization states×2 OLZ ionization states) across their protein binding profile, we randomly recruited 10,000 sets with four drug pairs from all 255 drugs in the CPI, and identified 9 pairs with mean PCC not lower than the mean PCC of the four CLZ-OLZ pairs.

Microarray data analysis

Suppose there are n genes sharing a specific GO term or linked to the same hub in the HPRD network. Each probe was independently ranked according to expression change for each instance in cMAP, with most up-regulated being at the top. For the cMAP instance # 1170, 1289, 2689 and 6188, which were the CLZ-treated instances, we calculated the mean rank R′ of each probe aswhere R1170, R1289, R2689 and R6188 indicate the rank in instance 1170, 1289, 2689 and 6188, respectively. For evaluation on the perturbation status of a system, we randomly recruited 10,000 sets with n genes, obtaining m sets with mean rank higher than the object system. The p value was calculated as m/10000.

Locating the polymorphism onto the proteins

Polymorphism information for the genes was retrieved from dbSNP [75] and UniProt [73]. The ‘coordinations’ of the amino acid sequence in the PDB files were adjusted to match the ‘coordination’ of dbSNP. The distance between the polymorphism site and the ligand binding pocket of the protein was visualized on PyMOL. Workflow of construction and mining of the multiple antithesis chemical-protein interactome (CPI). (a) Determining the case (AGNL+) and control (AGNL−) drugs from FDA's adverse event reporting system and PubMed. (b) A visualization of the chemical-protein interactome. Proteins that are preferably interacted by case but not control drugs are highlighted in a red dashed rectangle, these being regarded as the candidates mediating CIA. (TIF) Click here for additional data file. Structures of the 15 control molecules. (TIF) Click here for additional data file. Similarity of protein binding profile between Clozapine and Olanzapine. (a). Ordered by positive PCC value, the four CLZ-OLZ pairs ranked at the top 0.86, 2.51, 16.60 and 17.15 percentile of all possible pairs among 255 drug molecules, respectively. (b) The background distribution of the mean PCC of the four drug molecules were generated by randomly recruiting 10,000 sets with four drug pairs among all 255 drugs. CLZ and OLZ have highly similar protein binding profiles in terms of significantly high PCC of Z′-score vectors. (TIF) Click here for additional data file. The 410 protein pockets and their enzyme commission number. (DOC) Click here for additional data file. Drug molecules involved in CPI. (DOC) Click here for additional data file. ANOVA of the chemical-protein interactive effect before and after 2-directional Z-transformation. (DOC) Click here for additional data file.
  74 in total

Review 1.  Idiosyncratic drug reactions: current understanding.

Authors:  Jack Uetrecht
Journal:  Annu Rev Pharmacol Toxicol       Date:  2007       Impact factor: 13.820

2.  Specific binding of aminoglycosides to a human rRNA construct based on a DNA polymorphism which causes aminoglycoside-induced deafness.

Authors:  K Hamasaki; R R Rando
Journal:  Biochemistry       Date:  1997-10-07       Impact factor: 3.162

3.  PharmGKB: a logical home for knowledge relating genotype to drug response phenotype.

Authors:  Russ B Altman
Journal:  Nat Genet       Date:  2007-04       Impact factor: 38.330

4.  Identifying the proteins to which small-molecule probes and drugs bind in cells.

Authors:  Shao-En Ong; Monica Schenone; Adam A Margolin; Xiaoyu Li; Kathy Do; Mary K Doud; D R Mani; Letian Kuai; Xiang Wang; John L Wood; Nicola J Tolliday; Angela N Koehler; Lisa A Marcaurelle; Todd R Golub; Robert J Gould; Stuart L Schreiber; Steven A Carr
Journal:  Proc Natl Acad Sci U S A       Date:  2009-03-02       Impact factor: 11.205

Review 5.  gamma-tocopherol, the major form of vitamin E in the US diet, deserves more attention.

Authors:  Q Jiang; S Christen; M K Shigenaga; B N Ames
Journal:  Am J Clin Nutr       Date:  2001-12       Impact factor: 7.045

Review 6.  Elucidating mechanisms of drug-induced toxicity.

Authors:  Daniel C Liebler; F Peter Guengerich
Journal:  Nat Rev Drug Discov       Date:  2005-05       Impact factor: 84.694

7.  Drug off-target effects predicted using structural analysis in the context of a metabolic network model.

Authors:  Roger L Chang; Li Xie; Lei Xie; Philip E Bourne; Bernhard Ø Palsson
Journal:  PLoS Comput Biol       Date:  2010-09-23       Impact factor: 4.475

8.  DITOP: drug-induced toxicity related protein database.

Authors:  Jing-Xian Zhang; Wei-Juan Huang; Jing-Hua Zeng; Wen-Hui Huang; Yi Wang; Rui Zhao; Bu-Cong Han; Qing-Feng Liu; Yu-Zong Chen; Zhi-Liang Ji
Journal:  Bioinformatics       Date:  2007-04-26       Impact factor: 6.937

9.  Human leukocyte antigen class I-restricted activation of CD8+ T cells provides the immunogenetic basis of a systemic drug hypersensitivity.

Authors:  Diana Chessman; Lyudmila Kostenko; Tessa Lethborg; Anthony W Purcell; Nicholas A Williamson; Zhenjun Chen; Lars Kjer-Nielsen; Nicole A Mifsud; Brian D Tait; Rhonda Holdsworth; Coral Ann Almeida; David Nolan; Whitney A Macdonald; Julia K Archbold; Anthony D Kellerher; Debbie Marriott; Simon Mallal; Mandvi Bharadwaj; Jamie Rossjohn; James McCluskey
Journal:  Immunity       Date:  2008-06       Impact factor: 31.745

10.  SePreSA: a server for the prediction of populations susceptible to serious adverse drug reactions implementing the methodology of a chemical-protein interactome.

Authors:  Lun Yang; Heng Luo; Jian Chen; Qinghe Xing; Lin He
Journal:  Nucleic Acids Res       Date:  2009-05-05       Impact factor: 16.971

View more
  34 in total

Review 1.  Computational polypharmacology: a new paradigm for drug discovery.

Authors:  Rajan Chaudhari; Zhi Tan; Beibei Huang; Shuxing Zhang
Journal:  Expert Opin Drug Discov       Date:  2017-01-23       Impact factor: 6.098

2.  Automatic construction of a large-scale and accurate drug-side-effect association knowledge base from biomedical literature.

Authors:  Rong Xu; QuanQiu Wang
Journal:  J Biomed Inform       Date:  2014-06-10       Impact factor: 6.317

Review 3.  When can patients with potentially life-threatening adverse effects be rechallenged with clozapine? A systematic review of the published literature.

Authors:  Peter Manu; Deepak Sarpal; Owen Muir; John M Kane; Christoph U Correll
Journal:  Schizophr Res       Date:  2011-11-22       Impact factor: 4.939

4.  Combining automatic table classification and relationship extraction in extracting anticancer drug-side effect pairs from full-text articles.

Authors:  Rong Xu; QuanQiu Wang
Journal:  J Biomed Inform       Date:  2014-10-13       Impact factor: 6.317

5.  Xyloketal B, a marine compound, acts on a network of molecular proteins and regulates the activity and expression of rat cytochrome P450 3a: a bioinformatic and animal study.

Authors:  Junhui Su; Cui Chang; Qi Xiang; Zhi-Wei Zhou; Rong Luo; Lun Yang; Zhi-Xu He; Hongtu Yang; Jianan Li; Yu Bei; Jinmei Xu; Minjing Zhang; Qihao Zhang; Zhijian Su; Yadong Huang; Jiyan Pang; Shu-Feng Zhou
Journal:  Drug Des Devel Ther       Date:  2014-12-12       Impact factor: 4.162

6.  Interaction network among functional drug groups.

Authors:  Minho Lee; Keunwan Park; Dongsup Kim
Journal:  BMC Syst Biol       Date:  2013-10-16

Review 7.  Integrative approaches for predicting in vivo effects of chemicals from their structural descriptors and the results of short-term biological assays.

Authors:  Yen Sia Low; Alexander Yeugenyevich Sedykh; Ivan Rusyn; Alexander Tropsha
Journal:  Curr Top Med Chem       Date:  2014       Impact factor: 3.295

8.  A bioinformatic and mechanistic study elicits the antifibrotic effect of ursolic acid through the attenuation of oxidative stress with the involvement of ERK, PI3K/Akt, and p38 MAPK signaling pathways in human hepatic stellate cells and rat liver.

Authors:  Wenhua He; Feng Shi; Zhi-Wei Zhou; Bimin Li; Kunhe Zhang; Xinhua Zhang; Canhui Ouyang; Shu-Feng Zhou; Xuan Zhu
Journal:  Drug Des Devel Ther       Date:  2015-07-31       Impact factor: 4.162

9.  Drug repositioning framework by incorporating functional information.

Authors:  Zikai Wu; Yong Wang; Luonan Chen
Journal:  IET Syst Biol       Date:  2013-10       Impact factor: 1.615

Review 10.  Machine learning approaches and databases for prediction of drug-target interaction: a survey paper.

Authors:  Maryam Bagherian; Elyas Sabeti; Kai Wang; Maureen A Sartor; Zaneta Nikolovska-Coleska; Kayvan Najarian
Journal:  Brief Bioinform       Date:  2021-01-18       Impact factor: 11.622

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.