Qi-Shi Du1,2, Shu-Qing Wang3, Neng-Zhong Xie1, Qing-Yan Wang1, Ri-Bo Huang1, Kuo-Chen Chou4,2. 1. State Key Laboratory of China for Biomass Energy Enzyme Technology, National Engineering Research Center of China for Non-Food Biorefinery, Guangxi Academy of Sciences, Nanning 530007, China. 2. Gordon Life Science Institute, Boston, MA 02478, USA. 3. School of Pharmacy, Tianjin Medical University, Tianjin 300070, China. 4. Center for Informational Biology, University of Electronic Science and Technology of China, Chengdu 610054, China.
Abstract
A two-level principal component predictor (2L-PCA) was proposed based on the principal component analysis (PCA) approach. It can be used to quantitatively analyze various compounds and peptides about their functions or potentials to become useful drugs. One level is for dealing with the physicochemical properties of drug molecules, while the other level is for dealing with their structural fragments. The predictor has the self-learning and feedback features to automatically improve its accuracy. It is anticipated that 2L-PCA will become a very useful tool for timely providing various useful clues during the process of drug development.
A two-level principal component predictor (2L-PCA) was proposed based on the principal component analysis (PCA) approach. It can be used to quantitatively analyze various compounds and peptides about their functions or potentials to become useful drugs. One level is for dealing with the physicochemical properties of drug molecules, while the other level is for dealing with their structural fragments. The predictor has the self-learning and feedback features to automatically improve its accuracy. It is anticipated that 2L-PCA will become a very useful tool for timely providing various useful clues during the process of drug development.
Entities:
Keywords:
PCA; drug design; molecular fragments; peptides; physicochemical properties
With the fast developments of computer-aided drug design (CADD) [1-5], currently a number of drug design approaches are developed, and several computer software packs [6, 7] are available that can speed up the discovery of new chemical and biological drugs in more efficient and economical procedure. However, so far we still have no perfect theories, ideal technologies, and faultless software tools that can guarantee complete success of the designed drugs due to the complicity of the interactions between medicinal drugs and their biological targets [8, 9]. The factors and parameters that may affect the bioactivities of drugs are not only from the structure of drug itself, but also from its biological target, coenzymes, and interaction environment [10, 11].Principal component analysis (PCA) [12-14] is a useful tool that has been widely used in chemistry, biology, environment, and many fields of social science. The PCA approach has also been used in drug design for many years. Traditionally PCA is a single level and one direction prediction and analysis technique, described as the following equationwhere are the physicochemical parameters of the i-th molecule, are the coefficients of molecular parameters, and w is bioactivity of the i-th molecule [15, 16]. The bioactivity w could be logarithm of IC50, (pIC50,=-logIC50,), or binding free energy ΔG° between drug and receptor.After the coefficients of parameters are solved from the linear equations Eq.1 in a training set of drug candidates, the parameter coefficients can be used to predict the bioactivities of the designed or newly synthesized drug compounds,where K is the total number of molecular parameters. Currently hundreds even thousands of molecular parameters are available for drug design [17, 18]. However for certain drug-receptor interaction system, these parameters are not equally important; actually too many parameters may cause the over correlation problem [19, 20]. In PCA technique only the principle components are selected to describe the bioactivities of drug molecules, and to predict the bioactivities of drug candidates.In the present study, an improved principal component analysis method, the so-called two-level principal component analysis (2L-PCA), is proposed to deal with the extreme complexity and huge amount of parameters in drug design and discovery. In the 2L-PCA predictor, the 1st level is to deal with the physicochemical properties of drug molecules, and the 2nd level is to deal with the fragments of molecular structures. The proposed two-level model can not only significantly enhance the prediction power, but also yield more useful information for in-depth analysis.According to Chou’s 5-step rule [21] that has been widely used by many investigators (see, e.g., [22-37]), to develop a really useful statistical predictor, one should consider the following five procedures: (1) benchmark dataset; (2) sample representation; (3) operation algorithm; (4) cross validation; (5) web-server. Below, let us describe how to deal with them one-by-one. However, to comply with the Journal’s rubric style, they are not exactly following the aforementioned order.
RESULTS AND DISCUSSION
As an example to show the advantage of 2L-PCA, we applied it for predicting the binding affinity of epitope-peptides with class I MHC molecules HLA-A*0201 [38, 39]. HLA-A*0201 is one of the most frequent class I alleles found in many different species and populations, which plays a critical role for antigen presentation in both viral antigens [40] and tumor antigens from a variety of cancers [41-44], and is expressed in approximately 50% of Caucasians population [45].The epitope-peptides consist of nine amino acids [38, 39]. In the 2L-PCA study for the epitope-peptides, the nine side chains of the nine amino acids are the nine fragments. Eight physicochemical properties are used as the descriptors of the 20 natural amino acids. Four of them are the HMLP parameters [15, 16], describing the lipophilic character, hydrophilic character, surface area with lipophilic potential, and surface area with hydrophilic potential, respectively. The fifth property is the volume of amino acid side chains. The remaining three properties are the secondary structural potency indices of amino acids: the α-potency, β-potency, and coil-potency [46]. Listed in Table 1 are the eight physicochemical parameters of 20 amino acids used in this study.
Table 1
Eight physicochemical parametersa of 20 natural amino acid side chains
A.A.
Lip
Hyd
SL (Å2)
SH (Å2)
Pα
Pβ
Pc
V(Å3)
Leu (L)
1.2906
0.0000
84.5476
0.0000
1.21
1.30
0.68
166.7
Ile (I)
1.1046
0.0000
88.6055
0.0000
1.08
1.60
0.66
166.7
Val (V)
0.5324
0.0000
77.8108
0.0000
1.06
1.70
0.62
140.0
Phe (F)
0.4412
-0.1195
105.7054
11.2472
1.13
1.38
0.71
189.9
Met (M)
1.0768
-0.3068
70.3631
23.2299
1.45
1.05
0.58
162.9
Trp (W)
0.8364
-0.4310
133.6980
14.8820
1.08
1.37
0.75
227.8
Ala (A)
0.1744
0.0000
34.7760
0.0000
1.42
0.83
0.70
88.6
Cys (C)
0.2479
-0.2402
23.5563
30.4540
0.70
1.19
1.18
108.5
Gly (G)
0.0208
0.0000
3.7616
0.0000
0.57
0.75
1.50
60.1
Tyr (Y)
0.4534
-0.5896
80.9646
42.7160
0.69
1.47
1.06
193.6
Thr (T)
1.4265
-0.4369
46.7285
16.0490
0.83
1.19
1.07
116.1
Ser (S)
0.2346
-0.6040
26.0681
15.9613
0.77
0.75
1.32
89.0
His (H)
0.8124
-0.7766
82.1701
13.8631
1.00
0.87
1.06
153.2
Gln (Q)
1.0036
-0.7211
70.0876
17.8662
1.11
1.10
0.86
143.9
Lys (K)
1.4600
-0.6229
97.7144
8.0786
1.16
0.74
0.98
168.7
Asn (N)
0.6396
-0.7211
50.5075
17.7804
0.67
0.89
1.35
117.7
Glu (E)
1.0315
-0.9298
57.1582
25.5726
1.51
0.37
0.84
138.4
Asp (D)
0.6058
-0.9298
37.4173
25.2736
1.01
0.54
1.20
111.1
Arg (R)
1.2424
-1.4797
90.8008
35.3095
0.98
0.93
1.04
173.4
Pro (P)
0.3226
0.0000
69.2297
0.0000
0.57
0.55
1.59
122.7
Lip: lipophilic index; Hyd: hydrophilic index; SL: lipophilic surface area; SH: hydrophilic surface area; Pα: potency of α-helix; Pβ: potency of β-band; P: potency of loop; V: volume of side chains.
Lip: lipophilic index; Hyd: hydrophilic index; SL: lipophilic surface area; SH: hydrophilic surface area; Pα: potency of α-helix; Pβ: potency of β-band; P: potency of loop; V: volume of side chains.In this study the HMLP parameters were used to describe the lipophilicity and hydrophilicity of molecular fragments. In peptides the HMLP parameters of the 20 natural amino acid side chains are available from literatures. However, the HMLP parameters of common chemical molecular fragments have to be derived using complicated calculations. In such cases other hydrophobic parameters can be used, e.g., the atom-based hydrophobic parameters in [47].To reduce computational time, the cross validation in this study was performed via the independent dataset test [48], as described as follows. The sequences and experimental binding affinities of the 90 peptides were used as the training dataset to train the model, while those of the 40 peptides taken from [49] as the independent dataset to test the model. Actually, such 40 peptides had also been compiled in a series of publications [41, 42, 50–55]. The logarithms (pIC50) of IC50 were used as the bioactivity, because they are related to the changes in the free binding energy [55, 56]. Listed in Table 2 are the sequences and the experimental pIC50 of the peptides used in the training set. The binding strength of the 90 training peptides and 40 testing peptides covers the low, intermediate, and high affinity. The following two criteria were applied in the choice of the testing peptides: (1) the range of binding affinities in the testing dataset should not exceed the range of affinities in the training set; (2) the amino acid at each position in the testing dataset should also be present at that position in the training set of peptides. These two conditions make the 130 peptides to be the ideal benchmark dataset for 2L-PCA method.
Table 2
Amino acid sequences and experimental and predicted bioactivities of 90 MHC-I peptides in the training set
Statistical indices:R=0.887132 R2= 0.787003 RES=0.366873 SEE=0.038672.The iterative 2L-PCA technique described in Method section is used for the binding affinity study of peptides based on the sequences and experimental data listed in Table 2. The initial coefficient values of fragment parameters were assigned to 1, implying that all fragment parameters are equally important. Shown in Figure 1 are the curves of correlation coefficients R vs iterations , where the curve R is for the iteration of coefficients , and the curve R is for the iterations of coefficients . The average fitting error Q between the calculated bioactivities and the experimental bioactivities of peptides are shown in Figure 2, where Q is for iteration and Q for iteration. It has been observed that, after 10 to 12 iterations, the iterative result converged smoothly. The converged prediction coefficient sets and are given in Table 3. In the iterative solution precedure the correlation coefficien increases from the first value RA(1)=0.4167 to the converged value RA(98)=0.8871, and the prediction residue decreases from the first value QA(1)=0.7223 to the converged value QA(98)=0.0387.
Figure 1
The correlation coefficients between experimental and predicted bioactivities increase with the iterations
R is the correlation coefficient in the iterative procedure for of the physicochemical properties, and R is the correlation coefficient in the iterative procedure for of the molecular fragments.
Figure 2
The residue between predicted bioactivities and experimental bioactivities in the iterative procedure
The Q is the average square root of the summation of squared differences between predicted bioactivities and experimental bioactivities. Q is for iteration and Q is for iteration.
Table 3
Prediction coefficients of eight physicochemical properties and nine residue positions obtained from the training set of MHC-I peptides
No.
Property
Coefficient
No.
Position
Coefficient
{ak}
(Residue)
{bkl}
1
Lip
-0.02445
1
R1
2.53268
2
Hyd
0.19258
2
R2
8.36712
3
SL
-0.00212
3
R3
3.06856
4
SH
0.00348
4
R4
-4.89559
5
Pα
0.15367
5
R5
3.12686
6
Pβ
0.07823
6
R6
2.45367
7
Pc
0.19764
7
R7
1.24669
8
Vol
0.00366
8
R8
-3.50416
--
--
--
9
R9
-3.79249
The correlation coefficients between experimental and predicted bioactivities increase with the iterations
R is the correlation coefficient in the iterative procedure for of the physicochemical properties, and R is the correlation coefficient in the iterative procedure for of the molecular fragments.
The residue between predicted bioactivities and experimental bioactivities in the iterative procedure
The Q is the average square root of the summation of squared differences between predicted bioactivities and experimental bioactivities. Q is for iteration and Q is for iteration.The predicted pIC50 of the 40 queried peptides in the testing set are given in Table 4, which were predicted using the coefficients of properties and of fragments based on the eight physicochemical parameters and the nine fragments (amino acid side chains). The diversity of the peptides in the training set is very important for the prediction power of TLPC, especially for the residue positions at which we want to make prediction. It is expected that, with more experimental data available, the predictive power of 2L-PCA will be further improved. Actually, 30 prediction servers for humanMHC-I peptide molecules were evaluated in a review article [57]. Among the 30 existing servers, 16 were ranked as the first class that provided the most accurate prediction results for MHC-I peptide molecules with the correlation coefficients ranging from r = 0.55 to r = 0.87. It has been shown in this study that the prediction correlation coefficient yielded by our 2L-PCA method is r = 0.868, being ranked around the very top of the first class.
Table 4
Amino acid sequences and experimental and predicted bioactivities of 40 MHC-I peptides in the testing set
Statistical indices:R=0.867872 R2= 0.753202 RES=0.469728 SEE=0.074271.2L-PCA neither needs knowing the exact comformations of the peptides nor needs aligning the peptides according to a template. The two steps are necessary but quite difficult for CoMFA [58, 59] and CoMSIA [60, 61] owing to that there are numerous possible conformations for peptides and that the experimental crystal structure for serving as a template is often not available. 2L-PCA method provides an alternate way for design of the chemical drugs and peptide drugs.The eigenvalues and contributions of physicochemical properties and amino acid positions in peptides are summarized in Table 5 and shown in Figure 3. In Table 5 the eigenvalues are normalized. The eigenvalue portion of the first three property eigenvectors is almost 100%, and the eigenvalue portion of the first eigenvector alone is larger than 99%. Most contributions are made by the three properties: side chain volume (Vol), lipophilic surface area (SL), and hydrophilic surface area (SH), as shown in Figure 3b and Table 5. The contributions of other 5 properties seem very small. The eigenvalue of the first peptide position eigenvector is larger than 98%. In Table 5 the contributions of the nine amino acid positions are different. However the differences are not big, implying that all positions are almost equally important. The detailed computation results are given in Supplementary Information 1.
Table 5
Eigenvalues and contributions of physicochemical properties and amino acid positions in training set of peptides
Physicochemical properties
Positions (fragments)
No.
Eigenvaluea
Property
Contribution
No
Eigenvalue a
Position b
Contribution
1
0.99118
Lip
0.00004
1
0.98873
Residue-1
0.12126
2
0.00641
Hyd
0.00000
2
0.00300
Residue-2
0.12043
3
0.00240
SL
0.20595
3
0.00249
Residue-3
0.1130
4
0.00005
SH
0.00534
4
0.00213
Residue-4
0.09871
5
0.00004
Pα
0.00004
5
0.00106
Residue-5
0.1046
6
0.00003
Pβ
0.00005
6
0.00094
Residue-6
0.10804
7
0.00002
Pc
0.00002
7
0.0007
Residue-7
0.11931
8
0.00001
Vol
0.78857
8
0.00058
Residue-8
0.10186
--
--
--
--
9
0.00037
Residue-9
0.11278
a Eigenvalues are normalized.
b The positions of peptides are equal to the fragments of molecules.
Figure 3
Eigenvalues and contributions of properties and peptide positions
(a) The eigenvalues of property eigenvectors. (b) The contributions of properties to the eigenvalues. The volumes (Vol) and hydrophobic surface areas (SL) of amino acid side chains make the largest contributions. (c) The eigenvalues of peptide position eigenvectors. (d) The contributions of peptide positions to the eigenvalues. The contributions of all nine amino acid positions are almost equally important.
a Eigenvalues are normalized.b The positions of peptides are equal to the fragments of molecules.
Eigenvalues and contributions of properties and peptide positions
(a) The eigenvalues of property eigenvectors. (b) The contributions of properties to the eigenvalues. The volumes (Vol) and hydrophobic surface areas (SL) of amino acid side chains make the largest contributions. (c) The eigenvalues of peptide position eigenvectors. (d) The contributions of peptide positions to the eigenvalues. The contributions of all nine amino acid positions are almost equally important.We are often facing two kinds of challenges in theoretical prediction for drug design: one is over-correlation problem, and the other is lack of information and explanation for the predicted results. The over-correlation problem is caused by large amount of parameters used in the prediction model, which may yield quite good correlation results in self-consistency test [62, 63], but very poor predicted results in independent dataset test owing to the high dimensional disaster [19] or “curse of dimensionality” problem. To solve this problem, the pseudo amino acid composition (PseAAC) was introduced [64]. Ever since then, the concept of PseAAC or the general PseAAC [21] has been widely used in drug development and biomedicine [65, 66] and nearly all the areas of computational proteomics (see, e.g., [67] as well as a long list of references cited in [68, 69]). Actually, the physicochemical properties used here can be regarded as some optimal pseudo components [70]. It is through such a PseAAC approach to remove the trivial parameters (or reduce the feature vector’s dimension) and grasp the key ones. Besides, the traditional prediction methods fail to provide a good explanation for the predicted results; i.e., how do the physicochemical properties and the structural changes affect the bioactivities? In contrast to that, the proposed “2L-PCA” method can provide more information about the impact of the physicochemical properties and molecular fragments to the bioactivities of drug candidates.
MATERIALS AND METHODS
In practical drug design and development, usually the basic structure of drug candidates keep constant, only small modifications are made on several fragments. The structure parameters of the entire molecules cannot clearly describe the detailed characters of the small changes at individual fragments or substitutes. In the 2L-PCA model the molecular structures are separated into several fragments, and are described by a set of fragment parameters. An example of molecular structure and its fragments is shown in Figure 4A. The idea of molecular fragments also can be applied to the peptide drugs, in which each side chain of an amino acid is a fragment, as shown in Figure 4B.
Figure 4
Illustration of molecular fragments
(A) The structural fragments in neuraminidase (NA) of influenza virus A inhibitors. The molecular structure is divided into 4 fragments according to the substitutes being investigated. The fragments F1, F2 and F3 are three substituent groups, and the fragment F4 is the remaining part of the molecular parent. (B) In short peptides each side chain of amino acid residue is a fragment.
Illustration of molecular fragments
(A) The structural fragments in neuraminidase (NA) of influenza virus A inhibitors. The molecular structure is divided into 4 fragments according to the substitutes being investigated. The fragments F1, F2 and F3 are three substituent groups, and the fragment F4 is the remaining part of the molecular parent. (B) In short peptides each side chain of amino acid residue is a fragment.
General 3D equation of 2L-PCA
In the 2L-PCA prediction model the bioactivity w of molecule i is the summation of contributions Δg from all molecular fragments; i.e.,where Δg is the contribution of fragment l to the bioactivity w of molecule i, b is the prediction coefficient of fragment l, and L is the total number of molecular fragments. The contribution Δg of fragment l is the summation of the contributions from all physicochemical properties of fragment l, namelywhere x is the physicochemical property k of fragment l in molecule i, a is the prediction coefficient of physicochemical property k, and K is the total number of physicochemical properties.Inserting the Eq.4 into Eq.3 we get the general equation of 2L-PCA prediction model as given bywhere N is the total number of molecular samples. Eq.5 can be expressed in vector and matrix form as given belowwhere XN,L,K is the three dimensional (3D) data matrix of molecular parameters, WN is the bioactivity column vector of molecular samples, BL is the coefficient vector of fragments, and AK is the coefficient vector of physicochemical properties.
2D equations of properties and fragments
The general three-dimensional 2L-PCA equation of Eq.6 can be reduced to two 2D equations with the following algebra operations,where HN,L is the 2D data matrix of molecular fragments. Substituting HN,L into Eq.6, we obtain the following fragment 2D equationLikewise, the property 2D equation can also be expressed asandwhere FN,K is the 2D data matrix of physicochemical properties.
Algebra solutions of property and fragment 2D equations
The fragment 2D equation Eq.8 and the property 2D equation Eq.10 can be solved using the standard algebra method. Both sides of the fragment 2D equation of Eq.8 are multiplied with the transposed matrix HtN,L from left, it follows thatandThus, we get the following symmetrically square matrix equation of fragmentsSince the fragment square matrix equation of Eq.13 is multiplied by its inverse matrix U-1L,L, the prediction coefficients BL for the fragments are obtained, as given belowwhere the inverse matrix U-1L,L can be obtained by solving the eigen equation [71] [48] of UL,L, namely the equationmeaningwhere ΨL,L is the eigenvectors and αL is the eigenvalues of fragment square matrix UL,L[72, 73].Similarly, left-multiplying both sides of property 2D equation of Eq.10 with FtN,K, we haveandFrom Eqs.17-18, we get the following square matrix equation of propertiesMultiplying Equation Eq.19 with the inverse matrix V-1K,K, will give the solution of property prediction coefficients AK; i.e.Thus, the inverse matrix V-1K,K is obtained by solving the eigen equation of property square matrix VK,K:andwhere ΦK,K is the eigen-vectors and βk is the eigen-values of the property square matrix VK,K.
Iterative solution of 2L-PCA equations
In the training dataset for drug candidates the two prediction coefficients set AK and BL in the 2L-PCA general equation Eq.6 are solved in an iterative procedure [74, 75]. Firstly the initial fragment coefficients B(0)L are assigned to 1 {b=1, i=1,2…,L}, implying all fragments are equally important. The initial B(0)L are used in the property 2D equations Eq (9) and (10), thus the first solution of property coefficients A(1)K is obtained by solving the eigen-equations Eq.17-20. Then the property coefficients A(1)K are used in the fragment equations Eqs.7-8, and the first solution of fragment coefficients B(1)L are obtained by solving eigen-equations Eq.11-14. In the next iterative cycle the B(1)L is used to find the A(2)K. Above iterative procedure is repeated for n times, until to reaching a threshold value ε; i.e.,The bioactivities of designed drugs and newly synthesized drug candidates are predicted using the converged coefficients and as given belowIllustrated in Figure 5 is the iterative solution procedure for the 2L-PCA predictor.
Figure 5
The iterative algebra solution procedure of the solution of 2L-PCA prediction model for the two sets of coefficients {a(} and {b(}, where N is the number of molecular samples, L is the number of fragments in molecules, L′ is the principal number of fragments, K is the number of physicochemical properties, and K′ is the principal number of properties
Principal component analysis of properties and fragments
The property eigenvectors are orthogonal and normalized; i.e.,andwhere the term φ2 is the component of the j-th property in the k-th eigen-vector φ. The first K′ property eigen-vectors are the principal components whose eigen-values are larger than a threshold (e.g., ε=90% or 95%); i.e.,The total contribution γ of the j-th property to the bioactivity of molecular samples in training set is defined as the following summation,The property eigen-vectors span an orthogonal multiple space, in which a drug molecule P is a vector, and its projection J on the k-th property-eigenvector φ is calculated bywhere f is the i-th row vector of the property matrix FNK of Eq.9. In the projection J of molecular sample P on the k-th property-eigenvector j the component of the r-th property is αφ2, therefore the total contribution of r-th property to the sample P is the summation of components from all principal property eigenvectors, namelySimilarly, the fragment eigenvectors ψ span an L-dimensional orthogonal space. The first L′ fragment eigenvectors are the principal components. The total contribution factor λ of the j-th fragment to the bioactivity of peptide set is given byIn the same way the projection I of sample P on the l-th fragment-eigenvector ψ can be calculated bywhere h is the i-th row vector of the fragment matrix HNL of Eq.7. In the projection I of molecule P on the l-th fragment-eigenvector φ the component of the r-th fragment is αψ2, therefore the total contribution of r-th fragment to the sample P is the summation of components from all principal fragment eigenvectors; i.e.,
Web-server
As pointed out in [76], user-friendly and publicly accessible web-servers represent the future direction for developing practically more useful predictors or any computational tools. Actually, user-friendly web-servers as given in a series of recent publications [23-25, 30, 32, 34-36, 69, 70, 77-91] will significantly enhance the impacts by attracting the broad experimental scientists [66, 92]. We will do our best to establish a web-server for 2L-PCA as soon as possible. Once it has been done, an announcement will be made thorough a publication or our webpage.
CONCLUSION
The 2L-PCA predictor proposed in this paper is a very useful tool for drug design. Its advantages can be summarized as follows. (1) With 2L-PCA, the molecular structures of drug candidates can be separated into several fragments described by physicochemical parameters of the molecular fragments, thus the small modifications on individual fragments can be clearly shown. (2) Its two prediction coefficient sets of properties and of fragments can be solved in an iterative procedure, which possesses self-learning ability and information feed-back function in certain degree, and hence greatly promoting the prediction power of 2L-PCA. (3) It possesses the information from both of the structures of molecular fragments and the physicochemical properties, able to significantly improve the drug candidates in both the structure and property. (4) Its elegant algebra solution procedure will be very useful for further enhancing the ability of principal component analysis (PCA).
Authors: A Sette; J Sidney; M F del Guercio; S Southwood; J Ruppert; C Dahlberg; H M Grey; R T Kubo Journal: Mol Immunol Date: 1994-08 Impact factor: 4.407
Authors: G E Peoples; P S Goedegebuure; R Smith; D C Linehan; I Yoshino; T J Eberlein Journal: Proc Natl Acad Sci U S A Date: 1995-01-17 Impact factor: 11.205