Literature DB >> 28419258

EigenTHREADER: analogous protein fold recognition by efficient contact map threading.

Daniel W A Buchan1, David T Jones1.   

Abstract

MOTIVATION: Protein fold recognition when appropriate, evolutionarily-related, structural templates can be identified is often trivial and may even be viewed as a solved problem. However in cases where no homologous structural templates can be detected, fold recognition is a notoriously difficult problem ( Moult et al., 2014 ). Here we present EigenTHREADER, a novel fold recognition method capable of identifying folds where no homologous structures can be identified. EigenTHREADER takes a query amino acid sequence, generates a map of intra-residue contacts, and then searches a library of contact maps of known structures. To allow the contact maps to be compared, we use eigenvector decomposition to resolve the principal eigenvectors these can then be aligned using standard dynamic programming algorithms. The approach is similar to the Al-Eigen approach of Di Lena et al. (2010) , but with improvements made both to speed and accuracy. With this search strategy, EigenTHREADER does not depend directly on sequence homology between the target protein and entries in the fold library to generate models. This in turn enables EigenTHREADER to correctly identify analogous folds where little or no sequence homology information is.
RESULTS: EigenTHREADER outperforms well-established fold recognition methods such as pGenTHREADER and HHSearch in terms of True Positive Rate in the difficult task of analogous fold recognition. This should allow template-based modelling to be extended to many new protein families that were previously intractable to homology based fold recognition methods.
AVAILABILITY AND IMPLEMENTATION: All code used to generate these results and the computational protocol can be downloaded from https://github.com/DanBuchan/eigen_scripts . EigenTHREADER, the benchmark code and the data this paper is based on can be downloaded from: http://bioinfadmin.cs.ucl.ac.uk/downloads/eigenTHREADER/ . CONTACT: d.t.jones@ucl.ac.uk.
© The Author(s) 2017. Published by Oxford University Press.

Entities:  

Mesh:

Year:  2017        PMID: 28419258      PMCID: PMC5860056          DOI: 10.1093/bioinformatics/btx217

Source DB:  PubMed          Journal:  Bioinformatics        ISSN: 1367-4803            Impact factor:   6.937


1 Introduction

Accurate prediction of protein structure from protein sequence remains a significant open problem in structural biology and bioinformatics, and this topic has received a great deal of attention in the preceding 50 years. While some sub-problems such as homology modelling have shown marked successes, progress for other aspects has remained relatively modest. A single, integrated mathematical model of protein folding remains elusive (Mitchell and Gronenborn, 2015). Today, protein structure prediction typically proceeds by one of two broad strategies. Template-free or ab initio folding attempts to fold proteins using only the physiochemical information implicit in the protein sequence itself. To date, such methods have achieved rather limited success (Moult ), though recent developments in protein contact prediction are very promising. The alternative strategy, template based (or homology) modelling, is widely used by biologists as it has proven to be a robust predictive strategy, enjoying increasing success as both the sequence and structure databases expand. Template based modelling proceeds by first attempting to identify suitable structural templates for the given query protein sequence. This initial step is commonly referred to as fold recognition. If one or more templates can be identified, the 3D structure or structures can then be used as the basis for homology modelling which will result in a predicted structure (Söding and Remmert, 2011). As such, template-based modelling depends critically on successful fold recognition and to this end many sophisticated fold recognition strategies have been developed. Popular methods make use of computational methods as diverse as: dynamic programming, Support Vector Machines, neural networks, Hidden Markov Models, profile-profile comparison and so forth (Rost ; Olmea ; Zhou and Zhou, 2005; Wu and Zhang, 2008; Lobley ; Peng and Xu, 2011; Ma ; Gniewek ). Fold recognition strategies often involve matching a query sequence against a representative library of known, possible template folds. The fold library is expressed in terms of physiochemical features such as secondary structure and solvent accessibility, which are easy to calculate for each template fold and will also, ideally, be easy to predict from the query sequence and its homologous sequences. Typically, each feature will be expressed as a vector over the length of each fold library member and the query sequence. This representation makes it easy to match the feature vectors of the query sequence to those in the fold library in a computationally efficient manner. With an appropriate scoring function, the quality of each match can in turn be assessed. Query-sequence to specific-fold matches which fulfil some given selection criteria will then be used as structural templates for further structural modelling procedures. Selection criteria vary in sophistication from simple heuristics (‘top n matches’) to probabilistic scoring using Neural Networks or Support Vector Machines. Despite many successes, the early promise of classical threading methods, to detect protein folds in the absence of sequence similarity, has not stood the test of time (i.e. Jones ), or rather has not kept pace with the growth in both sequence and structure data banks. The basic idea of classical threading approaches was to use amino acid pair and solvation potentials to both pick out the best templates and find the optimal alignment (or threading). As fold space became more crowded, it became clear that these potentials alone were not sufficient. Present day methods combine features such as statistical potentials with sensitive sequence profile methods, which have become very powerful due to the exponential growth of sequence data banks, and it is these hybrid approaches that have come to dominate the field. Unfortunately, in cases where there is fold similarity but no evidence of common ancestry (so called analogous folds), sequence-directed fold recognition methods fail to provide adequate results. Here we present a new approach to protein fold recognition, called EigenTHREADER, which revisits the idea of detecting analogous folds by protein threading by exploiting new developments in residue-residue contact prediction rather than statistical potentials. It has long been understood that protein structure can be accurately reconstructed when complete (or sufficient high quality) contact or distance constraint information is available. Indeed, this insight is the basis of solving protein structures by NMR data (Creighton, 1992). With even sparse distance constraints, fold recognition is possible, even when high resolution structure reconstruction may not be possible. This is especially the case when the contact data available principally describes contacts between distal residues in the protein chain. It follows then, that if we can access or predict sufficient distance restraints from amino acid sequence, the fold of any given protein may be elucidated. For many years only modest progress had been made in the problem of protein structure prediction via residue-residue contact prediction. However, recent substantial advances in accurate contact prediction, via co-evolutionary sequence analysis, have now rendered contact prediction a viable path to both de novo protein structure prediction and fold recognition (Marks ; Jones ; Kaján ; Kosciolek and Jones, 2014; Seemayer ; Jones ). We also note such advances have also allowed the development of highly accurate profile search methods such as MRFAlign (Ma ) which integrate both query sequence profile and contact data. In this paper we present EigenTHREADER, a novel method for fold recognition which combines standard threading techniques with accurate contact prediction constraints. Predicted contact maps for query sequences are searched against a pre-generated library of contact maps representing possible template structures. EigenTHREADER has been specifically developed to tackle fold recognition problems in instances where powerful homology-driven detection methods such as HHSearch/HHPred (Söding, 2005) fail to produce results.

2 Materials and methods

2.1 Background

2.1.1 Representation of a protein as a contact map

A protein’s 3D structure can be described in terms of its inter-residue contacts. A contact indicates that a pair of residues (ideally distant in primary sequence) lie close to one another in 3D space in the native folded tertiary structure. Where ‘close’ is defined by some given distance threshold. Typically, this distance threshold is set such that any two residues within the threshold distance may be assumed to take part in some form of physiochemical interaction. The underlying assumption being that such interactions may be critical to stabilizing the 3D structure of the protein. Interaction threshold distances are typically considered between 6 and 16 Å between the C or C carbons of the residue pairs. Given a threshold distance, a contact map (or matrix) can be constructed, which is a 2D representation of the inter-residue contacts within the tertiary structure of a protein chain. Contact maps are square, binary, symmetric matrices valued such that contacting residues are designated 1 and positions in the matrix which do not represent contacts take the value 0. When analysing contact maps adjacent residues are typically excluded or not considered in subsequent analysis as such contacts are trivially true under all contact distance thresholds due to simple amino-acid main-chain connectivity.

2.1.2 The maximum contact map overlap (CMO) problem

The CMO problem asks, given two proteins (P and P) and their respective contact maps (), what is the alignment of the 2D contact maps which maximizes the overlaps between the maps (i.e. best superimposes the two maps)? The problem is constrained such that positions in the first or second protein can be aligned with at most one position in the other protein. Any non-aligned positions are assumed to align to gaps. A second constraint requires that the ordering of residues in both sequences must be preserved. Following on from the work of Di Lena we reproduce here their formalization of the maximum CMO between two contact maps: The maximum CMO of can be calculated as: the alignment of two contact maps, , which maximizes the quantity: Note that contacts between consecutive amino acids are not counted and that there is no penalty to the score for aligning a contact position in one matrix with a non-contact position in the other matrix. So, the maximum CMO is the alignment of the two matrices where the sum of the number of superimposed 1-valued elements is greatest.

2.2 EigenTHREADER

EigenTHREADER is a threading method which efficiently searches a library of protein folds (expressed as contact maps) with the contact map of a query protein. Contacts in the query contact map may be derived by experimental means (e.g. inferred from NMR or x-ray crystallographic data) or, of more relevance to this study, may be generated by predictive methods. In this study we make use of predicted contacts generated by MetaPSICOV (see Section 2.3). This method was found to be the most accurate contact prediction method in the most recent CASP experiment (Kinch ), and is thus an obvious starting point for contact threading. The maximum contact map overlap (CMO) between the predicted contact map for the query protein and every contact map in the fold library is calculated and scored. The highest scoring pairs can then be regarded as valid fold predictions for the query sequence as for those pairs the number of satisfied contacts is maximized. Calculating the maximum CMO is known to be an NP hard problem (Goldman, 1999). EigenTHREADER calculates near maximal CMOs using the heuristic method, Al-Eigen, developed by Di Lena . We introduce some algorithmic improvements so that a large library of folds can be searched in reasonable time. The Al-Eigen method uses eigendecomposition of symmetric matrices (Strang, 2016) and the Needleman-Wunsch alignment algorithm (Needleman and Wunsch, 1970) to achieve high quality contact map alignments in polynomial time.

2.2.1 Al-eigen

Here we briefly outline the Al-Eigen method, for a detailed treatment of the method we refer readers to the paper of Di Lena et al. Eigendecomposition allows us to decompose any real-valued symmetric matrix, M, into a series of eigenvectors and their associated eigenvalues. The matrix, M, can then be reconstituted by summing the outer product of each eigenvector-eigenvalue pair. It follows from this that the matrix M may be approximated, , by considering only the few (tth) eigenvectors with the largest associated eigenvalues. Such that: where is the approximation of matrix M to order t, is the ith eigenvector and is its associated eigenvalue. denotes the outer product of the eigenvector to itself. Two proteins can then be compared by considering the global alignment of the contact map eigenvectors rather than attempting to align the contact maps directly. This can be trivially computed in polynomial time with the Needleman-Wunsch algorithm given a scoring matrix with a specified gap penalty. Di Lena et al. state that their scoring function: Assigns high scores where the entries in each eigenvector, ′ and ′, have the same sign rather than the similar values.

2.2.2 Efficient contact map search

The original Al-Eigen algorithm paper clearly showed that the quality of the alignments was seen to increase as the number of included eigenvectors was increased. However, due to the requirement in their algorithm to evaluate all possible eigenvector signs (as ), the time required for each comparison scaled at 2, where n is the maximum number of eigenvectors considered. This meant that in any practical search time, only a relatively small number of eigenvectors could be considered, limiting the accuracy of alignments. Rather than exhaustively enumerating all possible eigenvector signs, EigenTHREADER opts instead for an iterative search procedure where we attempt to invert the signs of each eigenvector in turn, starting with the eigenvector associated with the largest eigenvalue. The CMO score is then assessed after each inversion, and any sign inversion which decreases the CMO score is rejected. Once a sign inversion is accepted, this process is repeated, starting again with the largest eigenvalue/eigenvector, until no further improvement in CMO score is observed. This modified algorithm is expected to scale by n2 rather than the 2 of the original Al-Eigen. Although this iterative procedure cannot be guaranteed to produce optimal scores we have observed that it always achieves better alignments than Al-Eigen for any comparable runtime (data not shown). As a further constraint to the alignment, a secondary structure matching score can also be optionally added to the CMO score matrix, up-weighting regions of the alignment path matrix where the predicted secondary structure of the target matches the observed secondary structure in the template.

2.2.3 Final scoring

After the optimal contact map alignment is found, a final match score is produced by calculating the Pearson correlation coefficient between the MetaPSICOV contact probabilities and the contact distances in the template protein. One advantage of this score over other metrics is that it can be transformed easily into a t-statistic and so significance can be tested using a standard t-test. This provides a simple statistical significance test for contact map matches. Rather than using the t-statistic alone, as a final refinement of the scoring function, a logistic regression function is fitted to three variables: the t-statistic value, the fraction of the target that is aligned, and the fraction of the template that is aligned. The data used for this regression are pairwise matches (i.e. matching SCOP folds) in the MetaPSICOV (Jones ) training set, which does not overlap with the 150 test proteins. After the regression, this simple model gives good estimates of the probability of a fold-level match being correct for each matched template.

2.3 MetaPSICOV

For the EigenTHREADER performance benchmarking, query protein contacts were predicted using MetaPSICOV (Jones ). MetaPSICOV is a 2 stage neural network protein contact predictor which integrates contact predictions from multiple co-evolutionary protein contact predictors; PSICOV (Jones ), mfDAC/FreeContact (Kaján ) and CCMpred (Seemayer ). In the first stage 672 features are generated for the prediction target protein. These cover a variety of physio-chemical properties such as solvation potential, helix-strand propensities, amino-acid propensities and sequence separation. Critically 6 input features are derived from the three contact prediction methods PSICOV, FreeContact and CCMpred. This stage outputs a predicted contact map for the query sequence. The second stage neural network correlates the outputs for the first stage network analysing the predicted contact map from stage one. Taking an window of the contact map this stage detects patterns to eliminate outlying predictions and infill gaps in the contact map. Inter-residue interactions such as main-chain hydrogen bonding are also identified at this stage. The second stage utilizes a superset of the first stage features with a total feature set of 731 features. Interested readers should refer to the MetaPSICOV paper and its Supplementary material (Jones ).

2.4 Benchmark data

150 single chain, single domain proteins with their associated predicted contacts were taken from the MetaPSICOV benchmark dataset (Jones ). To test EigenTHREADER’s tolerance to sparse or low quality data we generated 8 additional contact subsets taking only a proportion of the contacts for each dataset. For one experiment, we took the top scoring L (sequence length), L/2, L/5 and L/10 long range contacts (sequence separation >21 residues). For the other experiment the lists of contacts for each lists were randomized rather than ranked by prediction score, we then took an L, L/2, L/5 and L/10 set of long range contacts from these randomized lists.

2.5 Benchmark comparison software

EigenTHREADER performance was benchmarked against the state-of-the-art fold recognition methods HHSuite 3.0.0 (https://github.com/soedinglab/hh-suite) and pGenTHREADER 8.9 (http://bioinfadmin.cs.ucl.ac.uk/downloads/pGenTHREADER/).

2.5.1 Fold and sequence libraries

To perform a valid comparison between EigenTHREADER, HHSearch and pGenTHREADER, identical fold libraries were constructed. We downloaded the 13,730 HHSearch a3m files for SCOP 1.75 (http://www.user.gwdg.de/∼compbiol/data/hhsuite/databases/hhsearch_dbs/). These were used to prepare the relevant HH-Suite Hidden Markov Models and library files as per the HH-Suite documentation. For each HH-Suite SCOP a3m file we constructed the equivalent fold library files for EigenTHREADER and pGenTHREADER. We note that we could not generate EigenTHREADER fold library files for a trivial number of the 13 730 domains resulting in a slightly smaller database of 13 613 domains. To maintain parity between each of our fold libraries we deleted these ‘missing’ entries in the EigenTHREADER library from the HHSearch library such that all three libraries cover the same set of 13,613 domains. Uniref90 (Suzek ) for the pGenThreader PSIBLAST was downloaded from UniProt FTP server and for the HHBlits profile generation we downloaded the uniprot20_2013_03 sequence database. Additionally, we wanted to investigate EigenTHREADER runtimes. A fold library based on whole PDB chains (Berman ), 12 833 chains, rather than domains was prepared to represent a potential worst-case runtime use of EigenTHREADER.

3 Results

EigenTHREADER has several tuneable parameters, two of which are performance critical: the number of eigenvectors to match and the contact distance. To find the optimal values for each of these parameters we generated EigenTHREADER predictions across the whole benchmark dataset holding one of the two parameters constant and incrementing the value of the test parameter in integer steps. We ran a non-exhaustive search for both parameters with the number of eigenvectors tested from 1 to 20 (contact distance held at 10 Å) and contact distances from 1 to 20 Å tested (eigenvectors held at 20). As both parameters are unlikely to have any non-linear interaction a grid search of these parameters was not conducted.

3.1 EigenTHREADER runtimes

Figure 1 shows the increase in runtime as the number of eigenvectors is increased. Increasing the number of eigenvectors brings with it increased fold recognition performance, but trading off a quadratic increase in runtime. It is worth noting that as the size of the fold library is increased, runtimes scale linearly as the time to match each fold library entry is approximately constant for a given number of eigenvectors (data not shown). Alongside the EigenTHREADER runtimes we show the estimated runtimes for Al-eigen given the exponential increase in runtime reported in the work of Di Lena et al. It is clear that EigenTHREADER represents a substantial increase in performance.
Fig. 1

EigenTHREADER and Al-eigen runtimes. Average runtime in seconds as a function of the number of eigenvectors used. The contact fold library used contained 12,833 full length PDB chains. Al-eigen runtimes are estimated ater the paper of Di Lena et al

EigenTHREADER and Al-eigen runtimes. Average runtime in seconds as a function of the number of eigenvectors used. The contact fold library used contained 12,833 full length PDB chains. Al-eigen runtimes are estimated ater the paper of Di Lena et al

3.2 Impact of the number of eigenvectors on fold recognition performance

In Figure 2 we show the true positive rate as a function of the number of eigenvectors. Performance is broken down on a t1, t2, t5 and t10 basis, where a true positive has been counted if the correct Class, Fold or Superfamily is found anywhere in the top 1, 2, 5 or 10 results. For all three prediction levels, as we relax the true positive stringency (t1 to t10) the recognition performance increases, as expected. When predicting SCOP class there is no substantial increase in performance as the number of eigenvectors increases, indicating that all the information available for such a prediction is contained in the first eigenvector. At the fold and superfamily levels, as the number of eigenvectors increases the performance also increases. This is expected as each eigenvector should add increasing information to the prediction and there ought to be additional information beyond the first eigenvector. Performance is seen to level out at around 10 eigenvectors but we assume performance increases should slowly continue past 20 eigenvectors. We stopped at 20, as run times begin to become prohibitive for trivial increases in performance.
Fig. 2

Performance as number of eigenvectors increase. Average True Positive Rate of predictions for the 150 benchmark proteins for EigenTHREADER as the number of eigenvectors is adjusted from 1 to 20. Plots show the performance for SCOP Class, Fold and Superfamily predictions considering only the top 1, 2, 5 or 10 scoring predictions

Performance as number of eigenvectors increase. Average True Positive Rate of predictions for the 150 benchmark proteins for EigenTHREADER as the number of eigenvectors is adjusted from 1 to 20. Plots show the performance for SCOP Class, Fold and Superfamily predictions considering only the top 1, 2, 5 or 10 scoring predictions

3.3 Impact of contact distance on performance

Figure 3 shows change in performance as we adjust the contact distance parameter. In all cases, there is little predictive power when only contacts below 5 Å are included. Performance rapidly increases as the contact distance increases reaching peak performance between 7 and 10 Å. Performance tails off once the contact distance exceeds 11 or 12 Å. This is consistent with the distance thresholds found to be optimal for contact-assisted de novo folding (Nugent and Jones, 2012; Kosciolek and Jones, 2014).
Fig. 3

Performance as the distance threshold is increased. Average True positive rate of predictions for the 150 benchmark proteins as the EigenTHREADER distance threshold is adjusted from 1 to 20. Plots show the performance for SCOP Class, Fold and Superfamily predictions considering only the top 1, 2, 5 or 10 scoring predictions

Performance as the distance threshold is increased. Average True positive rate of predictions for the 150 benchmark proteins as the EigenTHREADER distance threshold is adjusted from 1 to 20. Plots show the performance for SCOP Class, Fold and Superfamily predictions considering only the top 1, 2, 5 or 10 scoring predictions

3.4 Performance with sparse data

Figure 4 shows the fold prediction results when running EigenTHREADER with very sparse, long range contact data with either the most confident predictions (Top) or a random set of predictions (Random), see Section 2.4. As expected, as the number of predictions becomes exceedingly sparse, moving from L to L/10, the TPR rate declines rapidly. This correlates to moving from using only 1–5% of the most confident MetaPSICOV predictions to using less than 0.15% of the top contacts. When considering the Top L predictions, the TPR is about 0.2 lower than the peak performances seen in Figures 2 and 3 using only one 20th of the data. This indicates that EigenTHREADER predictions are still robust even with little contact data available. As a control, when randomized contacts are used, it’s clear that EigenTHREADER performs poorly, as expected, indicating the importance of obtaining correct, high quality contact data for correct fold recognition.
Fig 4

EigenTHREADER fold prediction performance. Fold prediction using the Top or Random L, L2, L5 or L10 MetaPSICOV contacts. Comparison shows TPR performance when considering either the top 1, 2, 5 or 10 EigenTHREADER predictions

EigenTHREADER fold prediction performance. Fold prediction using the Top or Random L, L2, L5 or L10 MetaPSICOV contacts. Comparison shows TPR performance when considering either the top 1, 2, 5 or 10 EigenTHREADER predictions

3.5 Comparison of EigenTHREADER, pGenTHREADER and HHSearch

3.5.1 Analogous fold recognition

EigenTHREADER was developed to enable fold recognition in instances where homology based fold recognition is not possible. We have compared the performance of EigenTHREADER in this specific task with two other widely used fold recognition methods; pGenTHREADER and HHSearch. pGenTHREADER is a profile-profile search method which compares a sequence profile generated with PSIBLAST against a library of structure profiles. In the HHSearch case we first used HHBlits to generate sequence profile HMMs and then used these to search the fold library using HHSearch. We are also interested using such predictions to build high quality models, any hits that have less than 40% overlap with the query sequence were also excluded. Figure 5 shows the average true positive rate for the top 1, top 2, top 5 and top 10 predictions for each prediction method. For the following analysis, we have excluded any hits which shared the same SCOP family (left-hand bar chart) or where SCOP family and superfamily are excluded (right-hand bar chart). When family and super family members are excluded it reduces the number of benchmark proteins where a True Positive is attainable. Where family hits are excluded the TPR is calculated over 130 benchmark proteins, when both superfamily and family hits are excluded the TPR is calculated over only 76 proteins. The left-hand bar chart simulates the case where there is minimal homology information present in the fold library for each benchmark protein. The right-hand bar chart simulates the case where there are no homologous relatives for each benchmark protein in the fold library. These highly stringent criteria eliminate most hits from the results of all three methods.
Fig. 5

True Positive Rate comparison for analogous fold recognition. Average True Positive Rate performance for EigenTHREADER, pGenTHREADER and HHSearch across the benchmark target proteins. For these fold recognition searches, the left-hand bar chart considers only matches at fold and superfamily levels (calculated over 130 benchmark proteins). The right-hand bar chart considers matches only at the fold level (calculated over 76 benchmark proteins)

True Positive Rate comparison for analogous fold recognition. Average True Positive Rate performance for EigenTHREADER, pGenTHREADER and HHSearch across the benchmark target proteins. For these fold recognition searches, the left-hand bar chart considers only matches at fold and superfamily levels (calculated over 130 benchmark proteins). The right-hand bar chart considers matches only at the fold level (calculated over 76 benchmark proteins) We see that HHSearch outperforms both pGenTHREADER and EigenTHREADER when homology is present in the fold library (left-hand bar chart). This is to be expected as we know that HHSearch is among the most sensitive sequence homology searching methods available today. However, when we exclude SCOP Superfamily and Family matches from the results the performance of all three methods more than halves. In this case EigenTHREADER shows better performance than the other two methods, nearly 4 times the performance of pGenTHREADER and about twice that of HHSearch. This indicates the EigenTHREADER can have a role to play in the instances of fold recognition where no homologues can be found.

3.5.2 Model quality comparison

All three methods compared are able to produce low resolution backbone structural models based on the fold alignments obtained during the searches (see Section 3.5.1). Under our stringent filtering criteria we note that only 103 of the benchmark proteins find suitable structural templates via HHSearch. The structure comparison scores are calculated only over this subset. Table 1 summarizes the TM-score (Zhang and Skolnick, 2005) and GDT-TS (Zemla ) scores for the best models created by the three methods. Models generated by EigenTHREADER for analogous hits outperform those produced by both pGenTHREADER and HHSearch, for the 123 benchmark proteins which HHSearch finds hits. As we move from T1 to T5 the average median scores typically fall as the model variability rises as more models with lower scores are included in the statistic. The averaged TM and GDT max scores are seen to increase for all methods, indicating that the best fitting model is not always the highest scoring hit.
Table 1

Median and best max TM-score and GDT-TS scores

EigenTHREADER
pGenTHREADER
HHSearch
TM-score (median/max)GDT-TSTM-scoreGDT-TSTM-scoreGDT-TS
T10.35/0.3529.47/29.470.19/0.1916.25/16.250.19/0.1918.5/18.5
T50.32/0.3928.04/33.10.18/0.2316.03/19.440.18/0.1918.63/22.37

The table gives the median TM-Score and GDT-TS score for the Top (highlighted) and Top 5 hits across benchmark set alongside the best score achieved by any target. Values are averaged over 103 benchmark proteins.

Median and best max TM-score and GDT-TS scores The table gives the median TM-Score and GDT-TS score for the Top (highlighted) and Top 5 hits across benchmark set alongside the best score achieved by any target. Values are averaged over 103 benchmark proteins. In Figure 6 we plot the actual TM scores of the T1 hits from both EigenTHREADER and HHSearch for the benchmark proteins. Nearly all the EigenTHREADER T1 models have greater TM scores than the HHSearch T1 models. This indicates that EigenTHREADER’s best hit template is either closer to the target structure for that benchmark protein, or that the alignment to the template may be more accurate.
Fig. 6

Comparison of EigenTHREADER and HHSearch T1 TM scores. Each point represents a single benchmark protein. The TMscore (x and y axes) for the highest scoring model for both methods are plotted

Comparison of EigenTHREADER and HHSearch T1 TM scores. Each point represents a single benchmark protein. The TMscore (x and y axes) for the highest scoring model for both methods are plotted

4 Conclusion

In the presence of detectable homologous structures, protein fold recognition may be regarded as being a mostly solved problem. Previous results amply demonstrate that methods such as pGenTHREADER and HHSearch achieve very high accuracy for this aspect of the fold recognition problem. Recognition of analogous folds, where no homologues exists in the fold library, is anything but a solved problem. Performance of predictive methods in this task, is typically poor. In this paper we have presented and benchmarked an alternative approach to fold recognition, EigenTHREADER, which relies only on residue contacts predicted from sequence alignments. Our benchmark demonstrates that EigenTHREADER outperforms both pGenTHREADER and HHSearch in the challenging task of analogous fold recognition, although it is not as sensitive in the task of homologous fold search. This work further demonstrates the power of recently developed co-evolutionary contact prediction methods in varied structural bioinformatics applications. Given the ability to predict an accurate contact map, and assuming the native fold is present in the fold library, EigenTHREADER offers an alternative path to identify useful templates for homology modelling. This should make template-based modelling a viable option for many more structurally uncharacterized sequence families in the near future.
  26 in total

1.  The Protein Data Bank.

Authors:  H M Berman; J Westbrook; Z Feng; G Gilliland; T N Bhat; H Weissig; I N Shindyalov; P E Bourne
Journal:  Nucleic Acids Res       Date:  2000-01-01       Impact factor: 16.971

2.  Accurate de novo structure prediction of large transmembrane protein domains using fragment-assembly and correlated mutation analysis.

Authors:  Timothy Nugent; David T Jones
Journal:  Proc Natl Acad Sci U S A       Date:  2012-05-29       Impact factor: 11.205

3.  pGenTHREADER and pDomTHREADER: new methods for improved protein fold recognition and superfamily discrimination.

Authors:  Anna Lobley; Michael I Sadowski; David T Jones
Journal:  Bioinformatics       Date:  2009-05-07       Impact factor: 6.937

4.  A multiple-template approach to protein threading.

Authors:  Jian Peng; Jinbo Xu
Journal:  Proteins       Date:  2011-04-04

5.  Critical assessment of methods of protein structure prediction (CASP)--round x.

Authors:  John Moult; Krzysztof Fidelis; Andriy Kryshtafovych; Torsten Schwede; Anna Tramontano
Journal:  Proteins       Date:  2013-12-17

6.  De novo structure prediction of globular proteins aided by sequence variation-derived contacts.

Authors:  Tomasz Kosciolek; David T Jones
Journal:  PLoS One       Date:  2014-03-17       Impact factor: 3.240

7.  MetaPSICOV: combining coevolution methods for accurate prediction of contacts and long range hydrogen bonding in proteins.

Authors:  David T Jones; Tanya Singh; Tomasz Kosciolek; Stuart Tetchner
Journal:  Bioinformatics       Date:  2014-11-26       Impact factor: 6.937

8.  CCMpred--fast and precise prediction of protein residue-residue contacts from correlated mutations.

Authors:  Stefan Seemayer; Markus Gruber; Johannes Söding
Journal:  Bioinformatics       Date:  2014-07-26       Impact factor: 6.937

9.  Assessment of CASP11 contact-assisted predictions.

Authors:  Lisa N Kinch; Wenlin Li; Bohdan Monastyrskyy; Andriy Kryshtafovych; Nick V Grishin
Journal:  Proteins       Date:  2016-03-09

10.  FreeContact: fast and free software for protein contact prediction from residue co-evolution.

Authors:  László Kaján; Thomas A Hopf; Matúš Kalaš; Debora S Marks; Burkhard Rost
Journal:  BMC Bioinformatics       Date:  2014-03-26       Impact factor: 3.169

View more
  18 in total

1.  Probabilistic divergence of a template-based modelling methodology from the ideal protocol.

Authors:  Ashish Runthala
Journal:  J Mol Model       Date:  2021-01-07       Impact factor: 1.810

2.  Fold recognition by scoring protein maps using the congruence coefficient.

Authors:  Pietro Di Lena; Pierre Baldi
Journal:  Bioinformatics       Date:  2021-05-01       Impact factor: 6.937

3.  ProALIGN: Directly Learning Alignments for Protein Structure Prediction via Exploiting Context-Specific Alignment Motifs.

Authors:  Lupeng Kong; Fusong Ju; Wei-Mou Zheng; Jianwei Zhu; Shiwei Sun; Jinbo Xu; Dongbo Bu
Journal:  J Comput Biol       Date:  2022-01-21       Impact factor: 1.479

4.  DisCovER: distance- and orientation-based covariational threading for weakly homologous proteins.

Authors:  Sutanu Bhattacharya; Rahmatullah Roche; Bernard Moussad; Debswapna Bhattacharya
Journal:  Proteins       Date:  2021-10-11

5.  High precision in protein contact prediction using fully convolutional neural networks and minimal sequence features.

Authors:  David T Jones; Shaun M Kandathil
Journal:  Bioinformatics       Date:  2018-10-01       Impact factor: 6.937

6.  Why can deep convolutional neural networks improve protein fold recognition? A visual explanation by interpretation.

Authors:  Yan Liu; Yi-Heng Zhu; Xiaoning Song; Jiangning Song; Dong-Jun Yu
Journal:  Brief Bioinform       Date:  2021-09-02       Impact factor: 11.622

7.  CopulaNet: Learning residue co-evolution directly from multiple sequence alignment for protein structure prediction.

Authors:  Fusong Ju; Jianwei Zhu; Bin Shao; Lupeng Kong; Tie-Yan Liu; Wei-Mou Zheng; Dongbo Bu
Journal:  Nat Commun       Date:  2021-05-05       Impact factor: 14.919

8.  Protein structure prediction using deep learning distance and hydrogen-bonding restraints in CASP14.

Authors:  Wei Zheng; Yang Li; Chengxin Zhang; Xiaogen Zhou; Robin Pearce; Eric W Bell; Xiaoqiang Huang; Yang Zhang
Journal:  Proteins       Date:  2021-08-07

9.  Improving protein fold recognition using triplet network and ensemble deep learning.

Authors:  Yan Liu; Ke Han; Yi-Heng Zhu; Ying Zhang; Long-Chen Shen; Jiangning Song; Dong-Jun Yu
Journal:  Brief Bioinform       Date:  2021-11-05       Impact factor: 13.994

10.  LOMETS3: integrating deep learning and profile alignment for advanced protein template recognition and function annotation.

Authors:  Wei Zheng; Qiqige Wuyun; Xiaogen Zhou; Yang Li; Peter L Freddolino; Yang Zhang
Journal:  Nucleic Acids Res       Date:  2022-04-14       Impact factor: 19.160

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.