- Research article
- Open Access
Prediction of enzyme function based on 3D templates of evolutionarily important amino acids
BMC Bioinformatics volume 9, Article number: 17 (2008)
Structural genomics projects such as the Protein Structure Initiative (PSI) yield many new structures, but often these have no known molecular functions. One approach to recover this information is to use 3D templates – structure-function motifs that consist of a few functionally critical amino acids and may suggest functional similarity when geometrically matched to other structures. Since experimentally determined functional sites are not common enough to define 3D templates on a large scale, this work tests a computational strategy to select relevant residues for 3D templates.
Based on evolutionary information and heuristics, an Evolutionary Trace Annotation (ETA) pipeline built templates for 98 enzymes, half taken from the PSI, and sought matches in a non-redundant structure database. On average each template matched 2.7 distinct proteins, of which 2.0 share the first three Enzyme Commission digits as the template's enzyme of origin. In many cases (61%) a single most likely function could be predicted as the annotation with the most matches, and in these cases such a plurality vote identified the correct function with 87% accuracy. ETA was also found to be complementary to sequence homology-based annotations. When matches are required to both geometrically match the 3D template and to be sequence homologs found by BLAST or PSI-BLAST, the annotation accuracy is greater than either method alone, especially in the region of lower sequence identity where homology-based annotations are least reliable.
These data suggest that knowledge of evolutionarily important residues improves functional annotation among distant enzyme homologs. Since, unlike other 3D template approaches, the ETA method bypasses the need for experimental knowledge of the catalytic mechanism, it should prove a useful, large scale, and general adjunct to combine with other methods to decipher protein function in the structural proteome.
Structural genomics projects such as the Protein Structure Initiative ("PSI") aim to provide an experimental structure for all proteins [1–3], but as of May 2007 over one third of the nearly 4,400 protein structures deposited into the protein structure databank (PDB)  with the keyword "structural genomics" were either hypothetical proteins or without known function. The annotation of these structures remains an important goal essential to understanding their biological meaning. Ideally, such annotations might be obtained experimentally, through automated generalized screens for some enzymes . However, further efforts are required to develop efficient and large scale assays that cover the most relevant protein functions, and so far just 5% of current annotations are from direct experiments .
Thus 95% of annotations rely on the computational identification of similarity between a protein of unknown function and one of known function. Most frequently this similarity is common ancestry, identified by BLAST  or PSI-BLAST . This is most reliable when sequence identity is above 40% and matched with a profile [9–11], but errors will occur at lower sequence identity [9, 12–16]. Probably some fraction of annotations are misleading [17, 18] and may even propagate to other proteins [19–21]. It is thus imperative to develop and combine new techniques to increase annotation reliability. Meta-servers such as ProFunc  and JAFA  pool annotations from multiple sources. In order to raise the predictive value of these servers it is important to continue to improve each individual method.
These other methods exploit other types of functionally relevant similarities between proteins: one such is general structural similarity (DALI , VAST , SSM , Grath , PDBFun , TOPS , SuMo [30, 31], CM ); another is local sequence similarity of a few residues that are highly specific to function, such as pre-defined sequence motifs [33, 34]. Such motifs can be generalized to structures as 3D templates that represent key functional residues and their geometry. Examples include the geometric matching of 3D templates to proteins of unknown function (Jess [35, 36], Rigor , Pints , ASSAM , GASPS , and several methods used by ProFunc [22, 41]), the comparison of surface patches or clefts (Surfnet , VOIDOO , CASTp , SiteEngine , pvSOAR ), or of structural binding site locations (Surfnet-ConSurf , eF-site , Cavbase , PDBSiteScan [49, 50]). Such 3D templates may identify functional analogs that converged to perform the same function despite sharing no discernable homology . Overall, though, the total number of motifs that are experimentally identified remains small compared to the vast number and functional diversity of proteins .
The goal of this study is to generalize 3D template annotation methods by addressing the limited number of experimentally determined templates. Our hypothesis is that even without prior knowledge of a catalytic mechanism, evolutionary information can suffice to identify functional sites, extract representative 3D templates and search for relevant geometric matches in other structures. To test this possibility, we use the Evolutionary Trace (ET) [53–57]and build an automated Evolutionary Trace Annotation (ETA) pipeline. Benchmarks on 98 enzymes show that the annotation accuracy of ETA is high and remains so at low sequence identity, making it a useful complement to homology annotations.
Results and Discussion
Annotation Pipeline Overview
The ETA functional annotation pipeline integrates the steps in Figure 1. The input, or query X, is a protein structure of unknown function. Step one constructs a 3D template: points in a precise relative geometry that represent the locations and types of amino acids deemed necessary and sufficient for the activity of X. Next, the 3D template is matched in other structures from the PDB, or targets, to identify those with similar local structures – meaning that the 3D template can be superimposed to closely match some part of the target. To further increase functional relevance, a filter only accepts matches that fall on evolutionarily important sites in the target. The function of X is then predicted to be one of the functions among the remaining matches, and specifically to be the one found most often if such a plurality exists.
Each of these tasks is broken down into smaller steps. To build templates, the method first uses ET to rank the residues of a protein structure by their relative evolutionary importance  and to locate a functional site by identifying the largest structural cluster of top-ranked residues. A template picker routine then uses heuristics to select specific residues and choose points to represent them (see below). To search for local structural similarity between a template and a structure in the PDB, the Match Augmentation (MA) algorithm [58, 59] searches for sub-structures with geometric and chemical similarity to the template residues and organizing the search by ET ranks. Next, a geometric filter selects the most statistically significant matches based on the least root-mean-squared-deviation (RMSD) relative to the template, and a support vector machine (SVM) further selects matches based on the evolutionary importance and geometric similarity of the matched residues. The Enzyme Commission annotations (EC numbers)  of these significant matches represent a set of possible functions for the query protein. Since spurious matches should involve random functions, we hypothesize that a function with the most matches – the one with a plurality of matches – is most likely to be accurate.
Template design without prior knowledge of functional sites
In order to design 3D templates we tested several heuristics to choose how many residues to include; which ones to pick; and how to represent them geometrically. In turn, several heuristics for one of these choices were tested in a training set of 53 diverse enzymes while the other two choices were held at reasonable values. For example, to select which residues to pick, the template size was set at six residues and the template representation was set to Cα atoms only. Then, starting from a protein surface cluster of at least 10 top-ranked ET residues, alternative templates were constructed based on heuristics that biased templates towards ET rank, sequence conservation, solvent accessibility, or local topology (see Methods). These templates were then processed in the ETA pipeline and, as shown in Figure 2(a), the ET Rank heuristic, which picks the most evolutionarily important residues, had the best positive predictive value (PPV) of about 80% – in line with other choices – but a 2- to 3-fold improvement in sensitivity over the other heuristics.
To choose the best geometric representation, we considered either one or many points per template residue, centered on atoms or pseudo-atoms. A simple backbone Cα representation was chosen given its 2- to 3-fold higher sensitivity with little decrease in PPV compared to other methods (see Figure 2b). Finally, after testing template sizes between 4 and 8 residues per template we chose 6, because it yields the best combination of PPV and sensitivity (Figure 2c). In summary, reasonable 3D templates appear to consist of the six most evolutionarily important residues from a surface trace cluster represented them by their Cα atoms.
Functional relevance and optimality of templates
The rationale for building templates from clusters of top-ranked ET residues is that the latter usually overlap functional sites . In order to confirm the functional relevance of the automated 3D templates, they were therefore compared with SITE records (functional site residues identified in PDB structure files ) and CSA (Catalytic Site Atlas) records . Consistent with the lack of experimentally identified functional sites, only 10 and 33 of the 53 training set enzymes had SITE and CSA records, respectively. Of these, half (5 and 18 respectively) consisted of only two residues, and only two in each case had six or more residues.
The ET-based templates fully identified the SITE residues once, and partially overlapped them in six other cases, as shown for the Rieske iron-sulfur protein shown in Figure 3(a). In the three remaining cases, the SITE record was not matched yet the templates were still biologically relevant. In casein kinase II (Figure 3(b)), the SITE records describe only one of two metal-binding sites (Zn and Mg), while the template picker identified the other one. In beta-lactamase, there are three ligands, and the ETA template surrounding the two non-metal ligands is not described in the SITE records. In the final example, the template overlaps with records in the CSA . Thus the templates are functionally relevant in all 10 cases, although neither they nor the SITE records are a complete representation of the proteins' functional sites.
Likewise, comparison with CSA shows the ET-based templates typically overlap the known functional sites. Of the 33 proteins with CSA records (89 residues total), 24 (73%) proteins include one of these residues in the template itself, and 26 proteins (79%) found at least one of these residues at the same rank that the template was picked from. Furthermore, all but one of the templates were chosen from the same region as the CSA templates. In the single exception, 1goiA, the template residues were picked from a highly-ranked arm of the protein whereas the CSA annotations form a cluster of less highly-ranked residues in a cleft near the center.
Although ETA templates are functionally relevant, they may not be optimal. To test this possibility we compared them, in the training set, to a random sample of up to 500 unique, six residue, Cα-only templates randomly sampled from surface ET clusters. As shown in Figure 4, the PPV of ETA templates is best in 35 of the 53 proteins, often by a wide margin. In 32 proteins, the surface trace cluster had only 11 residues, so all 462 possible choices were tested. ETA templates had the best PPV in 24 of these 32 cases, and the second best one in 2 more. In 16 cases where ETA templates do not perform well, none of the random templates achieves a large PPV. Overall, ETA templates are close to optimal, suggesting that they typically do capture a small number of top-ranked surface residues that are functionally informative and yield high PPV.
The next step is to identify template matches. A search against the PDB finds on the order of 5,000 matches that fit the template's amino acids and geometry over a wide range of RMSDs, from 0–10Å, and a statistical filter then retains only those with p-values below 1%. Most of these remaining matches are still functionally irrelevant, as seen in Figure 5(a), because a single p-value cannot be biologically relevant in all cases: Some, like kinases or proteases, will have very many functional homologs and analogs while other proteins will have very few.
The evolutionary importance of the matched target residues is an essential criterion to distinguish true from irrelevant matches . The rationale is that biologically relevant matches should fall on evolutionarily important sites while a random match will fall anywhere, regardless of evolutionary importance. Figure 5(b) shows that indeed the ET ranks of target residues separate many false matches. Once an SVM was trained (see Methods) to separate matched targets based on RMSD and evolutionary importance, it considerably narrowed the range of possible annotations as only a handful of matches are left.
The ETA pipeline was tested first in 49 enzymes with known EC numbers picked randomly from the PDB (see Methods). ETA extracted templates from each, matched them in the PDB90 (see Methods), and extracted targets accepted by the SVM. Matches to target proteins with the same first 3 EC number digits as the query protein were deemed correct. On average each template had 3.3 matches, and 2.1 were correct. The range was variable, however: 10 templates had no matches at all, while two templates had 34 hits and 10 hits, respectively. As described in Table 1, 33 of the 39 templates match at least one protein with the correct identical function (85%). Strikingly, 32 templates achieve a plurality of matches to a single EC annotation and 30 of these identify the correct function (94%).
To test ETA in the most stringent and relevant case, these retrospective control experiments were repeated in 49 randomly chosen PSI enzymes with known EC numbers, the PSI test set (Table 2). Again, the templates averaged 3.3 matches, of which 2.1 were correct. Of 38 templates with at least one match, 30 find at least one correct hit (79%). Among the 28 templates that achieve a plurality of hits to one function, that function is correct in 22 cases (79%).
The ultimate goal of ETA is to provide functional annotations for PSI proteins, which are more stringent than most PDB proteins because they are required to have less than 30% sequence identity with any other PDB protein [61–66]. Since these proteins represent a sparser sampling of structures than the PDB set, a concern is that the plurality voting procedure, which relies on multiple matches to the same function, will yield far fewer correct predictions in such cases, and indeed accuracy is reduced from 94% in the PDB set to 79% in the PSI set and availability is reduced from 65% to 57%. To more fully account for the effects of this structural sampling bias present in the target dataset, we removed matches with progressively decreasing levels of sequence identity to other matches by the same template in the PSI set [see Additional file 1, Table S1]. While this does not remove most of the biases inherent in the PDB (towards small, globular, easily-crystallizable proteins, for instance), it at least accounts for proteins that are more highly represented – a problem that is not completely alleviated by use of the PDB90. At 80% or 60% sequence identity, no changes are observed; however at 40% there are 2 fewer correct predictions and 1 fewer incorrect prediction, which provides similar prediction accuracy (80%) and only slightly lower availability (51%). Even at the extremely low level of 15% sequence identity, prediction accuracy only decreases to 73% and availability to 53%, indicating that the accuracy and availability of ETA and the plurality voting procedure remains high even when structural sampling is very low, as it is with most PSI proteins.
Complementarity with homology information
In order to understand the nature of ETA annotations, they were compared with BLAST and PSI-BLAST, and Figure 6 suggests that most ETA matches are homologs. ETA, however, produces fewer false positives so that the specificity of functional annotation is increased by combining methods. In the first test set (Figure 6(a)), BLAST finds 186 true matches and 73 false ones, its positive predictive value, PPVBLAST, is thus 72%. The intersection of BLAST with ETA has fewer true matches (93) but even fewer false ones (29) so the combined PPVETA+BLAST is 76% – a relative increase of 6% over PPVBLAST. Similarly, PPVPSI-BLAST is 68%, whereas PPVETA+PSI-BLAST is 75%, a relative increase of 10%.
The complementarity of ETA and homology methods is even greater in the PSI set (Figure 6(b)). PPVBLAST is 62% whereas PPVETA+BLAST is 82% – a 32% relative increase – and PPVPSI-BLAST is 52%, whereas PPVETA+PSI-BLAST is 77%, a relative increase of 48%. Thus, ETA is complementary to homology-based annotation and substantially increases the predictive value of either BLAST or PSI-BLAST when combined with them.
One possible concern is that the increased in PPV from ETA is not significant because it can be achieved with BLAST alone simply with a more stringent e-value threshold. But, Figure 7 shows that the PPV improvement from ETA persists across a wide range of e-values and when, eventually, PPVBLAST and PPVETA+BLAST do converge, at an e-value of 1e-25, this is at the price of much reduced sensitivity. Otherwise, for higher BLAST e-values, ETA significantly increases in PPV – especially in the PSI set where homologous structures are fewer. For example, at an e-value of 0.05, the combined method shows a 32% relative increase in PPV above that of BLAST alone.
A second and related concern is that ETA matches might mostly arise among proteins with high sequence identity – a trivial result. Even if this were the case, ETA would still be of some use to identify residues likely to be the most functionally important in the target protein and add structural and functional evidence to that provided by sequence; however, Tables 3 and 4 suggest that these concerns are unfounded. When matches with sequence identity above a given threshold are removed, the gains in PPV from adding ETA to BLAST, or PSI-BLAST, persist as shown by Figures 8(a) and 8(b). The PPV advantage of the combined methods is about 50% greater in either the PDB or PSI test sets. For example, in the latter and at less than 20% sequence identity, PPVBLAST+ETA is 72% greater than PPVBLAST, and PPVPSI-BLAST+ETA is 68% greater than PPVPSI-BLAST alone. Thus, combining local structural matches of ETA templates with homology considerably improves functional annotation specificity, and does so most at low sequence identity.
Finally, we asked whether these increases in PPV, measured over all templates and their matches, translate to greater annotation accuracy by plurality voting when ETA is combined with homology methods. Figure 9a shows that in the PDB test set, BLAST+ETA plurality voting is always 100% accurate, even when only considering matches with less than 20% sequence identity (by comparison, the plurality voting accuracy of BLAST at less than 20% sequence identity is 88%). Likewise, plurality voting accuracy in the PSI set, while not 100%, is increased from 11% to 42%, relative to BLAST alone (Figure 9c). Although this increase in specificity is a trade-off with sensitivity Figures 9(b) and 9(d), these data confirm that ETA increases the predictive value of homology-based function annotations, particularly when there are no close homologs.
Comparison with other template annotation methods
To further benchmark these results, we compared ETA to two of the template-based methods of ProFunc, since they also seek to find local geometric similarity between templates and protein structures. ProFunc offers four template-based methods of functional annotation, differing primarily in the source of their templates: ProFunc's Enzyme Active Site ("PEAS"), DNA-binding, ligand-binding, and reverse templates . We first performed the comparison with the individual method used in ProFunc that most closely matches our own, PEAS. This method is both conceptually and methodologically similar to our own, with the major difference being the source of the input used to build the motifs: PEAS uses the available literature on catalytic sites, which is highly desirable for accuracy but due to the current paucity of such literature is much less so for usability, while ETA instead predicts functional residues by the well-known and experimentally-validated ET approach, which we hoped would provide similar levels of accuracy and much greater availability. To test this, we submitted each of the proteins in our PDB and PSI sets to the ProFunc server, whereupon PEAS annotations were taken as either the result of a plurality voting procedure, or as the top-scoring PEAS match.
ETA provides nearly four times as many predictions as PEAS and achieves an overall prediction accuracy that is 10% to 34% greater, as shown in Table 1. If only remote homologs with less than 20% sequence identity are allowed to match, ETA provides three times more true top predictions with the same level of accuracy as PEAS. PEAS builds templates from the available literature on known catalytic sites. This limited it to only 189 templates at the time of this analysis (spring 2007), and highlights the advantage of computing templates from evolutionary and structural considerations rather than relying on sparse experimental data.
Even when PEAS templates are available, ETA performs as well, or better. When PEAS templates predict a most-likely function, they achieve at most 71% accuracy, while in these cases ETA achieves 100% accuracy in the PDB set and only provides an incorrect prediction for a single template in the PSI set, for a minimum accuracy of 83%, or 74% at less than 20% sequence identity. For example in the case of glucose dehydrogenase (PDB 1SPX, chain A, EC 1.1.1), PEAS identifies a single match to a trihydroxynaphthalene reductase (PDB 1YBV, chain A, EC 1.3.1) with 27% sequence identity and a score of 358.094. ETA, however, finds 24 matches to the correct function (and none to a different function), 23 of which have less than 30% sequence identity. In another example, ubiquitin carboxyl-terminal hydrolase (PDB 1VJV, chain A, EC 3.1.2), PEAS identifies a single match to the sulfhydryl proteinase Papain (PDB 9PAP, EC 3.4.22, cysteine endopeptidase) with 17% sequence identity and a low score of 137.805. ETA finds a single match to a ubp-family deubiquitinating enzyme (PDB 1NBF, chain E, EC 3.1.2) with 20% sequence identity, which is the correct function.
Next we compared ETA with ProFunc's reverse-template approach ("PRT"), which like ETA also bypasses the need for experimental knowledge of the catalytic mechanism, although its method of doing so is quite different. Instead of defining a single template based on the available functional evidence, it instead tries several likely possibilities and scores the resulting large set of matches to identify likely functions . Here the methodological differences and especially the level of access provided to this method by the ProFunc web server made such a comparison more difficult. First, only 5 of perhaps 20 significant matches are reported by ProFunc, leaving many of the matches with low sequence identity below the reporting cutoff. Thus, we were not able to perform the comparison with low sequence identity matches as we did for PEAS (the low number of hits by PEAS allows it to avoid this restriction). Second, the larger number of hits also exaggerated concerns about redundancy between matches, so we restricted our consideration to those in the PDB90 (this was not done in PEAS, as only 2 proteins contributed more than one match). Self-matches (matches sharing the same PDB code as the query) were also removed in all three methods.
Similar to PEAS, PRT annotations were taken as either the result of a plurality voting procedure, or as the top-scoring PRT match. Unlike PEAS, however, PRT sometimes found matches to non-enzymes, and these cases were counted as false predictions in the scoring method, although like ETA they did not contribute a vote in the EC plurality voting method. Overall, PRT identified a comparable number of matches to the other individual methods, but strikingly, only 25% of these were to the correct function (PPV = 25%, whereas that of ETA is 2.5-fold higher at 62%). These matches are contributed by all 49 proteins (no other method compared herein found predictions for all proteins), but only 30 proteins contribute a true match. Using the plurality voting procedure, 30 proteins have a vote winner, 28 of which are correct. This high level of accuracy and availability of predictions is only slightly lower than that of ETA. The scoring method increases the availability of predictions, as every protein has a top-scoring match, but this match is correct in only 43% of cases, thus decreasing prediction accuracy to less than half that provided by any other method except PEAS. This suggests that the results provided by PRT are more likely to be true when multiple hits are found to the same function. Even so, only 21 proteins with at least one true match were found out of 49 with matches (43%). The proportion of proteins contributing at least one true match out of the total that contribute matches is quite low in comparison to the other methods in Table 1. For example, even the use of plurality voting on PRT's matches yielded only 30 proteins with one true match out of 49 with matches (61%), whereas ETA finds 33 of 39 with matches (85%) and BLAST finds 39 of 44 (89%).
While the prediction accuracy and availability of PRT and ETA is similar in the PDB set (although the proportion of proteins with at least one true match is much lower), PRT performs better in the PSI set. Overall PRT identified 75 matches, 44 of which are correct (59% PPV, in comparison to ETA's 57%). Here, only 42 proteins contributed matches, but again this is a higher number than any other method, although only 30 provide a correct match. As in the PDB set, this proportion is lower than any of the other methods (PRT, 71%; ETA, 79%; BLAST, 84%). Using plurality voting on these matches, however, yields the highest accuracy of any individual method, with 26 correct votes out of 29 total (90% accuracy, 59% availability), compared to ETA's 22 correct votes out of 28 (79% accuracy, 57% availability). Again though, using the function of the top-scoring hit only provides 64% accuracy, the lowest of any method in Table 2, with 86% availability.
These results indicate that while PRT finds many false matches (as do all of the individual methods), and while the top-scoring hit is only correct about half of the time in the PDB and PSI sets, using plurality voting brings its accuracy to a level comparable with other methods in the PDB set and even exceeding that of the other methods in the PSI set, while maintaining nearly the same availability. ETA, in comparison, has slightly higher voting accuracy and availability in the PDB set, and much higher PPV and proportion of proteins with at least one true match. In the PSI set, ETA has lower voting accuracy, comparable voting availability and PPV, and again a much higher proportion of proteins with at least one true match. These results are remarkable considering that ETA uses but a single template whereas PRT uses many.
ETA's failure to match and annotate convergent proteins  is worth noting. It may have arisen for many reasons. First, examples may be lacking from the dataset. But, an ETA search on a serine protease (query PDB 1SPX, EC 3.4.21) produced 21 hits to other serine proteases, none of which was to a protein with a different fold than the query. Thus the templates are fold-specific. One reason may be that they are too large, as choosing six Cα atoms from a surface trace cluster is less precise than and may not be as general as specific atoms from the classic "catalytic triad" of serine proteases. Or perhaps the ETA templates, which are rigid, cannot overcome tolerated conformational differences. Finally, 3D templates would be unlikely to identify wholesale rearrangements of the catalytic residues or changes in the mechanism itself . In the future, multiple geometric representations of smaller templates may improve sensitivity across folds.
ETA also failed to identify some homologs with identical functions. These arose for one of three reasons. First, the amino acid type allowed to match at each template position was occasionally incomplete because representative sequences were missing from or too infrequent in the alignment. Such infrequent variations may be genuine allowable substitutions, such as the case of the nitrile hydratase (PDB 2AHJ, chain A) and the glutathione s-transferase (PDB 1E6B, chain A); a similar event occurs in the case of the cellulase (PDB 1CEN) where none of the sequences chosen for inclusion in the multiple sequence alignment contained the appropriate substitution, which is found in just one of the BLAST matches.
Second, the SVM does not perfectly separate relevant from random matches. Some matches fall on the wrong side of the separating hyperplane, as happened for a glutathione s-transferase (PDB 1F2E, chain A) – a problem that may be reduced with additional training data or features.
Third, the problem occasionally lies in confused annotation of multi-domain proteins, when ETA incorrectly treats the entire protein as having one function. If it then picks template residues from the domain that is missing annotation, as happened in the case of the topoisomerase (PDB 1EJ9, chain A), an error ensues.
Finally, to further understand false negatives missed by both ETA and BLAST, we compared functional sites as defined by both SITE  or CSA  but found no similarities that would have been recognized by ETA or BLAST. Such remote homologs and analogs may perform the same function via a different mechanism or geometry , which would be very difficult if not impossible for 3D template methods to find.
False positives are also a concern. These arose often due to missing, partial, or wrong EC annotations. For example, two matches to a Rieske iron-sulfur protein template (PDB 1RIE) lack EC annotation in the PDB and a third had an EC number different at the second digit. Yet all three, considered false, in fact have identical Gene Ontology (GO)  biochemical function annotation with the query ("ubiquinol-cytochrome-c reductase activity"). Likewise, two matches to a cAMP-dependent protein kinase template (PDB 1RGS) have no EC annotation but they share the same GO biochemical function annotation ("cAMP-dependent protein kinase regulator activity"). Similarly, a match to a beta-lactamase template (PDB 1K55, chain A) without EC annotation in the PDB also shares GO biochemical annotation ("penicillin-binding, beta-lactamase activity") with the query. Finally, in one instance, a match to a glutathione transferase (PDB 6GSV, chain A) template failed to be recognized as correct because the EC annotation of the match (PDB 1HNL) was not extracted from its non-standard PDB file (released Dec. 22, 1994). These examples taken from the training set suggest that at least 7 of 8 matches classified as false positives are in fact correct.
To address a key limitation of 3D templates to annotate enzyme function – the sparseness of available experimental data to define templates , this study tested the hypothesis that evolutionary information could be used instead. Evolutionary data are often plentiful, and easily analyzed to identify key functional sites and residues with which to search for functional similarities among proteins. Thus, evolution-based 3D template annotation could be attempted in any protein with known structure and sufficiently diverse sequence homologs.
The automated ETA method was implemented to pick six of the most evolutionarily important residues from the surface of a protein, represent them by their Cα atoms, identify their relevant matches in the PDB and to pick the function with a plurality of matches. The most stringent tests, on 49 PSI proteins, show that ETA narrows the list of likely functions to just a few possibilities and correctly identifies the single most likely function in 79% of cases. Although these predictions are currently limited to homologs, they are not trivial since they involve predictions on proteins with low sequence identity. Thus ETA is complementary to homology-based annotation: in the PSI set, combining these approaches raises voting accuracy by 20% relative to BLAST alone. Significantly, this improvement is even greater in the region of low sequence identity – precisely where homology methods are known to be less accurate.
These results prove the hypothesis, extend the range of application of 3D template functional annotation to a majority of enzymes with little or no information on their catalytic activity, and highlight the central role that evolutionary information can play at every step of function prediction: template definition, geometric matching, and filtering matches based on their ET ranks. The results also show that despite the fairly low atomic resolution of 3D templates, limited to Cα-only representation, the evolutionary information provided by ET captures some of the key determinants of catalysis, and leads to a general method to build 3D templates and improves the accuracy of functional annotation.
Future directions should include more refined descriptions of side chain atoms; taking into account experimental information when available; exploring new matching strategies to allow larger-scale application; and integrating functional prediction with alternative methods of annotations. The approach could be extended to non-enzymes, using ET ranks to suggest 3D templates for co-factors, small ligands, or macromolecular interactions, and using GO annotations  for functional predictions. This approach may also have application beyond function annotation, for example fold-specific rather than function-specific residues could be used to annotate SCOP fold classifications [69, 70]. For now, this fully automated functional annotation pipeline (to be available at our web site ) increases the accuracy of enzyme annotations for structural genomics, often narrowing experimental confirmation to one or just a few likely functions for which to assay.
The training set was chosen to be diverse at the levels of sequence, structure, and function. It contains 53 diverse enzymes with less than 25% sequence identity to one another, representing 33 4-digit EC numbers and 13 3-digit EC numbers. The first test set, the PDB set, includes 49 enzymes with known function randomly chosen to be representative of the PDB. The second, the PSI set, was built similarly with structures from the PSI to assess performance in structural genomics proteins. Both originally contained 50 proteins, but one from each was also found in the training set (with the same PDB code) and removed. The remaining proteins in the PDB and PSI sets have no more than 38% and 44% sequence identity to any protein in the training set, respectively. These proteins had available functional annotations in the form of complete 4-digit EC numbers. The PDB code, EC annotation, SCOP class, SCOP fold, and functions of each protein in these three datasets are available in the supplementary tables [see Additional file 1, Tables S2–S4]. Templates were searched against one of two target sets of annotated proteins. For the optimization experiments (Figure 2), matches were searched against 13,600 chains from the 2002 PDB. This set includes only a single chain for proteins with multiple chains due to crystallographic symmetry. Mutants, ionically perturbed structures, and small peptide fragments were manually identified and removed. For all other experiments, templates were searched against the 2004 PDB-SELECT-90, (PDB90) [72, 73], a representative, non-redundant subset of the PDB with less than 90% sequence identity to one another (at the time the most computationally-intensive portion of this work was done, the 2006 version was not yet available). This dataset of 8,600 proteins decreases bias towards overrepresented proteins such as lysozyme, which lead to incorrect results from our statistical and machine learning filters in cases where such proteins represent more than 1% of the entire set of structures in the PDB, and also makes the computationally-intensive template matching step (see below) more practical. In the 2002 PDB and PDB90 sets, 5,200 and 2,800 proteins have full, unambiguous (only one) 4-digit EC annotation while 7,900 and 5,400 have none. Only 500 (<4%) and 400 (<5%) matches have partial or ambiguous (i.e. more than one) EC annotation. These matches were discarded and not counted as either true or false.
3D Template Creation
ET analyses were performed using an automated , real-valued  version of the ET algorithm . The evolutionary importance and the alignment provided for ET will be used to create templates. The Template Picker starts with the best-ranking residues and then consider lower-ranking residues until the largest structural cluster (all residues having at least one non-hydrogen atom within 4 Å of another residue in the cluster) contains at least 10 residues, excluding those with solvent accessibility less than 2 as measured by DSSP  (a cutoff chosen by manual observation).
Next, template residues are chosen from the surface trace cluster according to one of the following heuristics. "ET Rank" picks the most evolutionarily important residues; "No Surface" eliminates the surface constraint; "Start Surface" starts with the most solvent-accessible residue and then picks nearby evolutionarily important ones; "Conservation" favors residues with the least amino acid variation in the alignment; "Compact" starts at the centroid of the cluster and picks nearby residues; "Cleft" starts at the least solvent-accessible residue and then picks nearby residues that are relatively inaccessible to solvent; and "Solvent Accessibility" picks the most solvent accessible residues, regardless of their evolutionary importance. All heuristics break ties by choosing residues closest to the average position of the centroids of the current template residues and the trace cluster.
These residues are represented as a set of geometric points labeled with their evolutionary importance and amino acid types that appear more than once in the corresponding column of the multiple sequence alignment. Single-point methods choose points according to one of the following heuristics. "Cα " and "Cβ " use the Cα or Cβ atoms of the residues; "Average Cα-Cβ " uses a point between the Cα and Cβ atoms; and "Average All" uses the centroid of the amino acid (excluding hydrogen atoms). Similarly, multiple-point methods use the following heuristics: "Cα+Average Sidechain" uses the Cα atom and the centroid of the sidechain; "Cα+Cβ " uses both the Cα atom and the Cβ atom; and "All Atoms" uses a set of points representing each non-hydrogen atom in the amino acid.
To find matches to a template in a set of target structures, we applied Match Augmentation, a geometric pattern matching tool that uses the evolutionary importance of each residue and the amino acid variability information at those positions [58, 59, 76]. MA matches a query template to a target structure in two stages: seed matching first identifies several low RMSD matches to the template's three highest-ranked residues; augmentation then iteratively matches remaining template residues in order of their ET rank. MA then outputs the lowest RMSD match if one is found. This enables MA to search the PDB for matches to a typical template in about 40 minutes on a single processor. ETA then computes the statistical significance (p-value) of a match using a nonparametric density estimate of the distribution of match RMSDs to a target set to obtain a list of significant matches.
Evaluation of Matches
EC annotations  are those reported in the PDB. We define a true functional match as either exact agreement of all 4 digits of the hierarchical EC number (optimization experiments) or those that share the first 3 digits (all other experiments, unless otherwise stated), excluding matches to the same PDB code as the query. Matches to proteins without EC numbers are conservatively classified as false matches in calculating sensitivity and positive predictive value, but ignored completely in plurality voting. PPV and sensitivity measurements are calculated using all matches, while accuracy and availability refer to the single most likely function predicted by a plurality of matches. Negative predictive value and specificity are not reported because they always exceeded 99% due to the ability of the SVM and statistical filters to remove the vast majority of matches to proteins of different functions.
Machine Learning Filtering of Matches
Once MA and the statistical filter identify the matches with significant chemical and geometric similarity, an SVM identifies likely functional matches using a 7-dimensional vector representing the RMSD of the match (one dimension) and the evolutionary importance of each of the target residues (6 dimensions, one for each of the 6 matched residues). The former is obtained from the MA program described above for each match passing through the statistical filter, and the latter is calculated as simply the sorted normalized ET rank of each target residue in the optimization experiments (for the template size experiment, the dimensionality of the vector was adjusted according to the number of residues in the template), and in all other experiments as the sorted absolute value of the difference in ET rank between each of the 6 matching template and target residues, with the latter method providing a modest improvement over the former. SVMs were implemented using the Spider package for MATLAB  using default settings with a balanced ridge parameter (calculated as the difference between the proportions of matches with the same or different functions in the training data) and an RBF kernel with σ = 0.5 (0.5 was found to provide the largest increase in SVM PPV over a linear kernel without decreasing sensitivity amongst a range of possible parameter values: .01, .05, .1, .25, .5, 1, 2, 5). To avoid bias in the optimization experiments, predictions on each training set protein were made by an SVM trained without representatives of its 4-digit EC number (i.e., 33 SVMs were made, each excluding one of the 33 functions in the dataset).
BLAST and PSI-BLAST
BLAST and PSI-BLAST searches were performed against the sequences in the 2004 PDB-90. Matches with an e-value of 0.05 or better were selected. For PSI-BLAST, 2 iterations were performed and sequences with an e-value below the cutoff in either iteration were selected.
Protein Structure Initiative
Evolutionary Trace Annotation
Protein structure DataBank
least Root Mean Squared Deviation
Support Vector Machine
Positive Predictive Value
Catalytic Site Atlas
Profunc's Enzyme Active Site templates
Profunc's Reverse-Template approach
Brenner SE: A tour of structural genomics. Nat Rev Genet 2001, 2(10):801–809.
Burley SK: An overview of structural genomics. Nat Struct Biol 2000, 7 Suppl: 932–934.
Leulliot N, Tresaugues L, Bremang M, Sorel I, Ulryck N, Graille M, Aboulfath I, Poupon A, Liger D, Quevillon-Cheruel S, Janin J, van Tilbeurgh H: High-throughput crystal-optimization strategies in the South Paris Yeast Structural Genomics Project: one size fits all? Acta Crystallogr D Biol Crystallogr 2005, 61(Pt 6):664–670.
Berman HM, Westbrook J, Feng Z, Gilliland G, Bhat TN, Weissig H, Shindyalov IN, Bourne PE: The Protein Data Bank. Nucleic Acids Res 2000, 28(1):235–242.
Kuznetsova E, Proudfoot M, Sanders SA, Reinking J, Savchenko A, Arrowsmith CH, Edwards AM, Yakunin AF: Enzyme genomics: Application of general enzymatic screens to discover new enzymes. FEMS Microbiol Rev 2005, 29(2):263–279.
Valencia A: Automatic annotation of protein function. Curr Opin Struct Biol 2005, 15(3):267–274.
Altschul SF, Gish W, Miller W, Myers EW, Lipman DJ: Basic local alignment search tool. J Mol Biol 1990, 215(3):403–410.
Altschul SF, Madden TL, Schaffer AA, Zhang J, Zhang Z, Miller W, Lipman DJ: Gapped BLAST and PSI-BLAST: a new generation of protein database search programs. Nucleic Acids Res 1997, 25(17):3389–3402.
Todd AE, Orengo CA, Thornton JM: Evolution of function in protein superfamilies, from a structural perspective. J Mol Biol 2001, 307(4):1113–1143.
Watson JD, Laskowski RA, Thornton JM: Predicting protein function from sequence and structural data. Curr Opin Struct Biol 2005, 15(3):275–284.
Whisstock JC, Lesk AM: Prediction of protein function from protein sequence and structure. Q Rev Biophys 2003, 36(3):307–340.
Wilson CA, Kreychman J, Gerstein M: Assessing annotation transfer for genomics: quantifying the relations between protein sequence, structure and function through traditional and probabilistic scores. J Mol Biol 2000, 297(1):233–249.
Devos D, Valencia A: Practical limits of function prediction. Proteins 2000, 41(1):98–107.
Devos D, Valencia A: Intrinsic errors in genome annotation. Trends Genet 2001, 17(8):429–431.
Tian W, Skolnick J: How well is enzyme function conserved as a function of pairwise sequence identity? J Mol Biol 2003, 333(4):863–882.
Skolnick J, Fetrow JS: From genes to protein structure and function: novel applications of computational approaches in the genomic era. Trends Biotechnol 2000, 18(1):34–39.
Sjolander K: Phylogenomic inference of protein molecular function: advances and challenges. Bioinformatics 2004, 20(2):170–179.
Copley SD, Novak WR, Babbitt PC: Divergence of function in the thioredoxin fold suprafamily: evidence for evolution of peroxiredoxins from a thioredoxin-like ancestor. Biochemistry 2004, 43(44):13981–13995.
Brenner SE: Errors in genome annotation. Trends Genet 1999, 15(4):132–133.
Zhang B, Rychlewski L, Pawlowski K, Fetrow JS, Skolnick J, Godzik A: From fold predictions to function predictions: automation of functional site conservation analysis for functional genome predictions. Protein Sci 1999, 8(5):1104–1115.
Galperin MY, Koonin EV: Sources of systematic error in functional annotation of genomes: domain rearrangement, non-orthologous gene displacement and operon disruption. In Silico Biol 1998, 1(1):55–67.
Laskowski RA, Watson JD, Thornton JM: ProFunc: a server for predicting protein function from 3D structure. Nucleic Acids Res 2005, 33(Web Server issue):W89–93.
Friedberg I, Harder T, Godzik A: JAFA: a protein function annotation meta-server. Nucleic Acids Res 2006, 34(Web Server issue):W379–81.
Holm L, Sander C: Protein structure comparison by alignment of distance matrices. J Mol Biol 1993, 233(1):123–138.
Madej T, Gibrat JF, Bryant SH: Threading a database of protein cores. Proteins 1995, 23(3):356–369.
Krissinel E, Henrick K: Secondary-structure matching (SSM), a new tool for fast protein structure alignment in three dimensions. Acta Crystallogr D Biol Crystallogr 2004, 60(Pt 12 Pt 1):2256–2268.
Harrison A, Pearl F, Sillitoe I, Slidel T, Mott R, Thornton J, Orengo C: Recognizing the fold of a protein structure. Bioinformatics 2003, 19(14):1748–1759.
Ausiello G, Zanzoni A, Peluso D, Via A, Helmer-Citterich M: pdbFun: mass selection and fast comparison of annotated PDB residues. Nucleic Acids Res 2005, 33(Web Server issue):W133–7.
Gilbert D, Westhead D, Nagano N, Thornton J: Motif-based searching in TOPS protein topology databases. Bioinformatics 1999, 15(4):317–326.
Jambon M, Imberty A, Deleage G, Geourjon C: A new bioinformatic approach to detect common 3D sites in protein structures. Proteins 2003, 52(2):137–145.
Jambon M, Andrieu O, Combet C, Deleage G, Delfaud F, Geourjon C: The SuMo server: 3D search for protein functional sites. Bioinformatics 2005, 21(20):3929–3930.
Lisewski AM, Lichtarge O: Rapid detection of similarity in protein structure and function through contact metric distances. Nucleic Acids Res 2006, 34(22):e152.
Sigrist CJ, Cerutti L, Hulo N, Gattiker A, Falquet L, Pagni M, Bairoch A, Bucher P: PROSITE: a documented database using patterns and profiles as motif descriptors. Brief Bioinform 2002, 3(3):265–274.
Nevill-Manning CG, Wu TD, Brutlag DL: Highly specific protein sequence motifs for genome analysis. Proc Natl Acad Sci U S A 1998, 95(11):5865–5871.
Wallace AC, Borkakoti N, Thornton JM: TESS: a geometric hashing algorithm for deriving 3D coordinate templates for searching structural databases. Application to enzyme active sites. Protein Sci 1997, 6(11):2308–2323.
Barker JA, Thornton JM: An algorithm for constraint-based structural template matching: application to 3D templates with statistical analysis. Bioinformatics 2003, 19(13):1644–1649.
Kleywegt GJ: Recognition of spatial motifs in protein structures. J Mol Biol 1999, 285(4):1887–1897.
Stark A, Sunyaev S, Russell RB: A model for statistical significance of local similarities in structure. J Mol Biol 2003, 326(5):1307–1316.
Artymiuk PJ, Poirrette AR, Grindley HM, Rice DW, Willett P: A graph-theoretic approach to the identification of three-dimensional patterns of amino acid side-chains in protein structures. J Mol Biol 1994, 243(2):327–344.
Polacco BJ, Babbitt PC: Automated discovery of 3D motifs for protein function annotation. Bioinformatics 2006, 22(6):723–730.
Laskowski RA, Watson JD, Thornton JM: Protein function prediction using local 3D templates. J Mol Biol 2005, 351(3):614–626.
Laskowski RA: SURFNET: a program for visualizing molecular surfaces, cavities, and intermolecular interactions. J Mol Graph 1995, 13(5):323–30, 307–8.
Kleywegt GJ, Jones TA: Detection, delineation, measurement and display of cavities in macromolecular structures. Acta Crystallogr D Biol Crystallogr 1994, 50(Pt 2):178–185.
Shulman-Peleg A, Nussinov R, Wolfson HJ: Recognition of functional sites in protein structures. J Mol Biol 2004, 339(3):607–633.
Binkowski TA, Freeman P, Liang J: pvSOAR: detecting similar surface patterns of pocket and void surfaces of amino acid residues on proteins. Nucleic Acids Res 2004, 32(Web Server issue):W555–8.
Glaser F, Morris RJ, Najmanovich RJ, Laskowski RA, Thornton JM: A method for localizing ligand binding pockets in protein structures. Proteins 2006, 62(2):479–488.
Kinoshita K, Furui J, Nakamura H: Identification of protein functions from a molecular surface database, eF-site. J Struct Funct Genomics 2002, 2(1):9–22.
Schmitt S, Kuhn D, Klebe G: A new method to detect related function among proteins independent of sequence and fold homology. J Mol Biol 2002, 323(2):387–406.
Ivanisenko VA, Pintus SS, Grigorovich DA, Kolchanov NA: PDBSiteScan: a program for searching for active, binding and posttranslational modification sites in the 3D structures of proteins. Nucleic Acids Res 2004, 32(Web Server issue):W549–54.
Ivanisenko VA, Pintus SS, Grigorovich DA, Kolchanov NA: PDBSite: a database of the 3D structure of protein functional sites. Nucleic Acids Res 2005, 33(Database issue):D183–7.
Henschel A, Kim WK, Schroeder M: Equivalent binding sites reveal convergently evolved interaction motifs. Bioinformatics 2006, 22(5):550–555.
Porter CT, Bartlett GJ, Thornton JM: The Catalytic Site Atlas: a resource of catalytic sites and residues identified in enzymes using structural data. Nucleic Acids Res 2004, 32(Database issue):D129–33.
Lichtarge O, Bourne HR, Cohen FE: An evolutionary trace method defines binding surfaces common to protein families. J Mol Biol 1996, 257(2):342–358.
Sowa ME, He W, Slep KC, Kercher MA, Lichtarge O, Wensel TG: Prediction and confirmation of a site critical for effector regulation of RGS domain activity. Nat Struct Biol 2001, 8(3):234–237.
Yao H, Kristensen DM, Mihalek I, Sowa ME, Shaw C, Kimmel M, Kavraki L, Lichtarge O: An accurate, sensitive, and scalable method to identify functional sites in protein structures. J Mol Biol 2003, 326(1):255–261.
Kristensen DM, Chen BY, Fofanov VY, Ward RM, Lisewski AM, Kimmel M, Kavraki LE, Lichtarge O: Recurrent use of evolutionary importance for functional annotation of proteins based on local structural similarity. Protein Sci 2006, 15(6):1530–1536.
Morgan DH, Kristensen DM, Mittelman D, Lichtarge O: ET viewer: an application for predicting and visualizing functional sites in protein structures. Bioinformatics 2006, 22(16):2049–2050.
Chen BY: Hierarchial Pattern Matching for Functional Annotation of Proteins. In Department of Computer Science. Houston, TX , Rice University; 2003.
Chen BY, Fofanov VY, Bryant DH, Dodson BD, Kristensen DM, Lisewski AM, Kimmel M, Lichtarge O, Kavraki LE: Geometric Sieving: Automated Distributed Optimization of 3D Motifs for Protein Function Prediction: Venice, Italy. ; 2006.
NC-IUBMB: Enzyme Nomenclature 1992. San Diego , Academic Press; 1992.
Chance MR, Bresnick AR, Burley SK, Jiang JS, Lima CD, Sali A, Almo SC, Bonanno JB, Buglino JA, Boulton S, Chen H, Eswar N, He G, Huang R, Ilyin V, McMahan L, Pieper U, Ray S, Vidal M, Wang LK: Structural genomics: a pipeline for providing structures for the biologist. Protein Sci 2002, 11(4):723–738.
Todd AE, Marsden RL, Thornton JM, Orengo CA: Progress of structural genomics initiatives: an analysis of solved target structures. J Mol Biol 2005, 348(5):1235–1260.
O'Toole N, Grabowski M, Otwinowski Z, Minor W, Cygler M: The structural genomics experimental pipeline: insights from global target lists. Proteins 2004, 56(2):201–210.
Vitkup D, Melamud E, Moult J, Sander C: Completeness in structural genomics. Nat Struct Biol 2001, 8(6):559–566.
Baker D, Sali A: Protein structure prediction and structural genomics. Science 2001, 294(5540):93–96.
Marti-Renom MA, Stuart AC, Fiser A, Sanchez R, Melo F, Sali A: Comparative protein structure modeling of genes and genomes. Annu Rev Biophys Biomol Struct 2000, 29: 291–325.
Wallace AC, Laskowski RA, Thornton JM: Derivation of 3D coordinate templates for searching structural databases: application to Ser-His-Asp catalytic triads in the serine proteinases and lipases. Protein Sci 1996, 5(6):1001–1013.
Ashburner M, Ball CA, Blake JA, Botstein D, Butler H, Cherry JM, Davis AP, Dolinski K, Dwight SS, Eppig JT, Harris MA, Hill DP, Issel-Tarver L, Kasarskis A, Lewis S, Matese JC, Richardson JE, Ringwald M, Rubin GM, Sherlock G: Gene ontology: tool for the unification of biology. The Gene Ontology Consortium. Nat Genet 2000, 25(1):25–29.
Kolodny R PD Honig B.: Protein structure comparison: implications for the nature of 'fold space', and structure and function prediction. Curr Opin Struct Biol 2006, 16(3):393–398.
Murzin AG, Brenner SE, Hubbard T, Chothia C: SCOP: a structural classification of proteins database for the investigation of sequences and structures. J Mol Biol 1995, 247(4):536–540.
Lichtarge Computational Biology Lab[http://mammoth.bcm.tmc.edu]
Hobohm U, Scharf M, Schneider R, Sander C: Selection of representative protein data sets. Protein Sci 1992, 1(3):409–417.
Hobohm U, Sander C: Enlarged representative set of protein structures. Protein Sci 1994, 3(3):522–524.
Mihalek I, Res I, Lichtarge O: A family of evolution-entropy hybrid methods for ranking protein residues by importance. J Mol Biol 2004, 336(5):1265–1282.
Kabsch W, Sander C: Dictionary of protein secondary structure: pattern recognition of hydrogen-bonded and geometrical features. Biopolymers 1983, 22(12):2577–2637.
Chen BY, Fofanov VY, Kristensen DM, Kimmel M, Lichtarge O, Kavraki LE: Algorithms for structural comparison and statistical analysis of 3D protein motifs. Pac Symp Biocomput 2005, 334–345.
This work was supported in part by NSF DBI-0547695 (OL and LK) and by NIH GM066099, GM079656, and the March of Dimes MOD FY06-371 (OL), and by a Sloan Fellowship and the Brown School of Engineering at Rice University (LK). This work was also supported by training fellowships from the Keck Center for Interdisciplinary Bioscience Training from the W.M. Keck Foundation (AML) and NLM Grant No. 5T15LM07093 (RMW, DMK, BYC), from the NIH institutional postdoctoral fellowship program in medical genetics NIH 5 T32 GM07526-29 (SE), and from the VIGRE Training in Bioinformatics Grant NSF DMS 0240058 (VYF).
The code was primarily developed as follows: template heuristics and overall automation (DMK), geometric matching (BYC, LEK), geometric statistics (VYF, MK), support vector machine (RMW). The data sets were collected and analyzed by DMK, RMW, AML, and SE. The strategy and research design were led by DMK and OL with contributions from RMW and all authors. The manuscript was jointly written by DMK, RMW, and OL, with inputs from SE and all of the other authors.
David M Kristensen, R Matthew Ward contributed equally to this work.
Electronic supplementary material
Additional file 1: Supplementary material (Supplementary Tables S1–4) is provided as an HTML-formatted webpage. Supplementary Table S1: PSI Set voting as sequence identity threshold of matched target pairs decreases. Supplementary Table S2: Training Set. Supplementary Table S3: PDB Set. Supplementary Table S4: PSI Set. (HTM 310 KB)
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Kristensen, D.M., Ward, R.M., Lisewski, A.M. et al. Prediction of enzyme function based on 3D templates of evolutionarily important amino acids. BMC Bioinformatics 9, 17 (2008). https://doi.org/10.1186/1471-2105-9-17
- Support Vector Machine
- Positive Predictive Value
- Functional Site
- True Match
- Plurality Vote