- Research article
- Open Access
A stochastic context free grammar based framework for analysis of protein sequences
© Dyrka and Nebel; licensee BioMed Central Ltd. 2009
- Received: 17 December 2008
- Accepted: 8 October 2009
- Published: 8 October 2009
In the last decade, there have been many applications of formal language theory in bioinformatics such as RNA structure prediction and detection of patterns in DNA. However, in the field of proteomics, the size of the protein alphabet and the complexity of relationship between amino acids have mainly limited the application of formal language theory to the production of grammars whose expressive power is not higher than stochastic regular grammars. However, these grammars, like other state of the art methods, cannot cover any higher-order dependencies such as nested and crossing relationships that are common in proteins. In order to overcome some of these limitations, we propose a Stochastic Context Free Grammar based framework for the analysis of protein sequences where grammars are induced using a genetic algorithm.
This framework was implemented in a system aiming at the production of binding site descriptors. These descriptors not only allow detection of protein regions that are involved in these sites, but also provide insight in their structure. Grammars were induced using quantitative properties of amino acids to deal with the size of the protein alphabet. Moreover, we imposed some structural constraints on grammars to reduce the extent of the rule search space. Finally, grammars based on different properties were combined to convey as much information as possible. Evaluation was performed on sites of various sizes and complexity described either by PROSITE patterns, domain profiles or a set of patterns. Results show the produced binding site descriptors are human-readable and, hence, highlight biologically meaningful features. Moreover, they achieve good accuracy in both annotation and detection. In addition, findings suggest that, unlike current state-of-the-art methods, our system may be particularly suited to deal with patterns shared by non-homologous proteins.
A new Stochastic Context Free Grammar based framework has been introduced allowing the production of binding site descriptors for analysis of protein sequences. Experiments have shown that not only is this new approach valid, but produces human-readable descriptors for binding sites which have been beyond the capability of current machine learning techniques.
- Parse Tree
- Context Free Grammar
- Grammar Rule
- Amino Acid Property
- Terminal Symbol
From the very beginning of modern biology, which can be traced to the 1950s when the structure of the DNA was unveiled, linguistic metaphors were readily used to describe the molecular world. Linguistics itself experienced a revolution led by Noam Chomsky in the second half of 20th century . In the 1980s his work regarding mathematical theory of language was adopted in the field of molecular biology by several researchers [2–4]. Many similarities between natural languages and the language of nature have been revealed. For instance, any functional polypeptide can be regarded as syntactically proper. However, similarly to natural languages, where a correct grammatical structure does not imply that a sentence is meaningful, not all amino acid chains fold into proteins with physiological functions.
According to the linguistic level of the analysis, computational tools utilised in biochemistry can be divided into those operating at the lexical, structural, semantic and pragmatic levels . The first level is occupied by algorithms providing statistical analysis . Structural or syntax features are examined by software which parse sequences [7, 8]. The embedded ambiguity of structures, as well as flexibility and versatility are among the advantages of this approach. Recently, an increasing amount of linguistic methods with a probabilistic component has been investigated at the structural level, i.e. Hidden Markov Models  and stochastic Context-Free Grammars . At the semantic level a representation of meaning is assigned to the structure  and at the pragmatic level some context of the sequence (e.g. relationships between proteins) is taken into account.
In the field of protein sequence analysis, the size of the alphabet and the complexity of relationships between amino acids have mainly limited the application of formal language theory to the production of grammars whose expressive power is not higher than stochastic regular grammars. The first rules were designed to define short functional patterns consisting of adjacent and well conserved amino acids. They are expressed by non-probabilistic regular grammars, e.g. PROSITE patterns  and PRINTS [13, 14]. Although their expressive power is fairly limited, they have proved extremely useful in protein annotation and detection of important protein regions (e.g. active sites) by highlighting short sub-sequences associated to biochemical functions. Approaches based on Hidden Markov Models (HMMs) are regarded as the state of the art methods in the field of protein sequence annotation. Specifically, Profile HMMs, which were introduced by Krogh et al. , are widely used and proved their efficiency for representing motifs, calculating multiple alignments, and profile analysis . However, an important drawback of HMM profiles is that they are not human-readable and, therefore, these descriptors cannot provide any biological insight by themselves. In addition, since the expressive power of an HMM is similar to a stochastic regular grammar [16–18], they have limitations regarding the types of patterns they are able to encode. For example, they cannot cover any higher-order dependencies such as nested and crossing relationships that are common in proteins, e.g. anti-parallel β-sheets and parallel β-sheets respectively . Similarly, bonds in binding sites often exceed the capability of regular grammars and HMMs .
Attempts to produce systems with an increased expressive power have been limited [7, 10, 21] and, according to our knowledge, the only practical tool dedicated to protein analysis was built using stochastic tree grammars to predict both anti-parallel and parallel β-sheets [36, 63]. These weakly context-sensitive grammars could not only predict which amino acids were involved in sheets, but also the locations of the hydrogen bonds. However, the structure of the grammar had to be provided; their algorithm learned the probability parameters.
CFG have already been applied successfully in the fields of bioinformatics, particularly for RNA structure prediction [5, 10, 22–24] and compression . A CFG is particularly adapted to this task because it can express, unlike regular grammar, the nested dependencies due to the Watson-Crick pairing which is key to RNA structure. Due to a larger set of terminals (20 amino acids) and less straightforward relations between residues (there is no equivalence to the Watson-Crick pairing), utilisation of Context-Free Grammars to analyse proteins has not been, so far, comparably successful.
Since the design of an unbiased negative sample is particularly difficult in protein sequence analysis, the fact that CFGs cannot be inferred from positive data only is a serious drawback . An alternative is to develop an approach based on stochastic grammars which, in principle, do not require a negative set for their inference [17, 27].
In this paper, a Stochastic Context Free Grammar based framework for the analysis of protein sequences is presented and applied to the interpretation and detection of amino acids involved in binding sites. We start by demonstrating the value of our framework by showing the biological insight which is provided by the produced grammars. Then, we assess its performance in sequence annotation and binding site detection and evaluate them against profile HMMs. In the Methods section, we present the general principles which are behind our framework and the key strategies it relies on. Formal definition of Stochastic Context Free Grammars, implementation aspects and detailed description of datasets are provided in the Appendix.
Description of datasets
Binding site patterns used for evaluation
PROSITE pattern for the anion exchanger family (PDOC00192)
PROSITE pattern for the aldo-keto reductase family (PDOC00061). Family binds Nicotinamide-Adenine-Dinucleotide Phosphate (NAP).
Pattern created by extension of PROSITE pattern which is a legume lectin beta-chain signature (PDOC00278). Family binds calcium and manganese located in the C-terminal section of the beta-chain.
Pattern created by selecting the fragment which interacts with sulphate ions (SO4) from the PROSITE profile for Rhodanese domain (PS50206) which is present in M-phase inducer (MPI) phosphatase family.
Zinc finger meta-pattern created using 7 different PROSITE zinc finger patterns: PS00028, PS00518, PS00752, PS01030, PS01102, PS13000 and PS01358.
A complete description of these datasets is provided in Appendix E.
Analysis of grammar structures
The rational for utilising Stochastic Context Free Grammars to produce ligand binding site descriptors is that not only they have the power to express branched and nested like dependencies, but also their rules can be analysed to acquire biological knowledge about binding sites of interest. In this section, we illustrate how analysis of sequence based SCFGs allows gaining an insight into the spatial configuration of binding sites. We propose two ways of analysing probabilistic grammars to extract biologically meaningful features focusing on either parse trees or grammar rules.
The grammar generated for this pattern based on accessibility is composed of the following rules associated with their normalized probability. p, z and n express respectively high, average and low accessibility.
A → BC rules:
S → TS (0.49) | Vp (0.51)
T → XU (1.00)
U → nz (0.49) | zz (0.51)
V → pn (0.53) | pz (0.47)
W → zp (0.15) | TU (0.85)
X → VW (1.00)
A → a rules:
A/L R/K N/M D/F C/P Q/S E/T G/W H/Y I/V
n: 0.01 0.10 0.11 0.11 0.00 0.10 0.14 0.04 0.00 0.00
0.00 0.18 0.00 0.00 0.05 0.10 0.07 0.00 0.00 0.00
z: 0.11 0.05 0.05 0.04 0.01 0.05 0.02 0.09 0.10 0.03
0.03 0.00 0.05 0.00 0.08 0.05 0.07 0.03 0.09 0.05
p: 0.00 0.00 0.00 0.00 0.15 0.00 0.00 0.00 0.03 0.14
0.13 0.00 0.11 0.18 0.00 0.00 0.00 0.13 0.03 0.11
Whereas the accessibility based grammar describes in particular the beta sheet which is present in the pattern, the magnesium propensity based grammar deals with magnesium binding. Rules of the 'A → BC' type for this grammar are the following:
S → Vn (0.43) | Vz (0.57)
T → zU (1.00)
U → Xn (0.26) | Tz (0.52) | TW (0.22)
V → nS (0.28) | XW (0.30) | VU (0.42)
W → np (0.67) | zp (0.31) | XW (0.02)
X → zW (1.00)
where p, z and n express respectively high, average and low magnesium binding propensity.
Finally, the calcium propensity based grammar defines not only the calcium binding part of the pattern, but more generally the pattern's structure. 'A → BC' type grammar rules are the following:
S → TW (0.50) | XS (0.50)
T → TW (0.42) | XW (0.58)
U → zp (1.00)
V → VU (0.06) | zz (0.94)
W → VW (0.46) | Vz (0.21) | pn (0.32)
X → VU (0.64) | XU (0.36)
where p, z and n express respectively high, average and low calcium binding propensity.
Rules of the 'A → BC' type for the NAP propensity grammar for this pattern are the following:
S → zU (0.81) | Sz (0.19)
T → pV (0.72) | Tz (0.28)
U → zT (0.72) | Uz (0.28)
V → pU (0.24) | Vz (0.23) | Sp (0.19) |
V → zp (0.23) | np (0.11)
where p, z and n express respectively high, average and low NAP propensity.
Cycle A defines a NAP binding fragment consisting of two consecutive amino acids of high NAP propensity. This corresponds to the well conserved LYS270 and SER271 of 1MRQ, which are seen in orange in Figure 6.
Since the termination of any derivation of this grammar imposes either V→np or V→zp rules and another T→pV production (the only non recursive T rule) is required to end the cycle B, the shortest parse tree terminating cycle B (see above) would display the following pattern 'p zzp ypp', where y represents either z or n. Residues of high NAP propensity show a 'i → i+3' periodicity which could suggest the presence of a NAP binding site involving an alpha helix. The derivation tree of 1MRQ shows that compared to the shortest predicted parse tree, the recursive rule T→Tz is used to extend the original pattern to 'p zzp zpz p' (i→i+3/i+4) which corresponds to the substring 'N EQR IRQN'. Analysis of the PDB model confirms this pattern defines a helix. Moreover, ASN273, ARG276 and ASN280, which are seen in blue in Figure 6, are indeed very close to the ligand and provide an NAP binding environment. Ligplot data  show that ARG276, and ASN280 are actually involved in the bound state of the molecule.
Using the parse tree of the SO4 propensity based grammar (Figure 8b), some insight can be provided regarding SO4 binding. Contrarily to the hydrophilic side of the site which is composed of residues showing low SO4 propensity, the hydrophobic side appears as a good candidate for SO4 binding. More specific information can be obtained through the analysis of the SO4 propensity based grammar whose rules of type 'A → BC' are as follows:
S → TW (1.00)
T → XW (0.51) | nU (0.25) | nz (0.25)
U → Xz (0.39) | Xn (0.34) | Xp (0.27)
V → np (0.57) | zp (0.36) | nz (0.07)
W → Vz (0.94) | Vp (0.06)
X → zS (0.54) | nS (0.46)
where p, z and n express respectively high, average and low SO4 binding propensity.
where the most likely derivation of W is: W → Vz and V → n|z p
From cycle A, the following pattern is revealed: 'ySyp zyp z', where y represents either z or n. Since S can be substituted by the pattern itself, after a substitution the patterns become 'yySyp zyp zyp zyp z'. This shows a 'i→i+3' periodicity of SO4-friendly residues which is consistent with the presence of an alpha-helix. In addition, the derivation of the less likely cycle B produces the following pattern: 'nySxyp z' where x represents any SO4 propensity. Then, if S is substituted by the pattern coded in cycle A, the new pattern models a 'i→i+3/i+4' periodicity, 'nyySyp zyp zxyp z', which is also typical for helices.
This result combined with the low SO4 propensity of the hydrophobic side of the binding site suggests that SO4 binding would involve the arginine-rich ridge of a helix. This is confirmed by Ligplot which shows that ARG488 and ARG492 are involved in SO4 binding.
This analysis of grammars describing ligand binding sites has shown that probabilistic context-free grammars allow the production of binding site descriptors which are human-readable and, hence, provide some insight into biologically meaningful features. Moreover, each of these grammars relies on high probability rules which could not be expressed with regular grammars. Therefore, this confirms that the description of many ligand binding sites benefits from the expressive power of context free grammars.
Stochastic Context-Free Grammars for sequence annotation and binding site detection
In order to demonstrate that, not only SCFG based descriptors are meaningful, but are powerful at both annotating sequences and detecting binding sites, we first evaluate them on sites which can be expressed quite successfully by a PROSITE pattern. In this section, all results are produced using grammars containing a full set of rules.
TP and TN rates for sequence annotation by grammars obtained for PS00219 pattern
Van der Waals volume
Beta sheet propensity
Charge + volume
Since each SCFG deals with one amino acid property at a time, scores obtained by several grammars need to be combined to obtain optimal results (see Methods for details). Table 2 shows TP and TN rates for grammars based on different properties, their combinations and their comparison with scores obtained by PROSITE patterns. This short pattern - only 12 residues - is the anion exchanger pattern (PS00219). The table reveals that charge and van der Waals volume are important features for the expression of this binding site. Moreover, SCFGs allows detecting relevant sequences missed by the PROSITE pattern.
Sequence annotation by grammars obtained for PS00307 pattern
Rc|Pr = 1.0
Sequence annotation by combined grammars obtained for PS00063 pattern
Rc|Pr = 1.0
Binding site detection by grammars obtained for PS00307 pattern.
Detection (50% coverage)
As an outcome of this evaluation, performance of detection appears to be good. In the most difficult task, where the highest peak was demanded to be exactly at the position of the pattern, success rate was 75%. When 50% coverage, i.e. 10 residues displacement for PS00307, was allowed, success rate rose to 100%. Similar outcomes were obtained for the other patterns where detection results were in line with annotation results.
To conclude, our system managed to achieve good accuracy in both annotation and detection. The results confirmed suitability of our approach in integrating amino acid properties in our grammars and combining obtained grammars. It shows that these strategies together with appropriate choice of the properties relevant to the pattern provide satisfactory solutions to the requirement of alphabet size reduction.
The remaining part of this paper will only show annotation results since it makes comparisons with profile HMM performances easier.
Constrained grammar evaluation
Performance comparison of standard and NestedNT SCFGs
Max. F1 (Rc|Pr = 1.0)
NestedNT SCFGs performed consistently better than standard SCFGs, especially concerning Recall for 100%Precision. These results suggest that increasing the number of non-terminals allows improving performance by increasing expressive capabilities. Analysis of parse trees shows that more than 6 independent NTs would be required to cover all important structural features. Moreover, examination of grammar structures produced with different parameters confirmed that constrained grammars were more consistent in their structure than standard SCFGs.
Performance comparison of SCFGs with profile HMMs
Since we have already demonstrated that unlike HMM profiles, rules of SCFG are human readable and can be used to gain some biological insight about binding sites, in this section comparison between the two techniques is limited to annotation results.
Performance comparison of PROSITE patterns, Profile HMMs and SCFGs
Rc| Pr = 1.0
No PROSITE pattern
Out of scope
These curves show that although our stochastic grammars are based here on a single feature - zinc propensity - they perform slightly better than Profile HMMs. Although none of the other tested properties allowed improving SCFGs results, we believe there is still some space for improvement if suitable properties could be combined to zinc propensity.
Study of false negatives produced by these two methods at their maximum performance level in the term of F1, shows 13 sequences were rejected by SCFG while 17 by Profile HMM. Since only 4 sequences belonged to both groups, this seems to confirm both schemes have very different definitions of this binding site which might be regarded as complementary.
This study demonstrates the capability of the framework we propose to take advantage of the expressive power of Stochastic Context Free Grammar for analysis of protein sequences. First, we have shown with a few examples that the analysis of sequence based SCFG rules allows gaining an insight into the 3D structure of binding sites. This is a unique feature of our approach compared to, for example, HMM based methods which only produce 'black box' descriptors. Our analysis of grammar structures has revealed that the ability of expressing branched and nested dependencies is essential to describe some binding sites which can be seen as displaying such relationships through the intermediate of a ligand. This confirms the theoretical potential of our method in describing sites which are out of the scope of HMM profiles. It is important to be aware that many sites, such as parallel β-sheets, display dependencies which are beyond the expressiveness of SCFGs and, therefore, are not suitable candidates for our approach.
Secondly, we have demonstrated that our SCFG based system can be practical and accurate to annotate proteins and detect binding site patterns. This confirms that the various strategies developed to deal with the challenge of using SCFGs for proteins sequences were appropriate. Our approach of integrating quantitative properties of amino acids into the SCFG framework has shown to be an efficient method to reduce the size of grammars. Moreover, properties based on ligand propensity were especially useful. In addition, combining grammars typically yielded in better scores than those obtained by any single property grammar. Furthermore, experimentations, where grammar structures are constrained, suggest that restricting the grammar induction search space using heuristics is an approach which merits further investigation. Results show that our approach usually does not perform as well as Profile HMMs in annotation task when dealing with binding sites which can be well expressed with rigid regular grammars. This can be explained by the fact our scheme relies on a reduced amount of information, i.e. amino acid properties instead of amino acid identities,
The main benefit of the system we propose is that - when considering only rules with significant probabilities - both structure and rule probabilities of context-free grammars are learned automatically without introducing constraints specific to the targeted sites. Such grammars of relatively simple structure are human-readable; hence they could become valuable sources of information for molecular biologists. Another advantage of our framework is that, unlike other methods, it does not rely on sequence alignments. Therefore, as encouraging results with zinc finger meta-pattern suggest, our system may be particularly suited to deal with patterns shared by non-homologous proteins.
We have presented a novel Stochastic Context-Free Grammars based framework relying on quantitative representation of amino acid properties. The SCFG based system for protein sequence analysis was tested on several data samples in various configurations. First, we have shown the produced binding site descriptors are human-readable and their analysis can provide biological insight into the structures of their associated binding sites. To our knowledge, no other type of binding site descriptors can reveal subtle interactions as described by SCFGs. Secondly, by achieving high Precision and Recall in annotation and very good detection rates our system proved to be a practical tool for protein pattern recognition. Moreover, results for the zinc finger meta-pattern which outperformed Profile HMMs suggest that meta-patterns are one of the fields where application of SCFGs can be especially useful. In addition, since both approaches produced different false negative, SCFGs can be seen as complementary to existing Profile HMM based methods. This suggests our SCFG framework could be used to improve those methods. This study also supports the idea that binding site regions which could be seen as involving indirect nested dependencies between residues are prime targets for our framework.
An increase of the number of non-terminal symbols allows representing a larger variety of relations within a binding site. Additional constraints to grammars enable the use of more symbols and facilitate the learning process. Indeed, our experiment showed that, generally, constrained grammars produced better results. For future work, we intend to further our research into constrained grammars by inferring optimal grammar structure. We will also implement secondary structure based grammars to take advantage of this higher level property. Furthermore, our procedure of grammar combination will be refined by customising each grammar's weight to reflect the entropy of underlying properties in the training samples and single grammar performance. Finally, we plan to develop a web tool allowing interactive analysis of binding sites encoded by SCFG based descriptors.
We present a grammar based system for analysis of protein sequences. The complexity of amino acid interactions led us to adopt a Context Free Grammar framework. Moreover, the difficulty of producing negative samples guided our selection towards a stochastic scheme (a formal definition of stochastic context-free grammars is provided in Appendix A). Since in the context of protein sequences the structure of the grammar is originally unknown, it needs to be induced. In this work a genetic algorithm is used for this purpose (see Appendix C for details). The general principle behind our framework is to start the learning process from a set containing all possible rules and infer their probabilities. Although this approach leads to quite large sets of rules even for moderate alphabets, it avoids bias which can be introduced by additional constraints. Moreover, an inherent property of proper stochastic grammar is that the distribution of probabilities onto a small number of rules, which express well the pattern of interest, gives better scores than even distribution onto all possible rules. Consequently, a natural trend during grammar evolution is the reduction of probabilities of rules that are unnecessary. Therefore, after grammar induction, the final set of rules can be pruned to omit rules which will have only a limited impact on the overall score of a scanned sequence.
In principle, the number of context-free rules for a given number of non-terminal symbols can be infinite. However, by transforming a CFG into a Chomsky Normal Form (CNF, see Appendix A for details), the number of rules is bound by the cube of the number of non-terminals. Therefore, this formulation will be used in our framework. Another advantage of CNF is that it can be parsed by the efficient polynomial probabilistic CKY parser (see Appendix B).
where each amino acid (ai) is associated with each of these non-terminals with a probability (Pr).
Since all terminal rules are fixed with given probabilities, only the probabilities of the subset of rules in the form of A → BC are subject to evolution. However, relations expressed by these rules only refer to the 3 property levels instead of the 20 amino acid types. Moreover, to avoid trivial solutions, non-terminals which are Left-Hand Side (LHS) symbols in the terminal rules are prohibited from being LHS non-terminal symbols of these other rules. The LHS non-terminals of A → BC are later called 'independent non-terminals' or iNT.
Choice of amino acid properties
Our method relies on the selection of amino acid properties in order to deal with the size of the protein alphabet by defining specific terminal rules based on their quantitative values. These values are collected from the AAindex database which provides quantitative estimates of the 20 amino acids for over 500 properties [43–45]. They are clustered into 6 categories which can be broadly labelled as beta propensity, alpha and turn propensities, composition, physiochemical properties, hydrophobicity and others. Representatives of the well defined properties, i.e. the 5 first ones, are selected by choosing properties which are the closest to the centres of the property clusters defined in the AAindex database. They are defined using their AAindex property codes as:
Average relative frequency of beta-sheet, KANM800102 ,
Information measure for middle helix, ROBB760103 ,
Relative frequency of occurrence JOND920101 ,
Normalized van der Waals volume, FAUJ880103 ,
Information value for accessibility with average fraction of 35% (called later "accessibility"), BIOV880101 .
In addition to these properties, we also used the net charge of amino acids. Values are obtained by combining net, positive and negative charge indices from KLEP840101 , FAUJ880111 and FAUJ880112  respectively. Moreover, since we target protein binding sites, ligand binding propensities of amino acids can also be very informative. Those propensities are calculated by standardising the ligand binding statistics provided by the Molecular Structure Database of EMBL-EBI .
Although in principle, grammars could be generated for all of those properties, computational constraints make it impractical. Therefore, an appropriate set of properties is chosen using expert knowledge for each binding site of interest.
An alternative to inferring a grammar with a complete set of rules is to produce a grammar where constraints are introduced in the design of an initial rule set. This brings a couple of advantages. First, for a given number of rules the number of non-terminals (NT) can be increased. Secondly, it allows imposing a bias in the grammars so that they use context-free features (i.e. nesting and branching) instead of regular features which may lead to local minima in the rule inference search space. The rationale behind this concept is that it requires at least two rules in Chomsky Normal Form that collaborate with each other to represent nested dependencies. As evolution of probabilities of rules with different LHS non-terminals is independent, the bias towards nested solutions may need to be enforced in the grammar structure. To achieve this, we propose to constrain rules of the type A → BC.
To describe these constraints, we shall recall the following definitions:
Non-terminal symbol which represents explicitly an amino acid property is called 'property NT' or pNT.
Non-terminal not representing explicitly an amino acid property is called 'independent NT' or iNT.
Therefore, for 7 NTs including 3 pNT this results in a total of 196 rules.
The generalised nested relations are produced by the first and second rules which impose switching in the course of derivation between oiNT and eiNT. Additionally, the third rule creates a branch if the NT of the free form is iNT.
This scheme produces only 76 rules for 7 NT. Hence, for NestedNT the number of NTs can be increased from 7 to 9 while keeping the number of rules manageable (i.e. 162 rules, more details in Appendix D).
Evaluation and datasets
The large size of the amino acid alphabet, the non-trivial character of dependencies between residues and the high computational complexity of Context-Free Grammars make the task of learning efficient SCFGs for protein pattern detection very challenging. In order to assess the performance of our framework, grammars evolved under our scheme were first utilised to gain insight into binding site biological features. Then, they were evaluated in their ability to detect the precise positions of a binding site within a sequence and to annotate protein sequences. Finally, results were compared to those obtained from Profile HMMs. These profiles were built using the latest version (v 2.3.2 at the time of writing) of the standard HMMER package  where standard parameters were applied and same positive training data sets as SCFGs were used for training.
Since F1 is more conservative measure than arithmetic or geometric average, it allows finding the optimal threshold to distinguish between presence and absence. Typically, the highest score generated by a properly induced grammar occurs in the position of the binding site. However, precise site detection is not a requirement for correct annotation.
Binding site patterns used to evaluate our framework are based on PROSITE entries, since PROSITE is the database containing the most comprehensive library of protein patterns; many of them describe binding sites . While PROSITE contain both regular expression based patterns and domain profiles, in this document when we mention PROSITE patterns we refer to the former. Since PROSITE patterns are regular expressions, there is some bias towards representing binding sites with strong regular features. However, some PROSITE patterns are associated with relatively high false positive and false negative rates and therefore are suitable for testing our scheme. Moreover, many PROSITE patterns can be associated to a single binding site environment, e.g. 11 patterns are linked to zinc fingers. Since our framework does not rely on the alignment of protein sequences, which implies some homology, it makes it possible to combine patterns functionally similar but associated with different protein families. Those meta-patterns can be particularly powerful in detecting binding sites in sequences without homologues.
Three PROSITE binding site patterns of various sizes and complexity were selected to show that our general approach is valid. Then, using a PROSITE domain profile, we analysed a subset of the proteins it describes to compare our method with a HMM profile. Finally, a zinc finger meta-pattern that we created using 7 zinc finger PROSITE patterns is processed to demonstrate the performance of our framework on binding sites which belong to different protein families. For each pattern of interest, positive and tests sets were based on the associated PROSITE dataset - no negative training set is required in the learning process. Ideally the negative test set should have been defined as a representative set of all protein sequences available in UniProt  which does not contain the pattern of study. Due to computational constraints a smaller set had to be defined. Therefore, the Protein Data Bank (PDB)  instead of UniProt was chosen as the database of reference.
A. Formal definition of stochastic context-free grammars
where upper case letters refer to non-terminals and lower case letters refer to terminal symbols. Although the representation of grammars in Chomsky Normal Form is not the most compact one, context-free grammars in the CNF have a simple and well-defined form of rules. Therefore, this formalism is commonly used in computational linguistics and many efficient algorithms have been specially designed for it.
Usually, probabilities of all productions for one Left-Hand Side (LHS) symbol sum to one; the SCFG is then called proper.
B. Standardised parsing method for stochastic context-free grammars
The Cocke-Kasami-Younger (CKY) algorithm (designed in the 1960s) is one of the most common parsing methods for CFGs. It has a simple structure and is efficient: its computational complexity is polynomial O(n3) regarding string length. This is a bottom-up parser, i.e. the derivation tree is built starting from terminal symbols. It requires a context-free grammar in the Chomsky Normal Form, so that the string which is analysed gets shorter at every iteration step. In this work, we implemented a modified version of the CKY algorithm, called Stochastic CKY or SCKY , so that Stochastic Context Free Grammars can be parsed. The outcome of this procedure is the probability that a given sequence was generated by a certain grammar G (i.e. the sequence belongs to the language L(G)) instead of a Boolean value as in the case of non-probabilistic CKY. This probability is defined as a product of probabilities of all grammar rules involved in the construction of the corresponding parse tree. More formally, it can be described as follows :
Given an input sequence W of N terminal symbols: W = a1, a2, ..., aN. Grammar G consists of R non-terminal symbols: α1, α2, ..., αR and a set P of LT terminal (p1: αr → ai, Pr(pl)) and LNT non-terminal (pm: αr → αs αt, Pr(pm)) rules. A table T of dimensionality N × N × R is constructed and initially filled with zeros. Then the following algorithm is applied:
For each element a i of the input sequence W (i.e. for i = 1 to N)
for each terminal rule in the P set (i.e. l = 1 to L T )
if there is a production rule p l : α r → ai,
the value of T at position [i, 1, α r ] is increased by Pr(p l )
Then, for i = 2 to N
and for j = 1 to N-i+1
and for k = 1 to i-1
for each non-terminal rule in the P set (i.e.m = 1 to L NT )
if there is a production rule p m : α r → α s α t in G,
the value of T at position [i, j, α r ] is increased:
T [i, j, α r ] + = T [j, k, α s ] × T [j + k, i-k, α t ] × Pr(p m )
(or the subsequence of the input sequence W between positions i and i+j-1) was derived from the non-terminal symbol αr of the grammar G. Therefore, after all steps, the value of T [1, N, 1] is the probability that the input sequence W belongs to the language L(G). This version of the algorithm, where a probability for a certain node is calculated as a sum of probabilities of all sub trees is called the Baum-Welch style SCKY algorithm .
one obtains a Viterbi style SCKY algorithm . In this case the value of T [i, j, αr] is the probability that a sequence of terminal symbols ai, ai+1, ..., ai+j-1 (or the subsequence of the input sequence W between positions i and i+j-1) was derived from the non-terminal symbol αr of the grammar G in the Viterbi or most likely parse. T [1, N, 1] is therefore the probability that the input sequence W was generated by the grammar G in the Viterbi parse.
where a is the coefficient of linear regression if the logarithm of the score is used instead of its raw value.
Standard deviation is shown. Marked area denotes parse tree spans which cover at least one whole pattern instance from the learning set (pattern based on PS00307, see Datasets section for details).
In our framework, Baum-Welch style is utilised in training and Viterbi style in scanning mode. Baum-Welch parsing was chosen for grammar induction to avoid rapid convergence to trivial local minima in the absence of a negative training set. On the other hand, according to our experiments Viterbi algorithm produces better discrimination between positive and negative samples and therefore it is more appropriate for scanning. Moreover, Sakakibara's work suggests that when a grammar is correctly induced, the most likely parse tree of a binding site sequence reflects its structural features . In both cases, the basic version of the parser returns a score which is the log of probability rather than the probability itself. Therefore, it is the average log of probabilities for all training samples which is optimised in the training step.
C. Learning method for stochastic context-free grammars
Since grammar rules are generally unknown in real world applications, efficient and robust methods are required to infer Stochastic Context-Free Grammars. There are two main approaches for learning grammars: Maximum A Posteriori (MAP) Expectation-Maximisation algorithms (EM) and evolutionary methods (Genetic Algorithms (GA) [33, 34] or Genetic Programming (GP) ). The former was employed for SCFGs of known structure (only probabilities were trained) [22, 23]. Moreover, a MAP estimation process was designed based on single base and base pair (local neighbours) frequencies, mutation rates and, finally, rule probabilities . Among evolutionary approaches, GP was successfully applied to derive grammars for small domain-specific non-probabilistic Context-Free languages using positive and negative examples . A tabular representation for CFGs was also proposed to reduce the problem of learning CFGs to the problem of merging and splitting non-terminals according to positive and negative samples . Furthermore it was shown that it is possible to learn grammar from positive examples only, if precise information of the grammatical structure of the unknown grammar is available . Finally, steady-state distributed GA was applied for a version of SCFGs called Biased Weighted Grammars . In this approach, grammar rules were divided into two parts: a real and constant 'bias', and an integer 'weight' which was evolved. Following experiments on theoretical grammars and short sequences, the authors reported faster convergence and a better success rate and grammar compactness than grammars obtained by the Inside Outside version of the EM algorithm.
Following successful applications of evolutionary algorithms to SCFG [39, 40] and our previous experience in CFG learning , we chose a Genetic Algorithm for grammar induction. In the design of the GA we adopted the approach where a single individual represents a whole grammar. This strategy has been already successfully applied in many similar applications [8, 40, 42]. Since our GA actually evolves probabilities of grammar rules, real number coding was chosen for the genotype. The initial population is initialised randomly and then iteratively subjected to evaluation, reproduction, genomic operators and finally succession. These processes are described in more detail at the end of the section. The goodness of grammars induced by the GA is assessed on the basis of its fitting to the training sample of sequences, i.e. the selected grammar is the one which generates maximal log probabilities over the whole set. The algorithm stops when there is no further significant improvement in the score.
The implementation of our grammar induction algorithm is based on Matthew Wall's GAlib library which provides a set of C++ genetic algorithm objects .
where S is the positive sample, Wi is a sequence from S, G is a given grammar and Pr(Wi|G) is the probability that Wi belongs to L(G).
The reproduction step of the GA uses the tournament method which picks randomly a small set of individuals from the original population, and then selects the best one which is added to the set of parents . This is repeated until the appropriate number of parents is chosen. The strength of this method is that the selective pressure is held at the same level during the whole induction process. This strategy with the tournament of 2 competitors was confirmed to be effective in applications similar to ours [8, 42]. Once the reproduction step is completed, the population of parents is subjected to standard genomic operations to produce new individuals. We utilised a steady-state scheme with overlapping populations (50%) to assure the stability of the GA algorithm: only the poorer half of the population is substituted by new individuals. Since our GA deals with probabilities of stochastic rules, i.e. real numbers, offspring are produced by crossover where the genetic information of two individuals is averaged. However, some random distortion is added in order to enhance exploratory capabilities of the algorithm (so called blind crossover in Galib's framework). Subsequently, a classical one point mutation operator is used to mutate randomly chosen genes. This allows escaping from evolutionary traps by making possible the exploration of space not covered by parents. The probabilities of crossover and mutation were 0.9 and 0.001 respectively. Finally, the termination condition of the GA is applied: it is based on monitoring the improvement of the score given by the objective function.
where ri and si are values of rule probabilities. Such distance takes into account properties of the normalized grammar without confusing genotype (raw chromosomes) and phenotype stages (after normalisation). As expected, experiments showed Weighted Hamming distance metric is superior both in performance and convergence speed over the Euclidean style measure .
D. Strategies to handle the computational complexity
Although we introduced a strategy to deal with the size of the protein alphabet by dealing with each physiochemical property separately and introducing 3 non-terminal rules which express their quantitative values, the computational complexity of parsing a Context-Free Grammar remains an issue: it is cubic in time and square in space regarding the length of the input sentence. While standard memory resources are adequate for protein sequence scanning (the average length of a sequence is around 350 amino acids), the time complexity is a critical issue in particular during the process of grammar induction. Typically a population made of hundreds of grammars needs to be parsed at each step of the iterative process. Moreover, since the structure of the final grammar is initially unknown, the initial population of grammars should have a set of rules large enough so that it has the potential to express the properties of the pattern of interest.
Most applications reported in the literature use population sizes between 50 and 1000 individuals. Since a compromise had to be found between exploratory capabilities and manageability, we chose to induce grammars using a constant population of 200 individuals. We conducted experiments which revealed that for such a population size, the total number of rules of each individual should not exceed 200 to be able to generate a grammar within a reasonable amount of time (several hours). This constraint led us to design two different strategies regarding the selection of initial rules. The first approach supplies each individual with a complete set of rules associated with random probabilities in order not to introduce any bias in the evolution of grammars. Since we use Chomsky Normal Form for rules, the number of possible rules is bounded by the cube of number of non-terminals. Therefore, in this scheme no more than 7 non-terminals can be introduced to keep the number of rules below 200. The second approach introduces some additional assumptions regarding the structure of the grammar, as described in next section. This allows emphasing the context freeness of the expected solution and increasing the number of non-terminals to 9 without increasing the volume of the initial rule set.
Although genetic algorithms converge whatever their initial population , they may not find the global optimal solution. Therefore, for each grammar generation, we actually produced several grammars (usually 3) whose scanning results were combined using arithmetical averaging of scores. Using a cluster of powerful machines - 16 bi-processor 64 bit machines with AMD Opteron™ 244 (1.8 GHz, 1 MB cache) processors - time needed for producing all grammars associated to a given pattern was typically of a few hours.
E. Detailed description of datasets
The base of the negative samples in all tests consisted of 829 single chain sequences of 300-500 residues returned by PDB30% (accessed on 12th December 2006). Then for each experiment, sequences matching the studied pattern, if any, were removed from the negative set: one sequence was excluded for PS00063 pattern and two for Zinc finger pattern.
PS00219 is one of two motifs for the anion exchanger family (PDOC00192). The training set consisted of 8 different instances of the 12 residue long PROSITE pattern:
and the 11-residue binding site sequence of a protein missed by the pattern:
We added 76 sequences from the UniProt (9th December 2006) matching PS00219 to the positive part of the testing set.
PS00063 pattern is one of three PROSITE patterns designed for the aldo-keto reductase family (PDOC00061) binding NAP ligand (Nicotinamide-Adenine-Dinucleotide Phosphate). The pattern is located in the C-terminal of an about 300 residue long protein and centred on a lysine residue which is likely to be the active site residue. The 16 residues long PROSITE consensus pattern is:
The training set consisted of 13 representative instances (chosen on the basis of low sequence similarity) of this pattern and sequences found in the PROSITE false negative set. 86 complete sequences matching the pattern formed the positive testing set. A sequence which contained PS00063 motif was excluded from the negative test set.
PS00307 is a legume lectin beta-chain signature that binds calcium and manganese located in the C-terminal section of the beta-chain (PDOC00278):
The positive test set consisted of 67 true positive and false negative PROSITE pattern PS00307 matches from UniProt database (accessed on 23rd April 2007).
The M-phase inducer (MPI) phosphatase family consists of proteins which bind SO4 molecules. The family cannot be covered by a single PROSITE pattern. However, it forms a subset of Rhodanese-like proteins described by Rhodanese domain profile (PS50206). The training set consisted of 16 representative sequences of the binding site and its neighbourhood (total length 25). These short sequences were extracted from the Swiss-Prot database:
The positive test set included 130 non-redundant sequences which belongs to the family according the UniProt (accessed on 22nd February 2008).
Zinc finger is a large superfamily of binding DNA proteins which relies on a zinc atom to support the structure of the binding site (see Figure 16). 11 different PROSITE patterns define their binding sites. We created a zinc finger meta-pattern by selecting all patterns which involved 4 zinc binding residues and did not exceed 30 residues of maximum length.
Number of positive training and test samples for PROSITE patterns involved in Zinc finger meta-pattern
Number of known instances of the pattern
Number of known sequences containing the pattern
Positive test set
The authors would like to thank Dr Kotulska, Dr Makris, Dr Monekosso, Dr Greenhill and Dr Unold for their various contributions during the development of this research. They would also like to acknowledge financial support from the British Council Young Scientists Programme, the Lower Silesian Voivodeship Programme GRANT and the Ministry of Science and Higher Education of Poland.
- Chomsky N: Three models for the description of language. IRE Trans. on Information Theory IT 1956, 2(3):113–124. 10.1109/TIT.1956.1056813View ArticleGoogle Scholar
- Brendel V, Busse HG: Genome structure described by formal languages. Nucleic Acid Res 1984, 12: 2561–2568. 10.1093/nar/12.5.2561PubMed CentralView ArticlePubMedGoogle Scholar
- Jimenez-Montao MA: On the syntactic structure of protein sequences and the concept of grammar complexity. Bull Math Biol 1984, 46: 641–659.View ArticleGoogle Scholar
- Head T: Formal language theory and DNA: an analysis of the generative capacity of specific recombinant behaviors. Bull Math Biol 1987, 49: 737–750.View ArticlePubMedGoogle Scholar
- Searls DB: The language of genes. Nature 2002, 420: 211–217. 10.1038/nature01255View ArticlePubMedGoogle Scholar
- Lonardi S: Pattern Discovery in Biosequences (tutorial). In Proceedings of Intelligent Systems in Molecular Biology: 3–7 August 2002. Edmonton, Canada; 2002.Google Scholar
- Jonyer I, Holder LB, Cook DJ: MDL-Based Context-Free Graph Grammar Induction and Applications. International Journal of Artificial Intelligence Tools 2004, 13(1):65–79. 10.1142/S0218213004001429View ArticleGoogle Scholar
- Maczka J: Zastosowanie wnioskowania gramatycznego w analizie biologicznych sekwencji danych. In MSc thesis. Wroclaw University of Technology; 2004.Google Scholar
- Vaidyanathan PP, Yoon BY: HMM with auxiliary memory: a new tool for modeling RNA secondary structures. In Proceedings of the Thirty-Eighth Asilomar Conference on Signals, Systems and Computers: 2004. Volume 2. IEEE Press, Monterey, CA; 2004:1651–1655.Google Scholar
- Sakakibara Y: Grammatical Inference in Bioinformatics. IEEE Trans. On Pattern Analysis And Machine Intelligence 2005, 27(7):1051–1062. 10.1109/TPAMI.2005.140View ArticleGoogle Scholar
- Ishikawa T, Mitaku S, Terano T, Hirokawa T, Suwa M, Ching SB: Building a Knowledge-Base for Protein Function Prediction using Multistrategy Learning. In Proceedings of Genome Informatics Workshop: 1995. Edited by: Hagiya M, Suyama A, Takagi T, Nakai K, Miyano S, Yokomori T. Universal Academy Press, Tokyo; 1995.Google Scholar
- Sigrist CJA, Cerutti L, Hulo N, Gattiker A, Falquet L, Pagni M, Bairoch A, Bucher P: PROSITE: a documented database using patterns and profiles as motif descriptors. Brief Bioinform 2002, 3(3):265–274. 10.1093/bib/3.3.265View ArticlePubMedGoogle Scholar
- Attwood TK, Beck ME, Bleasby AJ, Parry-Smith DJ: PRINTS - A database of protein motif fingerprints. Nucleic Acids Res 1994, 22(17):3590–3596.PubMed CentralPubMedGoogle Scholar
- Mulder NJ, Apweiler R, Attwood TK, Bairoch A, Binns D, Bork P, Cerutti L, Copley R, Courcelle E, Das U, Daugherty L, Dibley M, Finn R, Fleischmann W, Haft D, Hulo N, Hunter S, Kanapin A, Kejariwal A, Labarga A: New developments in the InterPro database. Nucleic Acids Res 2007, 35: D224-D228. 10.1093/nar/gkl841PubMed CentralView ArticlePubMedGoogle Scholar
- Krogh A, Brown M, Mian IS, Sjolander K, Haussler D: Hidden Markov models in computational biology: Applications to protein modeling. J Mol Biol 1994, 235: 1501–1531. 10.1006/jmbi.1994.1104View ArticlePubMedGoogle Scholar
- Durbin R, Eddy SR, Krogh A, Mitchison G: Biological analysis: sequence probabilistic models of proteins and nucleic acids. Cambridge and New York: Cambridge University Press; 1998.View ArticleGoogle Scholar
- Dupont PR: Inductive and Statistical Learning of Formal Grammars. Research talk at Université catholique de Louvain, Louvain-La-Neuve; 2002.Google Scholar
- Geman S, Johnson M: Probabilistic grammars and their applications. In International Encyclopedia of the Social & Behavioral Sciences. Edited by: Smelser NJ, Baltes PB. Oxford: Pergamon; 2002.Google Scholar
- Searls DB: The Computational Linguistics of Biological Sequences. In Artificial Intelligence and Molecular Biology. Volume 2. Edited by: Hunter L. AAAI Press, Menlo Park, CA; 1993:47–120.Google Scholar
- Eddy S: HMMER User's Guide: Biological sequence analysis using profile hidden Markov models. Washington University School of Medicine, Howard Hughes Medical Institute and Dept. of Genetics; 2003.Google Scholar
- Kupiec J: An Algorithm for Estimating the Parameters of Unrestricted Hidden Stochastic Context-Free Grammars. In Proceedings of the 14th conference on Computational linguistics. Volume 1. Association for Computational Linguistics, Morristown, NJ; 1992:387–393.View ArticleGoogle Scholar
- Sakakibara Y, Brown M, Underwood RC, Mian IS: Stochastic Context-Free Grammars for Modeling RNA. In Proceedings of the 27th Hawaii Int. Conf. on System Sciences. Edited by: Hunter L. IEEE Computer, Los Alamitos, CA; 1993.Google Scholar
- Sakakibara Y, Brown M, Hughey R, Mian IS, Sjolander K, Underwood R, Haussler D: Stochastic Context-Free Grammars for tRNA. Nucleic Acids Res 1994, 22(23):5112–5120. 10.1093/nar/22.23.5112PubMed CentralView ArticlePubMedGoogle Scholar
- Pollard KS, Salama SR, Lambert N, Lambot M-A, Coppens S, Pedersen JS, Katzman S, King B, Onodera C, Siepel A, Kern AD, Dehay C, Igel H, Ares M, Vanderhaeghen P, Haussler D: An RNA gene expressed during cortical development evolved rapidly in humans. Nature 2006, 443: 167–172. 10.1038/nature05113View ArticlePubMedGoogle Scholar
- Liu Q, Yang Y, Chen C, Bu J, Zhang Y, Ye X: RNACompress: Grammar-based compression and informational complexity measurement of RNA secondary structure. BMC Bioinformatics 2008., 9(176):Google Scholar
- Gold EM: Language identification in the limit. Information and Control 1967, 10(5):447–474. 10.1016/S0019-9958(67)91165-5View ArticleGoogle Scholar
- Sakakibara Y: Efficient learning of context-free grammars from positive structural examples. Inform Comput 1992, 97: 23–60. 10.1016/0890-5401(92)90003-XView ArticleGoogle Scholar
- Revesz GE: Introduction to Formal Languages. New York: McGraw-Hill Book Company; 1983.Google Scholar
- Baker JK: Trainable grammars for speech recognition. In Proceedings of the 97th Meeting of the Acoustical Society of America. Edited by: Klatt D, Wolf J. Acoustical Society of America; 1979:547–550.Google Scholar
- Hopcroft J, Ullman J: Introduction to Automata Theory, Languages, and Computation. Reading: Addison-Wesley; 1979.Google Scholar
- Baum LE, Petrie T, Soules G, Weiss N: A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains. Ann Math Statist 1970, 41(1):164–171. 10.1214/aoms/1177697196View ArticleGoogle Scholar
- Forney GD: The Viterbi algorithm. Proceedings of the IEEE 1973, 61(3):268–278. 10.1109/PROC.1973.9030View ArticleGoogle Scholar
- Holland JH: Adaptation in Natural and Artificial Systems. Ann Arbor: University of Michigan; 1975.Google Scholar
- Goldberg DE: Genetic Algorithms in Search, Optimization and Machine Learning. Reading: Addison-Wesley; 1989.Google Scholar
- Koza JR: Genetic Programming: On the Programming of Computers by Means of Natural Selection. Cambridge: MIT Press; 1992.Google Scholar
- Abe N, Mamitsuka H: Predicting Protein Secondary Structure Using Stochastic Tree Grammars. Machine Learning 1997, 29(2–3):275–301. 10.1023/A:1007477814995View ArticleGoogle Scholar
- Knudsen B, Hein J: RNA secondary structure prediction using stochastic context-free grammars and evolutionary history. Bioinformatics 1999, 15(6):446–454. 10.1093/bioinformatics/15.6.446View ArticlePubMedGoogle Scholar
- Mernik M, Crepinsek M, Gerlic G, Zumer V, Viljem Z, Bryant BR, Sprague A: Learning Context-Free Grammars using an Evolutionary Approach. In Technical report. University of Maribor and the University of Alabama at Birmingham; 2003.Google Scholar
- Sakakibara Y: Learning context-free grammars using tabular representations. Pattern Recognition 2005, 38: 1372–1383. 10.1016/j.patcog.2004.03.021View ArticleGoogle Scholar
- Keller B, Lutz R: Evolutionary induction of stochastic context free grammars. Pattern Recognition 2005, 38: 1393–1406. 10.1016/j.patcog.2004.03.022View ArticleGoogle Scholar
- Dyrka W: Rozpoznawanie wzorców proteinowych z zastosowaniem metod maszynowego uczenia. In MSc thesis. Wroclaw University of Technology; 2005.Google Scholar
- Wadowski D: Zastosowanie ewolucyjnie modyfikowanych Maszyn Turinga w rozpoznawaniu biosekwencji. In MSc thesis. Wroclaw University of Technology; 2004.Google Scholar
- Nakai K, Kidera A, Kanehisa M: Cluster analysis of amino acid indices for prediction of protein structure and function. Protein Eng 1998, 2: 93–100. 10.1093/protein/2.2.93View ArticleGoogle Scholar
- Tomii K, Kanehisa M: Analysis of amino acid indices and mutation matrices for sequence comparison and structure prediction of proteins. Protein Eng 1996, 9: 27–36. 10.1093/protein/9.1.27View ArticlePubMedGoogle Scholar
- Kawashima S, Ogata H, Kanehisa M: AAindex: amino acid index database. Nucleic Acids Res 1999, 27: 368–369. 10.1093/nar/27.1.368PubMed CentralView ArticlePubMedGoogle Scholar
- Kanehisa MI, Tsong TY: Local hydrophobicity stabilizes secondary structures in proteins. Biopolymers 1980, 19: 1617–1628. 10.1002/bip.1980.360190906View ArticlePubMedGoogle Scholar
- Robson B, Suzuki E: Conformational properties of amino acid residues in globular proteins. J Mol Biol 1976, 107: 327–356. 10.1016/S0022-2836(76)80008-3View ArticlePubMedGoogle Scholar
- Jones DT, Taylor WR, Thornton JM: The rapid generation of mutation data matrices from protein sequences. Computer Applications in Biosciences 1992, 8: 275–282.Google Scholar
- Fauchere JL, Charton M, Kier LB, Verloop A, Pliska V: Amino acid side chain parameters for correlation studies in biology and pharmacology. Int J Peptide Protein Res 1988, 32: 269–278.View ArticleGoogle Scholar
- Biou V, Gibrat JF, Levin JM, Robson B, Garnier J: Secondary structure prediction: combination of three different methods. Protein Eng 1988, 2: 185–191. 10.1093/protein/2.3.185View ArticlePubMedGoogle Scholar
- Klein P, Kanehisa M, DeLisi C: Prediction of protein function from sequence properties: Discriminant analysis of a data base. Biochim Biophys Acta 1984, 787: 221–226.View ArticlePubMedGoogle Scholar
- Golovin A, Dimitropoulos D, Oldfield T, Rachedi A, Henrick K: MSDsite: A Database Search and Retrieval System for the Analysis and Viewing of Bound Ligands and Active Sites. PROTEINS: Structure, Function, and Bioinformatics 2005, 58(1):190–9. 10.1002/prot.20288View ArticleGoogle Scholar
- Arabas J: Wykłady z algorytmów ewolucyjnych. Warsaw: Wydawnictwo Naukowo-Techniczne; 2004.Google Scholar
- Wall M: GAlib library documentation (version 2.4.4). Massachusetts Institute of Technology; 1999.Google Scholar
- Dyrka W: Probabilistic Context-Free Grammar for pattern detection in protein sequences. In MSc thesis. Kingston University, London; 2007.Google Scholar
- Hulo N, Bairoch A, Bulliard V, Cerutti L, Cuche B, De Castro E, Lachaize C, Langendijk-Genevaux PS, Sigrist CJA: The 20 years of PROSITE. Nucleic Acids Res 2007, 36: D245–9. 10.1093/nar/gkm977PubMed CentralView ArticlePubMedGoogle Scholar
- UniProt Consortium: Universal Protein Resource (UniProt). Nucleic Acid Res 2007, 35: D193-D197. 10.1093/nar/gkl929View ArticleGoogle Scholar
- Berman HM, Westbrook J, Feng Z, Gilliland G, Bhat TT, Weissig H, Shindyalov IN, Bourne PE: The Protein Data Bank. Nucleic Acid Res 2000, 28: 235–242. 10.1093/nar/28.1.235PubMed CentralView ArticlePubMedGoogle Scholar
- Wallace AC, Laskowski RA, Thornton JM: LIGPLOT: A program to generate schematic diagrams of protein-ligand interactions. Protein Eng 1995, 8: 127–134. 10.1093/protein/8.2.127View ArticlePubMedGoogle Scholar
- Cleverdon CW: On the inverse relationship of Recall and Precision. Journal of Documentation 1972, 28: 195–201. 10.1108/eb026538View ArticleGoogle Scholar
- Davis J, Goadrich M: The Relationship between Precision-Recall and ROC Curves. In Proceedings of the 23rd International Conference on Machine Learning. ACM Press; 2006.Google Scholar
- Feng B, Gorin AA, Hingerty BE, Geacintov NE, Broyde S, Patel DJ: Structural alignment of the (+)-trans-anti-benzo[a]pyrene-dG adduct positioned opposite dC at a DNA template primer junction. Biochemistry 1997, 36: 13769–13779. 10.1021/bi970069sView ArticlePubMedGoogle Scholar
- Mamitsuka H, Abe N: Predicting location and structure of beta-sheet regions using stochastic tree grammars. In Proceedings of the Second International Conference on Intelligent Systems for Molecular Biology. AAAI Press, Menlo Park, CA; 1994:276–284.Google Scholar
- Chou PY, Fasman GD: Prediction of the secondary structure of proteins from their amino acid sequence. J Adv Enzymol 1978, 47: 45–148.Google Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.