Beyond rotamers: a generative, probabilistic model of side chains in proteins
- Tim Harder^{1},
- Wouter Boomsma^{2, 3},
- Martin Paluszewski^{1},
- Jes Frellsen^{1},
- Kristoffer E Johansson^{2, 4} and
- Thomas Hamelryck^{1}Email author
DOI: 10.1186/1471-2105-11-306
© Harder et al; licensee BioMed Central Ltd. 2010
Received: 3 March 2010
Accepted: 5 June 2010
Published: 5 June 2010
Abstract
Background
Accurately covering the conformational space of amino acid side chains is essential for important applications such as protein design, docking and high resolution structure prediction. Today, the most common way to capture this conformational space is through rotamer libraries - discrete collections of side chain conformations derived from experimentally determined protein structures. The discretization can be exploited to efficiently search the conformational space. However, discretizing this naturally continuous space comes at the cost of losing detailed information that is crucial for certain applications. For example, rigorously combining rotamers with physical force fields is associated with numerous problems.
Results
In this work we present BASILISK: a generative, probabilistic model of the conformational space of side chains that makes it possible to sample in continuous space. In addition, sampling can be conditional upon the protein's detailed backbone conformation, again in continuous space - without involving discretization.
Conclusions
A careful analysis of the model and a comparison with various rotamer libraries indicates that the model forms an excellent, fully continuous model of side chain conformational space. We also illustrate how the model can be used for rigorous, unbiased sampling with a physical force field, and how it improves side chain prediction when used as a pseudo-energy term. In conclusion, BASILISK is an important step forward on the way to a rigorous probabilistic description of protein structure in continuous space and in atomic detail.
Background
With the emergence of the first experimentally determined protein structures, the investigation of the conformations of their amino acid side chains began. It quickly became apparent that the χ (chi) dihedral angles - the main degrees of freedom in side chains - are not distributed freely, but tend to cluster around certain positions [1–3]. This behavior was already well known for dihedral bond angles in small organic molecules [4]. As more protein structures were solved to a high resolution, an increasingly accurate analysis of the adopted conformations became possible.
Today, the most common way to describe the conformational space of side chains is through so-called rotamer libraries: collections of representative side chain conformations, called rotamers [5]. These libraries are usually compiled from experimentally determined, high resolution protein structures by clustering the side chain conformations. Clusters of side chain angles thus obtained can then for example be represented by Gaussian distributions [6, 7]. Traditionally, a rotamer in a library corresponds to the mean conformation of such a cluster and may be interpreted as a local energy minimum [5]. In recent studies, rotamer libraries with many thousands of rotamers were used [8, 9]. Such libraries are built to cover the conformational space with high resolution.
The accurate description of side chain conformational space is an important ingredient of the solution to many biomolecular problems, such as protein design, docking and high resolution protein structure prediction. Over the past decades rotamer libraries have been successfully applied in all of these contexts. Arguably, the most well studied field is the prediction of side chain conformations for a fixed protein backbone; there is a manifold of programs in the public domain devoted to this problem [10–14].
Rotamer libraries are usually applied as discrete collections of side chain conformations. Discretizing conformational space is a popular approximation to solve problems that are computationally expensive otherwise. For example, when assigning side chains in the densely packed protein core, discretizing the search space leads to exhaustive yet fast search strategies (such as dead end elimination) which can quickly find a global minimum solution [10, 15, 16]. However, in recent studies it was shown that a Markov chain Monte Carlo (MCMC) sampling scheme combined with a detailed rotamer library yields equally good or better results, which suggests that the combinatorial problem often poses no significant obstacle to finding a global minimum solution [8, 13].
The discretization in rotamer libraries inherently leads to edge effects [17, 18]. In docking problems for example, small differences in the side chain conformation may result in large differences in energy. Rotamers are often used as stiff building blocks; not considering the conformations in between rotamers may skip energetically favorable configurations [17, 18]. There are three common heuristic strategies to tackle these issues. The first, which is most commonly used, is tweaking the energy functions; for example, by reducing the influence of mild steric clashes [11, 13, 19]. The second is to increase the number of rotamers in the library in order to improve its resolution [8, 9, 19]. Finally, one can combine rotamer based sampling with some form of continuous optimization [3, 17]. Another problem associated with rotamer libraries is the occurrence of so-called non-rotameric states: side chain conformations that cannot be assigned to any of the standard gauche+, gauche- or trans states [7]. Such conformations are typically missing in rotamer libraries and difficult to fill in correctly [20, 21].
Here we present BASILISK, a dynamic Bayesian network [22] that formulates a probabilistic model of the conformational space of amino acid side chains. The model is generative: it allows sampling of plausible side chain conformations. BASILISK loosely stands for Ba yesian network model of si de chain conformations estimated by maximum li kelihood. BASILISK represents all relevant variables in continuous space and thus avoids the problems that are due to the discretization used in rotamer libraries. Furthermore, BASILISK incorporates the ø (phi) and ψ (psi) angles. This makes it possible to condition the sampling upon the residue's backbone conformation, which is known to exert a strong influence on the side chain's conformation [3]. BASILISK represents all amino acids in a single probabilistic model, which is an entirely novel way of attacking this problem. Such an approach corresponds to a powerful machine learning technique called multitask or transfer learning, which often leads to better models with fewer parameters [23, 24].
We first describe the BASILISK model, then proceed to evaluate its performance, and conclude with illustrating some potential applications.
Results and discussion
Parameterization
In previous studies, it has been shown that the side chain conformation correlates highly with the conformation of the backbone [6]. For the backbone, the two main degrees of freedom are the ϕ and ψ dihedral angles, which when plotted against each other result in the celebrated Ramachandran plot [26]. We incorporate ϕ and ψ angles in BASILISK to be able to condition the sampling on the backbone conformation.
BASILISK: a generative model of side chain conformations
Bayesian networks are graphical models that determine the possible factorizations of the joint probability distribution of a set of random variables [27–29]. A Bayesian network is a graph in which the nodes represent the random variables, and the edges encode their conditional independencies. The graph is directed and acyclic, and is often chosen based on prior, expert knowledge. If sequences of variables are modeled, the models are called dynamic Bayesian networks (DBNs) [22]. Here, dynamic originally referred to time sequences, such as speech signals, but arbitrary sequences can be modeled. Each position in the sequence is called a slice. The sequences represented by a DBN are allowed to have different lengths; a property which we use to our advantage, as explained below.
We briefly describe the most important features of the model. For each slice, an input node (which is a discrete variable) indicates which angle and amino acid type are modeled. For example, 3 indicates the χ_{1} angle of aspartate, 4 indicates the χ_{2} angle of aspartate, and so forth. We recently used a similar approach to formulate a probabilistic model of RNA structure [30].
The natural manifold of all the dihedral angles combined is the hypertorus: a torus with dimension three or higher. BASILISK constructs a probability distribution on this manifold in the following way: the model has a single output node per slice, in the form of a von Mises distribution [31], which can be considered the circular equivalent of a Gaussian distribution. The von Mises distribution takes the circular nature of the data into account: a dihedral angle in [- π, π[ is naturally represented as a point on the circle. The von Mises distribution belongs to the realm of directional statistics [31]: the statistics of angles, directions and orientations. We previously developed probabilistic models of RNA and protein structure based on the combination of DBNs and directional statistics [30, 32, 33]. The von Mises distribution was also used previously in a seminal study on probabilistic models of the protein backbone in terms of the ϕ and ψ angles [34], and in a preliminary study on clustering of side chainrotamers [35].
The problem of representing amino acid types that differ in the number of χ angles within one model is elegantly solved by using a DBN with a variable number of slices. There are two slices for the ϕ and ψ angles, followed by a sequence of slices that represent the χ angles. For example, to model glutamine, which has three χ angles in its side chain, one slice is added to the DBN that is shown in Figure 2.
The dependencies between the input nodes (which specify the amino acid type and the angles) and the output nodes (which specify the values of the angles) are mediated by a sequence of interconnected, discrete hidden nodes. The values of these nodes are never observed: their technical purpose is to model the dependencies between the amino acid type and the χ angles on the one hand, and the sequential dependencies between the χ angles on the other hand. The hidden nodes are so-called nuisance variables, that are integrated away in parameter estimation, sampling and inference. It should be noted that the hidden nodes thus introduce dependencies between all angles, and not just between two consecutive angles - a common misconception.
Our aim was to describe all side chain and backbone angles for all different amino acid types in a single probabilistic model. This approach is known as multitask or transfer learning in the field of machine learning [23, 24] and has several advantages. As the same set of distributions is used to model all amino acids (and all angles), it leads to a lower amount of free parameters. Moreover, it makes "knowledge transfer" possible between amino acids with similar conformational properties during training [23, 24]. Finally, for rotamer libraries, one needs to determine the optimal number of rotamers for each amino acid type separately, while in our approach, only the size of the hidden node needs to be determined. This can be done using an established statistical procedure for model selection (see Model training).
Several other network architectures were discarded during model selection as they could not adequately capture the joint distributions, which illustrates the importance of the network's architecture. Neither regular hidden Markov models, nor various mixture models produced satisfying results (data not shown). A similar observation was made for the probabilistic model of RNA structure mentioned previously [30].
It is important to note that the model as depicted in Figure 2 represents a single amino acid. When assigning side chains to an entire protein backbone, the model is simply applied to each position in the chain. Sampling conformations from BASILISK is fast: generating 50,000 arginine side chain conformations takes about two seconds on an average desktop computer (Intel Core 2, at 2.4 GHz).
Probability distributions
where is the sequence of χ angles, is the angle index information which includes the amino acid type, ϕ and ψ are the backbone angles, and is the sequence of hidden node values.
where the sums run over all possible hidden node sequences .
where the sum again runs over all possible hidden node sequences . The backbone angles are thus simply disregarded in this calculation.
The marginal, conditional probabilities P(χ|H) for a single angle are represented by von Mises distributions (see material and methods). The parameters of the von Mises distribution are specified by the value of the hidden node, H.
As BASILISK is a simple extension of a hidden Markov model, all relevant joint and marginal probabilities can be calculated in a straightforward manner using the forward algorithm [30, 36].
Initial analysis
For generative probabilistic models, an obvious first quality check is visual inspection. Accordingly, we start by investigating whether BASILISK captures the angular preferences found in the training data, before performing a more rigorous and in-depth analysis.
As a second test, we inspected pairwise histograms of the χ_{1} and χ_{2} angles for all relevant amino acids. These plots provide an indication of whether the model captures the correlation between two angles correctly. Again we compare samples from BASILISK model with the training data.
The results of the visual inspections provide a strong indication that the model behaves as desired. We now move on to a more qualitative, in-depth analysis.
BASILISK concurs with a standard rotamer library
In the following tests, we compare BASILISK to several rotamer libraries, as these are the method of choice to explore the conformational space of amino acid side chains for many purposes.
We use the Dunbrack backbone independent library [6] (bbind02.May.lib) as a representative rotamer library, as it is widely used and based on rigorous statistical analysis of high quality protein structures. In the construction of the Dunbrack library, it was assumed that the distribution of each angle in a rotamer follows a Gaussian distribution. Accordingly, rotamers in this library are reported as a sequence of Gaussian distributions - one for each χ angle. This allows us to evaluate the probability density value for any given side chain conformation according to the Dunbrack library.
For all calculations we used the BASILISK model with the backbone angles marked as unobserved - which results in a backbone independent likelihood - for fair comparison with the backbone independent Dunbrack rotamer library.
In the following paragraphs we take a more detailed look at the probability distributions encoded in the BASILISK model, and compare with several standard rotamer libraries. For this analysis we again use the Dunbrack library, but also include two additional backbone independent libraries [7, 37].
Kullback-Leibler divergence analysis.
Amino acid | Dunbrack | Tuffery | Lovell | BASILISK backbone-dependent |
---|---|---|---|---|
Cysteine | 0.01 | 0.03 | 0.00 | -0.13 |
Aspartate | 0.27 | 0.53 | 0.79 | -0.49 |
Glutamate | 0.16 | 0.89 | 1.16 | -0.16 |
Phenylalanine | 0.04 | 0.49 | 0.20 | -0.35 |
Histidine | 0.88 | 1.98 | 1.56 | -0.10 |
Isoleucine | 0.13 | 0.02 | 1.15 | -0.43 |
Lysine | 0.38 | 0.72 | 6.55 | -0.23 |
Leucine | 0.10 | 0.32 | 2.38 | -0.21 |
Methionine | 0.00 | 0.22 | 2.91 | -0.06 |
Asparagine | 0.42 | 0.82 | 3.60 | -0.41 |
Glutamine | 0.28 | 1.00 | 6.41 | -0.17 |
Arginine | 0.15 | 0.80 | 2.59 | -0.17 |
Serine | 0.04 | 0.16 | 0.10 | -0.22 |
Threonine | 0.06 | 0.14 | 0.25 | -0.48 |
Valine | -0.07 | 0.13 | -0.06 | -0.45 |
Tryptophan | -0.33 | 0.07 | 1.49 | -0.04 |
Tyrosine | -0.06 | 0.37 | 0.21 | -0.33 |
Average | 0.14 | 0.46 | 1.69 | -0.28 |
Overall, BASILISK captures the conformational preferences of amino acid side chains more accurately than any of the rotamer libraries, with few exceptions. For example, the Dunbrack library performs better for tryptophan. We speculate this is due to the relatively low abundance of tryptophan in the training data (< 2%), and the fact that we are training an all amino acid model. An amino acid with few observed data points will have a smaller impact on the estimated parameters than an amino acid that was presented more often during training. The relatively low performance of the Lovell library can be explained by the small number of rotamers in the library. Especially for long side chains such as glutamine, lysine or arginine, too many rotamers appear to be missing.
Note that only libraries reporting both mean and variance for each χ angle are suitable for this analysis. Many rotamer libraries are mere discrete sets of possible conformations [8, 9]: they cannot be evaluated in the same, rigorous way.
BASILISK captures the backbone's influence
It is well known that there is a strong correlation between backbone and side chain conformations [3]. This backbone dependency is captured by the BASILISK model by incorporating the backbone's two main degrees of freedom: the ϕ and ψ dihedral angles.
To the best of our knowledge, BASILISK is the first model that captures this correlation in continuous space; that is, without resorting to the usual discretizations of the conformational space. Comparison with other models is therefore difficult. Notably, a comparison with backbone dependent rotamer libraries based on the KL divergence is not possible due to their lack of an expression for the joint probability of the backbone and the side chain angles. However, we do present two decisive tests. First, we resort to visual inspection, followed by a quantitative evaluation based on the KL-divergence between backbone dependent and independent BASILISK. In the next section, we evaluate the influence of the backbone information on side chain sampling for a fixed backbone.
For a quantitative evaluation, we turn again to the KL-divergence; this time, to compare BASILISK with and without backbone dependency. As in the previous test, where BASILISK was compared to different rotamer libraries, this test determines which model is closer to the theoretical truth model as embodied by the test set (see Data sets for training and testing). Table 1 (last column) shows the differences between the KL divergences for all relevant amino acids. The negative numbers indicate that the backbone dependent model resembles the experimental data most. This indicates that BASILISK indeed captures the influence of the backbone, and that incorporating backbone information improves the accuracy for all amino acids. This conclusion is also supported by the results described in the next section.
Application: side chain sampling for a fixed backbone
In the previous sections, we evaluated the probability distributions encoded in BASILISK. We now proceed to evaluate the applicability of the model. As a proof of concept we implemented a side chain prediction algorithm that assigns side chains to a fixed protein backbone. Xiang and Honig [8] showed that given a large rotamer library, an MCMC approach leads to good accuracy in predicting buried side chain conformations. Following their study, we combine side chain sampling from BASILISK with an MCMC method and an unmodified Lennard-Jones potential [39]. The main purpose of the potential is to avoid steric clashes between the side chains. The parameters for the potential were derived from the OPLS force field as implemented in Tinker [40, 41].
For the evaluation, we considered a χ angle within ± 20° of its value in the crystal structure as correct [8, 12]. We only included buried side chains in the protein core in the evaluation, because exposed side chains often have few steric restraints and we did not use any energy term that accounts for the solvent interaction. However, all side chains were included in the MCMC procedure and none were fixed, in order not to bias the simulation towards the native state. The test set contained 43 single chain crystal structures that were used to evaluate side chain prediction algorithms in other studies [8, 9, 42].
To avoid getting trapped in local minima, we resampled three random residues at a time [11]. This effectively enables side chains to swap their positions. After a fixed set of MCMC steps, the lowest energy structure was selected as the final prediction. For details on the energies and the sampling see Sampling strategy and energies.
Side chain placement for a fixed backbone.
Structure | L, B^{ a } | Lennard-Jones^{ b } | BASILISK^{ c } | BASILISK BB^{ d } | IRECS^{ e } | SCWRL 4^{ e } | |||||
---|---|---|---|---|---|---|---|---|---|---|---|
χ _{ 1 } (%) | χ _{ 2 } | χ _{ 1 } (%) ^{ f } | χ _{ 1 } (%) | χ _{ 2 } | χ _{ 1 } (%) ^{ f } | χ _{ 1 } (%) | χ _{ 2 } | χ _{ 1 } (%) ^{ f } | χ _{ 1 } (%) | χ _{ 2 } | χ _{ 1 } (%) ^{ f } | χ _{ 1 } (%) | χ _{ 2 } | χ _{ 1 } (%) ^{ f } | ||
1NAR | 289, 45 | 77.78 | 76.92 | 73.33 | 87.50 | 93.33 | 87.50 | 84.44 | 70.37 | 86.67 | 79.31 |
5P21 | 166, 21 | 90.48 | 77.78 | 85.71 | 100.00 | 95.24 | 88.89 | 95.24 | 88.89 | 100.00 | 80.00 |
1BJ7 | 150, 12 | 91.67 | 75.00 | 100.00 | 77.78 | 100.00 | 77.78 | 91.67 | 75.00 | 83.33 | 85.71 |
1GCI | 269, 40 | 95.00 | 86.67 | 97.50 | 81.25 | 100.00 | 81.25 | 95.00 | 85.71 | 97.50 | 93.33 |
2BAA | 243, 30 | 86.67 | 60.00 | 83.33 | 86.67 | 90.00 | 82.35 | 86.67 | 81.25 | 90.00 | 94.12 |
1DHN | 121, 15 | 93.33 | 100.00 | 100.00 | 85.71 | 86.67 | 100.00 | 93.33 | 100.00 | 93.33 | 100.00 |
1AMM | 174, 22 | 90.91 | 100.00 | 100.00 | 92.86 | 100.00 | 92.86 | 100.00 | 85.71 | 86.36 | 90.91 |
1IC6 | 279, 47 | 89.36 | 73.68 | 91.49 | 70.00 | 93.62 | 75.00 | 91.49 | 73.68 | 93.62 | 85.00 |
1KOE | 172, 26 | 80.77 | 92.86 | 73.08 | 84.62 | 80.77 | 84.62 | 92.31 | 92.86 | 88.46 | 84.62 |
2HVM | 273, 43 | 83.72 | 74.07 | 95.35 | 82.76 | 90.70 | 89.66 | 90.70 | 85.19 | 90.70 | 84.62 |
3LZT | 129, 10 | 80.00 | 83.33 | 70.00 | 83.33 | 80.00 | 83.33 | 100.00 | 83.33 | 100.00 | 83.33 |
1CEX | 197, 24 | 95.83 | 89.47 | 100.00 | 100.00 | 95.83 | 100.00 | 87.50 | 94.74 | 100.00 | 100.00 |
1AGY | 197, 25 | 92.00 | 84.21 | 96.00 | 100.00 | 96.00 | 100.00 | 84.00 | 94.74 | 92.00 | 100.00 |
1EDG | 380, 76 | 85.53 | 65.85 | 85.53 | 85.00 | 90.79 | 81.82 | 85.53 | 80.49 | 89.47 | 86.05 |
1THV | 207, 20 | 85.00 | 76.92 | 80.00 | 91.67 | 85.00 | 92.31 | 90.00 | 76.92 | 90.00 | 100.00 |
2CPL | 164, 24 | 95.83 | 73.33 | 91.67 | 85.71 | 95.83 | 93.33 | 100.00 | 80.00 | 95.83 | 93.33 |
1NPK | 150, 16 | 100.00 | 60.00 | 100.00 | 80.00 | 100.00 | 90.00 | 93.75 | 88.89 | 87.50 | 88.89 |
1MLA | 305, 38 | 97.37 | 71.43 | 97.37 | 86.36 | 100.00 | 86.36 | 94.74 | 75.00 | 92.11 | 84.21 |
1ARB | 263, 37 | 89.19 | 90.48 | 89.19 | 88.89 | 86.49 | 85.00 | 86.49 | 68.42 | 83.78 | 90.00 |
1MML | 251, 19 | 78.95 | 81.82 | 84.21 | 75.00 | 89.47 | 91.67 | 94.74 | 83.33 | 94.74 | 91.67 |
1CHD | 198, 26 | 96.15 | 68.75 | 96.15 | 81.25 | 100.00 | 76.47 | 92.31 | 73.33 | 92.31 | 80.00 |
1QQ4 | 198, 25 | 80.00 | 60.00 | 84.00 | 80.00 | 84.00 | 90.91 | 88.00 | 63.64 | 88.00 | 81.82 |
1QJ4 | 256, 36 | 83.33 | 75.00 | 91.67 | 81.48 | 94.44 | 81.48 | 91.67 | 85.71 | 94.44 | 81.48 |
1B9O | 123, 14 | 78.57 | 50.00 | 71.43 | 57.14 | 78.57 | 50.00 | 92.86 | 66.67 | 92.86 | 44.44 |
1BYI | 224, 30 | 80.00 | 86.67 | 100.00 | 100.00 | 96.67 | 94.12 | 90.00 | 87.50 | 93.33 | 100.00 |
1XNB | 185, 22 | 90.91 | 91.67 | 100.00 | 91.67 | 95.45 | 100.00 | 100.00 | 66.67 | 95.45 | 91.67 |
2PTH | 193, 19 | 94.74 | 100.00 | 100.00 | 100.00 | 94.74 | 100.00 | 94.74 | 100.00 | 100.00 | 100.00 |
1WHI | 122, 12 | 91.67 | 100.00 | 100.00 | 75.00 | 100.00 | 75.00 | 91.67 | 100.00 | 100.00 | 100.00 |
153L | 185, 26 | 84.62 | 93.33 | 96.15 | 93.33 | 88.46 | 86.67 | 100.00 | 87.50 | 100.00 | 100.00 |
1QTW | 285, 35 | 94.29 | 84.00 | 91.43 | 91.67 | 91.43 | 83.33 | 88.57 | 70.83 | 97.14 | 80.77 |
2IHL | 129, 12 | 66.67 | 75.00 | 75.00 | 75.00 | 83.33 | 75.00 | 100.00 | 75.00 | 100.00 | 75.00 |
1CZ9 | 139, 14 | 85.71 | 88.89 | 85.71 | 100.00 | 100.00 | 100.00 | 100.00 | 88.89 | 100.00 | 100.00 |
2RN2 | 155, 11 | 90.91 | 87.50 | 90.91 | 87.50 | 90.91 | 100.00 | 81.82 | 100.00 | 81.82 | 100.00 |
1RCF | 169, 28 | 92.86 | 87.50 | 96.43 | 82.61 | 100.00 | 95.83 | 82.14 | 80.00 | 92.86 | 90.91 |
7RSA | 124, 12 | 75.00 | 100.00 | 75.00 | 100.00 | 75.00 | 100.00 | 75.00 | 100.00 | 91.67 | 100.00 |
1A8Q | 274, 39 | 87.18 | 70.00 | 71.79 | 93.75 | 89.74 | 80.95 | 94.87 | 87.50 | 92.31 | 95.65 |
1CEM | 363, 55 | 89.09 | 64.52 | 83.64 | 77.42 | 94.55 | 79.41 | 89.09 | 80.00 | 89.09 | 80.00 |
1AAC | 105, 13 | 100.00 | 75.00 | 100.00 | 100.00 | 100.00 | 100.00 | 92.31 | 87.50 | 100.00 | 87.50 |
1PLC | 99, 10 | 100.00 | 85.71 | 90.00 | 66.67 | 100.00 | 71.43 | 90.00 | 85.71 | 100.00 | 71.43 |
1BD8 | 156, 11 | 81.82 | 100.00 | 90.91 | 85.71 | 90.91 | 100.00 | 100.00 | 100.00 | 90.91 | 85.71 |
1NLS | 237, 23 | 78.26 | 85.71 | 86.96 | 87.50 | 86.96 | 81.25 | 86.96 | 80.00 | 91.30 | 81.25 |
1IXH | 321, 44 | 81.82 | 72.00 | 84.09 | 84.62 | 88.64 | 85.19 | 93.18 | 75.00 | 88.64 | 84.00 |
1AKO | 268, 35 | 77.14 | 72.73 | 85.71 | 91.30 | 85.71 | 91.30 | 100.00 | 81.48 | 97.14 | 88.46 |
Average | 207, 27 | 87.44 | 80.65 | 89.32 | 86.25 | 92.08 | 87.49 | 91.92 | 83.43 | 93.13 | 88.26 |
In a second test, we use the BASILISK likelihood as a pseudo-energy component [43], combined with the Lennard-Jones potential. Table 2c shows that the prediction quality increases (by about 2% for χ_{1}). Incorporating backbone information in BASILISK (Table 2d) increases the performance compared to the backbone independent (by more than 2%) and the Lennard-Jones only case (by more than 4%). It should be noted that none of these tests include energies that evaluate key features such as hydrogen bonds, salt-bridges or electrostatic interactions.
For comparison, Table 2e also reports the prediction accuracy of IRECS [12] and SCWRL 4 [14], which are two leading programs in the field. In both cases, the results are on a par with BASILISK. SCWRL 4 and IRECS are specialized programs optimized for both prediction accuracy and speed: they use fine tuned and optimized force fields combined with backbone dependent rotamer libraries. The comparison serves to illustrate the quality of BASILISK as a probabilistic model; with respect to computational performance, SCWRL 4 and IRECS (whose runtime is typically seconds to minutes) are clearly superior to the unoptimized application of BASILISK (where we sampled for several hours to ensure convergence).
Conclusions
In this paper, we introduce a generative, probabilistic model of the conformational space of side chains that allows sampling of realistic, native-like side chain angles in continuous space. BASILISK incorporates a continuous backbone dependency, which to the best of our knowledge is entirely novel. Another unique feature is that BASILISK represents all relevant natural amino acids within one model. This powerful approach is known as multitask or transfer learning in the field of machine learning, and comes with several advantages.
In the first tests we showed that BASILISK is able to accurately capture the angular preferences found in proteins. Using the KL divergence, we confirmed that the model compares favorably with several standard rotamer libraries.
BASILISK also captures the effect of the backbone conformation on the side chain, and samples realistic angular distributions for various areas of the Ramachandran plot. Again using the KL divergence, we confirmed that including backbone information leads to more accurate results.
As a proof of concept, we implemented a simple side chain prediction method that assigns side chains to a fixed protein backbone, using an MCMC sampling scheme and an unmodified Lennard-Jones potential as energy function. The results show the applicability of combining a continuous description of conformational space with a detailed energy function. Adding BASILISK as an explicit pseudo-energy term improves the prediction results. Best results are obtained when the backbone conformation is taken into account.
Specialized side chain prediction programs combine highly tuned energy functions with an efficient exploitation of the discrete nature of rotamers. This makes them very fast, yet accurate. BASILISK as such does not compete with those programs, but provides a solution where a detailed, continuous description of conformational space is required. The possibility to combine an unmodified, standard force field with BASILISK opens great possibilities for applications such as docking, structure prediction or protein design. For example, the calculation of side chain entropies is important for tasks such as protein quality assessment or protein design [44–46]. BASILISK can facilitate these calculations - which are now often performed with discrete rotamer libraries - in continuous space.
BASILISK, when combined with our previously described probabilistic model of the protein backbone (TorusDBN [33]), can be used to sample protein structures in continuous space and in full atomic detail. An obvious potential application is to sample protein conformations by combining TorusDBN and BASILISK with a physical force field, with applications in protein structure prediction, simulation and design.
BASILISK illustrates the enormous potential and increasing importance of probabilistic models and probabilistic machine learning methods in structural bioinformatics [19, 30, 33, 44, 47, 48]. We believe that BASILISK is an excellent solution for problems that require going beyond discrete representations of amino acid side chains in protein structure simulation, prediction and design.
Methods
Data sets for training and testing
For training, we used a high quality dataset obtained from the PISCES server [49]. The PISCES server can be used to select a set of structures from the Protein Data Bank that respect quality thresholds regarding resolution or R-value. We imposed a resolution of 1.6 Å or better, an R-value of 0.25 or better, and a pairwise sequence similarity cutoff of 25%. Subsequently, all structures were removed that had a sequence similarity higher than 25% with any of the structures used in the fixed backbone prediction test (see next paragraph).
The resulting set consisted of 1703 crystal structures. All structures were processed using the REDUCE program [50], which automatically corrects some common errors in protein structures (such as histidines with a flipped ring). From this initial set retrieved from the PISCES server, we randomly picked 10% of the structures and reserved these for testing. The test set contained 31,229 side chains from 171 structures. The training set contained angles from 277,975 residues from 1532 structures. The angles were calculated using Biopython's Bio.PDB module [51, 52].
Data set for fixed backbone prediction
The data set for the fixed backbone prediction consisted of crystal structures that were previously used in three other studies for the same purpose [8, 9, 42].
We removed structures with a very small core (less than 10 fully buried residues) and structures with multiple chains or chain breaks, resulting in 43 remaining structures. The input files for the test only retained the backbone atoms; all side chain atoms and hetero-atoms were removed.
We used DSSP [53] to calculate the relative accessible surface area in order to determine the solvent exposure state of a residue. We only included fully buried residues for which the accessible surface area is zero in our analysis, as we did not use any energy term accounting for the solvent interaction. However, all side chains were included in the experiments, in order to avoid bias towards the native structure.
Model training
The BASILISK model was implemented and trained using our freely available Mocapy ++ toolkit [54]. The model's parameters were estimated using the stochastic expectation maximization (EM) algorithm [55].
The model also includes backbone information, which usually leads to a quick explosion of parameters due to discretization. For example, dividing the Ramachandran plot in bins of 10° by 10° creates 1296 bins, which combined with 18 rotameric amino acids and several rotamers per amino acid can quickly lead to data sparseness in training. This problem is avoided by treating the data in a natural, continuous space.
Modeling the angles
where x ∈ [- π, π[ is the random angle, μ is the mean, κ ≥ 0 is a concentration parameter and I_{0} is the modified Bessel function of the first kind and of order zero.
Probability densities from rotamer libraries
where is the sequence of χ angles, A is the amino acid type, P(R_{ A }) is the probability of the rotamer R of amino acid type A, and P( |R_{ A }) is the probability of the sequence of χ angles for rotamer R of amino acid type A. The sum runs over all defined rotamers for the amino acid A in a rotamer library.
The product runs over all n χ angles.
Kullback-Leibler divergence
where p is usually the empirical data or a truth model and q usually represents a probabilistic model that approximates p. The KL divergence is non-negative and only becomes zero if p = q.
For the backbone dependent case, a fair evaluation based on the KL divergence is not possible: rotamer libraries do not allow the calculation of the joint probability of the x , ϕ and ψ angles.
Sampling strategy and energies
where E_{LJ}( ) is the Lennard-Jones energy of conformation , R is the ideal gas constant and T is the temperature. We set the temperature to room temperature, which results in for all calculations.
where is the probability of accepting to replace with ; and are the probabilities of and according to the target distribution; and and are the probabilities to move to state from state and to state from state according to the proposal distribution.
where is the Lennard-Jones derived probability of as before, and is the product of the probabilities of the side chains in according to BASILISK. Note that in this case, we sample according to the Lennard-Jones potential in an unbiased way.
For the backbone dependent experiments, is replaced in the above expressions by , where and are the (fixed) backbone angles of .
We proposed three new side chain conformations at random sequence positions in every iteration. This effectively enables side chains to swap places, which is important to solve the combinatorial problem in the densely packed protein core. The backbone independent sampling is done using ancestral sampling [28]. In the backbone dependent case, sampling is done using the forward-backtrack algorithm [30, 32, 33, 57].
In the fixed backbone experiments, we used 500,000 MCMC iterations. For the final prediction, we selected the structure with the highest probability (or, equivalently, lowest energy). In the evaluation, we considered a χ angle within 20° of the angle observed in the crystal structure as correct.
Availability
A Python implementation of BASILISK, including all the parameters of the optimal model, is freely available for download at https://sourceforge.net/projects/basilisk-dbn/. The source code provides a class that implements the main features of BASILISK, namely sampling side chain angles and evaluating the probability of a given set of angles. The package also includes example scripts that show how to use the BASILISK module. The first script parses a Protein Data Bank file [58] using Biopy-thon's Bio.PDB package [51, 52], retrieves all the side chains and calculates the likelihood of their χ angles. A second script samples side chain angles for a given amino acid type and optionally a set of backbone angles. For a full description of the features, please refer to the provided manual.
Declarations
Acknowledgements
We thank our colleagues at the Bioinformatics Centre (University of Copenhagen) for valuable comments and suggestions. We also thank Jesper Ferkinghoff-Borg (DTU Elektro, Technical University of Denmark), Kanti Mardia (University of Leeds, UK), Thomas Poulsen (Novozymes) and Leonardo De Maria (Novozymes) for helpful discussions. T. Harder, J. Frellsen and M. Paluszewski are funded by the Danish Council for Strategic Research (NaBiIT, 2106-06-0009). W. Boomsma is funded by the Danish Council for Independent Research (FNU, 272-08-0315). KE. Johansson is funded by the Danish Council for Independent Research (FTP, 274-080124).
Authors’ Affiliations
References
- Chandrasekaran R, Ramachandran GN: Studies on the conformation of amino acids. XI. Analysis of the observed side group conformation in proteins. Int J Protein Res 1970, 2: 223–233.View ArticlePubMed
- Ponder JW, Richards FM: Tertiary templates for proteins. Use of packing criteria in the enumeration of allowed sequences for different structural classes. J Mol Biol 1987, 193: 775–791. 10.1016/0022-2836(87)90358-5View ArticlePubMed
- Dunbrack RL, Karplus M: Backbone-dependent rotamer library for proteins. Application to side-chain prediction. J Mol Biol 1993, 230: 543–574. 10.1006/jmbi.1993.1170View ArticlePubMed
- Eyring H: Steric hindrance and collision diameters. J Am Chem Soc 1932, 54: 3191–3203. 10.1021/ja01347a022View Article
- Dunbrack RL: Rotamer libraries in the 21st century. Curr Opin Struct Biol 2002, 12: 431–440. 10.1016/S0959-440X(02)00344-5View ArticlePubMed
- Dunbrack RL, Cohen FE: Bayesian statistical analysis of protein side-chain rotamer preferences. Protein Sci 1997, 6: 1661–1681. 10.1002/pro.5560060807View ArticlePubMedPubMed Central
- Lovell SC, Word JM, Richardson JS, Richardson DC: The penultimate rotamer library. Proteins 2000, 40: 389–408. 10.1002/1097-0134(20000815)40:3<389::AID-PROT50>3.0.CO;2-2View ArticlePubMed
- Xiang Z, Honig B: Extending the accuracy limits of prediction for side-chain conformations. J Mol Biol 2001, 311: 421–430. 10.1006/jmbi.2001.4865View ArticlePubMed
- Peterson RW, Dutton PL, Wand AJ: Improved side-chain prediction accuracy using an ab initio potential energy function and a very large rotamer library. Protein Sci 2004, 13: 735–751. 10.1110/ps.03250104View ArticlePubMedPubMed Central
- Canutescu AA, Shelenkov AA, Dunbrack RL: A graph-theory algorithm for rapid protein side-chain prediction. Protein Sci 2003, 12: 2001–2014. 10.1110/ps.03154503View ArticlePubMedPubMed Central
- Jain T, Cerutti DS, McCammon JA: Configurational-bias sampling technique for predicting side-chain conformations in proteins. Protein Sci 2006, 15: 2029–2039. 10.1110/ps.062165906View ArticlePubMedPubMed Central
- Hartmann C, Antes I, Lengauer T: IRECS: A new algorithm for the selection of most probable ensembles of side-chain conformations in protein models. Protein Sci 2007, 16: 1294–1307. 10.1110/ps.062658307View ArticlePubMedPubMed Central
- Lu M, Dousis AD, Ma J: OPUS-Rota: A fast and accurate method for side-chain modeling. Protein Sci 2008, 17: 1576–1585. 10.1110/ps.035022.108View ArticlePubMedPubMed Central
- Krivov GG, Shapovalov MV, Dunbrack RL: Improved prediction of protein side-chain conformations with SCWRL4. Proteins 2009, 77: 778–795. 10.1002/prot.22488View ArticlePubMedPubMed Central
- Desmet J, DeMayer M, Hazes B, Lasters I: The dead-end elimination theorem and its use in protein side-chain positioning. Nature 1992, 356: 539–542. 10.1038/356539a0View ArticlePubMed
- Desmet J, Spriet J, Lasters I: Fast and accurate side-chain topology and energy refinement (FASTER) as a new method for protein structure optimization. Proteins 2002, 48: 31–43. 10.1002/prot.10131View ArticlePubMed
- Wang C, Schueler-Furman O, Baker D: Improved side-chain modeling for protein-protein docking. Protein Sci 2005, 14: 1328–1339. 10.1110/ps.041222905View ArticlePubMedPubMed Central
- Grigoryan G, Ochoa A, Keating AE: Computing van der Waals energies in the context of the rotamer approximation. Proteins 2007, 68: 863–878. 10.1002/prot.21470View ArticlePubMed
- Yanover C, Schueler-Furman O, Weiss Y: Minimizing and learning energy functions for side-chain prediction. Lect Notes Comput Sci 2007, 381–395. full_text
- Schrauber H, Eisenhaber F, Argos P: Rotamers: to be or not to be? An analysis of amino acid side-chain conformations in globular proteins. J Mol Biol 1993, 230: 592–612. 10.1006/jmbi.1993.1172View ArticlePubMed
- Petrella RJ, Karplus M: The energetics of off-rotamer protein side-chain conformations. J Mol Biol 2001, 312: 1161–1175. 10.1006/jmbi.2001.4965View ArticlePubMed
- Ghahramani Z: Learning dynamic Bayesian networks. Lect Notes Comput Sci 1998, 1387: 168–197. full_textView Article
- Caruana R: Multitask learning. Mach Learn 1997, 28: 41–75. 10.1023/A:1007379606734View Article
- Pan SJ, Yang Q: A survey on transfer learning. IEEE Trans Knowl Data Eng 2009, in press.
- Engh RA, Huber R: Accurate bond and angle parameters for X-ray protein structure refinement. Acta Crystallogr A 1991, 47: 392–400. 10.1107/S0108767391001071View Article
- Ramachandran GN, Ramakrishnan C, Sasisekharan V: Stereochemistry of polypeptide chain configurations. J Mol Biol 1963, 7: 95–99. 10.1016/S0022-2836(63)80023-6View ArticlePubMed
- Pearl J: Probabilistic reasoning in intelligent systems. Morgan Kaufmann; 1988.
- Bishop CM: Pattern recognition and machine learning. Springer; 2006.
- Needham CJ, Bradford JR, Bulpitt AJ, Westhead DR: A primer on learning in Bayesian networks for computational biology. PLoS Comput Biol 2007, 3: e129. 10.1371/journal.pcbi.0030129View ArticlePubMedPubMed Central
- Frellsen J, Moltke I, Thiim M, Mardia KV, Ferkinghoff-Borg J, Hamelryck T: A probabilistic model of RNA conformational space. PLoS Comput Biol 2009, 5: e1000406. 10.1371/journal.pcbi.1000406View ArticlePubMedPubMed Central
- Mardia KV, Jupp PE: Directional statistics. John Wiley and Sons, New York, USA; 2000.
- Hamelryck T, Kent JT, Krogh A: Sampling realistic protein conformations using local structural bias. PLoS Comput Biol 2006, 2:-e131. 10.1371/journal.pcbi.0020131
- Boomsma W, Mardia KV, Taylor CC, Ferkinghoff-Borg J, Krogh A, Hamelryck T: A generative, probabilistic model of local protein structure. Proc Natl Acad Sci USA 2008, 105: 8932–8937. 10.1073/pnas.0801715105View ArticlePubMedPubMed Central
- Edgoose T, Allison L, Dowe DL: An MML classification of protein structure that knows about angles and sequence. Pac Symp Biocomput 1998, 585–596.
- Fetrow JS, Berg G: Using information theory to discover side chain rotamer classes: analysis of the effects of local backbone structure. Pac Symp Biocomput 1999, 278–289.
- Durbin R, Eddy SR, Krogh A, Mitchison G: Biological sequence analysis. Cambridge University Press, UK; 1998.View Article
- Tuffery P, Etchebest C, Hazout S, Lavery R: A new approach to the rapid determination of protein side chain conformations. J Biomol Struct Dyn 1991, 8: 1267–1289.View ArticlePubMed
- Kullback S, Leibler RA: On information and sufficiency. Ann Math Statist 1951, 22: 79–86. 10.1214/aoms/1177729694View Article
- Lennard-Jones JE: On the forces between atoms and ions. Proc R Soc Lond A Math Phys Sci 1925, 109: 584–597. 10.1098/rspa.1925.0147View Article
- Jorgensen WL, Maxwell DS, Tirado-Rives J: Development and testing of the OPLS all-atom force field on conformational energetics and properties of organic liquids. J Am Chem Soc 1996, 118: 11225–11236. 10.1021/ja9621760View Article
- Kaminski GA, Friesner RA, Tirado-Rives J, Jorgensen WL: Evaluation and reparametrization of the OPLS-AA force field for proteins via comparison with accurate quantum chemical calculations on peptides. J Phys Chem B 2001, 105: 6474–6487. 10.1021/jp003919dView Article
- Liang S, Grishin NV: Side-chain modeling with an optimized scoring function. Protein Sci 2002, 11: 322–331. 10.1110/ps.24902View ArticlePubMedPubMed Central
- Mendes J, Nagarajaram HA, Soares CM, Blundell TL, Carrondo MA: Incorporating knowledge-based biases into an energy-based side-chain modeling method: Application to comparative modeling of protein structure. Biopolymers 2001, 59: 72–86. 10.1002/1097-0282(200108)59:2<72::AID-BIP1007>3.0.CO;2-SView ArticlePubMed
- Kamisetty H, Xing EP, Langmead CJ: Free energy estimates of all-atom protein structures using generalized belief propagation. J Comp Biol 2008, 15: 755–766. 10.1089/cmb.2007.0131View Article
- Kamisetty HK, Langmead CJ: A graphical model approach for predicting free energies of association for protein-protein interactions under backbone and side-chain flexibility. Proc Struc Bioinform Comput Biophys 2009, 67–68.
- Sciretti D, Bruscolini P, Pelizzola A, Pretti M, Jaramillo A: Computational protein design with side-chain conformational entropy. Proteins 2009, 74: 176–191. 10.1002/prot.22145View ArticlePubMed
- Theobald DL, Wuttke DS: Accurate structural correlations from maximum likelihood superpositions. PLoS Comput Biol 2008, 4: e43. 10.1371/journal.pcbi.0040043View ArticlePubMedPubMed Central
- Hamelryck T: Probabilistic models and machine learning in structural bioinformatics. Stat Methods Med Res 2009, 18: 505–526. 10.1177/0962280208099492View ArticlePubMed
- Wang G, Dunbrack RL: PISCES: a protein sequence culling server. Bioinformatics 2003, 19: 1589–1591. 10.1093/bioinformatics/btg224View ArticlePubMed
- Word JM, Lovell SC, Richardson JS, Richardson DC: Asparagine and glutamine: Using hydrogen atom contacts in the choice of side-chain amide orientation. J Mol Biol 1999, 285: 1735–1747. 10.1006/jmbi.1998.2401View ArticlePubMed
- Hamelryck T, Manderick B: PDB file parser and structure class implemented in Python. Bioinformatics 2003, 19: 2308–2310. 10.1093/bioinformatics/btg299View ArticlePubMed
- Cock PJA, Antao T, Chang JT, Chapman BA, Cox CJ, Dalke A, Friedberg I, Hamelryck T, Kauff F, Wilczynski B: Biopython: freely available Python tools for computational molecular biology and bioinformatics. Bioinformatics 2009, 25: 1422–1423. 10.1093/bioinformatics/btp163View ArticlePubMedPubMed Central
- Kabsch W, Sander C: Dictionary of protein secondary structure: Pattern recognition of hydrogen-bonded and geometrical features. Biopolymers 1983, 22: 2577–2637. 10.1002/bip.360221211View ArticlePubMed
- Paluszewski M, Hamelryck T: Mocapy++ - A toolkit for inference and learning in dynamic Bayesian networks. BMC Bioinformatics 2010, 11: 126.View ArticlePubMedPubMed Central
- Nielsen S: The stochastic EM algorithm: Estimation and asymptotic results. Bernoulli 2000, 6: 457–489. 10.2307/3318671View Article
- Burnham KP, Anderson DR: Model selection and multimodel inference - a practical information-theoretic approach. Second edition. Springer; 2002.
- Cawley SL, Pachter L: HMM sampling and applications to gene finding and alternative splicing. Bioinformatics 2003, 19: 36–41. 10.1093/bioinformatics/btg1057View Article
- Berman HM, Westbrook J, Feng Z, Gilliland G, Bhat TN, Weissig H, Shindyalov IN, Bourne PE: The protein data bank. Nucleic Acids Res 2000, 28: 235–242. 10.1093/nar/28.1.235View ArticlePubMedPubMed Central
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.