Skip to main content

NCACO-score: An effective main-chain dependent scoring function for structure modeling



Development of effective scoring functions is a critical component to the success of protein structure modeling. Previously, many efforts have been dedicated to the development of scoring functions. Despite these efforts, development of an effective scoring function that can achieve both good accuracy and fast speed still presents a grand challenge.


Based on a coarse-grained representation of a protein structure by using only four main-chain atoms: N, Cα, C and O, we develop a knowledge-based scoring function, called NCACO-score, that integrates different structural information to rapidly model protein structure from sequence. In testing on the Decoys'R'Us sets, we found that NCACO-score can effectively recognize native conformers from their decoys. Furthermore, we demonstrate that NCACO-score can effectively guide fragment assembly for protein structure prediction, which has achieved a good performance in building the structure models for hard targets from CASP8 in terms of both accuracy and speed.


Although NCACO-score is developed based on a coarse-grained model, it is able to discriminate native conformers from decoy conformers with high accuracy. NCACO is a very effective scoring function for structure modeling.


A central stage at the protein structure modeling is to develop an effective energy function, also called potential or scoring function, which generally fall into two categories: physical-based and knowledge-based energy functions. Physical-based energy functions are derived from the laws of physics, which often use molecular mechanics method [13]. Whereas, knowledge-based energy functions are based on statistical analysis of experimentally determined protein structures, which provide an excellent shortcut towards a powerful energy function [4]. Compared to physical-based energy functions, knowledge-based energy functions have become more and more popular in protein structure prediction due to the relatively easy generation and manipulation of model structures and the lower computational cost. This can be seen from recent CASPs (Critical Assessment of Techniques for Protein Structure Prediction), in which the most successful prediction methods use knowledge-based energy functions [5, 6]. Moreover, knowledge-based approaches have also been widely used in protein design [7], validation of experimentally determined protein structures [8, 9] and protein-protein and protein-ligand interactions [10].

Knowledge-based energy functions can also be developed at different level of complexity depending on the level of structural details considered in the structural models. At the most detailed structural level, the knowledge-based energy functions require the structural information of all heavy atoms [4, 1119]. The all-atom knowledge-based energy functions can achieve good accuracy in structural analysis, but they typically incur intensive computation [20]. To reduce running time, many efforts have attempted to develop coarse-grained models with reduced structural representation [2132]. The simplest coarse-grained model is to represent a residue as a point and thus a protein structure can be delineated as a simple Cα-trace. The coarse-grained models at residue level indeed can significantly decrease the running time in structure modeling but they usually suffer unsatisfactory accuracy [21].

To balance the accuracy and computational time, the intermediate models between the atom-level and residue-level representations have also been developed [15, 21, 22, 24]. In these models, the side chains are considered, which are usually simplified as Cβ atoms or the side chain center of mass. For example, in low resolution structure prediction, the Rosetta of Baker lab used a structural model represented by heavy main-chain atoms and pseudo side chain center of mass [33]. More recently, Makino and Itoh also developed a knowledge-based potential named DFMAC that requires the coordinates of main-chain atoms (N, Cα and C) and pseudo Cβ atom [21]. Since the side chain conformations have been abstracted, these main-chain dependent models can achieve both relatively good accuracy and reasonable running time. Although these energy models have showed high ability of structure discrimination on known decoy data sets, few have demonstrated success in structure modeling, especially in de novo structure prediction. This is because de novo structure prediction requires high-performance scoring function not only with high accuracy of structure discrimination at low computational expense, but also with a smooth energy landscape which goes beyond the ability to distinguish the known decoy data sets. For example, DFMAC uses an orientation-dependent potential term between two Cα-pseudo-Cβ vectors. Although the orientation-dependent potential showed a considerable improvement in distinguishing native structures and non-native (or decoy) structures, it relies on strict geometry features which are difficult to be satisfied due to the inaccuracy of pseudo atoms. This could significantly affect its use in structural modeling. Therefore, development of scoring functions for effective structure modeling still remains a challenging problem.

Here we also attempt to develop an effective knowledge-based scoring function based on main-chain dependent coarse-grained model that only requires the main-chain atoms (N Cα C and O) coordinates per residue, which we called as NCACO-score. In developing NCACO-score, we considered an integration of four potential terms: contact-based pairwise atom-atom interactions, sequence-dependent local conformational propensities, solvation effects, and geometry propensities of pairwise triplet fragments on beta sheet. Although the first three terms follow the same form of other knowledge-based scoring functions [11, 21], they are derived differently and carefully parameterized in the integration (see Methods). Moreover, we proposed a new potential term, the fourth term, to promote the formation of beta sheet during the structure modeling. The testing on 32 decoy sets from Decoys'R'Us database [34] shows that NCACO-score outperforms other coarse-grained potentials in discriminating native structures from their decoy structures. Remarkably, its average Z-score is much lower than those other coarse-grained potentials, indicating that NCACO-score has a larger energy gap between the native state and nonnative ones. This suggests its potential and effectiveness in structure prediction [13]. Furthermore, in an application of the scoring function to structure prediction using a simple fragment-based assembly procedure, we found that the structures modeled for the 14 hard targets of CASP8 achieved comparable accuracy with those predicted by Robetta [35]. The average running time of prediction for these targets was ~64.5 h of CPU time. This demonstrates the effectiveness of the NCACO-score in structure modeling. We believe that the scoring function could be very useful for protein structure modeling.


Overview of NCACO-score

In NCACO-score, we consider two levels of coarse-grained structure representations. One is a five-bead model, in which a residue is represented as four main-chain atoms (N Cα C and O) and a pseudo side chain center of mass (except GLY). The pseudo Side chain Center of Mass (SCM) was determined according to the φ/ψ backbone torsion angles of the residue. We use the five-bead model to derive pairwise atom-atom contact potential (E con ) and sequence-dependent local conformational potential (E trp ). The other is a residue-level structure representation requiring Cα coordinates only. We use the residue-level model to derive solvation potential (E sol ) and beta sheet geometry propensity potential (E beta ). Therefore, our NCACO-score integrates the above four terms:


The potential components considered in NCACO-score could reflect different aspects of protein folding principle. E con stands for the mean interaction potential between two atoms, which reflects the compatibility of the whole protein structure. This potential is the most widely used term in knowledge-based scoring function, and is even used alone in some pioneers' work [13, 15, 28, 32]. E trp reflects the local conformational biases of secondary structure, which is local-sequence dependent. E sol stands for the solvation energy of protein, which reflects the hydrophobic effect of protein folding. We used a simple model based on Cα atom to derive the solvation energy by following Makino and Itoh's method [21]. To promote the formation of beta sheet, we introduced E beta to capture the geometrical features of beta sheet at residue level. The details of these four terms and their integration are described in Methods. Although it's difficult to construct orthogonal potential components for knowledge-based scoring function, we will show below that the integration of these four terms indeed improves structure discrimination ability, enabling us to develop an effective knowledge-based scoring function.

Assessment of structure discrimination ability of NCACO-score and its individual terms

To gain insights into how well NCACO-score and its individual components discriminate native structures from non-native structures (also called decoys), we looked into their performance of structure discrimination on the Decoys'R'Us sets. 32 proteins from five decoy sets were selected: 1) 4state_reduced (seven proteins), 2) fisa (four proteins), 3) fisa_casp3 (three proteins), 4) lmds (ten proteins), and 5) lattice_ssfit (eight proteins).

Table 1 summarizes the discrimination power of NCACO-score and its four individual potential terms on the five decoy sets in terms of the ranks and Z-scores of native structures. As shown in the table, NCACO-score ranked the first the native structures of 23 proteins out of 32 proteins. Remarkably, the Z-scores of native structures were very low in most of the 32 proteins with average Z-score of -5.06, demonstrating the great structure discrimination ability of NCACO-score. Despite its overall good performance, NCACO-score could not effectively discriminate between the native and decoy structures for the two proteins (1fc2 in fisa set, and 1bba in lmds set) (z-score > 0), which we will explain below.

Table 1 Performance of single terms and the total scoring function of NCACO-score on Decoys'R'Us sets.

For individual terms, E trp had the best performance, which ranked the first 21 of 32 native structures with average Z-score of -5.34, indicating that it contributed the most to NCACO-score. Although E con and E sol overall had lower ability of structure discrimination compared to E trp , they outperformed E trp in the fisa set. E beta , which is designed to capture the structural feature of beta sheet, indeed showed a good performance for most proteins containing beta sheet (average Z-score = -6.92).

From above, we can see that the performance of NCACO-score largely relies on the individual term E trp . Therefore, the extremely poor performance of E trp in discriminating the native and decoy structures of four proteins (1fc2 and 1hdd-C in fisa set, 1bba and 1fc2 in lmds set) could significantly affect the performance of NCACO-score in these four proteins. However, E con and E sol have better structure discrimination than E trp in these four proteins. As shown in Table 1, the integration of these two terms improves the performance NCACO-score, particularly for 1hdd-C in fisa set and 1fc2 in lmds set, in which integrated NCACO-score significantly outperforms E trp . This suggests the necessity of the integration of these different terms in developing an effective scoring function.

The decoy discrimination ability of NCACO-score was also rigorously evaluated using 4-fold cross-validations on the Decoys'R'Us sets (see additional file 1). As seen from the results of cross-validations, NCACO-score performed nearly equally well in both training sets and testing sets not only for the average rank of native structures (38.44 in training sets vs 36.96 in testing sets) but also for the Z-score of native structures (-5.10 in training sets vs -4.93 in testing sets). The close performance of our model in training sets and testing sets suggests the robustness and reliability of our model.

A good energy function should be able to discriminate native structure from near-native decoys [36]. However, Decoys'R'Us sets are not suitable for this test, because most of the decoys are far from native structures. Therefore, we further generated a new near-native decoy set by fragment replacement method (see additional file 2). This data set consists of 87 proteins with decoys of TM-scores between 0.6 and 0.9 compared to the native structure (see additional file 2). When NCACO-score was tested on this data set, the average Pearson correlation coefficient between energy and cRMSD for the 87 proteins was 0.64 (see additional file 2), demonstrating the reliability of NCACO-score in discrimination of near native structures.

Comparison with other knowledge-based scoring functions

We compared the performance of NCACO-score on the 32 Decoys'R'Us sets with 6 state-of-the-art knowledge-based scoring functions: RAPDF [19], Atomic KBP [13], DFIRE-A [15], DFIRE-B [15], PC2CA [22], and DFMAC [21]. Table 2 shows comparison of the ranks and Z-scores of the native structures. RAPDF, Atomic KBP, and DFIRE-A need coordinates of all heavy atoms of main chain and side chain. DFIRE-B needs information of main chain and Cβ. PC2CA needs information of Cα and Cβ. DFMAC needs information of the main-chain atoms (N, Cα, and C). Like DFMAC, our scoring function NCACO-score needs coordinates of the main-chain atoms (N, Cα, C, and O). The comparison results showed NCACO-score had the best discrimination performance on the 32 proteins in terms of both the average rank and the average Z-score. Among the four functions which used coarse-grained model (DFIRE-B, PC2CA, DFMAC, and NCACO-score), NCACO-score had the lowest average Z-score (-5.06), followed by DFMAC (-4.05), PC2CA (-3.48) and DFIRE-B (-3.32). For the average rank of native structure, NCACO-score also gave the best rank (36.84), followed by PC2CA (39.09) DFIRE-B (40.81) and DFMAC (47.53).

Table 2 Comparison of performance between NCACO-score and other potential functions on Decoys'R'Us sets.

For individual proteins, all the 6 functions showed similar trends with regard to their structure discriminating abilities. For example, they all discriminated 4state_reduced and lattice_ssfit sets with ease but were difficult to discriminate same proteins (e.g. 1fc2 in fisa set, 1bba and 1fc2 in lmds set). This phenomenon has been mentioned by other researchers before [15, 37]. Zhou speculated that the failure of the scoring functions in 1bba could be that it was an atypical small protein without a significant hydrophobic core [15].

Application to de novo protein structure prediction

Next, we sought to explore the performance of NCACO-score in structure modeling. Based on fragment assembly with three-residue fragments, we implemented a de novo structure prediction method that uses NCACO-score to guide the fragment assembly process (see Methods). To promote the formation of correct beta sheet, and prevent the formation of wrong beta sheet, the weight of E beta was changed periodically according to a sine function during the fragment assembly procedure. In order to avoid the excessive collisions between atoms during the assembly process, a simple energy term for punishing collision was added to the NCACO-score. The procedure iterated three times, and the predicted structures from the previous iteration were used as the initial structures of the next iteration.

To compare our prediction method with Robetta, one of the best existing protein structure prediction servers, we tested 14 CASP8 hard targets, on which Robetta used template-free modeling method. For each target, 1000 structure models were generated in our method, then clustered and 5 top models were selected by a centroid-based clustering. Table 3 shows the accuracies of the top 1 models predicted by our method by comparing to the models that Robetta predicted in CASP8 which are available at the Robetta web site. As shown in the table, our method had average prediction accuracy of TM-score 0.290, comparable to that by Robetta (0.287).

Table 3 Comparison of performance between our method and Robetta on 14 CASP8 hard targets.

Although both our structure predictor and Robetta are based on fragment assembly, they have significantly different performance on modeling the structures. For example, for T0496-D2, our method correctly predicted its overall topology except for the coil part of its N-terminal (TM-score = 0.463) (comparing the predicted and native structure of T0496-D2 in Figure 1), which is much better than Robetta prediction (TM-score = 0.291). For the 14 targets, the Pearson's correlation coefficient between TM-scores of our predicted structures and those of Robetta-predicted structures is very low (0.085). The complementarity between the two methods underscores the importance of our work on the development of NCACO-score for structure modeling. Moreover, our method guided by NCACO-score has a moderate computational cost. For the 14 targets, the average CPU time was ~64.5 h on a 2.33 GHz Intel Xeon processor.

Figure 1
figure 1

Illustration of the predicted structure for T0496-D2. The predicted model by NCACO-score (B) is compared with the experimental structure (A). Red to blue runs from the N to the C terminus. Structures are displayed by using VMD [48].


In this study, we have developed a knowledge-based scoring function named NCACO-score. NCACO-score integrates four different aspects of statistical structural features based on two coarse-grained models that only require coordinates of the heavy atoms of main-chain and pseudo side chain center of mass. We have demonstrated that NCACO-score can effectively discriminate native structures from their decoys, with a performance comparable to or even better than other state-of-the-art coarse-grained or all-atom knowledge-based statistical scoring functions. Moreover, NCACO-score can be used to guide fragment assembly for fast structure prediction, which can achieve a comparable accuracy to Robetta, one of the best structure modellers of similar kind.

In developing knowledge-based scoring functions, orientation-dependent structural features have been widely used [11, 21, 23, 38]. For examples, DFMAC uses an orientation-dependent potential term between two Cα-pseudo-Cβ vectors [21], and in OPUS-Cα, the distance-dependent pairwise energy term and hydrogen bonding energy term are also orientation-dependent [23]. These orientation-dependent potentials are sensitive to geometrical features, causing the energy to be truncated abruptly at the cutoff. Therefore, these orientation-dependent potentials could have very rough energy landscape, which limit their applications to structural modeling. In NCACO-score, we exclude the orientation-dependent potentials that are sensitive to geometrical features, and only the coordinates of the heavy atoms of main-chain and pseudo side chain center of mass are needed, greatly simplifying structure representation without need to scan the side chain conformations. Moreover, unlike the directional hydrogen-bonding potentials for capturing the interaction of beta sheet, which depend on critical geometrical constraints for atoms, the novel term we developed to capture beta sheet was based on the propensity of geometrical features between beta-strand parings. As the geometrical features are defined at Cα level in our model, the potential is less sensitive than typical directional hydrogen-bonding potential. We have shown that the novel beta sheet geometry propensity potential indeed had a good discrimination power for most proteins containing beta sheet.

Many potential terms were proposed and could be included in an effective knowledge-based scoring function. For example, Wu et al. added packing energy and three-body energy in their OPUS-Cα potential [23], Makino and Itoh added the potential of ω dihedral angle in their DFMAC potential [21], and Fogolari added pseudo bond/angle/dihedral potentials in their PC2CA potential [22]. These potential terms are proved effective more or less in structure discrimination, which will be attempted in NCACO-score in our future work. The inclusion of more potential terms could improve the performance of structure discrimination, but this could render the energy landscape too rough and cause overfitting [39]. In developing NCACO-score, we have only considered four terms that reflect different aspects of protein folding principles. Indeed, integration of these four terms improves the performance of NCACO-score, although E trp makes a dominant contribution.


NCACO-score is a knowledge-based scoring function that integrates four statistical structural features to effectively discriminate native structures from their decoys. Successful application of NCACO-score to structure modeling shows that NCACO-score could be a useful tool for structure modeling.


Nonhomologous structure database

  1. 6997

    protein structures (less than 25% homology) with a resolution < 3.0Å and R-factor < 1.0 are obtained from PISCES server (May 20, 2010) [40], and are used to derive statistical potentials. For determining the distance cutoff of contact for any two types of atom, we need to get the minimal distance between any atom pair in protein structures (the detail of contact definition is below). So, a high-resolution structure database is used, including 2069 protein structures (less than 25% homology) with a resolution < 1.6Å and R-factor < 0.25 from PISCES server (May 20, 2010).

Knowledge-based scoring function: NCACO-score

1. Coarse-grained structure representations

To calculate E con and E trp , NCACO-score uses a coarse-grained model of five beads, which includes 5 atoms (N Cα C O in backbone, and pseudo side chain center of mass) for representing a residue (Figure 2). For the χ1/χ2 torsion angles of side chain were dependent on its backbone φ/ψ torsion angles [41], the pseudo side chain center of mass was determined by its backbone φ/ψ torsion angles in our model, which is described as follows:

Figure 2
figure 2

Schematic representation of the backbone atoms (N Cα C O) and the side chain center of mass (SCM).

First, the side chain centers of mass (SCM) excluding H atoms for all residues of 6997 proteins are calculated. The φ/ψ torsion angles of backbone, the pseudo bond length (Cα-SCM), the pseudo bond angle (N-Cα-SCM), and the pseudo bond dihedral (N-C-Cα-SCM) are calculated for each residues. Second, the φ/ψ torsion angles (ranging from -180° to 180°) are divided into 36 bins with a width of 10°. The values of pseudo bond length, angle, and dihedral of the 19 amino acids (except GLY) according to each of the 36*36 bins are averaged on the 6997 proteins. Thus, a table containing the average pseudo bond length/angle/dihedral for each of all 19*36*36 pseudo SCM is obtained. Finally, given the four backbone atoms (N Cα C O) coordinates of a structure, the pseudo SCM information (bond length/angle/dihedral) for each residue is extracted from the table according to its amino acid type and φ/ψ torsion angles of backbone. The coordinate of pseudo SCM atom of each residue can be calculated by its backbone atoms (N Cα C O) coordinates and its pseudo SCM information through coordinates transformation.

To calculate E sol and E beta , we use residue-level coarse-grained model, in which a residue is represented as its Cα atom. Therefore, only the coordinates of Cα atoms are needed.

2. Individual energy terms

The pairwise atom-atom contact potential

According to our five-bead coarse-grained model, there are four atoms (N Cα C O) for GLY and five atoms (N Cα C O SCM) for the other 19 amino acids, resulting in all 99 atom types. Two atoms A and B are defined to be in contact if their distance d AB is between r AB and λ*r AB , where r AB is the statistical shortest contact distance between atoms A and B observed in the 2069 high-resolution protein structures (r AB > 2.2Å to exclude the situation that two atoms could be covalently linked). λ = 1.9 is used in our model. Then, for each pair of atoms A and B, the number of contacts (N AB ) and number of non-contacts are counted in the 6997 proteins. By following the method of Shakhnovich lab [11], the contact potential uses the form of μ-potential defined as:


The value of μ = 0.987 is chosen to make the net interaction zero. E con for a protein is summed over the energies of all possible atom pairs in the protein.

The sequence-dependent local conformational potential

The Ramachandran map suggests that the distribution of φ/ψ torsion angles for a polypeptide is limited, and the distributions of φ/ψ torsion angles are different for different amino acids. We consider the local conformation potential based on three-residue fragment. Figure 2 shows a triplet fragment consisting of A i- 1, A i , A i +1, where A i is the amino acid type of the i-th residue. The four dihedrals ψi-1φ i ψ i φi + 1(range from -180° to 180°) are used to express the local conformation potential of a triplet fragment. Each dihedral is divided into 12 bins with bin width 30°. By following the method of Shakhnovich lab [11], the sequence-dependent local conformation potential is also expressed as a μ-potential:


where N j and are the number of occurrence of the triplet A i- 1A i A i + 1 in the j-th bin and the total number of occurrence of the triplet A i- 1A i A i + 1 subtracted by N j in the 6997 proteins, respectively. The value of μ = 0.994 is chosen to make the net interaction zero. E trp for a protein is summed over the energies of all overlap triplet fragments in the protein.

The solvation potential

The solvation potential is derived at residue level by considering Cα atom only, which is similar to the SURR term used in DFMAC potential [21]. It is described as follows:


where A i is the type of the i-th residue, and E ak is the potential for amino acid a with k contact residues. N ak is the number of observations for amino acid a with k contact residues in the 6997 proteins, and (the expectation of N ak ) is estimated by equation 7. In the equation, N a is the total number of occurrence of amino acid a, N k is the total number of residues with k contact residues, and N total is the total number of residues in the database. In this procedure two residues are regarded to be in contact if the distance between their Cα atoms is less than 12.5Å. E sol for a protein is summed over the energies of all residues in the protein.

The beta sheet geometry propensity potential

Hydrogen bond energy plays an important role in the formation of beta sheet. Thus far, most methods have attempted to calculate hydrogen-bond donor and acceptor explicitly to capture beta sheet [11, 23, 38], which are computationally intensive and cause the non-smooth truncation of energy at the geometric boundaries. To overcome the shortcoming, we used the geometrical features of beta sheet to guide the formation of beta sheet correctly based on a Cα level coarse-grained model. As shown in Figure 3A, both parallel and anti-parallel beta sheet have similar backbone geometrical feature at Cα level. Our model considers the pairing of three-residue fragments. First, we determine whether a pair of triplet fragments has a tendency to form beta sheet according to a simple criteria: all the three distances and (see Figure 3B), are required to be less than a cutoff d for parallel beta sheet. While for anti-parallel beta sheet, the three distances are and . The tendencies of both parallel and anti-parallel patterns are considered. If the both patterns are satisfied the criteria, we compare the average value of the three distances and choose the pattern that has a smaller average distance. Second, the four features α 1 α 2 β and γ (illustrated in Figure 3B) of a fragment pair are calculated for all fragment pairs that have tendencies to form beta sheet in the 6997 proteins. Then the four features are binned according to their range. The statistical results point that α 1 and α 2 fall into the range between 70° to 180° (varying slightly on different parameter d ), which are separated into four bins: 0°~90°, 90°~120°, 120°~150°, and 150°~180°; β and γ fall into the range between 0° to 180°, which are separated into six bins: 0°~30°, 30°~60°, 60°~90°, 90°~120°, 120°~150°, and 150°~180°. In total, there are 4 × 4 × 6 × 6 = 576 bins for a fragment pair. Based on the Boltzmann law [42], the potential is derived as follows:

Figure 3
figure 3

Schematic illustration of the parameters used in the beta sheet geometry propensity potential. A: Left is the representation of backbone atoms and side chain centroid atom of beta sheet. Right is the representation of Cα atoms. Using the representation of Cα atoms, the geometrical features of beta sheet is the same for both parallel and anti-parallel types. B: Four parameters α 1 α 2 β γ for a triplet pair in a beta sheet (parallel) are used to determine the geometrical tendency of beta sheet. α 1 is the angle between two vector (CAi-1CAi and CAiCAi+1), and α 2 is the angle between two vector (CAj-1CAj and CAjCAj+1). Pi denotes the vector in the plane defined by three atoms (CAi-1 CAi CAi + 1) for residue CAi, and Pj denotes the vector in the plane defined by three atoms (CAj-1 CAj CAj + 1) for residue CAj. β is the angle between Pi and Pj. γ is the angle between two vectors (CAi-1CAi and CAj-1CAj). The three blue dotted lines are represented the three distances that are used to define the tendency of forming beta sheet.


where N α 1 α 2 βλ is the number of observations of all fragment pair in each bin of α 1 α 2 β γ in the database. is the average number of observations for each bin. For parameter d, we tested its range from 5.0Å to 6.4Å and finally set it to 5.6Å which gives a better optimization result. 5.6Å is close to the average distance between backbones of beta sheet in the structure database. E beta for a protein is summed over the energies of all triplet fragment pairs that have tendencies to form beta sheet in the protein.

3. Integration of the four terms into NCACO-score

The above four terms are linearly combined to form NCACO-score:


where a, b, c are the relative weights of E trp , E sol and E beta respectively, which are parameterized on 32 Decoys'R'Us sets (see below).

4. Optimization of weights and parameters

Weights of the equation 12 and parameters in the single potentials described above are optimized on 32 proteins of Decoys'R'Us sets (described above). The cost function for optimization is:


where is the average rank of native structure and is the average Z-score for the proteins used for training. The optimization goal is to minimize the function value. After optimization on all 32 proteins, the NCACO-score is


Performance assessment

Two commonly used indices are used for quality measures: Rn, the rank of native structure relative to decoy structures based on the calculated energy; Z-score, a quantitative measure of energy bias for the native structure against decoy structures, which is defined as:


and E tot are the energies of the native and decoy structures, respectively, and σ(E tot ) are the average and standard deviation of energy of all decoys, respectively.

Development a de novo structure prediction method using fragment assembly guided by NCACO-score

We applied NCACO-score to structure modeling based on fragment assembly similar to that was used in Rosetta [33].

1. Fragment templates library

In order to compare our prediction results with Robetta results in CASP8 fairly, the proteins in the database consisting of 6997 proteins that have more than 30% identity to the predicted target are excluded, which guarantees there are no homologous proteins for the predicted target. The list of fragment templates for the target proteins are generated as follows:

First, we obtained the secondary structure information for both target proteins and the template structures from the nonhomologous structure database. The secondary structures of target proteins are predicted using PSIPRED [43]. The secondary structures of the proteins in the nonhomologous structure database are identified using DSSP [44]: H, G, I for alpha helix, E for beta-strand, and the others for coil. Second, sequence profiles for each target sequence and each sequence of the structure database are constructed by three rounds of PSI-BLAST [45] with an e-value cutoff of 0.001. Finally, sequences of the target protein and the structure database are cut to overlapping triplet fragments. All triplet fragments of the structure database are scored with each triplet fragment of the target sequence using the following scoring function:


Where F query (i, j) and P template (i, j) are the frequency matrix of the query triplet and log-odds matrix of the template triplet for amino acid j at the i-th position, respectively. q i and t i are the secondary structure of query triplet and template triplet at the i-th position, respectively. After ranking, for each query triplet of the target protein, 25 triplets of top scores from the structure database are selected. The φ/ψ/ω torsion angles of template triplets are obtained as the fragment templates library.

2. NCACO-score-guided structure modeling process

NCACO-score can be used to guide fragment assembly for protein structure prediction, which is detailed as follows:

Step 1. An extended backbone structure is initialized for the target sequence, in which all φ/ψ/ω torsion angles are 180°.

Step 2. Template triplets in the fragment templates library are randomly selected to replace the value of φ/ψ/ω torsion angles of the target sequence from N-term to C-term. Thus a random initial backbone structure is constructed, whose φ/ψ/ω torsion angles of backbone are all from the fragment templates library.

Step 3. A triplet in the target sequence is randomly selected as the target fragment, and is replaced by randomly selected template triplet. The energies of the structures are evaluated by NCACO-score with atom clash punishment and promotion of beta sheet (described below). Whether to reject or accept a replacement is based on the metropolis acceptance criteria: a replacement with lower energy is accepted, and a replacement with higher energy is occasionally accepted. The details are described below:


where r is a random float number between 0 and 1. 35,000 replacements are implemented with a simulated annealing protocol. The temperature (T) is gradually decreased from 2000K to 300K. The initial factor is 1.0. In order to avoid local optima, if the times of continuous rejection (Nr) is more than 200, factor = 1.0+(Nr-200)/80.0; and if the factor is more than 11.0, the simulated annealing process is stopped.

Step4. The step2 and step3 are repeated for 1000 times to generate 1000 predicted structures for the target sequence.

Step5. Model selection. The 1000 predicted structures are clustered using a centroid-based clustering process by following the algorithm of SPICKER [46] with adaptation. The top five biggest clusters are selected as top five predicted structures. Different from SPICKER that uses RMSD to assess structural similarity for clustering, our implemented centroid-based clustering process uses TM-score, which is more sensitive than RMSD [47]. The initial TM-score cutoff is set to 0.7, the TM-score cutoff for clustering should be between 0.3 and 0.9, and the biggest cluster should includes 20% ~ 70% of the total number of structures.

The above procedure iterated for three times. In the second run, the top five predicted structures in the first run are used as initial structures. For each of the initial structures, the assembly procedure is implemented for 200 times, and it results in 200 predicted structures. The factor of metropolis acceptance criteria is different from that for the first run: if the times of continuous rejections Nr > 200, factor = 1.0+(Nr-200)/160.0; and if factor <6.0, the simulated annealing process is stopped. Similarly, the top five structures predicted in the second run are used as initial structures for the third run, and 200 times assembly procedures result in 200 predicted structures for each initial structure. In the third run, if the times of continuous rejection Nr > 200, factor = 1.0+(Nr-200)/320.0; and if the factor <3.5, the simulated annealing process is stopped. Finally, the structure with the lowest energy among the top five predicted structures from the third run is obtained as the best predicted model.

3. Atom clash punishment and promotion of beta sheet

During the process of fragment assembly, atom clash happens frequently. Atoms A and B are regarded to have clash with each other if the distance d AB between them is less than the statistical shortest contact distance between them r AB (as described in the pairwise atom-atom contact potential part). Two measures are used to punish the atom clash. One is based on the number of all backbone atom pairs having clash (N bb _ clash ). If N bb _ clash > N seq /3.0 (where N seq is the sequence length of the target protein), the structure is rejected. The other is to add a clash punishment term E clash = N clash to the NCACO-score. N clash is the total number of atom pairs in clash including the backbone atoms and the pseudo side chain center atoms.

As a long-range interaction, beta sheet is hard to form correctly during the fragment assembly process. To promote the correct formation of beta sheet, the weight of E beta varies by multiplying a periodic factor , where Tn is the step of random fragment replacement. Thus, the weight is increased during the first 500 steps. Then the weight is decreased and increased alternately.


  1. Cheatham TE, Young MA: Molecular dynamics simulation of nucleic acids: successes, limitations, and promise. Biopolymers 2000, 56(4):232–256. 10.1002/1097-0282(2000)56:4<232::AID-BIP10037>3.0.CO;2-H

    Article  CAS  PubMed  Google Scholar 

  2. Mackerell AD, Wiorkiewiczkuczera J, Karplus M: An All-Atom Empirical Energy Function for the Simulation of Nucleic-Acids. J Am Chem Soc 1995, 117(48):11946–11975. 10.1021/ja00153a017

    Article  CAS  Google Scholar 

  3. Boas FE, Harbury PB: Potential energy functions for protein design. Curr Opin Struc Biol 2007, 17(2):199–204. 10.1016/

    Article  CAS  Google Scholar 

  4. Arab S, Sadeghi M, Eslahchi C, Pezeshk H, Sheari A: A pairwise residue contact area-based mean force potential for discrimination of native protein structure. Bmc Bioinformatics 2010, 11: 16. 10.1186/1471-2105-11-16

    Article  PubMed Central  PubMed  Google Scholar 

  5. Skolnick J: In quest of an empirical potential for protein structure prediction. Curr Opin Struc Biol 2006, 16(2):166–171. 10.1016/

    Article  CAS  Google Scholar 

  6. Dill KA, Ozkan SB, Shell MS, Weikl TR: The protein folding problem. Annu Rev Biophys 2008, 37: 289–316. 10.1146/annurev.biophys.37.092707.153558

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  7. Poole AM, Ranganathan R: Knowledge-based potentials in protein design. Curr Opin Struc Biol 2006, 16(4):508–513. 10.1016/

    Article  CAS  Google Scholar 

  8. Sippl MJ: Knowledge-Based Potentials for Proteins. Curr Opin Struc Biol 1995, 5(2):229–235. 10.1016/0959-440X(95)80081-6

    Article  CAS  Google Scholar 

  9. Macarthur MW, Driscoll PC, Thornton JM: Nmr and Crystallography - Complementary Approaches to Structure Determination. Trends Biotechnol 1994, 12(5):149–153. 10.1016/0167-7799(94)90074-4

    Article  CAS  PubMed  Google Scholar 

  10. Zhang C, Liu S, Zhu Q, Zhou Y: A knowledge-based energy function for protein-ligand, protein-protein, and protein-DNA complexes. J Med Chem 2005, 48(7):2325–2335. 10.1021/jm049314d

    Article  CAS  PubMed  Google Scholar 

  11. Yang JS, Chen WW, Skolnick J, Shakhnovich EI: All-atom ab initio folding of a diverse set of proteins. Structure 2007, 15(1):53–63. 10.1016/j.str.2006.11.010

    Article  PubMed  Google Scholar 

  12. Potapov V, Cohen M, Inbar Y, Schreiber G: Protein structure modelling and evaluation based on a 4-distance description of side-chain interactions. Bmc Bioinformatics 2010, 11: 374. 10.1186/1471-2105-11-374

    Article  PubMed Central  PubMed  Google Scholar 

  13. Lu H, Skolnick J: A distance-dependent atomic knowledge-based potential for improved protein structure selection. Proteins 2001, 44(3):223–232. 10.1002/prot.1087

    Article  CAS  PubMed  Google Scholar 

  14. Lu MY, Dousis AD, Ma JP: OPUS-PSP: An orientation-dependent statistical all-atom potential derived from side-chain packing. J Mol Biol 2008, 376(1):288–301. 10.1016/j.jmb.2007.11.033

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  15. Zhou H, Zhou Y: Distance-scaled, finite ideal-gas reference state improves structure-derived potentials of mean force for structure selection and stability prediction. Protein Sci 2002, 11(11):2714–2726.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  16. Melo F, Feytmans E: Novel knowledge-based mean force potential at atomic level. J Mol Biol 1997, 267(1):207–222. 10.1006/jmbi.1996.0868

    Article  CAS  PubMed  Google Scholar 

  17. Shen MY, Sali A: Statistical potential for assessment and prediction of protein structures. Protein Sci 2006, 15(11):2507–2524. 10.1110/ps.062416606

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  18. McConkey BJ, Sobolev V, Edelman M: Discrimination of native protein structures using atom-atom contact scoring. P Natl Acad Sci USA 2003, 100(6):3215–3220. 10.1073/pnas.0535768100

    Article  CAS  Google Scholar 

  19. Samudrala R, Moult J: An all-atom distance-dependent conditional probability discriminatory function for protein structure prediction. J Mol Biol 1998, 275(5):895–916. 10.1006/jmbi.1997.1479

    Article  CAS  PubMed  Google Scholar 

  20. Helles G: A comparative study of the reported performance of ab initio protein structure prediction algorithms. Journal of the Royal Society Interface 2008, 5(21):387–396. 10.1098/rsif.2007.1278

    Article  PubMed Central  CAS  Google Scholar 

  21. Makino Y, Itoh N: A knowledge-based structure-discriminating function that requires only main-chain atom coordinates. Bmc Struct Biol 2008, 8: 46. 10.1186/1472-6807-8-46

    Article  PubMed Central  PubMed  Google Scholar 

  22. Fogolari F, Pieri L, Dovier A, Bortolussi L, Giugliarelli G, Corazza A, Esposito G, Viglino P: Scoring predictive models using a reduced representation of proteins: model and energy definition. Bmc Struct Biol 2007, 7: 15. 10.1186/1472-6807-7-15

    Article  PubMed Central  PubMed  Google Scholar 

  23. Wu YH, Lu MY, Chen MZ, Li JL, Ma JP: OPUS-Ca: A knowledge-based potential function requiring only C alpha positions. Protein Sci 2007, 16(7):1449–1463. 10.1110/ps.072796107

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  24. Go JF, Li HL, Jiang HL, Wang XC: A simple C-alpha-SC potential with higher accuracy for protein fold recognition. Biochem Bioph Res Co 2009, 379(2):610–615. 10.1016/j.bbrc.2008.12.131

    Article  Google Scholar 

  25. Miyazawa S, Jernigan RL: Residue-residue potentials with a favorable contact pair term and an unfavorable high packing density term, for simulation and threading. J Mol Biol 1996, 256(3):623–644. 10.1006/jmbi.1996.0114

    Article  CAS  PubMed  Google Scholar 

  26. Zhang J, Chen R, Liang J: Empirical potential function for simplified protein models: Combining contact and local sequence-structure descriptors. Proteins-Structure Function and Bioinformatics 2006, 63(4):949–960. 10.1002/prot.20809

    Article  CAS  Google Scholar 

  27. Fitzgerald JE, Jha AK, Colubri A, Sosnick TR, Freed KF: Reduced C-beta statistical potentials can outperform all-atom potentials in decoy identification. Protein Sci 2007, 16(10):2123–2139. 10.1110/ps.072939707

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  28. Rajgaria R, McAllister SR, Floudas CA: A novel high resolution C-alpha-C-alpha distance dependent force field based on a high quality decoy set. Proteins-Structure Function and Bioinformatics 2006, 65(3):726–741. 10.1002/prot.21149

    Article  CAS  Google Scholar 

  29. Hinds DA, Levitt M: A Lattice Model for Protein-Structure Prediction at Low Resolution. P Natl Acad Sci USA 1992, 89(7):2536–2540. 10.1073/pnas.89.7.2536

    Article  CAS  Google Scholar 

  30. Zhang C, Liu S, Zhou HY, Zhou YQ: An accurate, residue-level, pair potential of mean force for folding and binding based on the distance-scaled, ideal-gas reference state. Protein Sci 2004, 13(2):400–411. 10.1110/ps.03348304

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  31. Bahar I, Jernigan RL: Inter-residue potentials in globular proteins and the dominance of highly specific hydrophilic interactions at close separation. J Mol Biol 1997, 266(1):195–214. 10.1006/jmbi.1996.0758

    Article  CAS  PubMed  Google Scholar 

  32. Zhang C, Kim SH: Environment-dependent residue contact energies for proteins. P Natl Acad Sci USA 2000, 97(6):2550–2555. 10.1073/pnas.040573597

    Article  CAS  Google Scholar 

  33. Rohl CA, Strauss CEM, Misura KMS, Baker D: Protein structure prediction using rosetta. Method Enzymol 2004, 383: 66–93.

    Article  CAS  Google Scholar 

  34. Samudrala R, Levitt M: Decoys 'R' Us: A database of incorrect conformations to improve protein structure prediction. Protein Sci 2000, 9(7):1399–1401. 10.1110/ps.9.7.1399

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  35. Kim DE, Chivian D, Baker D: Protein structure prediction and analysis using the Robetta server. Nucleic Acids Res 2004, 32: W526-W531. 10.1093/nar/gkh468

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  36. Park B, Levitt M: Energy functions that discriminate X-ray and near-native folds from well-constructed decoys. J Mol Biol 1996, 258(2):367–392. 10.1006/jmbi.1996.0256

    Article  CAS  PubMed  Google Scholar 

  37. Tobi D, Elber R: Distance-dependent, pair potential for protein folding: Results from linear optimization. Proteins-Structure Function and Genetics 2000, 41(1):40–46. 10.1002/1097-0134(20001001)41:1<40::AID-PROT70>3.0.CO;2-U

    Article  CAS  Google Scholar 

  38. Kortemme T, Morozov AV, Baker D: An orientation-dependent hydrogen bonding potential improves prediction of specificity and structure for proteins and protein-protein complexes. J Mol Biol 2003, 326(4):1239–1259. 10.1016/S0022-2836(03)00021-4

    Article  CAS  PubMed  Google Scholar 

  39. Cohen M, Potapov V, Schreiber G: Four Distances between Pairs of Amino Acids Provide a Precise Description of their Interaction. PLoS Comp Biol 2009, 5(8):e1000470. 10.1371/journal.pcbi.1000470

    Article  Google Scholar 

  40. Wang GL, Dunbrack RL: PISCES: a protein sequence culling server. Bioinformatics 2003, 19(12):1589–1591. 10.1093/bioinformatics/btg224

    Article  CAS  PubMed  Google Scholar 

  41. Bower MJ, Cohen FE, Dunbrack RL: Prediction of protein side-chain rotamers from a backbone-dependent rotamer library: A new homology modeling tool. J Mol Biol 1997, 267(5):1268–1282. 10.1006/jmbi.1997.0926

    Article  CAS  PubMed  Google Scholar 

  42. Sippl MJ: Calculation of Conformational Ensembles from Potentials of Mean Force - an Approach to the Knowledge-Based Prediction of Local Structures in Globular-Proteins. J Mol Biol 1990, 213(4):859–883. 10.1016/S0022-2836(05)80269-4

    Article  CAS  PubMed  Google Scholar 

  43. Jones DT: Protein secondary structure prediction based on position-specific scoring matrices. J Mol Biol 1999, 292(2):195–202. 10.1006/jmbi.1999.3091

    Article  CAS  PubMed  Google Scholar 

  44. Kabsch W, Sander C: Dictionary of protein secondary structure: pattern recognition of hydrogen-bonded and geometrical features. Biopolymers 1983, 22(12):2577–2637. 10.1002/bip.360221211

    Article  CAS  PubMed  Google Scholar 

  45. Altschul SF, Madden TL, Schaffer AA, Zhang JH, Zhang Z, Miller W, Lipman DJ: Gapped BLAST and PSI-BLAST: a new generation of protein database search programs. Nucleic Acids Res 1997, 25(17):3389–3402. 10.1093/nar/25.17.3389

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  46. Zhang Y, Skolnick J: SPICKER: A clustering approach to identify near-native protein folds. J Comput Chem 2004, 25(6):865–871. 10.1002/jcc.20011

    Article  CAS  PubMed  Google Scholar 

  47. Zhang Y, Skolnick J: Scoring function for automated assessment of protein structure template quality. Proteins-Structure Function and Bioinformatics 2004, 57(4):702–710. 10.1002/prot.20264

    Article  CAS  Google Scholar 

  48. Humphrey W, Dalke A, Schulten K: VMD: visual molecular dynamics. J Mol Graph 1996, 14(1):33–38. 27–38 27-38 10.1016/0263-7855(96)00018-5

    Article  CAS  PubMed  Google Scholar 

Download references


We thank the members of Jiang lab for discussions. This study was supported by the Bai Ren Project of Chinese Academy of Sciences and grants from the Chinese Ministry of Science and Technology, the National Science and Technology Key Project (2008ZX10004-013) and Project 973 (2009CB918503) to TJ. The results described in this paper are obtained on the Deepcomp7000 of Supercomputing Center, Computer Network Information Center of Chinese Academy of Sciences. The authors would like to thank Mr. Yoshihide Makino for providing the data of DFMAC potential. The source codes and parameter files of NCACO-score can be downloaded free for academic use from

Author information

Authors and Affiliations


Corresponding author

Correspondence to Taijiao Jiang.

Additional information

Authors' contributions

LT, AW and TJ designed the research. LT and AW carried out the study. LT and TJ drafted the manuscript. All authors contributed to the discussion and helped to draft the manuscript. All authors have read and approved the final manuscript.

Liqing Tian, Aiping Wu contributed equally to this work.

Electronic supplementary material


Additional file 1:Cross-validation of decoy discrimination for NCACO-score on Decoys'R'Us sets. In order to estimate the accuracy of the decoy discrimination for NCACO-score in practice, a 4-fold cross-validation was performed on the 32 proteins of Decoys'R'Us sets. These proteins were divided into four fold for average. The detail group information of the four sets including training set (24 proteins) and testing set (8 proteins) can be seen (Table S2 to Table S5), and the weights of NCACO-score for each sets were optimized by the training set. (DOC 343 KB)


Additional file 2:Test of NCACO-score in discriminating near-native decoys generated by fragment replacement. In order to test whether NCACO-score is able to discriminate near-native decoys, we created a near-native decoy set by fragment replacement method. The decoy set contained 87 proteins, and each protein had 189 ~ 269 decoy structures with a TM-score of 0.6 ~ 0.9 relative to the native structure. Table S1 shows the performance of single terms and the total scoring function of NCACO-score on the near-native decoy set. (DOC 292 KB)

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Authors’ original file for figure 3

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Tian, L., Wu, A., Cao, Y. et al. NCACO-score: An effective main-chain dependent scoring function for structure modeling. BMC Bioinformatics 12, 208 (2011).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: