The MULTICOM toolbox for protein structure prediction

  • Jianlin Cheng1, 2, 3Email author,

    Affiliated with

    • Jilong Li1,

      Affiliated with

      • Zheng Wang1,

        Affiliated with

        • Jesse Eickholt1 and

          Affiliated with

          • Xin Deng1

            Affiliated with

            BMC Bioinformatics201213:65

            DOI: 10.1186/1471-2105-13-65

            Received: 20 January 2012

            Accepted: 30 April 2012

            Published: 30 April 2012

            Abstract

            Background

            As genome sequencing is becoming routine in biomedical research, the total number of protein sequences is increasing exponentially, recently reaching over 108 million. However, only a tiny portion of these proteins (i.e. ~75,000 or < 0.07%) have solved tertiary structures determined by experimental techniques. The gap between protein sequence and structure continues to enlarge rapidly as the throughput of genome sequencing techniques is much higher than that of protein structure determination techniques. Computational software tools for predicting protein structure and structural features from protein sequences are crucial to make use of this vast repository of protein resources.

            Results

            To meet the need, we have developed a comprehensive MULTICOM toolbox consisting of a set of protein structure and structural feature prediction tools. These tools include secondary structure prediction, solvent accessibility prediction, disorder region prediction, domain boundary prediction, contact map prediction, disulfide bond prediction, beta-sheet topology prediction, fold recognition, multiple template combination and alignment, template-based tertiary structure modeling, protein model quality assessment, and mutation stability prediction.

            Conclusions

            These tools have been rigorously tested by many users in the last several years and/or during the last three rounds of the Critical Assessment of Techniques for Protein Structure Prediction (CASP7-9) from 2006 to 2010, achieving state-of-the-art or near performance. In order to facilitate bioinformatics research and technological development in the field, we have made the MULTICOM toolbox freely available as web services and/or software packages for academic use and scientific research. It is available at http://​sysbio.​rnet.​missouri.​edu/​multicom_​toolbox/​.

            Keywords

            Protein structure prediction Bioinformatics tool Secondary structure Solvent accessibility Domain Contact map Tertiary structure Protein model quality assessment Fold recognition Protein disorder

            Background

            The central dogma of protein science is that protein sequence specifies protein structure; and protein structure determines protein function. Therefore, understanding protein structure is crucial for elucidating protein function and has fundamental significance in biomedical sciences including protein function analysis, protein design, protein engineering, genome annotation, and drug design. Since the experimental determination of the first two protein structures - myoglobin and haemoglobin - using X-ray crystallography [1, 2], the structures of more and more proteins have been solved by either X-ray crystallography or Nuclear Magnetic Resonance (NMR) techniques. Currently, there are about 75,000 protein sequences with determined structures deposited in the Protein Data Bank (PDB), which account for about 0.07% of the total known protein sequences (i.e. > 108 million). With the exponential growth of protein sequences with unsolved structures produced by various high-throughput, next generation sequencing techniques, predicting protein structure from sequence, which is critical for filling the sequence-structure gap [3], has become one of the most fundamental problems in structural bioinformatics and genomics. Accurate high-throughput protein structure prediction tools are urgently needed for both scientific research as well as the bio-tech industry. These tools will also fulfill a very important and major goal of the structural genomics project, namely to provide a rather complete set of experimentally determined structures for predicting the structure of about 99.9% of proteins with unsolved structures [3].

            The protein structure prediction problem is usually decomposed and attacked from the three different dimensional levels: 1D structure prediction, 2D structure prediction, and 3D structure prediction [4]. One-dimensional (1D) structure prediction is the prediction of protein structural features such as secondary structures, solvent accessibilities, disordered residues or domain boundaries along one-dimensional sequences. Since 1D prediction is usually the first step to obtain protein structure, the largest number of methods and tools had been developed for it, such as Porter [5], SAM [6], SSpro [7, 8], PSIPRED [9], SABLE [1013], YASSPP [14], Jpred [15], PREDATOR [1618], and GOR [19] for secondary structure prediction; NetSurfP [20], ACCpro [7, 21] and Real-SPINE [22] for solvent accessibility prediction; PONDR [23, 24], MFDp [25], DISOPRED [26], SPINE-D [27], PrDOS [28], Spritz [8], POODLE [2931], IUPRred [32, 33], DISOclust [34], and IntFOLD-DR [35] for disorder prediction; DomPred [36], DomSVR [37], PPRODO [38], CHOPnet [39], DoBo [40] and SSEP-Domain [41] for domain boundary prediction; and PredictProtein [42], Distill [43], and SCRATCH [7] for all four kinds of 1D predictions.

            Two-dimensional (2D) structure prediction is to predict the spatial relationships (e.g., residue-residue contacts, disulfide bonds, or beta-residue pairings) of two residues. 2D prediction is a challenging and increasingly important problem [44]. Some methods and tools for 2D prediction are PROFcon [45], Distill [43], TMHcon [46], DiANNA [47], GDAP [48], CYSPRED [49], BETAWRAP [50], SVM-BetaPred [44], BETTY [51], ProC_S3 [52], FragHMMent [53], SVMSEQ [54], and SAM [55].

            Three-dimensional (3D) structure prediction is to predict the 3D coordinates of each residue [5661], which is the ultimate goal of structure prediction. Some popular tools are I-TASSER [6264], MODELLER [65, 66], HHpred [67], QUARK [68], chunk-TASSER [69], Rosetta [61], Pcons-net [70], SAM [71], Raptor-X [72], SparksX [73], and MULTICOM. 1D, 2D, and 3D protein structure prediction methods are routinely evaluated in the Critical Assessment of Techniques for Protein Structure Prediction (CASP) [74] - a community-wide experiment for blind protein structure prediction that has been held every two years since 1994. CASP experiments have driven the development of protein structure prediction methods by objectively assessing the state of the art of the most active and imperative protein structure prediction problems. The last two CASPs (CASP8, 2008 and CASP9, 2010) [75] focused on trying to solve the most pressing structure prediction problems: disorder region prediction (1D) [76], residue-residue contact prediction (2D) [77], protein tertiary structure prediction (3D) [7880], evaluation of 3D models [8187], and protein model refinement [74, 88, 89].

            During the last several years, we have developed a series of tools for predicting protein structure and structural features at the 1D, 2D, and 3D levels, including secondary structure prediction, solvent accessibility prediction, disorder region prediction, domain boundary prediction, contact map prediction, disulfide bond prediction, beta-sheet topology prediction, protein fold recognition, multiple template combination and alignment, protein tertiary structure modeling, protein model quality assessment, and mutation stability prediction. Most of these tools have been rigorously tested by many users in the last several years and/or during the last three rounds of the Critical Assessment of Techniques for Protein Structure Prediction (CASP7-9) achieving state-of-the-art or near performance. In order to facilitate bioinformatics research and technological development in the field, we have incorporated updates and improvements accumulated over years into these tools and packed them together into one single comprehensive MULTICOM toolbox equipped with tutorials, documentation, software executables, some source code, web service, and online mailing list for technical support.

            The organization of the MULTICOM toolbox is shown in Figure 1. The 1D protein structure prediction tools are comprised of PSpro for the prediction of secondary structure and relative solvent accessibility, PreDisorder for disordered residue prediction, and DoBo for domain boundary prediction. The 2D protein structure prediction tools include SVMcon and NNcon for residue-residue contact prediction, DIpro for disulfide bond prediction, and BETApro for beta-sheet pairing prediction. The 3D protein structure prediction tools are comprised of MULTICOM for tertiary structure prediction and APOLLO for protein model quality assessment. The MULTICOM toolbox also contains several other protein bioinformatics tools including SeqRate for protein folding rate prediction, MUpro for the prediction of stability changes caused by single-residue mutation, MSACompro for multiple protein sequence alignment, and HMMEditor for visualization of protein Hidden Markov models. The entire MULTICOM toolbox is freely available for academic use and scientific research at http://​sysbio.​rnet.​missouri.​edu/​multicom_​toolbox/​. Users may download and install most of the tools locally or access them through web services.
            http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-65/MediaObjects/12859_2012_5269_Fig1_HTML.jpg
            Figure 1

            The organization of the MULTICOM toolbox.

            Methods and benchmarks

            1D structure prediction tools

            PSpro2.0 for secondary structure and relative solvent accessibility prediction

            PSpro2.0 is an improved and combined version of the popular tools SSpro/ACCpro 4 [7, 8, 21] for the prediction of protein secondary structure and relative solvent accessibility. It integrates both homology-based and ab initio methods to make predictions. The ab initio approach uses a 1-D recursive neural networks (1D-RNN) [7, 90] and takes the profile of a query protein sequence as input to predict its secondary structures (i.e. helix, strand, and loop) or relative solvent accessibility (i.e. exposed and buried) at 20 different exposure thresholds (i.e. 0%, 5%, 10%, …, 95%). The sequence profile was generated by using PSI-BLAST to search the query sequence against a Non-Redundant protein (NR) sequence database, which has been updated to the most recent version. The PSpro2.0 allows users to plug in any version of the NR database of their choice.

            The homology-based method in PSpro2.0 is called to make predictions if a significant homologous template protein can be found for a query protein in the Protein Data Bank (PDB) [91]. The homology-based method uses BLAST to search the query sequence against a locally compiled version of the PDB database to identify homologous hits. Information regarding the alignment between the query and the most significant hit, including the alignment e-value, the number of amino acids aligned, number of gaps, sequence identity, is gathered and used by a linear regression function to predict the accuracy of transferring the secondary structure and solvent accessibility of the hit to the query protein. The linear regression function was trained on a set of query-template alignments with known alignment information and transferring accuracy. If the predicted transferring accuracy is > = 0.82 for secondary structure (resp. > = 0.80 for relative solvent accessibility), the secondary structure (resp. relative solvent accessibility) is transferred from the hit to the query as predictions. Otherwise, ab initio predictions will be used. The combination of the ab initio method and homology-based method can automatically apply the most appropriate method for the query proteins having or not having significant homology with a known protein structure in order to improve the prediction performance. In order to take advantage of abundant new protein structures in the PDB, PSpro2.0 uses an updated local version of the PDB database comprised of 62,607 proteins. The new local PDB database is a few times larger than the old one used with SSpro/ACCpro 4 which had 22,064 proteins.

            We benchmarked PSpro2.0 on the protein targets of the last two Critical Assessments of Techniques for Protein Structure Prediction (CASP8 in 2008 and CASP9 in 2010). The CASP datasets were chosen because of their wide adoption in the field, their balance of easy (homology-based) and hard (ab initio or weak homology) targets, and their relatively large size. When the homology-based method was tested, the target proteins in the CASP8 and CASP9 data sets were removed from the local PDB database in order to avoid using themselves to make predictions. 100 CASP9 targets and 119 CASP8 targets that were not present in the local PDB database were used in this test.

            Table 1 reports the accuracy of secondary structure prediction and relative solvent accessibility prediction at a 25% threshold for both the combined method and the ab initio method alone. Here the accuracy is defined simply as the percent of correct predictions, i.e. the standard Q3 score for three-category secondary structure prediction, and the Q2 score for two-category relative solvent accessibility prediction. The results show that the accuracy of secondary structure prediction and relative solvent accessibility prediction of the combined method is in the range [80.8%, 83.3%] and [74.6%, 77.5%], respectively, higher than [76.6%, 77.7%] and [74.2%, 75.9%] of the ab initio method. Using homology prediction seems to improve secondary structure prediction more than relative solvent accessibility prediction. Combining homology and ab initio approaches seems to improve secondary structure prediction more than solvent accessibility prediction.
            Table 1

            The accuracy of the prediction of secondary structure (SS) and relative solvent accessibility (SA) on 100 CASP9 targets and 119 CASP8 targets, respectively

             

            both ab initio and homology

            ab initio alone

            Dataset

            SS

            SA

            SS

            SA

            CASP8

            83.30%

            77.50%

            77.73%

            75.94%

            CASP9

            80.78%

            74.56%

            76.60%

            74.20%

            PreDisorder1.1 for protein disorder prediction

            PreDisorder1.1 is an efficient and reliable ab initio prediction tool for protein disorder regions on the genomic scale. PreDisorder uses only sequence-related information in conjunction with neural networks to predict the disorder probability of each residue of a protein sequence. The earlier and most recent versions of PreDisorder had been consistently ranked as one of the top protein disorder predictors in the last three Critical Assessments of Techniques for Protein Structure Prediction (CASP7, 8, 9) in 2006, 2008, and 2010, respectively [92, 93]. Evaluated on 117 CASP8 targets and 117 CASP9 targets separately, PreDisorder yielded an AUC score of 0.86 and 0.82, respectively [92, 93]. AUC score represents the area under the Receiver Operating Characteristic (ROC) curve (true positive rates versus false positive rates) of disorder predictions. Considering different methods may use different criteria to set a probability threshold to make order/disorder decisions, we also calculated the break-even score and its corresponding decision threshold on predicted disorder probabilities. The break-even score is the value at which the sensitivity (i.e. recall) and specificity (i.e. precision) of disorder predictions are equal. The break-even scores on the CASP8 and CASP9 dataset are in the range [0.45, 0.56] using a probability threshold of around 0.5. Figures 2 and 3 illustrate the plots of sensitivity versus specificity over a varying decision threshold from 0.1 to 0.9 at step of 0.005 on the CASP8 and CASP9 data sets, respectively. The intersections in the figures denote the break-even points/scores.
            http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-65/MediaObjects/12859_2012_5269_Fig2_HTML.jpg
            Figure 2

            The plot of sensitivity and specificity (y axis) against different probability thresholds of classifying residues as disordered residues on CASP8 targets.

            http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-65/MediaObjects/12859_2012_5269_Fig3_HTML.jpg
            Figure 3

            The plot of sensitivity and specificity (y axis) against different probability thresholds of classifying residues as disordered residues on CASP9 targets.

            DoBo for protein domain boundary prediction

            Protein domain boundary prediction is often used as a means to decompose the modeling of a large, multi-domain protein in to smaller, more manageable pieces. In order for such a technique to be applicable to hard, free modeling targets it should not rely extensively on templates or known structures to delineate protein domain boundaries. DoBo [40] is the sequence based protein domain boundary predictor we have developed and included in the MULTICOM toolbox. It leverages evolutionary information contained in multiple sequence alignments to identify potential domain boundary sites. These candidate sites are then classified using a support vector machine. Predicted domain boundary sites are finally scored and a confidence value provided.

            We recently evaluated DoBo on 14 continuous, multi-domain CASP9 targets [40]. DoBo is able to recall 70% of the domain boundaries, which occur at least 40 residues from the N or C terminal end of the sequence. The precision of the domain boundary prediction is 49%. Here, a domain boundary prediction is considered correct if it occurs within 20 residues of a true domain boundary. Furthermore, on a large benchmark dataset using a 10 fold cross validation procedure, DoBo achieves a break-even point of 60% (ie, precision equals recall) for domain boundary predictions [40].

            2D structure prediction tools

            NNcon and SVMcon for general residue-residue contact prediction

            Residue-residue contact prediction continues to be an area of active research and becoming of greater importance in the latest rounds of CASP. Of particular importance to tertiary structure prediction are sequence based (ie ab-initio) contact prediction methods and recent work by Wu et al. has shown that predicted contact information can be used to significantly improve predictions for free modeling targets [94]. The MULTICOM toolbox contains two general residue-residue contact predictors – NNCon [95] and SVMcon [96]. NNcon [95] is a sequence-based, ab initio method to predict intra-chain protein residue-residue contacts. NNcon uses a set of two-dimensional (2D) recursive neural network ensembles [90] which predict the probability that the distance between any two residues are below a threshold (i.e. in contact). Features used for each residue include a sequence profile, secondary structure and solvent accessibility.

            SVMcon [96] is an ab initio method based on a support vector machine (SVM). For each residue pair, a set of features including secondary structure, solvent accessibility and a sequence profile is encoded for a 9-residue window centered on each residue. This feature vector is fed into a SVM trained on a large dataset which classifies the residue-residue pair.

            Both of our predictors participated in the most recent rounds of CASP (CASP8 and CASP9) and ranked among the top residue-residue contact predictors [97]. As an additional assessment, we evaluated both NNcon and SVMcon on all CASP9 targets. Table 2 shows the accuracy for medium and long range predicted contacts. Here, two amino acid residues are said to be in contact if the distance between their Cβ atoms (Cα for glycine) in the experimental structure is less than 8 Å. Long range contacts are defined as residues in contact whose separation in the sequence is greater than or equal to 24 residues. Medium range contacts are defined by interacting residues which are 12 to 23 residues apart in the sequence. These definitions were used in accordance with previous studies and CASP residue-residue contact assessments [97, 98]. A common evaluation metric for residue-residue contact predictions is the accuracy of the top L/5 or L/10 predictions where L is the length of the protein in residues and the predictions are ranked using a score provided for each prediction. Accuracy is defined as the number of correctly predicted residue-residue contacts divided by the total number of contact predictions considered. For medium range contacts, NNcon and SVMcon are capable of achieving accuracies at or above 35% when considering the top L/10 predictions and accuracies near 31% when considering the top L/5 predictions. For long range contacts, SVMcon performed notably better on the CASP9 targets with accuracies of 27% and 24% for the top L/10 and L/5 predictions, respectively, while NNcon obtained accuracies of 21% and 18%.
            Table 2

            Accuracy for NNcon and SVMcon contact predictions on all CASP9 targets

            Predictor

            medium range contacts (12 < = seq. separation < 24)

            long range contacts (seq. separation > = 24)

            top L/10

            top L/5

            top L/10

            top L/5

            top L

            SVMcon

            .35

            .32

            .27

            .24

            .14

            NNcon

            .36

            .31

            .21

            .18

            .11

            DIpro2.0 for protein disulfide bond prediction

            DIpro2.0 is a tool that uses kernel methods, two-dimensional recursive neural networks, and weighted graph matching for large-scale protein disulfide bridge prediction [99, 100]. Given a protein sequence, it can predict if a cysteine in the protein participates in a disulfide bond and how bonding cysteines are connected. The method can handle proteins with arbitrary number of disulfide bonds. Benchmarked on a large disulfide bond data set [99], the specificity and sensitivity of classifying individual residues as bonded or non-bonded are 87% and 89%, respectively, and the accuracy of overall disulfide connectivity pattern prediction is 51%. Some other disulfide bond prediction tools are DiANNA [47], GDAP [48], and CYSPRED [49].

            BETApro1.0 for protein beta-sheet structure prediction

            BETApro1.0 integrates two-dimensional recursive neural networks and graph algorithms with protein sequence profiles and predicted structural features (e.g. secondary structure and relative solvent accessibility) to predict specific beta residue pairs, beta strand pairs, strand alignments, strand pairing direction, and beta-sheet topology for beta sheets in a protein [101]. BETApro1.0 was evaluated on a large dataset using different standard measures [101]. At the break-even point, the specificity and sensitivity of beta-residue pairing predictions is 41%. At 59% specificity, the sensitivity of beta strand pairing predictions is 54%. Some other beta-sheet prediction tools are BETAWRAP [50], SVM-BetaPred [44], and BETTY [51].

            3D structure prediction and evaluation tools

            MULTICOM for tertiary structure prediction

            MULTICOM [102], an automated multi-level combination method, combines complementary and alternative templates, alignments, and models to predict protein tertiary structures. Several implementations of this approach with minor differences were tested in the last two Critical Assessments of Techniques for Protein Structure Predictions (CASP8 and CASP9) in 2008 and 2010, respectively [102]. One significant improvement on multi-template combination benchmarked in CASP9 is to check the structural consistency between multiple template candidates. This procedure avoids potential atom clashes caused by conflicting structural conformations from inconsistent templates. The structural similarity of a pair of query-template alignments was checked by comparing the structures of two templates after they are aligned to the same regions of the query using TM-Align [103]. Only structurally similar query-template alignments are combined. Both MULTICOM-server and MULTICOM-human predictors were ranked among the best in CASP8 and CASP9.

            Table 3 illustrates the evaluation results of one MULTICOM server predictor and one MULTICOM human predictor. The evaluation was conducted on 107 CASP9 targets, whose native structures were downloaded from the Protein Data Bank [104]. We used TM-Score [103] to compare predicted models with native structures to calculate their similarity scores in terms of both GDT-TS score [105] and TM-Score [103]. GDT-TS scores or TM-Scores are in the range [0, 100], where 0 means completely different and 100 exactly the same. Generally, a TM-Score of 50 indicates a reasonable model with largely correctly predicted topology and a score greater than 80 is a high-quality model. On average, the GDT-TS score and TM-Score of the first MULTICOM server models are 59.28 and 66.76, respectively, indicating the average quality of server models is good. The average score of MULTICOM-server models is 2–4 points lower than MULTICOM-human’s, one of the best CASP9 human predictors that made predictions by exploring the entire CASP9 model pool. This suggests that the automatically generated MULTICOM-server predictions are approaching the best performance among CASP9 models. Figure 4 shows good-quality models predicted by MULTICOM-server on four CASP9 targets.
            Table 3

            The average GDT-TS and TM scores of top-one and best-of-five models of MULTICOM predictors on 107 CASP9 targets

            Predictor

            First Model

            Best of Five

            GDT-TS

            TM-Score

            GDT-TS

            TM-Score

            MULTICOM (human)

            63.14

            70.53

            64.41

            71.85

            MULTICOM (server)

            59.28

            66.76

            62.02

            69.29

            http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-65/MediaObjects/12859_2012_5269_Fig4_HTML.jpg
            Figure 4

            Superimpositions of predicted models (blue) and native structures (orange) of four CASP9 targets. (A) T0520, TM-Score = 85, (B) T0527, TM-Score = 74, (C) T0634, TM-Score = 88, (D) T0641, TM-Score = 91.

            APOLLO for protein model quality assessment

            APOLLO is a software package that can predict global and residue-specific qualities of individual or multiple protein models without knowing native structures [106]. For an individual model, APOLLO uses a machine learning method (support vector machine) to predict its absolute global [107] and residue-specific qualities [106]. The absolute global quality of a model is the overall structural similarity between the model and its native structure in terms of GDT-TS score, whereas the absolute residue-specific qualities are the structural deviations at each residue position in terms of Angstrom (Å). The features used in the machine learning algorithm include amino acid sequence and the differences between predicted (predicted from amino acid sequence) and parsed (parsed from protein model) secondary structures, solvent accessibilities, and residue-residue contact probabilities. For multiple models, APOLLO uses a pair-wise comparison method to predict their relative global qualities [108]. This algorithm performs a full pair-wise comparison of each model against all the others by the structural alignment program TM-Score [103]; and the average structural similarity scores are used as the predicted global qualities. APOLLO also employs a hybrid approach to refine absolute quality scores. It selects the top five models ranked by initial quality scores as reference models and then superimposes every model with each of the reference models by TM-Score [109]. The average GDT-TS score resulted from the superimpositions is used as the predicted global quality.

            We evaluated the APOLLO software package on the models of 107 valid CASP9 targets whose experimental structures were available in the Protein Data Bank [104]. For global quality prediction, the average Pearson’s correlations between predicted and real quality scores of pair-wise, hybrid, and machine learning methods are 0.917, 0.870, and 0.671, respectively [106]. For residue-specific quality prediction, APOLLO has an average error deviation of 2.60 and 3.18 Å on the residues whose actual distances to the native are < = 10 and 20 Å, respectively [106].

            Other protein bioinformatics tools

            MUpro1.0 for protein mutation stability prediction

            MUpro1.0 [110] is a tool using support vector machines to predict protein stability changes for single amino acid mutations. It can predict the amount of the energy change caused by an amino acid mutation from a protein sequence, a protein structure, or both. MUpro1.0 was evaluated on a large dataset of single amino acid mutations [110]. It predicted the direction (positive versus negative) of the mutation-induced energy changes at 84% accuracy. The method can also reliably predict the absolute value of an energy change. Some mutation stability prediction tools are PoPMuSiC [111], SDM [112], I-Mutant2.0 [113], and CUPSAT [114].

            SeqRate for protein folding rate prediction

            SeqRate [115] is a sequence-based tool for large-scale protein folding rate prediction. It uses a Support Vector Machine regression method with a set of features derived from protein sequences alone to make predictions. The tool can predict both folding kinetic types and real-value folding rates. The folding kinetic type prediction accuracy of SeqRate on a standard benchmark is 80% [115].

            MSACompro1.2.0 for protein multiple sequence alignment with predicted structural features

            MSACompro1.2.0 [116] is a new tool that integrates predicted secondary structure, solvent accessibility, and contact map information with protein sequences to improve protein multiple sequence alignment. MSACompro1.2.0 was evaluated on the BAliBASE 3.0 datasets [117], yielding an average alignment Sum of Pair score (SP score) of 88.85 and the average alignment True Column score (TC score) of 61.31. The results showed that incorporating protein structural features into multiple sequence alignment improves alignment accuracy over existing tools without using structural features.

            HMMEditor for visualization of hidden Markov models of protein sequence family

            HMMEditor [118] is a visual, interactive editor for visualizing and manipulating profile Hidden Markov Models of a protein family. It provides a series of functions to visualize the profile HMM architecture, transition probabilities, and emission probabilities. It also allows users to align a sequence against the profile HMM and visualize the corresponding Viterbi path.

            Software packages, web services, documentation, and user support

            Most tools in the MULTICOM toolbox are available as both downloadable software packages and online web services at the one-stop web site http://​sysbio.​rnet.​missouri.​edu/​multicom_​toolbox/​ (Figure 5). Some tools that are only available as web services will be released as software packages in the near future. The documentation and relevant publications of these tools are also available at the same web site. Table 4 summarizes the availability and running environment of the MULTICOM tools.
            http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-65/MediaObjects/12859_2012_5269_Fig5_HTML.jpg
            Figure 5

            The MULTICOM toolbox web site.

            Table 4

            The availability and running environment of the MULTICOM tools

            Tools

            Software Package

            Source Code

            Web Service

            Platform

            Documentation

            PSpro2.0

            Yes

            Yes

            Yes

            Linux, Browser

            PDF, HTML

            PreDisorder1.1

            Yes

            Yes

            Yes

            Linux, Browser

            PDF, HTML

            DoBo

              

            Yes

            Browser

            PDF, HTML

            NNCon

            Yes

             

            Yes

            Linux, Browser

            PDF, HTML

            SVMcon

            Yes

             

            Yes

            Linux, Browser

            PDF, HTML

            DIpro2.0

            Yes

            Yes

             

            Linux

            PDF, HTML

            BETApro1.0

            Yes

            Yes

            Yes

            Linux, Browser

            PDF, HTML

            MULTICOM

              

            Yes

            Browser

            PDF, HTML

            APOLLO

            Yes

            Yes

            Yes

            Linux, Browser

            PDF, HTML

            MUpro1.0

            Yes

            Yes

            Yes

            Linux, Browser

            PDF, HTML

            SeqRate

            Yes

             

            Yes

            Linux, Browser

            PDF, HTML

            MSACompro1.2.0

            Yes

              

            Linux

            PDF, HTML

            HMMEditor

            Yes

             

            Yes

            Linux, Browser, Unix, Windows

            PDF, HTML

            The MULTICOM toolbox has been implemented in different programming languages including C++, Java, and Perl. The tools have been extensively tested on the Linux platform. We expect to gradually release some standalone tools for other popular platforms such as Windows and Mac. Most of the tools in the toolbox are available as online web services, which makes it easy for users to make predictions on a small scale without a need to install the software. The web interface is generally simple and intuitive and requires a minimum amount of information from the user. The results may be sent to users by email or be presented in the browser. Most tools are also available as software packages that can be downloaded by users for large-scale prediction or other purposes. In general, installing these tools is straightforward and often only requires unzipping the software, setting a few paths in a configuration file, and running a configuration script. The package of each tool includes a readme file that contains both installation instructions and a quick guide on using the tool. One or more test examples with expected results are often provided with the package for users to test an installation.

            In order to facilitate the use of the tools, the user manuals for these tools have been developed in PDF and HTML format and are available at the MULTICOM web site. The user manuals usually include step-by-step installation instructions, application examples, references to more technical documents, and frequently asked questions (FAQ) and solutions. In order to better serve users and gather community feedback to improve the toolbox, a mailing list is created. After subscribing the MULTICOM mailing list (multicom_toolbox@googlegroups.com), a user can post a message to the mailing list and view the collection of all prior postings. The technical support of the MULTICOM toolbox regularly reads the message postings and answers questions. Collected improvements will be released in future versions of the toolbox.

            Conclusion

            We developed a comprehensive MULTICOM toolbox consisting of a number of protein structure and structural feature prediction tools. These tools have been extensively tested and used internally and externally during the last several years yielding good performance. All the tools are freely available as software packages and/or online web services for academic use and scientific research at the MULTICOM web site. This makes them useful for large-scale annotation of structure and function of vast protein sequence resources generated in the genomic era. In the future, we will continue to improve the performance, usability, and documentation of these tools, make them available to more platforms (e.g. Windows and Mac), and add new protein structure and function prediction tools into the toolbox. Improvements and new developments will be released on the MULTICOM toolbox web site.

            Declarations

            Acknowledgements

            The work is partially supported by a NIH grant (5R01GM093123) to JC, a NLM fellowship to JE, and a Shumaker fellowship to ZW.

            Authors’ Affiliations

            (1)
            Department of Computer Science, University of Missouri-Columbia
            (2)
            Informatics Institute, University of Missouri-Columbia
            (3)
            C. Bond Life Science Center, University of Missouri-Columbia

            References

            1. Kendrew J, Dickerson R, Strandberg B, Hart R, Davies D, Phillips D, Shore V: Structure of myoglobin: a three-dimensional Fourier synthesis at 2å resolution. Nature 1960,185(4711):422–427.PubMedView Article
            2. Perutz M, Rossmann M, Cullis A, Muirhead H, Will G, North A: Structure of haemoglobin: a three-dimensional Fourier synthesis at 5.5å resolution, obtained by X-ray analysis. Nature 1960,185(4711):416–422.PubMedView Article
            3. Fox BG, Goulding C, Malkowski MG, Stewart L, Deacon A: Structural genomics: from genes to structures with valuable materials and many questions in between. Nat Methods 2008,5(2):129–132.PubMedView Article
            4. Rost B, Liu J, Przybylski D, Nair R, Wrzeszczynski KO, Bigelow H, Ofran Y: Prediction of protein structure through evolution. Handbook of Chemoinformatics 2003,:1789–1811.
            5. Pollastri G, Mclysaght A: Porter: a new, accurate server for protein secondary structure prediction. Bioinformatics 2005,21(8):1719–1720.PubMedView Article
            6. Karplus K, Karchin R, Draper J, Casper J, Mandel-Gutfreund Y, Diekhans M, Hughey R: Combining local-structure, fold-recognition, and new fold methods for protein structure prediction. Proteins: Structure, Function, and Bioinformatics 2003,53(S6):491–496.View Article
            7. Cheng J, Randall A, Sweredoski M, Baldi P: SCRATCH: a protein structure and structural feature prediction server. Nucleic Acids Res 2005,33(Web Server Issue):W72-W76.PubMedView ArticlePubMed Central
            8. Vullo A, Bortolami O, Pollastri G, Tosatto SCE: Spritz: a server for the prediction of intrinsically disordered regions in protein sequences using kernel machines. Nucleic Acids Res 2006, 34:W164-W168.PubMedView ArticlePubMed Central
            9. McGuffin L, Bryson K, Jones D: The PSIPRED protein structure prediction server. Bioinformatics 2000,16(4):404.PubMedView Article
            10. Adamczak R, Porollo A, Meller J: Accurate prediction of solvent accessibility using neural networks–based regression. Proteins: Structure, Function, and Bioinformatics 2004,56(4):753–767.View Article
            11. Adamczak R, Porollo A, Meller J: Combining prediction of secondary structure and solvent accessibility in proteins. Proteins: Structure, Function, and Bioinformatics 2005,59(3):467–475.View Article
            12. Wagner M, Adamczak R, Porollo A, Meller J: Linear regression models for solvent accessibility prediction in proteins. J Comput Biol 2005,12(3):355–369.PubMedView Article
            13. Porollo A, Adamczak R, Wagner M, Meller J: Maximum feasibility approach for consensus classifiers: Applications to protein structure prediction. 2003, 2003:75–76.
            14. Karypis G: YASSPP: better kernels and coding schemes lead to improvements in protein secondary structure prediction. Proteins: Structure, Function, and Bioinformatics 2006,64(3):575–586.View Article
            15. Cole C, Barber JD, Barton GJ: The Jpred 3 secondary structure prediction server. Nucleic Acids Res 2008,36(suppl 2):W197-W201.PubMedView ArticlePubMed Central
            16. Frishman D, Argos P: Incorporation of long-distance interactions into a secondary structure prediction algorithm. Protein Eng 1996,9(2):133–142.PubMedView Article
            17. Frishman D, Argos P: Knowledge-based protein secondary structure assignment. Proteins: Structure, Function, and Bioinformatics 1995,23(4):566–579.View Article
            18. Kabsch W, Sander C: Dictionary of protein secondary structure: pattern recognition of hydrogen-bonded and geometrical features. Biopolymers 1983,22(12):2577–2637.PubMedView Article
            19. Sen TZ, Jernigan RL, Garnier J, Kloczkowski A: GOR V server for protein secondary structure prediction. Bioinformatics 2005,21(11):2787–2788.PubMedView ArticlePubMed Central
            20. Petersen B, Petersen TN, Andersen P, Nielsen M, Lundegaard C: A generic method for assignment of reliability scores applied to solvent accessibility predictions. BMC Struct Biol 2009,9(1):51.PubMedView ArticlePubMed Central
            21. Pollastri G, Baldi P, Fariselli P, Casadio R: Prediction of coordination number and relative solvent accessibility in proteins. Proteins: Structure, Function, and Bioinformatics 2002,47(2):142–153.View Article
            22. Faraggi E, Xue B, Zhou Y: Improving the prediction accuracy of residue solvent accessibility and real-value backbone torsion angles of proteins by guided-learning through a two-layer neural network. Proteins: Structure, Function, and Bioinformatics 2009,74(4):847–856.View Article
            23. Iakoucheva LM, Kimzey AL, Masselon CD, Bruce JE, Garner EC, Brown CJ, Dunker AK, Smith RD, Ackerman EJ: Identification of intrinsic order and disorder in the DNA repair protein XPA. Protein Sci 2001,10(3):560–571.PubMedView ArticlePubMed Central
            24. Dunker AK, Cortese MS, Romero P, Iakoucheva LM, Uversky VN: Flexible nets. FEBS J 2005,272(20):5129–5148.PubMedView Article
            25. Mizianty MJ, Stach W, Chen K, Kedarisetti KD, Disfani FM, Kurgan L: Improved sequence-based prediction of disordered regions with multilayer fusion of multiple information sources. Bioinformatics 2010,26(18):i489-i496.PubMedView ArticlePubMed Central
            26. Ward JJ, McGuffin LJ, Bryson K, Buxton BF, Jones DT: The DISOPRED server for the prediction of protein disorder. Bioinformatics 2004,20(13):2138–2139.PubMedView Article
            27. Zhang T, Faraggi E, Xue B, Dunker A, Uversky VN, Zhou Y: SPINE-D: Accurate Prediction of Short and Long Disordered Regions by a Single Neural-Network Based Method. J Biomol Struct Dyn 2012,29(4):799–813.PubMedView ArticlePubMed Central
            28. Ishida T, Kinoshita K: PrDOS: prediction of disordered protein regions from amino acid sequence. Nucleic Acids Res 2007,35(suppl 2):W460-W464.PubMedView ArticlePubMed Central
            29. Shimizu K, Hirose S, Noguchi T: POODLE-S: web application for predicting protein disorder by using physicochemical features and reduced amino acid set of a position-specific scoring matrix. Bioinformatics 2007,23(17):2337–2338.PubMedView Article
            30. Hirose S, Shimizu K, Kanai S, Kuroda Y, Noguchi T: POODLE-L: a two-level SVM prediction system for reliably predicting long disordered regions. Bioinformatics 2007,23(16):2046–2053.PubMedView Article
            31. Shimizu K, Muraoka Y, Hirose S, Tomii K, Noguchi T: Predicting mostly disordered proteins by using structure-unknown protein data. BMC Bioinforma 2007,8(1):78.View Article
            32. Dosztányi Z, Csizmok V, Tompa P, Simon I: The pairwise energy content estimated from amino acid composition discriminates between folded and intrinsically unstructured proteins. J Mol Biol 2005,347(4):827–839.PubMedView Article
            33. Dosztányi Z, Csizmok V, Tompa P, Simon I: IUPred: web server for the prediction of intrinsically unstructured regions of proteins based on estimated energy content. Bioinformatics 2005,21(16):3433–3434.PubMedView Article
            34. McGuffin L: The ModFOLD server for the quality assessment of protein structural models. Bioinformatics 2008,24(4):586.PubMedView Article
            35. Roche DB, Buenavista MT, Tetchner SJ, McGuffin LJ: The IntFOLD server: an integrated web resource for protein fold recognition, 3D model quality assessment, intrinsic disorder prediction, domain prediction and ligand binding site prediction. Nucleic Acids Res 2011,39(suppl 2):W171-W176.PubMedView ArticlePubMed Central
            36. Marsden RL, McGuffin LJ, Jones DT: Rapid protein domain assignment from amino acid sequence using predicted secondary structure. Protein Sci 2002,11(12):2814–2824.PubMedView ArticlePubMed Central
            37. Chen P, Liu C, Burge L, Li J, Mohammad M, Southerland W, Gloster C, Wang B: DomSVR: domain boundary prediction with support vector regression from sequence information alone. Amino Acids 2010,39(3):713–726.PubMedView ArticlePubMed Central
            38. Sim J, Kim SY, Lee J: PPRODO: prediction of protein domain boundaries using neural networks. Proteins: Structure, Function, and Bioinformatics 2005,59(3):627–632.View Article
            39. Liu J, Rost B: Sequence-based prediction of protein domains. Nucleic Acids Res 2004,32(12):3522–3530.PubMedView ArticlePubMed Central
            40. Eickholt J, Deng X, Cheng J: DoBo: Protein domain boundary prediction by integrating evolutionary signals and machine learning. BMC Bioinforma 2011, 12:43.View Article
            41. Gewehr JE, Zimmer R: SSEP-Domain: protein domain prediction by alignment of secondary structure elements and profiles. Bioinformatics 2006,22(2):181–187.PubMedView Article
            42. Rost B, Yachdav G, Liu J: The predictprotein server. Nucleic Acids Res 2004,32(suppl 2):W321-W326.PubMedView ArticlePubMed Central
            43. Baú D, Martin A, Mooney C, Vullo A, Walsh I, Pollastri G: Distill: a suite of web servers for the prediction of one-, two-, and three-dimensional structural features of proteins. BMC Bioinforma 2006,7(1):402.View Article
            44. Singh S, Hajela K, Ramani A: SVM-BetaPred: prediction of right-handed ß-helix fold from protein sequence using SVM. Pattern Recognition in Bioinformatics 2007,:108–119.
            45. Punta M, Rost B: PROFcon: novel prediction of long-range contacts. Bioinformatics 2005,21(13):2960–2968.PubMedView Article
            46. Fuchs A, Kirschner A, Frishman D: Prediction of helix–helix contacts and interacting helices in polytopic membrane proteins using neural networks. Proteins: Structure, Function, and Bioinformatics 2009,74(4):857–871.View Article
            47. Ferre F, Clote P: DiANNA: a web server for disulfide connectivity prediction. Nucleic Acids Res 2005,33(suppl 2):W230-W232.PubMedView ArticlePubMed Central
            48. O’Connor BD, Yeates TO: GDAP: a web tool for genome-wide protein disulfide bond prediction. Nucleic Acids Res 2004,32(suppl 2):W360-W364.PubMedView ArticlePubMed Central
            49. Fariselli P, Riccobelli P, Casadio R: Role of evolutionary information in predicting the disulfide-bonding state of cysteine in proteins. Proteins: Structure, Function, and Bioinformatics 1999,36(3):340–346.View Article
            50. Bradley P, Cowen L, Menke M, King J, Berger B: Betawrap: Successful prediction of parallel β-helices from primary sequence reveals an association with many microbial pathogens. Proc Natl Acad Sci 2001,98(26):14819–14824.PubMedView ArticlePubMed Central
            51. Zimmermann O, Wang L, Hansmann UHE: BETTY: Prediction of β-Strand Type from Sequence. In Silico Biol 2007,7(4):535–542.PubMed
            52. Li Y, Fang Y, Fang J: Predicting residue–residue contacts using random forest models. Bioinformatics 2011,27(24):3379–3384.PubMedView Article
            53. Björkholm P, Daniluk P, Kryshtafovych A, Fidelis K, Andersson R, Hvidsten TR: Using multi-data hidden Markov models trained on local neighborhoods of protein structure to predict residue–residue contacts. Bioinformatics 2009,25(10):1264–1270.PubMedView ArticlePubMed Central
            54. Wu S, Zhang Y: A comprehensive assessment of sequence-based and template-based methods for protein contact prediction. Bioinformatics 2008,24(7):924–931.PubMedView ArticlePubMed Central
            55. Shackelford G, Karplus K: Contact prediction using mutual information and neural nets. Proteins: Structure, Function, and Bioinformatics 2007,69(S8):159–164.View Article
            56. Zhang Y, Skolnick J: The protein structure prediction problem could be solved using the current PDB library. Proc Natl Acad Sci 2005,102(4):1029–1034.PubMedView ArticlePubMed Central
            57. Baker D, Sali A: Protein structure prediction and structural genomics. Science 2001,294(5540):93–96.PubMedView Article
            58. Zhang Y: Progress and challenges in protein structure prediction. Curr Opin Struct Biol 2008,18(3):342–348.PubMedView ArticlePubMed Central
            59. Zhou H, Zhou Y: SPEM: improving multiple sequence alignment with sequence profiles and predicted secondary structures. Bioinformatics 2005,21(18):3615–3621.PubMedView Article
            60. Xu J, Li M, Kim D, Xu Y: RAPTOR: optimal protein threading by linear programming. J Bioinforma Comput Biol 2003,1(1):95–117.View Article
            61. Simons K, Kooperberg C, Huang E, Baker D: Assembly of protein tertiary structures from fragments with similar local sequences using simulated annealing and Bayesian scoring functions. J Mol Biol 1997,268(1):209–225.PubMedView Article
            62. Roy A, Kucukural A, Zhang Y: I-TASSER: a unified platform for automated protein structure and function prediction. Nat Protoc 2010,5(4):725–738.PubMedView ArticlePubMed Central
            63. Zhang Y: I-TASSER: Fully automated protein structure prediction in CASP8. Proteins: Structure, Function, and Bioinformatics 2009,77(S9):100–113.View Article
            64. Zhang Y: I-TASSER server for protein 3D structure prediction. BMC Bioinforma 2008,9(1):40.View Article
            65. Šali A, Potterton L, Yuan F, van Vlijmen H, Karplus M: Evaluation of comparative protein modeling by MODELLER. Proteins: Structure, Function, and Bioinformatics 1995,23(3):318–326.View Article
            66. Fiser A, Sali A: Modeller: generation and refinement of homology-based protein structure models. Methods Enzymol 2003, 374:461–491.PubMedView Article
            67. Soding J, Biegert A, Lupas A: The HHpred interactive server for protein homology detection and structure prediction. Nucleic Acids Res 2005,33(Web Server Issue):W244-W248.PubMedView ArticlePubMed Central
            68. Xu D, Zhang Y: Ab initio protein structure assembly using continuous structure fragments and optimized knowledge‐based force field. Proteins: Structure, Function, and Bioinformatics 2012,:-.
            69. Zhou H, Skolnick J: Ab initio protein structure prediction using chunk-TASSER. Biophys J 2007,93(5):1510–1518.PubMedView ArticlePubMed Central
            70. Wallner B, Larsson P, Elofsson A: Pcons. net: protein structure prediction meta server. Nucleic Acids Res 2007,35(suppl 2):W369-W374.PubMedView ArticlePubMed Central
            71. Karplus K, Barrett C, Hughey R: Hidden Markov models for detecting remote protein homologies. Bioinformatics 1998,14(10):846–856.PubMedView Article
            72. Peng J, Xu J: Low-homology protein threading. Bioinformatics 2010,26(12):i294-i300.PubMedView ArticlePubMed Central
            73. Yang Y, Faraggi E, Zhao H, Zhou Y: Improving protein fold recognition and template-based modeling by employing probabilistic-based matching between predicted one-dimensional structural properties of query and corresponding native properties of templates. Bioinformatics 2011,27(15):2076–2082.PubMedView ArticlePubMed Central
            74. Moult J, Fidelis K, Kryshtafovych A, Rost B, Hubbard T, Tramontano A: Critical assessment of methods of protein structure prediction-round VII. Proteins: Structure, Function, and Bioinformatics 2007,69(Suppl 8):3–9.View Article
            75. Moult J, Fidelis K, Kryshtafovych A, Tramontano A: Critical assessment of methods of protein strucutre prediction – round IX. Protiens 2011,79(S10):1–5.View Article
            76. Monastyrskyy B, Fidelis K, Moult J, Tramontano A, Kryshtafovych A: Evaluation of disorder predictions in CASP9. Proteins 2011,79(S10):107–118.PubMedView ArticlePubMed Central
            77. Monastyrskyy B, Fidelis K, Tramontano A, Kryshtafovych A: Evaluation of residue-residue contact prediction in CASP9. Proteins 2011,79(S10):119–125.PubMedView ArticlePubMed Central
            78. Cozzetto D, Kryshtafovych A, Fidelis K, Moult J, Rost B, Tramontano A: Evaluation of template-based models in CASP8 with standard measures. Proteins: Structure, Function, and Bioinformatics 2009,77(Suppl 9):000–000.
            79. Mariani V, Kiefer F, Schmidt T, Haas J, Schwede T: Assessment of template based protein structure predictions in CASP9. Proteins 2011,79(S10):37–58.PubMedView Article
            80. Kinch L, Shi SY, Cong Q, Cheng H, Liao Y, Grishin NV: CASP9 assessment of free modeling target predictions. Proteins 2011,79(S10):59–73.PubMedView ArticlePubMed Central
            81. Benkert P, Tosatto S, Schomburg D: QMEAN: a comprehensive scoring function for model quality assessment. Proteins 2008,71(1):-.
            82. Cozzetto D, Kryshtafovych A, Tramontano A: Evaluation of CASP8 model quality predictions. Proteins: Structure, Function, and Bioinformatics 2009,77(S9):157–166.View Article
            83. Eisenberg D, Luthy R, Bowie J: VERIFY3D: assessment of protein models with three-dimensional profiles. Methods Enzymol 1997, 277:396–404.PubMedView Article
            84. Larsson P, Skwark M, Wallner B, Elofsson A: Assessment of global and local model quality in CASP8 using Pcons and ProQ. Proteins 2009,77(S9):167–172.PubMedView Article
            85. McGuffin L, Roche D: Rapid model quality assessment for protein structure predictions using the comparison of multiple models without structural alignments. Bioinformatics 2010,26(2):182–188.PubMedView Article
            86. Paluszewski M, Karplus K: Model Quality Assessment using Distance Constraints from Alignments. Proteins 2008, 75:540–549.View Article
            87. Kryshtafovych A, Fidelis K, Tramontano A: Evaluation of model quality predictions in CASP9. Proteins 2011,79(S10):91–109.PubMedView ArticlePubMed Central
            88. Moult J, Fidelis K, Kryshtafovych A, Rost B, Tramontano A: Critical assessment of methods of protein structure prediction (CASP)-round VIII. 2009.
            89. MacCallum JL, Perez A, Schnieders MJ, Hua L, Jacobson MP, Dill KA: Assessment of protein structure refinement in CASP9. Proteins 2011,79(S10):74–90.PubMedView ArticlePubMed Central
            90. Baldi P, Pollastri G: The principled design of large-scale recursive neural network architectures–DAG-RNNs and the protein structure prediction problem. J Mach Learn Res 2003, 4:575–602.
            91. Bernstein FC, Koetzle TF, Williams GJB, Meyer EF: The protein data bank: A computer-based archival file for macromolecular structures*. J Mol Biol 1977,112(3):535–542.PubMedView Article
            92. Deng X, Eickholt J, Cheng J: PreDisorder: ab initio sequence-based prediction of protein disordered regions. BMC Bioinforma 2009,10(1):436.View Article
            93. Deng X, Eickholt J, Cheng J: A comprehensive overview of computational protein disorder prediction methods. Mol BioSyst 2011,:8.
            94. Wu S, Szilagyi A, Zhang Y: Improving protein structure prediction using multiple sequence-based contact predictions. Structure 2011,19(8):1182–1191.PubMedView ArticlePubMed Central
            95. Tegge AN, Wang Z, Eickholt J, Cheng J: NNcon: improved protein contact map prediction using 2D-recursive neural networks. Nucleic Acids Res 2009,37(suppl 2):W515-W518.PubMedView ArticlePubMed Central
            96. Cheng J, Baldi P: Improved residue contact prediction using support vector machines and a large feature set. BMC Bioinforma 2007,8(1):113.View Article
            97. Ezkurdia I, Graña O, Izarzugaza JMG, Tress ML: Assessment of domain boundary predictions and the prediction of intramolecular contacts in CASP8. Proteins: Structure, Function, and Bioinformatics 2009,77(S9):196–209.View Article
            98. Izarzugaza JMG, Graña O, Tress ML, Valencia A, Clarke ND: Assessment of intramolecular contact predictions for CASP7. Proteins: Structure, Function, and Bioinformatics 2007,69(S8):152–158.View Article
            99. Cheng J, Saigo H, Baldi P: Large scale prediction of disulphide bridges using kernel methods, two dimensional recursive neural networks, and weighted graph matching. Proteins: Structure, Function, and Bioinformatics 2006,62(3):617–629.View Article
            100. Baldi P, Cheng J, Vullo A: Large-scale prediction of disulphide bond connectivity. The MIT Press, Cambridge, MA; 2004:97–104.
            101. Cheng J, Baldi P: Three-stage prediction of protein β-sheets by neural networks, alignments and graph algorithms. Bioinformatics 2005,21(suppl 1):i75-i84.PubMedView Article
            102. Wang Z, Eickholt J, Cheng J: MULTICOM: a multi-level combination approach to protein structure prediction and its assessments in CASP8. Bioinformatics 2010,26(7):882–888.PubMedView ArticlePubMed Central
            103. Zhang Y, Skolnick J: Scoring function for automated assessment of protein structure template quality. Proteins: Structure, Function, and Bioinformatics 2004,57(4):702–710.View Article
            104. Berman H, Westbrook J, Feng Z, Gilliland G, Bhat T, Weissig H, Shindyalov I, Bourne P: The protein data bank. Nucleic Acids Res 2000,28(1):235–242.PubMedView ArticlePubMed Central
            105. Zemla A: LGA: a method for finding 3D similarities in protein structures. Nucleic Acids Res 2003,31(13):3370–3374.PubMedView ArticlePubMed Central
            106. Wang Z, Eickholt J, Cheng J: APOLLO: a quality assessment service for single and multiple protein models. Bioinformatics 2011,27(12):1715–1716.PubMedView ArticlePubMed Central
            107. Wang Z, Tegge AN, Cheng J: Evaluating the absolute quality of a single protein model using structural features and support vector machines. Proteins: Structure, Function, and Bioinformatics 2009,75(3):638–647.View Article
            108. Cheng J, Wang Z, Tegge A, Eickholt J: Prediction of global and local quality of CASP8 models by MULTICOM series. Proteins 2009,77(S9):181–184.PubMedView Article
            109. Wang Z, Cheng J: An iterative self-refining and self-evaluating approach for protein model quality estimation. Protein Sci 2012,21(1):142–151.PubMedView ArticlePubMed Central
            110. Cheng J, Randall A, Baldi P: Prediction of protein stability changes for single site mutations using support vector machines. Proteins: Structure, Function, and Bioinformatics 2006,62(4):1125–1132.View Article
            111. Gilis D, Rooman M: PoPMuSiC, an algorithm for predicting protein mutant stability changes. Application to prion proteins. Protein Engineering 2000,13(12):849–856.PubMedView Article
            112. Worth CL, Preissner R, Blundell TL: SDM—a server for predicting effects of mutations on protein stability and malfunction. Nucleic Acids Res 2011,39(suppl 2):W215-W222.PubMedView ArticlePubMed Central
            113. Capriotti E, Fariselli P, Casadio R: I-Mutant2. 0: predicting stability changes upon mutation from the protein sequence or structure. Nucleic Acids Res 2005,33(suppl 2):W306-W310.PubMedView ArticlePubMed Central
            114. Parthiban V, Gromiha MM, Schomburg D: CUPSAT: prediction of protein stability upon point mutations. Nucleic Acids Res 2006,34(suppl 2):W239-W242.PubMedView ArticlePubMed Central
            115. Lin G, Wang Z, Xu D, Cheng J: SeqRate: sequence-based protein folding type classification and rates prediction. BMC Bioinforma 2010,11(Suppl 3):S1.View Article
            116. Deng X, Cheng J: MSACompro: Protein Multiple Sequence Alignment Using Predicted Secondary Structure, Solvent Accessibility, and Residue-Residue Contacts. BMC Bioinforma 2011, 12:472.View Article
            117. Thompson JD, Koehl P, Ripp R, Poch O: BAliBASE 3.0: latest developments of the multiple sequence alignment benchmark. Proteins: Structure, Function, and Bioinformatics 2005, 1:127–136.View Article
            118. Dai J, Cheng J: HMMEditor: a visual editing tool for profile hidden Markov model. BMC genomics 2008,9(Suppl 1):S8.PubMedView ArticlePubMed Central

            Copyright

            © Cheng et al.; licensee BioMed Central Ltd. 2012

            This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://​creativecommons.​org/​licenses/​by/​2.​0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

            Advertisement