Argot2: a large scale function prediction tool relying on semantic similarity of weighted Gene Ontology terms

  • Marco Falda1Email author,

    Affiliated with

    • Stefano Toppo1Email author,

      Affiliated with

      • Alessandro Pescarolo1,

        Affiliated with

        • Enrico Lavezzo2,

          Affiliated with

          • Barbara Di Camillo3,

            Affiliated with

            • Andrea Facchinetti3,

              Affiliated with

              • Elisa Cilia4,

                Affiliated with

                • Riccardo Velasco4 and

                  Affiliated with

                  • Paolo Fontana4Email author

                    Affiliated with

                    BMC Bioinformatics201213(Suppl 4):S14

                    DOI: 10.1186/1471-2105-13-S4-S14

                    Published: 28 March 2012

                    Abstract

                    Background

                    Predicting protein function has become increasingly demanding in the era of next generation sequencing technology. The task to assign a curator-reviewed function to every single sequence is impracticable. Bioinformatics tools, easy to use and able to provide automatic and reliable annotations at a genomic scale, are necessary and urgent. In this scenario, the Gene Ontology has provided the means to standardize the annotation classification with a structured vocabulary which can be easily exploited by computational methods.

                    Results

                    Argot2 is a web-based function prediction tool able to annotate nucleic or protein sequences from small datasets up to entire genomes. It accepts as input a list of sequences in FASTA format, which are processed using BLAST and HMMER searches vs UniProKB and Pfam databases respectively; these sequences are then annotated with GO terms retrieved from the UniProtKB-GOA database and the terms are weighted using the e-values from BLAST and HMMER. The weighted GO terms are processed according to both their semantic similarity relations described by the Gene Ontology and their associated score. The algorithm is based on the original idea developed in a previous tool called Argot. The entire engine has been completely rewritten to improve both accuracy and computational efficiency, thus allowing for the annotation of complete genomes.

                    Conclusions

                    The revised algorithm has been already employed and successfully tested during in-house genome projects of grape and apple, and has proven to have a high precision and recall in all our benchmark conditions. It has also been successfully compared with Blast2GO, one of the methods most commonly employed for sequence annotation. The server is freely accessible at http://​www.​medcomp.​medicina.​unipd.​it/​Argot2.

                    Background

                    Thanks to the advent of the Next Generation Sequencing technologies, we have assisted to an exponential increase in sequence data generation [1]. The task to assign a curator-reviewed function to every single sequence is unworkable, calling for efficient/effective methods to assign automatic annotation are necessary as a first analysis step to support working hypotheses and drive experimental validations of biological functions.

                    Computational approaches can be rather imprecise because functional inference is not as straightforward as one would expect, due to the unevenness of the classical paradigm "sequence-structure-function". Some authors suggest that for sequences sharing less than 30% of identity, the functional transfer may be highly inaccurate or completely wrong [2, 3]: in particular Enzyme Classification (EC) numbers tend to be conserved only for proteins with sequence identity above 80%. Other authors report different figures [4, 5] confirming the difficulty to agree on a unique view due to a certain unpredictability of biological systems.

                    In the category of sequence-based methods, the simple search for homologous sequences is considered a common practice for function prediction based on annotation transfer, and BLAST [6] can be considered a gold standard. If its classical pairwise alignment engine fails, the profile based PSI-BLAST [6] is able to identify relationship among distantly related proteins.

                    Another widely accepted approach relies on functional domains assignments. HMMER [7], which is based on Hidden Markov Models (HMM), is among the most known tools falling in this category. HMMER is mainly used to query the Pfam HMM models [8] and search for functional patterns and domains in the target sequences.

                    Recently, the Gene Ontology (GO) consortium [9] has revolutionized the way to access knowledge data and has rapidly become a standard de facto. The GO is organized in a hierarchical directed acyclic graph that greatly facilitates the mining of biological information by computational algorithms.

                    With the advent of GO and UniProtKB-GOA database (GOA) [10] of functionally annotated proteins, several algorithms have been developed to improve functional inference based on the plain use of BLAST [11]. Among these solutions, Blast2GO [1214] can be considered one of the best platforms to assist the user in annotating sequences.

                    In this paper, we present Argot2 (Annotation Retrieval of Gene Ontology Terms), a tool designed for high-throughput annotation of large sequence data sets with high efficiency and precision. Argot2 is born for in-house needs to annotate predicted genes from large-scale sequencing projects; now it has a free and fully functional web interface and its engine has been completely revisited. It has been extensively tested during highly challenging endeavours as grape [15] and apple [16] genome annotations and it has been continuously refined from its early version, Argot [17], to reach a high flexibility and confidence in extracting fruitful knowledge from different sources of information. The web server version is computationally efficient, highly scalable, and it is able to address the different needs of basic and advanced users in annotating small sets of proteins up to entire genomes. Here we also report the assessment of Argot2 tested in four different configurations and in comparison with Blast2GO.

                    Methods

                    Algorithm description

                    Argot2 processes the GO annotations of the hits retrieved by BLAST and HMMER searches. A weighting scheme and a clustering approach are applied to select the most accurate GO terms for annotating the target proteins.

                    Argot2 takes a list of GO terms belonging to the GO graph G(V,E) as input and weights them according to the e-value score of the hits. Assuming that the set V is ordered, it is possible to establish a one-to-one correspondence between the i th GO term g i V used for the annotation, its weight w i and the e-value scores S i and S i ' given by BLAST and HMMER. The weights are computed as follows:
                    http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-S4-S14/MediaObjects/12859_2012_5111_Equ1_HTML.gif
                    (1)
                    http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-S4-S14/MediaObjects/12859_2012_5111_Equ2_HTML.gif
                    (2)

                    As pfam2go [18] provides a minimal coverage of GO terms for each Pfam model, we extract from GOA the GO annotations of all proteins belonging to each Pfam entry to enrich these assignments. In Eq. 2 http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-S4-S14/MediaObjects/12859_2012_5111_IEq1_HTML.gif is the frequency of the GO term g i calculated over the total number P of proteins in the model and f(x) is a logistic curve introduced to reward highly frequent terms and to penalize those that are sparse and likely false positives.

                    All the possible paths starting from the input GO terms and leading to the root node are reconstructed and the GO nodes not included in any of these paths are discarded from the analysis, obtaining the so-called "GO-slim" (Figure 1-i).
                    http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-S4-S14/MediaObjects/12859_2012_5111_Fig1_HTML.jpg
                    Figure 1

                    Argot2 algorithm. i) Position of the retrieved nodes in the GO graph (black circles) with their weights (W). White circles connected by dashed lines are pruned GO terms that are not present in the final GO-slim. ii) Filtering steps based on Z-score and G-score (see the main text). The yellow big circles are the representatives of the corresponding groups having the highest Total Score (TS) and are used for the annotation. iii) The hexagons report the cumulative weights of the GO nodes i.e. W2 is obtained by the sum of its child nodes marked as black circles (WB and WC). Node 4 does not contribute to the cumulative score, as it is a reconstructed parent from node C. It inherits the weight of node C only (WC,4).

                    The remaining GO terms are grouped together in sets Gr k ∈ ℘;(V) according to their semantic similarity [19]: the nodes that share a strong biological relationship form a unique informative group, and only the most specific and high scoring annotations are considered.

                    Given two generic GO terms g i , g j V, we use the Lin's formula [20] (Eq. 3) as a semantic similarity measure. This metric has been chosen since it gave the best results in clustering annotations with respect to other existing methods [17].

                    The Lin's formula is defined as:
                    http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-S4-S14/MediaObjects/12859_2012_5111_Equ3_HTML.gif
                    (3)

                    In this formula, the function sim res : V × V → ℜ defined as: http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-S4-S14/MediaObjects/12859_2012_5111_IEq2_HTML.gif represents the highest Information Content IC among the subsumers of the terms g i and g j . Using the notation g i g j to mean that a path from the term g i to the term g j exists, the set of the subsumers can be defined through the function S: V × V → ℘(V) as S(g i ,g j ) = {gV:gg i ^ gg j }.

                    The function IC : V → ℜ is the Information Content of the i th GO term calculated according to the Resnik formula [21] as:
                    http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-S4-S14/MediaObjects/12859_2012_5111_Equa_HTML.gif

                    where |{g:g i g}| indicates the total number of occurrences of GO terms descending from GO term i and |{g: gGOA}| is the total number of GO terms in the GOA database.

                    Three scores are then introduced to filter isolated GO terms and to rank the remaining ones. The first one, the Group Score GrS : N → ℜ, is the sum of the cumulative Internal Confidence InC of the nodes g j belonging to the k th group Gr k , being N the set of the natural numbers:
                    http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-S4-S14/MediaObjects/12859_2012_5111_Equb_HTML.gif
                    The Internal Confidence InC : V → ℜ is a cumulative measure that takes into account the global cumulative weight distributions W: V → ℜ defined as http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-S4-S14/MediaObjects/12859_2012_5111_IEq3_HTML.gif , that is the sum of the weight w of a GO term g (Eq. 1 and Eq. 2) plus the weights of its children, and the sum of the cumulative weight of the root node (see Figure 1-iii):
                    http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-S4-S14/MediaObjects/12859_2012_5111_Equ4_HTML.gif
                    (4)
                    The second score Z: V → ℜ, called Z-score, is calculated for each extracted GO term g i as follows:
                    http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-S4-S14/MediaObjects/12859_2012_5111_Equc_HTML.gif

                    where http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-S4-S14/MediaObjects/12859_2012_5111_IEq4_HTML.gif is the weight of the root node divided by the total number of the retrieved GO nodes, while σ is the standard deviation of all the weights.

                    If the Z-score and the Group Score are below a certain threshold, the corresponding GO terms are discarded. These filtering steps reward those paths, up to the root, that are statistically significant discarding the branches of the GO graph containing nodes with low weights (see in Figure 1-ii the discarded path and group).

                    After the filtering phases, the algorithm assigns the third score, the Total Score TS : V → ℜ, to each culled GO term g i , according to the following formula:
                    http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-S4-S14/MediaObjects/12859_2012_5111_Equ5_HTML.gif
                    (5)
                    where Inc nc : V → ℜ is the non-cumulative internal confidence, calculated as
                    http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-S4-S14/MediaObjects/12859_2012_5111_Equ6_HTML.gif
                    (6)

                    Differently from the cumulative Internal Confidence InC defined by (Eq. 4), it estimates the local non-cumulative weight distribution, which considers only the weight of the term under analysis.

                    The function GrS nc : N → ℜ is the non-cumulative Group Score associated to the k th group Gr k . It is calculated as the sum of the non cumulative Internal Confidence InC nc (Eq. 6) of the nodes belonging to that group:
                    http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-S4-S14/MediaObjects/12859_2012_5111_Equd_HTML.gif

                    The GO terms with TS above a chosen threshold are extracted and reported.

                    The score rewards those hits that are particularly significant and specific, thanks to the contribution of the Information Content (see yellow circles in Figure 1-ii).

                    The non cumulative measures InC nc and GrS nc have been introduced to guarantee that no biases are introduced due to the scores of child nodes.

                    Web server functionalities and features

                    Argot2 has been completely reengineered to speed up and improve the annotation process. The algorithm has undergone several adjustments to easily merge the GO annotations retrieved from different databases. UniProt [22] and Pfam are presently used as reference databases and queried using BLAST and HMMER respectively.

                    The server can be accessed in three ways addressing different needs from small to large scale function predictions (see Figure 2).
                    http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-S4-S14/MediaObjects/12859_2012_5111_Fig2_HTML.jpg
                    Figure 2

                    Activity diagram of the Argot2 web server. Activity diagram of the Argot2 web server showing the three types of access: "Interactive analysis" for up to 100 sequences, "Batch analysis" for more than 100 sequences and "Consensus analysis" based on provided weighted GO annotations (see the main text).

                    a) In the "interactive analysis" the user simply inputs up to 100 DNA/protein sequences in FASTA format. For every sequence, a table is shown containing: predicted annotations with scores, hyperlinks to external sources, lists of proteins contributing to the final annotation, and a graphical position map of the retrieved hits into the GO graph.

                    b) The "batch analysis" is addressed to researchers interested in the annotation of entire genomes. Since this process is highly demanding, due to the long computational time required by BLAST and HMMER, we ask users to perform BLAST and HMMER searches locally and then upload search results into Argot2.

                    c) The last access option is called "consensus analysis" as users may provide their own weighted GO terms for each protein; these annotations can be obtained by any other method or database, in addition or in alternative to the "default" BLAST and HMMER searches used by the web server. The outputs of the analyses of type b and c are Excel or Tab Separated Values (TSV) files listing the retrieved annotations along with specific metrics: Total Score, Information Content and Internal Confidence. Finally, predictions can be automatically clustered in functional classes by using the GOClass tool (Additional file 1) and viewed as pie-charts. The Argot2 algorithm steps are mainly based on the original idea published in [17]. Important changes have been applied to the procedure to filter potential false positive hits out during the evaluation of the predicted terms. The raw measure Total Score (TS) has also been redefined. The server is freely accessible at the URL in [23].

                    Argot2 assessment

                    Argot2 has been benchmarked in four different conditions to test how proteins (either kept or removed from the databank) influence the results, and which is the impact of domain based HMM searches. The four different configurations are indicated in the following as: a) BH_with, b) B_with, c) BH_without, d) B_without. The prefix "BH" means that Argot2 has been tested on BLAST and HMMER searches, whereas "B" only on BLAST searches. The suffix "with" means that the proteins of the test set are present in the databank and "without" means they have been eliminated. Argot2 has been also compared with Blast2GO.

                    The assessment of Argot2 was based on the guidelines of the "Critical Assessment of Function Annotations" (CAFA) experiment [24] (see Additional file 7). We tested over 4000 proteins with already available GO annotations in GOA, both from Eukaryota (Euk) and Prokaryota (Pro), randomly extracted from about 50000 sequences released for the CAFA challenge. In addition, the well annotated yeast genome, comprising 6187 annotated proteins, has also been used as a test set. The details and statistics of the test sets are available in Additional files 2, 3, 4, 5 and on our web site [25].

                    The evaluation has been carried out at a protein-centric level using the following criteria. Let N be a pool of unknown target proteins. For each given protein p, the GO terms predicted by each method are retrieved and ranked accordingly to the corresponding Total Score TS p (Eq. 5).

                    For a given threshold t applied to the Total Score TS p the four different configurations are assessed based on precision and recall, calculated for each protein p as:
                    http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-S4-S14/MediaObjects/12859_2012_5111_Equ7_HTML.gif
                    (7)

                    The number of True Positives ( http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-S4-S14/MediaObjects/12859_2012_5111_IEq5_HTML.gif ) is the size of the intersection between the sets of benchmark (true) and predicted GO terms with score TS p > t. The number of False Positives ( http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-S4-S14/MediaObjects/12859_2012_5111_IEq6_HTML.gif ) is the size of the difference between the sets of predicted and true GO terms. The number of False Negatives ( http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-S4-S14/MediaObjects/12859_2012_5111_IEq7_HTML.gif ) is the size of the difference between the sets of true and predicted GO terms. The denominators of (Eq. 7) and (Eq. 8) represent the total number of predicted terms and the number of true terms, respectively. If, for a given threshold t, a protein has not any annotated term, its precision is not calculated.

                    Assessment Method 1 (m1) with sliding threshold

                    We consider a set of threshold scores t ranging from 0 to the maximum observed score t max . For each t, precision and recall are averaged across the N proteins of the pool, obtaining:
                    http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-S4-S14/MediaObjects/12859_2012_5111_Eque_HTML.gif

                    Each pair of values (1-PR t , RC t ) represents a point of the precision/recall curve.

                    Assessment Method 2 (m2) with sliding threshold

                    We calculate precision and recall as in the case of m1 method, but all the GO terms retrieved by the different tools (predicted terms) and those originally annotated on the benchmark proteins (true terms) are first propagated to the root. Thus, all GO terms standing in the paths of the predicted/true terms up to the root are considered in the assessment. The idea is that a predicted GO term, though not exact, may share some of its parent nodes with some parent nodes of one true GO term. This term cannot be considered completely wrong but rather closely related and, consequently, its shared parent nodes are included in the evaluation. See Additional file 7 for details and extensive explanation of assessment m1 and m2.

                    Results and discussion

                    Precision/recall curves for Molecular Function (MF) and Biological Process (BP) have been calculated with method m1 and m2 for yeast (Figure 3), Eukaryota, and Prokaryota test sets (Additional file 3 and 4). The first outcome of our benchmarking provides evidence of the effectiveness of the combination of BLAST and HMMER weighted hits (BH vs. B curves shown in Figure 3) in recovering a large number of GO terms (high recall), without significantly affecting precision, and outperforming the use of BLAST alone.
                    http://static-content.springer.com/image/art%3A10.1186%2F1471-2105-13-S4-S14/MediaObjects/12859_2012_5111_Fig3_HTML.jpg
                    Figure 3

                    Precision/recall curves of the yeast benchmark test. Precision/recall curves for Molecular Function (MF) and Biological Process (BP) calculated with method m1 and m2 (see the main text) for yeast test set. Recall and 1-precision of the tested algorithms are reported in y-axis and x-axis, respectively, for the two configurations "with" (keeping the benchmarked proteins in the databank) and "without" (removing them from the databank). See the main text for the abbreviations BH_with, B_with, BH_without, and B_without.

                    One potential bias in the assessment of all methods is that 84% and 99% of the proteins, in Euk and Pro test sets respectively (Additional file 2), are annotated without manual validation (Inferred from Electronic Annotation, IEA) and an over-estimation of tool performance may occur due to the use of predicted terms for functional inference [26]. To investigate the influence of this potential bias, the yeast proteome was used as benchmark, since a wealth of experimental data is available for this organism (over 84% of the proteins contain at least one non-IEA annotation. See Additional file 2). Though this is a challenging task involving 6187 sequences, the assessment gives an idea of what Argot2 is expected to do on a genome scale, namely to obtain a precise and thorough picture of molecular functions and biological processes of an entire organism. The general trends and the robustness shown in Pro and Euk test sets are confirmed (see Additional file 3, 4, and 6 from "a" to "h"). Nonetheless, a minor decrease in performance can be observed in yeast. This is due to the fact that yeast is mainly annotated with highly informative non-IEA GO terms, whose frequency in GOA databank is very low and consequently their retrieval may be a hard task. In particular it is possible to observe that the recall worsen, whereas the precision is only marginally affected proving that Argot2 is able to retrieve reliable and even low-frequent GO terms (compare for example the third column of Additional file 6 with the first two columns of the same figure, row by row).

                    This trend is confirmed when target proteins are removed from the databanks used to train Argot2 (see curves suffixed by "with" vs. those suffixed by "without" in Figure 3). This issue is not present in Pro and Euk test sets, which mainly include highly frequent IEA GO terms. As expected, results of Pro and Euk test sets get slightly worse (see Additional file 3 and 4), but yeast is more affected and Argot2 finds more difficulties in extracting the right GO terms (see Figure 3, column "m1"). Nevertheless, method m2 reveals that, in these critical situations, Argot2 tends to be conservative rather than inaccurate, i.e. to show a lower recall but still a good precision (see Figure 3: "a" vs. "c", "b" vs. "d", "BH_without" and "B_without"). In conclusion, the lower performance is due to shallowness rather than inaccuracy. This means that most of the predicted nodes, though approximate, fall into the path of the correct annotations.

                    Finally, some interesting conclusions can be drawn in the "one-to-one" comparison with Blast2GO using the B_with Argot2 version that exploits the same BLAST data of Blast2GO. According to benchmark "m2", the recall is generally higher for Argot2 whereas the precision is comparable, to some extent, between the two tools. However, Argot2 is more effective in retrieving the exact original annotations, as evidenced by the use of assessment method m1 (see "m1" column in Figure 3 and "m1" rows in Additional file 6). The irregular contour trend of Blast2GO may be due to the sliding "Annotation Cut-off" parameter, which does not seem to be a well discriminating score. Fine tuning may be required, even though the default value suggested for the parameter "Annotation Cut-off", i.e. 55, gives the best trade-off between precision and recall. Moreover, Argot2 is fairly more computationally efficient compared to Blast2GO. Starting from BLAST and HMMER results, which remain the limiting steps of the process, Argot2 takes only few hours to annotate an entire genome.

                    Conclusions

                    Argot has been revisited to increase both accuracy and precision, thanks to an improved weighting scheme and the introduction of Pfam models. The server automatically downloads new releases of the used databanks UniProtKB-GOA, UniProt, Gene Ontology, and Pfam on a monthly basis to give end users an updated access to the tool. Presently, in our testing conditions Argot2 performs reasonably well in terms of both precision and recall, showing that TS score can effectively discriminate among false and true positives. The main rationale has been to create a tool able to favour the precision with respect to the recall. This is critical when annotating very large genome data sets, since reducing the false positives rate is definitely desirable. This can prevent biased information from impacting negatively on post-genome studies and statistics. In addition, we plan to associate a p-value to the raw score TS and to add new sources of information, trying to give an answer to non-trivial cases that lie in the twilight zone beyond similarity based evidences. In future releases we could explore other metrics, for example to assess different semantic similarity measures and to compare their performances with Lin's formula currently used by Argot2 (see [27]).

                    List of abbreviations used

                    All abbreviations in the text excluded from the following list are specific of this paper and have been defined in the main text

                    BLAST: 

                    Basic Local Alignment Search Tool

                    GO: 

                    Gene Ontology

                    GOA: 

                    Gene Ontology Annotation

                    EC: 

                    Enzyme Classification

                    PSI-BLAST: 

                    Position-Specific Iterative Basic Local Alignment Search Tool

                    HMM: 

                    Hidden Markov Model

                    TSV: 

                    Tab Separated Values

                    URL: 

                    Uniform Resource Locator

                    CAFA: 

                    Critical Assessment of Function Annotations

                    TP: 

                    True Positive

                    FP: 

                    False Positive

                    FN: 

                    False Negative

                    MF: 

                    Molecular Function

                    BP: 

                    Biological Process

                    IEA: 

                    Inferred by Electronic Annotation.

                    Declarations

                    Acknowledgements

                    We thank Luca Bianco for critical reading of the paper and for fruitful suggestions.

                    This article has been published as part of BMC Bioinformatics Volume 13 Supplement 4, 2012: Italian Society of Bioinformatics (BITS): Annual Meeting 2011. The full contents of the supplement are available online at http://​www.​biomedcentral.​com/​bmcbioinformatic​s/​supplements/​13/​S4.

                    Authors’ Affiliations

                    (1)
                    Department of Molecular Medicine, University of Padova
                    (2)
                    Department of Molecular Medicine, University of Padova
                    (3)
                    Department of Information Engineering, University of Padova
                    (4)
                    Istituto Agrario San Michele all’Adige Research and Innovation Centre, Foundation Edmund Mach

                    References

                    1. Galperin MY, Koonin EV: From complete genome sequence to 'complete' understanding? Trends in Biotechnology 2010,28(8):398–406.PubMedView Article
                    2. Todd AE, Orengo CA, Thornton JM: Evolution of function in protein superfamilies, from a structural perspective. Journal of Molecular Biology 2001,307(4):1113–1143.PubMedView Article
                    3. Devos D, Valencia A: Practical limits of function prediction. Proteins 2000,41(1):98–107.PubMedView Article
                    4. Tian WD, Skolnick J: How well is enzyme function conserved as a function of pairwise sequence identity? Journal of Molecular Biology 2003,333(4):863–882.PubMedView Article
                    5. Rost B: Enzyme function less conserved than anticipated. Journal of Molecular Biology 2002,318(2):595–608.PubMedView Article
                    6. Altschul SF, Madden TL, Schaffer AA, Zhang J, Zhang Z, Miller W, Lipman DJ: Gapped BLAST and PSI-BLAST: a new generation of protein database search programs. Nucleic Acids Research 1997,25(17):3389–3402.PubMedView Article
                    7. HMMER [http://​hmmer.​janelia.​org/​]
                    8. Finn RD, Mistry J, Tate J, Coggill P, Heger A, Pollington JE, Gavin OL, Gunasekaran P, Ceric G, Forslund K, Holm L, Sonnhammer EL, Eddy SR, Bateman A: The Pfam protein families database. Nucleic Acids Research 2010, 38:D211-D222.PubMedView Article
                    9. Ashburner M, Ball CA, Blake JA, Botstein D, Butler H, Cherry JM, Davis AP, Dolinski K, Dwight SS, Eppig JT, Harris MA, Hill DP, Issel-Tarver L, Kasarskis A, Lewis S, Matese JC, Richardson JE, Ringwald M, Rubin GM, Sherlock G: Gene ontology: tool for the unification of biology. The Gene Ontology Consortium. Nature Genetics 2000,25(1):25–29.PubMedView Article
                    10. Barrell D, Dimmer E, Huntley RP, Binns D, O'Donovan C, Apweiler R: The GOA database in 2009 - an integrated Gene Ontology Annotation resource. Nucleic Acids Research 2009, 37:D396–403.PubMedView Article
                    11. Martin DM, Berriman M, Barton GJ: GOtcha: a new method for prediction of protein function assessed by the annotation of seven genomes. BMC Bioinformatics 2004, 5:178.PubMedView Article
                    12. Conesa A, Gotz S, Garcia-Gomez JM, Terol J, Talon M, Robles M: Blast2GO: a universal tool for annotation, visualization and analysis in functional genomics research. Bioinformatics 2005,21(18):3674–3676.PubMedView Article
                    13. Götz S, Garcia-Gómez JM, Terol J, Williams TD, Nagaraj SH, Nueda MJ, Robles M, Talón M, Dopazo J, Conesa A: High-throughput functional annotation and data mining with the Blast2GO suite. Nucleic Acids Research 2008, 36:3420–3435.PubMedView Article
                    14. Conesa A, Gotz S: Blast2GO:A comprehensive suite for functional analysis in plant genomics. International Journal of Plant Genomics 2008, 2008:Article ID 619832.View Article
                    15. Velasco R, Zharkikh A, Troggio M, Cartwright DA, Cestaro A, Pruss D, Pindo M, Fitzgerald LM, Vezzulli S, Reid J, Malacarne G, Iliev D, Coppola G, Wardell B, Micheletti D, Macalma T, Facci M, Mitchell JT, Perazzolli M, Eldredge G, Gatto P, Oyzerski R, Moretto M, Gutin N, Stefanini M, Chen Y, Segala C, Davenport C, Demattè L, Mraz A, et al.: A high quality draft consensus sequence of the genome of a heterozygous grapevine variety. PLoS One 2007,2(12):e1326.PubMedView Article
                    16. Velasco R, Zharkikh A, Affourtit J, Dhingra A, Cestaro A, Kalyanaraman A, Fontana P, Bhatnagar SatishK, Troggio M, Pruss D, Salvi S, Pindo M, Baldi P, Castelletti S, Cavaiuolo M, Coppola G, Costa F, Cova V, Dal Ri A, Goremykin V, Komjanc M, Longhi S, Magnago P, Malacarne G, Malnoy M, Micheletti D, Moretto M, Perazzolli M, Si-Ammour A, Vezzulli S, et al.: The genome of the domesticated apple (Malus x domestica Borkh.). Nature Genetics 2010,42(10):833–839.PubMedView Article
                    17. Fontana P, Cestaro A, Velasco R, Formentin E, Toppo S: Rapid annotation of anonymous sequences from genome projects using semantic similarities and a weighting scheme in gene ontology. PLoS One 2009,4(2):e4619.PubMedView Article
                    18. Pfam2go [http://​www.​geneontology.​org/​external2go/​pfam2go]
                    19. Lord PW, Stevens RD, Brass A, Goble CA: Investigating semantic similarity measures across the Gene Ontology: the relationship between sequence and annotation. Bioinformatics 2003,19(10):1275–1283.PubMedView Article
                    20. Lin D: An Information-Theoretic Definition of Similarity. In Proceedings of the Fifteenth International Conference on Machine Learning (ICML'98): 24–27, July, 1998; Madison, Wisconsin, USA. Morgan Kaufmann Publishers Inc; 1998:296–304.
                    21. Resnik P: Semantic similarity in a taxonomy: An information-based measure and its application to problems of ambiguity in natural language. Journal of Artificial Intelligence Research 1999, 11:95–130.
                    22. Bairoch A, Apweiler R, Wu CH, Barker WC, Boeckmann B, Ferro S, Gasteiger E, Huang H, Lopez R, Magrane M, Martin MJ, Natale DA, O'Donovan C, Redaschi N, Yeh LS: The Universal Protein Resource (UniProt). Nucleic Acids Research 2005, (33 Database):D154–159.
                    23. Argot2 web site [http://​www.​medcomp.​medicina.​unipd.​it/​Argot2]
                    24. Critical Assessment of Function Annotations (CAFA) [http://​biofunctionpredi​ction.​org/​]
                    25. Supplementary material web site [http://​www.​medcomp.​medicina.​unipd.​it/​Argot2/​suppl_​mat_​BMC/​]
                    26. Louie B, Higdon R, Kolker E: A statistical model of protein sequence similarity and function similarity reveals overly-specific function predictions. PLoS One 2009,4(10):e7546.PubMedView Article
                    27. Couto FM, Silva MJ: Disjunctive shared information between ontology concepts: application to Gene Ontology. J Biomed Semantics 2011.,2(5):

                    Copyright

                    © Falda et al.; licensee BioMed Central Ltd. 2012

                    This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://​creativecommons.​org/​licenses/​by/​2.​0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

                    Advertisement