False positive reduction in protein-protein interaction predictions using gene ontology annotations
© Mahdavi and Lin; licensee BioMed Central Ltd. 2007
Received: 21 March 2007
Accepted: 23 July 2007
Published: 23 July 2007
Many crucial cellular operations such as metabolism, signalling, and regulations are based on protein-protein interactions. However, the lack of robust protein-protein interaction information is a challenge. One reason for the lack of solid protein-protein interaction information is poor agreement between experimental findings and computational sets that, in turn, comes from huge false positive predictions in computational approaches. Reduction of false positive predictions and enhancing true positive fraction of computationally predicted protein-protein interaction datasets based on highly confident experimental results has not been adequately investigated.
Gene Ontology (GO) annotations were used to reduce false positive protein-protein interactions (PPI) pairs resulting from computational predictions. Using experimentally obtained PPI pairs as a training dataset, eight top-ranking keywords were extracted from GO molecular function annotations. The sensitivity of these keywords is 64.21% in the yeast experimental dataset and 80.83% in the worm experimental dataset. The specificities, a measure of recovery power, of these keywords applied to four predicted PPI datasets for each studied organisms, are 48.32% and 46.49% (by average of four datasets) in yeast and worm, respectively. Based on eight top-ranking keywords and co-localization of interacting proteins a set of two knowledge rules were deduced and applied to remove false positive protein pairs. The 'strength', a measure of improvement provided by the rules was defined based on the signal-to-noise ratio and implemented to measure the applicability of knowledge rules applying to the predicted PPI datasets. Depending on the employed PPI-predicting methods, the strength varies between two and ten-fold of randomly removing protein pairs from the datasets.
Gene Ontology annotations along with the deduced knowledge rules could be implemented to partially remove false predicted PPI pairs. Removal of false positives from predicted datasets increases the true positive fractions of the datasets and improves the robustness of predicted pairs as compared to random protein pairing, and eventually results in better overlap with experimental results.
In recent years high throughput technologies have provided experimental tools to identify protein interactions in large scale, generating tremendous amount of protein interaction data . On the other hand, however, computational approaches for protein interaction inference have presented a growing number of inexpensive methods to predict vast number of protein pairs on genome scale . Both experimental techniques and computational approaches are affected by high false positives and false negatives that tend to result in poor agreement among bench mark datasets . On the experimental front, false positives mostly stem from the technology involved. Nonetheless, some techniques have been already proposed to enhance the reliability of current high-throughput screening datasets . On the computational front, most efforts have been focused on predicting more protein-protein interactions by means of various approaches identifying true positives that bring along numerous false positive and false negative predictions. Reduction of false positive predictions in computational approaches has not been adequately investigated.
So far, several computational approaches have been proposed to predict protein interactions . These approaches can be grouped into six categories based upon the hypotheses from which they originate. The first category comprises the methods that utilize genomics information to predict protein interactions. Conventional phylogenetic profiles , gene fusion , gene neighbourhood , and transgenic distance  are as such. Availability of whole genome sequences has enabled the genome scale homology search, resulting in the construction of protein profiles, discovery of fusion events, specifying gene orders, and identifying genetic distances in the above-mentioned genome-based methods. In second category are the methods that rely on statistical scoring functions such as mutual information , Jaccard coefficient , and chance co-occurrence distribution  to calculate the extent of similarity of protein phylogenetic profiles. These methods have been recently employed to enrich conventional genomics methods by using score functions instead of exact similarity of patterns or genetic localizations. The third group is domain-based protein interaction prediction methods. These methods postulate that conservation of sequence properties such as domains, motifs, and signatures over the course of evolution may contribute to the interaction of proteins. Earlier studies focus on an association method  which was improved by considering the number of signatures in each protein sequence . The likelihood approach was also implemented to enhance the feasibility of domain-based approaches . The fourth category consists of the methods in which structural similarities and prediction upon structural models is the underlying hypothesis. These methods range from the threading approach , docking methods , and the CAPRI experiment  to protein interaction prediction based on surface patch comparison  and oligomeric protein structure networks . The fifth category covers the methods which employ machine learning techniques to predict protein-protein interactions. These methods use different information to predict protein-protein interactions such as primary structures , and conserved network motifs . Interaction mining was also used to train learning systems to recognize correlated patterns within protein interaction pairs . Support vector machines (SVM) have been used to construct supervised classifiers in order to identify interacting proteins . The effect of the training dataset on the performance of SVM prediction has been studied  to enhance the efficiency of predictions. The sixth category includes the methods that use gene co-expression information to predict protein-protein interactions . These methods predict interacting proteins through integration of micro array data in different biological conditions and construction of co-expression profiles for genes .
False positive prediction in all computational methods and their limited overlap with experimental results are post-genomic challenges. Computational PPI prediction approaches consider protein-protein interactions in the most general context and often refer to 'functionally interacting proteins', implying that the proteins cooperate to perform a given task without necessarily involving any physical contact. Experimental PPI detection techniques, such as yeast two-hybrid and large-scale affinity purification with mass spectrometry, attempt to discover direct physical interactions between proteins. However, there is a limited overlap between sets of interacting proteins identified by functional and physical relationships . Given the incomplete coverage of experimental results, there is clearly the need to develop large-scale robust computational sets of interacting proteins validated by future experiments. Furthermore, because of the lack of solid information on protein-protein interaction, the accuracy of different computational approaches remains uncertain. Nevertheless, it is a common perception that if both experimental results and computational predictions agree on a link, the confidence level of that link would be high. Therefore, one measure to evaluate the false positive content of computational predictions is the level of agreement with experimental findings. Although high-throughput screening techniques are affected by false positives, validation of computational pairs by experimental results is widely acceptable.
To enhance the overlap between computational predictions and experimental results, we need to find a systematic way to remove false positives, resulting in an increased true positive fraction of every predicted PPI dataset. In order to achieve this goal a common ground upon which the predicted results can be evaluated is required. Gene Ontology (GO) annotations may serve as the common ground, even though annotation is an ongoing process. Gene Ontology (GO) is the database that contains controlled vocabularies to annotate molecular attributes for different model organisms. Annotations are defined in three structured ontologies which allow the description of molecular function (F), biological process (P), and cellular component (C). Each ontology is structured in child-parent hierarchies in which a 'child' may have many 'parents' and child terms are components of parent terms. Thus, information provided by GO must be useful in further assessment of predicted PPIs and may be integrated with global filtering algorithms to reduce the number of false positives in PPI predicted datasets. Currently, several attempts have been reported in constructing functional association predictors solely based on GO information. In some studies, associations between proteins in a pair are assessed in terms of the similar GO terms , while other studies evaluate functional associations based on either information content  or GO structural hierarchy . In a recent study, GO annotations have been used to construct a PPI network for yeast by measuring similarity between two gene ontology terms with a relative specificity semantic relation .
Therefore, GO can be utilized as a useful informative resource to either predict or further analyze the predicted PPI datasets. However, ontology annotation is an incomplete process and suffers from inconsistency within and between genomes. In some cases, two confirmed interacting proteins are assigned two different GO annotations which are not equivalent in terms of information content. One protein is assigned a term that represents a broad type of activity, and its interacting partner is assigned a more specific term that represents a subtype of that activity. In other cases, some proteins have not even been assigned all three ontologies which make the interaction assessments more difficult without human intervention. Thus, the molecular functions of GO annotations of related proteins should be harmonized in relation to the information content and compared on a more general level. There are advantages and disadvantages associated with the harmonization of GO terms. The advantage is that the predicted relationship between proteins in a pair can be detected systematically using some keywords and it is not required to be verified manually. The disadvantage is that the integration of GO annotations and predicted PPIs might not be able to reveal the specific functions of the interacting proteins. However, knowing the fact that PPI prediction techniques are merely capable of specifying the general category of relationship between two proteins, this disadvantage is not a great source of concern.
In this study a global framework to refine computationally predicted datasets is developed. First, two experimental PPI datasets with high confidence were prepared for two model organisms S. cerevisiae and C. elegans. Assuming the experimentally confirmed pairs are true, the GO annotations of these interacting proteins were utilized to extract keywords which represent general category functions of the proteins. Then, a set of heuristic rules was established to be satisfied by the predicted interacting protein pairs based on extracted keywords and the fact that two proteins acting in the same cellular components are more likely to interact than those located in different components. Next, four computational methods representing four out of six categories of prediction techniques, mentioned earlier in this section, were selected. Using these methods, four predicted datasets were created for each organism of interest. The heuristic rules were applied to these predicted datasets. When a predicted pair of interacting proteins satisfied the rules it was considered a true positive, otherwise the pair was assumed false positive and removed from the dataset. The results show that the filtered datasets have higher true positive fractions than non-filtered datasets and the improvement is statistically significant.
Results and Discussion
Using information deposited in the UNIPROT and GO databases, the experimentally obtained protein pairs for yeast and worm were processed, resulting in 1042 non-redundant GO term information (including 4391 yeast proteins) and 748 non-redundant GO term information (including 3390 worm proteins), respectively. These pieces of term information were further clustered, resulting in 35 and 25 keywords for yeast and worm, respectively (see Additional File 2).
Frequencies of keywords extracted from experimentally obtained yeast protein pairs
Remaining keywords (27 keywords)
where y is the total number of pairs in the predicted dataset (the test dataset). Cumulative specificity translates into the recovery power of all keywords when they are applied to a predicted dataset (test set).
Although the eight top-ranking keywords significantly recover the experimental or predicted datasets, the cumulative sensitivity or specificity is not distributed equally as seen in Figures 1, 2, 3. Among the keywords "binding" (BI) is an exception with the sensitivity of 53.22% in the yeast dataset, for instance, compared to 8.20% for "ase activity" (AS), 0.43% for "porter activity" (PO), and so on. This drastic difference between the sensitivity or specificity of this particular keyword and that of other keywords stems from the fact that our experimental datasets are collections of protein interactions detected mainly by the two-hybrid technique. This high-throughput technique detects physical interactions among proteins in which binding of a protein to the active site of another protein is a crucial step. Accordingly, most of these protein pairs are assigned the "binding" molecular function annotation in GO database. On the other hand, the contribution of keywords such as "receptor activity" (RE) in the cumulative sensitivity is 0.20% which is not a remarkable contribution; however, it is significant when it is compared with 0.22% increase in cumulative sensitivity by "remaining keywords" (RK) which represents 27 keywords in the case of yeast.
It should be noted that the highest obtainable cumulative sensitivity, in yeast for example, is 64.43% by means of all keywords and 64.21% by means of eight top-ranking keywords. Currently, it is impossible to obtain complete sensitivity (100%), as some experimental pairs do not have consistent annotations. This inconsistency comes from the fact that there are deficiencies in either annotation or experimental techniques. In case of the worm dataset the inconsistency is worse. Only 55% of worm genes are annotated and many annotations are not consistent. It is also notable that the GO molecular function annotations can not be used directly as keywords. When the definitions of the GO molecular functions were considered as keywords, the cumulative sensitivity of the training dataset was only 45.00%, comparing to that of 64.43% when the keyword extraction approach was implemented.
Two predicted proteins in the pair should match one of the eight trained function keywords.
Two predicted proteins in the pair should be in the same GO cellular components.
As many computational protein interaction prediction techniques suffer from mass false positive predictions, satisfying the rules filters the predicted datasets and removes the false interactions to some extent.
Comparison of SNR and S value of predicted datasets before (raw data) and after (filtered data) removing false positive protein-protein interaction pairs
SNR* (raw data)
SNR* (filtered data)
SNR* (raw data)
SNR* (filtered data)
Given the fact that protein interactions are required for cell functioning and permanent or transient interactions between proteins are regulated under biological circumstances, this statistical analysis can well distinguish between the predicted/filtered datasets and random selection of interaction. The predicted and filtered set of interactions in a dataset is significant when the true positive fraction of the dataset is greater than that in a randomly selected dataset. In other words, the selection of interacting proteins is significant when the strength value is greater than 1.
The algorithm proposed here to reduce the number of false positive predicted protein pairs could also be extended to evaluate and compare the effectiveness of PPI prediction among different computational approaches. The algorithm is a post-prediction processing step that is applied to the resulted predicted dataset when a computational method is implemented. Thus, it can be attached to any computational approach for further analysis of predicted results. However, it should be noted that ontology is an ongoing process. With more genes assigned with GO terms, the proposed filtering algorithm is a promising approach to reduce the number of false positive interactions and thus to enhance the accuracy of PPI prediction.
UNIPROT/GO limitations and intrinsic deviation of the analysis
UNIPROT and GO employ different strategies to annotate proteins. In cases where experimental information is not available, sequence homology is the strategy that is used to assign biochemical information to proteins. Thus, there is a concern that protein pairs detected by the proposed algorithm as true positives may also be inferred by homology which consequently demonstrates low accuracy of filtered protein pairs. We compared our filtered datasets with interacting proteins reported in KOG database provided by NCBI. This database includes orthologous and paralogous proteins of eukaryotic species. Each group is associated with a conserved and specific function. Our examination shows that, on average, only 1.24% of the protein pairs that satisfies the rules can be predicted through homology. Refer to Additional File 1 for more information.
Annotation is an ongoing process and there are many proteins: i) to be annotated, ii) erroneously annotated, iii) annotated but do not comply with experimental findings, iv) with unidentified locations and ubiquitous status. These proteins and their pair-wise interactions with other proteins contribute to the intrinsic deviation of the proposed approach to filtering false positive predictions. To confine the bias caused by the above mentioned reasons and decrease the deviation of the resulted filtered datasets, the rules have been applied solely to those protein pairs whose GO annotations are available. Furthermore, protein pairs with GO annotations suffer from inconsistency among annotations. Extracted functional keywords address this deficiency and can recover proteins pairs whose general functions are similar, even though their GO annotations are not in the same level of information content. Nevertheless, the deviation resulted from this inconsistency can be well represented by means of sensitivity and specificity. For example, in Yeast high confidence experimental dataset (training set), there are 16507 protein pairs of which 15748 protein pairs (95%) contain GO annotation. This figure indicates that the coverage of GO annotations for well-studied organisms is satisfactory. Of 15748 protein pairs with annotations, 10146 pairs contain similar function annotations accounting for 64.43% which is equal to the sensitivity of the extracted keywords.
The intrinsic deviation partially depends on the precision of annotation process. In fact, annotation process has shifted from manual annotation to automated annotation due to growing influx of protein information in the past few years and time-consuming process of manual curation. Shifting from manual annotation to automated procedures decreased the accuracy of annotation process. However, with the aid of powerful text-mining tools the accuracy of annotation is now satisfactory. Based on an investigation in 2002, Incellico Inc. reported that the accuracy of GO annotation is 95% . GOA is a project aiming at providing high quality GO annotation to proteins in UNIPROT knowledgebase . Camon et al.  evaluated the GO annotation retrieval of GOA project and reported 91% precision. Recently, Couto et al.  presented a text-mining technique with 93% precision in annotation.
Gene ontology annotation was used as a common ground to evaluate protein pairs predicted by four different PPI-predicting methods. Molecular function annotations in the Gene Ontology database were used to extract discriminating keywords, upon which heuristic rules were set. The rules were incorporated into an algorithm by which predicted datasets were filtered and false positive predictions were partially removed from the datasets. When only eight top-ranking keywords were chosen, over 99% of molecular function could be recovered as indicated by the cumulative sensitivity for both experimentally obtained and computationally predicted protein pairs. The effectiveness of the proposed algorithm to filter false positive predicted protein pairs varies from one method to another. The proposed algorithm is unbiased and could be implemented on all computational methods to increase the accuracy of PPI prediction. As more genes are assigned with GO annotations, the proposed filtering algorithm will become even more effective.
The dataset containing experimentally obtained protein pairs was used to extract the functional keywords from the GO annotations. The yeast dataset was compiled from the following three sources: (1) von Mering et al.  reported high confident yeast protein pairs that were confirmed by at least two experimental methods, resulting in 1920 protein pairs; (2) the BIND database  contains 10618 yeast protein pairs that were experimentally confirmed and manually curated; and (3) CYGD  contains 10472 experimentally verified yeast protein pairs. Combining these three sources resulted in 16507 non-duplicated yeast protein pairs, consisting of 4391 proteins.
The worm dataset was constructed from BIND  and Li et al., . They reported 4960 and 6629 protein pairs, respectively. These pairs were obtained by means of the yeast two-hybrid technique and manually curated. After removing duplicated pairs the dataset consists of 7081 pairs, comprising 3390 proteins in C. elegans.
Computational protein-protein interaction methods
Four PPI predicting methods from four out of six categories discussed in the Introduction section were chosen, including phylogenetic profiles (PP), chance co-occurrence distribution coefficient (CC), gene expression profiles (GE), and maximum likelihood estimation (MLE). The criteria of choosing these methods were based on: their genome-wide applicability and competitive results in the category [42–45]. The implementation of these methods is presented in Additional File 1.
Gene ontology and annotations
The GO annotations of proteins were retrieved from the UNIPROT knowledgebase  which is collaborated with the GO database . Annotations in both the UNIPROT and GO databases are updated on a regular basis. In this study, the UNIPROT knowledgebase, Release 8 (June 2006) and the GO database, Version 1.362 (May 2006) were used to extract keywords for the false positive reduction on the predicted protein pairs.
Proteins involved in experimentally verified protein pairs were submitted to UNIPROT. Then GO and InterPro cross-reference assignments of the protein were retrieved. Through "interpro2go" (retrieved from Mappings to GO on the GO website), all InterPro entries were mapped to GO terms and the GO terms of each protein were searched using AMIGO term search engine. The searched GO term information of each protein was collected and redundant information was removed. The remaining term definition relevant to the molecular function annotation (a part of term information) was compiled and used as a training dataset. The dataset was further manually grouped into different clusters according to their general molecular activities; for instance, GO:0003723 and GO:0000166 were placed in the same cluster because of molecule-binding activities. Refer to Additional File 2 for a complete listing of all clusters for S. cerevisiae and C. elegans.
where λ = N·f, in which N is the total number of words in a cluster, and f is the relative frequency of that word in the whole training dataset. To avoid floating point errors and facilitate computation, n! was approximated by Stirling's approximation, resulting inln p(n) = -λ + n ln λ - n ln(n) + n - 1
This calculation is valid when the total number of words in the training dataset is much greater than N or when f is small. In order to identify most comprehensive words in each cluster, grammatical terms such as proposition, and chemical formulae were purposefully eliminated. In the "enzymatic function" cluster, all enzyme activities were considered as "ase activity" since enzymes are introduced with "ase" suffix in biochemistry literature. In each cluster the word with the most negative ln p value was selected as the representative keyword.
- Zhu H, Bilgin M, Snyder M: Proteomics. Annu Rev Biochem. 2003, 72: 783-812. 10.1146/annurev.biochem.72.121801.161511.View ArticlePubMedGoogle Scholar
- Yu J, Fotouhi F: Computational approaches for predicting protein-protein interactions: A survey. Journal of Medical Systems. 2006, 30 (1): 39-44. 10.1007/s10916-006-7402-3.View ArticlePubMedGoogle Scholar
- Bork P, Jensen LJ, von Moring C, Ramani AK, Lee I, marcotte EM: Protein interaction networks from yeast to human. Current Opinion in Structural Biology. 2004, 14: 292-299. 10.1016/j.sbi.2004.05.003.View ArticlePubMedGoogle Scholar
- Deane CM, Salwinski L, Xenarios I, Eisenberg D: Two methods for assessment of the reliability of high throughput observations. Molecular & Cellular Proteomics. 2002, 1 (5): 349-356. 10.1074/mcp.M100037-MCP200.View ArticleGoogle Scholar
- Valencia A, Pazos F: Computational methods for the prediction of protein interactions. Current Opinion in Structural Biology. 2002, 12: 368-373. 10.1016/S0959-440X(02)00333-0.View ArticlePubMedGoogle Scholar
- Pellegrini M, Marcotte EM, Thompson MJ, Eisenberg D, Yeates TO: Assigning protein functions by comparative genome analysis: protein phylogenetic profiles. Proc Natl Acad Sci USA. 1999, 96: 4285-4288. 10.1073/pnas.96.8.4285.PubMed CentralView ArticlePubMedGoogle Scholar
- Marcotte EM, Pellegrini M, Ng HL, Rice DW, Yeates TO, Eisenberg D: Detecting protein function and protein-protein interactions from genome sequences. Science. 1999, 285: 751-753. 10.1126/science.285.5428.751.View ArticlePubMedGoogle Scholar
- Dandekar T, Snel B, Huynen M, Bork P: Conservation of gene order: a fingerprint of proteins that physically interact. Trends Biochem Sci. 1998, 9: 324-328. 10.1016/S0968-0004(98)01274-2.View ArticleGoogle Scholar
- Strong M, Mallick P, Pellegrini M, Thompson MJ, Eisenberg D: Inference of protein function and protein linkages in Mycobacterium tuberculosis based on prokaryotic genome organization : a combined computational approach. Genome Biology. 2003, 4: R59-10.1186/gb-2003-4-9-r59.PubMed CentralView ArticlePubMedGoogle Scholar
- Date SV, Marcotte EM: Discovery of uncharacterized cellular systems by genome-wide analysis of functional linkages. Nature Biotechnology. 2003, 21: 1055-1062. 10.1038/nbt861.View ArticlePubMedGoogle Scholar
- Yamada T, Goto S, Kanehisa M: Extraction of phylogenetic network modules from prokaryote metabolic pathways. Genome Informatics. 2004, 15: 249-258.PubMedGoogle Scholar
- Wu J, Kasif S, DeLisi C: Identification of functional links between genes using phylogenetic profiles. Bioinformatics. 2003, 19 (12): 1524-1530. 10.1093/bioinformatics/btg187.View ArticlePubMedGoogle Scholar
- Sprinzak E, Margalit H: Correlated sequence-signatures as markers of protein-protein interactions. J Mol Biol. 2001, 311: 681-692. 10.1006/jmbi.2001.4920.View ArticlePubMedGoogle Scholar
- Hayashida M, Ueda N: A simple method for inferring strengths of protein-protein interactions. Genome Informatics. 2004, 15: 56-68.PubMedGoogle Scholar
- Deng M, Mehta S, Sun F, Chen T: Inferring domain-domain interactions from protein-protein interactions. Genome Research. 2002, 12: 1540-1548. 10.1101/gr.153002.PubMed CentralView ArticlePubMedGoogle Scholar
- Lu L, Lu H, Skolnick J: MULTIPROSPECTOR : an algorithm for the prediction of protein-protein interactions by multimeric threading. PROTEINS: Structure, Function, and Genetics. 2002, 49: 350-364. 10.1002/prot.10222.View ArticleGoogle Scholar
- Smith GR, Sternberg MJE: Prediction of protein-protein interactions by docking methods. Current Opinion in Structural Biology. 2002, 12: 28-35. 10.1016/S0959-440X(02)00285-3.View ArticlePubMedGoogle Scholar
- Janin J, Henrick K, Moult J, Eyck LT, Sternberg MJE, Vajda S, Vakser I, Wodak SJ: CAPRI: A critical assessment of predicted interactions. PROTEINS: Strucrure, Function, and Genetics. 2003, 52: 2-9. 10.1002/prot.10381.View ArticleGoogle Scholar
- Carugo O, Franzot G: Prediction of protein-protein interactions based on surface patch comparison. Proteomics. 2004, 4: 1727-1736. 10.1002/pmic.200300692.View ArticlePubMedGoogle Scholar
- Brinda KV, Vishveshwara S: Oligomeric protein structure networks: insight into protein-protein interactions. BMC Bioinformatics. 2005, 6: 296-10.1186/1471-2105-6-296.PubMed CentralView ArticlePubMedGoogle Scholar
- Bock JR, Gough DA: Predicting protein-protein interactions from primary structure. Bioinformatics. 2001, 17: 455-460. 10.1093/bioinformatics/17.5.455.View ArticlePubMedGoogle Scholar
- Albert I, Albert R: Conserved network motifs allow protein-protein interaction prediction. Bioinformatics. 2004, 20: 3346-3352. 10.1093/bioinformatics/bth402.View ArticlePubMedGoogle Scholar
- Bock JR, Gough DA: Whole-proteome interaction mining. Bioinformatics. 2003, 19: 125-135. 10.1093/bioinformatics/19.1.125.View ArticlePubMedGoogle Scholar
- Huang Y, Frishman D, Muchnik I: Predicting protein-protein interactions by a supervised learning classifier. Computational Biology and Chemistry. 2004, 28: 291-301. 10.1016/j.compbiolchem.2004.08.001.View ArticleGoogle Scholar
- Lo SL, Cai CZ, Chen YZ, Chung MCM: Effect of training datasets on support vector machine prediction of protein-protein interactions. Proteomics. 2005, 5: 876-884. 10.1002/pmic.200401118.View ArticlePubMedGoogle Scholar
- van Noort V, Snel B, Huynen MA: Predicting gene functions by conserved co-expression. TRENDS in Genetics. 2003, 19: 238-242. 10.1016/S0168-9525(03)00056-8.View ArticlePubMedGoogle Scholar
- Zhou XJ, Kao MCJ, Huang H, Wong A, Nunez-Iglesias J, Primig M, Aparicio OM, Finch CE, Morgan TE, Womg WH: Functional annotation and network reconstruction through cross-platform integration of microarray data. Nature Biotechnology. 2005, 23 (2): 238-243. 10.1038/nbt1058.View ArticlePubMedGoogle Scholar
- Bard JBL, Rhee SY: Ontologies in biology: design, applications and future challenges. NATURE REVIEWS, GENETICS. 2004, 5: 213-222. 10.1038/nrg1295.View ArticlePubMedGoogle Scholar
- Rhodes DR, Tomlins SA, Varambally S, Mahavisno V, Barrette T, Kalyana-Sundaram S, Ghosh D, Pandey A, Chinnaiyan AM: Probabilistic model of the human protein-protein interaction network. Nature Biotechnology. 2005, 23: 951-959. 10.1038/nbt1103.View ArticlePubMedGoogle Scholar
- Lord PW, Stevens RD, Brass A, Goble CA: Investigating semantic similarity measures across the Gene Ontology: the relationship between sequence and annotation. Bioinformatics. 2003, 19 (10): 1275-1283. 10.1093/bioinformatics/btg153.View ArticlePubMedGoogle Scholar
- Wu H, Su Z, Mao F, Olman V, Xu Y: Prediction of functional modules based on comparative genome analysis and gene ontology application. Nucleic Acids Research. 2005, 33 (9): 2822-2837. 10.1093/nar/gki573.PubMed CentralView ArticlePubMedGoogle Scholar
- Wu X, Zhu L, Guo J, Zhang D-Y, Lin K: Prediction of yeast protein-protein interaction network: insights from the Gene Ontology and annotations. Nucleic Acids Research. 2006, 34 (7): 2137-2150. 10.1093/nar/gkl219.PubMed CentralView ArticlePubMedGoogle Scholar
- Nooren IMA, Thornton JM: Structural Characterization and functional significance of transient protein-protein interactions. J Mol Biol. 2003, 325: 991-1018. 10.1016/S0022-2836(02)01281-0.View ArticlePubMedGoogle Scholar
- Fujimori T, Miyazu T, Ishikawa K: Evaluation of analytical methods using signal-noise ratio as a statistical criterion. Microchemical Journal. 1974, 19 (1): 74-85. 10.1016/0026-265X(74)90103-9.View ArticleGoogle Scholar
- Camon E, Magrane M, Barrell D, Lee V, Dimmer E, Malsen J, Binns D, Harte N, Lopez R, Apweiler R: The gene ontology annotation (GOA) database: sharing knowledge in Uniprot with gene ontology. Nucleic Acids Research. 2004, 32 (1): D262-D266. 10.1093/nar/gkh021.PubMed CentralView ArticlePubMedGoogle Scholar
- Camon E, Barrell D, Dimmer E, Lee V, Magrane M, Malsen J, Binns D, Apweiler R: An evaluation of GO annotation retrieval for BioCreAtIvE and GOA. BMC Bioinformatics. 2005, 6 (suppl I): S17-10.1186/1471-2105-6-S1-S17.PubMed CentralView ArticlePubMedGoogle Scholar
- Couto FM, Silva MJ, Lee V, Dimmer E, Camon E, Apweiler R, Kirsch H, Rebholz-Schuhmann D: GOAnnotator: linking protein GO annotations to evidence text. Journal of Biomedical Discovery and Collaboration. 2006, 1: 19-10.1186/1747-5333-1-19.PubMed CentralView ArticlePubMedGoogle Scholar
- von Mering C, Krause R, Snel B, Cornell M, Oliver SG, Fields S, Bork P: Comparative assessment of large-scale data sets of protein-protein interactions. Nature. 2002, 417: 399-403. 10.1038/nature750.View ArticlePubMedGoogle Scholar
- Alfarano C, Andrade CE, Anthony K, Bahroos N, Bajec M, Bantoft K, Betel D, Bobechko B, Boutilier K, Burgess E: The biomolecular interaction network database and related tools 2005 update. Nucleic Acids Res. 2005, 33: D418-D424. 10.1093/nar/gki051.PubMed CentralView ArticlePubMedGoogle Scholar
- Güldener U, Münsterkötter M, Kastenmüller G, Strack N, van Helden J, Lemer C, Richelles J, Wodak SJ, Garcia-Martinez J, Perez-Ortin JE: CYGD: the comprehensive yeast genome database. Nucleic Acids Res. 2005, 33: D364-D368. 10.1093/nar/gki053.PubMed CentralView ArticlePubMedGoogle Scholar
- Li S, Armstrong CM, Bertin N, Ge H, Milstein S, Boxem M, Vidalain PV, Han JDJ, Chesneau A, hao T: A map of interactome network of the metazoan C. elegans. Science. 2004, 303: 540-543. 10.1126/science.1091403.PubMed CentralView ArticlePubMedGoogle Scholar
- Marcotte EM, Pellegrini M, Thompson MJ, Yeates TO, Eisenberg D: A combined algorithm for genome-wide prediction of protein function. Nature. 1999, 402: 83-86. 10.1038/47048.View ArticlePubMedGoogle Scholar
- Butland G, Peregrin-Alvarez JM, Li J, Yang W, Yang X, Canadien V, Starostine A, Richards D, Beattie B, Krogan N, Davey M, Parkinson J, Greenbaltt J, Emili A: Interaction network containing conserved and essential protein complexes in Escherichia coli. Nature. 2005, 433: 531-537. 10.1038/nature03239.View ArticlePubMedGoogle Scholar
- Tu K, Yu H, Li Y-X: Combining gene expression profiles and protein-protein interaction data to infer gene functions. Journal of Biotechnology. 2006, 124: 475-485. 10.1016/j.jbiotec.2006.01.024.View ArticlePubMedGoogle Scholar
- Liu Y, Liu N, Zhao H: Inferring protein-protein interactions through high-throughput interaction data from diverse organisms. Bioinformatics. 2005, 15: 3279-3285. 10.1093/bioinformatics/bti492.View ArticleGoogle Scholar
- Bairoch A, Boeckman B: The SwissProt protein sequence data bank. Nucleic Acids Research. 1992, 29: 2019-2022.View ArticleGoogle Scholar
- The Gene Ontology Consortium: Gene Ontology: tools for the unification of biology. Nature Genet. 2000, 25: 25-29. 10.1038/75556.PubMed CentralView ArticleGoogle Scholar
- Hazbun TR, Fields S: Networking proteins in yeast. Proc Natl Acad Sci USA. 2001, 98: 4277-4278. 10.1073/pnas.091096398.PubMed CentralView ArticlePubMedGoogle Scholar
- Dang H: Evaluation of the accuracy of Gene Ontology (GO) assignments to sequences and integration of GO in a cross-referencing database. [http://www.geneontology.org/meeting/Tucson-Abstracts-2002.html]
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.