Evading the annotation bottleneck: using sequence similarity to search non-sequence gene data
© Gilchrist et al; licensee BioMed Central Ltd. 2008
Received: 23 July 2008
Accepted: 17 October 2008
Published: 17 October 2008
Non-sequence gene data (images, literature, etc.) can be found in many different public databases. Access to these data is mostly by text based methods using gene names; however, gene annotation is neither complete, nor fully systematic between organisms, and is also not generally stable over time. This provides some challenges for text based access, especially for cross-species searches. We propose a method for non-sequence data retrieval based on sequence similarity, which removes dependence on annotation and text searches. This work was motivated by the need to provide better access to large numbers of in situ images, and the observation that such image data were usually associated with a specific gene sequence. Sequence similarity searches are found in existing gene oriented databases, but mostly give indirect access to non-sequence data via navigational links.
Three applications were built to explore the proposed method: accessing image data, literature and gene names. Searches are initiated with the sequence of the user's gene of interest, which is searched against a database of sequences associated with the target data. The matching (non-sequence) target data are returned directly to the user's browser, organised by sequence similarity. The method worked well for the intended application in image data management. Comparison with text based searches of the image data set showed the accuracy of the method. Applied to literature searches it facilitated retrieval of mostly high relevance references. Applied to gene name data it provided a useful analysis of name variation of related genes within and between species.
This method makes a powerful and useful addition to existing methods for searching gene data based on text retrieval or curated gene lists. In particular the method facilitates cross-species comparisons, and enables the handling of novel or otherwise un-annotated genes. Applications using the method are quick and easy to build, and the data require little maintenance. This approach largely circumvents the need for annotation, which can be a major obstacle to the development of genomic scale data resources.
Increasing amounts of gene sequence data are being held in databases around the world and methods continue to be developed that allow us to access these data in a convenient and informative manner. At the same time, large amounts of non-sequence gene data are also being collected, and efforts are being made to develop methods to store, access and retrieve these secondary data. Examples of this type of data would be in situ expression patterns, mutant phenotypes, scientific literature and 'gene pages' in model organism databases.
Analysis of access methods used by other image data providers
gene name, anatomy, or development stage
Allen Brain Atlas
gene name, accession numbers and other IDs, anatomy, or markers
gene, anatomy or development stage
gene, anatomical structure, developmental stage, GO terms, assay type
gene names, pre-computed orthologs, ontologies
found on Gene pages
gene name or key word
WISH Photo Browser
development stage, view or clone name
Expression Pattern Search
cell, cell group, or life stage
Expression Search Tools
development stage, or molecule ID
Search for Gene Expression Data
gene name, anatomy, or development stage, and other more specific terms, indirect via BLAST
Making the observation that in situ images are intrinsically associated with a sequence (the in situ probe), we hypothesised that a method based on sequence similarity searching might provide the power and accuracy needed, without the overhead of the annotation that would be required to create a gene name based application. If such an approach was successful, it would also generalise to other collections of data where the data are gene based and an identifiable sequence is associated with each piece of data. For example, sequence accession numbers are widely embedded in scientific literature, and to be able directly to access literature on the basis of sequence similarity would appear to be useful.
The general model of the method would be for the point of entry into the search process to be the sequence of the user's gene of interest. This sequence would be used to run a sequence similarity search (e.g. BLAST ), in the background, against a specifically prepared database of sequences associated with the target search data (such as images). The IDs of the matching sequences are linked to the target data, enabling the target data that matches the query sequence to be returned to the user. This effectively uses the query sequence as 'bait' to retrieve the non-sequence data. The signature of the method is the direct return of useful target data in response to the query sequence.
The sequence based search would retrieve data associated with sequences similar to, as well as identical to, the query sequence, and thus would enable data retrieval for related genes as well as the specific user's gene. This would have useful application in (for example) cross-species searches. Equally, there is no requirement for these to be gene sequences, and the method could be used for any type of biological data with a sequence.
A search for applications of the proposed method where it might already be in use drew a blank. Specifically we failed to find any instances of a sequence similarity search being used as the entry point for direct retrieval of image or other non-sequence gene data.
What we did find were (a) enhancement of the output of standard BLAST sequence searches with clickable links to other data where available, (b) BLAST searches leading to lists of sequences (without alignment detail) which acted as links to other data, and (c) pre-computed sequence similarity search results being used to link items within databases. The following are examples of these mechanisms. Probably the most familiar are the 'linkouts' in the results pages for NCBI BLAST . These linkouts take the user to various other of the NCBI family of databases, such as the PubMed literature databases  and the Entrez Gene database . They are undoubtedly useful, but the links must be followed separately to investigate the secondary data, and not all reported sequence matches have linkouts. One of a number of gene expression databases, 4DXpress  has an emphasis on cross-species comparison. Primary access to the data is through gene names, plasmid IDs, and temporal and spatial expression descriptors (stage, anatomy, etc.) via ontologies. A BLAST search can be performed, taking the user to lists of either systematic gene IDs or probe sequences from which further links lead to expression data. Access to data for orthologous genes in other species is provided by pre-computed relationships (from Ensembl ), and also for paralogous genes within species. The zebrafish model organism database, ZFIN , provides a facility much like the NCBI BLAST search, where the target database is the set of gene sequences which have expression data available, and image data for each gene is accessed via linkouts. While these examples demonstrate the usefulness of using sequence similarity searches and search results to link resources, they fall short of the type of search mechanism proposed here by not proceeding directly from the query sequence to the retrieved target data.
A number of other search methods of obvious utility were implemented in the databases we looked at, including development stage and anatomy based searches, and pattern matching methods. Image retrieval was also often provided based on plasmid ID or accession number, which is, at one level, a good proxy for the gene. However, it requires a very specialised knowledge to be familiar with enough IDs for this to be really useful, and we discount this as an effective method for gene based searches.
It seems clear that building a system that is based on the gene sequence, and independent of gene annotation, should confer a number of advantages:
no additional annotation or curation effort would be required, making applications easier to build and maintain
the mechanism would work just as well with genes of unknown function, or genes which are un-annotated for any other reason
data retrieval is not limited to the gene of interest but is extended to similar genes in a controlled fashion
data retrieval would be straightforwardly cross-species, with no concerns about how gene names varied between organisms
data retrieval would also operate across related genes with different names in the same organism
retrieved data for multiple genes would be intrinsically self-organising on a basis familiar to molecular biologists, i.e. evolution
Data management, search and retrieval methods have been widely investigated, and are well discussed in the literature (for examples in biology see [9–16], and also [17, 18] for some of the broader arguments). The topic of gene specific data retrieval has also received much attention, particularly in the context of literature searches, and the recent review by Kersey and Apweiler  provides a general insight into the problem. Possibly the most widely used literature search engine in biology, PubMed , is based on a text search; use of logical operators and a limits mechanism allow users to perform complex queries which can include gene and species names. Methods focused more specifically on genes, developed for literature retrieval, generally use data mining techniques to identify and disambiguate gene names and symbols in free text (see [20–23]), in order to use the text itself more effectively. iHOP  is another interesting example using natural language processing to much the same ends.
To test our hypothesis that the use of an indirect sequence similarity search method to retrieve gene based image data would prove effective and also generalise to other types of data, we set out to implement the method in image, literature and gene name searches.
Results and discussion
As anticipated, building applications to use an indirect sequence similarity search was straightforward, and required minimal data preparation. The applications performed as intended, and, with a common methodology, they shared many of the same software components.
We built three applications: quickImage, an image search engine, to fulfill our original goal for this project, quickLit, to retrieve gene-specific literature, and quickGene, a tool to explore gene names. All applications work cross-species, and are available as publicly accessible resources:
Discussion with colleagues in the ascidian research community provided early evidence of the attractiveness of the method for accessing large collections of image data, and we were able to combine a large number of Ciona intestinalis images with those from Xenopus laevis and Xenopus tropicalis.
The individual applications are described below, but first we describe the method generically, to avoid repetition and to make the underlying processes clear.
generic method for indirect sequence similarity search
(i) data preparation
The first step is to identify the data sources for the project, download the relevant data files, and extract the required data into a local managing database. The core part of this is the pairwise association of each piece of data with the sequence identifier(s) it is intrinsically related to, plus whatever other information is available to describe the data. Generally each source of data requires its own parser to be written, but these use simple computing tools and may be written in a few hours by a competent bioinformatician. The second step is to use the sequence identifiers to download the actual sequences from whichever database they are most conveniently available, and build a blastable database from these sequences, indexed on the sequence identifiers that have been stored in the managing database. To minimise BLAST search times care should be taken to ensure that this database only contains sequences leading to useful target data.
(ii) application logic
The search engine applications were built from our standard programming toolkit, but could easily be written in any suitable computer programming language. The primary requirements for such an application are that it can run a system level command (BLAST), that it can interact with an SQL database on the local network, and manage internet connectivity.
Sensitivity can be adjusted, as in any BLAST search, by setting the maximum E-value for reported results, and this is provided as a control for users.
This application uses the query sequence to search for biological image data where the images originated from sequences the same as or similar to the query sequence.
Contributing image collections for quickImage
image collection coordinator
collection location URL
type of collection
University of California, Berkeley
in situ images
University of Manchester, UK
in situ images
Universite Paris-Sud, Orsay, France
in situ images
Gurdon Institute, Cambridge, UK
morpholino screen with in situ images
in situ images
in situ images
Each image collection provided a set of image file names and related data, and the URL of the web folder containing the images, or the images themselves. The image collections had mostly adopted internally consistent and straightforward naming convention for the image files based on plasmid or sequence IDs, and the links between images and their source sequences were straightforwardly parsed into the managing database. The Harland image collection, which had grown over a period of time with a gene based naming convention and manually edited file names, was more of a challenge, and gave us an opportunity to develop guidelines for image file naming which will help with future submissions to this project. The Harland image file names were edited to include an accession number before being added to the current version of the search engine.
The file naming guidelines can be summarised as follows. File names should be built consistently, but most consistent schemes will work; names should not include spaces or other problem characters (+, =, /, etc.); sequence information should be included in the form of the plasmid name, accession number or local ID; experimental information (stage, view, etc.) may be embedded by means of short codes or integer values; embedded information within the name should be divided by hyphens, or other characters (e.g. underscores) so long as the character used does not otherwise appear in any of the parts of the name; names should be unique within a collection. Development stages should be expressed as precisely as possible. An example of a conforming name would be BC063191-IS-12-LAT.gif (in situ made using probe from sequence BC063191, stage 12 embryo, lateral view).
In this application the sequences identifiers are a mix of sequence accession numbers and plasmid IDs, although this did not affect our ability to download the corresponding sequences from the appropriate databases to build the blastable database. To assist the user in identifying imperfect matches to their query sequence, we provide best BLAST hit descriptions for the originating sequences from the NCBI protein database, for human, mouse and Xenopus. These data are made available as part of the results.
Images already on a public web server are accessed in their original locations; otherwise they are placed in a folder on our local web server. Whichever method is used, the search engine returns HTML placeholders for the images, containing the URL of the actual image location, from which the browser then loads the image itself. This helps to reduce the load on our web server and can decrease download time for users.
In practice the search engine works well, and the user is rewarded in a few seconds with sets of images for their gene, and/or genes with similar sequences. In general there is sufficient additional information to organise the images according to the collection, the type of experiment, and the temporal progression of development stages. The user can scroll through the sets of images, and also click on any image to view it full size. The user can also search for images from any combination of the available species.
We included the ability to perform key-word searches of the BLAST identification data, and this combines in a simple Boolean AND/OR fashion with the sequence based search (i.e. results are returned from either the sequence match or the key-word match, but will not be reported twice). Thus demonstrating that the sequence based method can easily be combined with more traditional text based methods, and logical operators.
BLAST performance was very good for this application: generally < 1 second at current sequence numbers. This is primarily because the number of sequences (see below) is small for a BLAST database.
At the time of writing quickImage provides access to 39,429 images associated with 6,807 source gene sequences from three species. We invite expressions of interest from holders of other model organism image collections who feel this approach might suit their data.
This application uses the query sequence to search for published literature containing references to sequences the same as or similar to the query sequence. The output is lists of articles with titles, authors, etc. and links to PubMed. Application data were downloaded in various formats from NCBI GenBank , FlyBase , WormBase  and SGD , which contained links between accession numbers or other sequence identifiers and data describing published articles and their related PubMed IDs. We found a general lack of gene specific literature references for some non-vertebrate organisms in the GenBank sequence entries (which most of the data came from), hence the inclusion of the model organism databases. In general from GenBank we used the RefSeq  data, except for Xenopus (which we have a particular interest in) where we used the nr database which has better coverage. We have not attempted to ensure complete coverage of all possible publications from all possible sources.
Initial analysis of the downloaded data showed that most of the sequence identifiers were only associated with genomics papers, which would be uninformative for the intended use. These were easily identified from the data by counting sequence identifiers per PubMed ID. A paper with 100 or more sequences referenced to it was designated a genomics paper, and such papers were removed from the database, as were the sequences which were only referenced by genomics papers. This made the BLAST searches proportionally, and significantly, quicker. After these operations the managing database contained 116,188 sequence identifiers, and 175,128 titles or PubMed IDs.
There was clearly an imbalance in the number of citations per sequence between the model organisms (fly, worm, yeast) incorporated into the search engine from their own databases, and the other organisms sourced from GenBank alone (data not shown). The greater numbers of references from the model organisms' databases are presumably a reflection on the model organisms' specific literature curation activities, while the literature associated accession numbers from GenBank are for " [p]ublications by the authors of the sequence that discuss the data reported in the record" (GenBank help page text).
BLAST performance was somewhat slower than for the image search application, but with approximately 20× more sequences, this was to be expected. By comparison, it was still much faster than searching one of the complete protein databases (e.g. RefSeq or nr from NCBI) because of the exclusion of sequences without references or those only referenced by genomics papers.
The disparity in numbers of references between the model organisms' databases and GenBank suggests that there are many more accession numbers embedded in papers than currently available in downloadable databases. A project to systematically mine all biological literature for accession numbers could generate a very powerful, gene based literature search tool. This emphasises the importance of including sequence accession numbers, as well as gene names, in journal submissions.
NCBI's Entrez Gene  is a key resource for gene based data, but occasionally, when searching for named genes, we feel it would be useful to know if the lists of gene entries returned were actually related to each other. The quickGene application was designed to address this. The application uses the query sequence to search NCBI's Entrez Gene data for entries with sequences the same as or similar to the query sequence. The output is lists of genes and links to Entrez Gene. Application data were downloaded from Entrez Gene. To reduce the BLAST search times and concentrate the search on the most likely interesting results, we used only the subset of data corresponding to the better known model organisms. To further speed up the search we retained only one protein sequence per gene entry. After loading, the managing database contained ~652,000 sequence identifiers and Entrez Gene IDs.
BLAST performance was again commensurate with the numbers of sequences to be searched, and was still less than 10 seconds for a ~400 residue protein. This was a little slower than for the other two applications because of the larger numbers of sequences.
application performance and validation
To show that our method performs as intended we needed to demonstrate that, for a given gene of interest, an application would retrieve all the data for that gene that were available. We chose to do this with the image data, implementing a text search mechanism in quickImage to perform an internal comparison between the sequences based method and a text based method. We selected a test set of arbitrary, but developmentally interesting, Xenopus genes, and investigated the performance of each one individually, comparing the images returned by the two methods. This approach was necessary because, although some of the images in the database were already annotated, most of them were not, and so the 'correct' total number of image sets for each gene was not known in advance.
It was not feasible to make meaningful, large-scale, systematic comparisons with other databases providing access to similar collections of data. Other expression image databases generally had quite different collections of images from ours, although there was overlap in some cases. For the literature and gene name applications the relationship between our data sets and the databases we downloaded the data from were much clearer, but there was no practical way of generating and assessing large-scale test data in the other databases.
Images in quickImage are grouped into image sets according to which image associated sequence they were derived from, and our comparison between the two retrieval methods was based on image sets. Text data to search against was provided by the BLAST hit descriptions from the best match between the image associated sequences and NCBI protein sequences for mouse, human, Xenopus laevis and Xenopus tropicalis. Data to search with, for each test gene, was collected from the NCBI Entrez Gene database , and consisted of the current gene symbol and the full gene name (as well as older aliases), and, retrieved via the indicated link, the longest reference mRNA sequence.
Comparison between the two retrieval methods was made as follows. First the mRNA was used to retrieve images by the sequence method, and the number of image sets retrieved for each gene was noted. Then an exhaustive text search was performed for each gene, variously using the current gene symbol, the whole and parts of the full gene name, older aliases and other commonly used names. For many of these searches, whether sequence or text based, images for other genes were retrieved along with the target gene images, and care was taken to disambiguate search results by inspection. In no cases did the text searches turn up any additional images for the target gene that the sequence based search had missed.
Comparison of text based and sequence based retrieval methods for image data for an arbitrary set of genes
numbers of image sets retrieved for target gene using different methods
current full name
mRNA accession or other identifier
with full-length mRNA
with current gene symbol
with trial and error text terms
hairy and enhancer of split 1
homeobox protein SIX1
BMP and activin membrane-bound inhibitor
bone morphogenetic protein 4
mRNA from Entrez Gene appears to be truncated, used EST-based contig sequence instead
fibroblast growth factor 8
LIM homeobox 1
SWI/SNF related, matrix associated, actin dependent regulator of chromatin, subfamily d, member 1
probe design sequences were in 3'UTR so there were no BLAST hits for text identification
SRY (sex determining region Y)-box 2
alias gene symbol 'sox-2' worked better than 'sox2'
T, brachyury homolog
a large number of protein descriptions contain the letter 't'
tumor protein p53
older alias gene symbol 'p53' retrieved both image sets
The relatively poor performance of the gene symbol in the text based search is attributable to the use of the BLAST hit descriptions as the text data to search against. These are generally close to the full name for the gene/protein, and may only contain the gene symbol by chance. Whilst this does mean that the full name may often work with text based retrieval, the full name for many genes may be difficult to recall exactly (e.g. "SRY (sex determining region Y)-box 2" for Xenopus tropicalis sox2), and even small differences may make the search fail.
Our test showed that the sequence based retrieval method works very well, and, although this is a relatively small number of genes, we have no reason to believe that the results are not broadly representative. The method is clearly not infallible. Searches will fail if there is no (or minimal) sequence overlap between the user's query sequence and the data-associated sequence for a given gene. Chances of this can be minimised by use of the longest appropriate sequences, both by the user as the query sequence, and by the application builder in the BLAST database of data associated sequences.
One of the great strengths of the method is the ability to search across different species for data from orthologous genes, without being affected by inconsistent gene naming schemes. This is also true for related genes within a species (for example, the Sox, HMG-Box and other families of transcriptions factors in human share sequence similarity). Furthermore, the retrieved data can be usefully ordered according to the approximate evolutionary relationship of the genes involved. The choice of mRNA or protein sequences to search with will affect the depth of detectable homology, as expected in a BLAST search, and may affect the range of genes that data is returned for. The retrieval and organisation of data for related genes can be seen quite clearly in Figures 2, 3, and 4.
Unknown or novel genes with typically uninformative database descriptions like 'hypothetical protein LOC23277' or 'novel zinc finger protein' are unlikely to be found usefully with a text search, unless these highly specific terms are known or very broad definitions needed. By contrast, the sequence based retrieval method works equally well with novel genes as with known genes. Of the 2,618 sequences underlying the Xenopus image data, 128 (5%) had only uninformative identifying best hit BLAST descriptions (in human, mouse, X. laevis and X. tropicalis), and are likely novel genes.
limitations of this approach
The main limitations of this approach are the requirement for the user to acquire a sequence for the gene of interest before they can do the search, the need to interpret the results sufficiently to distinguish between the gene of interest and related genes (and between actual orthologs and other homologs, across species), and the inability to search with standard gene symbols.
In addition, something that would need careful consideration for any implementation of our method is the impact on the overall search time of the BLAST search. BLAST search times are dependent on the size of the BLAST database, and for larger databases may eventually go beyond that which most users will cheerfully wait for. Depending on the importance of the data being sought, and the application strategies adopted to mitigate search times, this may become an issue. Application developers will need to evaluate typical BLAST search times for proposed databases, and ensure that the anticipated number of concurrent users does not overload the available hardware and create unacceptable delays in running searches.
Motivated by the need to provide access to large numbers of images accumulated by the Xenopus community, we have developed a novel approach to the problem of biological image data management. In the process we discovered that applying the same methodology to other sets of data can lead to effective search applications in different fields, particularly in literature searches where retrieved references show a high degree of relevance and are intrinsically well organised. We believe the method will have application to almost any collection of sequence based data, and will usefully extend the available repertoire of search tools and methods.
The advantages of this method of indirect sequence based retrieval are its independence of gene annotation, the ease of making cross-species comparisons, the elimination of the trial and error associated with gene name based systems, the accessibility of novel or otherwise un-annotated genes, the organisation of retrieved data in an intuitively obvious way, and the ability to build applications simply and quickly, with low maintenance overheads.
We suggest some other potential applications of the method. Firstly, it may be useful as an alternative way to access gene lists in (say) model organism databases, especially for researchers unfamiliar with a species and its gene naming conventions. Second, accession numbers provide the link between the gene data and the sequence, and many of these have associated Gene Ontology (GO) terms  available in public databases. This presents an opportunity to combine the power of ontology based queries with the simplicity of the sequence retrieval method. Third, the relatively future-proof mechanism of sequence based searching may appeal to community based projects like the proposed Gene Wiki  that rely on "small contributions from a large population of contributors" and may not have the resources to establish an ongoing maintenance programme. In a more general sense there are no obvious technical obstacles to incorporating the method into existing search interfaces for use where gene data is being sought.
acquiring and storing data
For quickImage, image related data were acquired directly from the image collections, usually in the form of a spreadsheet. This was parsed into a uniform SQL database format using simple computing tools (grep, SQL, etc.) as appropriate. One of the projects was already managed locally (Smith morpholino screen) and the data were simply transferred from one part of our database to another. For the other two applications, data files were downloaded by ftp from the various source databases and parsed in much the same manner as the image data.
downloading source sequences
For quickImage, lists of sequence accession numbers were uploaded to Entrez using the Entrez batch tool , and the returned sequences were downloaded directly into a fasta file. Other sequences were available internally from our EST database . cDNA sequences were used in preference to pairs of 5'/3' EST sequences from the same clone. Where a pair of ESTs was used the two sequences were merged if there was a detectable overlap, otherwise they were simply joined end to end with a poly-n linker between them. For the other two applications, it was generally more effective to download and manage a local copy of the NCBI 'nr' protein database, and then use the NCBI utility 'fastacmd' to extract unique sequence entries with lists of 'gi' numbers and the -t option from a blastable database of the nr sequences. Some work had to be done to remove duplicate entries, particularly from the literature data sets which were downloaded from several sources.
A blastable database of the sequences associated with the data to be retrieved was made for each application. Multiple databases (for example in quickImage, where there was a database per image collection) were joined using a .nal file to create a single effective database.
The user BLAST searches are run using blastn, tblastn, blastp or blastx as appropriate, allowing the user to set the maximum E-value and limit the number of returned hits, and using low-complexity filtering "for look-up table only". Tabular output is requested.
Details of the design and function of the computer program are not presented here, as they contain nothing particularly novel or unusual; the underlying ideas are not dependent on implementation detail, and the primary functional requirements (see above) are available in most web programming environments. Interested readers may view or download the source code from the project home page (see Availability and requirements, below). A zipped archive of the code at the time of writing is available as Additional file 1.
Availability and requirements
Project name: quickApps
Project home page: http://informatics.gurdon.cam.ac.uk/apps/quickApps/
Operating system(s): Windows 2000 and XP
Programming languages: C++, SQL
Other requirements: Apache, NCBI BLAST, SQL-Server, DOS
Source code: can be viewed and downloaded at the project home page
License: code is freely available under a BSD style license
This work has been supported in part by the European Commission funded Sixth Framework Programme for Research and Technological Development, Coordination Action X-OMICS (project N° 512065). We would like to acknowledge the work of a number of people in building up the various Xenopus image collections: at NIBB, Atsushi Kitayama and Hiroyo Nishide for their contribution to XDB; in the Harland Lab, Annie Chou, Neha Prakash, Vivian Choi, Samir Mehrotra, Mustafa Khokha, Tim Grammer and Andrea Wills; in the Papalopulu Lab, Julia Mason and Roz Friday; and in the Smith Lab, Amer Rana and Clara Collart. We are grateful to our colleagues in the ascidian community for their enthusiastic response to the ideas proposed in this paper, and for making available the wild type in situ image data from their model organism database, ANISEED. Particular thanks go to Patrick Lemaire for facilitating this, and to Fabrice Daian for organising the data to export to us. We would also like to gratefully thank NCBI, FlyBase, WormBase and SGD for making various components of the literature and gene data available for download, and acknowledge the enormous amount of work that goes into compiling these valuable collections of data. MG, JCS and NPa are funded by the Wellcome Trust. JCS wishes to acknowledge his involvement in Endotrack. We also thank the reviewers for their informed and useful suggestions.
- Seringhaus MR, Cayting PD, Gerstein MB: Uncovering trends in gene naming. Genome Biol 2008, 9(1):401. 10.1186/gb-2008-9-1-401PubMed CentralView ArticlePubMedGoogle Scholar
- Altschul SF, Madden TL, Schaffer AA, Zhang J, Zhang Z, Miller W, Lipman DJ: Gapped BLAST and PSI-BLAST: a new generation of protein database search programs. Nucleic acids research 1997, 25(17):3389–3402. 10.1093/nar/25.17.3389PubMed CentralView ArticlePubMedGoogle Scholar
- NCBI BLAST[http://blast.ncbi.nlm.nih.gov/]
- NCBI/MedLine PubMed[http://www.ncbi.nlm.nih.gov/PubMed]
- Maglott D, Ostell J, Pruitt KD, Tatusova T: Entrez Gene: gene-centered information at NCBI. Nucleic acids research 2007, (35 Database):D26–31. 10.1093/nar/gkl993Google Scholar
- Haudry Y, Berube H, Letunic I, Weeber PD, Gagneur J, Girardot C, Kapushesky M, Arendt D, Bork P, Brazma A, et al.: 4DXpress: a database for cross-species expression pattern comparisons. Nucleic Acids Res 2008, (36 Database):D847–853.Google Scholar
- Flicek P, Aken BL, Beal K, Ballester B, Caccamo M, Chen Y, Clarke L, Coates G, Cunningham F, Cutts T, et al.: Ensembl 2008. Nucleic acids research 2008, (36 Database):D707–714.Google Scholar
- Sprague J, Clements D, Conlin T, Edwards P, Frazer K, Schaper K, Segerdell E, Song P, Sprunger B, Westerfield M: The Zebrafish Information Network (ZFIN): the zebrafish model organism database. Nucleic acids research 2003, 31(1):241–243. 10.1093/nar/gkg027PubMed CentralView ArticlePubMedGoogle Scholar
- Ashburner M, Ball CA, Blake JA, Botstein D, Butler H, Cherry JM, Davis AP, Dolinski K, Dwight SS, Eppig JT, et al.: Gene ontology: tool for the unification of biology. The Gene Ontology Consortium. Nature genetics 2000, 25(1):25–29. 10.1038/75556PubMed CentralView ArticlePubMedGoogle Scholar
- Becker KG, Hosack DA, Dennis G Jr, Lempicki RA, Bright TJ, Cheadle C, Engel J: PubMatrix: a tool for multiplex literature mining. BMC Bioinformatics 2003, 4: 61. 10.1186/1471-2105-4-61PubMed CentralView ArticlePubMedGoogle Scholar
- Cannata N, Schroder M, Marangoni R, Romano P: A Semantic Web for bioinformatics: goals, tools, systems, applications. BMC Bioinformatics 2008, 9(Suppl 4):S1. 10.1186/1471-2105-9-S4-S1PubMed CentralView ArticlePubMedGoogle Scholar
- Guffanti A, Reid JF, Alcalay M, Simon G: The meaning of it all: web-based resources for large-scale functional annotation and visualization of DNA microarray data. Trends Genet 2002, 18(11):589–592. 10.1016/S0168-9525(02)02795-6View ArticlePubMedGoogle Scholar
- Krauthammer M, Nenadic G: Term identification in the biomedical literature. J Biomed Inform 2004, 37(6):512–526. 10.1016/j.jbi.2004.08.004View ArticlePubMedGoogle Scholar
- Malik R, Franke L, Siebes A: Combination of text-mining algorithms increases the performance. Bioinformatics 2006, 22(17):2151–2157. 10.1093/bioinformatics/btl281View ArticlePubMedGoogle Scholar
- Muller HM, Kenny EE, Sternberg PW: Textpresso: an ontology-based information retrieval and extraction system for biological literature. PLoS biology 2004, 2(11):e309. 10.1371/journal.pbio.0020309PubMed CentralView ArticlePubMedGoogle Scholar
- Raychaudhuri S, Chang JT, Imam F, Altman RB: The computational analysis of scientific literature to define and recognize gene expression clusters. Nucleic Acids Res 2003, 31(15):4553–4560. 10.1093/nar/gkg636PubMed CentralView ArticlePubMedGoogle Scholar
- Blumberg R, Atre S: The Problem with Unstructured Data. DM Review 2003.Google Scholar
- Shirky C: Ontology is Overrated: Categories, Links, and Tags.[http://www.shirky.com/writings/ontology_overrated.html]
- Kersey P, Apweiler R: Linking publication, gene and protein data. Nat Cell Biol 2006, 8(11):1183–1189. 10.1038/ncb1495View ArticlePubMedGoogle Scholar
- Finkel J, Dingare S, Manning CD, Nissim M, Alex B, Grover C: Exploring the boundaries: gene and protein identification in biomedical text. BMC Bioinformatics 2005, 6(Suppl 1):S5. 10.1186/1471-2105-6-S1-S5PubMed CentralView ArticlePubMedGoogle Scholar
- Fundel K, Zimmer R: Gene and protein nomenclature in public databases. BMC Bioinformatics 2006, 7: 372. 10.1186/1471-2105-7-372PubMed CentralView ArticlePubMedGoogle Scholar
- Podowski RM, Cleary JG, Goncharoff NT, Amoutzias G, Hayes WS: Suregene, a scalable system for automated term disambiguation of gene and protein names. J Bioinform Comput Biol 2005, 3(3):743–770. 10.1142/S0219720005001223View ArticlePubMedGoogle Scholar
- Yoneya T: PSE: a tool for browsing a large amount of MEDLINE/PubMed abstracts with gene names and common words as the keywords. BMC Bioinformatics 2005, 6: 295. 10.1186/1471-2105-6-295PubMed CentralView ArticlePubMedGoogle Scholar
- Hoffmann R, Valencia A: A gene network for navigating the literature. Nature genetics 2004, 36(7):664. 10.1038/ng0704-664View ArticlePubMedGoogle Scholar
- Ascidian Network for InSitu Expression and Embryological Data[http://aniseed-ibdm.univ-mrs.fr/]
- Benson DA, Karsch-Mizrachi I, Lipman DJ, Ostell J, Wheeler DL: GenBank. Nucleic acids research 2007, (35 Database):D21–25. 10.1093/nar/gkl986Google Scholar
- Wilson RJ, Goodman JL, Strelets VB: FlyBase: integration and improvements to query tools. Nucleic acids research 2008, (36 Database):D588–593.Google Scholar
- Rogers A, Antoshechkin I, Bieri T, Blasiar D, Bastiani C, Canaran P, Chan J, Chen WJ, Davis P, Fernandes J, et al.: WormBase 2007. Nucleic acids research 2008, (36 Database):D612–617.Google Scholar
- Dwight SS, Balakrishnan R, Christie KR, Costanzo MC, Dolinski K, Engel SR, Feierbach B, Fisk DG, Hirschman J, Hong EL, et al.: Saccharomyces genome database: underlying principles and organisation. Briefings in bioinformatics 2004, 5(1):9–22. 10.1093/bib/5.1.9PubMed CentralView ArticlePubMedGoogle Scholar
- Pruitt KD, Tatusova T, Maglott DR: NCBI reference sequences (RefSeq): a curated non-redundant sequence database of genomes, transcripts and proteins. Nucleic acids research 2007, (35 Database):D61–65. 10.1093/nar/gkl842Google Scholar
- Gilchrist MJ, Zorn AM, Voigt J, Smith JC, Papalopulu N, Amaya E: Defining a large set of full-length clones from a Xenopus tropicalis EST project. Developmental biology 2004, 271(2):498–516. 10.1016/j.ydbio.2004.04.023View ArticlePubMedGoogle Scholar
- Huss JW, Orozco C, Goodale J, Wu C, Batalov S, Vickers TJ, Valafar F, Su AI: A Gene Wiki for Community Annotation of Gene Function. PLoS biology 2008, 6(7):e175. 10.1371/journal.pbio.0060175PubMed CentralView ArticlePubMedGoogle Scholar
- NCBI Entrez batch tool[http://www.ncbi.nlm.nih.gov/sites/batchentrez]
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.