IDconverter and IDClight: Conversion and annotation of gene and protein IDs
© Alibés et al; licensee BioMed Central Ltd. 2007
Received: 07 April 2006
Accepted: 10 January 2007
Published: 10 January 2007
Researchers involved in the annotation of large numbers of gene, clone or protein identifiers are usually required to perform a one-by-one conversion for each identifier. When the field of research is one such as microarray experiments, this number may be around 30,000.
To help researchers map accession numbers and identifiers among clones, genes, proteins and chromosomal positions, we have designed and developed IDconverter and IDClight. They are two user-friendly, freely available web server applications that also provide additional functional information by mapping the identifiers on to pathways, Gene Ontology terms, and literature references. Both tools are high-throughput oriented and include identifiers for the most common genomic databases. These tools have been compared to other similar tools, showing that they are among the fastest and the most up-to-date.
These tools provide a fast and intuitive way of enriching the information coming out of high-throughput experiments like microarrays. They can be valuable both to wet-lab researchers and to bioinformaticians.
The databases that can help annotate our data are fast changing and rapidly increasing in number. This makes it more difficult to easily integrate this useful information to the output from the different types of high-throughput experiments and analyses of those experiments. But integrating the available data is crucial to gain further biological understanding of our results .
Output from microarray and other high-throughput experiments involves several thousands of gene, clone or protein identifiers. Comparing results from different experiments with different identifiers may require a non trivial and tedious conversion of IDs one by one. Also, collecting functional information for several thousand identifiers from different data sources may end up being too time consuming a task. Motivated by the necessity of researchers at our Institute to obtain this information in a reliable, up-to-date and easy manner, we developed IDconverter and IDClight, two complementary applications that retrieve data from the same source, but present it in different ways to cover different users' needs.
Conversions between gene and protein identifiers may be one-to-one or one-to-many. For instance, a user working with a given gene (e.g., p53), and starting from its HUGO name (TP53), may be interested in knowing the corresponding Ensembl gene ID (ENSG00000141510), its UniGene cluster ID (Hs.408312), but also the cDNA clones from GenBank that map to it ([GenBank:AF052180], [GenBank:NM_000546], [GenBank:AY429684], etc.), the KEGG pathways where it is involved (hsa04010, hsa04110, hsa04210, etc.) or whether any protein produced by this gene has been solved and its 3D structure is in the Protein Data Bank ([PDB:1A1U], [PDB:1AIE], [PDB:1C26], etc.). With the tools here presented, all this information and more is readily available with a simple query through an intuitive user interface.
There are some tools available with similar objectives (Resourcerer , Onto-Translate , SOURCE , MatchMiner , GeneMerge , and AnnBuilder ) which provide mappings between some identifiers, but in general they lack a link between two of the most used databases: those at NCBI  and Ensembl . In the Results section a comparison between some of these tools and the ones presented in this article is shown and discussed.
IDconverter and IDClight are integrated within Asterias , a new suite of tools for the analysis of genomic data. Output from all the applications on this suite can be enriched by adding a link to IDClight, provided that the user specifies the organism and type of identifier used. IDClight can also be linked from other external applications.
Both IDconverter and IDClight use data from a set of tables where, given our selection of databases, all possible conversions have already been pregenerated to ensure a quick answer to any query. This factor is specially important if we consider that some users need to convert the tens of thousands of gene IDs from a microarray experiment. Currently, the data in these pregenerated tables come from six different and publicly available databases: Ensembl , NCBI (UniGene and PubMed) , human chromosomal location from UCSC Genome Browser , KEGG pathway , and Reactome . The UniGene database is only available in a plain text format, requiring its transformation into a MySQL database to pregenerate the tables.
IDconverter front end is coded in PHP and IDClight is written in Python and uses the Apache module mod_python. Both applications run on an Apache web server and the databases are stored in a MySQL database server. To speed up the net waiting time from both tools, tables that store all possible conversions for each type of input identifier are periodically pregenerated (See additional file 1: Database schema for a brief description of the schema of the database where the pregenerated data is stored). IDconverter and IDClight run on two load-balanced servers with 2 dual core AMD processors each.
IDconverter is the application that allows the user to map in batch mode multiple identifiers and select which output (types of identifiers and format) she prefers. The input identifiers can be gene names (HUGO), GenBank accessions, UniGene cluster IDs, Ensembl gene IDs, Clone IDs, Affymetrix IDs, RefSeq RNAs, RefSeq peptides, Entrez genes IDs, and SwissProt names.
Special attention was paid when designing a user friendly Graphical User Interface, suitable for biologists. This interface design makes the tool easy to understand and use, which results in greater user acceptance and facilitates the usage and incorporation in the workflow of a microarray laboratory.
IDClight is a tool created as a light and fast web service to be used to enrich the output of other data analysis tools. It is designed to be easily linkable from any application as all the input information (ID, ID type and organism) is sent to the application as parameters in the URL. The same 10 identifiers that can be used with IDconverter are allowed as input in this application. All possible output identifiers and functional and bibliographic information available are then displayed, with the appropriate hyper links from each identifier.
We would like to stress that IDClight can be trivially linked from external applications, as it is being done by our tools SignS, Tnasas, GeneSrF, Pomelo II and ADaCGH, available from the Asterias suite . As an example, the URL to IDClight for the snapshot in Figure 2, looking for information on the mouse Ensembl gene ENSMUSG00000003123, is .
IDClight was launched on January 2006 and has been performing an average of 800 conversions per day.
Comparison with other similar tools
Several of the tools with similar objectives that have been presented in the Background section have been compared to IDconverter. Those selected were MatchMiner , SOURCE , and Onto-Translate , because they present features most similar to the IDconverter ones. Other tools have not been so throughly reviewed in detail for different reasons: Resourcerer  is a useful tool provided that the user wants to use as input one of the commonly used microarrays, but it is not possible to use with a list of identifiers chosen by the user; GeneMerge  has not been considered in this comparison because its choice of input and output identifiers is very limited; finally, AnnBuilder  is a very interesting R package, but it is not an application in itself and requires installing R and Bioconductor.
Comparison of conversion web applications
max num of IDs entered
max ID types in output
Java applet, registration required
SOURCE Batch Search 
MatchMiner Batch Lookup 
HTML, text, spreadsheet, GoMiner
No rat data
HTML, text, spreadsheet
The testing procedure consisted in using several lists of identifiers (See additional file 2: Description of the test data), focusing on the time necessary for different conversions and the number of input identifiers with a corresponding output ID. Twelve different conversions have been tested for all the tools where it was possible; from four different inputs (Affymetrix HGU133A IDs, HUGO, Entrez Gene IDs, and RefSeq_RNAs) to three outputs (GenBank accessions, UniGene cluster IDs, and RefSeq_peptides). For some tools and specific conversions, the tests could not be performed successfully in any of the three rounds of testing (25th–30th August, 2006, 19th–23rd October, 2006, and 20th December, 2006) because either the application crashed or did not return any results in a reasonable time. In those cases, partial or approximated results are shown.
To ensure a fair testing process, the web servers in the U.S. (MatchMiner, SOURCE, and Onto-Translate) were tested from the authors' center in Spain; IDconverter was tested from the U.S.
IDconverter was usually among the fastest applications in every conversion. Few of the large conversions took more than a minute. Those that were slower correspond to conversions from a gene identifier (like HUGO or Entrez Gene ID) to a clone identifier (such as GenBank accession).
SOURCE, for those 4 out of the 12 conversions tested that it is built to perform, was also among the fastest tools.
MatchMiner performed quite well for conversions to UniGene cluster, but it was slow for those to GenBank accession or to RefSeq_peptide. In some of the later cases it even crashed as it was not capable of handling the large output files.
Onto-Translate had a fast answer time for almost all conversions, except for the conversion of RefSeq_RNAs to GenBank accessions when, even if the allotted memory to the applet was increased to 256 Mb, it was not capable of returning results for large sets and for smaller ones it took several minutes.
It has to be taken into account that two of the tools here shown, IDconverter and SOURCE, allow the user to convert to multiple types of IDs on the same batch run. However the spectrum of conversions allowed for SOURCE is smaller than that of IDconverter (Figure 3).
From Figure 5, we can conclude that:
For those conversions using HUGO or Entrez Gene IDs as input, all four applications performed similarly, with values around 70–75%, except for the conversion Entrez Gene ID to GenBank accession or RefSeq_peptide, where Onto-Translate had a few more results and the conversion of Entrez Gene ID to RefSeq_peptide, where IDconverter had a few less.
For the Affymetrix ID conversions, the results depended on the output identifier; for two of them Onto-Translate was the most complete one, for the other it was IDconverter. As stated above, the results for MatchMiner are only upper boundaries.
For the conversions from RefSeq_RNA identifiers, MatchMiner performed best overall. Onto-Translate reached 100% with those conversions to RefSeq_peptide. IDconverter values were around 70% for GenBank accession and UniGene cluster and close to 97% for RefSeq_peptide.
On average and taking into account only those percentages evaluated with the complete lists, MatchMiner returned an ID for 84% of the input IDs in 8 successfully evaluated conversions, Onto-Translate for 81% (11 conversions), and SOURCE (4 conversions) and IDconverter (12 conversions) for 72%.
IDconverter and IDClight are a pair of tools that integrate some of the most used gene/clone/protein identifier conversions with several functional and bibliographic additional information. This is done in a easy-to-use, fast and up-to-date manner. Our commitment is to recreate the pregenerated tables every two months, following Ensembl update schedule, thus keeping all the conversions and additional information as updated as possible.
Availability and requirements
Project name: IDconverter and IDClight.
Operating system(s): Web-based application (*,†).
Programming language: Python (*,†) and PHP (*).
Other requirements: Web browser (*,†).
License: None (*,†).
Any restrictions to use by non-academics: None (*,†).
Note: * – IDconverter; † – IDClight.
We are grateful to the researchers at the Centro Nacional de Investigaciones Oncológicas and other users of these applications that have provided us with feedback information that helped find bugs and improve the applications' features. We thank Joaquín Dopazo for his involvement in the initial stages of IDconverter, Martti Tolvanen for extensively and carefully testing the data consistency, Iddo Friedberg for testing the time performance of IDconverter from La Jolla, CA, USA, and two anonymous reviewers for comments. Funding has been provided by Fundación de Investigatión Médica Mutua Madrileña and Project TIC2003-09331-C02-02 of the Spanish Ministry of Education and Science (MEC). RD-U is partially supported by the Ramón y Cajal programme of the Spanish MEC. Applications are running on a cluster of machines purchased with funds from the RTICCC from the Spanish FIS.
- Rhodes DR, Chinnaiyan AM: Integrative analysis of the cancer transcriptome. Nat Genet 2005, 37(Suppl):S31-S37. 10.1038/ng1570View ArticlePubMedGoogle Scholar
- Tsai J, Sultana R, Lee Y, Pertea G, Karamycheva S, Antonescu V, Cho J, Parvizi B, Cheung F, Quackenbush J: RESOURCERER: a database for annotating and linking microarray resources within and across species. Genome Biol 2001., 2(11):
- Khatri P, Sellamuthu S, Malhotra P, Amin K, Done A, Draghici S: Recent additions and improvements to the Onto-Tools. Nucleic Acids Res 2005, (33 Web Server):W762-W765. 10.1093/nar/gki472
- Diehn M, Sherlock G, Binkley G, Jin H, Matese JC, Hernandez-Boussard T, Rees CA, Cherry MJ, Botstein D, Brown PO, Alizadeh AA: SOURCE: a unified genomic resource of functional annotations, ontologies, and gene expression data. Nucl Acids Res 2003, 31: 219–223. 10.1093/nar/gkg014PubMed CentralView ArticlePubMedGoogle Scholar
- Bussey KJ, Kane D, Sunshine M, Narasimhan S, Nishizuka S, Reinhold WC, Zeeberg B, Ajay W, Weinstein JN: MatchMiner: a tool for batch navigation among gene and gene product identifiers. Genome Biol 2003, 4(4):R27. 10.1186/gb-2003-4-4-r27PubMed CentralView ArticlePubMedGoogle Scholar
- Castillo-Davis CI, Hartl DL: GeneMerge–post-genomic analysis, data mining, and hypothesis testing. Bioinformatics 2003, 19(7):891–892. 10.1093/bioinformatics/btg114View ArticlePubMedGoogle Scholar
- Zhang J, Carey V, Gentleman R: An extensible application for assembling annotation for genomic data. Bioinformatics 2003, 19: 155–156. 10.1093/bioinformatics/19.1.155View ArticlePubMedGoogle Scholar
- Wheeler DL, Barrett T, Benson DA, Bryant SH, Canese K, Chetvernin V, Church DM, DiCuccio M, Edgar R, Federhen S, Geer LY, Helmberg W, Kapustin Y, Kenton DL, Khovayko O, Lipman DJ, Madden TL, Maglott DR, Ostell J, Pruitt KD, Schuler GD, Schriml LM, Sequeira E, Sherry ST, Sirotkin K, Souvorov A, Starchenko G, Suzek TO, Tatusov R, Tatusova TA, Wagner L, Yaschenko E: Database resources of the National Center for Biotechnology Information. Nucleic Acids Res 2006, (34 Database):D173-D180. 10.1093/nar/gkj158
- Birney E, Andrews D, Caccamo M, Chen Y, Clarke L, Coates G, Cox T, Cunningham F, Curwen V, Cutts T, Down T, Durbin R, Fernandez-Suarez XM, Flicek P, Graf S, Hammond M, Herrero J, Howe K, Iyer V, Jekosch K, Kahari A, Kasprzyk A, Keefe D, Kokocinski F, Kulesha E, London D, Longden I, Melsopp C, Meidl P, Overduin B, Parker A, Proctor G, Prlic A, Rae M, Rios D, Redmond S, Schuster M, Sealy I, Searle S, Severin J, Slater G, Smedley D, Smith J, Stabenau A, Stalker J, Trevanion S, Ureta-Vidal A, Vogel J, White S, Woodwark C, Hubbard TJ: Ensembl 2006. Nucleic Acids Res 2006, (34 Database):D556–561. 10.1093/nar/gkj133
- Alibés A, Morrissey ER, Cañada A, Rueda OM, Casado D, Yankilevich P, Díaz-Uriarte R: Asterias: a parallelized web-based suite for the analysis of expression and aCGH data. Cancer Informatics, in press.
- Hinrichs AS, Karolchik D, Baertsch R, Barber GP, Bejerano G, Clawson H, Diekhans M, Furey TS, Harte RA, Hsu F, Hillman-Jackson J, Kuhn RM, Pedersen JS, Pohl A, Raney BJ, Rosenbloom KR, Siepel A, Smith KE, Sugnet CW, Sultan-Qurraie A, Thomas DJ, Trumbower H, Weber RJ, Weirauch M, Zweig AS, Haussler D, Kent WJ: The UCSC Genome Browser Database: update 2006. Nucleic Acids Res 2006, (34 Database):D590–598. 10.1093/nar/gkj144
- Kanehisa M, Goto S, Hattori M, Aoki-Kinoshita KF, Itoh M, Kawashima S, Katayama T, Araki M, Hirakawa M: From genomics to chemical genomics: new developments in KEGG. Nucleic Acids Res 2006, (34 Database):D354–357. 10.1093/nar/gkj102
- Joshi-Tope G, Gillespie M, Vastrik I, D'Eustachio P, Schmidt E, de Bono B, Jassal B, Gopinath GR, Wu GR, Matthews L, Lewis S, Birney E, Stein L: Reactome: a knowledgebase of biological pathways. Nucleic Acids Res 2005, (33 Database):D428-D432.
- Hoffmann R, Valencia A: A gene network for navigating the literature. Nat Genet 2004, 36(7):664. 10.1038/ng0704-664View ArticlePubMedGoogle Scholar
- IDClight example[http://IDClight.bioinfo.cnio.es/idclight.prog?id=ENSMUSG00000003123&idtype=ensembl&org=Mm]
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.