- Open Access
dictyExpress: a Dictyostelium discoideum gene expression database with an explorative data analysis web-based interface
BMC Bioinformaticsvolume 10, Article number: 265 (2009)
Bioinformatics often leverages on recent advancements in computer science to support biologists in their scientific discovery process. Such efforts include the development of easy-to-use web interfaces to biomedical databases. Recent advancements in interactive web technologies require us to rethink the standard submit-and-wait paradigm, and craft bioinformatics web applications that share analytical and interactive power with their desktop relatives, while retaining simplicity and availability.
We have developed dictyExpress, a web application that features a graphical, highly interactive explorative interface to our database that consists of more than 1000 Dictyostelium discoideum gene expression experiments. In dictyExpress, the user can select experiments and genes, perform gene clustering, view gene expression profiles across time, view gene co-expression networks, perform analyses of Gene Ontology term enrichment, and simultaneously display expression profiles for a selected gene in various experiments. Most importantly, these tasks are achieved through web applications whose components are seamlessly interlinked and immediately respond to events triggered by the user, thus providing a powerful explorative data analysis environment.
dictyExpress is a precursor for a new generation of web-based bioinformatics applications with simple but powerful interactive interfaces that resemble that of the modern desktop. While dictyExpress serves mainly the Dictyostelium research community, it is relatively easy to adapt it to other datasets. We propose that the design ideas behind dictyExpress will influence the development of similar applications for other model organisms.
Public databases of results from high-throughput experiments are abundant and extremely useful, but most biologists lack the training in computer programming to effectively explore and interact with the data. A solution to this problem is afforded by recent developments in information technology, which facilitate the development of web-based systems that support interaction and explorative data analysis. These systems require only basic web-surfing skills and modest computer power, but may deliver powerful data analysis capabilities to the biologist's fingertips. The major advantages of these systems over first-generation web applications is that they provide the look and feel of a desktop application within a web browser window, with intuitive visualization and the availability of helpful hints through techniques such as term-completion and tagging. Instead of the infamous "Submit" button and the corresponding switch from one web page to another, modern systems employ an interactive, single-screen interface, which adapts to the user's data and actions. Such interfaces are used in many popular applications, such as e-mail browsers, spreadsheets, words processors, and social networking websites, but the field of bioinformatics has yet to adopt these new technologies.
In this paper, we report on the development of a gene expression database and its corresponding web application, dictyExpress http://www.ailab.si/dictyExpress, that we consider to be a pioneering attempt at this change. This application is designed around a repository of gene expression data from microarray experiments in the social amoeba Dictyostelium discoideum. Dictyostelium is a popular organism in which individual cells aggregate upon starvation and differentiate into fruiting bodies that consist of two major cell types – spores and stalks. This organism is a convenient model system for the study of cell motility, chemotaxis, development, social behaviour and more, and the availability of global gene expression profiles greatly facilitates these studies. Until now, gene expression profiles of this popular system have been deposited in public databases and some of them are available as static graphs on the organism's central web site, dictyBase http://www.dictybase.org. These graphs depict individual gene expression profiles as they change during development of the wild type strain, but they do not allow curious biologists to explore gene expression in other strains, or interact with the data in any other way.
Dealing with time is central in Dictyostelium development. dictyExpress was developed to specifically address time, and to provide optimized procedures for retrieval, visualization and interactive analysis of time-series data. The result of this effort is a comprehensive, electronically-accessible database of all the Dictyostelium expression data published by the Functional Genomics Project at Baylor College of Medicine, featuring a web-based application that can query the database and perform sophisticated data mining tasks. The web interface can be easily expanded to include additional tools and adapted to the analysis of other public databases. In this paper, we provide the overall description of both the database and the website components of dictyExpress. We then focus on the web-based exploratory environment, which we regard as the major original contribution of our work.
dictyExpress is composed of a MS SQL database, software for data management and retrieval, data analysis software and a client web-based application (Figure 1). The data management and retrieval part is written within MS SQL, and it interfaces with the Bioconductor suite  for data normalization and pre-processing. The system provides data to external clients through a programmatic, HTTP-based interface. The client web application, developed in FLASH within the FLEX open source development framework http://www.adobe.com/products/flex/, offers a number of data analysis procedures, mainly relying on an analytics server that either performs the analysis on the fly (e.g., clustering, or network construction), or fetches stored results of previous analyses (e.g., gene similarity scoring). The dictyExpress database server is freely accessible. In contrast, the dictyExpress analytics server, which also implements an HTTP-based programmatic interface, is available only to dictyExpress client-specific requests. The analytics server is powered by the Orange data mining suite [2, 3] to process profile similarity scoring, clustering and dendrogram optimization, and Gene Ontology term enrichment analysis.
A critical issue with dictyExpress is the performance of the analytics server, which carries all the computational load of the application and is a potential bottleneck in the system. We have developed a dedicated web application to estimate the response time under different loads of the server, and are monitoring its performance daily. An expansion to a server farm is planned if the current, multi-core server will become insufficient.
Results and discussion
dictyExpress provides access to over 1057 expression array experiments from the BCM Functional Genomics group. The web interface (Figure 2) includes components for data retrieval, selection of individual genes or groups of genes, graphic display of gene expression time courses, Gene Ontology term enrichment analysis, display of gene co-expression networks, hierarchical clustering, and expression profile visualization of a selected gene in different experiments. Most importantly, the components are "connected" such that a change in any one of the components (e.g., selection of a gene subset from the hierarchical clustering dendrogram) can propagate to other components and their associated visualizations. Visual interaction is also incorporated into data retrieval: a user can, for example, hand-draw an approximate gene expression profile and dictyExpress would find and display genes that match it.
Content of the dictyExpress database
As of March 2009, the dictyExpress database included data from over 1057 expression array experiments collected from wild type and from 24 mutant strains that were grown in HL5 liquid suspension and developed on nitrocellulose filters [4–12]. All of the microarrays were printed with cDNA and genomic DNA fragments that were amplified by PCR. All the experiments were done by comparative hybridization where each sample (e.g., a particular time point in development) was compared with a common pool of RNA samples form various time points in Dictyostelium development. In most of the experiments, gene expression was observed at 13 different time points (2-hour intervals during the 24-hour developmental time course). A list of Dictyostelium strains, time points at which the data were recorded, and the number of replication measurements is provided on the application home page.
User interface and analytical functions
Six different components make up the graphical user interface of the dictyExpress web application:
Gene Expression Query is where the user selects the desired experiments and defines the genes of interest. Experiment filtering (strain name, treatment or growth conditions should match all of the entered search terms) and gene name completion are also supported. The names in the gene selection list are clickable and the links lead to the corresponding dictyBase gene home page.
Expression Profile displays gene expression profiles (time-series) for the given experiment and the set of selected genes. Any profile can be selected form the visualization, and may be followed by a request to search for genes with similar expression profiles. The user may also hand-draw a hypothetical profile using the 'freehand' option and search for genes with a similar behaviour.
Hierarchical Clustering considers a list of selected genes and displays a corresponding dendrogram with associated gene names, gene IDs and textual annotations. A heat map, representing the expression time-series, can also be visualized, thus providing a standard dendrogram-heat map visualization that researchers have become familiar with in recent years . The dendrogram is clickable, allowing the user to select any branch and its corresponding genes.
Gene Ontology displays the results of a term-enrichment analysis in which the selected genes serve as the query and all the genes from the experiment serve as the reference set. The display follows the visual design proposed by the enrichment analysis application GOAT , and provides information on the enrichment scores and associated p-values. Reports on each of the three Gene Ontology aspects (molecular function, biological process and cellular component) can be accessed separately.
Co-expression Network considers a single reference gene and displays a neighbourhood network of the most similar genes. The application uses the same profile similarity measures as the gene clustering application. The networks are drawn so that the most distant gene in the network is up to 3 hops away from the target gene. Double-clicking on any gene makes it the reference component, and results in redrawing the network accordingly.
Experiment Comparison displays expression profiles of a reference gene in several (selected) experiments. Double-clicking on any of the profiles makes the corresponding experiment the current one and updates the content of all the other components, while retaining the current selection of genes.
The web-based interface of dictyExpress also implements a set of supporting functions that are available through the applications menu bar (see Figure 2, upper left part of the snapshot). These include data export (of selected genes or the entire experiment), bookmarking of the current view (the experiment and the selected genes will be stored in a bookmark) or, alternatively, copying the permalink (web link to the application and current selection of experiment and genes) to the clipboard, sending an e-mail with an embedded link to the current view, and crafting a PDF report of the current view.
Explorative data analysis
The central design principle used in crafting the dictyExpress web application was interactivity. Most of the visual presentations we implement are clickable: the user can select a gene subset by clicking on a branch of the dendrogram or select a term in the Gene Ontology annotation. A gene in the co-expression network can be selected by clicking on any of the networks nodes, by selecting the corresponding trajectory in the Expression Profile component, or by selecting a corresponding column in the hierarchical clustering dendrogram. Gene selections are communicated across the different components of the application, either upon manual request (pressing the "Update" button in the corresponding window would modify the set of selected genes in all the other components) or automatically (e.g., selection of a single gene in the dendrogram highlights the corresponding profile in the Expression Profiles and triggers the rendering of a co-expression network around this particular gene).
Another useful feature implemented in dictyExpress is an explicit search for similarly expressed genes (Figure 3). The user selects a target gene in the Expression Profile or in the Hierarchical Clustering components and the search is invoked by pressing the "Find similarly expressed genes" button.
All of the features listed above contribute to the implementation of explorative data analysis, where the visual presentation of the data guides the user on which genes to focus next and what gene expression profiles to consider. This interactivity sets dictyExpress apart from other current web-based gene expression analysis applications.
Electronic access to the dictyExpress database
The data in the dictyExpress repository are available through a programmatic (HTTP) data access. The user can query for raw microarray data, normalized data, and time series data, obtain various mapping schemas, such as the one between microarray spot ID and gene ID, and access various annotations of the experiments. The following links are a few examples of HTTP queries in dictyExpress:
http://www.ailab.si/dictyexpress/api/index.php?action=spot_id_mapping returns a mapping from microarray spots to gene names and IDs
http://www.ailab.si/dictyexpress/api/index.php?action=get_annotation_options&query=49***true&annotation_object_id=4 lists all the biological samples in the data base
http://www.ailab.si/dictyexpress/api/index.php?action=get_ts_data&query=4***mek1-|||6***none|||3***unknown&gene_ids=65097,65096,61518,63686,68277,65524 returns the time series expression data for six genes (given are their repository IDs) for an experiment done with the mek1- knockout mutant where no treatment was applied and where the growth conditions are not specified.
The detailed documentation on the syntax of HTTP dictyExpress queries, along with more examples that illustrate their use, is available on-line at http://www.ailab.si/dictyexpress/api.
dictyExpress provides a public database of gene expression data for a popular model organism and an original web-based application for data exploration. The prototype of the system has been launched in September 2008. As of April 2009, dictyBase includes direct links to dictyExpress from the gene home pages. Following these links, dictyExpress displays the wild-type expression profile for a selected gene, and supports the user for further exploration. The users are able to test the expression of their gene of interest in the wild type and in the mutant strains, and use the application for exploring the Dictyostelium transcriptome, shuttling back and forth to dictyBase in order to explore the annotations of interesting genes.
dictyExpress has an enormous value to the entire community. Currently, it allows researchers to explore a large database of expression arrays without having knowledge in data mining or access to powerful computers and expensive software. Eventually, we anticipate that other research communities will adopt this approach so that public databases of gene expression arrays would become readily available to the public.
Availability and requirements
dictyExpress can be accessed at http://www.ailab.si/dictyExpress. The software is platform-independent and runs in all major browsers with a Flash player plug-in. It has been tested within the Firefox, Internet Explorer and Safari web browsers.
Microarray normalization and pre-processing
The pre-processing pipeline incorporates the LIMMA package  in R/BioConductor  for quality control and normalization. Within chip normalization is performed using the 'printtip loess' normalization function in LIMMA. Along with normalized intensities two statistics are calculated for each chip: chip quality, and median signal intensity. Chip quality is characterized by correlation between on-chip replication, and can be used to filter for high quality chips. Median signal intensities are stored for efficient scaling for between chip normalization.
Gene expression profile similarity scoring
Gene expression profiles in dictyExpress are time sequences mainly consisting of 13 developmental time points that were analyzed with a custom cDNA array (Van Driessche et al. 2002). Several analysis components, including the one for clustering, gene co-expression network construction and search for similar expression profiles rely on the scoring of a pair-wise profile distance. We use three alternative standard similarity measures: Euclidian distance (squared sum of squared per-point distances), Pearson's correlation (standard Pearson product-moment correlation coefficient) or Manhattan distance (squared sum of absolute per-point distances).
Gene expression clustering
Gene expression profiles are clustered using agglomerative hierarchical clustering , where the user can choose between average, single, or complete linkage. The layout of the dendrogram is optimized to minimize the gene expression profile distances between neighbouring leaves .
GO term enrichment analysis
The hypergeometric distribution is used to compute the enrichment of Gene Ontology terms  for the selected subset of genes. All the other genes in the experiment constitute the reference set. For the display of the results we have borrowed the visualization from GOAT , which shows ontology branches of enriched terms together with the corresponding p-values and enrichment scores.
Gene co-expression network
Co-expression networks are developed around a user-selected target gene and its neighbours with similar expression profiles. For reasons of obtaining reasonable response times, we use the following heuristics to define which genes to consider in the network. Network genes are gathered starting from the target gene, including its five most similar neighbours and the procedure is iteratively repeated on the newly added genes up to three times (according to a user-defined parameter). Only edges that link the most similar genes are shown in the visualization, and they are selected such that the average connectivity of the genes in the network is 5.0. The networks are developed on the analytics server from pre-processed data that includes a list of 20 closest neighbours for each similarity measure and each gene. This particular network construction algorithm is speed-efficient and heuristically constructs networks that are close to those we would obtain through extensive search and computation of the entire similarity matrix.
Gentleman RC, Carey VJ, Bates DM, Bolstad B, Dettling M, Dudoit S, Ellis B, Gautier L, Ge Y, Gentry J, et al.: Bioconductor: open software development for computational biology and bioinformatics. Genome Biol 2004, 5(10):R80. 10.1186/gb-2004-5-10-r80
Demsar J, Zupan B, Leban G, Curk T: Orange: from experimental machine learning to interactive data mining. In European Conference of Machine Learning: 2004; Pisa, Italy. Springer Verlag; 2004:537–539.
Curk T, Demsar J, Xu Q, Leban G, Petrovic U, Bratko I, Shaulsky G, Zupan B: Microarray data mining with visual programming. Bioinformatics 2005, 21(3):396–398. 10.1093/bioinformatics/bth474
Booth EO, Van Driessche N, Zhuchenko O, Kuspa A, Shaulsky G: Microarray phenotyping in Dictyostelium reveals a regulon of chemotaxis genes. Bioinformatics 2005, 21(24):4371–4377. 10.1093/bioinformatics/bti726
Good JR, Cabral M, Sharma S, Yang J, Van Driessche N, Shaw CA, Shaulsky G, Kuspa A: TagA, a putative serine protease/ABC transporter of Dictyostelium that is required for cell fate determination at the onset of development. Development 2003, 130(13):2953–2965. 10.1242/dev.00523
Katoh M, Shaw C, Xu Q, Van Driessche N, Morio T, Kuwayama H, Obara S, Urushihara H, Tanaka Y, Shaulsky G: An orderly retreat: Dedifferentiation is a regulated process. Proc Natl Acad Sci USA 2004, 101(18):7005–7010. 10.1073/pnas.0306983101
Kibler K, Svetz J, Nguyen TL, Shaw C, Shaulsky G: A cell-adhesion pathway regulates intercellular communication during Dictyostelium development. Dev Biol 2003, 264(2):506–521. 10.1016/j.ydbio.2003.08.025
Mendoza MC, Booth EO, Shaulsky G, Firtel RA: MEK1 and protein phosphatase 4 coordinate Dictyostelium development and chemotaxis. Mol Cell Biol 2007, 27(10):3817–3827. 10.1128/MCB.02194-06
Van Driessche N, Alexander H, Min J, Kuspa A, Alexander S, Shaulsky G: Global transcriptional responses to cisplatin in Dictyostelium discoideum identify potential drug targets. Proc Natl Acad Sci USA 2007, 104(39):15406–15411. 10.1073/pnas.0705996104
Van Driessche N, Demsar J, Booth EO, Hill P, Juvan P, Zupan B, Kuspa A, Shaulsky G: Epistasis analysis with global transcriptional phenotypes. Nat Genet 2005, 37(5):471–477. 10.1038/ng1545
Van Driessche N, Shaw C, Katoh M, Morio T, Sucgang R, Ibarra M, Kuwayama H, Saito T, Urushihara H, Maeda M, et al.: A transcriptional profile of multicellular development in Dictyostelium discoideum. Development 2002, 129(7):1543–1552.
Xu Q, Ibarra M, Mahadeo D, Shaw C, Huang E, Kuspa A, Cotter D, Shaulsky G: Transcriptional transitions during Dictyostelium spore germination. Eukaryot Cell 2004, 3(5):1101–1110. 10.1128/EC.3.5.1101-1110.2004
Weinstein JN: Biochemistry. A postgenomic visual icon. Science 2008, 319(5871):1772–1773. 10.1126/science.1151888
Xu Q, Shaulsky G: GOAT: an R tool for analyzing Gene Ontology term enrichment. Applied Bioinformatics 2005, 4(4):281–283. 10.2165/00822942-200504040-00008
Smyth GK: limma: Linear Models for Microarray Data. In Bioinformatics and Computational Biology Solutions Using R and Bioconductor. Edited by: Gentleman R, Carey V, Dudoit S, Irizarry R, Huber W. New York: Springer; 2005:397–420.
Tan P-N, Steinbach M, Kumar V: Introduction to data mining. Boston, MA: Pearson Education; 2005.
Bar-Joseph Z, Gifford DK, Jaakkola TS: Fast optimal leaf ordering for hierarchical clustering. Bioinformatics 2001, 17(Suppl 1):S22–29.
Ashburner M, Ball CA, Blake JA, Botstein D, Butler H, Cherry JM, Davis AP, Dolinski K, Dwight SS, Eppig JT, et al.: Gene ontology: tool for the unification of biology. The Gene Ontology Consortium. Nat Genet 2000, 25(1):25–29. 10.1038/75556
We thank Bill Loomis for critical testing of dictyExpress and for encouraging discussions. This work was supported by a grant from the National Institute of Health (P01-HD39691) and grants from the Slovenian Research Agency (P2-0209, J2-9699, L2-1112). AP was supported by a fellowship from the Keck Center for Interdisciplinary Bioscience Training of the Gulf Coast Consortia (NIH Grants 1 T90 DA022885 and 1 R90 DA023418).
BZ and GS conceived the project and the initial design. AP developed the dictyExpress database server and its HTTP interface. GR implemented the web-based interface and designed the corresponding web pages. Server-based data analysis scripts were implemented by TC, BZ and GR. GS and AK provided the test data and performed user testing. All the authors drafted the manuscript and read and approved its final version.
Gregor Rot, Anup Parikh contributed equally to this work.