 Methodology Article
 Open access
 Published:
Interactive knowledge discovery and data mining on genomic expression data with numeric formal concept analysis
BMC Bioinformatics volume 17, Article number: 374 (2016)
Abstract
Background
Gene Expression Data (GED) analysis poses a great challenge to the scientific community that can be framed into the Knowledge Discovery in Databases (KDD) and Data Mining (DM) paradigm. Biclustering has emerged as the machine learning method of choice to solve this task, but its unsupervised nature makes result assessment problematic. This is often addressed by means of Gene Set Enrichment Analysis (GSEA).
Results
We put forward a framework in which GED analysis is understood as an Exploratory Data Analysis (EDA) process where we provide support for continuous human interaction with data aiming at improving the step of hypothesis abduction and assessment. We focus on the adaptation to human cognition of data interpretation and visualization of the output of EDA.
First, we give a proper theoretical background to biclustering using Lattice Theory and provide a set of analysis tools revolving around \(\mathcal {K}\)Formal Concept Analysis (\(\mathcal {K}\)FCA), a latticetheoretic unsupervised learning technique for realvalued matrices.
By using different kinds of cost structures to quantify expression we obtain different sequences of hierarchical biclusterings for gene under and overexpression using thresholds. Consequently, we provide a method with interleaved analysis steps and visualization devices so that the sequences of lattices for a particular experiment summarize the researcher’s vision of the data. This also allows us to define measures of persistence and robustness of biclusters to assess them.
Second, the resulting biclusters are used to index external omics databases—for instance, Gene Ontology (GO)—thus offering a new way of accessing publicly available resources. This provides different flavors of gene set enrichment against which to assess the biclusters, by obtaining their pvalues according to the terminology of those resources.
We illustrate the exploration procedure on a real data example confirming results previously published.
Conclusions
The GED analysis problem gets transformed into the exploration of a sequence of lattices enabling the visualization of the hierarchical structure of the biclusters with a certain degree of granularity. The ability of FCAbased biclustering methods to index external databases such as GO allows us to obtain a quality measure of the biclusters, to observe the evolution of a gene throughout the different biclusters it appears in, to look for relevant biclusters—by observing their genes and what their persistence is—to infer, for instance, hypotheses on their function.
Background
In the present framework to analyze Gene Expression Data (GED)—be it on microarray expression profiles [1] or the more recent and higher quality profiles obtained by the socalled Next Generation Sequencing (NGS) [2–4]— the data are eventually represented as a gene expression matrix \(X\in \mathbb {R}^{m\times {n}}\) with m rows representing genes and n columns representing each an empirical sample or condition.
Initially, clustering genes by gene expression similarity was the technique of choice to try to induce what proteins are being synthesized under what conditions in different samples of cells. The inception of insights about gene behavior are then facilitated by these groupings.
However, comparisons of different clustering algorithms applied to gene expression [5–7] did not lead to clear conclusions about their performance since the results are highly depending on the data analyzed. The unsupervised nature of GED analysis problem also prevents a systematic evaluation of algorithms, since in most situations there is no previously defined groundtruth.
Also, the idea of nonoverlapping clusters or partitional clusterings might not be adequate, since overlapping functional relations between genes or similarities of conditions are obscured in such clusterings. Further technical difficulties are the need fora priori choosing a distance metrics and, for some popular methods like kmeans [8] or selforganizing maps (SOM) [9] an a priori knowledge of the number of clusters.
Some of these problems can be solved by Exploratory Data Analysis (EDA) [10], but basic clustering techniques lack the interactivity and flexibility capabilities desirable in a tool design for exploration. Hierarchical clustering is an alternative for solving the exploratory difficulties producing a dendrogram that not only identifies the clusters but also the similarity between them, and allows a certain overlap in the explored clusters, though not on the finally chosen ones. Its lack of robustness is its main drawback [11].
Another limitation of clustering is that the domain of the analysis, i.e. whether to group genes or empirical samples, also needs to be decided a priori and either one or the other may be applied. Biclustering [12], also known as coclustering or twomode clustering, provides us with the possibility of simultaneously performing both combining genes and sample groupings. The intuition is that the transcription of genes sampled under differing expression conditions can be modeled as the aggregation of the effect of different biologicallyplausible phenomena, having their computational correlates in biclusters, pairs of sets of indices into the genes and conditions in a gene expression matrix. In the last few years, biclustering has emerged as the unsupervised method of choice for GED [1, 13, 14].
For instance, the authors of the Iterative Signature Algorithm (ISA) [15, 16] posited the existence of transcription modules—these being the coupled sets of conditions and genes— whereby the expression level of a particular gene g in a condition c is an aggregation of the discretized activities of all the transcription modules g and c belong to:
where k∈{1,…,p} ranges over the possible transcription modules or factors, P∈{0,1}^{m×p} is a matrix each of whose columns P _{·k }∈{0,1}^{m} is a promoter vector describing if transcription factor k activates each gene and A∈{0,1}^{n×p} is a matrix each of whose columns A _{·k }∈{0,1}^{n} is a vector describing whether the transcription factor k is active in condition c. Both of these kinds of vectors are sparse: ISA first discretizes the geneexpression matrix X into I by means of gene and conditionrelative thresholds φ _{ g } and φ _{ c }, respectively, and then carries out the bicluster analysis. Note, also, the relationship of such models to Nonnegative Matrix Factorization (NMF).
A prevalent phenomenon in gene expression measurement is that due to experimental variation, thermodynamical fluctuations and other uncontrolled conditions, measurements are quite noisy, and often include a number of outliers, the advantages of NGS over conventional microarrays in this respect notwithstanding. For this reason, the generative multiplicative model for K biclusters used in e.g. FABIA [14] includes an error model. The generic form of this model is:
where the λ _{ k } are the prototype gene expression vectors containing zeros for genes not participating in the bicluster, z _{ k } are the vectors containing zeros for conditions not participating in the bicluster, and Ψ is an error matrix, to be minimized. The bicluster itself adopts the form of a subblock of the matrix whose rows and columns are approximately proportional, as measured by their scalar product.
A desirable feature in these models is to allow bicluster overlapping to reflect the fact that a particular gene can participate in different biological processes (modules, functions) for different conditions.
It was already noticed in [17] that overlapping allows the possibility of some biclusters being “included” within others and used a hierarchical depiction of this order to suggest the unfolding of finer and finer structure with the evolution of a threshold parameters.
Regardless of the biclustering method adopted, measurement variability, the dual roles of genes and conditions and the sheer number of relations and factors to be considered hinder the human analyst’s intuition to be brought to bear in the process of GED analysis. Therefore, it might profit from HumanComputer Interaction (HCI) for Knowledge Discovery in Databases and Data Mining (KDD&DM) [18].
KDD&DM is a conceptual framework including a set of desiderata, tools and practices for the analysis of data, that encourages complementing traditional Confirmatory Data Analysis (CDA) with human interaction to perfect the step of hypothesis abduction. For this purpose, the interpretation and visualization of data and the results of the data mining process have to be adapted to human cognition. Examples of such effort can be found in [19] where visualization requirements based on domain experts’ interviews are enumerated, or [16] where exploratory analysis in the guise of a hierarchical diagram of models is depicted and coindexed with other exploratory plots, like heatmaps.
Exploratory Data Analysis (EDA) is the proper statistical framework to carry out KDD&DM. Though gaining momentum in several fields, this paradigm—to be contrasted to CDA—shows a number of challenges as applied to the analysis of GED: having a trustworthy technique to measure gene expression, supporting the induction process, and evaluating the result of induction. Further insights into this issue will be reviewed in Discussion.
Formal Concept Analysis (FCA, [20]) can be conceptualized as an unsupervised, nonpartitional hierarchical coclustering algorithm for binary input tables based in lattice theory. Application of these techniques for GED can be found for instance in [21] that shows a method to identify biomarkers in breast cancer, in [22] where it is employed to find a list of genes for inclusion into a partially known basic gene network, in [23] that describes two different but mathematically equivalent FCA methods to cluster genes or in [24] for consensus clustering of multiexperiment expression data.
FCA supports EDA both at a theoretical level, by conceptualizing exploration as an embedding in landscapes of knowledge [25, 26], and practically, by providing visual, interactive diagram exploration tools that depict and describe the relation between genes and conditions in a condensed, yet highly intuitive form.
Unfortunately, FCA is illadapted to dealing with GED numerical data. Rather, it has to use a preprocessing technique, scaling, whereby numerical data tables are transformed into binary ones.
In this paper, we demonstrate an exploratory method for GED based on \(\mathcal {K}\)Formal Concept Analysis (\(\mathcal {K}\)FCA, [27]), a generalization of FCA where entries in data tables may be nonbinary numbers taking values in a scale \(\mathcal {K}\) designed to convey statistical information between genes and conditions, in the form of a lattice of biclusters.
This datadriven method does not require previous knowledge of the distribution of the data, nor is it necessary to define any distance metrics or give an estimation of the number of clusters, and it provides a browsable representation of the hierarchy of overlapping biclusters in the form of a lattice at each chosen level of resolution.
The proposal is wellfounded and completes the “landscapes of knowledge” metaphor providing a sound basis for EDA over nonboolean data with FCA that enables exploring the data at different resolutions [28]. As we sweep over those resolutions, the output is a sequence of gene expression lattices, where the researcher can see how clusters evolve, enabling a more detailed and less rigid understanding of the behavior some genes may share under different conditions. To improve this understanding, the gene lattices are used as an indexing mechanism onto external ontologies, thus providing a flavor of Gene Set Enrichment.
In this way, we introduce an expressive biclustering algorithm—\(\mathcal {K}\)FCA—coupled with its natural visualization method—a sequence of order diagrams or lattices—adapted for GED analysis in a suitable EDA framework, intended as an aid for decision and research by experts.
We also provide for open access WebGeneKFCA [29], the prototype tool employed for the analysis, at http://webgenekfca.com. As explained in Interfacing with gene ontologies, to support the exploratory process, the tool offers a brief description for each gene selected from the biclusters. This description has references to the NCBI gene database^{1} to ease the access to the latest online description of that gene. There are also references to each of the Gene Ontologies^{2} the gene belongs to, with one link to each ontology description including pvalues (see Exploration: gene set analysis). Finally WebGeneKFCA shows whether the gene is known to belong to a pathway and provides a link to the KEGG pathway database^{3}.
To illustrate the analysis we advocate we have carried out the analysis of some public GED and will argue for the consistency of our results with those of the paper originally describing them. The particular example of this paper can be found at https://webgenekfca.com/webgenekfca/datamatrices/7 where the reader can interactively explore the output lattices at different levels.
Methods
A Formal Concept Analysis primer
FCA [20] is an unsupervised biclustering algorithm for binary data based in lattice theory [30] that, apart from providing the desired biclusters of gene and condition sets establishes a partial order in them, usually represented as a lattice diagram.
Assume for the moment that GED are collected in a boolean matrix \(I \in \mathbb {B}^{m \times n}\) of m genes (or objects in FCA parlance) with n possible samples or conditions (called attributes in FCA) where an object can have or not a given attribute. The triple of the set of genes G, conditions C and the relation is called a formal context (G,C,I) and it carries two polar functions: the first one can obtain all the conditions in which any set of genes x occur, while the second can obtain all the genes in which a set of conditions y occur.
Despite being mutually recursive, these two functions find their fixpoints in just two steps
A formal concept (here, a bicluster) is the pair of an extent (set of genes) a⊆G and an intent (set of conditions) b∈C which define each other mutually.
Note how formal concepts fulfill the definition of biclusters or factors in [15].
The set of formal concepts is \(\mathfrak B(G,C,I)\). Formal concepts are partially ordered by the inclusion (resp. reverse inclusion) of extents (resp. intents). This means that for every two concepts c _{1}=(a _{1},b _{1}) and c _{2}=(a _{2},b _{2}) there is a concept order
and therefore the set of formal concepts with this order is actually a complete lattice \(\underline {\mathfrak {B}}(G,C,I)\). In this instace we call it call the gene expression lattice.
Creating and reading gene expression lattices FCA provides efficient generic procedures and tools [20] for:

1.
Finding all the biclusters (a,b).

2.
Finding the ordering between biclusters ≤.

3.
Finding a compact set of biclusters that generate all others by a well understood method.

4.
If the sets of genes or conditions are sufficiently small, drawing the lattice as an order diagram and navigate it using a pointandclick interface.
So by casting GED as formal contexts, biclusters as formal concepts and hierarchies as concept lattices we are capable of carrying out extensive exploratory analysis of GED using the FCA machinery.
Figure 1 is an example of a classical depiction of a lattice diagram (right) corresponding to a synthetic boolean matrix (left) where each of the nodes represent a concept (or bicluster). For the purpose of reading extents and intents of the lattice diagram, biclusters could be annotated graphically with a complete labeling, by listing for each bicluster the set of genes (white boxes) in the extent and the set of samples (gray boxes) in the intent. But since this implies repeating many times each gene and condition throughout the lattice (the biclusters are overlapping) the following, reduced labeling is preferred: we put the label of each condition only in the highest (most abstract) concept it appears, and the label of each gene only in the lowest (most specific) concept it appears. So conditions usually appear just above the corresponding concept and genes appear just below and each only once for the whole lattice, thus diminishing the visual clutter.
In this labeling scheme, to recover the set of genes of a particular bicluster—the extent—we take the union of all (white) gene labels found from the node downwards in the lattice. Similarly, to build the set of conditions—the intent—we take the union of all the (gray) condition labels found from the node upwards in the lattice. In the example, if we go from b _{1} downwards in the lattice collecting gene labels (below the nodes) we obtain its extent g _{6}, and if we go upwards we find the condition labels in its intent, c _{6} (above b _{1} itself) and c _{5} (above b _{2}). Thus, b _{1}=({g _{6}},{c _{5},c _{6}}) and b _{2}=({g _{4},g _{5},g _{6}},{c _{5}}) are overlapping biclusters but b _{2} appears above b _{1} (i.e. b _{1}≤b _{2}) because {g _{6}}⊆{g _{4},g _{5},g _{6}} (i.e., the set of genes in b _{1} are contained in the set of genes of b _{2}) and {c _{5},c _{6}}⊇{c _{5}} (i.e. the conditions for which the genes of b _{1} are expressed include the conditions for which the genes of b _{2} are expressed).
Finally, the biclusters (or sets of biclusters) that do not have any overlappings appear in the lattice as separate sublattices (although strictly speaking they all share the top and bottom nodes). In Fig. 1 three separate sublattices can be observed: S L _{1} (to the left, shadowed in gray) including a single bicluster plus the top and bottom concepts; S L _{2} (at the center) with three biclusters plus top and bottom; and S L _{3} (to the rigth, also shadowed in gray), also with a single bicluster plus top and bottom. Concepts in different sublattices are incomparable except for the top and bottom. We will say that such sublattices are adjoined or parallel sublattices of the GED lattice.
There are many different available algorithms to visualize a Concept Lattice, each with its advantages and disadvantages, some based on square grids, others in attraction or repulsion forces, etc. A review can be found in [31]. In this paper, most of the lattices depicted are obtained with WebGeneKFCA that provides our own adaptations of the visualization schemes for GED (see section Lattice visualization adaptation for GED).
From FCA to kFCA: exploring nonboolean gene expression data
The main drawback of FCA is the requirement that the gene expression quantification be boolean.
We overcome this restriction using a generalization called \(\mathcal K\)FCA [27, 32, 33], where \(\mathcal K\) is a type of cost adequate to measure gene expression levels. Its choice depends on the data preprocessing step and whether we want to explore gene expression for over or underexpression^{4}.
\(\mathcal K\)FCA introduces an extra parameter in the exploration procedure, the threshold of existence for biclusters to be considered: for each threshold level φ we may obtain a different φlattice and φconcepts. For instance, for underexpression analysis this parameter \(\varphi \in \mathbb R\), describes a maximum level of expression allowed for pairs of genes and conditions (g,c) to be considered as members of a bicluster (the φconcept).
Therefore to obtain all the possible biclusters it is necessary to calculate the sequence of lattices defined as a function of the different φ threshold values. Just as a timeordered sequence of images constitutes a movie that could be explored frame by frame using rewind and forward operations, our depiction of the φordered sequence of lattices casts the process of lattice exploration as the observation of the lattices as they evolve with φ, as will be illustrated in section The evolution of the number of concepts with thresholding. Indeed, with this procedure the explorer can progressively choose from a coarser view of the data (with a very demanding φ) that only allows the most salient biclusters to appear or zoom in into finer views where this threshold is relaxed to offer a more detailed lattice with a larger number of biclusters (see section Lattice visualization adaptation for GED). Our own graphical representation of the sequence of lattices that ensures that biclusters with the same set of conditions are always plotted in the same spatial coordinates independently of φ and that has been specifically designed for facilitating the exploration of GED, also allows us to define a measure of the persistence or robustness of a bicluster, as will be discussed in Lattice visualization adaptation for GED.
Lattice visualization adaptation for GED
Providing visually smooth transitions between consecutive lattice representations is the key for easing the expert process of discovering meaningful biclusters. In [29] we proposed a scheme having the distinctive feature that the biclusters with the same set of conditions are always plotted in the same position through different concept lattices^{5}. This means that as the user explores the values of ϕ (or φ) she will easily see how the set of genes of each bicluster evolves, increasing or decreasing until disappearing.
In our particular example, with n=9 conditions, this silhouette will exhibit 10 levels or rows including the top and bottom (see Figs. 3, 4, 5 and 6). This can be observed in our example where the intents (i.e. the set of conditions) of the maximum of 9 concepts of the second row (right below the top) have only a single element: each of the conditions. The third row will be composed of up to \(\binom {9}{2}~2\)combinations of the previous row concepts’ intents (i.e. all the possible pairs of conditions), the fourth, up to \( \binom {9}{3}~3\)combinations, etc.
Unlike the standard representation of lattice diagrams of Fig. 1, where genes and conditions were represented in separate white and gray boxes respectively, our adaptation for GED takes into account the fact that G≫C and substitutes the pair of boxes per node by a single one indicating the set of conditions and the number of genes belonging exclusively to that particular node, usually too large to be listed. Nonetheless, selecting the node by clicking on it provides access to the full list of genes. As in Fig. 1, to complete the list of genes of the bicluster we have to take the union of all the genes found in the labels from that node downwards.
To illustrate this, in Fig. 3 we have included the labels for every node^{6}. For example, the second biggest node (the biggest is the top) represents a bicluster with only one condition (MaleIPS) and 14 own genes (i.e. those that are only underexpressed for that condition and no other)^{7}. Also, the different rows of the lattice show the hierarchy previously explained where the second row presents the biclusters of the lattice with a single condition each, the third contains those nodes that include extensions with pairs of conditions, etc.
Gene set enrichment with external ontologies
Interfacing with gene ontologies
As very early noted by Godin and collaborators [34, 35] a Formal Concept Analysisbased lattice can be turned into a contentbased indexing device onto other knowledge resources. This affordance plays an important role in supporting the exploration of a scientific experiment and specifically for GED analysis [28]. A more indepth analysis of affordances of FCA for the analysis and synthesis of Information Retrieval systems is [36].
This means that the datadriven lattices obtained with \(\mathcal K\)Formal Concept Analysis can be used to support interaction with those ontologies by indexing them based in extents and intents. Besides, this also facilitates Gene Set Enrichment enabling the search of possible additional genes of GO terms present in a given bicluster and the evaluation of their hierarchy in the lattice.
We have enriched WebGeneKFCA with direct links to Gene Ontology (GO) and KEGG web services providing an interactive guide for navigating already available genetic information resources under the scope of the particular experiment being explored.
In particular, WebGeneKFCA provides a brief description for each probeset selected from a bicluster. This description has references to the NCBI gene database^{8} to ease the access to the latest online description of that gene. There are also references to each of the Gene Ontologies^{9} the gene belongs to, with one link to each ontology description. Finally WebGeneKFCA shows if the gene is known to belong to a pathway and provides a link to KEGG pathway database. ^{10}
Statistical methods for hypothesis testing
Most EDA processes need to undergo a subsequent CDA step to empirically verify the discoveries. Prior to this costly process however, it is also convenient to calculate the probability for obtaining these gene clusters by looking at biological information known a priori, that is, computing the socalled pvalues of the discovered biclusters with respect to wellknown gene ontologies.
This idea was put on practice by [37] where different genes where classified in one of the different 199 functional categories from the Martinsried Institute of Protein Sciences (MIPS) yeast database and with this information the probability that each gene belongs to a cluster just by chance is calculated. In [38] the same work is done but with the a priori information gathered from the Gene Ontology (GO) database.
We follow the work of [39], developed in the context of Gene Set Enrichment and Depletion applications, a very important application favored by our setting, taking advantage of the fact that WebGeneKFCA provides interfacing facilities to GO (see section Interfacing with gene ontologies). The mathematical details have been included in Additional file 1.
Results
A methodology for the EDA of genomic expression data using concept lattices
A general view of the methodology
We propose the following stages for the interactive exploratory analysis of GED data with concept lattices.

1.
Contextualization and data preparation

2.
Exploration: concept lattice cardinality.

3.
Exploration: gene and condition biclustering.

∙
Latticebased underexpression analysis.

∙
Latticebased overexpression analysis.

∙

4.
Exploration: Gene Set analysis.

(a)
Latticebased functional enrichment with ontologies.

(b)
Latticebased gene set enrichment analysis.

(a)
At each of these steps, the system provides input guidance and output visualization to assist and guide the user in hypothesis abduction.
Next we visit each of these stages clarifying them and providing a running example on real data.
Contextualization and data preparation
Contextualization refers to building a formal context or the data table for the analysis. The decisions typically affect whether to analyze in terms of genes or probesets and a detailing of what the conditions chosen for the study are, possibly with an explanation of what their purpose is.
Once the expression data have been gathered, they have to be rendered adequate for ulterior \(\mathcal K\)FCA. To render data into a logarithmic cost amenable to \(\overline {\mathbb {R}}_{\max,+}\) and \(\overline {\mathbb {R}}_{\min,+}\) modeling, we suggest it should be normalized an logcompressed, in addition to any preprocessing to adjust for background noise, etc., [40].
Running example: contextualization and data preparation To illustrate our EDA process we have taken as a reference the trisomy data and the results presented in [41] where one chromosome 21 is silenced in pluripotent stem cells presenting trisomy 21. This extra chromosome is silenced by inserting a XIST gene found in the X chromosome which condenses one X chromosome in female mammals. In this experiment a modified version of the XIST gene was inserted into chromosome 21 and it was activated or deactivated by the presence of Doxycycline.
To build the context we downloaded from the National Center for Biotechnology Information [42] 27 CEL files from [41] (see Additional file 2). Only the probesets for chromosome 21 were selected so G=621 and the original expression data matrix has a dimension of 621×27.
Since there were 9×3 samples of different tissues, to average noise out the geometric mean of the expression level of each probeset was taken for each different tissue (3 samples of each), so that C=9 and we obtain a matrix A of 621×9 entries. The value of each probeset was later normalized by its overall geometric mean over the conditions and logcompressed
to obtain the context (G,C,X).
More details about this experiment can be found in Additional file 2 and it can be browsed online at https://webgenekfca.com/webgenekfca/datamatrices/7 for the data and https://webgenekfca.com/webgenekfca/kfcaresultses/9 for lattice exploration.
Exploration: choosing the range of thresholds for under and overexpression
\(\mathcal K\)FCA is a generic technique in \(\mathcal K\) that, with the proper choice of thresholds and underlying cost algebras \(\mathcal K\), allows us to explore gene over and underexpression (see [27, § 2.2.2] for the details).

1.
For each underexpression threshold φ, kFCA finds those biclusters maximal for inclusion of gene and condition sets that have a norm below the threshold
$$\begin{array}{*{20}l} {\mathfrak{B}}^{\varphi}_{\max} (G, C, X) = \left\{ (a,b) \mid \ (a,b) \_{\max} \leq \varphi\right\}. \end{array} $$(7) 
2.
For each overexpression threshold ϕ, kFCA finds those biclusters minimal for inclusion of gene and condition sets that have a norm above the threshold ϕ,
$$\begin{array}{*{20}l} {\mathfrak{B}}^{\phi}_{\min} (G, C, X) = \left\{ (a,b) \mid \ (a,b) \_{\min} \geq \phi\right\}. \end{array} $$(8)
Thus, for each matrix of GED, we need to explore in two directions to find both the under and overexpressed genes in the conditions under scrutiny, but for the purpose of limiting the impact of under and overexpression noise we want to avoid exploring values of the threshold close to 0.
Therefore, to analyze underexpression we explore in φ∈(−∞,0] and to analyze overexpression in ϕ∈[0,∞).
To guarantee the evolution of the exploration from threshold to threshold, we concentrate on those φ and ϕ that actually appear in the expression data, instead of exploring the whole ranges given. In such case, the product of the exploration are the sequences of lattices obtained with either threshold:
for underexpression and
for overexpression. Several other strategies could also be used to further decimate these ranges, like sampling the bins in a histogram analysis of X _{ ij } values.
The evolution of the number of concepts with thresholding
An important feature of the sequence of lattices produced in the exploration is the evolution of the number of concepts or biclusters along the φ and ϕ thresholds, since it provides an indication of the size and complexity of the lattice. For instance, in overexpression, if the absolute value of the threshold of existence is large, then large absolute values of the gene concentrations will be required for the concepts to exist, meaning that the lattice will only show the most salient relationships or biclusters. On the contrary, if the absolute values required for existence are low, many nodes of the lattice appear showing spurious relations due to the uncertainty during data collection or measurement noise.
Sudden changes in the slope reveal values of threshold where the lattice changes substantially and therefore will be values of interest to look into in the exploration process as we describe below.
Running example: visualizing the number of concepts Figure 2 is a depiction of this evolution for the data described in the section Contextualization and data preparation.
Since φ∈(−∞,0] and ϕ∈[0,∞) the left part of the curve corresponds to underexpression analysis whilst the right one represents overexpression. The maximum number of concepts is attained at \(\varphi = \phi = 0.0, {\mathfrak {B}}^{0.0}_{\max } (G, C, X) = {\mathfrak {B}}^{0.0}_{\min } (G, C, X) = 350\) well under the theoretical maximum at 2^{C}=2^{9}=512 : we take this to imply that the combinatorics of the probesets in this example is greatly reduced, supporting the hypothesis of heavy coregulation. In this case the interesting ranges to explore for underexpression and overexpression are, respectively, φ∈[−0.07,−0.02] and ϕ∈[0.02,0.08].
Exploring for under and overexpression: visualization of bicluster hierarchy
The hierarchical organization of the bicluster lattices can be gleaned from the visualization scheme presented in Lattice visualization adaptation for GED. We say that the higher in the lattice a node appears, the more abstract the bicluster is, since the set of genes that comprise its extent appear in fewer conditions. Conversely, the lower the bicluster, the more specific it is since the set of genes included in its extent respond to a larger number of conditions and hence are better profiled.
When using the online tool, the gene appearance order for a given cluster as a function of φ is related to the confidence of that gene to belong to the given cluster. From there the reader can explore the lattices for different values of φ and ϕ.
Running example: gene underexpression analysis
If we select a very restrictive φ, i.e. if φ≪0 (see for example Fig. 3, φ=−0.150), only biclusters on the second row (those which are highly underexpressed in only one condition), a very few on the third (those highly underexpressed on two conditions) and a single one on the fourth (highly underexpressed on three conditions) appear^{11}. That is, very abstract biclusters are present and the number of probesets that they contain is very low. Most of the probesets are at the top bicluster, meaning that we cannot assert that they are underexpressed with this very strict confidence level.
As we relax the restrictions on φ more interesting groupings appear. In particular, around φ≈−0.010 (Fig. 4) big biclusters appear at the third, fourth and even fifth row allowing us to observe which sample combinations share the same underexpressed genes, notably situated to the right of the lattice where the condition Clone3Dox is placed. Specially relevant is the bicluster corresponding with Male iPS and all the Clones treated with Doxycycline (fifth row) that appears at this level but persists (i.e. is very robust) until φ=0.0. This way the interpretation that there are genes from the Clones treated with Doxycycline that have a similar level of expression as those found in disomatic cells is consistent with that given in the original paper [41] where only some genes from the trisomic cells are expected to decrease their expression when the third chromosome is silenced with the procedure there described.
Also worth mentioning is the biggest bicluster with 43 own probesets whose intent comprises Male iPS, and Clones 1 and 3 treated with Doxycycline. For some reason these two clones are responding slightly better than Clone 2 to the experiment, which is also consistent with the graph facilitated in [41, Fig. 4a]. Attending to the bicluster hierarchy, made evident in the lattice structure, we can say that this is a less specific bicluster than the one mentioned in the previous paragraph since these 43 probesets are the ones underexpressed in the three mentioned conditions but not for Clone 2.
Following the same line of reasoning, we can explore the third row where the two most significant biclusters are the ones for the conditions MaleIPS and Clone3Dox to the left and Clone1Dox and Clone3Dox to the right. These are parent nodes for the one described in the previous paragraph and ancestors of the one in the fith row mentioned earlier. Thus we can say that these are even less specific. This means that the probesets that we find there listed are underexpressed only in their respective pair of conditions but not in the rest.
But if we keep relaxing the restrictions approaching the origin at φ≈−0.005 (Fig. 5) big biclusters appear yet in lower positions of the lattice (fith and sixth rows in the example) and therefore are more specific. However, let us remind that for these very specific biclusters to appear, extremely low variations in the concentrations are admitted as significant and the results are prone to measurement errors. The explorer should be cautious when analysing these biclusters. See, for example, that the big bicluster in the sixth row shows the genes that are underexpressed (minimally) to both Parental (with and without Doxicicline treatment) and all the nontreated clones.
Running example: gene overexpression analysis
In the analysis of overexpression the exploration order is reversed. As can be noted from Fig. 2, a larger number of concepts, presumably including too specific biclusters with low reliability, appear at lower values of ϕ due to the relaxed restrictions on the concentrations and more robust biclusters can be observed with larger values of ϕ.
As an example for ϕ=0.05 (Fig. 6) there is one big cluster in the third row for the nontreated Clones 1 and 2 and two others in the second row again for the nontreated Clone 1 and nontreated Clone 3 showing that, in this case, overexpression rather affects the nontreated samples.
Exploration: gene set analysis
Next, as part of the lattice exploration, the user can evaluate the lists of probesets of each node making use of the interfacing facilities with external ontologies and also obtain their pvalues as indicated in Interfacing with gene ontologies.
Running example: interfacing with GO
A printout of a sample information that can be obtained by interfacing with GO through the lattices is included in Additional file 3. Please, note that the links in WebGeneKFCA are active and lead to the ontologies’ online databases. This particular sample has been obtained by digging into the main cluster of the lattice of Fig. 4 and selecting the probeset 11742211_x_at.
Running example: gene enrichment
This principle can be applied to the clusters identified in the previous section. For example, Table 1 shows the ten most reliable – the ones with the lowest pvalues – gene ontology terms from two different clusters. In this case the genes have been replaced by the microarray probesets. The full list can be obtained online at https://webgenekfca.com/webgenekfca/kfcaresultses/9 as a CSV file and also as Additional file 4. A printout is also included in Additional file 5.
Discussion
The aim of this paper is not merely to introduce a new biclustering algorithm for GED analysis but instead to offer a set of analysis and visualization tools that revolve around \(\mathcal {K}\)Formal Concept Analysis. These are cast into the framework of Exploratory Data Analysis (EDA) to support full human interaction during the step of hypothesis abduction. Tukey was the figure who advocated the use of exploratory, discoverydriven methods in the Statistics community. He coined the expression “Exploratory Data Analysis” and supported a complementary curriculum for Statisticians balancing EDA against Statistical Hypothesis Testing (that he called Confirmatory Data Analysis) [10]. At present, EDA is standard practice of good statistics, it is taught at basic statistics courses in academia [43], and supported by widelyused data processing software [44, 45].
The reader should be aware that since this methodology cannot be used as a tool for Confirmatory or Predictive Data Analysis by itself, an empirical verification of the hypothesis gained in the exploration should be carried out as a subsequent step. We believe, nevertheless, that the framework we promote is specially suited to support scientific knowledge discovery in GED [28] given the usual lack of groundtruth in this type of data. This leads us to the enduring dilemma of obtaining quality indicators in an EDA framework.
Despite not being a Confirmatory Data Analysis tool, our framework profits from some affordances of FCArelated tools to define quality indicators. On the one hand, we introduced the notion of persistence or robustness of a bicluster based on the range of φ for which it exists—thus providing an idea of a concept robustness—, and the degree of confidence on the empirical measures that define the biclusters [29].
On the other hand, the resulting conceptual lattice can be used to index external databases, such as Gene Ontology (GO), thus offering a new way of accessing other available resources. According to the theoretical background of Gene Set Enrichment, this enables the calculation of the pvalues of biclusters as confidence measures based on the terms in those resources. In this sense, the sequence of lattices for a particular experiment allows the researcher to observe the evolution of a gene throughout the different biclusters it appears in, thus vertebrating the researcher vision of that given resource. This may be used to confer relevance to biclusters, observing which genes are included and what their persistence is, to infer, for example, hypotheses on their function.
Another key aspect of an EDA framework is its data visualization capabilities. We profit from two important FCA affordances in this regard: namely, that the formal quality of FCA makes it suitable for domainindependent data analysis, and that visualization and manipulation of data in table format and hierarchical format are mutually warranted—stemming from the duality of contexts and lattices. Furthermore, since we extend FCA to support non boolean data tables by using \(\mathcal K\)FCA, our visualization of GED takes the form of a sequence of lattices.
An important consideration in the exploration of this sequence of lattices is the choice of the particular values of φ and ϕ of interest. Hints for the discovery of relevant positions based on the evolution of the number of biclusters (or concepts) are presented in The evolution of the number of concepts with thresholding but it is worth noting that values of φ and ϕ close to 0 can be errorprone in noisy samples. As we have mentioned before, higher absolute values of these thresholds will show genes more intensely over or underexpressed, perhaps at the expense of missing some other relations. A current limitation of this representation is the small number of samples or conditions that can be simultaneously visualized, a disadvantage that can be partially ameliorated by a preprocessing stage providing manually arranged groupings of the conditions. But this ought to be revisited in the future.
Conclusions
Within the framework of EDA, we have introduced a set of interactive analysis tools based on \(\mathcal K\)FCA that include a new biclustering algorithm for GED analysis and visualization capabilities to support exploration of GED backed by two quality indicators: our own defined persistence of a bicluster and the pvalues computed within the background of Gene Set Enrichment statistical confidence measures facilitated by the indexing capabilities of \(\mathcal {K}\)FCA for external databases, such as Gene Ontology.
In contrast with the currently dominant paradigm of Confirmatory or Predictive Data Analysis, with important difficulties for its application to GED intrinsic to the problem definition and mainly due to the lack of groundtruth data, we belief that framing GED analysis in an EDA setting (possibly complemented with ulterior empirical verification of the findings) is a principled and relevant change of paradigm in GED analysis that eases the understanding of the process of scientific discovery. We have illustrated the capabilities of our \(\mathcal {K}\)FCAbased EDA framework with the analysis of a real data set confirming previously published findings on that data.
The exploration facilities that it offers stem from two main abilities of \(\mathcal {K}\)FCA: first, as an FCAderived methodology, it can be interpreted as a nonpartitional biclustering method that can be visualized as a sequence of lattices, evidencing the hierarchical structure of the biclusters thus obtained and already facilitating browsing into its structure and second, by using either maxplus or minplus as the underlying semirings, we obtain interpretations for gene under and overexpression respectively with a free parameter, the threshold of expression, we have used to define an extra flavor of exploratory analysis: changing this value, the level of detail at which the context is being explored varies, entailing differences in the lattice. Indeed, Fig. 2 is an exploratory plot of the consequences of varying such parameter in the particular case of analyzing gene expression.
By the previous procedure, the GED analysis problem gets transformed into the exploration of a sequence of lattices enabling the visualization of the hierarchical structure of the biclusters with a certain degree of granularity. A crucial advantage of our graphical representation of this sequence is the guarantee that all the biclusters with the same set of conditions are always plotted in the same spatial coordinates, therefore facilitating their interpretation.
The graphical interface, WebGeneKFCA, as an interactive tool for analysis and decision, allows the user to navigate along this parameter to observe rougher or finer biclusters. The algorithm, available as a web service, allows the researcher to analyze gene expression data with no previous knowledge of the experiment conditions and also interface with external gene ontologies.
Endnotes
^{1} http://www.ncbi.nlm.nih.gov/gene
^{2} http://amigo.geneontology.org/amigo/
^{3} http://www.genome.jp/kegg/pathway.html
^{4}Provided \(\mathbb R\) has the structure of a completed idempotent semifield \({\mathcal K}\), a technicality to induce the lattice structure.
^{5}To ensure that every bicluster with the same set of conditions appears at the same position throughout the whole sequence of lattices, each lattice is drawn over the silhouette of the Concept Lattice of a (virtual) contranominal scale involving all possible attributes, \(\mathbb {N^{c}_{M}} = \underline {\mathfrak {B}}(M,M,\neq)\). The rationale for this is explained in [29].
^{6} In the online tool WebGeneKFCA only the label for the node selected with the mouse is shown to avoid cluttering the diagram.
^{7} To complete the list of all the genes underexpressed for that condition we need to add those from that bicluster downwards in the lattice: from row 3, 5 genes from the node below to the left that corresponds to the conditions MaleIPS and ParentalNoDox, 1 gene from the node right below with conditions MaleIPS and Clone1NoDox and 2 genes from the node below to the left of the lattice with the conditions MaleIPS and Clone2Dox and from row 4,2 more genes corresponding to the node with MalIPS, ParentalNoDox and Clone2Dox.
^{8} http://www.ncbi.nlm.nih.gov/gene
^{9} http://amigo.geneontology.org/amigo/
^{10} http://www.genome.jp/kegg/pathway.html
^{11}Recall from section Lattice visualization adaptation for GED that the top node is in row 1.
References
Madeira SC, Oliveira AL. Biclustering algorithms for biological data analysis: a survey. IEEE/ACM Trans Comput Biol Bioinforma/IEEE, ACM. 2004; 1(1):24–45. doi:10.1109/TCBB.2004.2.
Xie Y, Wu G, Tang J, Luo R, Patterson J, Liu S, Huang W, He G, Gu S, Li S, Zhou X, Lam TW, Li Y, Xu X, Wong GKS, Wang J. SOAPdenovoTrans: De novo transcriptome assembly with short RNASeq reads. Bioinformatics. England: Oxford; 2014, pp. 1–7.
Bateman A, Quackenbush J. Virtual issue on bioinformatics for next generation sequencing. Bioinformatics. 2009; 25(4):429. doi:10.1093/bioinformatics/btp03.
Metzker ML. Sequencing technologies  the next generation. Nat Rev Genet. 2010; 11(1):31–46. doi:10.1038/nrg2626.
Jiang D, Tang C, Zhang A. Cluster analysis for gene expression data: a survey. IEEE Trans Knowl Data Eng. 2004; 16(11):1370–86. doi:10.1109/TKDE.2004.68.
de Souto MCP, Costa IG, de Araujo DSa, Ludermir TB, Schliep A. Clustering cancer gene expression data: a comparative study. BMC Bioinforma. 2008; 9:497. doi:10.1186/147121059497.
D’haeseleer P. How does gene expression clustering work? Nat Biotechnol. 2005; 23(12):1499–501. doi:10.1038/nbt12051499.
MacQueen J. Some methods for classification and analysis of multivariate observations. In: Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, Volume 1: Statistics. Berkeley, Calif.: University of California Press: 1967. p. 281–97. http://projecteuclid.org/euclid.bsmsp/1200512992.
Kohonen T. Selforganized formation of topologically correct feature maps. Biol Cybern. 1982; 43:59–69.
Tukey JW. We need both exploratory and confirmatory. Am Stat. 1980; 34(1):23–5.
Morgan B, Ray A. Nonuniqueness and inversions in cluster analysis. Appl Stat. 1995; 44(1):117–34.
Hartigan JA. Direct Clustering of Data Matrix. J Am Stat Assoc. 1972; 67(337):123–129.
Prelić A, Bleuler S, Zimmermann P, Wille A, Bühlmann P, Gruissem W, Hennig L, Thiele L, Zitzler E. A systematic comparison and evaluation of biclustering methods for gene expression data. Bioinformatics (Oxford, England). 2006; 22(9):1122–9. doi:10.1093/bioinformatics/btl060.
Hochreiter S, Bodenhofer U, Heusel M, Mayr A, Mitterecker A, Kasim A, Khamiakova T, Van Sanden S, Lin D, Talloen W, Bijnens L, Göhlmann HWH, Shkedy Z, Clevert DA. FABIA: factor analysis for bicluster acquisition. Bioinformatics. 2010; 26(12):1520–7.
Ihmels J, Friedlander G, Bergmann S, Sarig O, Ziv Y, Barkai N. Revealing modular organization in the yeast transcriptional network. Nat Genet. 2002; 31(4):370–7.
Ihmels J, Bergmann S, Barkai N. Defining transcription modules using largescale gene expression data. Bioinformatics. 2004; 20(13):1993–2003.
Bergmann S, Ihmels J, Barkai N. Iterative signature algorithm for the analysis of largescale gene expression data. Phys Rev E. 2003; 67(3):031902.
Holzinger A, Dehmer M, Jurisica I. Knowledge Discovery and interactive Data Mining in Bioinformatics  StateoftheArt, future challenges and research directions. BMC Bioinforma. 2014; 15(Suppl 6):1.
Streit M, Gratzl S, Gillhofer M, Mayr A, Mitterecker A, Hochreiter S. Furby: fuzzy forcedirected bicluster visualization. BMC Bioinforma. 2014; 15(Suppl 6):4.
Ganter B, Wille R. Formal Concept Analysis: Mathematical Foundations. Berlin, Heidelberg: Springer; 1999.
Motameny S, Versmold B, Schmutzler R. Formal Concept Analysis for the Identification of Combinatorial Biomarkers in Breast Cancer In: Medina R, Obiedkov S, editors. Berlin, Heidelberg: Springer. vol 4933: 2008. p. 229–240.
Gebert J, Motameny S, Faigle U, Forst CV, Schrader R. Identifying Genes of Gene Regulatory Networks Using Formal Concept Analysis. J Comput Biol. 2008; 15(2):185–94. doi:10.1089/cmb.2007.0107.
Kaytoue M, Kuznetsov SO, Napoli A, Duplessis S. Mining gene expression data with pattern structures in formal concept analysis. Inf Sci. 2011; 181(10):1989–2001. doi:10.1016/j.ins.2010.07.007.
Hristoskova A, Boeva V, Tsiporkova E. A formal concept analysis approach to consensus clustering of multiexperiment expression data. BMC Bioinforma. 2014; 15(1):1–16. doi:10.1186/1471210515151.
Wille R. Why can concept lattices support knowledge discovery in databases?J Exp Theor Artif Intell. 2002; 14(2–3):81–92.
Wille R. Proceedings, Formal Concept Analysis: 4th International Conference, ICFCA 2006, Dresden, Germany, February 1317, 2006 In: Missaoui R, Schmidt J, editors. Berlin, Heidelberg: Springer: 2006. p. 1–29.
ValverdeAlbacete FJ, PeláezMoreno C. Extending conceptualisation modes for generalised Formal Concept Analysis. Inf Sci. 2011; 181:1888–909.
ValverdeAlbacete FJ, GonzálezCalabozo JM, Peñas A, PeláezMoreno C. Supporting scientific knowledge discovery with extended, generalized formal concept analysis. Expert Syst Appl. 2016; 44:198–216. doi:10.1016/j.eswa.2015.09.022.
GonzálezCalabozo JM, PeláezMoreno C, ValverdeAlbacete FJ. Webgenekfca: an online conceptual analysis tool for genomic expression data. In: Proc. of The International Conference on Concept Lattices and Their Applications (CLA). Hungary: Laszlo Szathmary: 2012. p. 345–50.
Birkhoff G. Lattice Theory, 3rd edn. Providence: American Mathematical Society; 1967.
Eklund P, Villerd J. A survey of hybrid representations of concept lattices in conceptual knowledge processing In: Kwuida L, Sertkaya B, editors. Berlin, Heidelberg: Springer. vol 5986: 2010. p. 296–311.
ValverdeAlbacete FJ, PeláezMoreno C. Towards a generalisation of Formal Concept Analysis for data mining purposes. In: Concept Lattices. Proceedings of the International Conference on Formal Concept Analysis (ICFCA 06). LNAI. Germany: Springer: 2006. vol 3874. p. 161–76.
ValverdeAlbacete FJ, PeláezMoreno C. Further Galois connections between semimodules over idempotent semirings In: Diatta J, Eklund P, editors. Proceedings of the 4th Conference on Concept Lattices and Applications (CLA 07). Montpellier: 2007. p. 199–212.
Godin R, Gecsel J, Pichet C. Design of a browsing interface for information retrieval. In: Proceedings of the 12th International Conference on Research and Development in Information Retrieval (ACM SIGIR ’89). Cambridge, MA: ACM: 1989. p. 32–9.
Godin R, Saunders E, Gecsei J. Lattice model of browsable data spaces. Inf Sci. 1986; 40:89–116.
ValverdeAlbacete FJ, PeláezMoreno C. Systems vs. methods: an analysis of the affordances of formal concept analysis for information retrieval. In: Proceedings of Formal Concept Analysis Meets Information Retrieval (FCAIR), Workshop Colocated with ECIR2013. Russia: Sergei O. Kuznetsov: 2013. p. 113–26.
Tavazoie S, Hughes JD, Campbell MJ, Cho RJ, Church GM. Systematic determination of genetic network architecture. Nat Genet. 1999; 22(3):281–5. doi:10.1038/10343.
Berriz GF, King OD, Bryant B, Sander C, Roth FP. Characterizing gene sets with FuncAssociate. Bioinformatics. 2003; 19(18):2502–4. doi:10.1093/bioinformatics/btg363.
Rivals I, Personnaz L, Taing L, Potier MC. Enrichment or depletion of a GO category within a class of genes: which test?Bioinformatics. 2007; 23(4):401–7. doi:10.1093/bioinformatics/btl633.
Gentleman R, Carey VJ, Huber W, Irizarry RA, Dudoit S, (eds).Bioinformatics and Computational Biology Solutions Using R and Bioconductor. Statistics for Biology and Health. New York: Springer; 2005.
Jiang J, Jing Y, Cost GJ, Chiang JC, Kolpa HJ, Cotton AM, Carone DM, Carone BR, Shivak Da, Guschin DY, Pearl JR, Rebar EJ, Byron M, Gregory PD, Brown CJ, Urnov FD, Hall LL, Lawrence JB. Translating dosage compensation to trisomy 21. Nature. 2013; 500. doi:10.1038/nature12394.
Gene Expression Omnibus, National Center for Biotechnology Information. 2013. http://www.ncbi.nlm.nih.gov/geo/browse/. Accessed 09 Sept 2016.
Tukey JW. Exploratory Data Analysis. Behavioral Science series. Reading: Addison Wesley; 1977.
R Core Team. R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing; 2014. R Foundation for Statistical Computing. http://www.walkingrandomly.com/?p=4767. http://www.Rproject.org/. Accessed 09 Sept 2016.
Matlab. MATLAB and Statistics Toolbox Release 2012b. Natick: The MathWorks Inc; 2012.
PeláezMoreno C, GarcíaMoral AI, ValverdeAlbacete FJ. Analyzing phonetic confusions using formal concept analysis. J Acoust Soc Am. 2010; 128(3):1377–90. doi:10.1121/1.3458854.
Acknowledgements
The authors would like to thank Dr. Harold MolinaBulla for his technical support for hosting the WebGeneKFCA service.
Funding
This work was partially supported by the Spanish Ministry of Economics and Competitiveness projects TEC201461729EXP and TEC201453390P.
Availability of data and materials
The dataset supporting the conclusions of this article is available in the Gene Expression Omnibus (GEO) repository http://www.ncbi.nlm.nih.gov/geo/query/acc.cgi?acc=GSE47014. The WebGeneKFCA tool employed for the analysis is available at https://webgenekfca.com/webgenekfca/.
Authors’ contributions
JMGC, FVA and CPM developed the theory and methods. JMGC implemented the online tool, extracted and processed the empirical data. FVA and CPM analysed the results and wrote the manuscript. All authors read and approved the final manuscript.
Competing interests
The authors declare that they have no competing interests.
Consent for publication
Not applicable.
Ethics approval and consent to participate
Not applicable.
Author information
Authors and Affiliations
Corresponding author
Additional files
Additional file 1
Statistical methods for hypothesis testing. Description of the statistical methods for hypothesis testing employed in the paper and implemented in the online service WebGeneKFCA. (PDF 141 kb)
Additional file 2
Data procurement and normalization of the running example. Details about the procurement and normalization of the data employed in the running example employed throughout the paper. (PDF 171 kb)
Additional file 3
Printout of the genomic information interfaced by WebGeneKFCA. A printout of a sample information that can be obtained by interfacing with GO through the lattices of the running example described in http://www.biomedcentral.com/content/supplementary/10.1186/s128590161234zS1.pdfAdditional file 1. Please, note that the links in WebGeneKFCA are active and lead to the ontologies’ online databases. This particular sample has been obtained by digging into the main cluster of the lattice of Fig. 4 and selecting the probeset 11742211_x_at. It can also be obtained at https://webgenekfca.com/webgenekfca/kfcaresultses/9. (PDF 471 kb)
Additional file 4
CSV file of GO terms’ information for gene enrichment from WebGeneKFCA. A sample printout from WebGeneKFCA with the information about the GO terms and their pvalues computed as described in http://www.biomedcentral.com/content/supplementary/10.1186/s128590161234zS2.pdfAdditional file 2 for the bicluster with intent MalePS, Parental NoDox, Clone 1 NoDox and Clone 3 NoDox from Fig. 4. It can also be obtained online at https://webgenekfca.com/webgenekfca/kfcaresultses/9. (CSV 24 kb)
Additional file 5
Printout of GO terms’ information for gene enrichment from WebGeneKFCA A sample printout from WebGeneKFCA with the information about the GO terms and their pvalues computed as described in http://www.biomedcentral.com/content/supplementary/10.1186/s128590161234zS2.pdfAdditional file 2 for the bicluster with intent MalePS, Parental NoDox, Clone 1 NoDox and Clone 3 NoDox from Fig. 4. It can also be obtained online at https://webgenekfca.com/webgenekfca/kfcaresultses/9 as a CSV file. (PDF 358 kb)
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
GonzálezCalabozo, J.M., ValverdeAlbacete, F.J. & PeláezMoreno, C. Interactive knowledge discovery and data mining on genomic expression data with numeric formal concept analysis. BMC Bioinformatics 17, 374 (2016). https://doi.org/10.1186/s128590161234z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s128590161234z