Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Uncovering transcriptional interactions via an adaptive fuzzy logic approach

BMC Bioinformatics volume 10, Article number: 400 (2009) Cite this article

Abstract

Background

To date, only a limited number of transcriptional regulatory interactions have been uncovered. In a pilot study integrating sequence data with microarray data, a position weight matrix (PWM) performed poorly in inferring transcriptional interactions (TIs), which represent physical interactions between transcription factors (TF) and upstream sequences of target genes. Inferring a TI means that the promoter sequence of a target is inferred to match the consensus sequence motifs of a potential TF, and their interaction type such as AT or RT is also predicted. Thus, a robust PWM (rPWM) was developed to search for consensus sequence motifs. In addition to rPWM, one feature extracted from ChIP-chip data was incorporated to identify potential TIs under specific conditions. An interaction type classifier was assembled to predict activation/repression of potential TIs using microarray data. This approach, combining an adaptive (learning) fuzzy inference system and an interaction type classifier to predict t ranscriptional r egulatory n etworks, was named AdaFuzzy.

Results

AdaFuzzy was applied to predict TIs using real genomics data from Saccharomyces cerevisiae. Following one of the latest advances in predicting TIs, constrained probabilistic sparse matrix factorization (cPSMF), and using 19 transcription factors (TFs), we compared AdaFuzzy to four well-known approaches using over-representation analysis and gene set enrichment analysis. AdaFuzzy outperformed these four algorithms. Furthermore, AdaFuzzy was shown to perform comparably to 'ChIP-experimental method' in inferring TIs identified by two sets of large scale ChIP-chip data, respectively. AdaFuzzy was also able to classify all predicted TIs into one or more of the four promoter architectures. The results coincided with known promoter architectures in yeast and provided insights into transcriptional regulatory mechanisms.

Conclusion

AdaFuzzy successfully integrates multiple types of data (sequence, ChIP, and microarray) to predict transcriptional regulatory networks. The validated success in the prediction results implies that AdaFuzzy can be applied to uncover TIs in yeast.

Background

Identifying transcriptional interactions (TIs) is one of the central challenges in the post-genome era. When transcription factors (TFs) bind to cis-regulatory modules in the upstream DNA sequence of a target gene, its mRNA transcribes (expresses). In general, a cis-regulatory module consists of multiple TF binding sites, which may require several cooperating TFs to transcribe a given target gene. Therefore, predicting TIs for a whole genome can be computationally intensive. Nevertheless, integrating whole-genome DNA sequence, ChIP-chip, and microarray data may assist in the uncovering of gene regulatory networks.

Many types of resources have been exploited to predict gene regulatory networks; most of them use sequence data, localization data, gene expression data, protein structure data, or orthologs across different species. Sequence-based approaches focus on a group of genes and predict TIs within the group. Position weight matrices (PWMs) were incorporated to infer TF binding sites in [1]. Other approaches have been developed to find target genes with potential TIs such as, text mining [2], and support vector machines [3]. Besides sequence data, microarray data are also frequently used to reveal gene regulatory networks. The latest advance in Gaussian graphical models employed an empirical Bayes approach (EB-GGMs), and it can infer a large network of 3000+ genes [4]. The dynamics of pairwise TIs were studied using a nonlinear differential equation (NLDE) [5], which was shown to capture the behavior of transcriptional regulation with good accuracy. Other models proposed include Bayesian networks [6–9], state-space models [10], deterministic differential systems [11], linear differential systems [12], a linear dynamic model with latent factors [13], co-expression analysis [14], and machine learning [15, 16]. In particular, [17] proposed a statistical approach (PAP) that incorporated sequence and microarray data to infer transcriptional regulators for co-regulated genes. PAP first gathers a set of co-expressed genes, then analyzes the regulatory sequence of these genes to identify potential TF binding sites.

Recently, integrating multiple types of data to infer TI has been proposed. Several approaches, including GRAM [18], COGRIM [19] and ReMoDiscovery [20], have been proposed to predict transcriptional regulatory networks using both TF binding information and microarray data. A two-stage constrained matrix decomposition model, called cPSMF [21], is the latest advanced algorithm proposed to predict TIs using ChIP-chip, sequence and microarray data. cPSMF considered the nonlinear structure in gene expression data of TIs, and used a linear combination of weighted TF activities to predict TIs and transcriptional modules. These approaches allow the prediction of TIs with more biological significance than models that use microarray or sequence data alone.

In our preliminary study [22], a conventional fuzzy-logic approach (FuzzyTRN) was proposed to integrate both DNA sequence and microarray data to infer TIs. Here, we present a further enhanced machine-learning (adaptive fuzzy) approach, called AdaFuzzy, to infer TIs, which incorporates DNA sequence, ChIP-chip and microarray data. A robust position weight matrix and a feature vector are proposed in AdaFuzzy. Furthermore, potential TF binding sites in upstream sequences of a specific target gene are identified by an adaptive neuro-fuzzy inference system (ANFIS) using sequence data. ChIP-chip data confirms that TIs do indeed occur under specific experimental conditions. In addition, microarray data is used to classify predicted TIs into activator-target or repressor-target relations via a weighted regression. After potential TIs are identified, AdaFuzzy also classifies their types of promoter architectures to provide insights into the organization of transcriptional regulatory interactions.

Methods

The proposed method (AdaFuzzy) consists of three parts. (1) Identifying consensus sequence motifs of a given TF using a robust PWM (rPWM). A rPWM is different from a PWM as it allows adjustment for gaps in the aligned sequence motifs. The rPWM of a TF is used to search for potential TF binding sites in the upstream sequence of a given target gene. For each pair of TF-target genes, a feature vector consisting of three indices to identify possible TF binding sites is constructed. The novelty of the feature vector lies in the adjustment for gaps of the aligned sequence motifs to make the score robust. (2) The feature vector and ChIP-chip data are then incorporated to predict potential TIs by an adaptive neuro-fuzzy inference system (ANFIS), which is a learning fuzzy approach. (3) Finally, a classifier is developed to infer the interaction types of predicted TIs (activator-target (AT) or repressor-target (RT) interaction) using microarray data. Figure 1 shows a conceptual schematic diagram of AdaFuzzy. The TI discussed here is the physical interaction between a TF and its target gene. After all TIs have been identified, they can be categorized into one or more of the four major types of promoter architectures defined in [23] to provide insights into the organization of transcriptional regulatory interactions. The details of the proposed method for inferring TIs are stated in the following sections.

Figure 1
figure 1

Conceptual diagram of the AdaFuzzy algorithm. First, consensus sequence motifs of a given TF are identified using a robust PWM (rPWM), which the rPWM is then used to search for potential TF binding sites in the upstream sequence of a given target gene via a vector of three features. Then this feature vector is incorporated to predict potential TIs by an adaptive fuzzy system (ANFIS), and a classifier is developed to infer the interaction types (AT or RT). Finally, all inferred TIs are categorized into one or more of the four major types of promoter architectures.

Full size image

Identifying consensus sequence motif

For a group of genes of interest, suppose that some of them encode known TFs, for instance, a regulating gene that encodes a TF with n candidate sequence motifs of different length k i , which can be denoted by B = (b ij : i = 1, ..., n; j = 1, ..., k i ), and b ij ∈ {degenerate characters}. Each degenerate character is represented by two or more capital symbols with uniform frequencies and possibilities of occurrences. The details of these degenerate characters are summarized in the IUPAC website http://www.bioinformatics.org/sms/iupac.html.

ClustalW [24] is used to align the motifs of a regulating gene. To eliminate the length differences between motifs, the empty symbol '-' is inserted to fill in gaps introduced by the alignment. The aligned candidate sequence motifs of the regulating gene are denoted by ℜ = (r ij : i = 1, ..., n; j = 1, ..., k), k is the length of the aligned candidate sequence motifs of each TF, and r ij ∈ {degenerate characters or '-'}. Then, the alignment result is summarized into a position-specific frequency matrix, denoted by F, as

where ρx, jis the count of occurrences of nucleotide x at column j of ℜ calculated based on the occurrence probability of IUPAC nucleotide codes in additional file 1. Here, when computing ρx, jthe proportions of {A, C, G, T} in degenerate characters were also summed together with the frequencies of non-degenerate nucleotides. For instance, at the first column of three aligned sequences, there are A, C and Y, where Y assumes C and T with equal probability. Then ρA,1= 1, ρC,1= 1.5, ρG,1= 0 and ρT,1= 0.5. Next, in PWM the probability of observing a nucleotide b ∈ {A, C, G, T} in the whole genome of a given organism is equal to p b . However, a large number of gaps in the aligned sequences would inflate the values in the PWM. To correct this, we propose to multiply the probability of a nucleotide in PWM by its proportion of valid nucleotides (non-gaps) in n sequences. For a given TF, the robust position weight, denoted by S, is proposed as

where S(r. j = b) denotes the robust position-specific score of nucleotide symbol b occurring at column j of ℜ, n represents the number of candidate sequence motifs in ℜ, and ω j is the number of valid nucleotides (non-degenerate characters) at column j of ℜ. With small ω j , the value of S(r. j = b) will be reduced to reflect that information of all aligned jth elements of candidate motif sequences (column j of ℜ) is less representative. Hence, a rPWM, denoted by M, can be derived as M = (M bj = S(r. j = b); b ∈ {A, C, G, T}; j = 1, ..., k), which is a 4 × k matrix. The rPWM can be used as a matching template to identify potential TF binding sites in the upstream sequence of a given target gene.

Uncovering TF binding sites

For a given target gene, suppose that we have attained a fragment of its upstream sequence of length l, which can be denoted by U = (u(-x): x = l, l - 1, ..., 1), where u(-x)∈ {A, C, G, T}, and u(0) is the transcription start site. The rPWM of a given TF is used to identify possible TF binding sites in the upstream sequence U of a given target gene. The first feature, a function that captures the probability that a candidate TF is indeed the regulator, is formulated as

where -l ≤ υ ≤ -k, and k is the length of the aligned candidate sequence motifs of each TF. A large score of indicates a higher similarity between ℜ and the sequence fragment in the range [υ, υ + k - 1] of the upstream sequence U, and hence the sequence fragment might be a potential TF binding site for the TF. The maximum score is obtained by matching the rPWM with sequence fragment U' in the range

The nucleotide fragment in the range [υ, υ + k - 1] is used to determine the proportion of matched nucleotides which is the second feature. For a given pair of TF and target, the overall proportion of matched nucleotides adjusted for the effect of gaps is

where the indicator function I(E) = 1 if the event E holds; otherwise, 0. The weight (ω j /n) is to adjust for gaps in ℜ. The more valid nucleotides exist at column j of ℜ, the more important the matching event is. Large values of O(υ) indicate that ℜ and U' match well.

In addition, ChIP-chip data is also used to uncover TF-target gene interactions. For a given TF, the p-values of ChIP signals of all genes can be obtained after preprocessing all ChIP-chip data, and the p-value represents the significance level of a binding strength. Thus, the p-value of a TF associated with a given target gene, denoted by κ, is utilized as the third feature of AdaFuzzy.

Then, for any possible combination of TF and target gene, feature vectors [, O(υ), κ] can be calculated for predictions of TF binding sites via an ANFIS. The feature vector consists of information gathered by some similar but not completely overlapping features, and AdaFuzzy yields better results than using any subset of them. This concept is known as data fusion, a process of combining information gathered from multiple measurements into a single output to result in higher accuracy [25]. Data fusion has been proven effective in various applications. Thus, we use the feature vector to infer potential TIs by the ANFIS, introduced in the next subsection. Note that feature vectors [, O(υ), κ] with -l ≤ υ ≤ -k can be used to predict TF binding sites in the upstream sequence of a target gene for a given TF, and this additional information can be further used to identify the promoter architectures of target gene, which is stated in the next subsection.

Identifying TIs using ANFIS

The three features above capture information about how a TF matches the promoter sequence of a target. However, whether a linear or nonlinear function of these features and what appropriate weights should be used to best summarize the information are unknown. Nevertheless, information on TIs, e.g. a few hundred pairs of TIs in the repository YEASTRACT already exists. Therefore, it is reasonable to take a learning approach. Here, a learning version of the fuzzy logic approach, called adaptive neuro-fuzzy inference system (ANFIS) is proposed to identify potential TIs from the three features. The three quantitative inputs of the ANFIS, , O(υmax), and κ, which are converted into qualitative descriptions by using some membership functions (e.g. large, medium, and small) for fuzzy reasoning, the parameters for which can be estimated by existing TIs. Then, the reasoning process (fuzzy rules) maps all combinations of the qualitative descriptions onto a decision score. For instance, a trained ANFIS may contain rules such as "if is large, O(υmax) is large (the match of the sequences of a potential TF-target pair is good), and κ is small (ChIP signal intensity of a potential TF-target pair is significantly high), then the decision score is large (the chance that the potential TF-target pair is a TI is high)"; another extreme example would be, "if is small, O(υmax) is small (the match of the sequences of a potential TF-target pair is bad), and κ is large (ChIP signal intensity of a potential TF-target pair is insignificant), then the decision score is small (the chance that the potential TF-target pair is a TI is small)". Finally, an overall decision score (denoted by λ) summarizes the reasoning results of the if-then rules for predicting TIs. By applying known TIs to train ANFIS, the parameters of membership functions for the fuzzy qualitative transformation and fuzzy rules can be automatically tweaked. When the number of membership functions or fuzzy rules of an ANFIS is large, an over-fitting problem will occur (i.e., the number of parameters is larger than the number of observations), but this disadvantage can be circumvented by setting a limit on the numbers of membership functions or fuzzy rules when initiating ANFIS.

Here, a Sugeno type-3 reasoning ANFIS [26, 27] is used, which is the simplest model of ANFIS with a five-layer feed-forward architecture. A detailed description of this ANFIS can be found in additional file 2. Note that the cut-off for the decision score is also trained by existing TIs (say c), which is different from conventional ANFIS; the gradient descent method is used to train all parameters of the ANFIS. A decision score λ can be computed from the corresponding feature vectors [, O(υ), and κ] for any given υ. If the score λ of a given TF-target pair is greater than c, then this pair is predicted to be a TI. Furthermore, for all those λ scores greater than c, their associated υ's are used to identify the positions of predicted TF binding sites.

Classification of Promoter Architectures

After potential TIs are identified, insight into their transcriptional regulatory mechanism can be obtained if the prediction results include promoter architecture type. We thus used information from both sequence and ChIP-chip data to identify TF binding sites, and were able to predict some promoter architectures that ChIP experiments alone could not predict (see the experimental results section for details). In this subsection, we show how AdaFuzzy can classify the promoter architecture of identified TIs into at least one of the four types defined in [23], namely single regulator, repetitive motifs, multiple regulators and co-occurring regulators; see Figure 2 in [23] for an illustration of these architectures.

The first type of promoter architecture is single regulator architecture. This is the simplest type of architecture. For the upstream sequence of a given target gene, if there is only one TF with a υ that forms a feature vector [, O(υmax), κ] resulting in a λ > c, the predicted TI is classified as having single regulator architecture. The second type of promoter architecture is repetitive motif architecture. To identify this architecture, the feature vector [, O(υ), κ] was fed into the ANFIS for -l ≤ υ ≤ -k to identify all possible TF binding sites in the range [υ, υ + k - 1] of U. If the upstream sequence of a given target gene is identified to contain multiple TF binding sites for a TF (multiple number of υ that results in λ > c), then the predicted TI is classified as having repetitive motifs architecture. The third type of promoter architecture is multiple regulator architecture. If the upstream sequence of a given target gene contains multiple binding sites for multiple TFs, all related TIs are classified as having multiple regulator architecture. The final type of promoter architecture is co-occurring regulators architecture. Such architecture is formed by a pair of TFs on the same target, where in general the distance between the two TFs is significantly closer than expected by chance, and the distance between two TF binding sites is the length of inter-sequence between them [23]. Furthermore, by plotting the distribution of inter-sequence lengths of all predicted TIs, any TF pair whose inter-sequence length has a p-value < 0.005 is classified as having co-occurring regulators architecture. Please note that the co-occurring regulators discussed here do not include the regulatory mechanism of heterodimers. In addition, these four types of promoter architecture are not necessarily mutually exclusive. An identified TI can be classified into one or more types of promoter architectures.

Due to the lack of a benchmark, it is hard to evaluate the classification of a TF-target pairs to types of promoter architectures. However, as long as the overall advantages of the classification outweigh the disadvantages, it is still worthwhile performing.

Classification of AT/RT interactions

In our previous works [15, 16], patterns in expression curves of paired genes were shown to be associated with the types of interactions, such as activator-target (AT) interaction and repressor-target (RT) interaction. The causal relation is inferred based on the observation of gene expression data taken with time lags to uncover the expression behavior of one gene that led to a delayed pattern of altered expression of its partner [28].

The patterns of paired gene expression curves can be used to identify the type of interaction between them. For example, a similar (anti-similar) pattern in a gene expression pattern (gradients with the same (different) signs) implies an AT (RT) interaction, and these patterns can be captured by the time-lagged gradients. To determine the type of interaction between a pair of genes, denoted by {G1 and G2}, we fitted a weighted least square regression to time-lagged gradients of expression levels of G1 and G2. Weighted least square regression was used since it can dampen the effect of noise in the microarray data. The slope of the regression line, denoted by β1, can be obtained by the command 'robustfit' in MATLAB. The value of β1 can be used to infer the association between paired curves. A positive (negative) β1 indicates that overall the gradient signs of paired expression curves are of the same (opposite) sign, and this leads to a prediction of an AT (RT) interaction. The value of β1 can be mapped linearly to a decision score ranging from -1 to 1 to infer the interaction type of the gene pair. If the decision score is positive (negative), then the paired expression curves of G1 and G2 has a similar (anti-similar) pattern. The magnitude of the decision score indicates the strength of a pairwise interaction. For example, the decision score equals to 1 (- 1) indicates that the gene pair genes has a perfect positive (negative) association, and 0 means that there is no significant interaction between them. Furthermore, the p-value < 0.0001 of the decision score is used as the cutoff to predict an interaction type. Using such a stringent criterion can circumvent the noise in microarray data. Detailed description is in additional file 3. Note that a training version of this classifier can be used. However, this would be too complicated; for simplicity, the current version is used.

Results and discussion

In this section, AdaFuzzy, consisting of an ANFIS and an interaction type classifier, is applied to identify condition-specific TIs by integrated analysis of sequence, ChIP-chip and microarray data. The demonstration of the experimental results is divided into two parts: (1) inferring TIs using data in the public domain, (2) classifying all predicted TIs into one of the four architectures.

In this subsection, upstream sequence data of genes (-1000 bp to -1 bp) in different species are gathered from EMBL-EBI database [29]. Sequence data of candidate sequence motifs are collected from YEASTRACT [30] and TRANSFAC [31]. By scanning the complete genome sequences of S. cerevisiae, the probabilities of observing nucleotides p b , b ∈ {A, C, G, T} were calculated to be {0.3098, 0.1909, 0.1906, 0.3087}. The yeast ChIP-chip data set used was from [23], in which the genome-wide analysis contains 203 TFs in rich media condition, and 84 of them were also examined in at least one of 12 environmental conditions that may induce a stress response. A total of 19 TFs involved in the cell cycle and stress response were chosen to evaluate the performance of the proposed algorithm. The p-values of TF-gene pairs from [23] therein were used as the input (κ) of the ANFIS. Two publicly available yeast time-course microarray data sets were used, in which a cell cycle data set measured under normal growth conditions has 18 time points from [32], and the second set is related to yeast stress response to different experimental conditions, such as heat shock, amino acid starvation, nitrogen source deletion and progression into stationary phase [33]. There are 173 time points available in the second data set. The normalization process and missing-data imputation were conducted using zero transformation [34] and KNNimpute approaches [35], respectively.

Because ANFIS requires a complete training before it can produce any useful prediction, we collected 9609 positive TIs as training data set from YEASTRACT database. In addition, to control false negative rate of AdaFuzzy, 5260 negative TIs were formed by pairing up a TF with the other 18 TFs' target genes annotated in TRANSFAC and YEASTRACT.

Inferring TIs using cell cycle/stress condition data in yeast

To see how AdaFuzzy performs, we compare AdaFuzzy with four well-known methods, cPSMF [21], GRAM [18], COGRIM [19] and ReMoDiscovery [20]. Similar to AdaFuzzy, these approaches predict TIs by performing an integrated analysis of sequence, ChIP-chip and microarray data. cPSMF unravels TIs and combinatorial gene regulation of TFs based on a two-stage constrained matrix decomposition model. GRAM utilizes an iterative search method to identify common TF binding sites of genes, then it relaxes its cutoff for co-expressed genes to extend the original gene set. COGRIM uses a Bayesian hierarchical model to represent expression level as a function of TF expression and binding strength. ReMoDiscovery is an intuitive method that concurrently analyzes all three types of data. Among these methods, AdaFuzzy, cPSMF and COGRIM are able to predict the interaction types (AT/RT) of the predicted TIs, while GRAM and ReMoDiscovery cannot. The comparison of these approaches was based on the same set of data (sequence, ChIP-chip and microarray data). In addition, since AdaFuzzy is a machine learning-based approach, a training set with 14491 gene pairs (9231 positives (TIs) and 5260 negatives (non-TIs)) was used to evaluate the performance of AdaFuzzy by 3-fold cross validation (CV) with 500 repeats.

Following one of the latest advances in predicting TIs [21], we compare these five algorithms using over-representation analysis [36] and gene set enrichment analysis (GSEA) [37] using the 19 TFs in [21], in which the target genes of all predicted TIs were clustered by GO terms. The over-representation analysis examines the predicted target genes and determines if there are gene sets which are statistically over-represented. GSEA attempts to determine whether members of a gene set (a set of predicted targets for a given TF) tend occur at the top (or bottom) of all genes considered; this gene set is expected to correlate with the phenotypic class distinction (targets or non-targets of the TF). The enrichment scores of GSEA can be calculated by the free software GSEA-P and its key steps are in p. 15546 of [38].

Using these two analyses, the performances of the four algorithms applied to the 19 TFs, and the average result of AdaFuzzy conducting 500 repeated 3-fold cross-validation experiments (CVs) are summarized in Table 1. All gene pairs were grouped into 19 subgroups by TFs, e.g. all gene pairs with TF1 being grouped into Subgroup 1, and CVs were performed on the subgroups. Therefore, the training set was formed from 13 randomly-selected subgroups, and the test set was constructed from the remaining subgroups. The proposed AdaFuzzy outperformed the other methods in both analyses. The averaged enrichment level of AdaFuzzy over all TIs associated with the 19 TFs in over-representation analysis was 6.00, better than those of cPSMF (5.81), ReMoDiscovery (5.40), COGRIM (5.22) and GRAM (4.96). In GSEA, the averaged enrichment level of AdaFuzzy was the highest (4.03), followed by cPSMF (3.65), COGRIM (3.42), GRAM (2.90) and ReMoDiscovery (2.64). These results imply that the target genes of all TIs identified by AdaFuzzy and cPSMF are more functionally relevant than the others. The average number of TIs identified by AdaFuzzy was 364, while those of cPSMF, COGRIM, ReMoDiscovery and GRAM were 91, 85, 74 and 32, respectively. This suggests that the machine learning-based AdaFuzzy is able to produce functionally coherent information on transcriptional regulatory mechanisms.

Table 1 Comparison of AdaFuzzy to other methods using over-representation analysis and gene set enrichment analysis.
Full size table

The performances of AdaFuzzy, 'ChIP-experimental method' and the other four methods applied to infer TIs of the 19 TFs are summarized in Table 2, and they were checked against the experimentally validated interactions from YEASTRACT as follows. Among 109130 possible TIs (19 TFs × the number of target genes), 6924 links were predicted to be TIs, in which the modified true-positive rate (mTPR) was 73% (6736/9231), and the modified false negative rate (mFNR) was 27% (2495/9231). In terms of sensitivity and specificity, AdaFuzzy outperformed the others (followed by 'ChIP only method' and cPSMF). If we manually relax the thresholds of some parameters in AdaFuzzy, e.g., the significance level of β1 or the cut-off c of the output of ANFIS, more TIs will be predicted, but this will also lead to higher false positive rates. The parameters of AdaFuzzy can be further tuned by users to meet their preference.

Table 2 The performances of AdaFuzzy and the other approaches, checked against validated TIs of the 19 TFs from YEASTRACT.
Full size table

We further compared AdaFuzzy and 'ChIP-experimental method', which applied the criterion of p-values < 0.001 to ChIP-chip experiment to identify TIs, using experimentally validated TFBSs in [23] and [38] intersecting with YEASTRACT. By definition, mFNR = 1-mTPR, so we only report mTPRs in the following. Under the rich media (stress) condition in [23], the mTPR of 'ChIP-experimental method' and AdaFuzzy, applied to 1955 and 1220 TIs, are 100% (100%) and 90% (82%), respectively. While under the normal (methyl-methanesulfonate exposure) condition, the mTPR of 'ChIP-experimental method' and AdaFuzzy, applied to 2529 and 1021 TIs, are 45% (18%) and 81% (59%), respectively. Detailed prediction results are summarized in additional file 4. The MATLAB code of AdaFuzzy is available at http://www.stat.sinica.edu.tw/~gshieh/AdaFuzzy.rar.

Classifying Promoter Architectures

In the following, AdaFuzzy is applied to classify these 6865 TIs associated with the 19 aforementioned TFs to one or more types of promoter architectures in [23]. The predicted results are checked with biological information from the Saccharomyces Genome Database (SGD, http://www.yeastgenome.org).

For the results predicted by AdaFuzzy using cell cycle ChIP-chip and microarray data under the rich medium condition, ABF1 was predicted to be the TF regulating genes CDC24, GCN1 and IME4. These target genes share some common functions such as cellular developmental process and macromolecule metabolic process, and their promoters have been classified to single regulator architecture regulated solely by ABF1. Published literature shows that the ABF1 gene product binds to the upstream sequences of genes CDC24 [23, 38, 39], GCN1 [23] and IME4 [23, 38, 39]. Using the stress response data set in yeast, AdaFuzzy predicted that the gene product of REB1 interacted with the promoter sites of ABC1, MNP1 and NUT1. These target genes were found to be involved in cellular metabolic processes. Existing literature also confirms that protein Reb1p binds to the upstream sequences of ABC1 [24, 38, 40], MNP1 [38] and NUT1 [24, 38, 40], and these TIs were identified to be AT interactions. Figure 3 illustrates that the binding sites and their types of promoter architectures predicted by AdaFuzzy coincide with experimental results annotated in SGD.

Figure 2
figure 2

Repetitive motifs promoter architecture identified by AdaFuzzy. Yellow boxes represent binding sites predicted by AdaFuzzy, red boxes denote the results annotated in SGD or [23], and blue boxes show the results that are not annotated. Please note that the scale of the box (binding site) is not realistic.

Full size image
Figure 3
figure 3

Single regulator promoter architecture identified by AdaFuzzy. Yellow box represents binding sites predicted by AdaFuzzy, and red box denotes the results in SGD. Please note that the scale of the box (binding site) is not realistic.

Full size image

Several genes were predicted to have the repetitive motifs promoter architecture. Target genes with such promoter architecture are regulated in a graded manner by specific TFs. Among all TIs predicted by AdaFuzzy using the cell cycle yeast data set, ALG14 was classified to the repetitive motifs promoter architecture. The upstream sequence of ALG14 contains binding sites for the proteins of SWI4 and MBP1, while protein Swi4p was shown to regulate ALG14 [23, 38, 41, 42]. When using the stress response yeast data set, MET13 was predicted to have the repetitive motifs architecture which is bound by protein Gcn4p, while the regulation of Gcn4p on MET13 under stress conditions has been demonstrated [23, 43–45]. In addition, Gcn4p was identified to be an activator for MET13. Figure 2 shows that the predicted binding sites are in agreement with experimental results from SGD. Note that a potential binding site for Gcn4p was found in the upstream sequence of MET13 that was not annotated in SGD or [23].

The multiple regulators promoter architecture type is commonly seen in the yeast genome. For instance, SLM4 has been classified to be co-regulated by multiple regulators using the yeast cell cycle data set, such as Abf1p [23, 43], Fkh1p [23], Fkh2p [23, 38, 40, 42] and Swi6p [38, 40]. Applying AdaFuzzy to the stress response data set in yeast resulted in that HSP26 had multiple TF binding sites, while HSP26 was shown to be regulated by TFs Msn4p and Hsf1p, in [23, 46–48] and [23, 46–50], respectively. Msn4p was predicted to be an activator for HSP26. These prediction results are illustrated in Figure 4, which shows that the TF binding sites architectures classified by AdaFuzzy are consistent with experimental results in SGD. The binding sites of MBP1 and SKN7 were presented in the upstream sequence of SLM4, but AdaFuzzy applied to the rich medium data set failed to identify these as expected because the regulation of MBP1 and SKN7 on SLM4 occur only under stress conditions [23]. In addition, four binding sites were identified for Reb1p, Hsf1p and Abf1p, while these binding sites were not annotated in SGD or [23]. This shows that AdaFuzzy can predict novel results for biologists to test transcriptional regulatory interactions.

Figure 4
figure 4

Multiple regulators promoter architecture identified by AdaFuzzy. Yellow box represents binding sites predicted by AdaFuzzy, red box denotes false negative, and blue boxes show the results that are not annotated in SGD or [23]. Please note that the scale of the box (binding site) is not realistic.

Full size image

The fourth type of promoter architecture consists of binding site sequences which are closer than expected by chance. This implies that two independent regulators may interact with each other before regulating their target gene. In Figure 5, Fkh1p-Fkh2p and Mbp1p-Swi6p are predicted to be co-occurring regulators that interact with the promoter of SLM4 under rich medium condition. AdaFuzzy predicted that Swi4p-Swi6p is likely to co-active OCH1, which is supported by [23, 38, 40–42]. Under stress conditions, Swi4p-Swi6p and Swi4p-Mbp1p were classified to be co-occurring repression and activation regulators of CRH1, and these were confirmed by previous publications [23, 38, 40–42, 51]; these results are illustrated in Figure 5. In addition, 13 regulatory gene pairs, some validated and the others novel, identified by AdaFuzzy to be co-occurring regulators are summarized in Table 3. Among these results, MCM1-FKH1 and SWI4-MBP1 were not reported by ChIP-chip experiments in [23] but were validated by other biological experiments.

Table 3 The list of co-occurring regulators identified by AdaFuzzy.
Full size table
Figure 5
figure 5

Co-occurring regulators promoter architecture identified by AdaFuzzy. Yellow boxes represent binding sites predicted by AdaFuzzy, and red boxes denotes false negative. Please note that the scale of the box (binding site) is not realistic.

Full size image

Taken together, AdaFuzzy performs well in identification of TIs and is able to classify promoter architecture types using genomics data in yeast to provide insights into the organization of transcriptional regulatory interactions.

Conclusion

A novel algorithm AdaFuzzy is introduced for identifying TIs using sequence, ChIP-chip and microarray data. AdaFuzzy, cPSMF, GRAM, COGRIM and ReMoDiscovery were applied to TIs in yeast using genomic data from cell cycle and stress condition. AdaFuzzy performed better than the other methods in terms of over-representation analysis and GSEA, which were used in one of the latest advances [21]. Checked against known TIs of the preselected 19 TFs in [21] as annotated in databases and published literature, the mTPR and mFNR of AdaFuzzy were 72% and 28%, respectively. Furthermore, AdaFuzzy performed compatibly to 'ChIP-experimental method' in inferring TIs identified by two sets of large scale ChIP-chip experiments in [21] and [38]. This suggests that AdaFuzzy is useful for uncovering transcriptional regulatory interactions in yeast. AdaFuzzy can also classify the predicted TIs into one or more of the four promoter architectures in [23] to provide insights into the organization of transcriptional regulatory interactions. The classification results also coincide with known promoter architectures annotated in SGD and [23]. Some predicted TIs are not annotated in SGD and [23], and these can be tested further by biologists. However, AdaFuzzy is not able to predict TIs involved with heterodimers, which is an important regulatory mechanism in developmental and physiological processes in humans. We leave this for future research.

References

  1. Stormo GD: DNA binding sites: representation and discovery. Bioinformatics 2000, 16: 16–23. 10.1093/bioinformatics/16.1.16

    Article  CAS  PubMed  Google Scholar 

  2. Neduva V, et al.: Systematic discovery of new recognition peptides mediating protein interaction networks. PLoS Biol 2005, 3: e405. 10.1371/journal.pbio.0030405

    Article  PubMed Central  PubMed  Google Scholar 

  3. Martin S, et al.: Predicting protein-protein interactions using signature products. Bioinformatics 2005, 21: 218–226. 10.1093/bioinformatics/bth483

    Article  CAS  PubMed  Google Scholar 

  4. Schafer J, Strimmer K: An empirical Bayes approach to inferring large-scale gene association networks. Bioinformatics 2005, 21: 754–764. 10.1093/bioinformatics/bti062

    Article  PubMed  Google Scholar 

  5. Vu TT, Vohradsky J: Nonlinear differential equation model for quantification of transcriptional regulation applied to microarray data of Saccharomyces cerevisiae . Nucleic Acids Res 2007, 35: 279–287. 10.1093/nar/gkl1001

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  6. Friedman N, et al.: Using Bayesian networks to analyze expression data. J Comp Biol 2000, 7: 601–620. 10.1089/106652700750050961

    Article  CAS  Google Scholar 

  7. Friedman N: Inferring cellular networks using probabilistic graphical models. Science 2004, 303: 799–805. 10.1126/science.1094068

    Article  CAS  PubMed  Google Scholar 

  8. Perrin BE, et al.: Gene networks inference using dynamic Bayesian networks. Bioinformatics 2003, 19: ii138-ii148. 10.1093/bioinformatics/btg1071

    Article  PubMed  Google Scholar 

  9. Hughes T, et al.: Functional discovery via a compendium of expression profiles. Cell 2000, 102: 109–126. 10.1016/S0092-8674(00)00015-5

    Article  CAS  PubMed  Google Scholar 

  10. Beal MJ, et al.: A Bayesian approach to reconstructing genetic regulatory networks with hidden factors. Bioinformatics 2005, 21: 349–356. 10.1093/bioinformatics/bti014

    Article  CAS  PubMed  Google Scholar 

  11. De Jong H: Modeling and simulation of genetic regulatory systems: A literature review. J Comp Biol 2002, 9: 69–105.

    Article  Google Scholar 

  12. Rangel C, et al.: Modelling T-cell activation using gene expression profiling and state space models. Bioinformatics 2004, 20: 1361–1372. 10.1093/bioinformatics/bth093

    Article  CAS  PubMed  Google Scholar 

  13. Shieh GS, et al.: Inferring transcriptional compensation interactions in yeast via stepwise structure equation modeling. BMC Bioinformatics 2008, 9: 134. 10.1186/1471-2105-9-134

    Article  PubMed Central  PubMed  Google Scholar 

  14. Horvath S, Dong J: Geometric interpretation of gene coexpression network analysis. PLoS Comput Biol 2008, 4: e1000117. 10.1371/journal.pcbi.1000117

    Article  PubMed Central  PubMed  Google Scholar 

  15. Chuang CL, et al.: GeneCFE-ANFIS: A neuro-fuzzy inference system to infer gene-gene interactions based on recognition of microarray gene expression patterns. Biomed Eng Appl Basis Comm 2007, 19: 71–78. 10.4015/S1016237207000112

    Article  Google Scholar 

  16. Chuang CL, et al.: A pattern recognition approach to infer time-lagged genetic interactions. Bioinformatics 2008, 24: 1183–1190. 10.1093/bioinformatics/btn098

    Article  CAS  PubMed  Google Scholar 

  17. Chang LW, et al.: A systematic model to predict transcriptional regulatory mechanisms based on overrepresentation of transcription factor binding profiles. Genome Res 2006, 16: 405–413. 10.1101/gr.4303406

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  18. Bar-Joseph Z, et al.: Computational discovery of gene modules and regulatory networks. Nat Biotechnol 2003, 21: 1337–1342. 10.1038/nbt890

    Article  CAS  PubMed  Google Scholar 

  19. Chen G, et al.: Clustering of genes into regulons using integrated modeling - COGRIM. Genome Biol 2007, 8: R4. 10.1186/gb-2007-8-1-r4

    Article  PubMed Central  PubMed  Google Scholar 

  20. Lemmens K, et al.: Inferring transcriptional module networks from ChIP-chip-, motif- and microarray data. Genome Biol 2007, 7: R37. 10.1186/gb-2006-7-5-r37

    Article  Google Scholar 

  21. Li H, Zhan M: Unravelling transcriptional regulatory programs by integrative analysis of microarray and transcription factor binding data. Bioinformatics 2008, 24: 1874–1880. 10.1093/bioinformatics/btn332

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  22. Chuang CL, et al.: A Fuzzy Logic Approach to Infer Transcriptional Regulatory Network in Saccharomyces cerevisiae using Promoter Site Prediction and Gene Expression Pattern Recognition. Proceedings of the IEEE Congress on Evolutionary Computation: 1–6 June, 2008; Hong Kong 1714–1721.

  23. Harbison , et al.: Transcriptional regulatory code of a eukaryotic genome. Nature 2004, 431: 99–104. 10.1038/nature02800

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  24. Thompson JD, et al.: CLUSTAL W: improving the sensitivity of progressive multiple sequence alignment through sequence weighting, position-specific gap penalties and weight matrix choice. Nucleic Acids Res 1994, 22: 4673–4680. 10.1093/nar/22.22.4673

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  25. Hsu DF, Taksa I: Comparing rank and score combination methods for data fusion in information retrieval. Information Retrieval 2005, 8: 449–480. 10.1007/s10791-005-6994-4

    Article  Google Scholar 

  26. Sugeno M: Industrial applications of fuzzy control. Elsevier Science Pub. Co; 1985.

    Google Scholar 

  27. Jang JS: ANFIS: Adaptive-Network-based Fuzzy Inference Systems. IEEE Transactions on Systems, Man, and Cybernetics 1993, 23: 665–685. 10.1109/21.256541

    Article  Google Scholar 

  28. Reis BY, et al.: Approaching causality: discovering time-lag correlationships in genetic expression data with static and dynamic relevance networks. In Proceedings of RECOMB; 8–11 April, 2000; Tokyo Edited by: Shamir R, Myanno S, Istrail S, Pevzner P, Waterman M. 2000, 5.

    Google Scholar 

  29. Kulikova T, et al.: EMBL Nucleotide Sequence Database in 2006. Nucleic Acids Res 2007, 35: 16–20. 10.1093/nar/gkl913

    Article  Google Scholar 

  30. Teixeira MC, et al.: The YEASTRACT database: a tool for the analysis of transcription regulatory associations in Saccharomyces cerevisiae . Nucleic Acids Res 2006, 34: D446-D451. 10.1093/nar/gkj013

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  31. Matys V, et al.: TRANSFAC: transcriptional regulation, from patterns to profiles. Nucleic Acids Res 2003, 31: 374–378. 10.1093/nar/gkg108

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  32. Spellman PT, et al.: Comprehensive identification of cell cycle-regulated genes of the yeast Saccharomyces cerevisiae by microarray hybridization. Mol Biol Cell 1998, 9: 3273–3297.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  33. Gasch AP, et al.: Genomic expression programs in the response of yeast cells to environmental changes. Mol Biol Cell 2000, 11: 4241–4257.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  34. Gollub J, et al.: The Stanford Microarray Database: a user's guide. Methods Mol Biol 2006, 338: 191–208.

    CAS  PubMed  Google Scholar 

  35. Troyanskaya O, et al.: Missing value estimation methods for DNA microarrays. Bioinformatics 2001, 17: 520–525. 10.1093/bioinformatics/17.6.520

    Article  CAS  PubMed  Google Scholar 

  36. Grossmann S, et al.: An improved statistic for detecting over-represented Gene Ontology annotations in gene sets. In Proceedings of RECOMB; 2–5 April, 2006; Venice Lido. Edited by: Apostolico A, Guerra C, Istrail S, Pevzner P, Waterman M. Springer Berlin/Heidelberg; 2006:85–98.

    Google Scholar 

  37. Subramanian A, et al.: Gene set enrichment analysis: a knowledge-based approach for interpreting genome-wide expression profiles. Proc Natl Acad Sci USA 2005, 102: 15545–15550. 10.1073/pnas.0506580102

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  38. Workman CT, et al.: A systems approach to mapping DNA damage response pathways. Science 2006, 312: 1054–1059. 10.1126/science.1122088

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  39. Warragudi A, et al.: Genome-wide analysis of transcriptional dependence and probable target sites for Abf1 and Rap1 in Saccharomyces cerevisiae . Nucleic Acids Res 2007, 35: 193–202. 10.1093/nar/gkl1059

    Article  Google Scholar 

  40. Lee TI, et al.: Transcriptional regulatory networks in Saccharomyces cerevisiae . Science 2002, 298: 799–804. 10.1126/science.1075090

    Article  CAS  PubMed  Google Scholar 

  41. Iyer VR, et al.: Genomic binding sites of the yeast cell-cycle transcription factors SBF and MBF. Nature 2001, 409: 533–538. 10.1038/35054095

    Article  CAS  PubMed  Google Scholar 

  42. Schlecht U, et al.: Genome-wide expression profiling, in vivo DNA binding analysis, and probabilistic motif prediction reveal novel Abf1 target genes during fermentation, respiration, and sporulation in yeast. Mol Biol Cell 2008, 19: 2193–2207. 10.1091/mbc.E07-12-1242

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  43. Ernst J, et al.: Reconstructing dynamic regulatory maps. Mol Syst Biol 2007, 3: 74. 10.1038/msb4100115

    Article  PubMed Central  PubMed  Google Scholar 

  44. Natarajan K, et al.: Transcriptional profiling shows that Gcn4p is a master regulator of gene expression during amino acid starvation in yeast. Mol Cell Biol 2001, 21: 4347–4368. 10.1128/MCB.21.13.4347-4368.2001

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  45. Mascarenhas C, et al.: Gcn4 is required for the response to peroxide stress in the yeast Saccharomyces cerevisiae. Mol Biol Cell 2008, 19: 2995–3007. 10.1091/mbc.E07-11-1173

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  46. Chua G, et al.: Identifying transcription factor functions and targets by phenotypic activation. Proc Natl Acad Sci USA 2006, 103: 12045–12050. 10.1073/pnas.0605140103

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  47. Hahn JS, Thiele DJ: Activation of the Saccharomyces cerevisiae heat shock transcription factor under glucose starvation conditions by Snf1 protein kinase. J Biol Chem 2004, 279: 5169–5176. 10.1074/jbc.M311005200

    Article  CAS  PubMed  Google Scholar 

  48. Schüller C, et al.: Global phenotypic analysis and transcriptional profiling defines the weak acid stress response regulon in Saccharomyces cerevisiae . Mol Biol Cell 2004, 15: 706–720. 10.1091/mbc.E03-05-0322

    Article  PubMed Central  PubMed  Google Scholar 

  49. Imazu H, Sakurai H: Saccharomyces cerevisiae heat shock transcription factor regulates cell wall remodeling in response to heat shock. Eukaryot Cell 2005, 4: 1050–1056. 10.1128/EC.4.6.1050-1056.2005

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  50. Yamamoto A, et al.: Identification of a novel class of target genes and a novel type of binding sequence of heat shock transcription factor in Saccharomyces cerevisiae . J Biol Chem 2005, 280: 11911–11919. 10.1074/jbc.M411256200

    Article  CAS  PubMed  Google Scholar 

  51. Mai B, Breeden L: Xbp1, a stress-induced transcriptional repressor of the Saccharomyces cerevisiae Swi4/Mbp1 family. Mol Cell Biol 1997, 17: 6491–6501.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  52. Tsai HK, et al.: Statistical methods for identifying yeast cell cycle transcription factors. Proc Natl Acad Sci USA 2005, 102: 13532–13537. 10.1073/pnas.0505874102

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  53. Kumar R, et al.: Forkhead transcription factors, Fkh1p and Fkh2p, collaborate with Mcm1p to control transcription required for M-phase. Curr Biol 2000, 10: 896–906. 10.1016/S0960-9822(00)00618-7

    Article  CAS  PubMed  Google Scholar 

  54. Das D, et al.: Interacting models of cooperative gene regulation. Proc Natl Acad Sci USA 2004, 101: 16234–16239. 10.1073/pnas.0407365101

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  55. Banerjee N, Zhang MQ: Identifying cooperativity among transcription factors controlling the cell cycle in yeast. Nucleic Acids Res 2003, 31: 7024–7031. 10.1093/nar/gkg894

    Article  PubMed Central  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

This research was partially supported by NSC 95-2221-E-002-029-MY2 (for Chen), and NSC grant 96-2118-M-001-010-MY2 and Academia Sinica AS95ISS1 (for Shieh).

Author information

Authors and Affiliations

  1. Institute of Biomedical Engineering, National Taiwan University, Taipei, Taiwan

    Cheng-Long Chuang, Kenneth Hung, Chung-Ming Chen & Grace S Shieh

  2. Institute of Statistical Science, Academia Sinica, Taipei, Taiwan

    Cheng-Long Chuang & Grace S Shieh

Authors
  1. Cheng-Long Chuang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kenneth Hung
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chung-Ming Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Grace S Shieh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Chung-Ming Chen or Grace S Shieh.

Additional information

Authors' contributions

CLC and GSS devised the method. CLC implemented the method and drafted the manuscript. KH helped implement the method. CMC and GSS supervised the methodology and implementation. GSS wrote the manuscript. All of the authors read and approved the final manuscript.

Electronic supplementary material

Additional file 1: IUPAC code. The frequency table of degenerate characters defined in IUPAC. (PDF 5 KB)

12859_2009_3130_MOESM2_ESM.PDF

Additional file 2: Adaptive neuro-fuzzy inference system (ANFIS). Description of the architecture and general theory of ANFIS. (PDF 96 KB)

12859_2009_3130_MOESM3_ESM.PDF

Additional file 3: Classifier for ATRT. Detailed descriptions of the classifier for prediction of AT/RT interactions. (PDF 36 KB)

Additional file 4: Prediction results. The results predicted by the proposed AdaFuzzy. (PDF 2 MB)

Authors’ original submitted files for images

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Chuang, CL., Hung, K., Chen, CM. et al. Uncovering transcriptional interactions via an adaptive fuzzy logic approach. BMC Bioinformatics 10, 400 (2009). https://doi.org/10.1186/1471-2105-10-400

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-2105-10-400

Keywords

BMC Bioinformatics

ISSN: 1471-2105

Contact us