Skip to main content

Finding microRNA regulatory modules in human genome using rule induction



MicroRNAs (miRNAs) are a class of small non-coding RNA molecules (20–24 nt), which are believed to participate in repression of gene expression. They play important roles in several biological processes (e.g. cell death and cell growth). Both experimental and computational approaches have been used to determine the function of miRNAs in cellular processes. Most efforts have concentrated on identification of miRNAs and their target genes. However, understanding the regulatory mechanism of miRNAs in the gene regulatory network is also essential to the discovery of functions of miRNAs in complex cellular systems. To understand the regulatory mechanism of miRNAs in complex cellular systems, we need to identify the functional modules involved in complex interactions between miRNAs and their target genes.


We propose a rule-based learning method to identify groups of miRNAs and target genes that are believed to participate cooperatively in the post-transcriptional gene regulation, so-called miRNA regulatory modules (MRMs). Applying our method to human genes and miRNAs, we found 79 MRMs. The MRMs are produced from multiple information sources, including miRNA-target binding information, gene expression and miRNA expression profiles. Analysis of two first MRMs shows that these MRMs consist of highly-related miRNAs and their target genes with respect to biological processes.


The MRMs found by our method have high correlation in expression patterns of miRNAs as well as mRNAs. The mRNAs included in the same module shared similar biological functions, indicating the ability of our method to detect functionality-related genes. Moreover, review of the literature reveals that miRNAs in a module are involved in several types of human cancer.


MicroRNAs (miRNAs) are a class of small non-coding RNA molecules (20-24 nt), which are believed to participate in down-regulation of gene expressions. They inhibit their target genes (mRNA) in the post-transcriptional process by complementary base pairing [13]. Currently, 475 human miRNAs have been annotated in the miRNA registry, with over 1,000 miRNAs predicted to exist in humans. These miRNAs are predicted to target one-third of all genes in the genome, where each miRNA is expected to target around 200 transcripts [4, 5]. Recent studies have shown that miRNA can play fundamentally important roles in animal and plant development [13] as well as in genetic diseases including various types of cancer [69]. Therefore, discovering the functions of miRNA in living cells is an important task in biology.

Up to now, researchers have made many attempts to understand the functions of miRNAs in cellular processes more clearly, using both experimental and computational methods. Most efforts have concentrated on finding miRNAs and their targets [1013]. However, understanding the regulatory mechanism of miRNAs in the gene regulatory network is also essential to the discovery of functions of miRNAs in complex cellular systems. In animal cells, miRNA regulatory mechanism is represented by the relationships between miRNAs and their targets at the post-transcriptional level of the gene regulation network. Furthermore, the relationship between miRNAs and their target genes is generally complicated. One target gene could be regulated by several miRNAs and conversely, one miRNA may have several target genes [1, 2, 7].

In order to understand the regulatory mechanism of miRNAs in complex cellular systems and to discover important patterns hidden in the complex interactions, we need to identify the functional modules involved in complex interactions between miRNAs and their target genes [14, 15]. Previously, Yoon and De Micheli introduced the concept of miRNA regulatory modules (MRMs) [15], which are defined as groups of miRNAs and their target genes that are believed to have similar functions or to be involved in similar biological processes. They represented the multiple relations between miRNAs and target genes by a weighted bipartite graph, and then used a five-step method to find MRMs [15]. The main drawback of their method is that it deals only with miRNA-mRNA duplexes at the sequence level. Using only this kind of information may not be sufficient for determining MRMs. Other information such as miRNA and mRNA expression profiles could be also useful to detect the natural MRMs in a specific biological process [16, 17]. Another approach, proposed by Joung et al. [14], tries to combine multiple information sources to extract the MRMs. This method, however, relies on a genetic algorithm that undergoes several random processes. Therefore, the quality of their result depends on many sensitive parameters, thus making it unreliable.

As we know that miRNAs regulate expression by binding to cis-regulatory regions of 3'-UTR regions of genes, it is therefore reasonable to assume that genes regulated by the same miRNAs should contain similar expression profiles. This assumption initializes our analysis of human miRNA-target binding data and gene expression data to reveal the combinatorial nature of gene regulation at the post-transcription level. In this paper, we present a new computational method using rule learning to perform a comprehensive analysis of the combinatorial nature of gene regulation by detecting rules that identify a set of miRNAs associated with genes. The method extracts IF-THEN rules of miRNA combinations shared by target genes with a common expression profile. Similar to the approach of Joung et al. [14], our method also uses multiple information sources, including miRNA-target binding information, gene expression and miRNA expression profiles. However, the rule learning method allowed us to find the combinatorial nature of miRNA regulatory network without using any random process. As a result, the MRMs, found by our method, consist of highly-related miRNAs and their target genes with respect to biological processes. Moreover, evaluating MRMs by using the literature suggests that miRNAs in a module are involved in several types of cancer, and genes in the module indeed share common roles in biological processes.

Results and discussion

Finding potential miRNA regulatory modules

We applied our method to the human miRNA dataset as described in the Section Datasets. Table 1 shows the summary of potential MRMs induced by our method after applying several filtering procedures (Section Filtering rules). In general, the rule induction system can produce many rules from the miRNA regulatory table for each target gene. It may be that not all of them are interesting (i.e. significant with respect to biological processes). For finding the rules regarding highly related miRNAs and target genes with respect to expression, we used the Pearson's coefficient correlation (PCC) to remove uninteresting rules. A rule is significant if the PCC between any two genes is greater than a threshold (column 1, Table 1), and the same threshold was applied to miRNAs in that rule as well.

Table 1 Summary of miRNA regulatory rules induced by our method (confidence ≥ 0.75 and coverage ≥ 3)

We evaluated rules using the concept of confidence and coverage. Confidence indicates the exactness of the rules and defined as confidence = p/P; where p is the number of examples of positive class (i.e. similarity class) covered by the rule, and P is the number of all examples in the dataset covered by the rule. Coverage indicates the generality of the rules (i.e. the number of examples of positive class covered by the rule) and defined as coverage = p. Rule induction may produce a large number of very specific rules (i.e. rules with low coverage), indicating that no general relationship could be found between miRNA-binding information and expression data for these target genes. Other rules will cover many genes with a large diversity in their expression profiles (i.e. rules with low accuracy), violating the assumption that genes regulated by the same miRNAs should be coexpressed. Only when we find miRNA combinations common to several target genes with similar expression may we expect a high probability for actual coregulation.

In order to get a good estimate of our ability to find biologically interesting MRMs, we induced rules using only the 121 known miRNAs in human (Section Datasets). The number of rules induced from the dataset is given in column 2 in Table 1. The fact that our rule learning algorithm finds minimal miRNA combinations is attractive in general (column 3, Table 1). It also can be seen that our method produced fewer rules, when compared to previous methods (see [14] and [15]). The reason is that expression patterns of miRNAs as well as mRNAs in our rules were highly correlated. From each miRNA regulatory rule, we can easily obtain one corresponding potential MRM by finding similarity class examples covered by this rule. Table 2 shows thirty selected MRMs were found when our method was applied to the dataset mentioned in the Section Datasets. Due to limitations of space we can not show all modules, and the full set of potential MRMs can be obtained from our supplementary file

Table 2 Examples of potential miRNA regulatory rules (PCC = 0.2)

We also analyzed the expression patterns of miRNAs and mRNAs in each MRM, for example, Figure 1 shows the expression profiles of miRNAs and mRNAs of one MRM module that contains two miRNAs (hsa-miR-143 and hsa-miR-27a) and three target genes (NOVA1, CDH5, and ADD3). We can see that the expression patterns of miRNAs (Figure 1A) and mRNAs (Figure 1B) are highly similar. The illustration of expression patterns of other modules is omitted due to space limitations but can be performed in a similar manner.

Figure 1

Expression profiles of a module consists of two miRNAs and three target genes. (A) Expression profiles of miRNAs; (B) Expression profiles of target genes. X-axis represents samples; Y-axis represents expression values. The expression data was obtained from [9] on 89 samples.

Validation using gene ontology

With the current knowledge of combinatorial coregulation, it is hard for us to directly validate potential MRMs. Fortunately, using Gene Ontology (GO) [18] we can validate the target genes in each MRM with respect to biological processes, cellular components and molecular functions. This validation can be achieved by searching for statistically significant GO terms.

In order to test if the target genes for each MRM might be enriched functionally based on arbitrary GO terms, we performed GO annotation and significance analysis using GOstat [19]. We observed terms associated significantly with the target genes included in the GO gene-association database (goa_human and Affymetrix HG_U95AV2 Human known genes). We also used the default setting of GOstat. To find significantly overrepresented GO terms, GOstat calculates a P-value upon assuming hyper-geometric distribution of annotated GO terms. Table 3 shows the significant P-values of the genes in our example modules. It can be seen that miRNA target genes in our modules are actually highly correlated on GO annotations.

Table 3 Biological processes of potential miRNA regulatory modules annotated in GO [18]

Supporting evidence of miRNA associated with cancers

Recent studies have shown that several miRNAs are directly involved in human cancers (including lung, breast, brain, liver, and colon cancer) [2022]. This is because more than 50% of miRNA genes are located in cancer-associated genomic regions or fragile sites [23]. This evidence suggests that miRNAs may play a more important role in human cancers than was previously thought. Therefore, we validated the found modules with supporting evidence from the literature. Interestingly, several modules have been confirmed to be related to lung and other human cancers. For example, module 1 contains two miRNAs (hsa-miR-143 and hsa-miR-181b) and three target genes (NOVA1, ST8SIA4, and ZFP36L1). Both hsa-miR-143 and hsa-miR-181b are related to colorectal cancer [24, 25]. Specifically, Micheal et al. [24] reported that hsa-miR-143 had decreased expression in both tumorigenic and precancerous tissues compared to normal samples. Several cancer cell lines (including colorectal adenocarcinoma and breast carcinoma) were also found to have decreased expression levels of hsa-miR-143 [24]. The expression level of hsa-miR-181b was investigated in the study of Xi et al. [25]. Their analysis revealed that hsa-miR-181b had high expression level in tumors displaying p 53 deletion, and hsa-miR-181b expression level was strongly associated with the mutation status of the p 53 in tumor.

Of these target genes in this module, NOVA1 encodes a neuron-specific RNA-binding protein, a member of the Nova family of paraneoplastic disease antigenes that is recognized and inhibited by paraneoplastic antibodies. These antibodies are found in the sera of patients with breast cancer and small cell lung cancer [26]. ST8SIA4 encodes a type II membrane protein, which is a member of glycosyltransferase family 29 and may be present in the Golgi apparatus. Although this gene is considered as a member of genes coding for membrane protein, it can show differences in expression levels between malignant and non-malignant tumor [27]. The last one, ZFP36L1, is a member of the TIS11 family of early response genes. This gene is well conserved across species and has a promoter that contains motifs seen in other early-response genes. It may have a role as an oncogene.

Module 2 consists of two miRNAs (hsa-miR-145 and hsa-miR-125b) and five target genes (DAG1, NEDD9, YES1, BMPR2, and PTPRF). Iorio et al. [28] analyzed the expression of 76 breast cancer and 10 normal breast samples to identify miRNAs whose expressions are significantly deregulated in cancer versus normal breast tissues. They reported that hsa-miR-125b and hsa-miR-145 were indeed involved in human breast cancer [28]. While hsa-miR-125b was down-regulated, hsa-miR-145 was up-regulated in human breast cancer. Their analysis suggested that these miRNAs may potentially act as tumor suppressors. Furthermore, expression of hsa-miR-145 was found at a low level in lung cancer tissues compared to normal samples [29]. Based on the target prediction and expression level of hsa-miR-145 in human cancers, Akao et al. [30] also suggested that this miRNA may suppress genes involved in signal transduction and oncogenesis.

Of five target genes in this module, three of them (NEDD9, BMPR2, and PTPRF) are involved in cell surface receptor linked signal transduction, and others are involved in protein metabolic process in terms of GO categories (Table 3). Interestingly, all genes also have roles in development of several type of cancers. For example, PTPRF encoded proteins which are known to be signaling molecules that regulate a variety of cellular processes including cell growth, differentiation, mitotic cycle, and oncogenic transformation. The PTPRF gene also plays important roles in colorectal cancers [31] and kidney carcinomas [32]. Therefore, it is reasonable for us to conclude that our predicted MRM modules are really related to human cancers.

Additionally, Table 4 shows several selected miRNAs from the set of our MRMs associated with human cancers. Based on overall investigation into recently published papers in the literature, we found that some miRNAs in our modules were confirmed as tumor suppressors while some other had function as oncogenes. This suggests that our method could be used to find potential miRNAs which may be associated with human cancers.

Table 4 Selected miRNAs associated with human cancers


Although numerous miRNAs have recently been discovered in some species, their precise functional roles in cellular processes are still largely unknown. Specifically, the relationships between miRNAs and their target genes are less understood. In this paper we introduced a new computational method for finding MRMs from their predicted target genes and expression datasets (mRNA expression profiles and miRNA expression profiles). By combining these information sources, we can discover relevant MRMs in human genome.

In MRMs, found by our method, expression patterns of miRNAs as well as mRNAs were highly correlated. The mRNAs included in the same module also shared similar biological functions, indicating the ability of our method to detect functionality-related genes. Moreover, we also analyzed the relationships between several cancer diseases and our MRMs by using the literature. This analysis revealed that miRNAs in a module are involved in several types of cancer and genes in the module indeed share common roles in biological processes.

Despite these benefits of our method, several issues require further investigation. First, our rule induction method still produces a lot of rules. Many of them may be insignificant. New rule evaluation heuristic approaches could be used to reduce the search rule space. Second, the quality of MRMs obtained by our method depends on the choice of the similarity measure. In this paper, we have used the Pearson's correlation coefficient. However, other measures with the similar properties could be used for further study.



In our experiments, we extracted the expression profiles of miRNAs and mRNAs from the experimental data previously published by Lu et al. [9]. This dataset consists of 217 miRNAs and about 16,063 mRNAs on 89 multiple human cancer samples. The current miRNA target prediction methods are mainly based on the principle of miRNA-target interactions, and the accuracy of these methods has been confirmed by experimental validation of randomly selected miRNA targets [33] and by large-scale gene expression profiling studies [34]. Though there are several available miRNA target prediction methods such as PicTar, miRanda, and TargetScan, a recent study indicated that PicTar had the highest success rate in target gene prediction [35]. Moreover, up to 90% of the randomly selected miRNA targets from the predictions by PicTar have been validated as true targets [33]. We thus utilized PicTar algorithm [12] for obtaining predicted target genes of each miRNAs.

From three kinds of data (expression profiles of miRNAs and mRNAs, and miRNA target genes), we analyzed the relationships among 121 human miRNAs and 801 mRNAs, which are linked together. Of these 801 mRNA × 121 miRNA possible binding pairs, 4,629 pairs with significant binding scores (PicTar's score ≥ 1.0) were used in our experiments. Specifically, one miRNA binds to 38.25 mRNAs and one mRNA is bound by 5.77 miRNA on average in our data set. Further information about the original datasets is shown in Table 5.

Table 5 Overview of the original datasets used in this paper

Method overview

The problem can be formulated as follows: given a set of miRNAs (mi1, mi2,..., mi M ) and a set of their target genes (mRNAs) (m1, m2,..., m N ), we need to find a set of MRMs, each MRM is defined as a subset of miRNAs (mii 1, mii 2,..., mi ik ) and a subset of target genes (mj 1, mj 2,..., m jl ), where |ik| ≤ |M| and |jl| ≤ |N|. Figure 2 shows procedural steps of our approach. In the first step, we consider the first line (i.e. first gene) of the target gene (mRNA) expression profile table. We calculate the correlation coefficients between it and all other genes. The gene set will be divided into two classes, similarity and dissimilarity by using a correlation threshold. Next, we construct a regulatory decision table for the current gene by adding a class-column into the miRNA binding information table (Figure 2). We then apply the CN2-SD rule induction system [36] to produce a set of miRNA-mRNA regulatory rules. After that we use several filtering procedures to remove uninteresting rules. Only significant rules, which contain the miRNAs with highly correlated expression profiles, are considered to generate potential MRMs. This procedure will be repeated for the second gene in the mRNA expression profile table, and for all other genes.

Figure 2

Schematic description of our method for finding MRMs. An overview of our rule-based method for finding miRNA regulatory rules from multiple information sources, including miRNA expression profiles, mRNA expression profiles, and miRNA-target binding information.

The Pearson's correlation coefficient

In statistics, the Pearson's correlation coefficient (PCC) is a measure of similarity/dissimilarity between two random variables. In our case, we use the PCC for measuring similarity/dissimilarity between expression patterns of two genes or two miRNAs. Given two genes x and y, the PCC of x and y is defined as follows:

P C C ( x , y ) = i = 1 m ( x i x ¯ ) ( y i y ¯ ) i = 1 m ( x i x ¯ ) 2 i = 1 m ( y i y ¯ ) 2 MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaemiuaaLaem4qamKaem4qamKaeiikaGIaemiEaGNaeiilaWIaemyEaKNaeiykaKIaeyypa0tcfa4aaSaaaeaadaaeWaqaaiabcIcaOiabdIha4naaBaaabaGaemyAaKgabeaacqGHsislcuWG4baEgaqeaiabcMcaPiabcIcaOiabdMha5naaBaaabaGaemyAaKgabeaacqGHsislcuWG5bqEgaqeaiabcMcaPaqaaiabdMgaPjabg2da9iabigdaXaqaaiabd2gaTbGaeyyeIuoaaeaadaGcaaqaamaaqadabaGaeiikaGIaemiEaG3aaSbaaeaacqWGPbqAaeqaaiabgkHiTiqbdIha4zaaraGaeiykaKYaaWbaaeqabaGaeGOmaidaaaqaaiabdMgaPjabg2da9iabigdaXaqaaiabd2gaTbGaeyyeIuoadaaeWaqaaiabcIcaOiabdMha5naaBaaabaGaemyAaKgabeaacqGHsislcuWG5bqEgaqeaiabcMcaPmaaCaaabeqaaiabikdaYaaaaeaacqWGPbqAcqGH9aqpcqaIXaqmaeaacqWGTbqBaiabggHiLdaabeaaaaaaaa@6942@

where x i and y i are the i th sample values of genes x and y, respectively; x ¯ MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGafmiEaGNbaebaaaa@2D66@ and y ¯ MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xH8viVGI8Gi=hEeeu0xXdbba9frFj0xb9qqpG0dXdb9aspeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGafmyEaKNbaebaaaa@2D68@ are mean values obtained from m samples of genes x and y, respectively. The PCC of a pair of genes commonly returns a real value in [+1, -1]. PCC(x, y) > 0 represents that x and y are positively correlated with the degree of correlation. On the other hand, PCC(x, y) < 0 represents that x and y are negatively correlated with a value |PCC(x, y)|. A positive value of the PCC indicates that two genes are co-expressed and a negative value of the PCC indicates that opposite expression pattern exists between them. We can see that with this measure, genes with low- and high-expression values may be placed in the same cluster if they have similar patterns of changes in expression values over the samples. The advantage of the PCC over the Euclidean measure is that the Euclidean methods find mainly spherical shape of clusters, even if the shape of clusters may not be present in the dataset. The PCC is used as a measure of similarity/dissimilarity of cluster genes with similar expression patterns.

Rule induction

Rule induction is a machine learning technique that has been successfully applied in subgroup discovery. The problem of subgroup discovery can be defined as follows: given a population of individuals and a property of those individuals we are interested in, find population subgroups that are interesting with respect to the property of interest [36]. The induced rules usually have the form Cond → Class, where Class is a value of the property of interest, and Cond is a conjunction of attribute-value pairs selected from the features describing the training instances. In our case, Class has two values, similarity and dissimilarity. Attributes are miRNAs and attribute-value is 0 or 1.

In general, there are three strategies for inducing rules (describing individual interesting patterns) from data: separate-and-conquer, divide-and-conquer and exhaustive search [37]. The separate-and-conquer strategy searches for a rule that covers part of its training instances, separates (or reassigns with lower weight) these examples, and recursively conquers the remaining examples by learning more rules until no examples remain. The divide-and-conquer strategy is used in decision tree algorithms; this strategy is restricted to learning non-overlapping rules only. The exhaustive search strategy explores almost all of the whole search space. The basic idea is to use an association rule algorithm to gather all rules that predict the class attribute and also pass a minimum quality criterion.

By implementation, the divide-and-conquer strategy (in decision tree-based algorithms) is restricted to learn non-overlapping rules only. The exhaustive strategy (in association rule-based algorithms) has the problem of producing many redundant rules. The separate-and-conquer algorithms can partially avoid these disadvantages [36, 38], which is one of the main reasons for its popularity.

CN2 is a rule induction system implementing the separate-and-conquer strategy [39]. It learns a rule set by iteratively adding rules one at a time. Examples covered by the rule are removed from the search space before learning the next rule to add to the rule set. This is repeated until all examples are covered by at least one rule in the rule set or some stopping criteria is satisfied. Finally, CN2 can induce a set of independent rules, where each rule describes a specific subgroup of instances. This is not suitable for description tasks (discovering individual rules describing interesting patterns, as in this work). Since CN2 only induces the first few rules discovered are usually interesting. Subsequently induced rules are obtained from biased example subsets, i.e., subsets including only positive examples that are not covered by previously induced rules.

In 2004, CN2-SD, an improvement of CN2 for subgroup discovery, was proposed [36]. The CN2-SD generalizes the covering algorithm by introducing example weights. Initially, all examples have a weight of 1.0. However, the weights of examples covered by a rule will not be set to 0 (they are not removed as in CN2), but instead will be reduced by a certain factor. The resulting number of rules is typically higher than with CN2, since most examples will be covered by more than one rule. CN2-SD is, therefore, better able to learn local patterns, since the influence of previously covered patterns is reduced, but not completely ignored. In order to evaluate the rules with higher generality, CN2-SD also uses a weighted relative accuracy heuristic as presented in Equation 2. The weighted covering strategy tends to find rules that explain overlapped subgroups of instances in the search space, so the weighted relative accuracy heuristic produces highly general rules that express the knowledge contained in one specific subgroup. For these reasons, we utilize the CN2-SD in the rest of this paper for finding miRNA regulatory rules.

h W R A ( C o n d C l a s s ) = p ( C o n d ) p ( C l a s s | C o n d ) p ( C l a s s ) MathType@MTEF@5@5@+=feaagaart1ev2aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaemiAaG2aaSbaaSqaaiabdEfaxjabdkfasjabdgeabbqabaGccqGGOaakcqWGdbWqcqWGVbWBcqWGUbGBcqWGKbazcqGHsgIRcqWGdbWqcqWGSbaBcqWGHbqycqWGZbWCcqWGZbWCcqGGPaqkcqGH9aqpjuaGdaWcaaqaaiabdchaWjabcIcaOiabdoeadjabd+gaVjabd6gaUjabdsgaKjabcMcaPaqaaiabdchaWjabcIcaOiabdoeadjabdYgaSjabdggaHjabdohaZjabdohaZjabcYha8jabdoeadjabd+gaVjabd6gaUjabdsgaKjabcMcaPiabgkHiTiabdchaWjabcIcaOiabdoeadjabdYgaSjabdggaHjabdohaZjabdohaZjabcMcaPaaaaaa@6571@

Filtering rules

Though the CN2-SD rule induction system uses a weighted covering strategy to restrict the redundancy of learned rules and guarantee the scanning of the whole search space, uninteresting rules are still produced [36, 37]. Let us assume that our rule r has a form: IF [Cond] THEN [ClassDistribution]. Where Cond = [miR1 = val1miR2 = val2miR3 = val3...miR k = val k ] and Classdistribution = [p, n] is the class distribution of examples covered by r (miR i is a miRNA and val i = 0 or 1). We have used several heuristics to filter out unexpected rules. First, we remove trivial rules, r is called a trivial rule if the number of positive examples covered by r is less than 2. The reason is that the miRNAs in this rule only coregulate one gene, it is a trivial case. Second, if there is any miRNA in the Cond part of a rule which has a value equal to 0, this miRNA does not bind to the target genes of the corresponding rule. We also remove such rules. Third, we calculate the correlation coefficient between all miRNA pairs which appear in the same module. If the correlation coefficient of any miRNA pair is less than a given threshold, that rule will also be removed. This heuristic allows us to find MRMs which are not only highly correlated on target genes, but also highly correlated on miRNAs with respect to expression profiles.


  1. 1.

    Ambros V: The functions of animal microRNAs. Nature 2004, 431: 350–355. 10.1038/nature02871

    CAS  Article  PubMed  Google Scholar 

  2. 2.

    Bartel DP: MicroRNAs: genomics, biogenesis, mechanism, and function. Cell 2004, 116: 281–297. 10.1016/S0092-8674(04)00045-5

    CAS  Article  PubMed  Google Scholar 

  3. 3.

    Lagos-Quintana M, Rauhut R, Lendeckel W, Tuschl T: Identification of novel genes coding for small expressed RNAs. Science 2001, 294: 853–858. 10.1126/science.1064921

    CAS  Article  PubMed  Google Scholar 

  4. 4.

    Griffiths-Jones S, Grocock RJ, Dongen S, Bateman A, Enright AJ: miRBase: microRNA sequences, targets and gene nomenclature. Nucleic Acids Res 2006, 34: D140-D144. 10.1093/nar/gkj112

    PubMed Central  CAS  Article  PubMed  Google Scholar 

  5. 5.

    Griffiths-Jones S, Saini HK, van Dongen S, Enright AJ: miRBase: Tools for microRNA genomics. Nucleic Acids Res 2008, 36: D154-D158. 10.1093/nar/gkm952

    PubMed Central  CAS  Article  PubMed  Google Scholar 

  6. 6.

    Blenkiron C, Thorne L, Thorne N, Spiteri I, Chin S, Dunning M, Barbosa-Morais N, Teschendsoff A, Green A, Ellis I, Tavare S, Caldas C, Miska E: MicroRNA expression profiling of human breast cancer identifies new markers of tumour subtype. Genome Biol 2007,8(10):R214. 10.1186/gb-2007-8-10-r214

    PubMed Central  Article  PubMed  Google Scholar 

  7. 7.

    He L, Hannon GJ: MicroRNAs: Small RNAs with a big role in gene regulation. Nature Review 2004, 5: 522–531. 10.1038/nrg1379

    CAS  Article  Google Scholar 

  8. 8.

    Hobert O: miRNAs play a tune. Cell 2007, 131: 22–24. 10.1016/j.cell.2007.09.031

    CAS  Article  PubMed  Google Scholar 

  9. 9.

    Lu J, Getz G, Miska AE, Alvarez-Savedra E, Lamb J, Peck D, Sweet-Cordero A, Ebert LB, Mak HR, Ferrando AA, Downing , Jacks T, Horvitz HR, Golub RT: MicroRNA expression profiles classify human cancers. Nature 2005, 435: 834–838. 10.1038/nature03702

    CAS  Article  PubMed  Google Scholar 

  10. 10.

    Brown J, Sanseau P: A computational view of microRNAs and their targets. Drug discovery today: biosilico 2005,10(8):595–601.

    CAS  Article  Google Scholar 

  11. 11.

    Kiriakidou M, Nelson PT, Kouranov A, Fitziev P, Bouyioukos C, Mourelatos Z, Hatzigeorgiou A: A combined computational-experimental approach predicts human microRNA targets. Genes Dev 2004, 18: 1165–1178. 10.1101/gad.1184704

    PubMed Central  CAS  Article  PubMed  Google Scholar 

  12. 12.

    Krek A, Grun D, Poy MN, Wolf R, Rosenberg L, Epstein E, MacMenamin P, Piedade I, Gunsalus KC, Stoffel M, Rajewsky N: Combinatorial microRNA target predictions. Nature Genetics 2005, 37: 495–500. 10.1038/ng1536

    CAS  Article  PubMed  Google Scholar 

  13. 13.

    Lai EC, Tomancak P, Williams RW, Rubin GM: Computational identification of Drosophila microRNA genes. Genome Biol 2003, 4: R42. 10.1186/gb-2003-4-7-r42

    PubMed Central  Article  PubMed  Google Scholar 

  14. 14.

    Joung GJ, Hwang BK, Ban WJ, Kim JS, Zhang TB: Discovery of microRNA-mRNA modules via population-based probabilistic learning. Bioinformatics 2007,23(9):1141–1147. 10.1093/bioinformatics/btm045

    CAS  Article  PubMed  Google Scholar 

  15. 15.

    Yoon S, Micheli GD: Prediction of regulatory modules comprising microRNAs and target genes. Bioinformatics 2005,21(2):ii93-ii99. 10.1093/bioinformatics/bti1116

    CAS  PubMed  Google Scholar 

  16. 16.

    Huang JC, Morris QD, Frey BJ: Detecting MicroRNA Targets by Linking Sequence, MicroRNA and Gene Expression Data. Proc RECOMB 2006, 114–129.

    Google Scholar 

  17. 17.

    Zilberstein CB, Ziv-Ukelson M, Pinter RY, Yakhini Z: A High-Throughput Approach for Associating MicroRNAs with Their Activity Conditions. J Comput Biol 2006, 13: 245–266. 10.1089/cmb.2006.13.245

    CAS  Article  PubMed  Google Scholar 

  18. 18.

    Ashburner M, Ball CA, Blake JA, Botstein D, Butler H, Cherry JM, Davis AP, Dolinski K, Dwight SS, Eppig JT, Harris MA, Hill DP, Issel-Tarver L, Kasarskis A, Lewis S, Matese JC, Richardson JE, Ringwald M, Rubin GM, Sherlock G: Gene ontology: tool for the unification of biology. The Gene Ontology Consortium. Nature Genetic 2000, 25: 25–29. 10.1038/75556

    CAS  Article  Google Scholar 

  19. 19.

    Beissbarth T, Speed TP: GOstart: find statistically overrepresented Gene Ontologies within a group of genes. Bioinformatics 2004, 20: 1464–1465. 10.1093/bioinformatics/bth088

    CAS  Article  PubMed  Google Scholar 

  20. 20.

    Baohong Z, Xiaoping P, George PC, Todd AA: MicroRNAs as oncogenes and tumor suppressors. The New Eng J Med 2007, 353: 1767–1771.

    Google Scholar 

  21. 21.

    Dalmay T: MicroRNA and cancer. J Int Med 2008, 263: 1365–2796.

    Article  Google Scholar 

  22. 22.

    Wei W, Miao S, Gang-Ming Z, Jianjun C: MicroRNA and cancer: Current status and prospective. Int J Cancer 2006, 120: 953–960.

    Article  Google Scholar 

  23. 23.

    Calin GA, Sevignani C, Dan C, Hyslop T, Noch E, Yendamuri S, Shimizu M, Rattan S, Bullrich F, Negrini M, Croce CM: Human microRNA genes are frequently located at fragile sites and genomic regions involved in cancers. Proc Natl Acad Sci USA 2004, 101: 2999–3004. 10.1073/pnas.0307323101

    PubMed Central  CAS  Article  PubMed  Google Scholar 

  24. 24.

    Michael MZ, O'Connor SM, Pellekaan NG, Young GP, James RJ: Reduced accumulation of specific mi-croRNAs in colorectal neoplasia. Mol Cancer Res 2003,1(12):882–891.

    CAS  PubMed  Google Scholar 

  25. 25.

    Xi Y, Shalgi R, Fodstad O, Pil Y, Ju J: Differentially regulated micro-RNAs and actively translated messenger RNA transcripts by tumor suppressor p53 in colon cancer. Clin Cancer Res 2006, 12: 2014–2024. 10.1158/1078-0432.CCR-05-1853

    CAS  Article  PubMed  Google Scholar 

  26. 26.

    Ueki K, Ramaswamy S, Billings SJ, Mohrenweiser HW, Louis DN: ANOVA, a putative astrocytic RNA-binding protein gene that maps to chromosome 19q13.3. Neurogenetics 1997, 1: 31–36. 10.1007/s100480050005

    CAS  Article  PubMed  Google Scholar 

  27. 27.

    Zilberstein CB, Ziv-Ukelson M, Pinter RY, Yakhini Z: Altered Glycosylation in Cancer: Sialic Acids and Sialyltransferases. J of Cancer Molecules 2005,1(2):73–81.

    Google Scholar 

  28. 28.

    Iorio VM, et al.: MicroRNA Gene Expression Deregulation in Human Breast Cancer. Cancer Res 2005, 65: 7065–7070. 10.1158/0008-5472.CAN-05-1783

    CAS  Article  PubMed  Google Scholar 

  29. 29.

    Yanaihara N, et al.: Unique microRNA molecular profiles in lung cancer diagnosis and prognosis. Cancer Cell 2006,9(3):189–198. 10.1016/j.ccr.2006.01.025

    CAS  Article  PubMed  Google Scholar 

  30. 30.

    Akao Y, Nakagawa Y, Naoe T: MicroRNAs 143 and 145 are possible common onco-microRNAs in human cancers. Oncol Rep 2006,16(4):845–850.

    CAS  PubMed  Google Scholar 

  31. 31.

    Harder KW, Saw J, Miki N, Jirik F: Coexisting Amplifications of the Chromosome 1p32 Genes (PTPRF and MYCL1) Encoding Protein Tyrosine Phosphatase LAR and L-myc in a Small Cell Lung Cancer Line. Genomics 2002,27(3):552–553. 10.1006/geno.1995.1092

    Article  Google Scholar 

  32. 32.

    Cheburkin YV, et al.: Molecular Portrait of Human Kidney Carcinomas: The cDNA Microarray Profiling of Kinases and Phosphatases Involved in the Cell Signaling Control. Molecular biology 2002,36(3):376–384. 10.1023/A:1016059313254

    CAS  Article  Google Scholar 

  33. 33.

    Rajewsky N: MicroRNA target predictions in animals. Nat Genet 2006, 38: S8-S13. 10.1038/ng1798

    CAS  Article  PubMed  Google Scholar 

  34. 34.

    Lim LP, Clau NC, Garret-Engele P, Grimson A, Schelter JM, Castle J, Bartel DP, Linsley PS, Jonson JM: Microarray analysis shows that some microRNAs downregulate large numbers of target mRNAs. Nature 2005, 433: 769–773. 10.1038/nature03315

    CAS  Article  PubMed  Google Scholar 

  35. 35.

    Grun D, Wang Y, Langenberger D, Gunsalus K, Rajewsky N: MicroRNA target predictions across seven Drosophila species and comparison to mammalian targets. PLoS Comput Biol 2005, 1: e13. 10.1371/journal.pcbi.0010013

    PubMed Central  Article  PubMed  Google Scholar 

  36. 36.

    Lavrac N, Kavsek B, Flach P, Todorovski L: Subgroup discovery with CN2-SD. J Machine Learning Res 2004, 5: 153–188.

    Google Scholar 

  37. 37.

    Pham TH, Clemente JC, Satou K, Ho TB: Computational discovery of transcriptional regulatory rules. Bioinformatics 2005, 21: ii101-ii107. 10.1093/bioinformatics/bti1117

    CAS  Article  PubMed  Google Scholar 

  38. 38.

    Furnkranz J: Separate-and-Conquer Rule Learning. Artificial Intelligence Review 1999, 13: 03–54. 10.1023/A:1006524209794

    Article  Google Scholar 

  39. 39.

    Clark P, Nibblet T: The CN2 induction algorithm. Machine Learning 1989, 3: 261–283.

    Google Scholar 

  40. 40.

    Metzler M, Wilda M, Busch K, Viehmann S, Borkhardt A: High expression of precursor microRNA-155/BIC RNA in children with Burkitt lymphoma. Genes Chromosomes Cancer 2004, 39: 167–169. 10.1002/gcc.10316

    CAS  Article  PubMed  Google Scholar 

  41. 41.

    Volinia S, et al.: A microRNA expression signature of human solid tumors defines cancer gene targets. PNAS 2006,103(7):2257–2261. 10.1073/pnas.0510565103

    PubMed Central  CAS  Article  PubMed  Google Scholar 

  42. 42.

    He L, et al.: A microRNA polycistron as a potential human oncogene. Nature 2005, 435: 828–833. 10.1038/nature03552

    PubMed Central  CAS  Article  PubMed  Google Scholar 

  43. 43.

    Calin GA, et al.: Frequent deletions and down-regulation of micro-RNA genes miR15 and miR16 at 13q14 in chronic lymphocytic leukemia. Proc Natl Acad Sci USA 2002, 99: 15524–15529. 10.1073/pnas.242606799

    PubMed Central  CAS  Article  PubMed  Google Scholar 

  44. 44.

    Yu SL, et al.: MicroRNA Signature Predicts Survival and Relapse in Lung Cancer. Cancer Cell 2008, 13: 48–57. 10.1016/j.ccr.2007.12.008

    CAS  Article  PubMed  Google Scholar 

  45. 45.

    Nakajima G, Hayashi K, Xi Y, Kudo K, Uchida K, Takasaki K, Yamamoto M, Ju J: Non-coding MicroRNAs hsa-let-7g and hsa-miR-181b are Associated with Chemoresponse to S-1 in Colon Cancer. Cancer Genomics Proteomics 2006,3(5):317–324.

    PubMed Central  CAS  PubMed  Google Scholar 

  46. 46.

    Xi Y, Formentini A, Chien M, Weir DB, Russo JJ, Ju J, Kornmann M, Ju J: Prognostic values of microRNAs in colorectal cancer. Biomark Insights 2006, 2: 113–121.

    PubMed  Google Scholar 

  47. 47.

    Debernardi S, Skoulakis S, Molloy G, Chaplin T, Dixon-Mclver A, Young BD: MicroRNA miR-181a correlates with morphological sub-class of acute myeloid leukaemia and the expression of its target genes in global genome-wide analysis. Leukemia 2007, 21: 912–916.

    CAS  PubMed  Google Scholar 

  48. 48.

    Tavazoie SF, Alarcon C, Oskarsson T, Padua D, Wang Q, Bos PD, Gerald WL, Massague J: Endogenous human microRNAs that suppress breast cancer metastasis. Nature 2008, 451: 147–152. 10.1038/nature06487

    PubMed Central  CAS  Article  PubMed  Google Scholar 

  49. 49.

    Johnson CD, et al.: The let-7 microRNA represses cell proliferation. Cancer Res 2007,67(16):7713–7722. 10.1158/0008-5472.CAN-07-1083

    CAS  Article  PubMed  Google Scholar 

  50. 50.

    Mertens-Talcott SU, Chintharlapalli S, Li X, Safe S: The Oncogenic microRNA-27a targets genes that regulate specificity protein transcription factors and the G2-M checkpoint in MDA-MB-231 breast cancer cells. Cancer Res 2007,67(22):11001–11011. 10.1158/0008-5472.CAN-07-2416

    CAS  Article  PubMed  Google Scholar 

Download references


The research described in this paper was partially supported by the Institute for Bioinformatics Research and Development of the Japan Science and Technology Agency, and by COE project JCP KS1 of the Japan Advanced Institute of Science and Technology. The first author has been supported by Japanese government scholarship (Monbukagakusho) to study in Japan. The authors would like to thank Prof. Nada Lavrac for providing us the newest version of CN2-SD software. We also would like to thank Dr. Tho Hoan Pham for sharing his experience on rule induction learning and his comments on the manuscript.

This article has been published as part of BMC Bioinformatics Volume 9 Supplement 12, 2008: Asia Pacific Bioinformatics Network (APBioNet) Seventh International Conference on Bioinformatics (InCoB2008). The full contents of the supplement are available online at

Author information



Corresponding author

Correspondence to Dang Hung Tran.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

DHT and KS defined the research question, designed and performed the experiments. DHT and TBH drafted the manuscript. All authors contributed to and approved the final version of the manuscript.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Cite this article

Tran, D.H., Satou, K. & Ho, T.B. Finding microRNA regulatory modules in human genome using rule induction. BMC Bioinformatics 9, S5 (2008).

Download citation


  • Gene Ontology
  • miRNA Target
  • miRNA Expression Profile
  • Rule Induction
  • Subgroup Discovery