- Methodology article
- Open Access
Exploring complex miRNA-mRNA interactions with Bayesian networks by splitting-averaging strategy
- Bing Liu^{1}Email author,
- Jiuyong Li^{1},
- Anna Tsykin^{2},
- Lin Liu^{1},
- Arti B Gaur^{3} and
- Gregory J Goodall^{2, 4}
https://doi.org/10.1186/1471-2105-10-408
© Liu et al; licensee BioMed Central Ltd. 2009
- Received: 22 June 2009
- Accepted: 10 December 2009
- Published: 10 December 2009
Abstract
Background
microRNAs (miRNAs) regulate target gene expression by controlling their mRNAs post-transcriptionally. Increasing evidence demonstrates that miRNAs play important roles in various biological processes. However, the functions and precise regulatory mechanisms of most miRNAs remain elusive. Current research suggests that miRNA regulatory modules are complicated, including up-, down-, and mix-regulation for different physiological conditions. Previous computational approaches for discovering miRNA-mRNA interactions focus only on down-regulatory modules. In this work, we present a method to capture complex miRNA-mRNA interactions including all regulatory types between miRNAs and mRNAs.
Results
We present a method to capture complex miRNA-mRNA interactions using Bayesian network structure learning with splitting-averaging strategy. It is designed to explore all possible miRNA-mRNA interactions by integrating miRNA-targeting information, expression profiles of miRNAs and mRNAs, and sample categories. We also present an analysis of data sets for epithelial and mesenchymal transition (EMT). Our results show that the proposed method identified all possible types of miRNA-mRNA interactions from the data. Many interactions are of tremendous biological significance. Some discoveries have been validated by previous research, for example, the miR-200 family negatively regulates ZEB1 and ZEB2 for EMT. Some are consistent with the literature, such as LOX has wide interactions with the miR-200 family members for EMT. Furthermore, many novel interactions are statistically significant and worthy of validation in the near future.
Conclusions
This paper presents a new method to explore the complex miRNA-mRNA interactions for different physiological conditions using Bayesian network structure learning with splitting-averaging strategy. The method makes use of heterogeneous data including miRNA-targeting information, expression profiles of miRNAs and mRNAs, and sample categories. Results on EMT data sets show that the proposed method uncovers many known miRNA targets as well as new potentially promising miRNA-mRNA interactions. These interactions could not be achieved by the normal Bayesian network structure learning.
Keywords
- Bayesian Network
- Ingenuity Pathway Analysis
- Biological Experiment
- Sample Category
- Bayesian Network Structure
Background
MicroRNAs (miRNAs) belong to a group of single-stranded, non-coding RNAs that are 21-23 nucleotides in length [1]. miRNAs target protein coding mRNAs through complementary base-pairing that results in repressing translation and causing mRNA degradation [2, 3]. Hundreds of miRNAs have been identified and sequenced in plants, animals, and viruses since the first miRNA, lin-4, was discovered in 1993 [4]. As a growing class, it is estimated that miRNAs directly regulate at least 30% of the genes in the human genome [5].
Increasing evidence suggests that miRNAs play important roles in cell differentiation, proliferation, growth, mobility, and apoptosis [6–8]. miRNAs regulate target mRNAs [9], and act as rheostats to make fine-scale adjustments to protein output [10]. Consequently, dysregulation of miRNA function may lead to human diseases, including cancers [11]. However, the functions of most miRNAs and their precise regulatory mechanisms remain elusive. Thus, great efforts have been made to elucidate miRNA functions in recent years.
Extensive studies have proposed the diverse features of miRNA regulation. Mature miRNAs target the 3' untranslated regions (3' UTR) of genes by complementary base-pairing. Furthermore, mature miRNAs can alter the expression of genes by binding to the coding regions as well as the 5' UTR [12, 13]. Other regions, known as extended seed and delta seed regions, also contribute to the target selection [14]. miRNAs down-regulating target mRNAs has been widely observed [15, 16]. Recent experiments also show that miRNAs up-regulate target mRNAs in some cases [17–20]. In addition, miRNAs may up-regulate target mRNAs in one condition, but repress translation in another condition. For example, let7 and the synthetic microRNA miRcxcr4-likewise induce translation up-regulation of target mRNAs upon cell-cycle arrest; yet, they repress translation in proliferating cells [17]. The diversity and abundance of miRNA targets result in a large number of possible miRNA regulatory mechanisms. It would be infeasible to test all the possibility with biological experiments in large scale. Alternatively, computational approaches can facilitate experimental validation by producing valid hypotheses from existing data.
Several computational methods have been proposed to study miRNA regulatory mechanisms. Yoon et al. [21] proposed a prediction method for miRNA regulatory modules (MRMs) in which weighted bipartite graphs are adopted to model the binding structures of miRNAs and mRNAs at the sequence level. However, predictions only based on sequence may not be sufficient to determine the complex interactions of miRNA-mRNA pairs. Huang et al. [22] applied Bayesian network parameter learning to infer miRNA-mRNA interactions, while Joung et al. [23] utilized a biclustering approach to discover MRMs. Their methods integrate both sequence information and expression profiles of miRNAs and mRNAs to identify the relevant miRNA-mRNA pairs, thus potentially reduce false discovery rate. Furthermore, Tran et al. [24] applied a rule based method to explore MRMs based on an assumption that miRNAs and mRNAs of a module have similar expression patterns. Similarly, their method uses both sequence information and expression profiles of miRNAs and mRNAs. However, no information of sample categories has been utilized. Considering most biological experiments are designed to compare samples from different phenotypes, conditions, or treatment groups, the sample categories are important for exploring subtle but useful differences. All of the above mentioned methods have not utilized this critical characteristic of comparative design of biological experiments so far. In this study, we will show that without using the information of sample categories, subtle miRNA-mRNA interactions are missed out. In previous work, Liu et al. [25] associated miRNA-mRNA pairs with specific conditions to discover the functional miRNA-mRNA regulatory modules (FMRMs). However, only down-regulation patterns were considered. In this work, we will explore all the possible miRNA-mRNA interactions by taking into account sample categories of comparative designs of biological experiments.
Considering the complexity and diversity of miRNA-mRNA interactions, Bayesian Network (BN) structure learning has the privileges to discover statistically significant miRNA-mRNA interactions from data. It has been used widely for discovering gene regulatory networks [26], but not often for finding miRNA-mRNA interactions yet. In the scenario of BN structure learning, the interactions between miRNAs and mRNAs are defined as dependencies of their states encoded in a graphical representation. In the graph, miRNAs and mRNAs are denoted as nodes and interactions are directed edges. The presence or absence of a directed edge from a miRNA to a mRNA indicates the states of the mRNA are dependent or independent on that of a miRNA. This implies their regulatory relationship. Thus, the dependencies in the graph encode various types of miRNA-mRNA interactions. When the expression data of miRNAs and mRNAs are given, we can use the BN structure learning to capture miRNA-mRNA interactions.
In this paper, we present a method to capture complex miRNA-mRNA interactions with BN structure learning for specific conditions. This method discovers the dependency relationship between miRNAs and mRNAs which implies their complex interactions on heterogeneous data sets: miRNA-target binding information, expression profiles of miRNAs and mRNAs. In order to capture all possible interactions, we split expression profiles of miRNAs and mRNAs according to sample categories, and then build Bayesian networks on separate data sets. Interaction networks identified on individual data sets are then integrated by BN averaging procedure. To avoid statistically insignificant results due to small data sets, we employ bootstrapping to achieve reliable inference and integration. We call this strategy splitting and averaging of Bayesian networks (SA-BNs).
To test the SA-BNs approach, we used microRNA and mRNA expression data from the NCI-60 panel of cell lines and focused on miRNA-mRNA interactions potentially involved in the biological process of epithelial to mesenchymal transition (EMT). A number of miRNAs and mRNAs are known to be involved in this process and several miRNA-mRNA interactions have been experimentally verified [28, 29]. Compared to the results from a normal BN structure learning, SA-BNs uncover more known miRNA targets as well as promising miRNA-mRNA interactions.
Methods
For each sample category, Bayesian network structure learning is used to learn the dependency structures of miRNAs and mRNAs on the discretized profiles. The individual structures learned from data of each category are then integrated into an overall miRNA-mRNA interaction network by the designed BN averaging procedure. In order to control the false discovery, we make use of miRNA-targeting information in the learning process.
We note that the sample size of miRNA or mRNA is usually small in practice. Bootstrapping [30], that is, resampling with replacement, is applied to above procedures for robust inference. The belief confidences of inferred interactions are estimated by a statistic model. This model is to approximate frequency distributions of miRNA-mRNA interactions from bootstrapping. Significant miRNA-mRNA interactions and their confidence scores are thus achieved.
Annotation
Consider two expression data sets profiling N miRNA and M mRNA transcripts across S samples, respectively. Those samples belong to C different categories, either phenotypes, conditions, or treatment groups. Let i, j, where 1 ≤ i ≤ N and 1 ≤ j ≤ M, be the indices denoting the particular miRNA and mRNA. Let x = {x_{ i }} and y = {y_{ j }} be the vectors of miRNAs and mRNAs, and S_{ k }be the number of samples of category k, where 1 ≤ k ≤ C.
According to the sample categories, we reconstruct the two data sets of miRNA and mRNA to C data sets {D_{ k }}. Each reconstructed data set D_{ k }is composed by S_{ k }samples profiling miRNAs x and mRNAs y for category k. That is, D_{ k }has S_{ k }vectors, and each contains N + M variables, {x, y}, denoting miRNAs and mRNAs. We are interested in interactions between x and y supported by the experiment data. Assume miRNAs are independent to each other, and so as to mRNAs. The miRNA-mRNA interactions are represented as directed bipartite structures. Thus, we shall explore the relationships between x and y given data sets {D_{ k }} under the constraint of miRNA-targeting information.
Design of SA-BNs
The above question can be modeled as learning Bayesian network structures of miRNAs and mRNAs under topology constraints given the observed data sets. That is, to identify a graph G^{ h }depicting the miRNA-mRNA interactions which are best supported by the given data sets {D_{ k }}. We use h to denote a hypothesis. A graph G^{ h }= {x, y, E} encodes the dependencies between vertices x and y with directed edges E, whereas no edges mean independence between vertices. We denote the event of presence of an edge between variables x_{ i }and y_{ j }with F_{ ij }. Our objective is to find the probability p(F_{ ij }) from the inferred graph G^{ h }given data {D_{ k }}.
The prior probability p(D_{ k }) in Equation (3) is eliminated in Equation (5). It indicates that the presence of an edge is independent of the data set conditioned on the graph learned from the data set.
Thus, the stable inference of interactions between miRNAs and mRNAs given multiple data sets can be achieved. We summarize the procedure of computing p(F_{ ij }) in the following algorithm.
Algorithm 1: Calculating the interaction belief confidence p(F_{ ij }) of two sets of variables given data sets
Function: Cal_InteractionBelief()
Input:
C - number of data set
D_{ k }- data sets
l - number of candidate graphs from data set D_{ k }
I - index of parents (miRNAs)
J - index of descendants (mRNAs)
p - prior probability of a graph
Output:
p(F_{ ij }) - the interaction belief set of parent i to descendant j
Cal_InteractionBelief(C, D_{ k }, l, I, J, p)
{
for k in 1 to C
= graph_search(D_{ k }, I, J);/* Given D_{ k }, search for l graphs with the maximum likelihood p(D|G^{ h }) within the constrained graph space. The graph space is constrained by miRNA-targeting information coded by index I and J. Discussed in section Learning BN structures with constraints of domain knowledge.*/
end
for i in I
for j in J
p(F_{ ij }) = Σ_{ k }Σ_{ l }p(Fij| )p(D_{ k }| )p( )
end
end
}
In Algorithm 1, we constrain the structure learning with miRNA-targeting information. In the following two sections, we discuss the constraints, then present a statistical model to estimate the confidences of inferred interactions.
Learning BN structures with constraints of domain knowledge
The learning procedure of BNs is computationally consuming. The exhaustive search for the structure that best fits the observations is feasible only when there are a few genes. The space of possible structures grows hyper-exponentially with the number of genes. It has been shown that learning the global optimal BN is NP-complete [31]. Heuristic algorithms, such as hill climbing, can be used to search the state space efficiently. However, heuristic methods usually find a local optimal solution instead of the global one. This largely limits applications of BNs in real world.
An alternative solution to this problem is to constrain the searching space by integrating domain knowledge. It has been suggested that the utilization of domain knowledge can bias the searching space and lead to near optimal solutions [32]. Some methods have been proposed to explore gene regulatory networks by combining prior domain knowledge [33–36]. To a specific research question, the domain knowledge provides the problem-solving preferable constraints to the state space of the particular problem by knocking out obviously unreasonable states without losing the coverage. It may lead to improved network structures in short time [37].
We are interested in the regulatory relationship between miRNAs and mRNAs. The assumption of miRNAs regulating mRNAs constrains the topologies of miRNA-mRNA interactions to be directed bipartite graphs. This constraint reduces the searching space greatly. Furthermore, miRNA target information based on sequence complementary base-pairing provides another biological constraint to the topology. Many targeting databases can be used to construct the topology, for example, miRBase [38], PicTar [39], and TargetScan [40].
We use the miRNA target information from the target database to constrain the searching space of BNs. The putative target relation of miRNAs and mRNAs deduced from the target database is used as an initial structure of miRNA-mRNA interaction network. In Algorithm 1, this structure is given by variable I and J. I denotes the index of parents (miRNAs), and J denotes the index of descendants (mRNAs). Function graph_search(D_{ k }, I, J) searches bipartite graphs defined by I and J for the graphs that have maximum likelihood. Remove operation only is used in this function. It removes the edges one by one in the graph space constrained by I and J. By this way, we can constrain the searching space within the given putative targeting space. Generally, this space is relatively sparse, and hence the computational complexity is reduced. Therefore, we are able to use an exhaustive searching algorithm to discover the optimal solutions within the given space.
Generating highly confident interactions by integrating knowledge through bootstrapping
Unstable estimation caused by small number of samples is another challenge to BNs. A typical microarray experiment usually includes a large amount of genes and a small number of samples. The small number of samples rarely support statistically significant discoveries. BNs implement a model averaging procedure to average over several candidate solutions to obtain the optimal one. The confidence is estimated by bootstrapping. Averaging and bootstrapping provide BNs a reliable way to analyze data sets with the small size of samples. In our methods, we innovatively improve the methods for belief estimation. We use bootstrapping in the above procedures to estimate the confidence of discovered interactions. Let n be the number of bootstrapping, q_{ ijk }be the event of learning the interaction between miRNA i and mRNA j on the local data set D_{ k }. Assuming each learning process q_{ ijk }is a stochastic process, we approximate the whole learning process as a Bernoulli experiment where q_{ ijk }= 1 when miRNA i targets mRNA j learned from D_{ k }, otherwise q_{ ijk }= 0. Thus, q_{ ijk }follows a binomial distribution q_{ ijk }~B(n, p), where p is the probability of q_{ ijk }= 1. With a reasonable assumption, p(q_{ ijk }= 1) = p(q_{ ijk }= 0) = 0.5 is used in the design.
At the integration stage by averaging, the interactions from local data set D_{ k }are aggregated. The interaction of miRNA i and mRNA j learned through multiple data sets, denoted as Q_{ ij }= ∑_{ k }q_{ ijk }, also follows a binomial distribution Q_{ ij }~B(kn, p). Adopting this statistical model, we are able to extract the learned interactions at significant levels.
Results
In this section, we provide an analysis of miRNA-mRNA interactions for EMT data with the SA-BNs method.
EMT is part of processes of tissue remodeling during embryonic development, wound healing, and an essential early step in tumor metastasis [41]. Several molecular and cellular functions are involved in turning an epithelial cell into a mesenchymal cell. It requires alterations in morphology, cellular architecture, adhesion, and migration capacity [42]. In this work, we use the proposed computational method to discover miRNA-mRNA interactions for EMT.
Data sources
Our method integrates heterogeneous data to discover the interactions of miRNAs and mRNAs. These data include miRNA targeting information and expression profiles of miRNAs and mRNAs.
Several databases provide the putative targets of miRNAs [38–40]. We use miRBase [38] in this work because it gives more target predictions compared with experimentally supported databases. It allows our methods to produce relatively more hypotheses in a reasonable range. miRNA expression profiles for the NCI-60 panel of 60 cancer cell lines were from Gaur et al. [43]. They are available at the NCI/DTP database http://dtp.nci.nih.gov/mtweb/search.jsp. The mRNA expression profiles for NCI60 were downloaded from ArrayExpress http://www.ebi.ac.uk/arrayexpress, accession number E-GEOD-5720. Cell lines categorized as epithelial (11 samples) and mesenchymal (36 samples, one is not available) were used for this work.
Identifying differentially expressed miRNAs and mRNAs
Differentially expressed miRNAs for EMT
miRNA | Welch t-statistics | p-value | adjusted p-value |
---|---|---|---|
miR-200c | -14.0734 | 1.00 × 10^{-4} | 1.00 × 10^{-4} |
miR-141 | -11.3564 | 1.00 × 10^{-4} | 1.00 × 10^{-4} |
miR-200b | -9.3313 | 1.00 × 10^{-4} | 1.00 × 10^{-4} |
miR-200a | -7.4501 | 1.00 × 10^{-4} | 1.00 × 10^{-4} |
miR-155 | 6.7720 | 2.00 × 10^{-4} | 4.00 × 10^{-4} |
miR-140 | 6.6536 | 1.00 × 10^{-4} | 4.00 × 10^{-4} |
miR-203 | -5.7669 | 1.00 × 10^{-4} | 0.0031 |
miR-146 | 4.7355 | 7.00 × 10^{-4} | 0.0229 |
miRBase target V5.0 [38] is used to build the putative target pairs between the differentially expressed miRNAs and mRNAs. 1030 pairs of miRNA-mRNA are linked, comprising 6 miRNAs (miR-200c, miR-141, miR-200b, miR-200a, miR-155, and miR-203) and 610 probes for 460 unique mRNAs.
Discovering and validating miRNA-mRNA interactions with SA-BNs
To integrate miRNA and mRNA data profiled by different platforms, we discretized the data sets to binary values standing for up-regulation and down-regulation. We use the median of each array as the cut-off. The two discretized data sets were merged together sample wise, and then split to two data sets by sample categories, such as epithelia and mesenchymal. It is corresponding to the constant C in Algorithm 1. SA-BNs are then used to investigate the miRNA-mRNA interactions on the discretized EMT data sets with 1000 times bootstrapping. Confidences of interactions are estimated accordingly. As a result, we identified 231 statistically significant interactions which comprise 127 unique mRNAs and 6 miRNAs for EMT (Additional file 2).
Correlation test suggests both direct and indirect regulations discovered
Validating targets with TarBase and miRecords
Validating targets against TarBase and miRecords
miRNA | Target gene | Predicated by SA-BNs for EMT | Validated Interaction for EMT | Support Database | Pubmed ID |
---|---|---|---|---|---|
miR-200a | ZEB2/SIP1 | * | * | TarBase, miRecords | 18376396 |
miR-200a | ZEB1/TCF8 | * | TarBase, miRecords | 18376396 | |
miR-200b | RERE | miRecords | 17923093 | ||
miR-200b | ZEB1/TCF8 | * | * | TarBase, miRecords | 18376396 |
miR-200b | ZEB2/SIP1 | * | * | miRecords | 18376396 |
miR-200c | ZEB1/TCF8 | * | * | TarBase, miRecords | 18483486 |
miR-200c | ZEB2/SIP1 | * | * | TarBase | 18381893 |
miR-141 | CLOCK | TarBase, miRecords | 15131085 | ||
miR-141 | TGF-β | * | miRecords | 18483486 | |
miR-155 | AGTR1/AT1R | TarBase, miRecords | 16675453, 17668390, 7588946 | ||
miR-155 | BACH-1 | TarBase, miRecords | 17881434 | ||
miR-155 | LDOC1 | TarBase, miRecords | 17881434 | ||
miR-155 | MATR3 | TarBase, miRecords | 17881434 | ||
miR-155 | TM6SF1 | TarBase, miRecords | 17881434 | ||
miR-203 | SOCS-3 | miRecords | 17622355 | ||
miR-203 | P63 | miRecords | 18483491 |
It is worth noting that SA-BNs is mainly designed to indentify the miRNA-mRNA interactions for specific conditions. In the analysis, it has been used to discover the miRNA-mRNA interactions for EMT. Table 2 shows that 5 out of 7 identified miRNA-mRNA interactions by SA-BNs have been confirmed experimentally for EMT. It suggests that SA-BNs are promising to discover the miRNA-mRNA interactions for specific conditions. In the following, we will discuss the interactions for EMT in detail.
SA-BNs discover the miR-200 family target ZEB1 and ZEB2 for EMT which have been experimentally validated
The miR-200 family has been identified to play a central role in the regulation of the epithelial to mesenchymal transition [28, 29, 46]. In the interaction network, SA-BNs identified experimentally validated targets of miR-200 family. The results of SA-BNs show that ZEB1 is co-targeted by miR-200b and miR-200c, and ZEB2 is co-targeted by miR-200a and miR-200b in EMT module at statistically significant level. Correlation tests show that miR-200 negatively correlates with ZEB1 and ZEB2 at significant level (p-value < 0.005, adjusted by BH method). The discovery indicates that the miR-200 family negatively regulates ZEB1 and ZEB2, in agreement with previous experimental work showing that the miR-200 family regulate EMT by directly targeting ZEB1 and ZEB2[28, 29, 46]. This discovery of SA-BNs is consistent with the validated results.
SA-BNs discover LOX has wide interactions with miR-200 family for EMT which is also supported by literature
SA-BNs show that LOX is negatively co-regulated by all miR-200 family members inducing EMT. Higgins et al. have suggested that LOX regulates EMT [47]. This is consistent with our results and suggests that LOX has wide interactions with the miR-200 family members for EMT.
A significant number of mRNAs identified by SA-BNs participate in the biological processes of EMT
Identified mRNAs are significantly involved in the functional markers of EMT
Functions | Molecules | Number | p-value |
---|---|---|---|
migration | ADAM12, ADRB2, BMX, CSF3R, | 17 | 1.56 × 10^{-4} - 1.65 × 10^{-2} |
CTBP2, EFNA1, FAP, FN1, | |||
HAS2, IL6, KDR, LOX, MYH10, | |||
PTPRU, TIMP1, VCAM1, ZEB2 | |||
invasion | DKK3, FN1, HAS2, JUN, LOX, | 9 | 3.74 × 10^{-3} - 1.15 × 10^{-2} |
TIMP1, YY1, ZEB2, MYH10 | |||
scattering | EFNA1, FN1 | 2 | 4.98 × 10^{-3} |
Molecular networks participated in by identified mRNAs are highly relevant to EMT, suggesting that the pathways of identified mRNAs may also be regulated by the miR-200 family
Comparing Networks Identified by SA-BNs and Normal BNs
We compared the miRNA-mRNA interactions discovered by SA-BNs to those identified by normal Bayesian networks under the same settings. With normal BNs, 98 miRNA-mRNA interactions were identified at statistically significant level. They comprise 6 miRNAs and 84 mRNAs (Additional file 4). The significant interaction network with only negatively correlated modules is given in Figure 7-(b). In this network, normal BNs identified only one validated miR-200 target, ZEB1.
The topology of interaction network identified by SA-BNs is more biologically appropriate than that of normal BNs
In comparison with the network identified by SA-BNs (Figure 7-(a)), the network identified by traditional BNs is more sparse. SA-BNs capture more mRNAs that are potentially co-targeted by multiple miRNAs, which is a biological expectation when the miRNAs are known to contribute to the same biological process, as is the case for the multiple members of the miR-200 family [29]. Furthermore, based on their sequence similarity in the "seed region", miR-200a and miR-141 are predicted to interact with the same target sites. miR-200b and miR-200c, which share identical 5' ends, are predicted to recognize another set of targets in common [29]. However, in the network discovered by normal BNs, only one mRNA is co-targeted by miR-200a and miR-141, and only 2 by miR-200b and miR-200c. In contrast, 16 mRNAs are co-regulated by miR-200a and miR-141, and 19 mRNAs are co-regulated by miR-200b and miR-200c in the network discovered by SA-BNs. Thus the network from SA-BNs gives a more expected result than the one from normal BNs.
SA-BNs discover more relevant miRNA-mRNA interactions for EMT
To determine whether the unique set of interactions discovered by SA-BNs has different patterns which are specific to SA-BNs, we reviewed the correlations of miRNA-mRNA samples for each category, that is, epithelial and mesenchymal. It shows that a large number of miRNA-mRNA pairs show inconsistent correlation patterns across sample categories. For example, SA-BNs captured that miR-200c interacts with FN1 while the normal BNs did not. At the data level, miR-200c and FN1 show positive correlation in epithelial samples, but negative correlation in mesenchymal samples. The inconsistent patterns of local correlations prevent the normal BNs from discovering subtle interactions between miRNAs and mRNAs. SA-BNs are able to discover both strong and subtle interactions while the data show inconsistent patterns through available samples.
Comparison of results between SA-BNs and normal BNs
EMT relevant cellular functions | SA-BNs | Normal BNs | ||
---|---|---|---|---|
#Molecules | p -value | #Molecules | p -value | |
Cellular Movement | 14 | 4.62 × 10^{-4} - 2.86 × 10^{-2} | 7 | 9.83 × 10^{-4} - 3.92 × 10^{-2} |
Cell Morphology | 17 | 2.49 × 10^{-4} - 2.86 × 10^{-2} | 10 | 1.74 × 10^{-4} - 4.47 × 10^{-2} |
migration* | 6 | 4.62 × 10^{-4} - 2.86 × 10^{-2} | 6 | 6.93 × 10^{-3} - 3.59 × 10^{-2} |
invasion* | 6 | 1.53 × 10^{-3} - 2.46 × 10^{-2} | 1 | 3.76 × 10^{-2} |
scattering* | 2 | 1.27 × 10^{-3} | 1 | 1.74 × 10^{-3} |
Discussion
In the past few years, the identification of miRNAs and their targets has made significant progress. Current focus is shifting to the elucidation of miRNA functions. However, some specific features of miRNAs, for example their small size, abundance of repetitive copies and mode of action, pose several challenges in studying of miRNA functions [48].
miRNAs show diverse regulatory mechanisms with mRNAs. They have been known to down-regulate target mRNAs in the majority of cases. The up-regulation of miRNA also has been reported recently [17, 18], and even down- and up-regulations depending on physiological conditions [17]. The various observations of miRNA regulation make it difficult to generalize simple rules for miRNA-mRNA interactions, especially under different physiological conditions. Most previous work has studied the discovery of down-regulatory modules of miRNAs and mRNAs by computational methods [22, 25]. The up-regulatory and mix-regulatory mechanisms of miRNAs have not been identified from existing data. However, the discovery of up- and mix-regulatory mechanisms reveal the complex interactions of miRNAs and mRNAs, such as indirect regulations. Considering that most biological experiments have been designed for a comparative study, such as normal versus malignant, down- and up-regulatory mechanisms, especially featuring in the different phenotypes, conditions, or treatment groups, are of great interest to medical researchers.
In this work, we propose a new Bayesian network structure learning method to explore all types of miRNA-mRNA interactions by using heterogeneous information. Much research has been done to discover the gene regulatory networks with BNs on homogeneous data, for instance, microarray data or protein data, but not much work has been done to discover the interactions between miRNAs and mRNAs. Apart from making use of heterogeneous information such as miRNA-target binding, expression profiles of miRNAs and mRNAs, and sample categories, an innovation of the proposed method is to design a splitting and averaging scheme for Bayesian structure learning to discover up- and down-regulatory mechanisms of miRNAs. In addition, small sample size is a problem for reliable discoveries. We use bootstrapping and a statistical model to obtain reliable probability estimation of interactions discovered by SA-BNs.
Bootstrapping alleviates the overfitting problem which is common for machine learning on small size of data sets. The false discovery is well controlled by bootstrapping and the constraint of miRNA-target prediction.
The proposed method finds many regulatory mechanisms that have been supported by previous research. For example, the discovery of the miR-200 family targeting ZEB1 and ZEB2 for EMT has experimentally validated in previous research [28, 29, 46]. Other discoveries are also very promising. For instance, the results of SA-BNs show LOX widely interacts with the miR-200 family for EMT. It is consistent with previous research which suggests LOX regulates EMT [47]. In addition, the significant number of identified mRNAs have biological functions in EMT, especially the marker functions of EMT like migration, invasion, and scattering. It suggests that SA-BNs have captured many mRNAs and their interactive miRNAs participating in EMT. Furthermore, many molecular networks participated in by identified mRNAs are highly relevant to EMT, suggesting that the pathways of identified mRNAs may also be regulated by the miR-200 family.
The regulatory networks from our method reveal more mRNAs co-regulated by multiple miRNAs than a normal Bayesian network does. Multiple interactions are consistent with the current view of complex regulatory mechanism of miRNAs. Though there is no direct evidence to support the discovered up-regulatory and mix- regulatory mechanisms for EMT from previous research, this work indicates that there are many of such interactions supported by data at statistically significant levels. One reason is that little research has been conducted on this new area yet. These differentially regulatory mechanisms among different conditions are of great interest. We expect they can be validated by biological experiments in the near future.
Conclusions
In this study, we have proposed a method to explore the complex miRNA-mRNA interactions with Bayesian networks by a splitting-averaging strategy. It is designed to discover both strong and subtle interactions from expression profiles of miRNAs and mRNAs under the constraints of a putative targeting database. Several issues of BNs have been addressed, including integration of heterogeneous data, constraints of the BNs structures with prior knowledge, overfitting, and model integration with splitting and averaging. The analysis of EMT data sets shows that SA-BNs discover more biologically relevant miRNA-mRNA interactions compared to normal BNs. Some discoveries have been validated by previous research. Some are consistent with the literature. Some are statistically significant interactions that are novel and worthy of validation by biological experiments in the near future.
Declarations
Acknowledgements
This research has been supported by ARC DP0559090.
Authors’ Affiliations
References
- Filipowicz W, Bhattacharyya SN, Sonenberg N: Mechanisms of post-transcriptional regulation by microRNAs: are the answers in sight? Nature Reviews Genetics 2008, 9(2):102–114. 10.1038/nrg2290View ArticlePubMedGoogle Scholar
- Bartel DP: MicroRNAs: genomics, biogenesis, mechanism, and function. Cell 2004, 116(2):281–197. 10.1016/S0092-8674(04)00045-5View ArticlePubMedGoogle Scholar
- He L, Hannon GJ: MicroRNAs: small RNAs with a big role in gene regulation. Nature Reviews Genetics 2004, 5: 522–531. 10.1038/nrg1379View ArticlePubMedGoogle Scholar
- Lee RC, Feinbaum RL, Ambros V: The C. elegans heterochronic gene lin-4 encodes small RNAs with antisense complementarity to lin-14. Cell 1993, 75(5):843–854. 10.1016/0092-8674(93)90529-YView ArticlePubMedGoogle Scholar
- Lewis BP, Burge CB, Bartel DP: Conserved seed pairing, often flanked by adenosines, indicates that thousands of human genes are microRNA targets. Cell 2005, 120: 15–20. 10.1016/j.cell.2004.12.035View ArticlePubMedGoogle Scholar
- Ambros V: The functions of animal microRNAs. Nature 2004, 431: 350–355. 10.1038/nature02871View ArticlePubMedGoogle Scholar
- Du T, Zamore PD: Beginning to understand microRNA function. Cell Research 2007, 17: 661–663. 10.1038/cr.2007.67View ArticlePubMedGoogle Scholar
- Bushati N, Cohen SM: microRNA Functions. The Annual Review of Cell and Developmental Biology 2007, 23: 175–205. 10.1146/annurev.cellbio.23.090506.123406View ArticlePubMedGoogle Scholar
- Lim LP, Lau NC, Garrett-Engele P, Grimson A, Schelter JM, Castle J, Bartel DP, Linsley PS, Johnson JM: Microarray analysis shows that some microRNAs downregulate large numbers of target mRNAs. Nature 2005, 433: 769–773. 10.1038/nature03315View ArticlePubMedGoogle Scholar
- Baek D, Villen J, Shin C, Camargo FD, Gygi SP, Bartel DP: The impact of microRNAs on protein output. Nature 2008, 445: 64–71. 10.1038/nature07242View ArticleGoogle Scholar
- Zhang C: MicroRNomics: a newly emerging approach for disease biology. Physiol Genomics 2008, 33(2):139–147. 10.1152/physiolgenomics.00034.2008View ArticlePubMedGoogle Scholar
- Place RF, Li LC, Pookot D, Noonan EJ, Dahiya R: MicroRNA-373 induces expression of genes with complementary promoter sequences. Proceedings of the National Academy of Sciences 2008, 105(5):1608–1613. 10.1073/pnas.0707594105View ArticleGoogle Scholar
- Tay Y, Zhang J, Thomson AM, Lim B, Rigoutsos I: MicroRNAs to Nanog, Oct4 and Sox2 coding regions modulate embryonic stem cell differentiation. Nature 2008, 455(7216):1124–1128. 10.1038/nature07299View ArticlePubMedGoogle Scholar
- Grimson A, Farh KKHK, Johnston WKK, Garrett-Engele P, Lim LPP, Bartel DPP: MicroRNA Targeting Specificity in Mammals: Determinants beyond Seed Pairing. Mol Cell 2007, 27: 91–105. 10.1016/j.molcel.2007.06.017PubMed CentralView ArticlePubMedGoogle Scholar
- Bagga S, Bracht J, Hunter S, Massirer K, Holtz J, Eachus R, Pasquinelli AE: Regulation by let-7 and lin-4 miRNAs Results in Target mRNA Degradation. Cell 2005, 122(4):553–563. 10.1016/j.cell.2005.07.031View ArticlePubMedGoogle Scholar
- Wu L, Fan J, Belasco JG: MicroRNAs direct rapid deadenylation of mRNA. Proceedings of the National Academy of Sciences of the United States of America 2006, 103(11):4034–4039. 10.1073/pnas.0510928103PubMed CentralView ArticlePubMedGoogle Scholar
- Vasudevan S, Tong Y, Steitz JA: Switching from Repression to Activation: MicroRNAs Can Up-Regulate Translation. Science 2007, 318(5858):1931–1934. 10.1126/science.1149460View ArticlePubMedGoogle Scholar
- Yu J, Ryan DG, Getsios S, Oliveira-Fernandes M, Fatima A, Lavker RM: MicroRNA-184 antagonizes microRNA-205 to maintain SHIP2 levels in epithelia. Proceedings of the National Academy of Sciences 2008, 105(49):19300–19305. 10.1073/pnas.0803992105View ArticleGoogle Scholar
- Liu X, Nelson A, Wang X, Kanaji N, Kim M, Sato T, Nakanishi M, Li Y, Sun J, Michalski J, Patil A, Basma H, Rennard SI: MicroRNA-146a modulates human bronchial epithelial cell survival in response to the cytokine-induced apoptosis. Biochemical and Biophysical Research Communications 2009, 380: 177–182. 10.1016/j.bbrc.2009.01.066View ArticlePubMedGoogle Scholar
- Gebeshuber CA, Zatloukal K, Martinez J: miR-29a suppresses tristetraprolin, which is a regulator of epithelial polarity and metastasis. EMBO reports 2009, 10(4):400–405. 10.1038/embor.2009.9PubMed CentralView ArticlePubMedGoogle Scholar
- Yoon S, De Micheli G: Prediction of regulatory modules comprising microRNAs and target genes. Bioinformatics 2005, 21(suppl_2):ii93–100. 10.1093/bioinformatics/bti1116PubMedGoogle Scholar
- Huang JC, Morris QD, Frey BJ: Detecting MicroRNA Targets by Linking Sequence, MicroRNA and Gene Expression Data. Research in Computational Molecular Biology 2006, 3909/2006: 114–129. full_textView ArticleGoogle Scholar
- Joung JG, Hwang KB, Nam JW, Kim SJ, Zhang BT: Discovery of microRNA mRNA modules via population-based probabilistic learning. Bioinformatics 2007, 23(9):1141–1147. 10.1093/bioinformatics/btm045View ArticlePubMedGoogle Scholar
- Tran DH, Satou K, Ho TB: Finding microRNA regulatory modules in human genome using rule induction. BMC Bioinformatics 2008, 9(Suppl 12):S5. 10.1186/1471-2105-9-S12-S5PubMed CentralView ArticlePubMedGoogle Scholar
- Liu B, Li J, Tsykin A: Discovery of functional miRNA-mRNA regulatory modules with computational methods. Journal of Biomedical Informatics 2009, 42(4):685–691. 10.1016/j.jbi.2009.01.005View ArticlePubMedGoogle Scholar
- Friedman N, Linial M, Nachman I, Pe'er D: Using Bayesian Networks to Analyze Expression Data. Journal of Computational Biology 2000, 7(3–4):601–620. 10.1089/106652700750050961View ArticlePubMedGoogle Scholar
- Neapplitan RE: Learning Bayesian Networks. Upper Saddle River, NJ: Prentice Hall; 2003.Google Scholar
- Park SM, Gaur AB, Lengyel E, Peter ME: The miR-200 family determines the epithelial phenotype of cancer cells by targeting the E-cadherin repressors ZEB1 and ZEB2. Genes & Development 2008, 22(7):894–907. 10.1101/gad.1640608View ArticleGoogle Scholar
- Gregory PA, Bert AG, Paterson EL, Barry SC, Tsykin A, Farshid G, Vadas MA, Khew-Goodall Y, Goodall GJ: The miR-200 family and miR-205 regulate epithelial to mesenchymal transition by targeting ZEB1 and SIP1. Nat Cell Biol 2008, 10(5):593–6. 10.1038/ncb1722View ArticlePubMedGoogle Scholar
- Davison AC, Hinkley DV: Bootstrap Methods and their Application. Cambridge Series in Statistical and Probabilistic mathematics, Cambridge: Cambridge University Press; 1997.View ArticleGoogle Scholar
- Chickering DM: Learning Bayesian Networks is NP-Complete. In Learning from Data: Artificial Intelligence and Statistics V. Edited by: Fisher D, Lenz H. Springer-Verlag; 1996:121–130.View ArticleGoogle Scholar
- Wolpert D, Macready W: No free lunch theorems for optimization. Evolutionary Computation, IEEE Transactions on 1997, 1: 67–82. 10.1109/4235.585893View ArticleGoogle Scholar
- Geier F, Timmer J, Fleck C: Reconstructing gene-regulatory networks from time series, knock-out data, and prior knowledge. BMC Systems Biology 2007, 1: 11. 10.1186/1752-0509-1-11PubMed CentralView ArticlePubMedGoogle Scholar
- Husmeier D, Werhli AV: Bayesian Integration of Biological Prior Knowledge into the Reconstruction of Gene Regulatory Networks with Bayesian Networks. In Proceedings of the International Conference on Computational Systems Bioinformatics (CSB 2007) Edited by: Xu Y, Markstein P. 2007, 6: 85–95. full_textGoogle Scholar
- Djebbari A, Quackenbush J: Seeded Bayesian Networks: Constructing genetic networks from microarray data. BMC Systems Biology 2008, 2: 57. 10.1186/1752-0509-2-57PubMed CentralView ArticlePubMedGoogle Scholar
- Pei B, Rowe DW, Shin DG: Reverse Engineering of Gene Regulatory Network by Integration of Prior Global Gene Regulatory Information. In BIBM '08: Proceedings of the 2008 IEEE International Conference on Bioinformatics and Biomedicine. Washington, DC, USA: IEEE Computer Society; 2008:129–134. full_textView ArticleGoogle Scholar
- de Campos LM, Castellano JG: Bayesian network learning algorithms using structural restrictions. Int J Approx Reasoning 2007, 45(2):233–254. 10.1016/j.ijar.2006.06.009View ArticleGoogle Scholar
- Griffths-Jones S, Saini HK, van Dongen S, Enright AJ: miRBase: tools for microRNA genomics. Nucl Acids Res 2008, 36(suppl_1):D154–158.Google Scholar
- Krek A, Grun D, Poy MN, Wolf R, Rosenberg L, Epstein EJ, MacMenamin P, da Piedade I, Gunsalus KC, Stoffel M, Rajewsky N: Combinatorial microRNA target predictions. Nature Genetics 2005, 37(5):495–500. 10.1038/ng1536View ArticlePubMedGoogle Scholar
- Lewis BP, Shih I, Jones-Rhoades MW, Bartel DP, Burge CB: Prediction of Mammalian MicroRNA Targets. Cell 2003, 115(7):787–798. 10.1016/S0092-8674(03)01018-3View ArticlePubMedGoogle Scholar
- Savagner P: Leaving the neighborhood: molecular mechanisms involved during epithelial-mesenchymal transition. Bio Essays 2001, 23(10):912–923.Google Scholar
- Lee JM, Dedhar S, Kalluri R, Thompson EW: The epithelial-mesenchymal transition: new insights in signaling, development, and disease. J Cell Biol 2006, 172(7):973–981. 10.1083/jcb.200601018PubMed CentralView ArticlePubMedGoogle Scholar
- Gaur A, Jewell DA, Liang Y, Ridzon D, Moore JH, Chen C, Ambros VR, Israel MA: Characterization of MicroRNA Expression Levels and Their Biological Correlates in Human Cancer Cell Lines. Cancer Res 2007, 67(6):2456–2468. 10.1158/0008-5472.CAN-06-2698View ArticlePubMedGoogle Scholar
- Papadopoulos GL, Reczko M, Simossis VA, Sethupathy P, Hatzigeorgiou AG: The database of experimentally supported targets: a functional update of TarBase. Nucl Acids Res 2009, 37(suppl_1):D155–158. 10.1093/nar/gkn809PubMed CentralView ArticlePubMedGoogle Scholar
- Xiao F, Zuo Z, Cai G, Kang S, Gao X, Li T: miRecords: an integrated resource for microRNA-target interactions. Nucl Acids Res 2009, 37(suppl_1):D105–110. 10.1093/nar/gkn851PubMed CentralView ArticlePubMedGoogle Scholar
- Korpal M, Lee ES, Hu G, Kang Y: The miR-200 family inhibits epithelial-mesenchymal transition and cancer cell migration by direct targeting of E-cadherin transcriptional repressors ZEB1 and ZEB2. J Biol Chem 2008, C800074200.Google Scholar
- Higgins DF, Kimura K, Bernhardt WM, Shrimanker N, Akai Y, Hohenstein B, Saito Y, Johnson RS, Kretzler M, Cohen CD, Eckardt KU, Iwano M, Haase VH: Hypoxia promotes fibrogenesis in vivo via HIF-1 stimulation of epithelial-to-mesenchymal transition. J Clin Invest 2007, 117(12):3810–3820.PubMed CentralPubMedGoogle Scholar
- Krutzfeldt J, Poy MN, Stoffel M: Strategies to determine the biological function of microRNAs. Nature Genetics 2006, 38: S14-S19. 10.1038/ng1799View ArticlePubMedGoogle Scholar
- Shannon P, Markiel A, Ozier O, Baliga NS, Wang JT, Ramage D, Amin N, Schwikowski B, Ideker T: Cytoscape: A Software Environment for Integrated Models of Biomolecular Interaction Networks. Genome Research 2003, 13(11):2498–2504. 10.1101/gr.1239303PubMed CentralView ArticlePubMedGoogle Scholar
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.