 Research
 Open Access
 Published:
Simultaneous learning of individual microRNAgene interactions and regulatory comodules
BMC Bioinformatics volume 22, Article number: 237 (2021)
Abstract
Background
MicroRNAs (miRNAs) function in posttranscriptional regulation of gene expression by binding to target messenger RNAs (mRNAs). Because of the key part that miRNAs play, understanding the correct regulatory role of miRNAs in diverse pathophysiological conditions is of great interest. Although it is known that miRNAs act combinatorially to regulate genes, precise identification of miRNAgene interactions and their specific functional roles in regulatory comodules remains a challenge. We developed Theia, an effective method for simultaneously predicting miRNAgene interactions and regulatory comodules, which group functionally related miRNAs and genes via nonnegative matrix factorization (NMF).
Results
We apply Theia to RNA sequencing data from breast invasive carcinoma samples and demonstrate its effectiveness in discovering biologically significant regulatory comodules that are significantly enriched in spatial miRNA clusters, biological pathways, and various cancers.
Conclusions
Theia is a theoretically rigorous optimization algorithm that simultaneously predicts the strength and direction (i.e., upregulation or downregulation) of the effect of modules of miRNAs on a gene. We posit that if Theia is capable of recovering known clusters of genes and miRNA, then the clusters found by our method not previously identified by literature are also likely to have biological significance. We believe that these novel regulatory comodules found by our method will be a springboard for further research into the specific functional roles of these new functional ensembles of miRNAs and genes,especially those related to diseases like breast cancer.
Introduction
Genes are distinct nucleotide sequences that contain the instructions for synthesizing proteins within cells. These instructions are turned into the actual protein that the gene codes for via RNA transcripts, and further translation into proteins, the latter in the case of proteincoding genes. One of the ways in which this activity is moderated is by interference from small noncoding RNA molecules called microRNA (miRNA). MiRNAs, genes, and their products all interact, forming complex regulatory modules. MiRNAs are short noncoding RNAs (of about 22 nucleotides) that regulate gene expression by both transcriptional and posttranscriptional mechanisms via binding to cognate messenger RNAs (mRNAs). Since the first miRNA lin4 was discovered in 1993 [1], an increasing number of miRNAs have been found to affect a wide range of cellular and developmental processes through gene regulation [2]. Thus, accurately determining the miRNA targetome is crucial for understanding the role of miRNAs in various biological processes. However, most miRNAs’ specific functional roles and their combinatorial effects are still unclear.
The miRNA interactome: In order to identify potential miRNAgene interactions, the first generation of computational methods relied mainly on complementarity between the miRNA seed region and the 3’UTR section of mRNA, evolutionary conservation, and thermodynamic factors [3,4,5,6]. Sequencebased methods led to many false positives and some false negatives, and they are now primarily used as a tool to build putative interaction databases [7], such as in our own work [8,9,10,11].
Mapping a dynamic interactome using contextspecific interaction data: While sequence information is static, expression profiles of miRNAs and genes are contextspecific, providing useful clues on regulatory effects that may vary depending on conditions such as development or disease progression (temporal), and celltype (spatial) context. Thus, contextdependent regulation can be studied by analyzing conditionspecific or timeseries expression data. Initial attempts to make use of expression data involved correlation analyses that measured the Pearson Correlation Coefficient (PCC) between miRNA and gene expression levels [12]. Although PCC can decide regulation strength and direction for the validated interacting pairs, the PCC value on its own can’t tell which pairs are interacting, since noninteracting pairs may show significant PCC values. In addition, the correlation coefficients for interacting pairs can be small, giving rise to high error rates [11]. These methods cannot adequately model the joint relationships between miRNAs and genes [13]. To model the combinatorial effects of multiple miRNAs on genes, multidimensional linear regression with regularizations (e.g., Lasso regression [14] and Elastic Net regression [15]) have been proposed. Unfortunately, they can only provide a sparse solution, i.e., a relatively small set of strong miRNAgene interactions while disregarding the much more common subtle interactions [16], or they may have inaccurate estimates for weak interactions, further stymied by noisy or false interactions that can have a relatively high PCC, as seen in our recent work [11].
Need for a modular and biologically interpretable framework: Intuitively, miRNAgene interactions can be better understood by considering regulatory comodules that group miRNAs and genes that collectively interact in the regulation process, as evidenced in emerging studies [17, 18]. This line of work typically integrates multiple genomic data sources, including sequencebased putative miRNAgene interactions (putative interactions for short), proteinprotein interactions (PPI), and miRNA and gene expression data. For example, SNMNMF [19] jointly analyzed miRNA and gene expression profiles in a nonnegative matrix factorization (NMF) framework, in which matrix components were decomposed to provide information about regulatory comodules. To enhance the results, it integrated putative interactions and PPI simultaneously as regularization terms of the NMF problem. However, SNMNMF was designed to find the regulatory comodules only (i.e., grouping miRNAs and genes) and required additional steps to figure out the regulation strength of a particular miRNAgene interaction. A regressionbased model called PIMiM [20] handled this shortcoming by estimating the interaction strength by multiplying with module membership matrices. PIMiM reported better results than SNMNMF in discovering regulatory comodules [20], but its accuracy for estimating interaction strength is still lower than the stateoftheart [11]. Meanwhile, both SNMNMF and PIMiM restrict their models to downregulation only (anticorrelation between miRNA and gene expression), which is inconsistent with recent research results reporting that upregulations also exist [21]. In fact, gene upregulations are rampant in different cell phenotypes such as in cancer pathologies, an example being the upregulation of flap endonuclease 1 (FEN1) in cancer progression [22] and upregulation of the small GTPbinding protein, RhoA, in vascular hypertension [23]. The learned module membership matrices in our work are used to estimate individual miRNAgene interactions. Similar to Tiresias [11], these interaction estimates are in turn used by a regression network along with expression data to find contextspecific regulation strength and direction. Using the module membership matrices, which Tiresias does not deploy, Theia suppresses noise in the interaction edges better by disconnecting the miRNAs and genes that do not belong to at least one common regulatory comodule.
To summarize, our main contributions in this paper are as follows:

1
We develop a framework for simultaneous learning of regulatory comodules and miRNAgene interactions, leveraging interdependency between diverse data sources. We synergistically associate the miRNAgene ensembles with the individual interactions in a single framework such that optimizing one drives the other also to improve. Thus, we find that the accuracy in predicting the interaction profile of these miRNA is implicitly tied to the ability to model the miRNA and genes in these functionally meaningful mixedmembership modules.

2
Our method is able to accurately discover the regulatory comodules, achieving the ARI of up to 0.8 even at a biologicallyplausible low regulation strength and outperforming SNMNMF and PIMiM significantly. With TCGABRCA data set, we show the comodules we found are significantly enriched in miRNA spatial clusters and gene ontology BP terms. From miRCancer, we also show that most of miRNAs (219 out of 319) and genes (88 out of 112) we found are cancerrelated.

3
We assess the biological significance of miRNA modules through comparison with spatial miRNA clusters, cancerimplicated miRNA clusters, and miRNA modules with functional roles previously identified in literature. We assess the gene modules through Gene Ontology enrichment analysis, through the use of the Ingenuity Pathway Analysis software, and through a literature survey of the functional roles of gene modules.
But since the ground truth does not exist for natural data, we further validate these systems through the use of synthetic data.

4
We consider both upregulations and downregulations in the miRNAgene interactions within one unified framework. In doing so, we capture the more recent set of upregulated interactions that have been biologically validated.
Background
Nonnegative matrix factorization (NMF): The nonnegative matrix factorization (NMF) technique [24] was devised to factorize a nonnegative matrix \({{\varvec{X}}}\) into two lower ranking matrices, a basis matrix \({{\varvec{W}}}\), and a coefficient matrix \({{\varvec{H}}}\), such that neither of these matrices contain negative elements. Such factorization can be achieved by minimizing the cost function as follows:
The nonnegativity of \({{\varvec{W}}}\) and \({{\varvec{H}}}\) guarantees that parts of the matrix can be combined additively to form a whole. Thus, NMF is a useful technique for obtaining a partbased representation of the data. NMF is inherently useful for the purpose of clustering because of the property that the the jth column of \({{\varvec{X}}}\) belongs to the kth cluster when \({\varvec{H}}_{kj}>0\).
The NMF mechanics underlying Theia: While the original usecase for NMF was dimensionality reduction, i.e., producing a lowdimensional feature representation of highdimensional input data [24], recently, NMF has been found to be applicable to clustering by grouping elements that result in the same feature element [19, 25]. Inspired by this, we designed an NMFbased algorithm to produce a particular kind of grouping informationthe comodule membership. Unlike recent manifestations of NMFbased clustering that factorize expression matrices, we apply this technique to putative miRNAgene interactions and proteinprotein interactions to assemble interacting miRNAs and genes into modules. Thus, the lowdimensional representation of the molecule interactions obtained via factorization becomes the comodule membership. NMF provides us with the ability to handle partially incorrect data. Furthermore, sparse representations and easily interpretable factors can be extracted using NMF. We leverage both these properties in our pipeline.
Related work
Comparison with SNMNMF: Recognizing the regulatory comodules that model the groups of miRNAs and genes interacting collectively has greatly advanced our understanding of complex cellular systems. Representative work, SNMNMF [19] attempted to reconstruct the regulatory comodules based on the integration of multiple genomic data sources. However, fundamentally, it cannot provide the strength and the direction of the miRNAgene interactions. We give the mathematical basis for this below.
Given expression profiles of miRNAs and genes, \({{\varvec{X}} \in {\mathbb {R}}^{N \times I}}\) and \({{\varvec{Y}} \in {\mathbb {R}}^{N \times J}}\), DNAsequencebased putative interactions \({{\varvec{P}} \in \{0,1\}^{I \times J}}\), and proteinprotein interactions \({{\varvec{Q}} \in \{0,1\}^{J \times J}}\), where N is the number of expression samples, I is the number of miRNAs and J is the number of genes, the core of SNMNMF is minimizing the following cost function:
where \({\varvec{A}} \in {\mathbb {R}}^{N \times M}\) is a new vector space with M denoting the number of modules, \({\varvec{B}} \in {\mathbb {R}}^{M \times I}\) and \({\varvec{C}} \in {\mathbb {R}}^{M \times J}\) are, respectively, new representations of \({\varvec{X}}\) and \({\varvec{Y}}\) on \({\varvec{A}}\), and \(\text {Tr}(\cdot )\) denotes the trace of a matrix, the sum of the elements on the main diagonal. That is, SNMNMF integrates dynamic expression profiles of miRNAs and genes in a framework of multiple nonnegative matrix factorization, and simultaneously integrates static supersets in a regularized manner. When trained, \({\varvec{B}}\) and \({\varvec{C}}\) matrices determine the comodule in such a way that miRNA and genes whose magnitudes on \({\varvec{B}}\) and \({\varvec{C}}\) are higher than thresholds in the same row belong to a common module.
However, by modeling the membership to the comodule only by a threshold testing on the nonnegative elements of \({\varvec{B}}\) and \({\varvec{C}}\), i.e., grouping miRNAs and genes, this method does not provide the direction and strength of individual miRNAgene interactions. Instead of factorizing \({\varvec{X}}\) and \({\varvec{Y}}\), Theia groups interacting miRNAs and genes by directly factorizing putative interaction data \({\varvec{P}}\) and \({\varvec{Q}}\), and refines the comodule memberships with additional modeling for the direction and strength of individual miRNAgene interactions.
Comparison with PIMiM: PIMiM [20] alleviates the limitation of SNMNMF by estimating the interaction strength by multiplying the module membership matrices as follows:
where \(\hat{{\varvec{y}}}_n\in {\mathbb {R}}^{1 \times J}\) is an estimate of \({\varvec{y}}_n\), the nth row of \({\varvec{Y}}\), \({\varvec{x}}\in {\mathbb {R}}^{1 \times I}\) is the nth row of \({\varvec{X}}\), and \(\varvec{\mu }\in {\mathbb {R}}^{1 \times J}\) denotes the background mean of \({\varvec{y}}_n\) without regulation. The \({\varvec{U}} \in [0,\infty )^{I \times M}\) and \({\varvec{V}} \in [0,\infty )^{J \times M}\) are the module membership matrices whose elements larger than a threshold indicate the corresponding miRNA or gene (row indices) belong to a certain comodule (column indices). In PIMiM, the magnitude of an element in \({\varvec{U}}{\varvec{V}}^T\) is supposed to be proportional to the strength of a regulation relationship, if any. However, it still assumes the downregulations only (i.e., an element in \({\varvec{U}}{\varvec{V}}^T\) is always nonnegative), disregarding miRNAmodulated upregulations. In addition, the magnitudes of elements in \({\varvec{U}}{\varvec{V}}^T\) are often nonzero even if they are smaller than a threshold and thus assumed to be noninteracting. These nonzero values act a noise when learning (3) by regression and thus reduce the accuracy of estimates for true interacting pairs of miRNAs and genes.
In contrast to PIMiM, Theia disconnects the noninteracting pairs from a regression relationship and thus suppresses the noise.
Comparison with Tiresias: On the other hand, Tiresias [11] models both upregulations and downregulations adopting what is called the regulation weight matrix as follows:
where \({\varvec{W}}\in {\mathbb {R}}^{I \times J}\) denotes the regulation weight matrix whose elements model the regulation strength by their magnitude and regulation direction by their sign, \({\varvec{S}}\in [0,1]^{I \times J}\) is the true interaction indicator matrix whose element becomes 1 when an interaction is predicted and 0 otherwise, and the \(\bullet\) operator denotes elementwise product. Tiresias jointly decides the elements of \({\varvec{S}}\) and \({\varvec{W}}\) so that \(\hat{{\varvec{y}}}_n\) can be as close to \({\varvec{y}}_n\) as possible in a regression manner. This method was shown effective, achieving a higher F\(^{1}\) score than the previous methods. However, Tiresias does not model the regulation comodules, studying the individual miRNAgene interactions only.
Theia adopts the strategy that Tiresias used, i.e., Theia also models the interaction indicator matrix \({\varvec{S}}\) and the regulation weight matrix \({\varvec{W}}\), and by multiplying them together, Theia prevents pairs of miRNAs and genes that do not interact from affecting \(\hat{{\varvec{y}}}_n\). This helps suppress the unwanted noise when learning \(\hat{{\varvec{y}}}_n\) by a regression method. However, unlike Tiresias, Theia also models regulation comodules by additionally utilizing DNAsequencebased putative interactions \({{\varvec{P}}}\) and proteinprotein interactions \({{\varvec{Q}}}\), by which we subdivide miRNAs and genes into modules and allow them to interact only when they belong to at least one common module. By reducing this source of falsely predicted interactions, the accuracy of the interaction indicator matrix \({\varvec{S}}\) improves, and consequently, the accuracy of the regulation weight matrix \({\varvec{W}}\) as well.
Materials and methods
Data sources and preprocessing
We downloaded \(N = 1161\) breast invasive carcinoma samples from the TCGA data portal, and filtered out miRNAs and genes with small expression values (less than 0.1). The mature data was extracted using Bioconductor packages [26]. As a result, we obtained a data set containing the expression profiles of miRNAs \({{\varvec{X}} \in {\mathbb {R}}^{N \times I}}\) and genes \({{\varvec{Y}} \in {\mathbb {R}}^{N \times J}}\) where \(I = 979\) miRNAs and \(J = 19258\) genes. The nth sample of miRNA expressions and the corresponding gene expressions, i.e., the nth rows of \({\varvec{X}}\) and \({\varvec{Y}}\), will be denoted \({\varvec{x}}_n=(x_{ni}) \in {\mathbb {R}}^{1 \times I}\) and \({\varvec{y}}_n=(y_{nj})\in {\mathbb {R}}^{1 \times J}\), respectively, where \(x_{ni}\) is the expression of the ith miRNA and \(y_{nj}\) is the expression of the jth gene, in the nth sample.
We constructed a putative interaction matrix, \({{\varvec{P}}=(p_{ij}) \in \{0,1\}^{I \times J}}\), from TargetScan [4] (release 7.1). The interactions represented by this matrix are putative because TargetScan is based primarily on targetsite complementarity and suffers from a high false positive rate. Thus, \(p_{ij} = 1\) suggests without any guarantee, that an interaction between the ith miRNA and the jth gene exists. It is possible that \(p_{ij} = 0\) is a false negative; however, this is far less common [27, 28]. We constructed a matrix of proteinprotein interactions, \({{\varvec{Q}}=(q_{ij}) \in \{0,1\}^{J \times J}}\), from the Biological General Repository for Interaction Datasets (BioGRID) [29] (release 3.4.155). When the jth and \(j^{\prime}\)th genes interact, we set \(q_{jj^{\prime}}=1\); otherwise, \(q_{jj^{\prime}}=0\). Figure 1 shows a simple example to help understand our representation of data sources.
Module membership and regulation weight matrices
The miRNA membership matrix \({\varvec{U}}=(u_{ik}) \in [0,\infty )^{I \times K}\) and gene membership matrix \({\varvec{V}}=(v_{jk}) \in [0,\infty )^{J \times K}\) model the regulatory comodules, where K is the number of modules. The matrix entries \(u_{ik}\) and \(v_{jk}\) denote the likelihood that the ith miRNA and jth gene belong to the kth module respectively (greater magnitude indicates a greater chance of belonging to the module). In Theia, a regulatory comodule is defined by miRNAs and genes that belong to a particular module in common. As seen in Fig. 1, when the ith miRNA and jth gene share membership in a particular module, the value of \(({\varvec{U}}{\varvec{V}}^\intercal )_{ij}\), i.e., the (i, j) entry of \({\varvec{U}}{\varvec{V}}^\intercal\), is nonzero; thus, computing \({\varvec{U}}{\varvec{V}}^\intercal\) reveals the direct interactions between particular miRNAs and genes. Theia will utilize \({\varvec{U}}{\varvec{V}}^\intercal\) to decipher individual miRNAgene interactions, represented by \({\varvec{W}}=(w_{ij}) \in {\mathbb {R}}^{I \times J}\) that we call the regulation weight matrix. The value of \(w_{ij}\) estimates how strongly the ith miRNA regulates the jth gene (greater magnitude indicates stronger interaction). Further, the sign of \(w_{ij}\) defines the direction of regulation, such that negative values indicate downregulation and positive values indicate upregulation.
Overview
Our goal is to simultaneously learn the module membership matrices \({\varvec{U}}\) and \({\varvec{V}}\), and also the regulation weight matrix \({\varvec{W}}\). Toward this end, we develop Theia, which is built from three networks: Vnet, Unet, and Wnet (see Fig. 2). The Vnet first learns the gene module membership matrix \({\varvec{V}}\) from which the Unet then learns the miRNA module membership matrix \({\varvec{U}}\). By calculating \({\varvec{U}}{\varvec{V}}^\intercal\), the Wnet predicts the true interaction matrix \({\varvec{S}}\) between miRNAs and genes, and from this, it learns the regulation weight matrix \({\varvec{W}}\). Subdividing miRNAs and genes into modules to allow them to interact only when they belong to at least one common module, the source of falsely predicted interactions is reduced. This improves the accuracy of the true interaction matrix \({\varvec{S}}\) and in turn, the accuracy of the regulation weight matrix \({\varvec{W}}\) as well.
All three subnetworks are trained together using \({\varvec{X}}\), \({\varvec{Y}}\), \({\varvec{P}}\), and \({\varvec{Q}}\) such that the inferencing of \({\varvec{U}}\), \({\varvec{V}}\), and \({\varvec{W}}\) affect one another. Such training is done by minimizing a single cost function (see (11)), adjusting \({\varvec{U}}\), \({\varvec{V}}\), and \({\varvec{W}}\) simultaneously. This will benefit the learning process because of the inherent dependencies between these biological data sources.
Vnet and Unet: nonnegative matrix factorization
As seen in Fig. 3, to incorporate the putative interaction data \({\varvec{P}}\) and proteinprotein interaction data \({\varvec{Q}}\) into our inference framework, we learn the module membership matrices by factorizing \({\varvec{P}}\) into \({\varvec{U}}{\varvec{V}}^\intercal\) (i.e., \({\varvec{P}}\approx {\varvec{U}}{\varvec{V}}^\intercal\)) and \({\varvec{Q}}\) into \({\varvec{V}}{\varvec{V}}^\intercal\) (i.e., \({\varvec{Q}}\approx {\varvec{V}}{\varvec{V}}^\intercal\)). A nonzero value of \(({\varvec{U}}{\varvec{V}}^\intercal )_{ij}\) means that the ith miRNA and the jth gene interact belonging to a common module, and thus, \({\varvec{U}}{\varvec{V}}^\intercal\) should be similar to \({\varvec{P}}\). For a similar reason, \({\varvec{V}}{\varvec{V}}^\intercal\) should look like \({\varvec{Q}}\). Note that \({\varvec{P}}\) and \({\varvec{Q}}\) have a common factor \({\varvec{V}}\). We manage this constraint by first factorizing \({\varvec{Q}}\) in the Vnet, and provide the result \({\varvec{V}}\) to the Unet, which in turn will learn \({\varvec{U}}\) by factorizing \({\varvec{P}}\). The factorizations performed by Vnet and Unet minimize the respective cost functions,
and
Because all the elements of \({\varvec{U}}\) and \({\varvec{V}}\) must be nonnegative, the factorization should be accomplished using an NMF method [24]. Thus, we use the projected gradient descent algorithm [30] to minimize (5) and (6), which projects \({\varvec{U}}\) and \({\varvec{V}}\) to their nearest point in \([0,\infty )^{I \times K}\) and \([0,\infty )^{J \times K}\), respectively, whenever they contain negative quantities.
Note that unlike the common use case of NMF as a dimensionality reduction technique [19, 31], we adapt the algorithm for our specific use case. Conventionally, only one of the decomposed factors corresponding to representation of data matrix is useful and the other corresponding to the vector space (known as the basis matrix, typically with reduced dimensionality) does not play a role. Here, we decompose \({\varvec{P}}\) and \({\varvec{Q}}\), and the resulting factors \({\varvec{U}}\) and \({\varvec{V}}\) are all utilized as module membership matrices. It is also worth noting that unlike in PIMiM where zero elements of \({\varvec{Q}}\) are abandoned, we fully utilize all the information in \({\varvec{Q}}\).
Here, the module membership matrices \({\varvec{U}}\) and \({\varvec{V}}\) are mainly learned from the putative interaction information. However, later in Wnet, these \({\varvec{U}}\) and \({\varvec{V}}\) will be refined in conjunction with expression profiles \({\varvec{X}}\) and \({\varvec{Y}}\).
Wnet: regression
Using \({\varvec{U}}{\varvec{V}}^\intercal\), Wnet first computes \({\varvec{S}}=(s_{ij}) \in \{0, 1\}^{I \times J}\), which we call the true interaction matrix. The value of \(s_{ij}\) is the probability that the ith miRNA truly regulates the jth gene, and it is defined as:
where \(\sigma (z)=1/\left( 1+\exp (z\right)\) denotes the sigmoid activation function, and \(\beta\) is a scaling factor (which we set to \(\beta =2\)). In other words, \(({\varvec{U}}{\varvec{V}}^\intercal )_{ij}\) is scaled by 2\(\beta\) with a bias \(\beta\), in order to predict the probability of the true interaction between the ith miRNA and the jth gene. The value of \(s_{ij}\) becomes nearer to 1 as the probability of the ith miRNA and the jth gene belonging to a common module increases, or equivalently, as the ith miRNA and the jth gene share an increasing number of modules in common. The tanh function is a scaled version of the sigmoid activation function, shifted vertically to adjust the range. The tanh activation can be rewritten as \(tanh(z) = 2\sigma (2z)1\). By introducing a bias of of \(\beta\), we shift the scaled activation horizontally. An advantage of the scaling factor, is that the gradient is larger than a regular sigmoid. Not only is this because of the multiplication by a 2\(\beta\) factor, but also because the function becomes more sensitive to a change in the input. In our case, these two effects combined lead to faster convergence, assuming that the learning rate does not cause exploding gradients.
The regulation model \(R({\varvec{S}},{\varvec{x}}_n,\varvec{\mu })\) produces an estimate of \({\varvec{y}}_n\), which is defined as:
where \(\hat{{\varvec{y}}}_n=({\hat{y}}_{nj}) \in {\mathbb {R}}^{1 \times J}\), \(\varvec{\mu }=(\mu _{j}) \in {\mathbb {R}}^{1 \times J}\) with \(\mu _{j}\) denoting the sample mean of the jth gene, and \({\varvec{W}} \bullet {\varvec{S}}\) denotes the elementwise product (also known as the Schur product) between two matrices \({\varvec{W}}\) and \({\varvec{S}}\). Thus, \({\hat{y}}_{nj}\) is expressed as:
Namely, the \(R({\varvec{S}},{\varvec{x}}_n, \varvec{\mu })\) is a regression network whose main purpose is to learn the regulation weight matrix \({\varvec{W}}\). The unknowns of the Wnet (i.e., \(w_{ij}\)’s) are learned by mainly minimizing a cost function:
where \(\varvec{\sigma ^{2}}=(\sigma _j^{2}) \in {\mathbb {R}}^{1 \times J}\) with \(\sigma _j^2\) denoting the sample variance of the jth gene. Scaling \(({\hat{y}}_{nj}  y_{nj})\) by \(1 / \sigma _j^2\) is intended to prevent a certain gene from dominating other genes in the regression due to its large expression magnitude.
Note that unlike in PIMiM [20], we utilize \({\varvec{U}}\) and \({\varvec{V}}\) to predict whether there are interactions (on or off), and separately adopt \({\varvec{W}}\) by which we can model the direction of regulations (up or down) as well as the strength. By taking the Schur product between \({\varvec{S}}\) and \({\varvec{W}}\) in (8), the ith miRNA and the jth gene whose \(s_{ij}=0\) are disconnected in the regression network, and thus do not affect the minimization of the cost function in (10). This suppresses the unwanted interference when we learn \({\varvec{W}}\) by regression, and helps Theia decipher the small magnitudes of interactions, which are usually indistinguishable from noise in conventional regression methods. Note also that towards minimizing (10), the value of \(s_{ij}\) is automatically learned.
Combining Unet, Vnet, and Wnet
We have introduced three subnetworks of Theia, Vnet, Unet, and Wnet. These are dependent on one another and thus training one particular subnetwork alone will not lead to the intended results. For example, the Wnet requires \({\varvec{U}}\) and \({\varvec{V}}\) as its inputs, which are outputs of Unet and Vnet. The Unet also needs \({\varvec{V}}\) that is the output of Vnet. Training the Vnet alone causes \({\varvec{V}}\) to be learned from \({\varvec{Q}}\) only, without considering \({\varvec{X}}\), \({\varvec{Y}}\), and \({\varvec{P}}\). Hence, a global optimization of all three networks is required, for which we find an appropriate objective function.
In order to train Theia such that all input data sets \({\varvec{X}}\), \({\varvec{Y}}\), \({\varvec{P}}\) and \({\varvec{Q}}\) are integrated, we minimize the following total cost function using the projected gradient descent:
where each \(\lambda _n\) is a a weight that determines the relative importance of each term in the total cost function. The term \(\sum _{\forall i, j}w_{ij} / (IJ)\) functions as a regularizer for the Wnet in a similar manner as in the least absolute shrinkage selector operator (LASSO) regression. This helps Theia select significant interactions in \({\varvec{W}}\) while disregarding irrelevant ones.
We determined the values of \(\lambda _1\), \(\lambda _2\), and \(\lambda _3\) to be 0.5, 0.5, and 0.25 by an exhaustive search as seen in Fig. 4, in which we search the range from 0 to 1 for each of the three aforementioned parameters. For each of the runs, we generated synthetic data (see the Synthetic data results section for a more indepth discussion) and calculated the adjusted Rand Index. Note that Theia is not particularly sensitive to these parameters and performs relatively well (ARI near 1.0) even for suboptimal configurations. We also tested the effect of varying \(\lambda _n\) terms on the F\(^{1}\) score. In this case, we saw that the variation was smaller than that of the ARI score and thus was not useful for determining the ideal set of parameters.
Theia pipeline
In order to use Theia with the most recent biological data, the most recent putative interactions and proteinprotein interactions should be downloaded from databases such as TargetScan and BioGRID, respectively. MiRNA and gene expression data corresponding to the specific condition being studied must be downloaded as well. Then the training is initiated by executing the software program.
Once training is done, the ith miRNA and the jth gene are assigned to the kth regulatory comodules if \(u_{ik} > T_{{\varvec{U}}}\) and \(v_{jk} > T_{{\varvec{V}}}\), where \(T_{{\varvec{U}}}\) and \(T_{{\varvec{V}}}\) are cutoff thresholds. Note that each miRNA and gene may belong to multiple comodules, allowing for the identification of multiple functions. Theia will filter \(w_{ij}\) by multiplying it with \(s_{ij} p_{ij}\) because the value of \(w_{ij}\) is hardly adjusted during training if \(s_{ij} p_{ij}\) is near zero, and thus \(w_{ij}\) is not particularly meaningful in this case. In order to detect individual miRNAgene interactions, Theia will compute the regulatory network edge matrix, \({{\varvec{E}} = (e_{ij}) \in {\mathbb {R}}^{I \times J}}\), defined as:
The edge matrix gives us an indication toward the existence of an interaction between ith miRNA and jth gene. To prevent spurious predictions, we apply a threshold \(T_{{\varvec{W}}}\), where the interaction exists only if \(e_{ij} > T_{{\varvec{W}}}\). The regulation strength and the direction (up or down) of the detected interactions are determined by the magnitude and sign of \(w_{ij}\) respectively.
Our most novel algorithmic contribution involves learning the module membership matrices by decomposing \({\varvec{P}}\) and \({\varvec{Q}}\) using an NMF method, and utilizing them to predict true interactions. These interaction indicators are then used to disconnect noninteracting miRNAgene pairs in the regression network by which we can suppresses the unwanted interference when we learn the strength and direction of an regulation and improve the ability deciphering the small magnitudes of interactions.
Results
In addition to recovering interactions between miRNAs and genes, our work aims to discover comodules composed of a cluster of miRNAs that work together to regulate genes that share a function. Ground truth of such modules do not directly exist. Thus, we are forced to rely on indirect evidence of the biological significance of our modules in the form of enrichment analysis and by searching for overlap between known gene clusters and our modules. The underlying intuition is that if Theia is capable of recovering known clusters, then the clusters found by our method not previously identified by literature are also likely to have biological significance.
We decided to set the dimension of the matrix factorization K to 195 because our data set contained a total of 979 miRNA and we expect approximately between 2 and 5 miRNAs per module (\(979 / 5 \approx 195\)) based on results from Zhang et al. [19] and the distribution of spatial miRNA cluster sizes. Additionally, the parameters \(\lambda _1\), \(\lambda _2\), \(\lambda _3\), and \(\beta\) were set to 0.5, 0.5, 0.25, and 2, respectively. We set \(T_{{\varvec{U}}}=0.5\) and \(T_{{\varvec{V}}}=0.25\) when deciding whether a particular miRNA or gene was part of a module. After applying Theia and discarding comodules containing less than two miRNAs or less than two genes, we have obtained 112 comodules with an average of 4.0 miRNAs and 102.2 genes per module.
Since we cannot be entirely sure of the biological significance of our comodules, we also validate our method by testing against synthetically generated data sets, in which we can control for some parameters, such as varying rates of false positives in the putative interactions and varying strength of regulation in the relationship between miRNA and gene expressions. This way, we can be more sure that our results on real data are meaningful despite being unable to verify this directly.
The comodules are enriched in spatial microRNA clusters
Studies show that most miRNAs within 50 kilobase pairs (kb) tend to be coexpressed and regulate overlapping sets of target genes [32, 33]. This suggests that spatially clustered miRNA are likely to be functionally related or participate in cooperative regulation. Thus, one of the ways in which we evaluate the biological significance of the miRNAs within the comodules produced by Theia is by testing for spatial miRNA cluster enrichment.
Accordingly, we obtained miRNA sequences from the miRBase database [34,35,36,37,38] (release version 22) and grouped sequences within an intermiRNA distance of 50 kb. This criterion resulted in a sample of 1479 clusters containing from 2 to 125 miRNAs. The average number of members per cluster is 3.2. Approximately half (748 out of 1479) of the miRNA clusters contained only two miRNAs. As mentioned earlier, this distribution of cluster sizes influenced our decision to set K to 195. The statistical significance (pvalue) of the miRNA module’s enrichment in the spatial cluster was calculated using Fisher’s exact test. This statistic was transformed into a qvalue by correcting for the false discovery rate [39]. Of the 112 comodules identified in this study, 37 are significantly enriched in at least one miRNA cluster (qvalue < 0.05; see Table 1). All 112 comodules can be found in the additional files (see Additional file 1). For example, comodule 5 contains five miRNAs (miR449a, miR449b3p, miR449b5p, miR449c5p, miR4833p), of which all but miR4833p belong to the miRNA cluster located on chromosome 5, band 11.2. Even though miRNAs within 50 kilobase pairs (kb) tend to be coexpressed and regulate overlapping sets of target gene, it is not necessary for comodules to only contain miRNAs within 50 kb; they may contain a mixture of miRNAs within 50 kb and further than 50kb. Our tool is an improvement over previous stateoftheart methods, however, it is not perfect. Also, the miRBase database is growing as more discoveries are made. Perhaps our tool is predicting certain clusters not previously validated in the database, and some of these may be discovered in the future, while others may be false detections.
Quite a few of the miRNA modules found in this study are supported by existing literature. Notably, the miRNAs in comodule 20 are part of the C19MC cluster. Originally discovered by Bentwich et al. of Rosetta Genomics [40], the C19MC cluster spans 100 kb and yields 59 mature miRNAs, making it the largest cluster of miRNAs in the human genome [41]. The functional roles of the miRNA clusters in our modules are described exhaustively in Table 2.
The comodules are enriched in known functional sets
In addition to testing our comodules for overlap with spatial miRNA clusters, we also performed functional enrichment analysis for genes in the identified comodules. Specifically, we looked for enrichment in Gene Ontology [64, 65] (GO) biological process (BP) terms. We filtered out GO terms with more than 300 associated genes or fewer than 5 genes. The thresholds used here for filtering GO terms, are the same ones used in SNMNMF [19]. The GO enrichment analysis was performed on each cluster using GOATOOLS [66], which computes the statistical significance of a module’s enrichment with Fisher’s exact test, with a qvalue threshold of 0.05 (false discovery rate adjusted via the BenjaminiHochberg procedure [67]). Also, note that the software was set such that term counts were not propagated to parents (propagate_counts=False).
Of the 112 gene modules identified by Theia, 48 (43%) have at least one overrepresented GO biological process (BP) term with an FDRcorrected qvalue < 0.05. Alltogether, the modules are enriched in 302 unique GO biological processes. The most frequently enriched BP terms were cornification (14), cellular protein metabolic process (11), keratinization (8), fibrinolysis (5), muscle filament sliding (5), epidermis development (5), and platelet degranulation (5).
For comparison, when we performed the same test (three times) on the same number of randomly generated modules of the same size (112 total of size 102 genes), at most one module (1%) was enriched in at least one BP Term. This result is confirmed by the findings of Zhang et al. [19], who also performed GO enrichment on randomly generated modules and reported that only 2.4% of the modules were enriched in BP terms.
The comodules are strongly implicated in cancer
Since our input data included the miRNA and gene expression profiles of breast cancer samples, we expected the identified comodules to be related to cancer. We validated this hypothesis by comparing the miRNAs in our modules to those in miRCancer, a miRNAcancer association database (release version October, 2017) [68]. This database contains a total of 767 oncomirs. Our 112 modules consisted of 319 unique miRNA of which 219 were found in the miRCancer database. Given that our input data consisted of 979 miRNA of which 289 are related to cancer, this ratio (219 / 289) is highly significant (pvalue = 1.2176). In addition, 88 of the 112 (79%) modules have at least two oncogenic miRNAs. Comodules were also analyzed via Ingenuity Pathway Analysis (IPA) software (QIAGEN Inc.). The software identified cancer as a top network in 77 of the 112 modules (69%). Results can be found in Table 3 with more detials in the additional files (see Additional file 2).
The comodules form highly connected networks
The edges in IPA’s database of molecular interactions [69] connect genes on the basis of causeeffect relationships. Given that Theia groups genes that are related, we expect that dense graphs can be created from our generated gene modules. We used the default settings and found that in 88 of the 112 gene modules (79%) identified by our method, highly connected networks of genetic interactions could be constructed (score ≥ 35). Table 3 shows the top networks for some of the comodules. Among the top networks identified by the software were cancer (10), hereditary disorder (10), lipid metabolism (10), organismal development (10), cell morphology (12), celltocell signaling and interaction (12), molecular transport (13), small molecule biochemistry (18), organismal injury and abnormalities (19).
Theia can recover validated miRNAgene interactions
We also evaluate Theia’s ability to discover individual miRNAgene interactions. For this experiment, we downloaded the list of experimentallyvalidated interactions from miRTarBase (release 6.0) [70]. To increase the confidence of the groundtruth interactions, we filtered the list of interactions with \(PCC\ge 0.001\), \(PCC\ge 0.01\), and \(PCC\ge 0.1\). Note that we use absolute value of PCC here because positive values indicate upregulation and negative values indicate downregulation. This process resulted in 114, 108, and 45 validated interactions respectively. Note that the absence of an interaction in miRTarBase for the other pairs of miRNAs and genes does not necessarily mean that these pairs do not actually interact. Some of these pairs may indeed interact but are not yet validated by experiments. Thus, we cannot evaluate the precision and recall of Theia because nonvalidated interactions would be incorrectly counted as false positives. Instead, we focus on evaluating how well Theia can recover the validated interactions by computing the detection rate, which we define as the ratio of detected interactions to the total number of validated interactions (after filtering).
In Fig. 5 we can see that Theia’s detection performance is naturally dependent on the regulation strength. Interactions are easier to detect when they are strong (\(PCC\ge 0.1\)); thus, both Tiresias and Theia suffer when weaker interactions are considered as well (\(PCC\ge 0.001\)). The detection rate that Theia achieves is 0.8 when \(PCC\ge 0.1\) and 0.57 when \(PCC\ge 0.001\). This is significantly higher than the detection rate of our competitors. In the same conditions, Tiresias [11] achieves at most 0.64 and PIMiM [20] obtains at most 0.13. PIMiM was not originally designed to consider regulation direction and always assumes downregulation. To level the playing field, we advantaged PIMiM by giving it perfect knowledge of the regulation direction. That is, when PIMiM predicts a true interaction, we count it as a true positive regardless of its direction. Despite providing a similar advantage to SNMNMF, its detection rate was near zero and we omit its results here.
Evaluation using cross validation We evaluate Theia using tenfold cross validation similar to what has been done in previous studies [71, 72]. The experiments have been performed using experimentallyvalidated interactions from the miRTarBase (release 6.0) [70]. In the tenfold cross validation, all experimentallyvalidated interactions are randomly divided into tenfolds. For each round, one set is heldout and used for testing while the rest are used for training. The corresponding predicted result of test samples is considered as true positive (TP) when the predicted relevance score is greater than the threshold. Otherwise, false negative (FN). Similarly, for the unknown miRNAdisease interactions, the corresponding predicted result is considered as false positive (FP) when the predicted relevance score is greater than the threshold. Otherwise, true negative (TN). The AUC for each fold is calculated and the mean of these values is taken to get the mean AUC over ten folds. The training procedure remains identical except for a change in one of the inputs: the putative matrix \({{\varvec{P}}=(p_{ij}) \in \{0,1\}^{I \times J}}\), constructed from TargetScan [4] (release 7.1) is replaced by a matrix \({\varvec{P^{\prime}}=(p^{\prime}_{ij}) \in \{0,1\}^{I \times J}}\) constructed from the miRTarBase (release 6.0) [70]. All three subnetworks are trained together using \({\varvec{X}}\), \({\varvec{Y}}\), \({\varvec{Q}}\), and \(\varvec{P^{\prime}}\). The mean AUC across ten folds is calculated for Theia, Tiresias [11] and PIMiM [20] and found to be 0.9294, 0.8536 and 0.6137 respectively.
Evaluating Theia with synthetic data
Existing literature has only discovered a small fraction of the interacting miRNAgene pairs. Target genes for rice miRNAs have been mainly predicted by computational approaches, and only a small fraction of targets has been experimentally validated [73]. Several highthroughput crosslinkingimmunoprecipitation (CLIP) approaches have been reported to produce a high number of false negatives [4]. Furthermore, the detailed combinatorial roles of most miRNAs and genes are still unclear. This fact makes real datasets inadequate for computing evaluation metrics, for which knowledge of the ground truth is required. Consequently, we synthetically generate miRNAgene interactions, regulatory comodules, miRNA and gene expressions, putative interactions, and proteinprotein interactions. With this data where we can control ground truth, we evaluate the efficacy of Theia with varying rates of false positives in the putative interactions and varying ratios of signal to noise in the miRNA/gene expression.
The need for synthetic datasets Previous works focus on evaluating their methods on biological datasets. Out of previous works SNMNMF, PIMiM and Tiresias, only previous stateoftheart Tiresias [11] makes use of synthetic data. However, in contrast to Tiresias, we evaluate the methods in our work on a much larger set of synthetic datasets. Figure 1 gives an example of matrices \({\varvec{X}}\) and \({\varvec{Y}}\) from which the PCC values are calculated. The sequences derived from these matrices, for an MiRNA and a gene, are used in this calculation, with each term corresponding to a sample; the number of terms is equal to the number of samples \({\varvec{N}}\). In this work, while generating synthetic datasets, we vary parameters \(p_\text {signal} \in \{0, 0.05, 0.1, \dots , 1\}\) and \(p_\text {fp} \in \{0, 0.05, 0.1, \dots , 2\}\). This gives rise to 861 combinations, since there are 21 possibles values of \(p_\text {signal}\) and 41 possible values of \(p_\text {fp}\). Table 4 shows us the effect that varying \(p_\text {signal}\) has on the PCC values, and hence on the dataset matrices \({\varvec{X}}\) and \({\varvec{Y}}\). Even if we assume that synthetic datasets match each other closely for some range of \(p_\text {signal}\), this range is small compared to the range of values in which we vary \(p_\text {signal}\); observe in Table 4 that the change in PCC values is appreciable as we vary \(p_\text {signal}\). Another question which arises is how closely the TCGA BRCA dataset matches the synthetic datasets. Even if we assume that for a certain pair of \(p_\text {signal}\) and \(p_\text {fp}\) the TCGA BRCA dataset matches the corresponding synthetic dataset, it is impossible for the TCGA BRCA to be matched closely to all synthetic datasets used, as this would contradict the observations of Table 4. In fact, in the case the TCGA BRCA dataset matches a synthetic dataset, it will be related to only a very small percentage of all the synthetic datasets used in this study. In this way we ensure two things; the availability of a ground truth to compare the predictions made by Theia with, and the evaluation of Theia on a large number of datasets. Both these factors reinforce the applicability of Theia to a larger range biological contexts.
Synthetic data generation Several studies indicate that the sizes of clusters of functionally related genes are distributed according to a positively skewed distribution. That is, the vast number of genes sets are relatively small, while a few are much larger [74]. One can also arrive at this conclusion from the perspective of genetic hubs, small class of genes that affect many different biological pathways [75]. These hubs tend to have a high level of connectivity in biological networks, and this means that they tend to be a part of largesized modules and also appear in a large number of modules. On the other hand, the more common nonhub genes form smaller modules and appear in a few modules. Likewise, we see a similar skewed distribution in spatial miRNA clusters. The distribution as well as the distribution of GO BP term module sizes can be found in more detail (see Additional file 4). For these reasons, we generated comodules such that the number of members per module followed a positiveskewed distribution. In order to reflect the high connectivity of the genetic hubs, we also model the number of modules per miRNA/gene as a positiveskewed distribution. More details can be found in the additional files (see Additional file 3)
In detail, we generate the module membership matrices \({\varvec{U}}\) and \({\varvec{V}}\) such that their elements are either 0 or 1. The number of nonzero elements in each column of \({\varvec{U}}\) and \({\varvec{V}}\) (which represents the number of miRNAs or genes in a module) is distributed according to the skew normal distribution, \(\mathcal {SN}(\xi , \omega , \alpha )\), with location parameter \(\xi = 1\), scale parameter \(\omega = 1\), and shape parameter \(\alpha = 5\). In addition, the number of nonzero elements in each row of \({\varvec{U}}\) and \({\varvec{V}}\) (which represents the number of modules in which a particular miRNA or gene has membership) is also distributed according to the skew normal distribution, \(\mathcal {SN}(\xi , \omega , \alpha )\), with \(\xi =D/K\), \(\omega = 10\), \(\alpha = 5\) (\(D = I\) for \({\varvec{U}}\) and \(D = J\) for \({\varvec{V}}\)).
The ground truth interactions between miRNAs and genes, \({\varvec{G}}=(g_{ij}) \in \{1,0,1\}^{I \times J}\), is the product of the miRNA and gene module membership matrices. Thus, \(g_{ij}\) is nonzero if the ith miRNA and the jth gene share at least one module in common. A majority (controlled by \(p_\text {down}\)) of the nonzero elements are made negative (representing a downregulation). Precisely, we define \({\varvec{G}}\) as follows:
where \(\text {Pr}(b_{ij} = 0) = 1  \text {Pr}(b_{ij} = 1) = p_\text {down}\).
The miRNA expression, \({{\varvec{X}} \in {\mathbb {R}}^{N \times I}}\), and gene expression, \({{\varvec{Y}} \in {\mathbb {R}}^{N \times J}}\), are distributed normally. Each sample of expression data is generated as follows:
where \(\mu _x\) and \(\mu _y\) are the average miRNA and gene expression levels respectively when there is no regulation. The parameters \(\sigma _x^2\) and \(\sigma _y^2\) are the expression level variances. The value of \(p_\text {signal}\) controls the strength of the effect of the miRNA expression level on the gene expression level. By increasing this signal, the modules embedded in the expression data become easier to extract, while decreasing the signal results in the modules becoming obscured by the variance. The correspondence between \(p_\text {signal}\) and the PCC is shown in Table 4.
Putative miRNAgene interactions \({\varvec{P}}\) are generated:
where \(\text {Pr}(b^{\prime}_{ij} = 1) = 1  \text {Pr}(b^{\prime}_{ij} = 0) = p_\text {fp}\sum _{\forall i,j}g_{ij}/(IJ)\). The parameter \(p_\text {fp}\) controls the number of false positive interactions relative to the density of \({\varvec{G}}\). For example, when \(p_\text {fp} = 1\), the density of \({\varvec{P}}\) is (roughly) doubled and approximately half of the interactions will be false positives. When \(p_\text {fp} = 2\), the density is (roughly) quadrupled and approximately threequarters of the interactions will be false positives, and so on. The purpose of this relative false positive rate is to make the effect of \(p_\text {fp}\) independent of the dimensions of G.
Lastly, the proteinprotein interactions \({\varvec{Q}}\) are generated:
That is, \(q_{ij} = 1\) if \(({\varvec{V}}{\varvec{V}}^\intercal )_{ij} \ge 1\), and \(q_{ij} = 0\) otherwise.
Synthetic data results All parameters for Theia were kept the same as in the biological dataset evaluation, except both the cutoff for \({\varvec{U}}\) and \({\varvec{V}}\) were set to 0.5. Comodules were generated according to the previously described procedure with the following parameters: \(N = 1000\), \(K = 10\), \(I = 50\), \(J = 500\), \(\mu _x = 3\), \(\mu _y = 10\), and \(\sigma _x^2 = \sigma _y^2 = 1\).
In order to measure the similarity between modules discovered by Theia and the true modules, which we know in the case of the synthetic data, we use the adjusted Rand index (ARI). The basic Rand index (RI) computes a similarity measure between two clusterings by considering all pairs of elements and counting pairs that are assigned to the same cluster and dividing this value by the total number of pairs. However, the RI does not account for chance, i.e., two clusterings that are similar purely by chance. The likelihood of such chance placements is higher when there is a small number of clusters or a small number of elements or both. Thus, instead of the RI, we decide to use the ARI, which adjusts the index value to account for the expected similarity between the clusterings. The ARI lies between 1 and 1. Random clusterings have an ARI close to 0 while 1 stands for perfect match, and an ARI less than zero represents a worsethanrandom clustering.
To evaluate Theia’s ability to recover the true miRNAgene interactions, we use the F\(^{1}\) score. If both the interaction and the direction of the interaction were correctly predicted, then this was considered a true positive. On the other hand, if an interaction was predicted when no interaction existed, this was considered a false positive. But if the lack of an interaction was correctly predicted, this was considered a true negative. The remaining cases were considered false negatives.
The ARI and the F\(^{1}\) score were computed for every combination of \(p_\text {signal} \in \{0, 0.05, 0.1, \dots , 1\}\) and \(p_\text {fp} \in \{0, 0.05, 0.1, \dots , 2\}\). A Gaussian filter with \(\sigma = 0.5\) was applied to the 40 by 20 matrix of results to reduce the noise. Figure 6 shows the resulting contour plot. We can see that Theia can achieve an ARI near 0.9 when \(p_\text {fp}=0\) and \(p_\text {signal}=0.5\). This tells us that with no false positives in \({\varvec{P}}\) and a high signal strength, Theia can recover the groundtruth comodules almost perfectly. In the most biologicallyplausible region (i.e., small PCC values, typically less than 0.1, which correspond to the region around \(p_\text {signal}=0\)), Theia can still achieve ARI ranging from 0.5 to 0.8, depending on \(p_\text {fp}\). This is significantly better than existing solutions as we will see later. We can also see that Theia can achieve an F\(^{1}\) score of up to 0.7 even when \(p_\text {signal}=0\). This is the benefit of Theia’s use of \({\varvec{P}}\) and \({\varvec{Q}}\), from which we can learn much about interactions even without using expression data. With a high \(p_\text {signal}\) and a low \(p_\text {fp}\), Theia can perfectly recover true interactions (F\(^{1}\) = 1).
The fact that Theia performs so well on synthetic data without the need for additional tuning of the hyperparameters is suggestive of two facts. First, this indicates that Theia can easily adapt to different data sets, making this algorithm useful for a wide array of pathophysiological conditions. Second, this result validates the biological significance of our synthetic data generation procedure. Thus, our data generation algorithm can confidently be used to evaluate the effectiveness of future methods within this class of algorithms. This contribution is especially significant in the domain of computational genomics because the availability of highquality ground truth data sets is often limited.
Comparison with other methods
Unlike other recent methods for miRNAgene regulatory comodule identification, Theia learns the comodules along with the regulation strength represented by \({\varvec{W}}\) in the regression network. This feature helps improve the accuracy of the comodules, since the regression network is mutually related with the comodules, and thus minimizing the cost of the regression network, which is contributed proportionally to \({\varvec{W}}\) by each interacting miRNAgene pair, forces the module clustering as well to improve.
To demonstrate that Theia’s approach can indeed improve the accuracy of comodules, we compare Theia with SNMNMF [19] and PIMiM [20] using TCGABRCA data set. For this experiment, the number of comodules K was set to 195 (which is roughly equal to #miRNAs/5) for all three methods. We set the weight parameters for SNMNMF \(\lambda _1\), \(\lambda _2\), \(\gamma _1\), and \(\gamma _2\) to 0.0001, 0.01, 20, and 10, respectively because these were found to be optimal in [19]. By following the procedure as described in the Supplementary Material in [19], we determined the optimal SNMNMF threshold T to be 1 because this value yielded the highest ratio of modules enriched in GO BP terms to total modules as compared to other values of T in the range 1 to 10. The regularization and weight parameters of PIMiM, \(\alpha\), \(\beta\), \(C_1\), and \(C_2\) were optimized by performing an iterative line search to determine the values of these parameters using the F\(^{1}\) score as the target function to optimize (as described in [20]). The optimal parameters were found to be 1, 0.5, 3, and 3 respectively. The results of a comparative analysis can be seen in Fig. 7. In this figure, the metrics are influenced by the number of comodules predicted by each method. Note that some of the comodules predicted by the methods may not be functionally valid, and these metrics are affected by these errors.
We can see that Theia outperforms SNMNMF significantly in all respects. Although a slightly greater proportion of PIMiM’s modules were enriched in at least one GO BP term (C), we can attribute this to a large degree of intermodule overlap, as evidenced by the low number of unique GO BP terms (F). That is, there is a large amount of duplication within PIMiM’s modules causing causing (C) and (E) to be inflated.
The fact the modules discovered by Theia were enriched in such a large and varied group of GO terms indicates that our solution was able to cluster many miRNAs and genes according to their function, rather than just the most obvious relationships. Theia also had great success in constructing miRNA modules that overlapped with spatial miRNA clusters compared to competing solutions; 37 of Theia’s modules were enriched in these spatial clusters while less than 10 of SNMNMF’s and PIMiM’s modules were enriched in this way. Finally, many of the miRNAs in our modules are known to be associated to cancer. This result seems to suggest that our method is truly context sensitive in that it can identify regulatory comodules that are related to the pathophysiological condition from which the RNA expression data originated.
We also compare Theia with SNMNMF, PIMiM, and Tiresias in terms of the F\(^{1}\) score and ARI using the same synthetic data set, which we used to evaluate Theia. Figure 8 shows the results of each method relative to Theia. Theia outperforms SNMNMF and PIMiM in both ARI and F\(^{1}\) score for all combinations of \(p_\text {signal}\) and \(p_\text {fp}\). We hypothesize that SNMNMF and PIMiM performed poorly during these ARI experiments because these methods were not tested with synthetic data during their formulation. We believe that the design and the tuned hyperparameters of these methods overfit to the specific data sets on which they were originally fitted. Thus, they are unable to model different data sets as easily as Theia. Compared to Tiresias, Theia has a significant advantage when the signal strength (\(p_\text {signal}\)) is weak. We postulate that this stems from Theia’s novel use of \({\varvec{U}}\) and \({\varvec{V}}\) to disconnect noninteracting miRNAgene pairs in the regression network.
Figure 9 zooms in on one combination of \(p_\text {signal}\) and \(p_\text {fp}\) (1.0 and 0.1 respectively), and shows the precisionrecall curve for Theia, PIMiM, and Tiresias. Because Theia is able to suppress noise in the miRNAgene interaction matrix better than Tiresias, we minimize the number of false positive interactions, and thus we are able to push the threshold lower; by doing so, we greatly increase our recall without sacrificing much precision.
Using the synthetic data set, we also study the effect of number of modules (K) on Theia, SNMNMF, and PIMiM. For this, we vary the value of K, and correspondingly the numbers of miRNAs (=5X number of modules) and genes (=50X number of modules) as well. The result of the ARI and F\(^{1}\) score is shown in Fig. 10. We can see that both ARI and F\(^{1}\) score change depending on K. However, in case of Theia, ARI and F\(^{1}\) score stay above 0.9 and 0.8, respectively. In contrast, SNMNMF and PIMiM achieve much lower ARI and F\(^{1}\) score, regardless of K. Note also that as the number of modules increases, the sparsity of the input matrices also increases, and this is characteristic that Theia handles particularly well.
Visualizing Theia’s Results
As part of our Theia framework, we also include a method of a visualizing the generated modules (See Fig. 11). Typical approachessuch as the one used in Le, et al. [20]create a graph by connecting pairs of genes and pairs miRNAs and genes that interact.
The problem is that if such a graph is created with a nontrivial number of input miRNAs and genes, the result becomes unreadable. For this reason, we create one node for each comodule and point all the genes that are part of that comodue to it. If a gene is part of two modules than it will point to two modules and so on. We used the forcedirected algorithm [76] to render the resulting graph. Our implementation is interactive and allows the user to rotate the graph, which means that overlapping nodes are less of a problem.
We can see from the visualization that the number of modules in which a particular gene is a member follows the skew normal distributionthe majority of genes only point to one module, a fair number point to two, and even fewer point to three, and so on. We also see the varying number of genes per module. A few modules are very large while the majority only contain a few genes.
Discussion
In this paper, we have presented an algorithm called Theia that can predict the effects of modules of miRNAs on genes. Our work gets to the heart of the biological discovery that groups of miRNAs act combinatorially to regulate genes. Theia is a theoretically rigorous optimization algorithm that simultaneously predicts the strength and direction (i.e., upregulation or downregulation) of the effect of modules of miRNAs on a gene. We validated Theia by testing it on 1161 breast invasive carcinoma samples from the TCGA data portal, which contains 979 miRNAs and 19,258 genes. This resulted in the identification of 112 regulatory comodules. We found that some of the miRNA modules generated by our model are biologically significant (37 are enriched in spatial miRNA clusters and 48 have at least one enriched GO biological process), e.g., the miRNAs belonging to a given module are found to have similar functional roles, as determined by prior laboratory studies, or are proximate (prior studies have indicated that spatially clustered miRNAs often have similar functional roles). Similarly, we found that the gene modules are significantly enriched in many GO BP terms and form highly connected interaction networks. We posit that if Theia is capable of recovering known clusters of genes and miRNA, then the clusters found by our method not previously identified by literature are also likely to have biological significance. We believe that these novel regulatory comodules found by our method will be a springboard for further research into the specific functional roles of these new functional ensembles of miRNAs and genes, especially those related to diseases like breast cancer.
To further validate Theia, we generated synthetic data sets where the ground truth was known for all samples using parameters determined from real data. Notably, we found that the same hyperparameters of our model work well for both the real and synthetic data sets, indicating that our algorithmic framework is stable and robust to changes in the quality and type of input data. We evaluate the quality of miRNAgene clustering and the accuracy of the interaction predictions obtained by Theia through comparison to prior works PIMiM, SNMNMF, and Tiresias. At a very high level of false positives (\(p_\text {fp} = 2\), \(p_\text {signal} = 0.5\)), we see that Theia achieves an ARI score of 0.60 (2.9 times improvement over SNMNMF and PIMiM), and the F\(^{1}\) score of 0.55 (1.9 times improvement over SNMNMF and PIMiM). When the signal strength is very low (\(p_\text {signal} = 0.15\), \(p_\text {fp} = 2\)), Theia achieves an F\(^{1}\) score of 0.55 (1.4 times improvement over Tiresias).
In future work, we are looking at modeling the effects of modules of miRNAs using a nonlinear regression model. More substantively, we are looking at jointly modeling the effects of miRNAs, Transcription Factors, and cisregulatory modules on gene expression levels. By considering the overall logic of gene expression profiles, we can holistically map out the gene regulatory networks and thus have a better handle on how to detect anomalies in gene expression in disease.
On the algorithmic front, we are looking at creating building blocks, which we call kernels, of genome annotating algorithmic motifs. These kernels can then be put together and optimized for specific end goals, rather than creating these kernels de novo, as outlined in our vision for the Sarvavid domainspecific language (DSL) framework [77]. For example, we will be augmenting our Theia framework by including additional transregulatory factors, such as TFs, plus additional cisregulatory factors, such as DNA regulatory sequences [78], in an attempt to wholly map out the gene expression landscape. We have already seen a glimpse of this by augmenting Tiresias with the insight that genes and miRNA work together in manytomany capacities, and in modules, in addition to acting individually. Our machine learning models will become progressively better as more biologically validated data becomes available, whether it is putative miRNAgene interactions, their expression levels through mutual interactions, or proteinprotein interaction data.
Data availability
The tool is available at https://bitbucket.org/cellsandmachines/theia/. The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
References
Lee RC, Feinbaum RL, Ambros V. The C. elegans heterochronic gene lin4 encodes small RNAs with antisense complementarity to lin14. Cell. 1993;75(5):843–54.
Fabian MR, Sonenberg N, Filipowicz W. Regulation of mRNA translation and stability by microRNAs. Annu Rev Biochem. 2010;79(1):351–79.
GriffithsJones S, Grocock RJ, van Dongen S, Bateman A, Enright AJ. mirbase: microrna sequences, targets and gene nomenclature. Nucleic Acids Res. 2006;34:140–4.
Agarwal V, Bell GW, Nam JW, Bartel DP. Predicting effective microrna target sites in mammalian mRNAs. eLife. 2015;4:05005.
Betel D, Koppal A, Agius P, Sander C, Leslie C. Comprehensive modeling of microrna targets predicts functional nonconserved and noncanonical sites. Genome Biol. 2010;11(8):90.
Khorshid M, Hausser J, Zavolan M, van Nimwegen E. A biophysical miRNAmRNA interaction model infers canonical and noncanonical targets. Nat Methods. 2013;10(3):253–5.
Muniategui A, Pey J, Planes FJ, Rubio A. Joint analysis of miRNA and mRNA expression data. Briefings Bioinform. 2013;14(3):263–78.
Ghoshal A, Shankar R, Bagchi S, Grama A, Chaterji S. Microrna target prediction using thermodynamic and sequence curves. BMC Genomics. 2015;16(1):121.
Ghoshal A, Grama A, Bagchi S, Chaterji S. An ensemble svm model for the accurate prediction of noncanonical microrna targets. In: ACMBCB Best Paper Award, p. 403 2015.
Ghoshal A, Zhang J, Roth M, Xia K, Grama A, Chaterji S. A distributed classifier for microrna target prediction with validation through tcga expression data. IEEE/ACM Trans Comput Biol Bioinform. 2018;15(4):103751.
Koo J, Zhang J, Chaterji S. Tiresias: Contextsensitive approach to decipher the presence and strength of microrna regulatory interactions. Theranostics. 2018;8(1):277–91.
Mohorianu I, LopezGomollon S, Schwach F, Dalmay T, Moulton V. Firepatfinding regulatory patterns between sRNAs and genes. Wiley Interdiscip Rev Data Min Knowl Discov. 2012;2(3):273–84.
Hashimoto Y, Akiyama Y, Yuasa Y. Multipletomultiple relationships between microRNAs and target genes in gastric cancer. PLoS ONE. 2013;8(5):1–11.
Lu Y, Zhou Y, Qu W, Deng M, Zhang C. A lasso regression model for the construction of micrornatarget regulatory networks. Bioinformatics. 2011;27(17):2406–13.
Beck D, Ayers S, Wen J, Brandl MB, Pham TD, Webb P, Chang CC, Zhou X. Integrative analysis of next generation sequencing for small noncoding RNAs and transcriptional regulation in myelodysplastic syndromes. BMC Med Genomics. 2011;4(1):19.
Denzler R, Agarwal V, Stefano J, Bartel DP, Stoffel M. Assessing the cerna hypothesis with quantitative measurements of miRNA and target abundance. Mol Cell. 2014;54(5):766–76.
Vidal M, Cusick ME, Barabási AL. Interactome networks and human disease. Cell. 2011;144(6):986–98.
Uhlmann S, Mannsperger H, Zhang JD, Horvat EÁ, Schmidt C, Küblbeck M, Henjes F, Ward A, Tschulena U, Zweig K, Korf U, Wiemann S, Sahin Ö. Global microrna level regulation of egfrdriven cellcycle protein network in breast cancer. Mol Syst Biol. 2012;8(1):570.
Zhang S, Li Q, Liu J, Zhou XJ. A novel computational framework for simultaneous integration of multiple types of genomic data to identify micrornagene regulatory modules. Bioinformatics. 2011;27(13):401–9.
Le HS, BarJoseph Z. Integrating sequence, expression and interaction data to determine conditionspecific miRNA regulation. Bioinformatics. 2013;29(13):89–97.
Vasudevan S. Posttranscriptional upregulation by microRNAs. Wiley Interdisciplinary Reviews: RNA. 2012;3(3):311–30.
Singh P, Yang M, Dai H, Yu D, Huang Q, Tan W, Kernstine KH, Lin D, Shen B. Overexpression and hypomethylation of flap endonuclease 1 gene in breast and other cancers. Mol Cancer Res. 2008;6(11):1710–7.
Le V, Lee J, Chaterji S, Spencer A, Liu YL, Kim P, Yeh HC, Kim DH, Baker AB. Syndecan1 in mechanosensing of nanotopological cues in engineered materials. Biomaterials. 2018;155:13–24.
Lee DD, Seung HS. Learning the parts of objects by nonnegative matrix factorization. Nature. 1999;401:788–91.
Brunet JP, Tamayo P, Golub TR, Mesirov JP. Metagenes and molecular pattern discovery using matrix factorization. Proc Nat Acad Sci. 2004;101(12):4164–9.
Xu T, Su N, Liu L, Zhang J, Wang H, Zhang W, Gui J, Yu K, Li J, Le TD. mirbaseconverter: an r/bioconductor package for converting and retrieving miRNA name, accession, sequence and family information in different versions of mirbase. BMC Bioinform. 2018;19(19):179–88.
Creighton CJ, Nagaraja AK, Hanash SM, Matzuk MM, Gunaratne PH. A bioinformatics tool for linking gene expression profiling results with public databases of microrna target predictions. RNA. 2008;14(11):2290–6.
Pinzón N, Li B, Martinez L, Sergeeva A, Presumey J, Apparailly F, Seitz H. microrna target prediction programs predict many false positives. Genome Res. 2017;27(2):234–45.
Stark C, Breitkreutz BJ, Reguly T, Boucher L, Breitkreutz A, Tyers M. Biogrid: a general repository for interaction datasets. Nucleic Acids Res. 2006;34:535–9.
Lin CJ. Projected gradient methods for nonnegative matrix factorization. Neural Comput. 2007;19(10):2756–79.
Devarajan K. Nonnegative matrix factorization: an analytical and interpretive tool in computational biology. PLoS Comput Biol. 2008;4(7):1000029.
Baskerville S, Bartel DP. Microarray profiling of microRNAs reveals frequent coexpression with neighboring miRNAs and host genes. RNA. 2005;11(3):241–7.
Wang Y, Luo J, Zhang H, Lu J. microRNAs in the same clusters evolve to coordinately regulate functionally related genes. Mol Biol Evol. 2016;33(9):2232–47.
Kozomara A, GriffithsJones S. mirbase: annotating high confidence microRNAs using deep sequencing data. Nucleic Acids Res. 2014;42(D1):68–73.
Kozomara A, GriffithsJones S. mirbase: integrating microrna annotation and deepsequencing data. Nucleic Acids Res. 2011;39(suppl1):152–7.
GriffithsJones S, Saini HK, van Dongen S, Enright AJ. mirbase: tools for microrna genomics. Nucleic Acids Res. 2008;36(suppl1):154–8.
GriffithsJones S, Grocock RJ, van Dongen S, Bateman A, Enright AJ. mirbase: microrna sequences, targets and gene nomenclature. Nucleic Acids Res. 2006;34(suppl1):140–4.
Jones GS. The microrna registry. Nucleic Acids Res. 2004;32(Database issue):109–11.
Storey JD, Tibshirani R. Statistical significance for genomewide studies. Proc Nat Acad Sci. 2003;100(16):9440–5.
Bentwich I, Avniel A, Karov Y, Aharonov R, Gilad S, Barad O, Barzilai A, Einat P, Einav U, Meiri E, et al. Identification of hundreds of conserved and nonconserved human microRNAs. Nat Genet. 2005;37(7):766.
Zhang R, Wang YQ, Su B. Molecular evolution of a primatespecific microrna family. Mol Biol Evol. 2008;25(7):1493–502.
Loriot A, Van Tongelen A, Blanco J, Klaessens S, Cannuyer J, van Baren N, Decottignies A, De Smet C. A novel cancergermline transcript carrying prometastatic mir105 and tettargeting mir767 induced by dna hypomethylation in tumors. Epigenetics. 2014;9(8):1163–71.
Yan W, Li R, Liu Y, Yang P, Wang Z, Zhang C, Bao Z, Zhang W, You Y, Jiang T. Microrna expression patterns in the malignant progression of gliomas and a 5microrna signature for prognosis. Oncotarget. 2014;5(24):12908.
Feng M, Yu Q. miR449 regulates CDKRbE2F1 through an autoregulatory feedback circuit. London: Taylor & Francis; 2010.
Harbour JW, Dean DC. The rb/e2f pathway: expanding roles and emerging paradigms. Genes Dev. 2000;14(19):2393–409.
Xia L, Zhang D, Du R, Pan Y, Zhao L, Sun S, Hong L, Liu J, Fan D. mir15b and mir16 modulate multidrug resistance by targeting bcl2 in human gastric cancer cells. Int J Cancer. 2008;123(2):372–9.
MartinezSanchez A, Murphy CL. mir1247 functions by targeting cartilage transcription factor sox9. J Biol Chem. 2013;288(43):30802814.
Shi S, Lu Y, Qin Y, Li W, Cheng H, Xu Y, Xu J, Long J, Liu L, Liu C, et al. mir1247 is correlated with prognosis of pancreatic cancer and inhibits cell proliferation by targeting neuropilins. Curr Mol Med. 2014;14(3):316–27.
Lund AH. mir10 in development and cancer. Cell Death Differ. 2010;17(2):209.
Desvignes T, Contreras A, Postlethwait JH. Evolution of the mir199214 cluster and vertebrate skeletal development. RNA Biol. 2014;11(4):281–94.
Hermeking H. The mir34 family in cancer and apoptosis. Cell Death Differ. 2010;17(2):193.
Wanet A, Tacheny A, Arnould T, Renard P. mir212/132 expression and functions: within and beyond the neuronal compartment. Nucleic Acids Res. 2012;40(11):4742–53.
Miao L, Yao H, Li C, Pu M, Yao X, Yang H, Qi X, Ren J, Wang Y. A dual inhibition: microrna552 suppresses both transcription and translation of cytochrome p450 2e1. Biochimica et Biophysica Acta (BBA) Gene Regul Mech. 2016;1859(4):650–62.
Yang Y, Ago T, Zhai P, Abdellatif M, Sadoshima J. Thioredoxin 1 negatively regulates angiotensin iiinduced cardiac hypertrophy through upregulation of mir98/let7. Circu Res. 2010;108(3):30513.
AnayaRuiz M, Cebada J, DelgadoLópez G, SanchezVazquez ML, PérezSantos J. mir153 silencing induces apoptosis in the mdamb231 breast cancer cell line. Asian Pac J Cancer Prev. 2013;14(5):2983–6.
Wu Z, He B, He J, Mao X. Upregulation of mir153 promotes cell proliferation via downregulation of the pten tumor suppressor gene in human prostate cancer. Prostate. 2013;73(6):596–604.
Chen JF, Mandel EM, Thomson JM, Wu Q, Callis TE, Hammond SM, Conlon FL, Wang DZ. The role of microrna1 and microrna133 in skeletal muscle proliferation and differentiation. Nat Genet. 2006;38(2):228.
Yoshino H, Chiyomaru T, Enokida H, Kawakami K, Tatarano S, Nishiyama K, Nohata N, Seki N, Nakagawa M. The tumoursuppressive function of mir1 and mir133a targeting tagln2 in bladder cancer. Br J Cancer. 2011;104(5):808.
Sun Y, Koo S, White N, Peralta E, Esau C, Dean NM, Perera RJ. Development of a microarray to detect human and mouse microRNAs and characterization of expression in human organs. Nucleic Acids Res. 2004;32(22):188.
Khella HW, Bakhet M, Allo G, Jewett M, Girgis A, Latif A, Girgis H, Von Both I, Bjarnason G, Yousef G. mir192, mir194 and mir215: a convergent microrna network suppressing tumor progression in renal cell carcinoma. Carcinogenesis. 2013;34(10):2231–9.
le Sage C, Nagel R, Egan DA, Schrier M, Mesman E, Mangiola A, Anile C, Maira G, Mercatelli N, Ciafrè SA, et al. Regulation of the p27kip1 tumor suppressor by mir221 and mir222 promotes cancer cell proliferation. EMBO J. 2007;26(15):3699–708.
Galardi S, Mercatelli N, Giorda E, Massalini S, Frajese GV, Ciafrè SA, Farace MG. mir221 and mir222 expression affects the proliferation potential of human prostate carcinoma cell lines by targeting p27kip1. J Biol Chem. 2007;282(32):2371623724.
Liu L, Nie J, Chen L, Dong G, Du X, Wu X, Tang Y, Han W. The oncogenic role of microrna130a/301a/454 in human colorectal cancer via targeting smad4 expression. PLoS ONE. 2013;8(2):55532.
Ashburner M, Ball CA, Blake JA, Botstein D, Butler H, Cherry JM, Davis AP, Dolinski K, Dwight SS, Eppig JT, et al. Gene ontology: tool for the unification of biology. Nat Genet. 2000;25(1):25.
Consortium GO. Expansion of the gene ontology knowledgebase and resources. Nucleic Acids Res. 2016;45(D1):331–8.
Tang H, Klopfenstein D, Pedersen B, Flick P, Sato K, Ramirez F, Yunes J, Mungall C. Goatools: tools for gene ontology. Zenodo. 2015;10:5.
Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B (Methodol). 1995;57(1):289–300.
Xie B, Ding Q, Han H, Wu D. mircancer: a micrornacancer association database constructed by text mining on literature. Bioinformatics. 2013;29(5):638–44.
Calvano SE, Xiao W, Richards DR, Felciano RM, Baker HV, Cho RJ, Chen RO, Brownstein BH, Cobb JP, Tschoeke SK, et al. A networkbased analysis of systemic inflammation in humans. Nature. 2005;437(7061):1032.
Chou CH, Chang NW, Shrestha S, Hsu SD, Lin YL, Lee WH, Yang CD, Hong HC, Wei TY, Tu SJ, Tsai TR. miRTarBase 2016: updates to the experimentally validated miRNAtarget interactions database. Nucleic acids research. 2016;44(D1):23947.
Chen Q, Zhe Z, Lan W, Zhang R, Wang Z, Luo C, Chen YPP. Identifying miRNAdisease association based on integrating miRNA topological similarity and functional similarity. Quant Biol. 2019;7(3):202–9.
Lan W, Wang J, Li M, Liu J, Wu FX, Pan Y. Predicting micrornadisease associations based on improved microrna and disease similarities. IEEE/ACM Trans Comput Biol Bioinf. 2016;15(6):1774–82.
Baldrich P, Campo S, Wu MT, Liu TT, Hsing YIC, Segundo BS. Micrornamediated regulation of gene expression in the response of rice plants to fungal elicitors. RNA Biol. 2015;12(8):847–63.
Zhang X, Cheng W, Listgarten J, Kadie C, Huang S, Wang W, Heckerman D. Learning transcriptional regulatory relationships using sparse graphical models. PLoS ONE. 2012;7(5):35762.
Lehner B, Crombie C, Tischler J, Fortunato A, Fraser AG. Systematic mapping of genetic interactions in caenorhabditis elegans identifies common modifiers of diverse signaling pathways. Nat Genet. 2006;38(8):896.
Kamada T, Kawai S, et al. An algorithm for drawing general undirected graphs. Inf Process Lett. 1989;31(1):7–15.
Mahadik K, Wright C, Zhang J, Kulkarni M, Bagchi S, Chaterji S. Sarvavid: a domain specific language for developing scalable computational genomics applications. In: Proceedings of the 2016 international conference on supercomputing, p. 34 2016.
Kim SG, Harwani M, Grama A, Chaterji S. Epdnn: a deep neural networkbased global enhancer prediction algorithm. Sci Rep. 2016;6:38433.
Funding
This work is supported in part by the NIH R01 Grant 1R01AI123037, a Lilly Endowment grant, and funding from Purdue’s College of Engineering and Department of Agricultural and Biological Engineering (ABE). Any opinions, findings, and conclusions or recommendations expressed in this paper are those of the authors and do not necessarily reflect the views of the funding agencies.
Author information
Authors and Affiliations
Contributions
M.R., P.J., J.K., S.C. participated in the computational analyses and wrote the manuscript. S.C. provided overall guidance and funding for the project. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Additional file 1.
MiRNAgene comodules.
Additional file 2.
Comodule analysis.
Additional file 3.
Synthetic data generation.
Additional file 4.
Distribution of sizes of spatial miRNA clusters and GO terms.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Roth, M., Jain, P., Koo, J. et al. Simultaneous learning of individual microRNAgene interactions and regulatory comodules. BMC Bioinformatics 22, 237 (2021). https://doi.org/10.1186/s12859021041512
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12859021041512
Keywords
 Clustering
 Bioinformatics
 Regulatory comodules
 miRNAgene interaction