 Research
 Open Access
 Published:
Markov chain Monte Carlo for active module identification problem
BMC Bioinformatics volume 21, Article number: 261 (2020)
Abstract
Background
Integrative network methods are commonly used for interpretation of highthroughput experimental biological data: transcriptomics, proteomics, metabolomics and others. One of the common approaches is finding a connected subnetwork of a global interaction network that best encompasses significant individual changes in the data and represents a socalled active module. Usually methods implementing this approach find a single subnetwork and thus solve a hard classification problem for vertices. This subnetwork inherently contains erroneous vertices, while no instrument is provided to estimate the confidence level of any particular vertex inclusion. To address this issue, in the current study we consider the active module problem as a soft classification problem.
Results
We propose a method to estimate probabilities of each vertex to belong to the active module based on Markov chain Monte Carlo (MCMC) subnetwork sampling. As an example of the performance of our method on real data, we run it on two gene expression datasets. For the first manyreplicate expression dataset we show that the proposed approach is consistent with an existing resamplingbased method. On the second dataset the jackknife resampling method is inapplicable due to the small number of biological replicates, but the MCMC method can be run and shows high classification performance.
Conclusions
The proposed method allows to estimate the probability that an individual vertex belongs to the active module as well as the false discovery rate (FDR) for a given set of vertices. Given the estimated probabilities, it becomes possible to provide a connected subgraph in a consistent manner for any given FDR level: no vertex can disappear when the FDR level is relaxed. We show, on both simulated and real datasets, that the proposed method has good computational performance and high classification accuracy.
Background
Integrative network approaches are commonly used for interpretation of highthroughput data [1]. Such methods are applied in many different contexts: in genomewide association studies [2], for elucidating mechanisms of metabolic regulation [3], for analysis of somatic mutations in cancer [4], etc. The main idea of these methods is that considering internal connections (for example, between proteins, metabolites or other entities) can lead to deeper understanding of the data and the corresponding biological processes.
The connectivity information could be used in multiple ways. The simplest analysis could involve manual exploring of connections between the input signals [5]. More sophisticated methods include using connections for gene set enrichment analysis [6], comparing networks [7] and many others.
One of the most welldeveloped and used approaches consists of selecting a connected subnetwork that best represents an active or functional module. This concept was initially suggested by Ideker et al. [8]. The authors proposed a metric to score subnetworks based on gene expression data with a heuristic method jActiveModules to find the topscoring networks. Since then, multiple methods for solving this active module identification problem were developed. One of the most notable methods, called BioNet, was proposed by Dittrich et al. [9]. They suggested using a maximumlikelihoodinspired subnetwork scoring scheme such that finding the best scoring subnetwork corresponds to solving the MaximumWeight Connected Subgraph (MWCS) problem. While the problem is NPhard, in the same paper a practical exact solver was proposed. Maximumlikelihood inspired formulation combined with an exact solver for the corresponding problem allowed to achieve great performance on both simulated and real data, in particular showing much better precision and recall values compared to jActiveModules. According to the recent review [10] jActiveModules and BioNet remain the two mostused methods for the active module problem.
A question that is not usually addressed in the existing methods for solving the active module identification problem is the level of confidence of individual vertex inclusion. By design, in the resulting networks vertices with high individual significance are connected via less significant vertices. This raises the question whether vertices included in the module are more important compared to vertices with similar individual significance that are not included in the module. This is particularly important when an individually nonsignificant vertex is included in the module. Uncertainty in this aspect can lead to misinterpretation of the data either by attributing importance to false vertices or missing key vertices.
Previously Beisser et al [11] suggested a jackknife resampling approach where the active module problem is solved multiple times for resampled input data. It allows to introduce support values: how many times a particular vertex or edge was a part of the solution for the resampled data. The calculated support values can be then used to distinguish robust signals from noise in the resulting module. However, this method is limited to experiments with a large number of replicates and can not be applied for smallscale experiments.
The way different module confidence thresholds are handled is another problem of binary methods like BioNet. For example, a module of higher confidence could contain vertices not present in a module of lower confidence. Since in a realcase scenario several confidence thresholds are considered, such inconsistencies impede the interpretation of the results. To address this issue, previously [12] we considered a problem of connectivitypreserving vertex ranking – a ranking with the constraints that: 1) each prefix of the ranking should induce a connected subgraph, and 2) smaller induced subgraphs correspond to more confident modules. In that paper we proposed a semiheuristic ranking method that was better (as measured by the area under the ROC curve, AUC ROC) compared to both baseline vertex ranking by individual input significance and ranking from multiple BioNet runs with different thresholds.
In the current study we consider the active module identification problem as a soft vertex classification problem. In this case, instead of providing a hard classification of vertices into either being in the module or not, we estimate probabilities of each vertex to belong to the active module. To estimate these probabilities we propose a method that is based on Markov chain Monte Carlo (MCMC) module sampling from a posteriori distribution. First, by producing the vertex probabilities, this approach directly resolves the question of individual vertex confidence. Moreover, we show that the estimated probabilities can be used to calculate expected AUC ROC of any ranking and thus the problem of finding the best connectivitypreserving ranking can be defined constructively. We prove that this problem is NPcomplete, but show that in practice it can be solved accurately and efficiently using a heuristic algorithm. Finally, we show that the method can achieve high classification accuracy on simulated data and works well on real data.
Formalization of the active module problem in terms of soft classification
For the sake of clarity in this paper we formulate the active module problem in terms of proteinprotein interaction networks together with gene expression data. We formalize the proteinprotein interaction network as a graph G, where vertices correspond to proteinencoding genes, and two vertices are linked by an edge if the corresponding proteins interact. Gene expression data are given for sets of samples for two biological conditions of interest (e.g. control and treatment), so that differential expression pvalues can be calculated for each gene. While for some genes the null hypothesis of having zero expression change between conditions is true, and so the corresponding pvalues are uniformly distributed on [0,1], pvalues for “interesting” genes that exhibit a difference in expression would tend to be closer to zero. According to [8], those interesting genes form a connected subgraph in G, which is called an active (or functional) module.
Betauniform mixture model
As shown in [9,13], the distribution of all pvalues can be approximated by the socalled betauniform mixture (BUM) distribution, where the beta component corresponds to a signal in the data, and the uniform component corresponds to noise. Let us recall that the beta distribution has support [0,1] and is defined by its density
where the Beta function. The BUM distribution is a mixture of uniform and beta β(a,1) distributions and is defined by its density
where λ is the mixture weight of the uniform component and a is the shape parameter of the beta distribution.
We assign a weight w(v) to each vertex v of the graph G equal to the pvalue assigned to the corresponding gene. Thus, in our model we have: a connected graph G on n=G vertices, its connected subgraph \({\mathcal {M}}\), a family of independent random variables W_{v}, \(v \in V(G)\setminus V({\mathcal {M}})\) with uniform distribution on [0,1], and a family of independent random variables W_{v}, \(v \in V({\mathcal {M}})\) with β(a,1) distribution.
MCMC approach
Our goal is to find out which vertices are likely to belong to the active module M:
Problem 1
(Soft Classification Active Module Problem, SCAMP) Given a connected graph G and vertex weights w_{v}∈[0,1] find the probability \(P(v \in {\mathcal {M}} \mid W = w)\) for each vertex v to belong to the module \({\mathcal {M}}\).
We solve this problem in the following way. We generate a large sample \(\mathbb {S}\) of random subgraphs S from conditional distribution \(P(S = {\mathcal {M}} \mid W = w)\) using the Metropolis–Hastings algorithm (see “Methods” section). While all the probabilities \(P(S = {\mathcal {M}} \mid W = w)\) are small and the multiplicity of each subgraph in \(\mathbb {S}\) is small, the probabilities of each vertex to belong to the module are cumulative statistics and show robust behavior. The same holds for the probabilities \(P(V \subset {\mathcal {M}} \mid W = w)\), where V are relatively small sets of vertices.
The benefits of the soft classification approach are:

1
it allows to estimate the level of confidence that a particular gene is expressed differently, which is the probability that a corresponding vertex belongs to the active module;

2
it allows to analyze alternative complement pathways by studying probabilities of the form \(P((V_{1} \subset {\mathcal {M}}) \lor \left (V_{2} \subset {\mathcal {M}}\right) \mid W = w)\);

3
for any set of genes V reported as differently expressed, our method allows to compute the false discovery rate (FDR) as \({\frac {1}{V}\sum _{v \in V}P(v \not \in {\mathcal {M}} \mid W = w)}\);

4
it provides a vertex ranking that maximizes the area under the ROC curve (AUC ROC) (see “Features of soft classification solution” section);

5
it allows to heuristically find a vertex connectivity preserving ranking that maximizes the AUC ROC (see “Connectivity preserving ranking” section).
Methods
Markov chain Monte Carlo based method
We solve Problem 1 in the following way: we sample a set \(\mathbb {S}\) of random subgraphs S from conditional distribution \(P(S = {\mathcal {M}} \mid W = w)\) using the Markov chain Monte Carlo (MCMC) approach, and estimate \({P(v \in {\mathcal {M}} \mid W=w)}\) as
First, we estimate the betauniform mixture parameters a and \(\lambda = 1  \frac {{\mathcal {M}}}{G}\) with a maximumlikelihood estimator [14].
For MCMC sampling we implement the MetropolisHastings algorithm [15]. It starts at a random subgraph S_{0} of order \(k={\mathcal {M}} = \left (1\lambda \right) G\). On each step i we choose a candidate subgraph S^{′} by removing a vertex v_{−} from S_{i} and adding another vertex v_{+} from the neighborhood of S_{i} (by neighborhood of a subgraph S we mean the set of all vertices of G at distance 1 from S). We note that the subgraph S^{′} always has the same number of vertices k as S_{0}. The proposal probability Q(S^{′}S_{i}) is
We set the acceptance probability in the MetropolisHastings algorithm as
where \(P\left (S'={\mathcal {M}} \mid W = w\right) = 0 \) as soon as S^{′} is not connected.
For any connected subgraph S of G the value \(P\left (S'={\mathcal {M}} \mid W = w\right)\) can be expressed in terms of probability density p of an absolutely continuous random vector variable W:
So,
The fraction \(\frac {p\left (w \mid S'={\mathcal {M}}\right)}{p\left (w \mid S_{i}={\mathcal {M}}\right)}\) is equal to
where L(S) is the likelihood of the subgraph S. In our case
so, we have:
Assuming that the prior distribution of choosing the module \(P(S={\mathcal {M}})\) is uniform^{1} on the set of connected subgraphs S of the same order \({\mathcal {M}}\), we get
The proposed MCMC algorithm can visit all possible subgraphs S, and so it converges to the distribution \(P(S={\mathcal {M}} \mid W = w)\).
Heuristic approach to arbitrary module order
Since on the real data the estimated order of an active module has a tendency to be too large (1−λ is up to 0.5), we adjust our method in order to allow to change the number of vertices in the subgraph during the MCMC process. In this approach on each step of the process one can either add one vertex to the subgraph or remove one vertex from it. In order to provide subgraphs of biologically relevant size, we penalize each additional vertex by a factor aτ^{a−1}, where τ is some confidence threshold as described in [9]. More formally, it means that we consider such a prior distribution on subgraphs that \(\frac {P(S={\mathcal {M}})}{P(S_{+}={\mathcal {M}})} = a \tau ^{a1}\), where S_{+} is an induced subgraph on the vertices V(S)∪{v_{+}}. Thus our heuristic approach is very similar to Algorithm 1, but
where
For estimating probabilities \(P(v \in {\mathcal {M}} \mid W=w)\) we need to choose a set of subgraph samples \(\mathbb {S}\). Here we consider two ways of doing this. For both ways we need to estimate the mixing time T of the algorithm: the number of Markov chain iterations such that the distribution of S_{T} approximates the target distribution well. We note that theoretically the Markov chain converges to the desired distribution since it is ergodic: it is recurrent (since the number of states is finite), it is aperiodic (since there is a positive probability that the process stays at the same state), and it is irreducible since by construction it can reach any subgraph from any other subgraph. In practice, the mixing time depends on multiple parameters including the graph G order. The first way to choose \(\mathbb {S}\) is to do a number of independent MCMC runs of T iterations and add each S_{T} to \(\mathbb {S}\). Here, all samples in \(\mathbb {S}\) are independent, which can be used to calculate the accuracy of the vertex probabilities estimation. Another way consists in doing one long run of MCMC and putting all S_{i} for i>T into \(\mathbb {S}\). Although consecutive samples are not independent, the probabilities that are estimated this way converge to the true probabilities given sufficiently long series (see “Experiments on simulated data” section for discussion of the converging time on the simulated data).
Features of soft classification solution
Having the set \(\mathbb {S}\) of subgraphs sampled from the conditional distribution
one can easily answer the following questions. First, one can estimate for each vertex v_{i} the probability p_{i} that it belongs to the active module. In the case when the module size is not fixed, we can also estimate the conditional probabilities
Second, for any booleanvalued function \(A({\mathcal {M}})\) (for example, \(A({\mathcal {M}}) = (v_{1} \in {\mathcal {M}}) \lor \left (v_{2} \in {\mathcal {M}}\right) \land \neg (v_{3} \in {\mathcal {M}}))\) one can estimate the probability \(P(A({\mathcal {M}}) \mid W = w)\).
Note, that if each S from \(\mathbb {S}\) was generated with an independent MCMC run, then each A(S) can be considered to be a result of a Bernoulli trial. Thus, all such probabilities can be estimated with a mean square error of the order \(\frac {p(1p)}{\mathbb {S}}\), where \(p = P(A({\mathcal {M}})W=w)\).
We also show how the probabilities of each vertex to belong to the active module are related to the expected AUC ROC for some vertex ranking. For a vertex ranking \(v_{1}, v_{2}, \dots, v_{n}\), where n=G, and a module \({\mathcal {M}}\) of order m the ROC curve is a stepcurve in a square [0,1]×[0,1], which starts at (0,0), and on the ith step it goes either up \(\left (\frac {1}{m},0\right)\) (if \(v_{i} \in {\mathcal {M}}\)) or right \(\left (0,\frac {1}{nm}\right)\) (if \(v_{i} \not \in {\mathcal {M}}\)). The AUC ROC shows how accurate the classification is.
We prove the following lemma:
Lemma 1
Let n be the number of vertices in G, m be the number of vertices in the module \({\mathcal {M}}\), \(v_{1},v_{2}, \dots, v_{n}\) be some vertex ranking and p_{i} be the probabilities \(p_{i} = P(v_{i} \in {\mathcal {M}} \mid W=w)\). Then the expected value of the AUC ROC is equal to
Proof
See Section S1 in Appendix. □
Lemma 1 implies that the vertex ranking with the largest expected value of the AUC ROC is the ranking according to a descending order on p_{i} (for any particular module order m). If the number m of the vertices in the module is not known, the expected AUC ROC is equal to
where
and \(\mathbb {E}\) stands for the expected value.
We note that the probabilities pi′ can be estimated based on the sample \(\mathbb {S}\) or approximated by p_{i}.
Connectivity preserving ranking
While we provide the best solution for the soft classification problem in terms of the expected AUC ROC, one can be interested in getting the solution for the hard classification problem as well. Our method is easily transformable into a hard classification method. Namely, our goal is to define a module M(q) for any FDR level q in a consistent manner. That is, we don’t allow the situation when a vertex is included in a module with a small FDR level, but excluded from a module with a larger FDR (formally speaking, we demand that M(q_{1})⊂M(q_{2}) as soon as q_{1}<q_{2}). Any such family of modules M(q) corresponds to a connectivity preserving ranking.
Definition 1
For a graph G with vertices v_{i} the connectivity preserving ranking is such a ranking of v_{i} that for any kprefix \(v_{1},v_{2},\dots,v_{k}\) the induced graph on this set of vertices is connected.
We want to choose the best connectivity preserving ranking in terms of the expected value of the AUC ROC. Since the expected AUC ROC depends only on p_{i} (or their modified versions pi′), we can formulate the following problem:
Problem 2
(Optimal Connectivity Preserving Ranking, OCPR) Given a graph G and the list of its vertices v_{i}, each equipped with the probability p_{i}, find the connectivity preserving ranking maximizing the expected AUC ROC.
Lemma 2
OCPR problem is NPhard.
Proof
See Section S2 in Appendix. □
As Problem 2 is NPhard, here we provide a heuristic algorithm to solve it. On the kth step of the algorithm we have an integer number r_{k} and G_{k} – a connected subgraph of G (where r_{1}=n and G_{1}=G), and we define a connected subgraph G_{k+1} in the following way. For each vertex v we define a subgraph \(G^{(v)}_{k+1}\) as the largest connected component of G_{k}∖{v} and \(H^{(v)}_{k+1}\) as \(G_{k} \setminus G^{(v)}_{k+1}\). Then we choose such a vertex v that maximizes average FDR in \(H = H^{(v)}_{k+1}\), which is equal to \({\frac {1}{H}\sum _{u \in H}P(u \not \in {\mathcal {M}} \mid W = w)}\). Then we assign the rank r_{k} to all vertices in the subgraph H. The next rank r_{k+1} is then defined as r_{k}−H.
Each step requires time O(n^{2}), so the performance time is O(n^{3}). On our real data example, the running time was 13 seconds on Intel(R) Core(TM) i57200U CPU @ 2.50GHz (implemented in C++).
Baseline ranking methods
We compared our approach with three other ranking methods on simulated data in “Experiments on simulated data” section. The first method ranks vertices by the ascending order of their input weights w_{v}. In the second method vertices are ranked by the descending order of the number of occurrences in the modules as found by running the BioNet method with 20 different significance thresholds. The thresholds are selected to be distributed at equal intervals between maximum and minimum vertex loglikelihoods. The third method is a semiheuristic ranking method from [12] developed for finding a good connectivity preserving ranking. To describe it briefly, it first finds the maximumlikelihood connected subgraph and recursively ranks a set of vertices inside and outside of the subgraph. The recursion step also involves finding a maximumlikelihood connected subgraph but with constraint on consistent connectivity with already defined ranking.
Note that we do not compare our method with the jackknife resampling method [11] on simulated data as it requires simulating gene expression data, which can induce artificial biases in the evaluation. Instead, we compare our results with the results of this method on real data (see “Experimental results on real data” section).
Results and discussion
Experiments on simulated data
First, in order to show that our implementation is correct, we consider a toy example, for which the desired probabilities can be directly computed. We generated a random graph G on 30 vertices and 65 edges. Then we chose the active module \({\mathcal {M}}\) on 9 vertices randomly and generated the weights from the beta distribution β(0.2,1) for the vertices in \({\mathcal {M}}\) and from the uniform distribution for all other vertices. For such a toy example we can both compute the probabilities \(P(v \in {\mathcal {M}}W = w)\) directly from (1) and estimate them as \(\hat {P}(v \in {\mathcal {M}}W = w)\) using our MCMC approach. We run 10^{6} iterations of the MetropolisHastings algorithm. The estimations approximated the actual probabilities very accurately with rootmeansquare error equal to 2·10^{−3}. We also note that the ranking of vertices based on estimations \(\hat {P}(v \in {\mathcal {M}}W = w)\) was the same as the ranking based on true probabilities. For both actual and estimated probabilities the AUC ROC is equal to 0.92.
Second, we considered MCMC convergence on a realworld proteinprotein interaction graph. We used a graph with 2,034 vertices and 8,399 edges as constructed in [9] for a diffuse large Bcell lymphoma dataset. We chose an active module uniformly at random from connected subgraphs on 200 vertices. Weights of the vertices in the active module were generated from the beta distribution β(0.25,1). We considered the behavior of loglikelihood values for samples during one MCMC run (Fig. 1, green line). This plot shows that the loglikelihood value stabilizes after about 25,000 iterations. Thus, we can estimate the MCMC mixing time T as 25,000 for this case. We also checked that 25,000 iterations is sufficient for estimating vertex probabilities. For different values of T^{′} we calculated AUC values for rankings based on 1,000 independent runs of MCMC for T^{′} iterations (Fig. 1, red line). The results show that indeed 25,000 iterations is enough to achieve high AUC values, and the saturation phase begins even earlier. Lastly, we compared ranking for one long MCMC run and for 1,000 independent samples (Fig. 1, blue line). For one long run we estimated probabilities using all generated MCMC samples except the first 25,000. It can be seen that AUC values saturate after about 50,000 total MCMC iterations which justifies the usage of one long MCMC run. Practically, this means that good probability estimates can be achieved very fast, given that 100,000 MCMC iterations took about one minute on a laptop.
Finally, we compared our MCMCbased connectivity preserving ranking method with three other ranking methods (see “Baseline ranking methods” section) on simulated data. Here we considered random instances of sizes 100, 500 and 2,034, 50 instances of each size. For the cases with 100 and 500 vertices scalefree graphs were randomly generated for each instance, for 2,034 vertices the previosly constructed graph from the BioNet example was used. Then we generated active modules in two steps: 1) the number of the vertices in a module was uniformly selected from 5% to 25% of the original graph order and 2) a module was chosen uniformly at random from all connected subgraphs with the selected order. Vertex pvalues were generated from the betauniform mixture distribution with values of the parameter a selected from the [0.01,0.5] interval. The AUC measures for rankings produced by four tested methods are shown on Fig. 2. For all values of a our approach shows significantly better performance compared to all three baseline methods.
Experimental results on real data
Similarily to the BioNet paper [9] we applied our method to the diffuse large Bcell lymphoma dataset and the proteinprotein interaction graph constructed there. The pvalues in the diffuse large Bcell lymphoma (DLBCL) dataset were the result of a differential expression ttest between the two tumor subgroups: germinal center Bcelllike (GCB) DLBCL and activated Bcelllike (ABC) DLBCL. The estimated BUM distribution parameters were λ=0.48 and a=0.18. As described in Section “Heuristic approach to arbitrary module order” section, we penalized the addition of a new vertex to the module using the confidence threshold τ=10^{−7}.
The obtained module is shown on Fig. 3. The module shows the prefix of the ranking with FDR = 0.25. Additionally, we highlighted submodules of more strict FDR values: 0.15 and 0.05. Note that, by construction, a more strict module is a subgraph of a less strict one. The genes in the modules are mostly known to be associated with cancer. For example, genes BCL2, BMF, CASP3, PTK2 and WEE1 are involved in the cell apoptosis pathway. Some other genes, like LYN or KCNA3, are associated with proliferation and signalling in hematopoietic cells. Additionally, we compared our result to one obtained by the jackknife resampling procedure as described in [11] with 100 resamples and the same threshold of τ=10^{−7}. Resampling support values are consistent with MCMCbased probabilities (see Appendix).
Finally, we applied our method to hypoxia induced gene expression changes in neural stem cells (GSE80070) [16]. There we calculated differential expression between normoxia and hypoxia conditions in cortex primary cells and used differential expression pvalues as an input to our algorithm. The input graph is a graph of proteinprotein interaction derived from the InWeb network [17]. After removing proteins with more than 250 connections, selecting only the expressed genes, and selecting the largest connected component, we obtained a graph of 8,807 vertices and 103,933 edges. As a result of our method we have obtained a ranking, the top vertices subgraph from which is shown on Fig. 4. The module includes many known hypoxiarelated genes, such as genes from the glycolysis pathway: TPI1, PGM2, LDHA, and, in particular, HIF1A – a known master regulator of cellular response to hypoxia, appearing at the core of the module.
For this dataset known hypoxiarelated gene sets can be used as an approximation of the ground truth. Formally, we use a union of REACTOME_CELLULAR_RESPONSE_TO_HYPOXIA and HALLMARK_HYPOXIA gene sets from MSigDB [18] as our reference hypoxia pathway. With an approximation of the ground truth set known we were able to calculate quality metrics and compare them to other methods. For the comparison we used ranking by the nominal differential expression pvalue, individual solutions by the BioNet method for different thresholds (the jackknife extension of BioNet is not applicable in this case, since the comparison is performed between groups of three biological replicates each), and individual subgraphs found by jActiveModules [8]. Confirming the results from [9] we show that jActiveModules solutions are dominated by BioNet solutions both in terms of true positive rate vs false positive rate and precision vs recall (Fig. 5). Our method, BioNet and pvalue ranking are showing comparable performance, with our method showing marginally better ranking performance in terms of AUC PR (0.191 vs 0.187 for pvalue ranking) and significantly better performance in terms of AUC ROC (0.731 vs 0.668 for pvalue ranking).
Additionally, we systematically tested our method on a collection of human gene expression datasets based on [19]. We analyzed 59 datasets, where for each dataset a relevant KEGG disease pathway (“target” pathway) is known, so that AUC ROC and AUC PR metrics can be calculated. As a baseline we used Pvaluebased and BioNetbased ranking, as described previously. For the AUC ROC metric, our method was better than BioNetbased ranking in 52 cases, and better than Pvalue based rakning in 55 cases. Similarly, for the AUC PR metric our method was better in 49 cases compared to BioNet and in 53 cases compared to Pvalue based ranking. The full results are available in Supplementary Materials, Table S4. However, we note that these results should be taken with caution, as all the methods performed poorly in terms of the AUC PR metric (with median value around 0.01). This means that these target pathways are far from perfect ground truth approximations, which highlights the importance of developing better benchmarking datasets.
While jackknife resampling support values [11] are consistent with our MCMCbased probabilities for the DLBCL dataset, they are not available for the hypoxia dataset and other datasets with small number or replicates. Thus, our approach has two major advantages compared to the jackknife method. First, our method is more flexible: it starts with pvalues and can be used even for experiments with a small number of replicates, where resampling is not feasible. Second, calculating individual vertex probabilities does not involve solving NPhard problems and can be easily done in practice without dependency on external solver libraries like IBM ILOG CPLEX. Even the NPhard problem of finding the AUC ROC optimal connectivity preserving ranking can be solved well on real data with the heuristic algorithm.
Conclusion
While the active module identification problem was intensively studied in recent years, most of the approaches solve it as a hard classification problem. Here we study the question of assigning confidence values for individual vertices and thus consider a soft classification problem. All the hard classification methods could only provide a blackbox which tells us whether a particular gene belongs to the active module or not, and so, by design, they all have a flaw: they don’t provide any way to distinguish between more and less confident inclusions. The soft classification approach addresses this issue.
We propose a method to estimate probabilities of each vertex to belong to the active module based on Markov chain Monte Carlo sampling. Based on these probabilities, for any given FDR level we can provide a solution to the hard classification problem in a consistent manner: a module for a more strict FDR level is a subgraph of any module for a more relaxed FDR level. Overall, the proposed approach is very flexible: it starts with pvalues, and thus can be used in many different contexts, and does not depend on external libraries for solving NPhard problems.
Endnotes
^{1} Since we do not make any additional assumptions about the module, the uniform distribution on subgraphs of equal order is the best choice of the prior distribution.
Appendix
S1
In this section we prove Lemma 1.
Proof
First of all, we introduce a rotated notnormalized ROC curve (Fig. 6). On the ith step this curve goes either up \(\left (\frac {\sqrt {2}}{2},\frac {\sqrt {2}}{2}\right)\) (if v_{i}∈M) or down \(\left (\frac {\sqrt {2}}{2},\frac {\sqrt {2}}{2}\right)\) (if v_{i}∉M).
This linear transformation of the ROC curve is a function, so one can find not only the expected value of the area under it, but its pointwise expected value as well. Let its height at the point \(\frac {i\sqrt {2}}{2}\) be h_{i}. Then the expected value of h_{i+1}−h_{i} is \(\frac {2p_{i}1}{\sqrt {2}}\). The area under the (original) ROC curve (up to the factor m(n−m)) is equal to the area under the rotated ROC curve plus the area of the quadrilateral AECD. The area of AECD is equal to the area of ABCD (which is equal to m(n−m)) minus the area of ABF (which is equal to \(\frac {m^{2}}{2}\)) plus the area of CEF (which is equal to \(\frac {(n2m)^{2}}{4}\)). Thus, we obtian:
After normalization we obtain
□
S2
In this section we prove Lemma 2.
Proof
To prove that OCPR is NPcomplete, we will use a modification of the method for proving that the Steiner tree problem in graphs is NPcomplete. The referenced method is described in [20].
In decisional form, OCPR is equivalent to:
OCPR (decisional). Given a graph G, the list of its vertices v_{i}, each equipped with the probability p_{i}, and a real number k, determine if there is a connectivity preserving ranking v_{1},v_{2},…,v_{n} such that \(\sum \limits _{i=1}^{n} ip_{i} \le k\).
First, we need to show that OCPR is in NP. Given an hypothetic positive solution v_{1},v_{2},…,v_{n}, it is trivial to check in polynomial time that this ranking is connectivity preserving and \(\sum \limits _{i=1}^{n} ip_{i} \le k\) holds.
The Exact Cover by 3Sets problem (X3C) is a wellknown NPcomplete problem mentioned in [21]:
Problem X3C. Given a finite set X with X=3q and a collection C of 3element subsets of X (C={C_{1},…,C_{n}}, C_{i}⊆X, C_{i}=3 for 1≤i≤n), determine if C contains an exact cover for X, that is, a subcollection C^{′}⊆C such that every element of X occurs in exactly one member of C^{′}?
Let us propose a reduction from X3C to OCPR giving a set of rules to build an instance of OCPR starting from a generic instance of X3C. If we prove that this transformation is executable in polynomial time, we will also prove that OCPR is NPcomplete. Given an instance of X3C, defined by the set X={x_{1},…,x_{3q}} and a collection of 3element sets C={C_{1},…,C_{n}}, we have to build an OCPR instance specifying the graph G=(V,E), the probabilities p_{i}, and the upper bound on the required sum k.
The vertices of G are defined as:
That is, we add a new node v, a node for each member of C, and a node for each element of X.
The edges of G are defined as:
That is, there is an edge from v to each node c_{i}, and an edge c_{i}x_{j} if the element x_{j} belongs to the set C_{i} of the X3C instance.
Let \(\varepsilon = \frac {1}{12q(q+1)}\). The probabilities p_{i} are defined as:
and the upper bound on the required sum is defined as \(k = \frac {3}{2}\).
The reduction from X3C to OCPR is easy to do in polynomial time.
Proposition 1
There exists a connectivity preserving ranking with \(\sum \limits _{i=1}^{n} ip_{i} \le k\) if and only if there is an exact cover in the corresponding instance of X3C. □
Proof. We split the proof into two parts, one for each implication.

X3C ⇒ OCPR Suppose there is an exact cover C^{′} for the X3C problem. Clearly, C^{′} uses exactly q subsets. Without loss of generality suppose they are C_{1},…,C_{q} (if it is not the case, we just have to relabel them). Then a valid connectivity preserving ranking looks as follows:
$$\begin{aligned} &v,\\ &c_{1}, x_{t_{1}}, x_{t_{2}}, x_{t_{3}},\\ &c_{2}, x_{t_{4}}, x_{t_{5}}, x_{t_{6}},\\ &\ldots,\\ &c_{q}, x_{t_{3q2}}, x_{t_{3q1}}, x_{t_{3q}},\\ &c_{q+1}, c_{q+2}, \ldots, c_{n}, \end{aligned} $$where every C_{i} consists of elements \(x_{t_{3i2}}, x_{t_{3i1}}, x_{t_{3i}}\). Then:
$$\begin{aligned} \sum\limits_{i=1}^{n} ip_{i} = 1 + (3 + 4 +& 5 + 7 + 8 + 9 + \ldots + (4q  1) + 4q + (4q + 1)) \varepsilon =\\ &= 1 + 6 q (q+1) \varepsilon = \frac{3}{2} = k. \end{aligned} $$ 
X3C ⇐ OCPR Suppose there is a connectivity preserving ranking with \(\sum \limits _{i=1}^{n} ip_{i} \le k\). Since k<2 and p_{v}=1, the first vertex in this ranking must be v. Let \(x_{t_{1}}, x_{t_{2}}, \ldots, x_{t_{3q}}\) be the order the vertices corresponding to the X3C instance elements appear in this ranking. For every j, vertex v and at least \(\left \lceil \frac {j}{3} \right \rceil \) vertices corresponding to 3element sets of the X3C instance must appear before vertex \(x_{t_{j}}\) in the ranking, since every vertex c_{i} appearing in the ranking opens the way for at most three new vertices x_{j} to appear afterwards. Hence, the earliest position vertex \(x_{t_{j}}\) might appear at in the ranking is \(j + 1 + \left \lceil \frac {j}{3} \right \rceil \). But if every \(x_{t_{j}}\) does appear at its earliest possible position, then, like in the former case,
$$\begin{aligned} \sum \limits_{i=1}^{n} ip_{i} = 1 + (3 + 4 + 5 +& 7 + 8 + 9 + \ldots + (4q  1) + 4q + (4q + 1)) \varepsilon =\\ & = 1 + 6 q (q+1) \varepsilon = \frac{3}{2} = k. \end{aligned} $$If any vertex \(x_{t_{j}}\) appears at a later position, its index in the ranking will increase, the sum of ip_{i} will increase and exceed k (since the sum of ip_{i} is already equal to k and \(p_{x_{t_{j}}} > 0\)). Therefore, every vertex \(x_{t_{j}}\) must appear at position \(j + 1 + \left \lceil \frac {j}{3}\right \rceil \), and the ranking looks like in the former case, too:
$$\begin{aligned} &v,\\ &c_{1}, x_{t_{1}}, x_{t_{2}}, x_{t_{3}},\\ &c_{2}, x_{t_{4}}, x_{t_{5}}, x_{t_{6}},\\ &\ldots,\\ &c_{q}, x_{t_{3q2}}, x_{t_{3q1}}, x_{t_{3q}},\\ &c_{q+1}, c_{q+2}, \ldots, c_{n}. \end{aligned} $$It’s easy to prove that \(x_{t_{3i2}}\), \(x_{t_{3i1}}\) and \(x_{t_{3i}}\) belong to C_{i} using induction on i from 1 to q. Hence, C^{′}={C_{1},C_{2},…,C_{q}} is an exact cover for the X3C instance.
This concludes the proof.
S3
In this section we compare our method and the jackknife resampling method described in [14]. We apply our method and the jackknife resampling method to the diffuse large Bcell lymphoma dataset and the proteinprotein interaction graph constructed in [9]. The pvalues in the DLBCL dataset are the result of a differential expression ttest between the two tumor subgroups: germinal center Bcelllike (GCB) DLBCL and activated Bcelllike (ABC) DLBCL. In our method we penalized adding a new vertex to the module using the confidence threshold τ=10^{−7}. For the jackknife method the pvalues are recalculated for each of 100 data resamples and then for each collection of the pvalues the active module identification problem is solved with BioNet (with the same threshold τ=10^{−7}). As the result of this procedure, for each vertex the support value (the occurrence frequency of the vertex in the solution) is computed. As one can see (Fig. 7), the results of these two methods are consistent.
Availability of data and materials
All of our source code is available at GitHub repository, https://github.com/ctlab/mcmcRanking.
Abbreviations
 ABC:

activated Bcell
 AUC:

area under the ROC curve
 BUM:

betauniform mixture
 DLBCL:

diffuse large Bcell lymphoma
 FDR:

false discovery rate
 GCB:

germinal center Bcell
 MCMC:

Markov chain Monte Carlo
 NP:

nondeterministic polynomial time
 OCPR:

optimal connectivity preserving ranking
 ROC:

receiver operating characteristic
 X3C:

exact cover by 3Sets problem
References
Mitra K, Carvunis AR, Ramesh SK, Ideker T. Integrative approaches for finding modular structure in biological networks. Nat Rev Genet. 2013; 14(10):719–32.
Rossin EJ, et al. Proteins encoded in genomic regions associated with immunemediated disease physically interact and suggest underlying biology. PLoS Genet. 2011; 7(1):e1001273.
Jha AK, Huang SC, Sergushichev A, Lampropoulou V, Ivanova Y, Loginicheva E, et al. Network integration of parallel metabolic and transcriptional data reveals metabolic modules that regulate macrophage polarization. Immunity. 2015; 42(3):419–30.
Leiserson MD, et al. Pancancer network analysis identifies combinations of rare somatic mutations across pathways and protein complexes. Nat Genet. 2015; 47(2):106–14.
Karnovsky A, Weymouth T, Hull T, Tarcea VG, Scardoni G, Laudanna C, et al.Metscape 2 bioinformatics tool for the analysis and visualization of metabolomics and gene expression data. Bioinformatics. 2012; 28(3):373–80.
Alexeyenko A, Lee W, Pernemalm M, Guegan J, Dessen P, Lazar V, et al.Network enrichment analysis: extension of geneset enrichment analysis to gene networks. BMC Bioinformatics. 2012; 13:226.
Ideker T, Krogan NJ. Differential network biology. Mol Syst Biol. 2012; 8:565.
Ideker T, Ozier O, Schwikowski B, Siegel AF. Discovering regulatory and signalling circuits in molecular interaction networks. Bioinformatics (Oxford, England). 2002; 18 Suppl 1:S233–S240.
Dittrich MT, Klau GW, Rosenwald A, Dandekar T, Müller T. Identifying functional modules in proteinprotein interaction networks: an integrated exact approach. Bioinformatics (Oxford, England). 2008; 24(13):i223–31.
Nguyen H, Shrestha S, Tran D, Shafi A, Draghici S, Nguyen T. A Comprehensive Survey of Tools and Software for Active Subnetwork Identification. Front Genet. 2019; 10:155.
Beisser D, Brunkhorst S, Dandekar T, Klau GW Dittrich MT, Muller T. Robustness and accuracy of functional modules in integrated network analysis. Bioinformatics. 2012; 28(14):1887–1894.
Isomurodov JE, Loboda AA, Sergushichev AA. Ranking vertices for active module recovery problem. In: International Conference on Algorithms for Computational Biology. Cham: Springer: 2017. p. 75–84.
Pounds S, Morris SW. Estimating the occurrence of false positives and false negatives in microarray studies by approximating and partitioning the empirical distribution of pvalues. Bioinformatics. 2003; 19(10):1236–42.
Beisser D, Klau GW, Dandekar T, Muller T, Dittrich MT. BioNet: an RPackage for the functional analysis of biological networks. Bioinformatics. 2010; 26(8):1129–30.
Hastings WK. Monte Carlo sampling methods using Markov chains and their applications. Biometrika. 1970; 57(1):97–109.
Braunschweig L, Meyer AK, Wagenfuhr L, Storch A. Oxygen regulates proliferation of neural stem cells through Wnt/betacatenin signalling. Mol Cell Neurosci. 2015; 67:84–92.
Li T, Wernersson R, Hansen RB, Horn H, Mercer J, Slodkowicz G, et al.A scored human proteinprotein interaction network to catalyze genomic interpretation. Nat Methods. 2017; 14(1):61–64.
Subramanian A, Tamayo P, Mootha VK, Mukherjee S, Ebert BL, Gillette MA, et al.Gene set enrichment analysis: a knowledgebased approach for interpreting genomewide expression profiles. Proc Natl Acad Sci U S A. 2005; 102(43):15545–50.
Nguyen TM, Shafi A, Nguyen T, Draghici S. Identifying significantly impacted pathways: a comprehensive review and assessment. Genome Biol. 2019; 20(1):203.
Santuari A. Steiner tree NPcompleteness proof. Technical report, University of Trento; 2003.
Garey MR, Johnson DS. Computers and Intractability: A Guide to the Theory of NPCompleteness. W.H. Freeman and Company; 1979.
Acknowledgements
The authors thank Artem Vasilyev and Alexander Loboda for fruitful discussions.
About this supplement
This article has been published as part of BMC Bioinformatics Volume 21 Supplement 6, 2020: Selected articles from the 15th International Symposium on Bioinformatics Research and Applications (ISBRA19): bioinformatics. The full contents of the supplement are available online at https://bmcbioinformatics.biomedcentral.com/articles/supplements/volume21supplement6.
Funding
The work of JI and AS was supported by the Ministry of Education and Science of the Russian Federation (agreement 2.3300.2017). The work of NA was financially supported by the Government of the Russian Federation through the ITMO Fellowship and Professorship Program. Publication costs are funded by the Government of the Russian Federation through the ITMO Fellowship and Professorship Program. The funding bodies did not play any role in the design of the study, the collection, analysis, and interpretation of the data, or in writing the manuscript.
Author information
Authors and Affiliations
Contributions
NA, JI, and AS contributed equally to the method design and preparation of the manuscript. VS performed comparison analysis. GK provided a proof that OCPR problem is NPhard. All author(s) read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Alexeev, N., Isomurodov, J., Sukhov, V. et al. Markov chain Monte Carlo for active module identification problem. BMC Bioinformatics 21 (Suppl 6), 261 (2020). https://doi.org/10.1186/s12859020035729
Published:
DOI: https://doi.org/10.1186/s12859020035729
Keywords
 Proteinprotein interaction
 Active module
 Markov chain Monte Carlo
 Gene expression
 Soft classification