 Methodology Article
 Open Access
 Published:
Efficient randomization of biological networks while preserving functional characterization of individual nodes
BMC Bioinformaticsvolume 17, Article number: 542 (2016)
Abstract
Background
Networks are popular and powerful tools to describe and model biological processes. Many computational methods have been developed to infer biological networks from literature, highthroughput experiments, and combinations of both. Additionally, a wide range of tools has been developed to map experimental data onto reference biological networks, in order to extract meaningful modules. Many of these methods assess results’ significance against null distributions of randomized networks. However, these standard unconstrained randomizations do not preserve the functional characterization of the nodes in the reference networks (i.e. their degrees and connection signs), hence including potential biases in the assessment.
Results
Building on our previous work about rewiring bipartite networks, we propose a method for rewiring any type of unweighted networks. In particular we formally demonstrate that the problem of rewiring a signed and directed network preserving its functional connectivity (Frewiring) reduces to the problem of rewiring two induced bipartite networks. Additionally, we reformulate the lower bound to the iterations’ number of the switchingalgorithm to make it suitable for the Frewiring of networks of any size. Finally, we present BiRewire3, an opensource Bioconductor package enabling the Frewiring of any type of unweighted network. We illustrate its application to a case study about the identification of modules from gene expression data mapped on protein interaction networks, and a second one focused on building logic models from more complex signeddirected reference signaling networks and phosphoproteomic data.
Conclusions
BiRewire3 it is freely available at https://www.bioconductor.org/packages/BiRewire/, and it should have a broad application as it allows an efficient and analytically derived statistical assessment of results from any network biology tool.
Background
Representing and modeling biological processes as networks, in particular signaling and gene regulatory relations, is a widely used practice in bioinformatics and computational biology. This bridges these research fields to the vast repertoire of tools and formalisms provided by graph and complexnetworktheory. Furthermore, this facilitate an integrative analysis of experimental observations, either by derivation of networks from the data, or by mapping the latter on the former. Hence, networkbased approaches have become a popular paradigm in computational biology [1, 2].
In the last few years this has allowed the design of a broad assortment of algorithms and tools whose aim ranges from providing an interpretative framework for the modeled biological relations, to the identification of networkmodules able to explain phenotypic traits and experimental data from large reference signaling graphs [3, 4]. Many methods in this last class aim at identifying a subnetwork, for example, that is composed by the most differentially expressed or significantly mutated genes [5–9], or that it is targeted by a given external perturbation [10–14]. Toward this aim different optimization procedures have been used to analyze experimental data, identifying a pathway that is deregulated in a given disease, or whose activity is perturbed upon a given drug treatment.
In many approaches, directed signed networks (DSNs, formally defined in the following sections) are used to model pathways and to interlink pathways from a given collection. In these networks, nodes represent biological entities (typically proteins) while edges represent the biological relationships between them (e.g., the activity of protein A affects that of protein B). These edges have a direction to discriminate effectors and affected nodes in a modeled relation, and a sign to specify whether the modeled relation is an activation (positive sign) or an inhibition (negative sign). Unsigned/undirected edges modeling generic interactions can be also present. When available, sign and direction allow a more detailed detection of the nature of the interaction between the nodes. In this study, the number, sign and direction of a node’s connections are cumulatively denoted by the functional characterization level (FCL) of the corresponding modeled biological entity (from now entity).
In a reference network modeling a set of interlinked pathways or proteinproteininteractions, the FCL might be high for a node that models a functional hub. For example a kinase phosphorylating a large number of substrate proteins will have a high number of outgoing edges with positive sign. Similarly, a gene activated by a large number of transcription factors will have a high number of positive incoming edges. On the other hand the FCL might be strongly biased by the relevance of a biological entity in a given research field, and the resource the network has been assembled from. For example, in a cancer focused reference network it is reasonable to find nodes that have a high FCL just because they have oncogenetic or tumorsuppressive properties, thus have been studied more than others. As a consequence, solutions to the network optimization problems tackled in bioinformatics (and mentioned above) can be strongly influenced by the topology of the initial network, and by the FCL of its nodes.
In an attempt to overcome this issue, some tools assess this bias by comparing their provided subnetwork solutions with those that would be obtained (using the same experimental data and the same algorithm) across a large number of trials, each starting from a reference network that is a randomized version of the original one. Many other tools neglect this aspect and the significance of the solution is computed by randomizing the experimental data only. For both options, the expectation of some topological properties (for example the inclusion of a given edge or node) of the subnetwork solutions is estimated by analyzing the random solutions obtained across the trials. In this way, the significance of these properties is quantified as the divergence from their expectation, testing against the null hypothesis that there is no association between the analyzed experimental data and the outputted subnetwork solutions.
To our knowledge, all the existing methods assessing their solution significance through reference network randomizations make use of a simple edge shuffling. This means that in a randomization trial each edge of the network is simply set to link two randomly selected nodes. This implicitly means that null models resulting from this randomization strategy are totally unconstrained with regards to the degree of the nodes, and the way they are linked to each other in the original network. Therefore, the impact of the FCL of the nodes in the original reference network on the outputted subnetwork solution is not considered. In order to take this into account a constrained randomization strategy preserving the FCL of all the nodes in the original network must be used.
The problem of randomizing an undirected and unweighted network while preserving the degree of its nodes, i.e. the total number of incident edges for each node, is known in graph theory as network rewiring and unfortunately presents itself with analytical and numerical challenges [15]. With the additional constrain that the network to rewire is bipartite (i.e. nodes can be partitioned into two subsets such that there are no edges linking nodes in the same set), this problem reduces to randomizing a binary matrix preserving its marginal totals, i.e. its rowwise and columnwise sums. Several algorithms exist to solve this problem [16, 17] but the computationally efficient randomization of moderately large matrices (therefore the rewiring of large bipartite networks) is still challenging. Additionally, to our knowledge, none of the methods published is formally shown to be able to actually simulate samplings from the uniform distributions of all the possible binary matrices with prescribed marginal totals. Such proof exists for methods rewiring directed binary networks based on swapandfill strategies applied to their adjacency matrices [18] but not dealing with DSNs. Finally, some recent methods have been proposed to solve the related (but yet different from FCL preserving rewiring) problem of randomizing metabolic networks in a massbalanced way [19].
In [20] we showed how an algorithm based on a Monte Carlo procedure known as the switchingalgorithm (SA) [21] can be used to efficiently randomize large cancer genomics datasets preserving the mutation burdens observed across patients and the number of mutations harbored by individual genes (hence to efficiently rewire large bipartite networks). To this aim, we derived a novel lower bound for the number of steps required by the SA in order for its underlying Markov chain to reach a stationary distribution. Additionally, we implemented the SA in the R package BiRewire (publicly available on Bioconductor [20]) and we showed a massive reduction in computational time requirements of our package and bound with respect to other existing R implementations [22] and bounds [21].
Here (i) we introduce the problem of rewiring a DSN modeling a biological network in a way that the FCL of all the modeled entities is preserved: FRewiring; (ii) we formally show how this problem reduces to rewiring 2 bipartite networks; (iii) we provide a generalized bound to the SA for bipartite networks of any size; and (iv) we show the validity of the Markov chain convergence criteria (used in our previous work) for Frewiring DSNs.
Finally, we provide an overview of the functions included in a new version of BiRewire for FRewiring, and we show results from two case studies where solutions obtained with two network optimization methods (BioNet [9], and CellNOpt [23]) are assessed for statistical significance and intial reference network biases against constrained null models generated with BiRewire.
Methods
Preliminary notations
The problem we are tackling is the computationally efficient randomization of a directed and signed network (DSN) (formally defined below) in a way that some local features of its individual nodes are preserved.
In such a network \(\mathcal {G}=(V,E)\), the edges in E can be encoded as triplets (a,b,∗) where a is called source node, b is called target node and ∗ is a label denoting the sign of the relation occurring among them, which could be positive, ∗=+, or negative, ∗=−.
According to this definition, in a DSN the edge (a,b,+) is different from the edge (a,b,−), thus making this formalism more flexible than that provided by a directed weighted network (with weights ∈{+1,−1}). In fact, differently from such a model, in a DSN two edges with same terminal nodes and direction but different sign can coexist. In addition, a DSN is different and less general than a multidigraph (a directed multigraph), because only two possible edges with the same direction can coexist between the same couple of nodes.
Given an edge e∈E, we define the function λ(e):E→{+,−}, mapping each edge to its sign label.
Given a node v∈V, we define its inboundstar I(v) as the set of edges in E having v as destination, I(v)={e∈E:e=(a,v,∗)}. Similarly, considering the edges having v as source defines its outboundstar, O(v)={e∈E:e=(v,b,∗)}. Imposing as additional condition for an edge to be included in these sets that of having a fixed sign label, defines positive and negative inbound and outbound stars. Formally, the v positive (respectively negative) inboundstar is the set of edges in G having v as destination and positive (respectively negative) label, I ^{+}(v)={e∈I(v):λ(e)=+} (respectively I ^{−}(v)={e∈I(v):λ(e)=−}). Analogously, the v positive (respectively negative) outboundstar is the set of edges in G having v as source and positive (respectively negative) label, O ^{+}(v)={e∈O(v):λ(e)=+} (respectively O ^{−}(v)={e∈O(v):λ(e)=−}).
By naturally extending the definition of node degree (i.e. the number of edges connected to a node) to these formalisms, we call positiveindegree of a node v the quantity I ^{+}(v) equal to the number of edges with positive label having v as destination. Similarly we define the v negativeindegree, positiveoutdegree and positiveindegree, the quantities I ^{−}(v), O ^{+}(v) and O ^{−}(v), respectively.
In the light of the introduced notation, the object of this study can be redefined as the randomization of the edges of a DNS \(\mathcal {G}\) while preserving not only its general nodedegrees (network rewiring), but also all the signed degrees defined above, for all the nodes: network Frewiring.
A biological pathway can be naturally represented through a DNS \(\mathcal {G}=(V,E)\). In this case the nodes in V would represent biological entities, and the edges in E would represent functional relationships occurring among them, whose type would be defined by the sign label (+ for activatory and − for inhibitory interactions), with directions indicating effector/affected roles (source/destination of the edges). In this case the signed degrees introduced above would define the functional characterization level (FCL) of the individual biological entities considering all the possible roles that they can assume within a given pathway.
Particularly the positiveoutdegree of a node v would correspond to the level of characterization of the corresponding biological entity as activator of other entities; the negativeoutdegree would correspond to its characterization as inhibitor; finally, the positive, respectively negative, indegree of a node would correspond to the level of characterization of the corresponding entity as activated, respectively inhibited, by other entities in the same DSN.
As a consequence, the ultimate goal of this study is to efficiently randomize a pathway (or a collection of interlinked pathways) in a way the functional characterization levels of its individual entities, i.e. the signeddirected degrees of all the nodes, are preserved.
Frewiring of a directed signed networks is reducible to the rewiring of two bipartite networks: reduction proof
Let us consider a directed signed network (DSN) \(\mathcal {G}=(V,E)\), with λ(e)∈{−,+}, ∀e∈E and a transforming function \(f(\mathcal {G})\), from the set of all the possible DSNs to the set of all the possible pairs of bipartite networks (B _{+},B _{−}), such as B _{∗}=(S _{∗},D _{∗},E _{∗}), whose node sets are defined as S _{∗}={v∈V:∃(v,x,∗)∈E}, and D _{∗}={v∈V:∃(x,v,∗)∈E}, with ∗∈{+,−}. Worthy of note is that the same node of \(\mathcal {G}\) can be both a source (therefore belonging the set S _{∗}) for some edge in E, and a destination (therefore belonging to the set D _{∗}) for some other edge in E. As a consequence f should also relabel the nodes (for example adding a subscript to labels of the nodes in D _{∗}). Here, for simplicity we will neglect this relabeling.
As a conclusion, the function f maps \(\mathcal {G}\) to two bipartite networks (BNs) (B _{+},B _{−}) such that B _{+}=(S _{+},D _{+},E _{+}) is the BN induced by the positive edges of \(\mathcal {G}\), where all the sources of these edges are included in the first node set S _{+}, all the destinations in the second set D _{+} and two nodes across these two sets are connected by an undirected edge if they are connected in the original network \(\mathcal {G}\) by a positive edge that goes from the node in the first set to that in the second one. The second bipartite network of the pair B _{−} is similarly induced by the negative edges of \(\mathcal {G}\). Formally E _{∗}={(s,d):s∈S _{∗},d∈D _{∗} and ∃(s,d,∗)∈E}, with ∗∈{+,−}. An example of this transformation is shown in Fig. 1 a.
It can be shown that such a function f realizes a bijection between the set of all the possible DNSs and the set of all the possible pairs of BNs [24]. As a consequence its inverse f ^{−1} is a function from the set of all the possible pairs of BNs to the set of all the possible DSNs, and it is defined as \(f^{1}(B_{1},B_{2}) = \mathcal {G} = (V,E)\), where
For simplicity, we assume that f ^{−1} reassignes to the nodes their original labels before constructing the node/edge sets of G, if they were relabeled by the function f. An example of this inverse transformation is shown in Fig. 1 b.
Proposition 1
Let be \(\mathcal {G}=(V,E)\) a DSN modeling a pathway (or a set of interlinked pathways) P, and f the transformation function described above \(f(\mathcal {G})=(B_{+},B_{}).\) If R _{+} and R _{−} are rewired versions of B _{+} and B _{−} respectively, then \(f^{1}(R_{+},R_{}) = \mathcal {H}\) is a randomized version of \(\mathcal {G}\) in which the signeddirected degrees of all the nodes v∈V, i.e. the quantities I ^{+}(v), I ^{−}(v), O ^{+}(v), O ^{−}(v), are kept equal to their original values. This implies that \(\mathcal {H}\) is an Frewired version of G, hence a randomization of P in which the functional characterizations of the individual entities are preserved.
Proof
First of all we need to show that \(\mathcal {H}\) is a randomized version of \(\mathcal {G}\), in other words that \(\mathcal {H}\) is a directed signed network with the same nodes set and number of edges of \(\mathcal {G}\) and the same signeddirected node degrees but a different edge set.
To this aim let be \(\mathcal {H}=(W,F)=f^{1}(R_{+},R_{})\). Since a rewiring does not affect the node set of the transformed network, R _{+} has the same node set of B _{+}, and R _{−} has the same node set of B _{−}. On the other hand, B _{+} and B _{−} are the two bipartite networks induced by the positive and negative edges (respectively) of \(\mathcal {G}\). For construction, the union of their nodes gives V. Taken together these observations imply that W=V
From the definition of f, B _{+} contains the positive edges in E and B _{−} the negative edges of E (whose terminal nodes have been possibly relabeled). From the definition of rewiring, the edge set of R _{+} contains the same number of edges of B _{+} but at least one edge not contained in B _{+}. Similarly the edge set of R _{−} contains the same number of edges of B _{−} and at least one edge not contained in B _{−}. Therefore, from the definition of f ^{−1}, F=E and F contains at least two edges that are not included in E. This imply that F≠E.
As a conclusion \(\mathcal {G}\) and \(\mathcal {H}\) have the same set of nodes and number of edges but different edge sets.
Secondly we need to show that the signed degrees of all the nodes of \(\mathcal {H}\) are equal to those of all the nodes in \(\mathcal {G}\).
Let us assume that the positiveindegrees of \(\mathcal {H}\) are different from those of \(\mathcal {G}\). From the f ^{−1} definition, this implies that R _{+} contains at least a node in the source set for which the degree is different from that of its counterpart in B _{+}. However, this contradicts R _{+} being a rewired version of B _{+}. With the same argument it is possible to prove that all the signeddirected node degrees of \(\mathcal {H}\) are equal to those of \(\mathcal {G}\). □
Switchingalgorithm lower bound for bipartite networks of any size
To rewire a bipartite network B=(S,D,E), the switchingalgorithm (SA) [21] performs a cascade of switchingsteps (SS). In each of these SS two edges (a,b) and (c,d) are randomly selected from E and replaced with (a,d) and (c,b) if these two new edges are not already contained in E. In this case the SS under consideration is said successful.
Underlying the SA is a Markov chain whose states are different rewired versions of the initial network \(\mathcal {G}\) and a transition between states is realized by a successful SS.
In [20] we prove that, if executing a sufficiently large number of SS, the SA can efficiently simulate samplings from the uniform distribution of all the possible bipartite networks with predefined node sets and prescribed node degrees. Therefore it can be used to obtain a rewired version of a network B that it is, on average, no more similar to B than are similar to each other two bipartite networks B _{1} and B _{2} sampled from the real uniform distribution of all the possible bipartite networks with the same node sets and node degrees of B. To this aim, the number of SS to be performed before sampling the (k+1)th rewired network must be large enough to assure that the algorithm has forgotten the kth sampled rewired network (the starting network \(\mathcal {G}\) for k=0). Formally, the number of SS between two following samplings must be at least equal to the burnin time of the Markov chain underlying the SA, which is needed to reach a stationary distribution [25, 26]. An example of this is shown in Fig. 2: the 5 plots show results from a simulation study in which the SA has been used to rewire a synthetic bipartite network of 50 + 50 nodes and an edge density of 20%, and rewired versions of this network have been sampled at different intervals of SSs. A sampling interval of 1 SS produces sampled networks that are strongly related to each other (Fig. 2 a). Gradually increasing the sampling interval (from 5 to 20 SS, Fig. 2 b to d), reduces the sampled network similarities but some local dependencies are maintained. At a sampling interval of 300 SS (Fig. 2 e) the Markov chain underlying the SS has reached its stationary distribution, the sampled networks are completely unrelated and there are no dependencies. Therefore, for the bipartite network under consideration, a number of SS ≥300 is sufficient to simulate samplings from the uniform distribution of all the possible bipartite networks with 50 + 50 nodes and node degrees equal to those of the original network.
An empirical bound N ^{′} for the minimal number of SS to be performed by the SA between two consecutive samplings has been proposed in [21] as being equal to 100 times the number of edges of the bipartite network to rewire. This makes rewiring moderately large networks computationally very expensive.
By analyzing the trend of similarity to the original network along the sample path of the Markov chain simulation implemented by the SA, in [20] we proposed a novel lower bound to the number of SS needed to rewire large bipartite networks equal to
where E is the set of edges of the network to rewire B=(S,D,E) and d=E/(SD) is its edge density. In [20] we show that this bound is much lower than N ^{′} and that our SA implementation and bound provide a massive reduction of the computational time required to rewire large bipartite networks (with thousands of nodes and tens of thousands of edges) with respect to other SA implementations [22] and the bound N ^{′}.
Here we provide a generalization of the lower bound N making the SA effective and computationally efficient in rewiring bipartite networks of any size. This is led by the observation that a DSN modeling a pathway (and the two bipartite networks induced by its positive and negative edges, respectively) can be even composed by a modest number of nodes and edges.
As shown in the supplementary data of [20] (from now on going, equations from this paper will have GSD, for Gobbi supplementary data, as prefix), Eq. 1 follows from the GSDEquation 11 (page 20) and it is a simplified form of
where t=SD is the total number of possible edges of the original network, d=E/t is its edge density, p _{ r } is the probability of a SS to be successful. ε is the accuracy of the bound in terms of distance (quantified through the convergence metric that we used to monitor the Markov chain underlying the SA, based on the number of edge shared by the original network and its rewired version at the generic kth SS, and defined in GSDEquation 9, page 19) from the real fixed point \(\bar {x}\).
Under the assumption of a uniform degree distribution^{1} we showed that p _{ r }=(1−d)^{2} (GDSEquation 4, page 16). As a consequence Eq. 2 can be rewritten as:
which for ε=1, gives Eq. 1.
Equation 3 expresses the lower bound of the number of SS as a function that accounts for the network topology and the estimated distance of the Markov chain underlying the SA from its steadystate, according to the convergence metric used in [20]. More detailed, this distance is equal to \(x^{(k)}\bar {x}\), where x ^{(k)} is the number of common edges between the original network and its rewired version after k SS, and \(\bar {x}\) is the expected number of common edges between the original network and its rewired version, after the Markov chain underlying the SA has reached its stationary distribution.
In our previous bound definition ε was defined in terms of number of edges, and N defined as in Eq. 1 in order to have \(x^{(k)}\bar {x} \le 1\) for k≥N.
For large bipartite networks, i.e. E>10000, a value of ε=1 guarantees a relative error δ<0.01% of edges for a number of SS k≥N. However, for relatively smaller networks, for example when E=100, a value of ε=1 implies a substantially increase in the relative error to δ=1%, making the estimated lower bound N increasingly suboptimal with respect to the estimated real fixed point.
For this reason here we redefine the lower bound N for the number of SS as a function of its relative error δ, which quantifies its suboptimality with respect to the estimated real fixed point. Through the simple substitution ε=Eδ, Eq. 3 can be rewritten as:
where \(\Omega =\frac {(1d)(\ln {(1d)}\ln {\delta })}{2p_{r}}\) depends only on the level of accuracy δ, the density d of the original network and the probability p _{ r } of a successful SS. For uniformly distributed degrees ^{1}, i.e. p _{ r }=(1−d)^{2}, this bound reads as:
A value of δ=0.00005 (corresponding to ε=1 edge when E∼20000), is used by default by our new implementation of the SA in the new version of the package BiRewire but this parameter can also be set to a user defined value, making our tool and bound suitable for the rewiring of bipartite networks of any size. Additionally, the choice of a suitable value for this parameter can be determined by visually inspecting the SA Markov chain convergence with a new dedicated function (described in “Overview of the new functions included in BiRewire v3.0.0” Section)
Convergence criteria for signed directed networks
In [20] we showed that the convergence criteria we used to estimate our lower bound N for the number of switchingsteps (SS) needed to rewire bipartite networks can be applied also to the more generic case of undirected networks.
To show the validity of this criteria for Frewiring of directed signed networks (DSNs) let us observe that the Jaccard Index (J) [27] used to assess the similarity between two DSN with the same set of nodes and same number of edges: \(\mathcal {G} = (V, E)\) and \(\mathcal {H} = (V,F)\) is defined as
where x=E∩F is the number of common edges and the last equivalence holds because the two DSNs have the same number of edges. When estimated for bipartite networks, our N guarantees that the number of common edges between an initial network B and its rewired version at the Nswitchingstep is asymptotically minimized.
Proposition 2
Let be R _{+} and R _{−} the rewired versions of two bipartite networks B _{+} and B _{−} obtained through a number of switchingsteps respectively equal to N _{+} and N _{−} (both computed using Eq. 4), and such that \((B_{+},B_{}) = f(\mathcal {G})\) (where f is the transformation function defined in Section Frewiring of a directed signed networks is reducible to the rewiring of two bipartite networks: reduction proof and \(\mathcal {G}\) a DSN). Then the Jaccard similarity between \(\mathcal {G}\) and \(\mathcal {H} = f^{1}(R_{+},R_{})\) is minimized.
Proof
\(J(\mathcal {G},\mathcal {H})\) reaches a minimum when the number of common edges x between \(\mathcal {G}\) and \(\mathcal {H}\) reaches a minimum. x is given by the sum of the number of common positive and negative edges across the two networks, namely x=x _{+}+x _{−}. Given that \(\mathcal {H} = f^{}1(R_{+},R_{})\), x _{+} is the number of common edges between B _{+} and R _{+}. Analogously x _{−} is the number of common edges between B _{−} and R _{−}. Since R _{+} and R _{−} are rewired version of B _{+} and B _{−} computed through N _{+} and N _{−} (minimizing x _{+} and x _{−}, respectively) also x=x _{+}+x _{−} is minimized. □
Results
Overview of the new functions included in BiRewire v3.0.0
The Rpackage BiRewire (http://bioconductor.org/packages/BiRewire/) was originally designed to efficiently rewire large bipartite networks ([20]). We have performed a major update, by including functions to:

read/write directed signed networks (DSN) from/to simple interaction format (SIF) files (functions birewire.load.dsg and birewire.save.dsg);

perform the transformation f (and its inverse f ^{−1}) to derive bipartite networks induced by positive and negative edges of a DSN, and viceversa (functions birewire.induced.bipartite and birewire.build.dsg);

Frewire a DSN by applying the switchingalgorithm (SA) to the two corresponding induced bipartite networks with numbers of switchingsteps automatically determined for both networks individually, using Eq. 3 (function birewire.rewire.dsg);

sample K rewired versions of a network: this function runs K instances of the SA in cascade; each of these instances performs a number of switchingsteps (SS) determined using Eq. 3. This function can take in input a bipartite network, an undirected network or a DSN (in this case Eq. 3 is used individually for the two bipartite networks induced by the positive and negative edges of the DSN, respectively) (birewire.sampler.* functions);

monitor the convergence of the Markov chain underlying the SA on user defined networks. This routine samples a userdefined number of networks at user defined intervals of SS. For each of these intervals, it computes a Jaccard similarity [27] pairwisely comparing the sampled networks to each other; finally it plots the sampled networks in a plane where points proximities reflect Jaccard similarities of the corresponding networks and point coordinates are computed through the generalized multidimensional scaling method tSNE [28]; this function gives in output the network coordinates of such scale reductions and produce the plots shown in Fig. 2. Also in this case the inputted graph can be a bipartite network, an undirected network or a DSN (birewire.visual.monitoring.* functions);

perform an analysis of the trends of Jaccard similarity across SS. This function performs a userdefined number of independent runs of the SA, computing the mean value and a confidence intervals of the observed pairwise Jaccard similarities between the obtained rewired networks. The result is a dataset containing the Jaccard similarity scores computed and sampled at userdefined intervals of SS, and a plot similar to that showed in Figs. 3 a and 4 a. This function takes in input a bipartite network or an undirected network or a DSN (birewire.analysis.* functions).
Worthy of note is that, supporting the analysis of DSNs, our package can handle also generic directed graphs, therefore with BiRewire3 it is now possible to rewire any kind of unweighted networks.
We have developed also a cython wrapper of the corresponding C library for Python users. A first release (with some basic functions) can be found in https://github.com/andreagobbi/pyBiRewire.
Case study 1: BioNet
The R package BioNet [29] provides a set of methods to map gene expression data onto a large reference biological network, and to identify (with a heuristic method) a maximal scoring subnetwork (MSS), which a is a set of connected nodes (or module) with unexpectedly high levels of differential expression [30]. Several other methods moving along the same lines exist (as, among others, EnrichNet [6]). Here we focus on BioNet because it can be considered a typical example among these methods, and we show how BiRewire3 can be used to estimate the impact of the reference network topology and the functional characterization level (FCL), i.e. signdirected degree, of its nodes on the optimal module outputted by this tool.
The initial reference network used by BioNet (the Interactome) is a large undirected proteinproteininteraction network assembled from HPRD [31] and encompassing 9,392 nodes and 36,504 edges. In [29], the authors show an application of BioNet to gene expression data from a diffuse large Bcell lymphoma (DLBCL) patient dataset, with corresponding survival data. After determining genewise Pvalues for differential expression and riskassociation, the authors aggregate them and fit a betauniform mixture model to the distribution of aggregated Pvalues that yields a final score (accounting for both considered factors) for each gene: the higher this score the more a gene is differentially expressed across the contrasted groups of patients. Then the methods proceeds with mapping these scores onto the Interactome nodes and, applying a heuristic method [9], it identifies a subnetwork (referred to as a module) that is a suboptimal estimate of the MSS. This module is shown in Fig. 3 c and the BioNet package vignette contains detailed instructions on how to reproduce this result.
To evaluate the impact of the FCLs of the Interactome nodes on the module outputted by BioNet when used on the DLBCL dataset, we generated 1,000 Frewired versions of the Interactome with BiRewire3 and used each of them as initial reference network in 1,000 individual BioNet runs, using the DLBCL dataset as input.
To this aim we first conducted a BiRewire3 analysis (using the dedicated function of our package) to determine the number of switchingsteps (SS) to be performed by the switchingalgorithm (SA) in order to Frewire the Interactome. This function makes use of the convergence criteria we designed in [20], which is based on the estimated time, in terms of SS, in which the Jaccard similarity (JS) between the original network and its rewired version at the kth SS reaches a plateau (Fig. 3 a). In [20] we showed that this criteria is equivalent to other established methods to monitor Markov chain convergence when the states are networks. In addition its relatively simple formulation consents the analytical derivation of an estimated plateau time, i.e. our bound N. Neverthless, our package allows also a visual inspection of the optimality of the estimated bound N showing how independent are Frewired versions of an initial network sampled at a number of userdefined SS intervals as well as every N SS (Fig. 2).
These preliminary analyses resulted in a required number of SS equal to N=170,491 (Fig. 3 a) and showed that this number of SS is actually sufficient to generate unrelated Frewired versions of the Interactome, thus to simulate samplings from the uniform distribution of all the possible networks with the same number of nodes and FCLs of the Interactome (Fig. 3 b). Generating 1,000 Frewired versions of the Interactome sampled each N SS required ∼2 hours on a 4 core 2.4 Ghz computer with 8GB memory.
Running 1,000 independent instances of BioNet using each of these Frewired Interactome as reference network and the DLBCL dataset in input resulted into 1,000 different module solutions (rewired solutions). For each of the nodes included in the original BioNet module solution (Fig. 3 c), we quantified the ratio of rewired solutions including them and we investigated how this quantity related to the corresponding BioNet scores (Fig. 3 d). As expected, we observed a significant correlation (R=0.51, p=0.001). In fact, as per the definition of the MSS, it is reasonable that nodes with high scores (such as, for example NR3C1 and BCL2) tend to be included in the module outputted by BioNet regardless their edges and degree in the reference Interactome. Similarly, nodes with large negative scores (such as CDC2 and JUN) are included in the module only because they link high scored nodes and it is obvious that they do not tend to be included in the rewired solutions, as in this case the way they are interlinked to other nodes is crucial.
Nevertheless, a number of nodes (such as, SMAD4, SMAD2 and PIK3R1) have modest score but tend to be included very frequently in the rewired solutions. This hints that what leads the inclusion of such nodes in the BioNet module is their high FCL. As a confirmation of this, SMAD4, SMAD2 and PIK3R1 fall over the 99th percentile when sorting all the nodes in the Interactome (and included in the DLBCL) based on their FCL (which in this case corresponds to their degree). This is a proof that the reference network provides the BioNet outputted module with a positive impact, and that at least some nodes are included in the solution because of their high FCL.
When extending this analysis to the nodes of the Interactome (included in the DLBCL dataset) that are not present in the module outputted by BioNet we observed again an expected significant correlation (R=0.51, p<10^{−16}), and some nodes (such as JUP, MMP2 and ITGA6) with high scores frequently included in the rewired solutions (the fact that these nodes do not appear in the BioNet outputted module is due to the suboptimality of the used heuristic). However we also observed a large number of nodes (such as RPL13A, STK17A and IDH3A) scored high but relatively infrequently included in the rewired solutions. This hints that these nodes are penalized by their low FCL in the reference Interactome, thus proving the existence of a negative impact provided by the reference Interactome to the BioNet outputted module, and that at least some nodes are not included in the solution because of their low FCL.
An indication of both these types of impacts, together with diagnostic plots and statistics would complement and complete the output of many valuable and widely used tools, such as BioNet.
Case study 2: CellNOpt
CellNOpt (www.cellnopt.org) is a tool used to train logic models of signal transduction starting from a reference directed signed network (DSN) called a prior knowledge network (PKN), describing causal interactions among signaling species (obtained typically from literature), and a set of experimental data (typically phosphorylation), obtained upon various perturbatory conditions ([23]).
CellNOpt converts the PKN into a logic model and identifies the set of interactions (logic gates) that best explain the experimental data. This is performed through a set of Bioconductor packages supporting a number of mathematical formalisms from Boolean models to ordinary differential equations.
Through a builtin genetic algorithm CellNOpt identifies a family of subnetworks from the reference DSN (from now, models) together with the value of the objective function (the model score δ) quantifying at what extent each model is able to explain the experimental data (the lower this value the better is the fit of the model to the data). By default, the best model with the lowest score denoted \(\hat {\delta }\) is returned to the endusers. Note, however, that multiple models may be returned if they cannot be discriminated given the experimental evidence. Besides, to account for experimental noise, users may also provide a parameter, which is called tolerance (in percentage), that will keep all models below a threshold defined as \(\lambda =\hat {\delta } (1+tolerance)\).
Setting this tolerance parameter is nontrivial and depends largely on the experimental error. One idea would be to estimate this threshold by looking at the expected ability of Frewired versions of the liverPKN to explain the data, when they are used as input to CellNOpt. In fact, even if original local node properties are maintained, in each of these Frewired networks the topology of the biological pathways interlinked in the liverPKN is disrupted. As described before, a large score calculated by CellNOpt indicates a large disagreement between data and network logic behavior at the measured nodes. Therefore the distribution of the δs outputted by CellNOpt when using these Frewired networks gives an idea of the attainable baseline performaces, which are not derived from biologically meaningful models but depend only on the FCL (signed and directed node degrees) of the original liverPKN.
Based on these considerations, here we show how BiRewire3 can be used to identify such a threshold as the maximal δ value whose deviance from expectation is statistically significant. Similarly to the previous case study, this expectation can be empirically estimated by running a large number of independent CellNOpt runs using Frewired versions of the initial reference signaling network and the same experimental data. Thus accounting for the effect of the node FCLs on both scores and outputted models. To this aim, we used the same reference PKN network and phosphoproteomic data used in [23], which has about 80 nodes and 120 directed and signed edges. This was a study on human liver cell and hence the network is called liverPKN hereafter. With the BiRewire3 package we generated (in less than 10 seconds, on a standard unix laptop) 1000 Frewired versions of the liverPKN, visually inspecting (as in the previous case study) the optimality of our estimated lower bound N for the number of switchingsteps (SS) to be performed by the switchingalgorithm (SA) (Fig. 4 a,b) between one sampled Frewired network and the following one. Subsequently we run 1000 independent instances of CellNOpt (using the CellNOptR package [23], v1.16 available on Bioconductor at www.bioconductor.org/packages/CellNOptR/).
On each of these Frewired liverPKN networks and the same phosphoproteomic dataset (obtaining one rewired model per each analysis), as well as a final run using the original liverPKN network (obtaining a family of 1000 different models).
When comparing the two populations of CellNOpt scores obtained from these two analyses we observed, as expected, a notably statistically significant difference (ttest pvalue <10^{−16}, Fig. 4 c), indicating that in the Frewired networks the topology of the pathways originally interlinked in the liverPKN is actually disrupted. Subsequently, using the distribution of scores of the rewired models we computed empirical pvalues for the CellNOpt scores for the entire model family outputted by the final run (making use of the original liverPKN).
For a given score δ _{ i } corresponding to the i−th model of the family, an empirical pvalue was set equal to the number of rewired models m such that δ _{ m }≥δ _{ i } divided by 1000 (the number of tested frewired liverPKNs). More than 90% of the models in the outputted family had a CellNOpt score significantly divergent from expectation (pvalue <0.05) and the estimated score threshold guaranteeing this (or a greater) divergence from expectation, thus a minimal impact of the initial liverPKN FCLs, was equal to 0.06.
Finally, and similarly to the analysis performed in the first study case, we quantified the tendency of each of the nodes included in the final merged CellNOpt model to be included in the rewired models, finding that also in this case this is indeed proportional to the nodes’ FCL.
In summary, BiRewire3 could be effectively used to determine a score threshold on an analytical ground, based on which meaningful models could be selected from the family outputted by CellNOpt for further analyses, and finally assemble a consensual model solution. Additionally, it could be employed to evaluate the extent of impact of the CellNOpt reference network on the topology of its outputted consensual model.
Discussion
BiRewire3 is a onestop tool to rewire in a meaningful way any type of unweighted networks (undirected, directed, and signed) currently used to model different datasets and relations in computational biology (including presenceabsence matrices, genomics datasets, pathways and signaling networks) in an computationally efficient way. It represents a significant and formally demonstrated advance with respect to its previous version [20], whose applicability was restricted to presence/absence matrices and undirected bipartite networks. We have previously shown that, thanks to an analytically derived lower bound to the number of steps of its underlying algorithm, the computational time requirements of BiRewire3 are vastly lower than those of other similar tools, reducing from months to minutes (on a typical desktop computer) when rewiring networks with tens of thousands of nodes and edge density ranging up to 20%. Additionally, the core algorithm underlying BiRewire3 is based on a Markov chain procedure that could be easily parallelized in future implementations, to exploit the power of modern multicore computer architectures, thus reducing these time requirements even further.
Our package is available as free open source software on Bioconductor and, as we showed in our case studies, it can be easily combined into computational pipelines together with a wide range of existing bioinformatics tools aiming at integrating signaling networks with experimental data.
Conclusion
We have presented a computational framework implemented in a R package that could complement existing network based tools. This will be useful for computing a wide range of constrained null models testing the significance of the solutions of these tools, and to investigate how the topology of the used reference networks can potentially bias these results.
Moreover, the range of applicability of BiRewire3 goes beyond computational biology, and includes all those fields making use of tools from network theory, from operative research, to microeconomy, and ecological research (an example of the application of BiRewire application in a microeconomy and technology patent study can be found at http://arxiv.org/abs/1509.07285).
Endnote
^{1} Our proof applies also to non uniform degree distributions, leading to the same conclusions for the case of directed signed networks. Here we use the uniform case for simplicity.
Abbreviations
 Frewiring:

Network rewiring preserving the functional characterization of the individual nodes
 DSN:

Directed signed network
 FCL:

Functional characterization level
 SA:

Switching Algorithm
 SS:

Switching steps
 GSD:

Supplementary data of [20]
 SIF:

Simple interaction format MSS: Maximal scoring subnetwork
 DLBCL:

Diffuse large B cell lymphoma
 PKN:

Prior knowledge network
References
 1
Ma’ayan A. Introduction to network analysis in systems biology. Sci Signal. 2011; 4(190):5.
 2
Iorio F, SaezRodriguez J, Bernardo DD. Network based elucidation of drug response: from modulators to targets. BMC Syst Biol. 2013; 7(1):139.
 3
SaezRodriguez J, MacNamara A, Cook S. Modeling signaling networks to advance new cancer therapies. Annu Rev Biomed Eng. 2015; 17:143–63.
 4
Pavlopoulos GA, Secrier M, Moschopoulos CN, Soldatos TG, Kossida S, Aerts J, Schneider R, Bagos PG. Using graph theory to analyze biological networks. BioData Mining. 2011; 4:10.
 5
Mitra K, Carvunis AR, Ramesh SK, Ideker T. Integrative approaches for finding modular structure in biological networks. Nat Rev Genet. 2013; 14(10):719–32. doi:10.1038/nrg3552.
 6
Glaab E, Baudot A, Krasnogor N, Schneider R, Valencia A. EnrichNet: networkbased gene set enrichment analysis. Bioinformatics. 2012; 28(18):451–7.
 7
Vandin F, Upfal E, Raphael BJ. Algorithms for detecting significantly mutated pathways in cancer. J Comput Biol. 2011; 18(3):507–22.
 8
Wang X, Terfve C, Rose JC, Markowetz F. HTSanalyzeR: an R/Bioconductor package for integrated network analysis of highthroughput screens. Bioinformatics. 2011; 27(6):879–80.
 9
Dittrich MT, Klau GW, Rosenwald A, Dandekar T, Müller T. Identifying functional modules in proteinprotein interaction networks: an integrated exact approach. Bioinformatics. 2008; 24(13):223–31.
 10
Hill SM, Heiser LM, Cokelaer T, Unger M, Nesser NK, Carlin DE, Zhang Y, Sokolov A, Paull EO, Wong CK, Graim K, Bivol A, Wang H, Zhu F, Afsari B, Danilova LV, Favorov AV, Lee WS, Taylor D, Hu CW, Long BL, Noren DP, Bisberg AJ, HPNDREAM Consortium, Mills GB, Gray JW, Kellen M, Norman T, Friend S, Qutub AA, Fertig EJ, Guan Y, Song M, Stuart JM, Spellman PT, Koeppl H, Stolovitzky G, SaezRodriguez J, Mukherjee S. Inferring causal molecular networks: empirical assessment through a communitybased effort. Nat Methods. 2016; 13(4):310–8.
 11
Kulbe H, Iorio F, Chakravarty P, Milagre CS, Moore R, Thompson RG, Everitt G, Canosa M, Montoya A, Drygin D, Braicu I, Sehouli J, SaezRodriguez J, Cutillas PR, Balkwill FR. Integrated transcriptomic and proteomic analysis identifies protein kinase CK2 as a key signaling node in an inflammatory cytokine network in ovarian cancer cells. Oncotarget. 2016; 7(13):15648–61.
 12
Melas IN, Sakellaropoulos T, Iorio F, Alexopoulos LG, Loh WY, Lauffenburger DA, SaezRodriguez J, Bai JPF. Integr Biol. 2015; 7(8):904–20.
 13
Woo JH, Shimoni Y, Yang WS, Subramaniam P, Iyer A, Nicoletti P, Martínez MR, López G, Mattioli M, Realubit R, Karan C, Stockwell BR, Bansal M, Califano A. Elucidating Compound Mechanism of Action by Network Perturbation Analysis. Cell. 2015; 162(2):441–51.
 14
Lecca P, Priami C. Biological network inference for drug discovery. Drug Discov Today. 2013; 18(56):256–64.
 15
Bender E, Canfield E. The asymptotic number of labelled graphs with given degree sequences. J Comb Theory Series A. 1978; 24:296–307.
 16
Strona G, Nappo D, Boccacci F, Fattorini S, SanMiguelAyanz J. A fast and unbiased procedure to randomize ecological binary matrices with fixed row and column totals. Nat Commun. 2014; 5:4114.
 17
Gotelli N, Entsminger G. Swap and fill algorithms in null model analysis: rethinking the knight’s tour. Oecologia. 2001; 129:281–91.
 18
Roberts ES, Coolen ACC. Unbiased degreepreserving randomization of directed binary networks. Phys Rev E. 2012; 85(4 Pt 2):046103.
 19
Basler G, Ebenhöh O, Selbig J, Nikoloski Z. Massbalanced randomization of metabolic networks. Bioinformatics. 2011; 27(10):1397–403.
 20
Gobbi A, Iorio F, Dawson KJ, Wedge DC, Tamborero D, Alexandrov LB, LópezBigas N, Garnett M, Jurman G, SaezRodriguez J. Fast randomization of large genomic datasets while preserving alteration counts. Bioinformatics. 2014; 30(17):617–23. doi:10.1093/bioinformatics/btu474.
 21
Milo R, Kashtan N, Itzkovitz S, Newman MEJ, Alon U. On the uniform generation of random graphs with prescribed degree sequences. 2003. Arxiv preprint condmat/0312028.
 22
Csardi G, Nepusz T. The igraph software package for complex network research. InterJournal Complex Syst. 2006; 1695:38.
 23
Terfve C, Cokelaer T, Henriques D, MacNamara A, Goncalves E, Morris MK, van Iersel M, Lauffenburger DA, SaezRodriguez J. CellNOptR: a flexible toolkit to train protein signaling networks to data using multiple logic formalisms. BMC Syst Biol. 2012; 6(1):133. doi:10.1186/175205096133.
 24
Chen WK. Graph Theory and Its Engineering Applications. Tokyo: World Scientific Publishing Co Pte Ltd; 1997.
 25
Ray J, Pinar A, Seshadhri C. Are We There Yet? When to Stop a Markov Chain while Generating Random Graphs. In: Algorithms and Models for the Web Graph. Berlin, Heidelberg: Springer: 2012. p. 153–64.
 26
Stanton I, Pinar A. Constructing and sampling graphs with a prescribed joint degree distribution. J Exp Algorithmics. 2012; 17(1):3–1.
 27
Jaccard P. Etude comparative de la distribution florale dans une portion des Alpes et du Jura. Bulletin de la Socit Vaudoise des Sciences Naturelles. 1901; 37:142.
 28
van der Maaten L, Hinton GE. Visualizing HighDimensional Data Using tSNE. J Mach Learn Res. 2008; 9:2579–605.
 29
Beisser D, Klau GW, Dandekar T, Müller T, Dittrich MT. BioNet: an RPackage for the functional analysis of biological networks,. Bioinformatics. 2010; 26(8):1129–30.
 30
Ideker T, Ozier O, Schwikowski B, Siegel AF. Discovering regulatory and signalling circuits in molecular interaction networks. Comput Appl Biosciences: CABIOS. 2002; 18 Suppl 1:233–40.
 31
Mishra GR, Suresh M, Kumaran K, Kannabiran N, Suresh S, Bala P, Shivakumar K, Anuradha N, Reddy R, Raghavan TM, Menon S, Hanumanthu G, Gupta M, Upendran S, Gupta S, Mahesh M, Jacob B, Mathew P, Chatterjee P, Arun KS, Sharma S, Chandrika KN, Deshpande N, Palvankar K, Raghavnath R, Krishnakanth R, Karathia H, Rekha B, Nayak R, Vishnupriya G, Kumar HGM, Nagini M, Kumar GSS, Jose R, Deepthi P, Mohan SS, Gandhi TKB, Harsha HC, Deshpande KS, Sarker M, Prasad TSK, Pandey A. Human protein reference database–2006 update. Nucleic Acids Res. 2006; 34(Database issue):411–4.
Acknowledgements
FI would like to thank Francesco “Ciccio” Napolitano for a number of insightful discussions.
Declarations
None.
Funding
FI has been partially supported by the European Bionformatics Institute and Wellcome Trust Sanger Institute postdoctoral (ESPOD) program.
Availability of data and materials
All the code and data objects mentioned in this manuscript and used to produce the presented results are available on Bioconductor at: https://www.bioconductor.org/packages/BiRewire/.
Authors’ contributions
FI, TC, MBF and JSR conceived the study and designed the implemented algorithms, AG designed all the mathematical proofs, implemented the algorithms and visualisation routines. FI wrote the manuscript. JSR supervised the study. GJ participated to the supervision of the study. FI and MBF performed additional analyses and modified figures and text to revise the manuscript, all the authors revised the manuscript text. All authors read and approved the final manuscript.
Competing interests
FI is an associate editor for a Biomed Central journal (BMC Medical Genomics). All the other authors declare that they have no competing interests.
Consent for publication
Not applicable.
Ethics approval and consent to participate
Not applicable.
Author information
Author notes
Affiliations
Corresponding authors
Correspondence to Francesco Iorio or Julio SaezRodriguez.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Received
Accepted
Published
DOI
Keywords
 Networks
 Pathways
 Rewiring