 Software
 Open access
 Published:
Exploring biological network structure with clustered random networks
BMC Bioinformatics volumeÂ 10, ArticleÂ number:Â 405 (2009)
Abstract
Background
Complex biological systems are often modeled as networks of interacting units. Networks of biochemical interactions among proteins, epidemiological contacts among hosts, and trophic interactions in ecosystems, to name a few, have provided useful insights into the dynamical processes that shape and traverse these systems. The degrees of nodes (numbers of interactions) and the extent of clustering (the tendency for a set of three nodes to be interconnected) are two of many wellstudied network properties that can fundamentally shape a system. Disentangling the interdependent effects of the various network properties, however, can be difficult. Simple network models can help us quantify the structure of empirical networked systems and understand the impact of various topological properties on dynamics.
Results
Here we develop and implement a new Markov chain simulation algorithm to generate simple, connected random graphs that have a specified degree sequence and level of clustering, but are random in all other respects. The implementation of the algorithm (ClustRNet: Clustered Random Networks) provides the generation of random graphs optimized according to a local or global, and relative or absolute measure of clustering. We compare our algorithm to other similar methods and show that ours more successfully produces desired network characteristics.
Finding appropriate null models is crucial in bioinformatics research, and is often difficult, particularly for biological networks. As we demonstrate, the networks generated by ClustRNet can serve as random controls when investigating the impacts of complex network features beyond the byproduct of degree and clustering in empirical networks.
Conclusion
ClustRNet generates ensembles of graphs of specified edge structure and clustering. These graphs allow for systematic study of the impacts of connectivity and redundancies on network function and dynamics. This process is a key step in unraveling the functional consequences of the structural properties of empirical biological systems and uncovering the mechanisms that drive these systems.
Background
Over the last decade, network models have advanced our understanding of biology at all scales, from gene regulatory networks to metabolic cycles to global food webs [1â€“4]. They are also driving the forefront of sociology, information technology and many other disciplines [5â€“7]. Researchers often build network models from empirical data and then seek to characterize and explain nontrivial structural properties such as heavytail degree distributions, clustering, short average path lengths, degree correlations and community structure [1, 6â€“12]. Many of these properties appear in diverse natural and manmade systems, and can fundamentally influence dynamical processes of and on these networks [13â€“19].
Clustering is a network characteristic describing the presence of triangles in a network, that is, the propensity of neighbors of a common vertex to also be neighbors with each other. (See Figure 1a and 1b.) It is an important topological characteristic that can significantly impact dynamical processes over complex networks [1, 20â€“23, 19]. Clustering is often correlated with local graph properties such as correlations in the number of edges emanating from neighboring vertices [21] and graph motifs [24, 4], as well as global properties such as community structure [25].
Clustering in biological and other empirical networks can stem from two sources: (a) it can arise as a byproduct of other, more fundamental, topological properties such as the degree sequence (distribution) or degree correlations (the dependence of a node's degree on its neighbors' degrees); or (b) it can be generated directly by some inherent property or mechanism within the system, for example, "the friends of my friends tend to become my friends" in social networks.
Some researchers have claimed that high clustering is a general feature of complex networks [21]. When we measure clustering in a variety of empirical networks, however, we find that it varies considerably. Table 1 shows that the clustering coefficients and transitivity values (a local and global measure of clustering, respectively) for these networks span the entire range of possible values (zero to one). Thus, it is important to understand not only the origins of clustering, but also the impact of clustering on network functions and dynamics. Towards this end, we introduce a method for generating random networks with a specified level of clustering.
Related Work
Random graphs are graphs that are generated by some random process [26]. They are widely used as models of complex networks [5] and can assume various levels of complexity. The simplest model for generating random graphs, with only a single parameter, is the Bernoulli or ErdÃ¶sRenyi random graph model, which produces graphs that are completely defined by their average degree and are random in all other respects. A slightly more complex and general model is one that generates graphs with a specified degree distribution (or degree sequence) and ones which are random in all other respects [27]. These models can be extended to include additional structural constraints, such as degree correlations or the density of triangles or longer cycles, as we will demonstrate below.
Existing methods for generating clustered graphs, however, do not take this approach. One of the first examples is the seminal work of Watts and Strogatz [1]. They introduced a model that produces networks with high clustering and low average path length (typical distances between pairs of nodes in the network are small), now known as the small world property. Although not intended as a generative algorithm for clustered graphs, the model produces graphs with clustering spanning the range from 0 to 1. The graphs generated under this model, however, have rigid spatial structure and cannot accommodate varying degree distributions.
The first algorithms that were designed to generate graphs with a specified level of clustering for arbitrary degree distributions belonged to the class of projected bipartite graphs. Newman [20] introduced a threestep method that first builds a bipartite graph of individuals and affiliations, then projects the bipartite graph to a unipartite graph of individuals only, and finally runs a percolation process over the unipartite graph. This results in a clustered graph with a degree distribution that depends on the original distributions of numbers of individuals per group and groups per individual. The level of clustering in the final graph varies smoothly from 0 to 1 as a function of the percolation probability. In [28], Guillaume suggested a similar bipartite graph approach. Although these approaches can generate clustered graphs with diverse degree distributions, they lack straightforward methods for choosing parameters that yield graphs with not only a prespecified clustering coefficient but also a prespecified degree distribution. These algorithms also tends to produce graphs that leave a significant proportion of the graph vertices isolated.
A second class of clustered graph models use "growing network" algorithms [29â€“31]. The inputs to these models are a degree distribution and level of clustering. The method begins with a set of vertices with no edges; the graph is then "grown" by adding edges based on the degree and clustering constraints. Although the algorithms of this class allow for arbitrary degree distributions and levels of clustering, they either require a complex implementation [29], produce graphs of a highly specific structure [31] or introduce large amounts of degree correlations [31, 30].
Finally, the family of statistical models known as exponential random graph (ERG) models [32, 33] also provide tools to fit the structure of observed networks, for statistics such as degree distribution and number of triangles. These ERG modelbased methods, although they have advanced significantly in recent years (e.g. [34]), still suffer from problems of degeneracy and computational intractability for large networks.
Our Approach
Here, we present a model that generates undirected, simple and connected graphs with prescribed degree sequences and a specified frequency of triangles, while maintaining a graph structure that is as random (uncorrelated) as possible. (A simple graph is one which contains no selfloops (edges from a node to itself) or multiedges (multiple edges between the same pair of nodes); and a connected graph is one where every node in the graph is reachable by a path of edges from every other graph node.) Prior models in this area were intended to generate clustered graphs that replicate the properties of realworld networks; our goal, on the other hand, is to generate a class of null networks with arbitrary degree distributions that are simple and connected and have a high density of triangles, but are random in all other respects.
This method thus leads to two valuable applications. First, network structure fundamentally influences the functions of and dynamical processes on networks. We can use clustered random graphs to systematically study the consequences of clustering, both independently and in combination with various degree patterns. Second, these networks can serve as null models for detecting whether an empirical network can be boiled down to its degree distribution and clustering values or, instead, contains substantial degree correlations or other important structures (beyond the byproducts of the degree distribution and clustering). One would first use the algorithm to generate an ensemble of networks that match the empirical degree sequences and clustering values, and then compare the structural, functional, or dynamical properties of the empirical network to those of the clustered random networks. We focus here on the role of these networks as null models as it is crucial to have appropriate random controls in the study of biological systems, as has been demonstrated in [24, 35, 36].
The rest of this article is organized as follows. In the Implementation section, we review common measures of clustering and introduce our Markov chain model and algorithm for generating clustered graphs with a specified degree sequence. In the Results section, we test our algorithm with numerical simulations and explore the structural properties of the generated graphs. The Discussion section is devoted to a demonstration of the randomly generated clustered networks as null networks for the analysis of empirical networks. We finish off with our conclusions, presenting the benefits of our Markov Chain simulation method for biological networks.
Implementation
Our clustered random graph generation method begins with a random graph and iteratively rewires edges to introduce triangles. Network rewiring, also known as edge swapping, is a wellknown method for generating networks with desired properties [37, 36, 38]. Two edges are called adjacent if they connect to a common node. Each rewiring is performed on two nonadjacent edges of the graph and consists of removing these two edges and replacing them with another pair of edges. Specifically, a pair of edges (i, j) and (k, l) is replaced with either (i, k) and (j, l), or (i, l) and (j, k) (as illustrated in Figure 1c). This change in the graph leaves the degrees of the participating nodes unchanged, thus maintaining the specified degree sequence. Below we describe a rewiring algorithm that increases the level of clustering in a random graph, while preserving the degree sequence.
The algorithm we develop below is implemented in Python as ClustRNet. It is based on Networkx, an opensource Python library available for download at [39], which provides standard graph library functionality (e.g. data structure, input/output, and layouts). The source code for ClustRNet, along with documentation and test network datasets, is available on the web [40]. Our algorithm joins a existing suite of random graph modelbased software tools for the analysis of biological networks and the dynamics on them [41, 42].
Measures of Clustering
We begin with a graph G = (V, E) which is undirected and simple. V is the set of vertices of G and E is the set of the edges. We let N = V and M = E denote the number of nodes and edges in G, respectively. The degree of a node i will be denoted d_{ i }. The set of degrees for all nodes in the graph makes up the degree sequence, which follows a probability distribution called the degree distribution.
Clustering is the likelihood that two neighbors of a given node are themselves connected. In topological terms, clustering measures the density of triangles in the graph, where a triangle is the existence of the set of edges (i, j), (i, k), (j, k) between any triplet of nodes i, j, k (Figure 1b).
To quantify the local presence of triangles, Î´(i) is defined as the number of triangles in which node i participates. Since each triangle consists of three nodes, it is counted thrice when we sum Î´(i) for each node in the graph. Thus the total number of triangles in the graph is
A triple is a set of three nodes, i, j, k that are connected by edges (i, j) and (i, k), regardless of the existence of the edge (j, k) (Figure 1a). The number of triples of node i is simply
assuming d_{ i }â‰¥ 2. To compute the total number of triples in the graph, Ï„(G), we sum Ï„(i) for all i âˆˆ V.
The clustering coefficient was introduced by Watts and Strogatz [1] as a local measure of triadic closure. For a node i with d_{ i }â‰¥ 2, the clustering coefficient c(i) is the fraction of triples for node i which are closed, and can be measured as Î´(i) = Ï„(i). The clustering coefficient of the graph is then given by:
where N_{2} is the number of nodes with c(i) â‰¥ 0. Some authors do define the clustering coefficient for all nodes of G [43].
A more global measure of the presence of triangles is called the transitivity of graph G and is defined as:
Although they are often similar, T(G) and C(G) can vary by orders of magnitude [22]. They differ most when the triangles are heterogeneously distributed in the graph.
These traditional measures of clustering are degreedependent and thus can be biased by the degree sequence of the network. The maximum number of possible triangles for a given node i is just its number of triples (Ï„(i)). For a node which is connected to only low degree neighbors, however, the maximum number of possible triangles may be much smaller than Ï„(i). To account for this, a new measure for clustering was introduced in [22] that calculates triadic closure as a function of degree and neighbor degree. Specifically, the SofferVasquez clustering coefficient () and transitivity () are given by:
where Ï‰(i) measures the number of possible triangles for node i, and N_{ Ï‰ }is the number of nodes in G for which Ï‰(i) > 0. We note that and are undefined if Ï‰(G) = Î£_{ i }Ï‰(i) = 0. Ï‰(i) is computed by counting the maximum number of edges that can be drawn among the d_{ i }neighbors of a node i, given the degree sequence of i's neighbors; this value is often smaller than [22]. For example, consider a star network of five nodes, where four nodes have degree 1 and one node has degree 4. Although the total number of triples is Ï„(G) = 6, the number of possible triangles is Ï‰(G) = 0 because the degree one nodes preclude their formation. The computation of Ï‰(i) must be done algorithmically and is not possible in closed form. (From here on, we refer to as the SVclustering coefficient and to as the SVtransitivity.)
Generative Model
Here we develop a model to generate a simply connected random graph with a specified degree sequence and a desired level of clustering. Generating random graphs uniformly from the set of simply connected graphs with a prescribed degree sequence is a wellstudied problem with algorithmic solutions [37]. One of the simplest and most popular of these generative algorithms was suggested by Molloy and Reed and is known as the configuration model [27]. Given a specific realizable degree sequence [44], {d_{ i }}, this method assigns d_{ j }halfedges to each node j, and then randomly connects pairs halfedges to create edges until there are no halfedges left. (A realizable degree sequence is one which satisfies the Handshake Theorem (the requirement that the sum of the degrees be even) and the ErdosGallai criterion (which requires that for each subset of the k highest degree nodes, the degrees of these nodes can be "absorbed" within the subset and the remaining degrees.) Although the model sometimes produces graphs that are not simple or connected, this can be remedied by subsequently removing multiple edges and self loops from the constructed graph and keeping only the largest connected component [37]. Our method begins by using this approach to generate a simple, connected random graph G, with a specific realizable degree sequence D. We then introduce triangles into G using a Markov Chain process without disturbing the degree sequence until we achieve the desired level of clustering, as follows.
Let G_{ D }be the set of all simple, connected graphs with degree sequence D. If are the graphs of G_{ D }, then we let be the states of the Markov chain, P, where X_{ i }represents the state in which our graph G = G_{ i }. The states X_{ i }and X_{i+1}are connected in the Markov Chain if G_{ i }can be changed to G_{i+1}with the rewiring of one pair of edges. The state space of the Markov chain P is connected because there exists a path from X_{ i }to X_{ j }(for any pair i, j) by one or more rewiring moves that leave the degree sequence unchanged [45].
Our clustered graph generation algorithm involves starting with the random graph G (generated with the configuration model above) and transitioning from the state corresponding to G (X_{ G }) to other states of P until a halting condition is reached. A transition from one state of the Markov chain to another only occurs when the algorithm makes an edge rewiring that both increases the clustering of the graph and leaves the graph connected. Since a rewiring does not alter the degree sequence of the graph, the rewired graph is still in G_{ D }. The transition probabilities of the Markov chain for a pair of connected states, X_{ i }to X_{ j }, are:
where clust(G_{ x }) is a clustering measure for graph G_{ x }, which can be replaced by any of the measures introduced in Section. The algorithm continues searching for a feasible rewiring (one that increases the clustering and does not disconnect the graph) until one is found. If a feasible move is not found, a transition is not made and the process remains in the current state.
The Markov chain above is finite and aperiodic, but not irreducible as the process can never transition to a state in which the graph has lower clustering. It does, however, have an absorbing state, X_{*}, in which the transitivity of G_{*} is greater than or equal to the desired transitivity or is the maximum possible transitivity given the particular degree sequence and connectivity constraints.
Algorithm
To generate clustered graphs, we apply the above Markov Chain simulation model by iteratively applying rewirings that increase graph clustering. Each rewiring takes a set of five nodes {x, y_{1}, y_{2}, z_{1}, z_{2}}, connected by four edges {(x, y_{1}), (x, y_{2}), (y_{1}, z_{1}), (y_{2}, z_{2})}, and swaps the outer edges: {(x, y_{1}), (x, y_{2}), (y_{1}, y_{2}), (z_{1}, z_{2})}(illustrated in Figure 1d). This introduces a triangle among nodes {x, y_{1}, and y_{2}}, without perturbing the degree sequence. The algorithm proceeds as follows:
Input: A realizable degree sequence {d_{ i }} a desired clustering value, target
Initialization: Generate a random graph G with degree sequence {d_{ i }} (using the configuration model), and measure the clustering of G, clust(G).
while clust(G) <target do
1. uniformly select a random node, x, from the
set of all nodes of G such that d_{ x }> 1.
2. uniformly select two random neighbors, y_{1}
and y_{2}, of x such that d_{y 1}> 1 and
d_{y 2}> 1 and y_{1}â‰ y_{2}.
3. uniformly select a random neighbor, z_{1}
of y_{1} and a random neighbor, z_{2} of
y_{2} such that z_{1} â‰ x, z_{2} â‰ x,
z_{1} â‰ z_{2}.
4. G_{ cand }: = G where G_{ cand }is the candidate
graph to which the transition may be made.
5. if (y_{1}, y_{2}) and (z_{1}, z_{2}) do not exist then
Rewire two edges of G_{ cand }: delete (y_{1}, z_{1}) and (y_{2}, z_{2}), add (y_{1}, y_{2}) and (z_{1}, z_{2}).
end
6. Update the value of clust(G_{ cand }) by measuring
Î´ (i) (and Ï‰ (i) if relevant) for the nodes involved
in the rewiring and their neighbors.
7. if clust(G_{ cand }) > clust(G) and G_{ cand }
is connected then
G: = G_{ cand }
end
end
Output: A random graph, G with degree sequence {d_{ i }} and clust(G) â‰¥ target.
The algorithm terminates when the graph attains at least the desired level of clustering or reaches a threshold number of unsuccessful rewiring attempts. In the latter case, the algorithm returns the graph with the maximum clustering achieved. For practical purposes, a threshold is placed on the number of unsuccessful attempts made by the algorithm in ClustRNet for the case that the desired clustering cannot be reached. Due to the random restarts made at every step, the algorithm is prevented from getting trapped in local minima.
The algorithm is designed to increase clustering while preserving both the degree sequence and connectedness of the graph. However, there are some cases where the desired clustering can only be reached by disconnecting the graph; and thus ClustRNet provides the option of removing the connectivity constraint (see Additional file 1, Figure S2).
Choice of Clustering Measure
The algorithm is defined independent of the choice of clustering measure. The term clust(G) in the algorithm above can be replaced by any clustering measure described in Section. ClustRNet includes all four of these clustering measures (C, , T; ).
The algorithm output varies with the choice of clustering measure. The clustering coefficient is a local measure; and thus C and yield networks that are only locally optimized for the desired level of clustering. The algorithm may have difficulty attaining target clustering values when using the absolute clustering measures (C or T) because of joint degree constraints (the degrees of adjacent nodes) on the possible numbers of triangles, as with the example presented in Section. The SofferVasquez clustering measures, which explicitly consider joint degree constraints, provide a way around this difficulty [22]. Although the rewiring in our algorithm changes the joint degree distribution (and thus the degree correlations) of the graph, Ï‰(G) is not altered significantly during network generation (as shown in Additional file 1, Figure S3). Thus, when using or , clustering is increased primarily by the addition of triangles (that is, increasing Î´ (G)) rather than decreasing Ï‰(G)).
Types of Graph Changes
As shown in Figure 2, there are six types of triangles that can be added or removed for every pair of edges that are rewired. As illustrated in Figure 1d, these additions and removals can occur in combination.

Type A: The addition of the edge between vertices y_{1} and y_{2} guarantees the addition of one triangle in every rewiring event.

Type B: The addition of the edge (y_{1}, y_{2}) could create new triangles with shared neighbors of y_{1} and y_{2}.

Type C: The addition of the edge (z_{1}, z_{2}) could add a triangle if there existed edges between x and z_{1} and x and z_{2}.

Type D: The addition of the edge between vertices z_{1} and z_{2} could create new triangles with shared neighbors of z_{1} and z_{2}.

Type E: The removal of edges (y_{1}, z_{1}) and (y_{2}, z_{2}) removes one triangle each if the edges (x, z_{1}) or (x, z_{2}) exist.

Type F: The removal of the edges between vertices y_{1} and z_{1}, and y_{2} and z_{2} could lead to the removal of existing triangles with shared neighbors of y_{1} and z_{1} or y_{2} and z_{2}.
We note that although the type A addition is a special case of type B, the type C addition is a special case of type D, and the type E removals are a special case of type F, we distinguish them because they have different probabilities of occurrence. Our lookahead strategy only allows rewiring moves when the total number of Type E and F losses is fewer than the total number of Type A, B, C, and D gains.
Computational Complexity
Like many heuristic search methods, the algorithm we propose can be computationally expensive. The method outlined in Section 2.2 requires O(M) steps to generate a connected graph, and up to O(M) steps to randomize the graph, where M is the number of edges in the graph. At each step of randomization, we test that the graph remains connected (an O(M) operation), resulting in an overall O(M^{2}) random network generation process. A naive computation of the transitivity/clustering coefficient requires checking every node for the existence of edges between every pair of neighbors of the node. This step requires O() operations, where N is the number of nodes and d_{ max }is the maximum degree of any node in the graph. The most expensive step of our algorithm is the introduction of triangles via rewiring. A single rewiring step requires O(M) operations for switching edges, checking for connectivity and updating the clustering measure. Although we cannot analytically calculate the number of attempted rewiring steps required to reach the desired transitivity, we have found it empirically to be O(M). Thus, the average complexity of the clustered network algorithm presented here is O(M^{2}). This complexity has been computed for the most naive versions of our algorithms; and more efficient implementations may improve the complexity greatly. For example, we might improve efficiency by performing connectivity tests once every x rewirings (for some number x) rather than during every rewiring, as proposed in [46].
Results
Performance
To test our algorithm, we generate networks with three different degree distributions and for a range of clustering target values. Specifically, we use Poisson (p_{ d }= e^{Î»}Î»^{d}/d!), exponential (p_{ d }= (1  e^{Îº})e^{Îº(d1)}) and a truncated scalefree (p_{ d }= d^{Î³}e^{d/Îº}/Li_{ Î³ }(e^{1/Îº})) degree distribution, each with a mean degree of five. Starting with random graphs with specific degree sequences matching these degree distributions, we rewire the networks towards (1) SVtransitivity (()) targets and (2) transitivity (T) targets in addition to allowing the algorithm to generate disconnected graphs. These targets allow us to evaluate how the clustering measure and connectivity requirement constrain the results, and the second target, in particular, allows us to compare results to other algorithms. Figure 3 illustrates the rewiring of a network with a Poisson distributed degree sequence evolving towards higher transitivity.
We evaluate the performance of our algorithm in comparison to one representative network growth algorithm [30] and one representative bipartite network method [20]. Specifically, we measured the discrepancies between input and output degree distributions (Figure 4 left graphs) and transitivity values (Figure 4, right graphs). Our algorithm preserves the input degree sequence perfectly, while there are considerable mismatches between the input and output degree distributions in the Volz and Newman models. For both comparisons, the transitivity values of the output graphs from our algorithm exactly match the target transitivity values, when those values can be attained given the network topology and the requirements of the algorithm. Some values at the lower end of the clustering scales cannot be reached because the expected transitivity for random graphs of specified degree distributions scales as where p_{ k }is the degree distribution [21, 8, 43]. This value is small for the Poisson degree distribution but can be quite high (especially when measured as SVtransitivity) for highlyskewed degree distributions such as the scalefree degree distribution. For the first comparison, the connectivity constraint imposes a maximum on the attainable clustering value, thus the highest SVtransitivity values cannot be reached without disconnecting the graphs. In these cases, our algorithm returns the graph with the largest attainable SVtransitivity that is less than the desired SVtransitivity. For the second comparison, (with requirements to match the other algorithms), our algorithm performs better in all cases compared to the Volz and Newman models. Due to the definition of the standard transitivity measure (T), however, we see that the networks reach a maximum T value, beyond which no further clustering can be accommodated by the network topology.
Structural Properties of Generated Networks
There are several other topological properties (besides degree sequence and clustering) that can strongly influence network function and dynamics. Among these are degree correlations (the dependence of a node's degree on its neighbors' degrees), community structure (groups of nodes that are highly intraconnected and only loosely interconnected), and average path length (typical distances between pairs of nodes in the network). We have specifically developed this model to increase clustering with minimal structural byproducts. Thus, we confirm that we have reached this goal by measuring the above properties in the networks generated by our algorithm.
We evaluated the extent to which the algorithm introduces degree correlations by comparing random (unclustered) graphs to clustered random graphs generated by our algorithm and the Volz [30] and Newman [20] algorithms (Figure 5. While our algorithm essentially preserves the correlation structure of the random graph, the other algorithms produce highly correlated graphs. Results are not shown for scalefree graphs as initial transitivity values were larger than 0.5 for all generated graphs.
Several authors have discussed the relationship between clustering and community structure [8, 25, 47, 21]. As Figure 3 shows, the addition of triangles leads to modular structure. This behavior is not surprising: as the number of edges in the graph is constrained, sets of connected nodes with high Ï‰(i) values (often highdegree nodes) must be brought together to create additional clustering. Although the presence of a significant proportion of triangles tends to separate the network into modules, it is not clear that clustering is always sufficient to explain the modular structure of a graph. We explore this further below.
Short average path lengths are a characteristic feature of random graphs [26]. To quantify the impact of our algorithm on path lengths, we calculated the average path length for each node to all other (N  1) nodes, and then compared the distributions of these values for several random and random clustered graphs (Figure 5). While our algorithm mostly maintains short average path lengths, the mean of the path length distribution does tend to be slightly larger for the clustered graphs than for the corresponding random graphs. The intuition behind this increase in average path length may lie in the increased community structure: as graphs become more clustered and separate into subgroups, nodes in different groups require more links to reach each other (Figure 3). Given that our algorithm can generate graphs of high clustering while preserving short path lengths, this introduces a novel method of generating graphs with the small world property without the correlations of WattsStrogatz graphs [1].
Discussion
Application: Analysis of Empirical Networks
It is crucial to have random controls in the study of biological systems. Our algorithm can be used to generate null models and applied to the detection of structure in empirical biological networks. We can generate ensembles of clustered random networks with empirically estimated degree sequences and clustering values to ascertain whether empirical networks have significant nonrandom structure in other respects. We demonstrate this application using representatives from four classes of biological networks. We also analyze one nonbiological network that is made of human transportation links as it provides contrast to the range of topological properties and design principles found in the biologicallymotivated networks. The five real networks are as follows: a) a trophic exchange network for the Little Rock Lake in Wisconsin [48]; b) a protein interaction network for yeast [3]; c) a metabolic network for the eukaryote Caenorhabditis elegans [49]; d) a network made up of epidemiologicallyrelevant contacts for individuals in the city of Vancouver [13]; and e) a transportation network, made up of US metropolitan areas connected by air travel [50]. These networks represent a diverse set of applications and are systems that are wellstudied in their respective literatures. The basic statistics of these networks, including clustering values, are listed in Table 1.
We use the following method to quantify deviations from randomness in these networks. First, we use our algorithm to generate 25 clustered random networks constrained to match the empirical degree sequence and clustering values. Second, we select a set of network topological measures (other than degree distribution and clustering), and compare these quantities for the empirical graph to the corresponding average quantities across the ensemble of generated graphs.
Specifically, we generate 25 clustered random networks for each empirical network, constrained to match the empirical degree sequence and SVtransitivity. In addition to the degree and clustering metrics, we also calculated diameter (longest shortest path length between any pair of nodes in the graph) [51], degree correlation coefficient [11] and modularity (degree of community structure) [52] (Table 2). Other than diameter, each of these metrics range from 0 to 1. The standard deviations for all statistics are negligible across the ensembles and thus not reported. For every statistic, we also give the deviation between the empirical value and the average across the generated ensemble of random clustered networks (specifically, deviation = ensemble mean  observed value). Small deviations suggest that the empirical network structure boils down to the degree distribution and clustering, and thus we turn our attention to possible mechanisms underlying these properties. In contrast, large deviations suggest that there are other fundamental properties to consider in addition to or, perhaps, instead of clustering.
Of all the empirical networks analyzed, the random counterparts of the the US air traffic network are the only ones that have structural properties almost identical to the real network (with the network of Vancouver epidemiological contacts being the next closest). This suggests that the structure of the US air traffic network comes almost exclusively from its degree patterns. (In fact, even the high clustering is explained exclusively by the degree patterns.) We note that the US air traffic network is the only nonbiological one and the most engineered of the networks we consider, and thus may have fewer emergent properties. The remaining empirical networks (all biological) differ considerably from their random counterparts, suggesting that there are important mechanistic features not captured in the random model.
Degree correlations vary somewhat systematically among the four biological networks (Table 2). The Vancouver human epidemiological contact network has significantly higher degree assortativity than our random networks, thus showing that the positive degree correlations are not just the result of degree distribution or clustering, both of which have been found to be positively correlated with assortativity [53]. This suggests the existence of social rules among humans that go beyond (a) variation in numbers of "friends" and (b) the tendency for "my friend's friend also to be my friend" [11]. The remaining biological networks (the yeast protein interactions, the Little Rock Lake foodweb, and the C. elegans metabolic networks), on the other hand, all have negative degree correlations. Our results show that the C. elegans metabolic network, in particular, has degree correlations approximately equal to the amount expected to arise as a random byproduct of degree distribution and clustering. One reason that a biological network only show random degree correlations might be due to the lack of a clear functional or structural advantage for strong correlations: negatively correlated networks are vulnerable to failures because functionality often depends on a few high degree nodes that provide essential connectivity. If any of these fail (e.g., because of a gene deletion in a metabolic network) the whole system fails [11, 12]. On the other hand, positively correlated networks, which have short distances between hub (highdegree) nodes, may be less favorable because they allow for the propagation of random perturbations (e.g., changes in the concentration of a protein in a proteininteraction network) [36].
All of the natural networks we study have significantly higher modularity than the corresponding clustered random networks, despite having a wide range of transitivity values. This suggests that clustering and community structure are not necessarily positively correlated, as has been previously suggested [52, 8]. The high modularity of the Little Rock foodweb, in particular, has been attributed to its high clustering [54]. Our generated clustered random graphs, however, indicate that the degree distribution and high transitivity only account for about half the modularity of the foodweb graph (Table 2). There is an extensive literature on the presence and evolution of modularity in protein, metabolic, and ecological networks highlighting its possible roles in functional specialization, innovation and robustness [55â€“60]. Since clustering and the mechanisms that give rise to it cannot fully account for the modularity of these empirical networks, such mechanistic explanations for the structure are warranted.
Conclusions
In this work, we have introduced a Markov chain simulation algorithm to generate clustered random graphs with a specified degree sequence and level of clustering. Our algorithm perfectly preserves the degree sequence of a random graph and generally maintains other fundamental properties of random graphs like short path length and low degree correlations. The use of random graphs as controls is a common and effective method for identifying important structural characteristics of biological networks (as, for example, has been seen in [61, 54, 62, 49, 13]). Our method provides a new null model for use with this technique. Since this method is based on a dynamic process, it can be used to generate both static networks with a specified amount of clustering and dynamic networks with evolving levels of clustering. Furthermore, since the process is a "memoryless" one, additional clustering can be added to any network without having to grow a new one from scratch. These clustered networks can provide valuable insights into the interdependent impacts of connectedness and redundancy on biological processes, and serve as appropriate null models for investigating the biological significance of other structural attributes.
Availability and Requirements

Project name: ClustRNet

Project home page: http://sbansal.com/ClustRNet/

Operating system(s): Platform independent

Programming language: Python 2.5

Other requirements: Networkx Python package 2.5

License: BSDstyle

Any restrictions to use by nonacademics: None
References
Watts D, Strogatz SH: Collective dynamics of small world networks. Nature 1998., 393(441):
Ulanowicz RE, Bondavalli C, Egnotovich MS: Network analysis of trophic dynamics in south florida ecosystem, FY 97: The florida bay ecosystem. Technical Report Ref. No. [UMCES] CBL 1998, 98â€“123.
Colizza V, Flammini A, Maritan A, Vespignani A: Characterization and modeling of proteinprotein interaction networks. Physica A 2005, 352: 1â€“27. 10.1016/j.physa.2004.12.030
Vazquez A, Dobrin R, Sergi D, Eckmann JP, Oltvai ZN, BarabÃ¡si AL: The topological relationship between the largescale attributes and local interaction patterns of complex networks. Proc Natl Acad Sci USA 2004, 101(52):17940â€“17945. 10.1073/pnas.0406024101
Newman MEJ, Watts DJ, Strogatz SH: Random graph models of social networks. Proc Natl Acad Sci 2002., 99(2566):
Albert R, Jeong H, Barabasi AL: Diameter of the worldwide web. Nature 1999, 401: 130â€“131. 10.1038/43601
Faloutsos M, Faloutsos P, Faloutsos C: On powerlaw relationships of the internet topology. Proceedings of the Conference on applications, technologies, architectures, and protocols for computer communications 1999, 251â€“262. full_text
Newman MEJ, Park J: Why social networks are different from other types of networks. Phys Rev E 2003., 68(036122):
Newman MEJ: Scientific collaboration networks: II. Shortest paths, weighted networks, and centrality. Phys Rev E 2001, 64(1):016132. 10.1103/PhysRevE.64.016132
Girvan M, Newman MEJ: Community structure in social and biological networks. Proc Natl Acad Sci USA 2002, 99(12):7821â€“7826. 10.1073/pnas.122653799
Newman MEJ: Assortative mixing in networks. Phys Rev Lett 2002, 89.
Friedel CC, Zimmer R: Influence of degree correlations on network structure and stability in proteinprotein interaction networks. BMC Bioinformatics 2007, 8: 297. 10.1186/147121058297
Meyers LA, Pourbohloul B, Newman MEJ, Skowronski DM, Brunham RC: Network theory and sars: predicting outbreak diversity. J Theo Biol 2005, 232: 71â€“81. 10.1016/j.jtbi.2004.07.026
Keeling MJ, Eames KTD: Networks and epidemic models. J R Soc Interface 2005, 2: 295â€“307. 10.1098/rsif.2005.0051
Albert R, Barabasi AL: Statistical mechanics of complex networks. Reviews of Modern Physics 2002, 74: 47â€“97. 10.1103/RevModPhys.74.47
Albert R, Jeong H, Barabasi AL: Error and attack tolerance of complex networks. Nature 2000, 406: 378â€“382. 10.1038/35019019
Bansal S, Grenfell B, Meyers LA: When individual behavior matters. J R Soc Interface 2007., 4(16): 10.1098/rsif.2007.1100
Keeling MJ: The implications of network structure for epidemic dynamics. Theo Pop Biol 2005, 67: 1â€“8. 10.1016/j.tpb.2004.08.002
Keeling MJ: The effects of local spatial structure on epidemiological invasions. Proc R Soc B 1999, 266: 859â€“867. 10.1098/rspb.1999.0716
Newman MEJ: Properties of highly clustered networks. Phys Rev E 2003., 68(026121):
Serrano M, Boguna M: Clustering in complex networks i. Phys Rev E 2006., 74(056114):
Soffer S, Vazquez A: Network clustering coefficient without degreecorrelation biases. Phys Rev E 2005., 71(057101):
Petermann T, Rios PDL: The role of clustering and gridlike odering in epidemic spreading. Phys Rev E 2004., 69(066116):
Milo R, ShenOrr S, Itzkovitz S, Kashtan N, Chklovskii D, Alon U: Network motifs: Simple building blocks of complex networks. Science 2002, 298: 824â€“827. 10.1126/science.298.5594.824
Radicchi F, Castellano C, Cecconi F, Loreto V, Parisi D: Defining and identifying communities in networks. PNAS 2004, 101(9):2658â€“2663. 10.1073/pnas.0400054101
Newman MEJ, Strogatz SH, Watts DJ: Random graphs with arbitrary degree distributions and their applications. Phys Rev E 2001, 64: 026118. 10.1103/PhysRevE.64.026118
Molloy M, Reed B: A critical point for random graphs with a given degree sequence. Random Struct Algo 1995., 6(161):
Guillaume J, Latapy M: Bipartite graphs as models of complex networks. Lecture Notes in Computer Science 2005, 3405: 127â€“139.
Boguna M, PastorSatorras R, Vespignani A: Statistical Mechanics of Complex Networks, of Lecture Notes in Physics, chapter Epidemic spreading in complex networks with degree correlations. Volume 625. Springer Berlin; 2003:127â€“47.
Volz E: Random networks with tunable degree distribution and clustering. Phys Rev E 2004., 70(056115):
Trapman P: On stochastic models for the spread of infections. PhD thesis, Vrije Universiteit Amsterdam; 2007.
Robins G, Pattison P, Kalish Y, Lusher D: An introduction to exponential random graph (p*) models for social networks. Social Networks 2007, 29(2):173â€“91. 10.1016/j.socnet.2006.08.002
Snijders T, Pattison PE, Robins GL, Handcock MS: New specifications for exponential random graph models. Sociol Methodol 2006, 36(1):99â€“133. 10.1111/j.14679531.2006.00176.x
Goodreau S: Advances in exponential random graph (p*) models applied to a large social network. Social Networks 2007, 29: 231â€“48. 10.1016/j.socnet.2006.08.001
ArtzyRandrup Y, Fleishman SJ, BenTal N, Stone L: Comment on "Network Motifs: Simple Building Blocks of Complex Networks" and "Superfamilies of Evolved and Designed Networks". Science 2004, 205: 1107. 10.1126/science.1099334
Maslov S, Sneppen K: Specificity and stability in topology of protein networks. Science 2002, 296: 910. 10.1126/science.1065103
Milo R, Kashtan N, Itzkovitz S, Newman MEJ, Alon U: Subgraphs in networks. Phys Rev E 2004., 70(058102):
Gale D: A theorem on flows in networks. Pac J Math 1957, 7: 1073.
Networks[http://networkx.lanl.gov/]
Clustrnet[http://sbansal.com/clustrnet]
Graphcrunch[http://www.ics.uci.edu/~bionets/graphcrunch/]
Newman MEJ: The structure and function of complex networks. SIAM Review 2003, 45: 167â€“256. 10.1137/S003614450342480
Erdos P, Gallai T: Graphs with prescribed degree of vertices. Mat Lapok 1960, 11: 264â€“274.
Taylor R: Constrained switchings in graphs. Comb Mat 1980., 8:
Gkantsidis C, Mihail M, Zegura E: The markov chain simulation method for generating connected power law random graphs. Proc 5th Workshop on Algorithm Engineering and Experiments (ALENEX.SIAM) 2003.
Ravasz E, Barabasi AL: Hierarchical organization in complex networks. Phys Rev E 2003., 67(026112):
Martinez ND: Artifacts or attributes? effects of resolution on the little rock lake food web. Ecol Monogr 1991, 61: 367â€“392. 10.2307/2937047
Albert R, Oltvai ZN, Barabasi AL, Jeong H, Tombor B: The largescale organization of metabolic networks. Nature 2000, 407: 651â€“654. 10.1038/35036627
US Bureau of Transportation Statistics[http://www.transtats.bts.gov]
Harary F: Graph Theory. Oxford University Press, London; 1969.
Newman MEJ: Detecting community structure in networks. Eur Phys J B 2004, 38: 321â€“330. 10.1140/epjb/e200400124y
Holme P, Zhao J: Exploring the assortativityclustering space of a networks degree sequence. Phys Rev E 2007, 75: 046111. 10.1103/PhysRevE.75.046111
Montoya J, Sole R: Small world patterns in food webs. J Theo Bio 2002, 214: 405â€“412. 10.1006/jtbi.2001.2460
Pimm SL, Lawton JH: Are food webs divided into compartments? J Anim Ecol 1980, 49: 879898.
Yodzis P: The compartmentation of real and assembled foodwebs. American Naturalist 1982, 120: 551570.
Gophna U, Kreimer A, Borenstein E, Ruppin E: The evolution of modularity in bacterial metabolic networks. PNAS 2008, 105: 6976â€“6981. 10.1073/pnas.0712149105
Kashtan N, Alon U: Spontaneous evolution of modularity and network motifs. PNAS 2005, 102(39):13773â€“13778. 10.1073/pnas.0503610102
Ricard V Sol SV, RodriguezCaso C: Modularity in Biological Networks. In Biological Networks. World Scientific; 2008.
Hartwell LH, Hopfield JJ, Leibler S, Murray AW: From molecular to modular cell biology. Nature 1999., 402(6761 Suppl):
Dunne J, Williams R, Martinez N: Foodweb structure and network theory: The role of connectance and size. PNAS 2002, 99: 12917â€“22. 10.1073/pnas.192407699
Wagner A: Yeast protein interaction network evolves repidly and contains few redundant duplicate genes. Mol Biol Evol 2001, 18: 1283â€“92.
Acknowledgements
The authors acknowledge valuable feedback from Joel Miller, Mark Newman, Erik Volz, Alberto Segre Ted Herman, and two anonymous reviewers. SB acknowledges financial support from the University of Texas at Austin. LAM acknowledges support from the McDonnell Foundation and NSF grant DEB0749097.
Author information
Authors and Affiliations
Corresponding author
Additional information
Authors' contributions
SB, SK and LAM contributed to algorithm design, implementation and manuscript writing. All authors read and approved the final manuscript.
Electronic supplementary material
Authorsâ€™ original submitted files for images
Below are the links to the authorsâ€™ original submitted files for images.
Rights and permissions
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Bansal, S., Khandelwal, S. & Meyers, L.A. Exploring biological network structure with clustered random networks. BMC Bioinformatics 10, 405 (2009). https://doi.org/10.1186/1471210510405
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/1471210510405