 Software
 Open Access
 Published:
Optimising orbit counting of arbitrary order by equation selection
BMC Bioinformatics volume 20, Article number: 27 (2019)
Abstract
Background
Graphlets are useful for bioinformatics network analysis. Based on the structure of Hočevar and Demšar’s ORCA algorithm, we have created an orbit counting algorithm, named Jesse. This algorithm, like ORCA, uses equations to count the orbits, but unlike ORCA it can count graphlets of any order. To do so, it generates the required internal structures and equations automatically. Many more redundant equations are generated, however, and Jesse’s running time is highly dependent on which of these equations are used. Therefore, this paper aims to investigate which equations are most efficient, and which factors have an effect on this efficiency.
Results
With appropriate equation selection, Jesse’s running time may be reduced by a factor of up to 2 in the best case, compared to using randomly selected equations. Which equations are most efficient depends on the density of the graph, but barely on the graph type. At low graph density, equations with terms in their righthand side with few arguments are more efficient, whereas at high density, equations with terms with many arguments in the righthand side are most efficient. At a density between 0.6 and 0.7, both types of equations are about equally efficient.
Conclusions
Our Jesse algorithm became up to a factor 2 more efficient, by automatically selecting the best equations based on graph density. It was adapted into a Cytoscape App that is freely available from the Cytoscape App Store to ease application by bioinformaticians.
Background
The smallscale structure of a graph contains important information about that graph’s function. Network motifs [1] are defined as subgraphs of a larger graph that appear significantly more often in that large graph than would be expected in a purely random graph with the same number of nodes and edges. It was found that motifs can easily be used to distinguish networks of different functions from each other, like genetic transcription networks from ecosystem food webs [1]. To know whether a certain subgraph is a motif in a specific explored graph, its expected number of appearances in random graphs should be known. This means the subgraph must be counted in a large number of random graphs [1]. This may be sped up by sampling [2] or parallellisation [3], but the random graphs are still needed.
It was first proposed in [4] not to restrict interest to those subgraphs that appear more often than expected. Instead, PPI networks were analysed by counting all small connected, induced subgraphs. These subgraphs are called graphlets. All graphlets on 2 to 5 nodes are shown in Fig. 1. They are all assigned a unique identification number, which can be used to refer to that specific graphlet (shown under each graphlet in Fig. 1). Originally, graphlets were restricted to 5 or fewer nodes because of limitations in computing power. Later research [5, 6] increased that number of nodes. Regardless of the exact computing power available, the exponentially exploding number of graphlets enforces the use of some cutoff on the number of nodes in a graphlet. Therefore, if the term “all graphlets” is used in this paper, it means “all graphlets on k or fewer nodes”, with k some arbitrary but fixed cutoff.
Each graphlet’s nodes can be subdivided into symmetrically equivalent sets, called orbits [7]. For example, consider graphlet 1, the threenode path, in Fig. 1. By mirroring the graphlet, the two outside nodes can be swapped, which does not change the graphlet’s structure. Therefore, these two nodes are contained in the same orbit. The middle node can never be interchanged with either of the outside nodes without changing the graphlet’s structure. This means that this node is in a different orbit. In Fig. 1, the outer nodes of graphlet 1 are coloured black, whereas the middle node is coloured white, to indicate their respective orbits. Likewise, in all other graphlets in Fig. 1, the nodes are shaded according to their orbit. Like graphlets, orbits are numbered. These numbers are unique across all graphlets, so an orbit number can be used to identify both the orbit and its graphlet. In Fig. 1, the number of each orbit is indicated close to one of its nodes.
When a graphlet is found in an explored graph, it is possible to determine which graph node is in what orbit of that graphlet. That orbit is then said to touch that node. The number of times orbit i touches node v is called v’s ith graphlet degree [7]. Graphlet degrees are an extension of a node’s degree, which itself is equivalent to the 0th graphlet degree, i.e. the graphlet degree of the 2node graphlet. As an extension of a graph’s degree distribution, the distribution of all of the graphlet degrees can be calculated, which is called the graph’s graphlet degree distribution or GDD. These graphlet degree distributions themselves are a useful tool for network comparison [7] and identification of nodes’ function [8].
To calculate a graph’s GDD, it seems at first sight that all graphlets within that graph need to be found. However, it was proved in [9] that this is not the case. They showed that, to calculate a node’s graphlet degrees (using graphlets on up to k nodes), a system of linear equations can be composed from all graphlets on k−1 nodes and all common neighbours of up to k−2 nodes in the explored graph. Solving this system of equations then results in the node’s graphlet degrees. Using equations allows part of the calculation to be done in advance and reused while counting multiple different orbits.
The ORCA algorithm (ORbit Counting Algorithm) [9] is the fastest available algorithm to calculate all nodes’ graphlet degrees. ORCA can count the orbits of graphlets up to either 4 or 5 nodes and uses such a system of equations to reduce this to finding graphlets on 3 or 4 nodes, respectively.
The Jesse algorithm, which managed to automatically generate equations for orbits of arbitrary order, as well as use them to count those orbits, was described in [5]. To this end, a nonambiguous, extendable graphlet and orbit numbering was introduced. This numbering does not follow the original numbering in Fig. 1, but is constructed in an algorithmical, consistent way. Likewise, a novel type of graphlet that represents a specific orbit was introduced. In these graphlets, a single node is marked, which singles out that node’s orbit. These socalled orbit representatives were used as the nodes of a directed tree, in which the arcs were the addition of nodes and edges to these orbit representatives. This tree can then be used to find orbit representatives on k−1 nodes within a graph, after which automatically generated [10] equations are used to calculate the number of orbits of graphlets on k nodes.
However, many redundant equations are generated, so a large linearly dependent system of equations arises. Originally, the equations used in Jesse were chosen on a firstcomefirstserved basis. If Jesse generated more than 1 equation that could be used to count orbit i, only the one that was generated first was saved and used. All other generated equations are just as correct, though.
Once the system of equations is completed, it can be straightforwardly solved as its lefthand side, where graphlet degrees are related to each other, is an upper triangular matrix. However, filling in the righthand side of all equations is more timeconsuming, as this depends on the graph’s structure. Therefore, different, but equally correct sets of equations can be used and have an impact on Jesse’s running time.
Other techniques to count graphlets have been developed: ranging from combinatorial counting that uses graphlets’ symmetries and substructures to count them without finding any graphlet, which is currently limited to graphlets on 4 nodes [11], to sampling techniques that do not count all graphlets but identify randomly sampled subgraphs [6], or incremental counting [12].
In this paper, we investigate whether it is possible to select a set of equations that allows the graphlet degrees to be calculated faster than when using other sets, and whether this set depends on the explored graph’s properties. First, a number of graph theory terms need to be defined. A highlevel explanation of Jesse’s internal structure follows. Then, the structure of a graphlet counting equation is explained, and the variable properties of equations are identified. With all of these, the effect of equation selection on Jesse’s speed can be investigated, accounting for different graph types, orders and sizes. Finally, the Cytoscape version of Jesse will be presented.
Formal graph theory definitions
This section is a collection of formal definitions of terms which will be used later on in the paper. These are formal definitions for all terms used in this paper, but for more information on how and why these terms were constructed we refer to [10].
Definition 1
An undirected graph
where V is the collection of nodes and E is the collection of edges of G, such that
Similarly, V(G) and E(G) are used to indicate G’s node and edge set, respectively. n=V is called the graph’s order, while m=E is called its size.
Definition 2
A graph G’s density
As it is the graph’s size divided by the maximal size that graphs of that order can have,
Definition 3
The isomorphisms between two graphs G and H are the onetoone functions that map G’s nodes to H’s nodes, such that their edge sets are mapped onto each other as well.
Two graphs are said to be isomorphic if they have at least one isomorphism.
Definition 4
The automorphisms of a graph G are the isomorphisms of G to itself.
Definition 5
A graph’s nodes have a unique, ordered index:
This index is chosen arbitrarily at graph creation. As a form of shorthand, we note v<w for Ind(v)<Ind(w).
Definition 6
The induced subgraph on a subset V_{s}⊆V(G)of a graph G’s nodes is the graph formed by V_{s} and all edges between those nodes that are present in G.
Definition 7
The number of common neighbours of a subset V_{s}⊆V(G) of a graph G’s nodes will be noted as c(V_{s}).
Following [9], c({u,v,...}) will also be noted as c(u,v,...).
Definition 8
A graphletG is a connected graph. Graphlets are assigned an unique numbering, such that the notation G_{i} denotes a unique graphlet for each value of i∈ℕ. A kgraphlet is a graphlet with k nodes.
Definition 9
The instances of a graphlet G_{i} in a graph H are the induced subgraphs of H that are isomorphic with G_{i}.
Definition 10
The automorphism orbit, or orbit in short, of a node v in a graphlet G_{i} is the set of nodes to which v can be mapped by an automorphism of G_{i}.
Orbits are assigned a unique numbering, spanning over all graphlets, such that the notation Orb_{j} can be used to identify both the orbit and its graphlet.
Definition 11
An orbit representative is a graphlet with a marked node x.
with
Orbit representatives follow the same numbering as orbits, such that Ω_{i} is the orbit representative that corresponds with Orb_{i}. The marked node of an orbit representative Ω will be noted as x(Ω).
Definition 12
The isomorphisms between two orbit representatives Ω and Ψ are the isomorphisms of Ω and Ψ’s graphlets that map Ω’s marked node to Ψ’s marked node.
Two orbit representatives are said to be isomorphic if they have at least one isomorphism.
Definition 13
The automorphisms of an orbit representative Ω are the isomorphisms of Ω to itself.
Definition 14
The induced orbit representative on a subset V_{s}⊆V(G) of a graph G’s nodes and a marked node x∈V_{s} is the orbit representative formed by V_{s} and all edges between those nodes that are present in G, with x as the orbit representative’s marked node.
Definition 15
The instances of an orbit representative Ω_{i} in a graph H are the induced subgraphs of H that are isomorphic with Ω_{i}.
An orbit Orb_{i}touches a node v in a graph G if its corresponding orbit representative Ω_{i} has an instance in G in which v is the marked node.
Definition 16
The ith graphlet degree o_{i}(v)of a node v in a graph G is the number of times orbit i touches v.
Once more, we refer the interested reader to [10] for more information.
Implementation
In this section, the structure of our Jesse program will be explained in broad strokes. Afterwards, the concept of equation selection, as well as the factors that can be used to select equations, are explained. Finally, the different random graph types that were used in testing are described.
Jesse
Jesse is the program we created to solve the orbit counting problem. It is described in detail in [5], but a short summary of the technique follows here.
The structure of Jesse’s main search algorithm is similar to ORCA’s structure: it is a treebased graphlet search, followed by filling in and solving a system of equations relating the graphlet degrees to common neighbours of the found graphlets. There is one important difference with ORCA: every required structure can be generated for graphlets of theoretically unlimited order.
The most important datastructure is the orbit tree. This tree’s nodes are the orbit representatives and its directed arcs symbolize the addition of a node or edge to an orbit representative. With this orbit tree, finding instances of orbit representatives within a graph becomes a treewalking matching algorithm.
Likewise, the orbit counting equations are generated. Because these equations relate the graphlet degrees to the number of common neighbours of orbit representative instances, those common neighbours need to be counted. This is done before the actual graphlet search, to allow for maximal reuse of calculations.
Then, the orbit representatives on (k−1) nodes are searched with the tree; with each found instance, the corresponding equations are filled in with the appropriate common neighbours. After the orbit search, the system of equations is solved. Interested readers are refered to [5] for more information.
Equation selection
For each graphlet order, many more equations are generated than there are orbits that need to be counted. All of these equations are correct. They form a huge, linearly dependent, upper triangular system, which can be easily simplified to a maximal linearly independent system by discarding all equations but one for each orbit.
As an illustration, here are the 3 possible equations to count orbit 40.
in which
The lefthand side of these equations contains terms relating to different graphlet degrees (order k) of a given node x; the righthand side consists of the number of common neighbours of specific nodes in all instances of some (k−1)orbit representatives. The predicates (P_{i}) exist to make sure every instance of Ω_{i} is accounted for exactly once. How these equations are generated is detailed in [10].
At first, Jesse saved the first equation that was generated for each orbit; the equations were generated in ascending order of the orbit number in the RHS sum. Orbit representatives of any order are numbered in such a way that adding an edge to an orbit representative will always increase its number, which will automatically result in an upper triangular system of equations [10].
As this selection has a clear bias towards lower densities in the orbit in the sum, this selection should first be made more fair. Random selection of which equation is kept for each orbit should solve this problem. And indeed: randomly selected equations are about twice as efficient as the firstcomefirstserved equations. This proves both that equation selection has a significant effect on Jesse’s running time and that the first sets that were used are not the most efficient. As it is unlikely that random equations are the most efficient either, which system of equations is most efficient must be determined.
Equations’ properties
There are many possible linearly independent sets of equations (16 possible sets for 4graphlets, 1.5∗10^{15} sets for 5graphlets and 3.5∗10^{182} for 6graphlets), which makes finding an optimal set of equations hard. Therefore, some global criteria for equation selection must be used to try and find a heuristic that makes the algorithm faster, and to possibly identify the reason why some equations are more efficient than others.
Equations 13 illustrate the different properties equations can have. The number of terms in the lefthand side ranges from 2 in Eq. (1) to 4 in Eq. (2) to 8 in Eq. (3). The orbit in the sum in the righthand side is orbit 6 from graphlet 4 in Eq. (1), orbit 10 from graphlet 6 in Eq. (2) and orbit 12 from graphlet 7 in Eq. (3). The number of different c(...) terms within the sum in the righthand side is 1 in Eq. (2) and 2 in Eqs. (1) and (3). Note that the total number of terms is much higher, but depends on the prevalence of the orbit in the RHS sum within the explored graph. For the purpose of equation selection, only properties that can be calculated without prior knowledge of the graph will be considered. Finally, the number of arguments of each of these c(...) terms (i.e. the number of nodes whose common neighbours are counted) is 3 in Eq. (1), 2 in Eq. (2) and 1 in Eq. (3). As a shorthand, LHS and RHS will be used to denote the lefthand side and righthand side of an equation, respectively, for the remainder of this paper.
The lefthand side can be safely ignored because each orbit will only be linked to denser orbits. Therefore, the system of equations will automatically be an upper triangular matrix, without any need for decomposition. The time needed to solve any single equation will therefore be O(n_{Orb,k}), in which n_{Orb,k} is the number of different orbits of kgraphlets. The time to compose this equation will be O(o_{i}(x)) with o_{i} an graphlet degree of some (k−1)graphlet, assuming all instances of Ω_{i} have been found. As o_{i}(x)≫n_{Orb,k} in most graphs for at least one o_{i}, most effort will be needed to calculate the righthand side of the equations. That leaves three properties: the orbit over whose instances the sum is made; the number of terms within the sum, by which the number of explicitly written c(...) terms is meant – not the total number of terms if the sum is expanded, which depends on the explored graph; and the number of arguments of the terms in the righthand side, which means the number of nodes that are enumerated within the parentheses of each c(...) term.
Two of these properties, however, are related. Remember that an equation needs to be selected for each orbit, so the lowest numbered orbit in the lefthandside of the equation is fixed. If this is fixed, though, the orbit in the RHS sum completely determines the number of arguments of the terms in the righthand side: the number of arguments of the terms will exactly be the number of edges that must be added to the orbit in the RHS sum to create the lowest numbered orbit in the LHS. In the previous example, orbit 40 has 3 more edges than orbit 6, so the number of arguments of the terms in the RHS of Eq. (1) must be 3. Orbit 40 has only 1 edge more than orbit 12, so the terms in the RHS of Eq. (3) must have 1 argument. As such, if the size of the orbit representative in the RHS sum increases, the number of arguments of the RHS terms will stay the same or decrease. Maximising the size of the orbit representative in the RHS sum will therefore minimise the number of arguments of the RHS terms, and vice versa.
On the other hand, the number of terms in the righthandside of the equation is dependent on the symmetry of the orbit representative in the sum, and of the specific nodes in each term. While these are of course related to the orbit representative, that relation is not straightforwardly characterised. Therefore, the effect of this factor will need to be calculated separately.
Random graphs used for testing
Three types of random graphs were used for this research: ErdősRényi graphs, BarabásiAlbert graphs and geometric graphs. A short explanation of how these graphs are generated follows here.
ErdősRényi graphs
ErdősRényi graphs [13], or ER graphs for short, are true random graphs. Given a certain number of nodes and edges, a random graph is generated that has exactly this order and degree. Every possible edge has the same probability to exist, making the chance that any pair of nodes is connected a constant.
These graphs are generated by first creating a graph with the desired number of nodes but no edges, then randomly adding edges one by one, uniformly selecting a random unconnected pair of nodes for each edge.
BarabásiAlbert graphs
In BarabásiAlbert graphs [14], shortened to BA graphs, edges are preferentially connected to highdegree nodes. The values needed to generate a BarabásiAlbert graph are its order and starting degree of each node δ (equal to half the average degree of the graph). BarabásiAlbert graphs are scalefree graphs, meaning that the degree distribution of a BarabásiAlbert graph follows a power law.
These graphs are generated starting from a connected graph with order equal to the starting degree. Any connected graph can be used as starting point; here, a complete graph was chosen to be able to get highdensity BA graphs. Then, δ different nodes are randomly drawn from the present nodes, in which each node’s chance to be drawn is proportional to its degree. A new node is added, connected to these nodes. This is repeated until the graph has the required order.
Geometric graphs
Geometric graphs [15] are characterised by the fact that their nodes have a spatial position. This position might be in any number of dimensions (D). Pairs of nodes that are within a certain threshold distance of each other are connected. This threshold distance is a parameter that is determined at the start of the graph generation.
To generate these graphs, all needed nodes are positioned randomly within a Ddimensional cube of unit size. When each node is connected, it is connected to the present nodes within the threshold distance from that node. Note: for some experiments, in particular those in which the speed of Jesse is plotted as a function of a graph’s density, the nodes were distributed in a Ddimensional torus instead, so coordinate 1 on any axis is equal to coordinate 0. Most of the time, D=3 in the following experiments.
Results
Effect of equation selection
The effects of equation selection were striking. In a first test, graphlets of 4, 5, 6 and 7 nodes were counted in ErdősRényi graphs with 50 nodes and 500 edges. Five selections of equations were used: random equations, equations with the fewest possible righthand side terms, equations with the most possible righthand side terms, equations with righthand side terms with the fewest possible arguments and equations with righthand side terms with the most possible arguments. The result of these measurements can be seen in Table 1.
The number of arguments has a large influence on Jesse’s running time – up to almost a factor 2 – but selecting equations based on the number of terms does not seem to influence Jesse’s running time. Therefore, in all further experiments, equations will be selected based on the number of arguments in each RHS term.
Cause
All possible c(...) terms, i.e. the number of common neighbours of all sets of up to k−2 nodes, are calculated before the graphlets are searched. Then, these are stored in a hash map with the arguments of each term as the key. When calculating the equations’ righthand sides, the c(...) terms are looked up from there. As the equations’ righthand side consists completely of a sum of these terms, this is the most logical place to start looking for the determining factor that influences the speed.
In Jesse, unlike in ORCA, all possible c(...) terms are stored in a single hash map. In ORCA, these are saved in multiple hash maps, a different hash map for each set size (i.e. the number of arguments of the RHS terms). So all common neighbours of 2 nodes are saved in a map, the common neighbours of 3 nodes in another, and so forth. To test whether this approach made a significant difference in running time, Jesse was temporarily adapted to save the c(...) terms in different maps. However, saving them in different maps did not make the algorithm run significantly faster than saving them in the same map. This indicates that the time difference between looking up small sets of nodes and large sets is not related to hash tables that possibly have too many collisions to be used well.
Secondly, Jesse was adapted to only use the hash codes of the sets of nodes as keys in the hash map. Note that in Java, hash maps can distinguish between different key objects with the same hash code. To do so, the entire key objects must be compared. Explicitly using the hash codes of the arguments of the c(...) terms as keys disabled the comparison of those lists. While this did speed up the algorithm with all sets of equations – in exchange for wrong results in large graphs because of hash collisions – it did not remove the speed difference. This indicates that the longer runtime of Jesse when looking up terms with more arguments is not due to the repeated comparison of longer lists to each other, although comparing lists has an effect on Jesse’s overall speed.
The two previous tests suggest that the time per lookup in the hash table is not too different between small and large sets of arguments. Therefore, the logical next step was to log the number of lookups that were used in runs with different equation sets. And indeed, there was a large difference in the number of lookups done between the best and worst sets of equations. Jesse was run with different sets of equations (random, righthand side terms with fewest arguments and with most arguments) for different graphlet orders (5 and 6) on different graph types (ErdősRényi, BarabásiAlbert and geometric) of different orders (50 to 200 nodes) and sizes (average degree 16 to 24). In all of these cases we recorded the time needed to calculate the graphlet degrees, as well as the number of lookups done. All of the generated data together can be seen in Fig. 2.
Even though all of these data points come from different graph types, with different orders and sizes; different graphlet orders; and equations that were selected in different ways, a power law fits them surprisingly well. Therefore, it seems safe to assume that the lookups are the largest cause of the speed difference between different sets of equations. However, the fit is a power law with an exponent that is close to, but different from 1. This may be due to other effects than lookups becoming more important at higher or lower density. The data points are coloured according to the used equations (Fig. 2), so it can also be seen that the datapoints made with the most efficient equations tend to be under the fitted line, whereas the datapoints using the least efficient equations are above the fitted line. This indicates that, apart from the number of lookups, there must be other factors making these equations more efficient. However, the number of lookups is clearly the most important factor for Jesse’s speed and looks like the most promising factor to optimize.
Reason for higher equation efficiency
In previous sections, it was illustrated that the equation set that results in the smallest number of lookups of common neighbours will be the most efficient set. However, we did not yet offer an explanation of why the equations with RHS terms with the fewest number of terms tend to be the ones with the fewest lookups in about all used graphs.
Recall that, for a fixed lowest numbered lefthand side orbit, the number of arguments of the RHS terms is directly related to the number of edges in the orbit representative over which the sum in the RHS is made. Terms with fewer arguments mean denser graphlets, which appear less frequently in a relatively sparse graph. In an ER graph, the expected number of instances of each orbit representative can even be calculated analytically fairly easily. In an ER graph G with n nodes and m edges, an orbit representative Ω with k nodes and e edges will appear
times, with \(S = \frac {k!}{\text {Aut}(\Omega)}\). If k≪m and k≪n, this reduces to
in which D(G) is G’s density.
Leaving all other variables constant, the number of instances of a specific orbit representative increases as a function of e at density D(G)<0.5, stays constant at D(G)=0.5 and decreases with increasing e at D(G)>0.5. If the number of lookups determines the speed of the algorithm, the same behaviour is expected from the algorithm’s speed.
To test this assumption, the running speed of Jesse counting 5graphlets was measured in ER, BA and GEO graphs with densities going from 0.1 to 0.9. This was repeated for graphs of order 50, 100, 150 and 200. Each experiment was repeated 20 times. The choice for 5graphlets was made because 5graphlets have enough effect of equation selection, but still can be counted quickly enough to do these repetitions in reasonable time. Jesse’s speed was measured with 3 sets of equations: random equations, equations with RHS terms with fewer arguments and equations with RHS terms with more arguments. The result can be seen in Figs. 3 and 4.
While the exact shape of the curves is slightly different between the different graph types that were used, some common trends can be discerned. It can clearly be seen that the running time of the equations with RHS terms with fewer arguments increases with increasing density, whereas the running time of the equations with RHS terms with more arguments decreases with increasing density.
At a density around 0.7, the equations with RHS terms with more arguments become more efficient than the equations with RHS terms with fewer arguments. This is especially notable because this point is dependent on neither the graph type, nor the graph order. Across all tested graphs, the crossover point remains constant.
At minimal density, the running time reached by equations with RHS terms with fewer arguments is reduced by a factor 2 compared to randomly selected equations. At low density and low order, the difference in running time decreases again, because the total number of graphlets decreases. Therefore, the relative amount of time used by the treewalking graphlet search, which is independent of the equations, becomes larger with respect to the time spent looking up common neighbours. At maximal density, the running time of equations with RHS terms with more arguments is about 10% shorter than the running time with randomly selected equations. Because of the longer running time at high density, the absolute difference in running time is larger for denser graphlets.
For almost all graphs, the running time with random equations is close to the average of the running time of equations with RHS terms with more arguments and RHS terms with fewer arguments. At medium density, they are sometimes less efficient than either (for instance in geometric graphs around a density of 0.6). That seems to indicate that in these graphs, medium density graphlets are less common than both low and high density graphlets.
Application to biological networks
Jesse was also benchmarked on two biological interaction networks from the IntAct database [16]: the diabetes network (169 nodes, 429 edges) and the affinomics network (1117 nodes, 2432 edges). The orbits of 6graphlets were counted. Three versions of equation selection were used: the firstcomefirstserved equation selection that Jesse used before actual equation selection was implemented, random equations and equations with RHS terms with the fewest possible arguments. The choice for RHS terms with few arguments was made because these networks have a low density (0.031 and 0.0065, respectively). The speed of these runs can be seen in Table 2.
As can be seen, the original equations used by Jesse perform worst in both cases. In the diabetes network, changing to equations with short RHS terms reduces the running time by a factor of 2. The difference in the affinomics network is much less pronounced, but still present. At the extremely low density of the affinomics network, graphlets on 6 nodes become rare, which reduces the difference equations can make. The same effect can be seen in the random graphs on 50 nodes in Fig. 4.
Discussion
Jesse is openly available at https://github.com/biointec/jesse as a Java command line tool. Equation selection is now implemented: Jesse will automatically select the most appropriate set of equations. When analysing graphs with density below 0.7, equations with RHS terms with fewer arguments will be used; for graphs with a density above 0.7, equations with RHS terms with more arguments will be used. It is possible to select other equations, however. This might be useful in disconnected graphs in which every connected component has a density above 0.7, but the entire graph has a density below 0.7, for instance.
The Jesse Cytoscape app
For ease of use, all of Jesse was integrated in a Cytoscape app. This app, named Jesse, can be found on the Cytoscape App store here: http://apps.cytoscape.org/apps/jesse. The interface of this app can be seen in Fig. 5.
It adds a new tab to Cytoscape’s control panel, named Jesse. In this tab, the box titled Search Options, marked with the character A in Fig. 5, contains the most basic options for orbit counting. The largest order of graphlets whose orbits need to be counted can be selected here, as well as any opened Cytoscape network, in which the orbits will be counted. A checkbox can be ticked to compute the graphlet degrees of only the nodes that are selected in the network view, otherwise the graphlet degrees of all nodes in the network are calculated. If the selected order is between 3 and 7 (included), then no other options are needed. Just pushing the Run button, character D in Fig. 5, at the bottom of the control panel is enough.
If the order of graphlets that need to be counted is greater than 7, no standard files for orbit counting are included with Jesse. They can, however, be generated for any order using the File Generation box, character B in Fig. 5. Files for both orbit numbering and the used search tree need to be generated and saved. Once they are generated, the files for a given graphlet order can be used anytime the Jesse app is used, without generating them again. Choosing generated files can be done in the File Options box, character C in Fig. 5.
When the algorithm has finished running, the Results panel, character E in Fig. 5, appears on the righthand side of the Cytoscape window. There, a table showing each node’s graphlet degrees can be seen. Clicking on a node’s name will highlight it in the network view; conversely, highlighting a node in the network will show its graphlet degrees. This allows quick inspection of a specific node’s graphlet degrees. Clicking on an orbit’s number in the table header will open a new network showing a visualisation of that orbit representative in a direct and intuitive way.
The used system of equations, as well as the results table, can be exported using the buttons at the bottom of the Results panel, character F in Fig. 5. The equations can be saved in pdf format or as plain text, TeX code or png, the results in a text file. Each line of the text file starts with the name of a node, followed by the graphlet degrees ordered by orbit number, separated by tabs. This allows postprocessing of these data with any other tools the user may have at their disposal.
Future work
The sets of equations that were tested in this paper were selected based on global criteria. They were meant to minimise the number of lookups that have to be done without prior knowlegde of the explored graph’s structure. Especially in graphs with a more complicated smallscale structure than the ones that were tested here, it is possible that the prevalence of a certain orbit representative does not depend solely on its density. Therefore, even in a sparse graph, it may be possible that a certain sparse graphlet appears less often than a dense graphlet. Then, selecting equations based on the RHS term number of arguments will not result in the best equation set.
If the number of orbit representatives of order k−1 is counted before applying the equations, as opposed to applying the equations during counting, the number of lookups may be calculated for each equation. For every orbit, the equation that will need the fewest lookups can then be chosen. However, then the instances should be saved, because the instances need to be filled in the equations, which in itself causes an overhead.
As the orbits are counted for every node separately, it may be entirely possible that the best equations are different from node to node in a single graph. Therefore, an additional speedup might be achieved by tailoring the equations to every node. It remains to be seen whether this difference is significant and outweighs the effort needed to calculate which equations to use.
Conclusion
With the addition of equation selection, the bioinformatics network analysis tool Jesse has been significantly sped up. Which equations are most efficient to use is mostly dependent on the graph’s density and less on the exact type of graph that is used. At low graph density, equations with righthand side terms with fewer arguments are most efficient, being up to twice as fast as random equations and four times faster than equations with righthand side terms with more arguments. At a density above 0.7, equations with righthand side terms with more arguments become more efficient, reaching a running time reduction of about 10% compared to random equations at extremely high density. The number of terms in equations’ right hand side has no significant effect on the algorithm’s running time.
The difference in running time when using different sets of equations can be attributed to the vastly different total number of terms that make up the equations’ right hand sides. These terms need to be looked up in a hash table, and the number of lookups needed has the dominant effect on the different running time between equations.
This knowledge was implemented into Jesse: it now automatically selects a system of equations based on the given graph’s density. When its density is lower than 0.7, the equations with the righthand side terms with the fewest arguments are chosen, when its density is higher than 0.7 those with the righthand side terms with the most arguments are chosen. A Cytoscape App for Jesse was created, which combines Jesse’s functionality with Cytoscape’s userfriendly interface and can be downloaded from the Cytoscape App Store.
Availability and requirements
Jesse as a command line tool is freely available at Github (https://github.com/biointec/jesse). It is implemented in Java, therefore it is platformindependent. It needs JRE 1.8.
As a Cytoscape App, Jesse can be downloaded from the Cytoscape App Store (http://apps.cytoscape.org/apps/jesse) and needs Cytoscape 3.x.
Abbreviations
 BA:

BarabásiAlbert (random graph)
 ER:

ErdősRényi (random graph)
 GDD:

Graphlet degree distribution
 GEO:

Geometric (random graph)
 LHS:

Lefthand Side (of an equation)
 RHS:

Righthand Side (of an equation)
References
 1
Milo R, ShenOrr S, Itzkovitz S, Kashtan N, Chklovskii D, Alon U. Network motifs: simple building blocks of complex networks. Science (New York, N.Y.) 2002; 298(5594):824–7.
 2
Wernicke S, Rasche F. FANMOD: a tool for fast network motif detection. Bioinformatics (Oxford, England). 2006; 22(9):1152–3.
 3
Lin W, Xiao X, Xie X, Li XlL. Network motif discovery: A GPU approach. In: 2015 IEEE 31st International Conference on Data Engineering. IEEE: 2015. p. 831–42.
 4
Pržulj N, Corneil DG, Jurisica I. Modeling interactome: scalefree or geometric?Bioinformatics (Oxford, England). 2004; 20(18):3508–15.
 5
Melckenbeeck I, Audenaert P, Colle D, Pickavet M. Efficiently counting all orbits of graphlets of any order in a graph using autogenerated equations. Bioinformatics (Oxford, England). 2017; 34(1372):758.
 6
Hasan A, Chung PC, Hayes W. Graphettes: Constanttime determination of graphlet and orbit identity including (possibly disconnected) graphlets up to size 8. PLoS ONE. 2017; 12(8):1–12.
 7
Pržulj N. Biological network comparison using graphlet degree distribution. Bioinformatics (Oxford, England). 2007; 23(2):177–83.
 8
Milenković T, Pržulj N. Uncovering biological network function via graphlet degree signatures. Cancer Informat. 2008; 6:257–73.
 9
Hočevar T, Demšar J. A combinatorial approach to graphlet counting. Bioinformatics (Oxford, England). 2014; 30(4):559–65.
 10
Melckenbeeck I, Audenaert P, Michoel T, Colle D, Pickavet M. An Algorithm to Automatically Generate the Combinatorial Orbit Counting Equations. PLoS ONE. 2016; 11(1):1–19.
 11
Pinar A, Seshadhri C, Vishal V. ESCAPE: Efficiently Counting All 5Vertex Subgraphs. In: Proceedings of the 26th International Conference on World Wide WebSwitzerland: International World Wide Web Conferences Steering Committee Republic and Canton of Geneva: 2017. p. 1431–40.
 12
Cannoodt R, Ruyssinck J, Ramon J, De Preter K, Saeys Y. IncGraph: Incremental graphlet counting for topology optimisation. PLoS ONE. 2018; 13(4):1–11.
 13
Erdős P, Rényi A. On random graphs I. Publ Math. 1959; 6:290–7.
 14
Barabási AL, Albert R, Jeong H. Meanfield theory for scalefree random networks. Physica A Stat Mech Appl. 1999; 272:173–87.
 15
Díaz J, Penrose MD, Petit J, Serna M. Convergence Theorems for Some Layout Measures on Random Lattice and Random Geometric Graphs. Comb Probab Comput. 2000; 9(6):489–511.
 16
Orchard S, Ammari M, Aranda B, Breuza L, Briganti L, BroackesCarter F, Campbell NH, Chavali G, Chen C, DelToro N, Duesbury M, Dumousseau M, Galeota E, Hinz U, Iannuccelli M, Jagannathan S, Jimenez R, Khadake J, Lagreid A, Licata L, Lovering RC, Meldal B, Melidoni AN, Milagros M, Peluso D, Perfetto L, Porras P, Raghunath A, RicardBlum S, Roechert B, Stutz A, Tognolli M, Van Roey K, Cesareni G, Hermjakob H. The MIntAct project  IntAct as a common curation platform for 11 molecular interaction databases. Nucleic Acids Res. 2014; 42(D1):358–63.
Acknowledgements
The authors wish to thank their respective funders and institutions.
Funding
This research was funded by Ghent University – imec and the European Union Seventh Framework Programme (FP7/20072013) – European Research Council Advanced Grant Agreement 322739DOUBLEUP.
Availability of data and materials
Jesse as a command line tool is freely available at Github (https://github.com/biointec/jesse). It is implemented in Java, therefore it is platformindependent. It needs JRE 1.8.
As a Cytoscape App, Jesse can be downloaded from the Cytoscape App Store (http://apps.cytoscape.org/apps/jesse) and needs Cytoscape 3.x.
The random graphs used to test Jesse were generated by Jesse itself. The used biological networks are available from https://www.ebi.ac.uk/intact/downloads.
Author information
Affiliations
Contributions
IM, PA, YVDP, MP and DC conceived the methods. IM and TVP designed and programmed the algorithms. IM performed the experiments and analysed the data. IM wrote the manuscript. All authors read, revised and approved the final manuscript.
Corresponding author
Correspondence to Pieter Audenaert.
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver(http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Melckenbeeck, I., Audenaert, P., Van Parys, T. et al. Optimising orbit counting of arbitrary order by equation selection. BMC Bioinformatics 20, 27 (2019). https://doi.org/10.1186/s1285901824839
Received:
Accepted:
Published:
Keywords
 Graph theory
 Graphlets
 Orbits
 Equations
 Optimisation
 Cytoscape app