- Methodology Article
- Open Access
Identification of highly synchronized subnetworks from gene expression data
BMC Bioinformatics volume 14, Article number: S5 (2013)
There has been a growing interest in identifying context-specific active protein-protein interaction (PPI) subnetworks through integration of PPI and time course gene expression data. However the interaction dynamics during the biological process under study has not been sufficiently considered previously.
Here we propose a topology-phase locking (TopoPL) based scoring metric for identifying active PPI subnetworks from time series expression data. First the temporal coordination in gene expression changes is evaluated through phase locking analysis; The results are subsequently integrated with PPI to define an activity score for each PPI subnetwork, based on individual member expression, as well topological characteristics of the PPI network and of the expression temporal coordination network; Lastly, the subnetworks with the top scores in the whole PPI network are identified through simulated annealing search.
Application of TopoPL to simulated data and to the yeast cell cycle data showed that it can more sensitively identify biologically meaningful subnetworks than the method that only utilizes the static PPI topology, or the additive scoring method. Using TopoPL we identified a core subnetwork with 49 genes important to yeast cell cycle. Interestingly, this core contains a protein complex known to be related to arrangement of ribosome subunits that exhibit extremely high gene expression synchronization.
Inclusion of interaction dynamics is important to the identification of relevant gene networks.
Life is a transient dynamic phenomenon. Biological functions and phenotypic traits, including disease traits, stem from the interactions across multiple scales in the living system. Therefore characterizing the condition-dependent interactions and emergent dynamics are important in the identification of relevant elements to a given biological process.
Recently, a number of computational methods have been developed to identify the condition specific protein-protein interaction (PPI) subnetworks, through integration of generic PPI data (typically obtained from an interactome database) and condition-specific gene expression data . For instance, by integrating yeast PPI networks with gene expression data, Han et al. showed that some modules are active only at specific times and locations . Qi et al. suggested that such approach enables the identification of subnetworks that are active under certain conditions . In a cell cycle study by de Lichtenberg et al, it was found that the cell cycle-regulated and constitutively expressed proteins form protein complexes at particular time points during the cell cycle . In these studies correlation in expression or similar measures are usually used to capture the condition specific gene interaction [3–9]. More recently, a number of studies focused on integration of PPI networks with time course expression data to identify subnetworks that exhibit meaningful dynamic changes in transcription. In a study of yeast metabolic oscillation by Tang et al , the active PPI network is first constructed for each time point (out of a total of 36 time points) through identification of interacting protein pairs whose corresponding genes exhibit a certain significant pattern in expression at that time point. Then Markov clustering algorithm is applied to create candidate functional module of each network. These modules were found to have much more significant biological meaning than those derived using static PPI networks only . In another study, Jin et al  defined a dynamic network module to be a set of proteins satisfying two conditions: (1) they form a connected component in the PPI network; and (2) their expression profiles exhibited time-shifted and local similarity patterns as evaluated using an time-warping dynamic programming algorithm. Using yeast as a model system and time course expression data from multiple experiments, they then showed that the majority of the identified dynamic modules are functionally homogeneous, and many of them shed light on the sequential ordering of the molecular events in the cellular system of yeast .
Understanding cellular physiology from a dynamic and systems perspective is obviously very important and valuable as demonstrated by these studies and many others . Incorporating time course data is a necessity along this direction. They not only capture how a whole system evolves over time, but also contain rich information regarding the coordination, namely, interaction, of the different elements in the system. The measurements from different time points are not independent of each other; this is in contrast to static measurements of different samples, or of the same sample under different conditions. However, most of the existing studies either construct active networks independently at each time point , or rely on pattern similarity measures to infer interaction which ignores the inter-time point dependence . Overlooking the interdependence among the time points not only loses sensitivity toward detecting relevant interactions but could also lead to erroneous predictions [11, 12].
In this study we investigate the application of an idea rooted in statistical physics and non-linear dynamics to characterize the state of gene interaction networks and use it to identify relevant subnetworks. We regard active subnetworks to be those showing high degree of differential expression, and high synchrony in expression changes (i.e., coordination in the timing of expression changes) among the members. The phase locking analysis will be utilized to evaluate expression synchrony, and to capture the dynamic interaction structure. Recently we found that the phase locking metric can identify interacting gene pairs more efficiently than correlation .
Previously, we proposed a Pathway Connectivity Index (PCI) to represent the activity of pre-defined pathways, such as those defined in KEGG and Biocarta. PCI utilizes expression information of all genes in a pathway, as well as the topological properties of its interaction networks. Its advantages have been demonstrated . This metric was later implemented in a software tool entitled Topological Analysis of Pathway-Phenotype Association (TAPPA). Here to capture contributions from topological characteristics of the dynamic interaction network, we integrate the phase locking analysis into PCI to define a novel metric: the Topology-Phase Locking (TopoPL) analysis . With both simulated and real yeast expression data during cell cycle, we will demonstrate the merits of TopoPL.
Simulation utilized the sample expression data gal80R given in Cytoscape (http://cytoscape.org/). There are 331 genes and 361 interactions in this network. Within it, we randomly selected subnetworks at three different sizes n (n = 40, 60, 80), as condition-responsive. In each responsive subnetwork m% (80%, 90%, 100%) of genes are defined to be active. The significance values of active genes were assigned randomly with top significance values in gal80R, and that of the other genes were randomly sampled from the rest of the significance values. The phase locking index λ (see 2.3) of the interactions in the predefined responsive subnetwork were sampled from , i.e. a normal distribution with μ = 0.8, σ = 0.5; while λ for the remaining edges were sampled from . The choice of these values was based on the distribution of the λ values of gene pairs in protein complexes and of randomly selected gene pairs. For protein complexes we used the MIPS annotation (http://mips.helmholtz-muenchen.de/genre/proj/yeast) edited by Gerstein Lab (http://www.gersteinlab.org/proj/bottleneck/mips.txt).
A gene of the predefined responsive subnetworks that is in the TopoPL-identified subnetwork is considered a successful identification. This procedure was repeated 10 times and the true positive (TP, sensitivity) rate was defined to be the number of successful identifications divided by the size of the predefined network n. The false positive (FP, specificity or precision) rate was estimated as the number of false identifications divided by the size of the identified subnetwork. The F score is a measure of a test's accuracy. It considers both the precision and the sensitivity of the test:
We used the average sensitivity, specificity and F score to measure the performance of TopoPL. The performance is also evaluated with Receiver Operating Characteristic (ROC) curve, a plot of the true positive rate against the false positive rate .
Gene expression and protein-protein interaction data
Gene expression data was downloaded from EMBL's Huber group (http://www.ebi.ac.uk/huber-srv/scercycle/). It is a time course study of yeast cell cycle, where cells were arrested using alpha factor or cdc28. The alpha factor dataset contains 41 time points and the cdc28 dataset contains 44 time points, both at 5-minute resolution. These datasets provide strand-specific profiles of temporal expression during the mitotic cell cycle of S. cerevisiae, monitored for more than three complete cell divisions . Yeast PPI data were downloaded from BioGRID (thebiogrid.org, version 3.1.69).
Phase locking analysis
The details of definitions and steps of the phase locking analysis was described in our previous work  and briefly summarized here. Given a time series s(t), its Hilbert transformation is given by
where PV stand for Cauchy Principal Value of integration. The corresponding analytical signal can then be constructed by:
where the instantaneous phase is thus uniquely determined. For two time series with instantaneous phase and , their cyclic relative phase is determined by
If two time series interact with each other, there will be rhythmic adjustment resulting in phase locking: is a constant. To evaluate the significance of phase locking, we utilize the circular mean of the phase difference
In a perfect locking , and when is randomly distributed. λ offers a new measure to infer potential interaction between gene pairs .
For each gene i, the EDGE software  was used to calculate , the significance of its expression changes during the time course study. We convert to a z-score through , where is the inverse normal CDF. Let be the adjacency matrix of genes in a PPI subnetwork and , TopoPL defines the overall activity of a subnetwork with:
captures the dynamic topological property of the subnetwork, and hub genes (genes with high network degree) contribute more to this metric. can be regarded as the "activity measurement" of the interaction. Gene pairs with significant and synchronized expression changes, and whose gene products interact, contribute more to the activity of the subnetwork.
This metric is an improved version over the PCI that we previously proposed to identify active pathways from gene expression data : , where is normalized log expression measurement of gene i in sample s, and is the adjacency matrix of the PPI network of genes in the pathway. The merit of PCI has been demonstrated in previous works . To reduce the potential impact on the network measure from residual inter-sample and inter-array biases after normalization, here we adopted the non-parametric measure in place of . A similar metric to Eq. (5) was developed recently by us to predict candidate disease genes for type 1 diabetes, where is the z-score of disease relevance of gene i. There again we demonstrated the advantage of incorporating network structural information .
Obviously, increase with the number of nodes and edges. To adjust for network size and density, we use the following equation
We implemented the searching procedure based on simulated annealing. The pseudocode of the algorithm is described below:
Input: the entire network ; a set of parameters for running simulated annealing: start temperature (= 1 in this study), end temperature (= 1e-8 in this study), number of iterations .
Output: the subnetwork with the highest score.
Steps: initialize each node with its expression significance score and each edge with its phase locking index; select the largest connected component (subnetwork) from top 10% significant nodes of ; calculate score of and obtain its score ; then run the following:
For i = 1 to N, Do
Calculate the current temperature ;
Exit loop if
Randomly pick a node
IF (), remove n from ;
ELSE add n to ;
Calculate score for the largest connected component of ;
IF Δ> 0, then;
ELSE, accept with the probability;
These steps can be iterated to identify subnetworks with the next highest scores and so on.
In this study we compared TopoPL with two other methods: (1) The commonly used network scoring method that sums significance levels of all genes in the network (hereafter referred to as the Additive scoring method):
(2) A metric that we previously proposed in our TAPPA software package  (hereafter referred to as the TAPPA scoring method) that only utilize the topological characteristics of the PPI network:
Using the simulated yeast gene expression data, we compared TopoPL with two other methods: (1) Additive scoring method (see definition Eq. (7) in Methods); and (2) TAPPA (see definition Eq. (8) in Methods) . Additive does not use any structural information of the network, TAPPA uses only predefined static network structure ignoring the dynamic, condition-specific changes in interaction patterns. Figure 1 summarizes the average sensitivity, precision and F score from all simulated data: 10 replicates each of three network sizes (n = 40, 60, 80), at three states of activity (m = 80%, 90%, 100%). Though the three methods have similar sensitivity, the precision of TopoPL is higher. F scores showed that TopoPL performs better than TAPPA and Additive. The ROC curves also indicate that TopoPL performs better than the other two approaches, with the highest Area Under Curve (AUC), as shown in Figure 2.
Yeast cell cycle data
After 100,000 iterations (), TopoPL identified a subnetwork of 524 genes and 2078 edges with the alpha factor dataset (in the following sessions, unless specified otherwise, we only report results from the alpha factor dataset; the cdc28 dataset gives very similar results). We performed the GO term enrichment analysis with topGO package in Bioconductor (http://www.bioconductor.org) to investigate how well the identified subnetwork captured the relevant functional modules . The most significant "Biological Process" GO terms are listed in Table 1. Many cell cycle, growth, and division-related processes were enriched in this subnetwork, such as GO:0042254 (ribosome biogenesis); GO:0007049 (cell cycle); GO:0022613 (ribonucleoprotein complex biogenesis); GO:0000278 (mitotic cell cycle); GO:0000280 (nuclear division). Almost all top terms are cell cycle related. Ribosomes are "factories" of protein synthesis, and synthesis of ribosomes is a key control point for the regulation of cell growth and division.
Presently, there is no "gold standard" to evaluate the biological relevance of network modeling algorithms. Here we investigated the functional enrichment of the proteins in the identified subnetworks , and compared to that obtained using Additive and TAPPA. The p values (Bonferroni corrected) of the top 2 terms are 3.33E-13 and 6.5E-12 with TAPPA, and 3.05E-8 and 3.13E-8, with Additive, respectively. TAPPA's are slightly larger than TopoPL, but Additive gave much larger p values. This indicates that including interaction structure, especially its dynamics, improves the sensitivity at identifying biologically relevant gene subnetworks.
It has been demonstrated that hub genes and high betweenness genes (i.e. genes having high number of shortest paths passing through) play important roles in gene networks . Table 2 listed the top 30 high-degree and high-betweenness nodes from the identified subnetwork. Though not been annotated with cell cycle, HEK2 is a RNA binding protein involved in asymmetric localization of the mRNA of ASH1, a transcription factor that acts to specify daughter cell fate in mating-type switching . Dsn1 has been annotated with cell cycle, it is important for chromosome segregation in S. cerevisiae . TPK1 has been annotated with the cell cycle GO terms. It is a cAMP dependent protein kinase which mediates basic cellular processes, such as the yeast-to-hypha transition and cell cycle regulation . NOP15 is also annotated with cell cycle GO terms. The transcription level of NOP15 is an important determinant of the productivity of RNA and its increased transcription provides an effective approach to obtain higher RNA yields in yeast .
The top 30 high-degree and high-betweenness nodes from the identified subnetwork and their interactions are presented in Figure 3. We hypothesize that they constitute a relevance core to yeast cell cycle, and provide a holistic picture of the primary molecular basis of cell cycle. In the core there are 18 genes annotated with GO:0007049 cell cycle (round rectangles), this rate (18 out of 39) is higher than that of the whole identified subnetwork (128 out of 524, a 1.9 fold enhancement, p = 0.11), and that of all genes in yeast (612 out of 5286, p = 0.00013). These results suggest that degree and betweenness can be utilized to further improve the performance of functional gene module identification.
We investigated the distribution of the phase locking index within the identified subnetwork. Clearly on average there is a higher degree of phase locking in it than in the whole PPI network (Figure 4). Interestingly the synchronization in the core is even higher, indicating that these core genes may work more closely in a coordinated fashion than others in the identified subnetwork.
Highly synchronized protein complex
We further examined the highly synchronized regions in the network core. Figure 5 shows the top 20 most synchronized interactions (corresponding ~1% of interactions in the identified subnetworks), MAK21 (NOC2) is at the center of this region. MAK21 is involved in preribosome export from the nucleus to the cytoplasm. Though it is not annotated with cell cycle GO term, but its homologue, SWA2 likely plays a role in ribosome biogenesis that is essential for the coordinated mitotic progression .
In protein complexes, the core components, which consist of two or more proteins that are present in most complex isoforms, are often regarded as functional units as they show surprisingly high degree of functional, essentiality, and localization homogeneity [24, 25]. We therefore also surveyed protein complexes and core components in the identified subnetwork. We found that all core components in complex 56 are in our core subnetwork, and they are shown in Figure 6. Interestingly all six genes show extremely high synchronization (0.976±0.006, see Figure 4). Their expression profiles are given in Figure 7. We also included their expression profiles in the cdc28 dataset; again high synchronization in expression is evident. This means that they are coordinated to work closely during cell cycle. This is not surprising as a large percentage of protein pairs within the core subnetwork were coexpressed at the same time during cell cycle . Our algorithm is naturally good at finding highly synchronized genes pairs, therefore tends to include more core components from the same complexes.
Interestingly all six genes are annotated with GO:0042254 (ribosomal chaperone activity), it is defined as "A cellular process that results in the biosynthesis of constituent macromolecules, assembly, and arrangement of constituent parts of ribosome subunits; includes transport to the sites of protein synthesis".
Transcription factor binding motif analysis
We have found that genes regulated by the same transcriptional factors are likely to be highly synchronized . Here to examine if the reverse is true, we used oPOSSUM (http://opossum.cisreg.ca/oPOSSUM3/) to identify shared transcription factor binding sites (TFBS) among the genes in the identified subnetwork . Given a group of genes, oPOSSUM first detects all TFBS documented in the JASPAR database in promoter regions (1000 bp upstream in this study), and then identifies overrepresented TFBS as compared to background gene sets (all genes in the PPI network in our study). It uses a simple binomial distribution model to compare the rate of occurrence of a TFBS in the set of target genes to the expected rate estimated from the background set. Table 3 gives the top 5 transcription factors of the identified subnetwork and its core.
FKH1 and MCM1 are well studied cell cycle related transcriptional factors . TOD6 (Pbf1) and DOT6 (Pbf2) as PAC-binding factors, important in the regulation of ribosome biogenesis. Existing ChIP-chip studies suggest that genes have the highest occupancy by TOD6 and DOT6 are highly enriched for the GO Biological Process ''ribosome biogenesis" .
Agreement between the datasets
A good algorithm should be efficient at uncovering the true biology underlying different datasets, which should be consistent. In this study, we identified 484 genes with the cdc28 dataset, and 524 genes with the alpha factor dataset. There are 156 (~31%) overlapping genes in them (p < 0.00001, Fisher Test). In contrast, there are only 87 (~17%) overlapping genes with the Additive method (alpha: 501 genes; cdc28: 509 genes), and 145 (~29%) with TAPPA (alpha: 499 genes; cdc28: 503 genes). This indicates that incorporating network structural and dynamic information can generate robust results.
TopoPL scoring method with a simulated annealing search was proposed in this study to identify active subnetworks during a biological process by integrating PPI with dynamic expression data. It incorporates both structural and dynamics information of gene interactions. When applied to the simulated data and the yeast cell cycle data, it yielded more consistent results from different experiments, and predicted more meaningful active network modules, than two alternative scoring methods that either ignores information of the network dynamics, or that of both the dynamics and structure.
Das J, Mohammed J, Yu H: Genome-scale analysis of interaction dynamics reveals organization of biological networks. Bioinformatics. 2012, 28 (14): 1873-8. 10.1093/bioinformatics/bts283.
Han JD, Bertin N, Hao T, Goldberg DS, Berriz GF, Zhang LV, Vidal M: Evidence for dynamically organized modularity in the yeast protein-protein interaction network. Nature. 2004, 430 (6995): 88-93. 10.1038/nature02555.
Qi Y, Ge H: Modularity and dynamics of cellular networks. PLoS computational biology. 2006, 2 (12): e174-10.1371/journal.pcbi.0020174.
Lichtenberg de, Jensen LJ, Brunak S, Bork P: Dynamic complex formation during the yeast cell cycle. Science. 2005, 307 (5710): 724-727. 10.1126/science.1105103.
Tang X, Wang J, Liu B, Li M, Chen G, Pan Y: A comparison of the functional modules identified from time course and static PPI network data. BMC Bioinformatics. 2011, 12: 339-10.1186/1471-2105-12-339.
Jin R, McCallen S, Liu CC, Xiang Y, Almaas E, Zhou XJ: Identifying dynamic network modules with temporal and spatial constraints." Pacific Symposium on Biocomputing. Pacific Symposium on Biocomputing. 2009, 203-214.
Liu Z, Wang Y, Wen T, Zhang X, Xia W, Chen L: Dynamically dysfunctional protein interactions in the development of Alzheimer's disease. Proc SMC. 2009, 4262-4267.
Keskin Ozlem, Ma Buyong, Rogale Kristina, Gunasekaran K, Nussinov Ruth: Protein-protein interactions: organization, cooperativity and mapping in a bottom-up Systems Biology approach. Physical Biology. 2005, 2 (2): S24-35. 10.1088/1478-3975/2/2/S03.
Guo Z, Li Y, Gong X, Yao C, Ma W, Wang D, Li Y, Zhu J, Zhang M, Yang D, Wang J: Edge-based scoring and searching method for identifying condition-responsive protein-protein interaction sub-network. Bioinformatics. 2009, 25 (12): 1574-10.1093/bioinformatics/btp308.
Przytycka TM, Singh M, Slonim DK: Toward the dynamic interactome: it's about time. Brief Bioinformatics. 2010, 11: 15-29. 10.1093/bib/bbp057.
Gao S, Hartman J, Carter JL, Hessner MJ, Wang X: Global analysis of phase locking in gene expression during cell cycle: the potential in network modelling. BMC Systems Biology. 2010, 4 (1): 167-10.1186/1752-0509-4-167.
Gurrin L, Sly P: Tutorials in Biostatistics. 2005, John Wiley & Sons Press
Gao S, Wang Xu: TAPPA: topological analysis of pathway phenotype association. Bioinformatics. 2007, 23 (22): 3100-10.1093/bioinformatics/btm460.
Granovskaia MV, Jensen Lars J, Ritchie Matthew E, Toedling Joern, Ning Ye, Bork P, Huber W, Steinmetz LM: High-resolution transcription atlas of the mitotic cell cycle in budding yeast. Genome Biology. 2010, 11 (3): R24-10.1186/gb-2010-11-3-r24.
Leek JT, Monsen EC, Dabney AR, Storey JD: EDGE: Extraction and analysis of differential gene expression. Bioinformatics. 2006, 22 (4): 507-10.1093/bioinformatics/btk005.
Gao S, Jia S, Hessner MJ, Wang X: Predicting disease related subnetworks for type 1 diabetes using a new network activity score. Omics. 2012, 16 (10): 566-78.
Rahnenfuhrer A, Lengauer T: Improved scoring of functional groups from gene expression data by decorrelating GO graph structure. Bioinformatics. 2006, 22 (13): 1600-10.1093/bioinformatics/btl140.
Yu H, Luscombe NM, Qian J, Gerstein M: Genomic analysis of gene expression relationships in transcriptional regulatory networks. Trends Genet. 2004, 20 (6): 227-10.1016/j.tig.2004.04.008.
Bobola N, Jansen RP, Shin TH, Nasmyth K: Asymmetric accumulation of Ash1p in postanaphase nuclei depends on a myosin and restricts yeast mating-type switching to mother cells. Cell. 1996, 84 (5): 699-10.1016/S0092-8674(00)81048-X.
Euskirchen GM: Nnf1p, Dsn1p, Mtw1p, and Nsl1p: a new group of proteins important for chromosome segregation in Saccharomyces cerevisiae. Eukaryot Cell. 2002, 1 (2): 229-10.1128/EC.1.2.229-240.2002.
Giacometti R, Kronberg F, Ricardo Biondi, Susana Passeron: Candida albicans Tpk1p and Tpk2p isoforms differentially regulate pseudohyphal development, biofilm structure, cell aggregation and adhesins expression. Yeast. 2011, 28 (4): 293-10.1002/yea.1839.
Chuwattanakul V, Sugiyama M, Khatun F, Kurata K, Tomita I, Kaneko Y, Harashima S: Increased transcription of NOP15, involved in ribosome biogenesis in Saccharomyces cerevisiae, enhances the production yield of RNA as a source of nucleotide seasoning. Journal of Bioscience and Bioengineering. 2012, 114 (1): 17-10.1016/j.jbiosc.2012.02.022.
Li N, Yuan L, Liu N, Shi D, Li X, Tang Z, Liu J, Venkatesan Sundaresan, Yang W: SLOW WALKER2, a NOC1/MAK21 Homologue, Is Essential for Coordinated Cell Cycle Progression during Female Gametophyte Development in Arabidopsis. Plant Physiol. 2009, 151 (3): 1486-10.1104/pp.109.142414.
Gavin AC: Proteome survey reveals modularity of the yeast cell machinery. Nature. 2006, 440: 631-636. 10.1038/nature04532.
Dezső Z, Oltvai ZN, Barabási AL: Bioinformatics Analysis of Experimentally Determined Protein Complexes in the Yeast Saccharomyces cerevisiae. Genome Research. 2003, 13: 2450-10.1101/gr.1073603.
Shannan J, Ho Sui, Fulton DL, Arenillas DJ, Kwon AT, Wasserman WW: oPOSSUM: integrated tools for analysis of regulatory motif over-representation. Nucleic Acids Research. 2007, 35: 245-10.1093/nar/gkm427.
Simon I: Serial Regulation of Transcriptional Regulators in the Yeast Cell Cycle. Cell. 2001, 106 (6): 697-10.1016/S0092-8674(01)00494-9.
Zhu C: High-resolution DNA-binding specificity analysis of yeast transcription factors. Genome Research. 2009, 19: 556-10.1101/gr.090233.108.
This work was supported in part by National Institute of Diabetes and Digestive and Kidney Diseases Grant R01DK080100 (XW).
Publication of this article is supported by NIDDK, NIH (Grant No. R01DK080100)
This article has been published as part of BMC Bioinformatics Volume 14 Supplement 9, 2013: Selected articles from the 8th International Symposium on Bioinformatics Research and Applications (ISBRA'12). The full contents of the supplement are available online at http://www.biomedcentral.com/bmcbioinformatics/supplements/14/S9.
The authors declare that they have no competing interests.
SG and XW designed the study. SG wrote the algorithms, performed the analysis, and created the figures and tables. SG and XW wrote the manuscript, read and approved the final version of the manuscript.
About this article
Cite this article
Gao, S., Wang, X. Identification of highly synchronized subnetworks from gene expression data. BMC Bioinformatics 14, S5 (2013). https://doi.org/10.1186/1471-2105-14-S9-S5
- Transcription Factor Binding Site
- Ribosome Biogenesis
- Yeast Cell Cycle
- Active Subnetwork
- Simulated Annealing Search