Function approximation approach to the inference of reduced NGnet models of genetic networks
- Shuhei Kimura^{1}Email author,
- Katsuki Sonoda^{2},
- Soichiro Yamane^{3},
- Hideki Maeda^{1},
- Koki Matsumura^{1} and
- Mariko Hatakeyama^{4}
DOI: 10.1186/1471-2105-9-23
© Kimura et al; licensee BioMed Central Ltd. 2008
Received: 02 August 2007
Accepted: 14 January 2008
Published: 14 January 2008
Abstract
Background
The inference of a genetic network is a problem in which mutual interactions among genes are deduced using time-series of gene expression patterns. While a number of models have been proposed to describe genetic regulatory networks, this study focuses on a set of differential equations since it has the ability to model dynamic behavior of gene expression. When we use a set of differential equations to describe genetic networks, the inference problem can be defined as a function approximation problem. On the basis of this problem definition, we propose in this study a new method to infer reduced NGnet models of genetic networks.
Results
Through numerical experiments on artificial genetic network inference problems, we demonstrated that our method has the ability to infer genetic networks correctly and it was faster than the other inference methods. We then applied the proposed method to actual expression data of the bacterial SOS DNA repair system, and succeeded in finding several reasonable regulations. When our method inferred the genetic network from the actual data, it required about 4.7 min on a single-CPU personal computer.
Conclusion
The proposed method has an ability to obtain reasonable networks with a short computational time. As a high performance computer is not always available at every laboratory, the short computational time of our method is a preferable feature. There does not seem to be a perfect model for the inference of genetic networks yet. Therefore, in order to extract reliable information from the observed gene expression data, we should infer genetic networks using multiple inference methods based on different models. Our approach could be used as one of the promising inference methods.
Background
With recent advances in technologies such as DNA microarrays, it has become possible to measure gene expression patterns on a genomic scale. One expected use of these data is to predict functions of genes through the inference of regulatory interactions of genes, i.e., a genetic network. There are increasing needs to reveal unknown functions of genes. Therefore, many researchers have become interested in the inference of genetic networks, and the development of this methodology has become a major topic in the bioinformatics field.
where X_{ n }is the expression level of the n-th gene, N is the number of genes in the network, and G_{ n }is a function of an arbitrary form. The purpose of the genetic network inference problem based on the set of differential equations is to approximate the function G_{ n }from the observed gene expression data. The function G_{ n }is generally approximated using a model of the fixed form; most typically a linear model [7, 11, 12] or an S-system model [13]. The computational time for inferring linear models of genetic networks is very short. However, the linear model is not suitable for analyzing time-series of gene expression data because it requires that the system operates near a steady state [7]. The S-system model, on the other hand, possesses some properties inherent in biochemical systems. Moreover, several methods are available for analyzing the model. Because of these advantages, a number of inference methods based on the S-system model have been proposed [14–21]. However, some of them are time-consuming because they require solving a set of differential equations many times.
To overcome the shortcomings of the fixed model approaches, we defined the genetic network inference problem as a function approximation problem [10]. For solving the defined problem, any type of function approximator is available. When we use a powerful function approximator to solve this problem, we can obtain a good approximation of the function G_{ n }. Therefore, on the basis of this problem definition, we have proposed inference methods that use powerful function approximators, i.e., a neural network model [10], a Normalized Gaussian network (NGnet) model [9], and a reduced NGnet model [22], respectively. As inference methods based on this problem definition do not always require solving any differential equations, our methods needed a low computational effort.
Inference methods based on the function approximation problem, on the other hand, require estimating differential coefficients of the gene expression level before inferring the genetic network. We must estimate them correctly in order to obtain reasonable network models, and a number of techniques are available for this purpose [8, 15, 17, 23]. However, as the measurement data are generally polluted by noise, it is difficult for us to estimate the differential coefficients in advance. This study therefore proposes a new method that performs the inference of the genetic network and the estimation of the differential coefficients simultaneously. Our method uses the reduced NGnet model to describe genetic networks, since it requires a quite low computational effort. Through numerical experiments, we verify the effectiveness of the proposed inference method.
Results and Discussion
Inference of an S-system network
In this experiment, we confirmed that, when a sufficient amount of noise-free data are given, the proposed method has an ability to infer the genetic network correctly.
Experimental setup
The S-system parameters of the target model.
i | α _{ i } | g _{i,1} | g _{i,2} | g _{i,3} | g _{i,4} | g _{i,5} | β _{ i } | h _{i,1} | h _{i,2} | h _{i,3} | h _{i,4} | h _{i,5} |
---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | 5.0 | 0.0 | 0.0 | 1.0 | 0.0 | -1.0 | 10.0 | 2.0 | 0.0 | 0.0 | 0.0 | 0.0 |
2 | 10.0 | 2.0 | 0.0 | 0.0 | 0.0 | 0.0 | 10.0 | 0.0 | 2.0 | 0.0 | 0.0 | 0.0 |
3 | 10.0 | 0.0 | -1.0 | 0.0 | 0.0 | 0.0 | 10.0 | 0.0 | -1.0 | 2.0 | 0.0 | 0.0 |
4 | 8.0 | 0.0 | 0.0 | 2.0 | 0.0 | -1.0 | 10.0 | 0.0 | 0.0 | 0.0 | 2.0 | 0.0 |
5 | 10.0 | 0.0 | 0.0 | 0.0 | 2.0 | 0.0 | 10.0 | 0.0 | 0.0 | 0.0 | 0.0 | 2.0 |
As the observed gene expression patterns, fifteen sets of noise-free time-series data, each covering all five genes, were given. The sets began from randomly generated initial values in [0.0, 2.0] and were obtained by solving the differential equations (2) on the target model. In a practical application, these sets of time-series data could be obtained by actual biological experiments. Eleven sampling points for the time-series data were assigned to each gene in each set. Thus, the observed time-series data for each gene consisted of 15 × 11 = 165 sampling points. We inferred the reduced NGnet models solely from these time-series data, and then, extracted interactions between genes from the obtained models. As one reduced NGnet model corresponds to one gene, we must infer 5 models to solve the artificial problem defined here. We carried out 10 trials by changing the seed for the pseudo random number to obtain each model. According to the preliminary experiments (see Additional file 1), we used the following parameters; the weight parameter used in the prior probability distribution γ was 20, the maximum indegree I was 5, and the number of the units of the reduced NGnet model M was 3. We can change the function approximation capability of the reduced NGnet model using the number of units M. However, we cannot use the model with an unduly large M, since the large M makes the estimation problem of the model parameters difficult. An unduly small M, on the other hand, should make the model insufficient to represent complicated interactions between genes.
Result
where TP, FN, TN and FP are the numbers of true-positive, false-negative, true-negative and false-positive regulations, respectively. The sensitivity increases from 0 to 1 with decreasing the number of false-negative regulations, and the specificity increases from 0 to 1 with decreasing the number of false-positive regulations. The sum of the squared error between the time-course produced by the obtained model and the given time-series data, i.e., the value of the objective function (16) defined in the Methods section, was 1.57 × 10^{-1} ± 1.23 × 10^{-1} on average.
Although our method has an ability to infer the positive and negative regulations of the n-th gene from the m-th gene simultaneously, it failed in inferring these regulations of the 3rd gene from the 2nd gene in most of the trials. Given that X_{2} works to suppress both the synthesis and the degradation of X_{3} with the same kinetic order in the target model, we know that the 2nd gene has only a weak impact on the 3rd gene. Therefore, it should be difficult for our method to infer these regulations. In order to infer these difficult regulations correctly, we should give more sets of the gene expression data [15, 28].
While the proposed method was unable to infer the target network with perfect precision as mentioned above, its computational time was sufficiently short. The computational time to obtain one reduced NGnet model averaged about 60.8 sec on a single-CPU personal computer (Pentium IV 2.8 GHz). The proposed method therefore required about 60.8 sec × 5 ≃ 5.1 min to solve this genetic network inference problem. In order to infer the same network, on the other hand, PEACE1 [16], the coevolutionary method [18], the method with a collocation approximation [21] and the decoupling method [15] reportedly took about 10 h on a PC cluster (Pentium III 933 MHz × 1040 CPUs), 89.0 min on a PC cluster (Pentium III 933 MHz × 8 CPUs), 2.84 h on a single-CPU personal computer (Pentium IV 2.4 GHz) and 6.38 min on a single-CPU personal computer, respectively. The comparison results present that the proposed method was faster than the other inference methods. As a high performance computer, such as a PC cluster, is not always available at every laboratory, the shorter computational time of the proposed method should be a preferable feature.
As mentioned before, the proposed method performs the inference of the reduced NGnet model and the estimation of the differential coefficients of the gene expression level simultaneously. When we can estimate the differential coefficients of the gene expression level correctly before inferring the genetic network, however, the proposed method can omit the simultaneous estimation of the differential coefficients of the gene expression level. When the simultaneous estimation of the differential coefficients is omitted, our method is almost equivalent to the inference method proposed in the paper [22]. As the data used in this section contained no noise, the inference ability of our method was not degraded even when the simultaneous estimation of the differential coefficients was omitted. The sensitivity and the specificity of the proposed method without the simultaneous estimation of the differential coefficients of the gene expression level were 0.854 ± 0.041 and 0.961 ± 0.044, respectively. Moreover, the omission of the simultaneous estimation of the differential coefficients made the computational time much shorter. The method without the simultaneous estimation of the differential coefficients required about 2.0 × 5 ≃ 10.0 sec to solve this problem. However, the simultaneous estimation of the differential coefficients improved the sum of the squared error between the time-courses produced by the obtained model and the given time-series data. Thus, the averaged objective values (16) of the method with and without the simultaneous estimation of the differential coefficients were 1.57 × 10^{-1} ± 1.23 × 10^{-1} and 3.37 × 10^{-1} ± 1.93 × 10^{-1}, respectively. These results indicate that, although the simultaneous estimation of the differential coefficients of the gene expression level, proposed in this study, makes the computational cost higher, it produces the models that are suitable for the computational simulation.
Inference of a random genetic network
Next, we checked the performance of our method in a real-world setting by conducting the experiment with noisy time-series data.
Experimental setup
where λ_{ n }and α_{ n }are the degradation rate and the synthesis rate, respectively, of the n-th mRNA, and γ_{n,m}and β_{n,l}are the activation cooperativity and the repression cooperativity, respectively, of the m-th gene on the n-th gene. The sets ${\mathcal{A}}_{n}$ and ${\mathcal{R}}_{n}$ specify the genes that activate and repress the n-th gene, respectively. As the target networks, we randomly constructed the systems of 10, 20 and 30 genes (N = 10, 20 and 30). Since the inference ability of the proposed method may depend on the structure of the target network, we changed the network structure on every trial. We generated the target networks of different structures by changing the model parameters described above. In order to-construct the sets ${\mathcal{A}}_{n}$ and ${\mathcal{R}}_{n}$, we randomly chose an integer k from a power-law distribution with a cutoff 5. Then, k genes were randomly selected from all of the genes contained in the network. Finally, the indices corresponding to the selected genes were added to the set ${\mathcal{A}}_{n}$ or the set ${\mathcal{R}}_{n}$ with the probability 0.5. The model parameters (λ_{ n }, α_{ n }, γ_{n,m}and β_{n,l}) are randomly selected from a uniform distribution.
Since the performances of inference methods generally depend on the amount of given time-series data, we performed the experiments with different numbers of sets of time-series data. We obtained the sets of time-series data by solving the set of differential equations (5). Each set consisted of the expression levels at the eleven time points. The measurement noise was simulated by adding 10% Gaussian noise to the computed time-series data. All of the other experimental conditions were the same as those used in the previous experiment.
Results
The specificity, on the other hand, seems to be independent from the amount of given time-series data. When we try to improve it, we must reduce the number of false-positive regulations contained in the inferred model. It is however difficult to reduce these regulations because the maximum indegree I used in the prior probability distribution (15) forgives our method for finding several false-positive regulations. Therefore, we should not expect the improvement of the specificity even when we give a larger amount of the observed data.
Inference of an actual genetic network
Finally, we tested the effectiveness of the proposed method on a genetic network inference problem using actual biological data.
Experimental setup
Results
The core network contained some reasonable regulations. As Figure 6 shows, although the proposed method failed to infer the regulation from lexA to uvrA. the negative regulations from lexA to the other genes were successfully inferred. As described before, RecA is known to regulate LexA. Though this is a regulatory interaction between proteins, it should be represented by the regulation of lexA from recA in our network. A number of genes take part in repairing DNA damages, and the accomplishment of DNA repair makes RecA stop the system. The inferred regulations of recA from all of the genes might explain this mechanism.
The number of the regulations inferred by the proposed method was larger than that of the S-tree based method proposed by Cho and his colleagues [14]. Although some of our inferred regulations that have not been experimentally observed might be new findings, the rest should be false-positive. In order to infer a more reliable network, we must give more sets of the expression data obtained from additional biological experiments or a priori knowledge about the target system. The computational time of the proposed method was, on the other hand, much shorter. While the S-tree based method running on the computer system (Athlon MP2800+) reportedly took about 35 h to infer the network of this system, the proposed method required about 47.1 sec × 6 ≃ 4.7 min on a single-CPU personal computer (Pentium IV 2.8 GHz). In this study, we focused only on whether or not the m-th gene regulates the n-th gene. However, the method based on the sensitivity analysis used in this study also provides us with the strength of the inferred regulation. This information would help biologists find the important regulations that are worth doing further investigation.
Conclusion
The genetic network inference problem can be defined as a function approximation problem. On the basis of this problem definition, we proposed a new method to infer reduced NGnet models of genetic networks in this study. The experimental results on the artificial genetic network inference problems showed that the proposed method has an ability to infer genetic networks correctly. Because of the simultaneous estimation of the model parameters and the differential coefficients of the gene expression level, the models inferred by our method fitted into the observed data. Therefore, they are suitable for the computational simulation. Moreover, when trying to infer genetic networks, our method was faster than the other inference methods. As we cannot always use a high performance computer, the short computational time of our method should be a preferable feature. The proposed method was then used to analyze the SOS DNA repair system in E. coli, and succeeded in finding several reasonable regulations. While the number of the regulations inferred by our method was larger than that of the S-tree based method [14], its computational time was much shorter.
There does not seem to be a perfect model for the inference of genetic networks yet. Therefore, in order to extract reliable information from the observed gene expression data, the genetic networks should be inferred using a number of different models. The reduced NGnet model should be one of the promising models for this purpose.
Methods
In this study, we propose a method to infer reduced NGnet models of genetic networks. We should note here that one model in this study corresponds to one gene. Therefore, when we try to solve a genetic network inference problem consisting of N genes, we must obtain N models, each corresponding to one of the genes. This section will describe the algorithm to obtain the reduced NGnet model corresponding to the n-th gene, first. Then, we will explain the technique to extract the information from the obtained models.
Inference of a reduced NGnet model
Problem definition
where ${X|}_{{t}_{k}}=\left({{X}_{1}|}_{{t}_{k}},\cdots ,{{X}_{N}|}_{{t}_{k}}\right)$ is the expression levels of all of the genes at time t_{ k }, and ${\frac{d{X}_{n}}{dt}|}_{{t}_{k}}$ is the differential coefficient of the expression levels (rate of transcription) of the n-th gene at time t_{ k }. The purpose of this problem is then to estimate the parameters of the function approximator that outputs ${\frac{d{X}_{n}}{dt}|}_{{t}_{k}}(k=1,\cdots ,T)$ against a corresponding input ${X|}_{{t}_{k}}$.
Though DNA microarray technologies allow us to measure the gene expression levels, we have yet to find a biological technique capable of measuring the differential coefficient of the gene expression level. As an alternative, the data we obtain by measuring the time-series of the gene expression levels allow us to estimate the differential coefficients using interpolation techniques, such as the spline interpolation [32], the local linear regression [33], the neural network [8], or the Whittaker's smoother [23]. This study estimates them using the method proposed in the Estimation of differential coefficients section. When both the gene expression levels and their differential coefficients are given, the genetic network inference problem described here becomes solvable.
Reduced NGnet model
where the dot (·) denotes an operator of the inner product, and N(x|m_{ i }, Σ_{ i }) is an N-dimensional Gaussian function; its center is an N-dimensional vector m_{ i }and its covariance matrix is an (N × N)-dimensional matrix Σ_{ i }. The N-dimensional vector w_{ i }and the scalar b_{ i }are the linear regression parameters, α_{ i }(${\sum}_{i=1}^{M}{\alpha}_{i}=1$ and α_{ i }> 0) is the weight parameter, and M is the number of units. The NGnet model softly partitions the input space into M regions using M Gaussian functions. The i-th unit linearly approximates its output by w_{ i }·x + b_{ i }within the corresponding region. The weighted sum of these outputs is the final output of the NGnet model. In the genetic network inference problem, the input vector x represents the expression levels of all of the genes, i.e., X = (X_{1}, ..., X_{ N }), and the output, y represents the differential coefficient of the expression level of the n-th gene, i.e., $\frac{d{X}_{n}}{dt}$.
As the original NGnet, model has a large number of the model parameters, we must give a large number of observations to obtain a good function approximation. This nature is not preferable for the inference of genetic networks, since the measurement of the gene expression patterns is expensive. In order to decrease the amount of data we must observe, we limited a covariance matrix of the NGnet model Σ_{ i }to being diagonal [22]. This restricted model was referred to as the reduced NGnet model. While the number of the parameters of the original NGnet model is O(N^{2}), that of the reduced model is O(N).
This study approximates the function G_{ n }using the reduced NGnet model, as mentioned above. Therefore, our object in this study is to find the parameters of the reduced NGnet model that outputs ${\frac{d{X}_{n}}{dt}|}_{{t}_{k}}$ (k = 1, ⋯, T) against a corresponding input ${X|}_{{t}_{k}}$. Our algorithm to estimate these parameters is described below.
Gradual reduction strategy
We cannot make the Gaussian function N(x|m, Σ) independent from any components of the input vector x, since its covariance. matrix Σ must be non-singular. As the reduced NGnet model contains several Gaussian functions, its output y also depends on all of the components of the input vector x. This fact indicates that, even when the n-th gene is unaffected by the m-th gene in the target network, the reduced NGnet model cannot capture the disconnection.
- 1.
Let a set C be {1, ..., N}, where N is the number of the genes in the target network. We call the genes whose indices are contained in set C the candidate genes. Let N_{ C }be the number of the elements of set C.
- 2.
Extract the expression data of the candidate genes from the whole observed data. Then, obtain the reduced NGnet model by applying the DAEM algorithm, described below, to the constructed data. Note that, as the constructed data contain the expression levels of the candidate genes only, the input dimension of the model is N_{ C }.
- 3.
Compute the BIC of the model obtained in step 2. The BIC of the reduced NGnet model is defined as BIC = M(3N_{ C }+ 2)log(T) - 2L,
- 4.
If the BIC calculated in step 3 is larger than of the previous iteration, output the model of the previous step and, then, stop.
- 5.
Using the method based on the sensitivity analysis (see the Model interpretation section) [10], choose the genes that are assumed to unaffect the n-th gene. Then, remove the indices corresponding to the selected genes from set C. When no gene is selected, remove the index of the gene that has the weakest regulation to the n-th gene.
- 6.
Return to step 2.
DAEM algorithm
We can use the EM algorithm to obtain the reduced NGnet model that outputs y_{ t }(t = 1, ..., T) against a corresponding input x_{ t }, since it can be interpreted as a stochastic model [9, 22, 37]. In our genetic network inference problem, the input x_{ t }and the output y_{ t }represent the given expression levels of the candidate genes at time t and the given differential coefficient of the expression level of the n-th gene at time t, respectively.
- 1.
Let θ^{(0)}, which is generated randomly, be the initial estimate of the model parameters θ. Set the counter k and the parameter corresponding to the temperature β to 0 and β_{ min }, respectively.
- 2.For each pair of the input and the output (x_{ t }, y_{ t }), compute${f}_{i}^{(k)}({y}_{t}|{x}_{t})=\frac{P{({x}_{t},{y}_{t},i|{\theta}^{(k)})}^{\beta}}{{\displaystyle {\sum}_{j=1}^{M}P{({x}_{t},{y}_{t},j|{\theta}^{(k)})}^{\beta}}},$(9)
- 3.
Find a new estimate θ^{(k + 1)}that maximizes the function Q_{ β }.
- 4.
k ← k + 1.
- 5.
Repeat steps 2, 3 and 4 until convergence.
- 6.
β ← β + β_{ add }.
- 7.
Stop if β > 1. Otherwise, return to step 2.
The parameters of the DAEM algorithm, β_{ min }and β_{ add }, were both set to 0.1 in this study.
Note that this algorithm estimates the parameter ${\sigma}_{i}^{2}$ along with the other model parameters. Although the reduced NGnet model does not contain the parameter, ${\sigma}_{i}^{2}$ we cannot derive the learning algorithm without estimating it.
Use of a priori knowledge
- 1.
Let the set A be {1, ..., N}.
- 2.
Choose I genes in ascending order of the value of ${\omega}_{m}={\displaystyle {\sum}_{i=1}^{M}{w}_{i,m}^{2}}$ where I is a parameter named the maximum indegree. The maximum indegree determines the maximum number of genes that directly affect the n-th gene.
- 3.
From the set A, remove the indices corresponding to the genes selected in the previous step.
When the n-th gene is assumed to be unaffected by the m-th gene, this probability distribution forces the corresponding regression parameters, i.e., w_{1,m}, ..., w_{M,m}, down to zero. As mentioned in the Gradual reduction strategy section, even when these parameters are zero, the weak regulation of the n-th gene from the m-th gene remains in the model. However, the gradual reduction strategy should remove these unnecessary regulations from the model.
Estimation of differential coefficients
The genetic network inference problem of this study requires estimating the differential coefficients of the gene expression levels from the observed time-series data, as mentioned in the previous section. We can use some interpolation technique to estimate them [8, 15, 17, 23]. However, it is often difficult to estimate the differential coefficients correctly because the noise contained in the observed time-series data easily disrupts the information about their slopes. Moreover, even when these data are correctly estimated, the reduced NGnet model may not have the ability to represent them with perfect precision. As a result, when we try to simulate the gene expression using the models inferred from these data, the computed expression levels may not resemble the observed data. These models are therefore not suitable for the computational simulation.
${\widehat{G}}_{n}$ is the reduced NGnet mode, i.e., the right hand side of the equation (6), that approximates the function G_{ n }given in the equations (1), and ${\widehat{X}}_{m}$ is the m-th gene's expression level acquired by making a direct estimation from the observed time-series data. In order to estimate ${\widehat{X}}_{m}$'s, this study uses either the spline interpolation [32] for noise-free data or the local linear regression [33] for noisy data.
As mentioned above, whenever trying to compute the objective function (16), we must train the reduced NGnet model. For this purpose, we use two methods, the gradual reduction strategy described above and the EM algorithm. This study uses the former one to enhance the probability of obtaining a reasonable model and the latter to reduce the computational cost. As the EM algorithm is identical to the DAEM algorithm with β_{ min }= 1, its computational time is short. In our EM algorithm, in order to enhance the probability of finding a reasonable model, the parameters of the best model that has ever been found through the search are used as the initial estimate. When the function optimizer first tries to compute the objective function (16), the gradual reduction strategy is always used to infer the model. In the other cases, we use the EM algorithm with the probability 1 - 0.1 T^{-1}, otherwise we use the gradual reduction strategy, where T is the number of the observations.
The dimension of the function minimization problem defined here is identical to the number of the observations T. Therefore, when a large amount of the data are given, we must solve very high-dimensional problems. A high-dimensional problem generally requires a high computational effort even when we use a sophisticated function optimizer. In order to reduce the computational cost, this study therefore optimizes the objective function (16) for every dimension using a one-dimensional search algorithm, the Brent's method [32].
We should note that, although the purpose of the problem described here is to obtain the reasonable differential coefficients of the gene expression levels, we can obtain the reduced NGnet model suitable for the computational simulation at the same time. Thus, this study infers a model of a genetic network by optimizing the objective function (16).
Model interpretation
When analyzing a genetic network, we must know whether the n-th gene is affected by the m-th gene. We extract this information from the reduced NGnet model obtained using the method based on the sensitivity analysis [10].
T is the number of sampling points of the measured time-series data, and ${\frac{\partial {\widehat{G}}_{n}}{\partial {X}_{m}}|}_{t}$ is the estimated sensitivity coefficient at time t, that is calculated from the reduced NGnet model obtained. As the model used in this study is differentiable, we can calculate ${\frac{\partial {\widehat{G}}_{n}}{\partial {X}_{m}}|}_{t}$ analytically.
a = 0.3 and b = 0.05. Note that, when the m-th gene promotes both of the synthesis and the degradation of the n-th gene for example, the values of ${S}_{n}^{+}(m)$ and ${S}_{n}^{-}(m)$ might be large. In these cases, the extraction method must infer both of the positive and the negative regulations of the n-th gene from the m-th gene. As a is set to less than 0.5, the method has an ability to infer these regulations simultaneously.
Declarations
Acknowledgements
We thank Mr. Hideki Terasawa from JFE SOLDEC Corporation for his fruitful discussions. Some calculations were performed on RIKEN Super Combined Cluster (RSCC). This work is partially supported by the Ministry of Education, Culture, Sports, Science and Technology of Japan under Grant-in-Aid for Young Scientists (B) No. 18710166.
Authors’ Affiliations
References
- Akutsu T, Miyano S, Kuhara S: Inferring Qualitative Relations in Genetic Networks and Metabolic Pathways. Bioinformatics 2000, 16: 727–734.View ArticlePubMedGoogle Scholar
- D'haeseleer P, Liang S, Somogyi R: Genetic Network Inference: From Co-expression Clustering to Reverse Engineering. Bioinformatics 2000, 16: 707–726.View ArticlePubMedGoogle Scholar
- Imoto S, Goto T, Miyano S: Estimation of Genetic Networks and Functional Structures between Genes by using Bayesian Network and Nonparametric Regression. Proc Pacific Symposium on Biocomputing 2002, 7: 175–186.Google Scholar
- Maki Y, Tominaga D, Okamoto M, Watanabe S, Eguchi Y: Development of a System for the Inference of Large Scale Genetic Networks. Proc Pacific Symposium on Biocomputmg 2001, 6: 446–458.Google Scholar
- Sakamoto E, Iba H: Inferring a System of Differential Equations for a Gene Regulatory Network by using Genetic Programming. Proceedings of the 2001 Congress on Evolutionary Computation: 2001; Seoul 2001, 720–726.Google Scholar
- Vance W, Arkin A, Ross J: Determination of Causal Connectivities of Species in Reaction Networks. Proc Natl Acad Sci USA 2002, 99: 5816–5821.PubMed CentralView ArticlePubMedGoogle Scholar
- Yeung MKS, Tegnér J, Collins JJ: Reverse Engineering Gene Networks using Singular Value Decomposition and Robust Regression. Proc Natl Acad Sci USA 2002, 99: 6163–6168.PubMed CentralView ArticlePubMedGoogle Scholar
- Voit EO, Almeida J: Decoupling Dynamical Systems for Pathway Identification from Metabolic Profiles. Bioinformatics 2004, 20: 1670–1681.View ArticlePubMedGoogle Scholar
- Kimura S, Sonoda K, Yamane S, Matsumura K, Hatakeyama M: Function Approximation Approach to the Inference of Normalized Gaussian Network Models of Genetic Networks. Proceedings of the 2006 International Joint Conference on Neural Networks: 2006; Vancouver 2006, 4525–4532.Google Scholar
- Kimura S, Sonoda K, Yamane S, Matsumura K, Hatakeyama M: Function Approximation Approach to the Inference of Neural Network Models of Genetic Networks. IPSJ Transactions on Bioinformatics 2007, 48: 9–19.Google Scholar
- Bernardo D, Thompson MJ, Gardner TS, Chobot SE, Eastwood EL, Wojtovich AP, Elliott SJ, Schaus SE, Collins JJ: Chemogenomic Profiling on a Genome-wide Scale using Reverse-engineered Gene networks. Nature Biotechnology 2005, 23: 377–383.View ArticlePubMedGoogle Scholar
- Gardner TS, Bernardo D, Lorenz D, Collins JJ: Inferring Genetic Networks and Identifying Compound Mode of Action via Expression Profiling. Science 2003, 301: 102–105.View ArticlePubMedGoogle Scholar
- Voit EO: Computational Analysis of Biochemical Systems. Cambridge: Cambridge University Press; 2000.Google Scholar
- Cho DY, Cho KH, Zhang BT: Identification of Biochemical Networks by S-tree Based Genetic Programming. Bioinformatics 2006, 22: 1631–1640.View ArticlePubMedGoogle Scholar
- Chou IC, Martens H, Voit EO: Parameter Estimation in Biochemical Systems Models with Alternating Regression. Theoretical Biology and Medical Modelling 2006, 3: 25.PubMed CentralView ArticlePubMedGoogle Scholar
- Kikuchi S, Tominaga D, Arita M, Takahashi K, Tomita M: Dynamic Modeling of Genetic Networks using Genetic Algorithm and S-system. Bioinformatics 2003, 19: 643–650.View ArticlePubMedGoogle Scholar
- Kimura S, Hatakeyama M, Konagaya A: Inference of S-system Models of Genetic Networks from Noisy Time-series Data. Chem-Bio Informatics J 2004, 4: 1–14.View ArticleGoogle Scholar
- Kimura S, Ide K, Kashihara A, Kano M, Hatakeyama M, Masui R, Nakagawa N, Yokoyama S, Kuramitsu S, Konagaya A: Inference of S-system Models of Genetic Networks using a Cooperative Coevolutionary Algorithm. Bioinformatics 2005, 21: 1154–1163.View ArticlePubMedGoogle Scholar
- Kutalik Z, Tucker W, Moulton V: S-system Parameter Estimation for Noisy Metabolic Profiles using Newton-flow Analysis. IET Systems Biology 2007, 1: 174–180.View ArticlePubMedGoogle Scholar
- Tominaga D, Horton P: Inference of Scale-free Networks from Gene Expression Time Series. J of Bioinformatics and Computational Biology 2006, 4: 503–514.View ArticleGoogle Scholar
- Tsai KY, Wang FS: Evolutionary Optimization with Data Collocation for Reverse Engineering of Biological Networks. Bioinformatics 2005, 21: 1180–1188.View ArticlePubMedGoogle Scholar
- Kimura S, Sonoda K, Yamane S, Yoshida K, Matsumura K, Hatakeyama M: Inference of Genetic Networks using a Reduced NGnet Model. Proceedings of the 2007 International Joint Conference on Neural Networks: 2007: Orlando 2007, 6.Google Scholar
- Vilela M, Borges CCH, Vinga S, Vanconcelos ATR, Santos H, Voit EO, Almeida JS: Automated Smoother for the Numerical Decoupling of Dynamics Models. BMC Bioinformatics 2007, 3: 305.View ArticleGoogle Scholar
- Savageau MA: Biochemical Systems Analysis I. Some Mathematical Properties of the Rate Law for the Component Enzymatic Reactions. J Theoret Biol 1969, 25: 365–369.View ArticleGoogle Scholar
- Shiraishi F, Savageau MA: The Tricarboxylic Acid Cycle in Dictyostelium Discoideum. J of Biological Chemistry 1992, 267: 22912–22918.Google Scholar
- Voit EO, Radivoyevitch T: Biochemical Systems Analysis of Genome-wide Expression Data. Bioinformatics 2000, 16: 1023–1037.View ArticlePubMedGoogle Scholar
- Hlavacek WS, Savageau MA: Rules for Coupled Expression of Regulator and Effector Genes in Inducible Circuits. J Mol Biol 1996, 255: 121–139.View ArticlePubMedGoogle Scholar
- Veflingstad SR, Almeida J, Voit EO: Priming Nonlinear Searches for Pathway Identification. Theoretical Biology and Medical Modelling 2004, 1: 8.PubMed CentralView ArticlePubMedGoogle Scholar
- Sutton MD, Smith BT, Godoy VG, Walker GC: The SOS Response: Recent Insights into umuDC-Dependent Mutagenesis and DNA Damage Tolerance. Annual Review of Genetics 2000, 34: 479–497.View ArticlePubMedGoogle Scholar
- Ronen M, Rosenberg R, Shraiman BI, Alon U: Assigning Numbers to the Arrows: Parameterizing a Gene Regulation Network by using Accurate Expression Kinetics. Proc Natl Acad Sci USA 2002, 99: 10555–10560.PubMed CentralView ArticlePubMedGoogle Scholar
- Data of SOS system reporter plasmids[http://www.weizmann.ac.il/mcb/UriAlon/Papers/SOSData/]
- Press WH, Teukolsky SA, Vetterling WT, Flannery BP: Numerical Recipes in C. 2nd edition. Cambridge: Cambridge University Press; 1995.Google Scholar
- Cleveland WS: Robust Locally Weight Regression and Smoothing Scatterplots. J of American Statistical Association 1979, 79: 829–836.View ArticleGoogle Scholar
- Moody J, Darken CJ: Fast Learning in Networks of Locally-tuned Processing Units. Neural Computation 1989, 1: 281–294.View ArticleGoogle Scholar
- Sato M, Ishii S: On-line EM Algorithm for the Normalized Gaussian Network. Neural Computation 2000, 12: 407–432.View ArticlePubMedGoogle Scholar
- Schwarz G: Estimating the Dimension of a Model. Annals of Statistics 1978, 6: 461–464.View ArticleGoogle Scholar
- Xu L, Jordan MI, Hinton GE: An Alternative Model for Mixtures of Experts. Advances in Neural Information Processing Systems 1995, 7: 633–640.Google Scholar
- Ueda N, Nakano R: Deterministic Annealing EM Algorithm. Neural Networks 1998, 11: 271–282.View ArticlePubMedGoogle Scholar
- Thieffry D, Huerta AM, Pérez-Rueda E, Collado-Vides J: From Specific Gene Regulation to Genomic Networks: a Global Analysis of Transcriptional Regulation in Escherichia Coli. BioEssays 1998, 20: 433–440.View ArticlePubMedGoogle Scholar
- Maki Y, Ueda T, Okamoto M, Uematsu N, Inamura Y, Eguchi Y: Inference of Genetic Network using the Expression Profile Time Course Data of Mouse P19 Cells. Genome Informatics 2002, 13: 382–383.Google Scholar
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.