A microarray data-based semi-kinetic method for predicting quantitative dynamics of genetic networks
© Yugi et al; licensee BioMed Central Ltd. 2005
Received: 20 May 2005
Accepted: 13 December 2005
Published: 13 December 2005
Elucidating the dynamic behaviour of genetic regulatory networks is one of the most significant challenges in systems biology. However, conventional quantitative predictions have been limited to small networks because publicly available transcriptome data has not been extensively applied to dynamic simulation.
We present a microarray data-based semi-kinetic (MASK) method which facilitates the prediction of regulatory dynamics of genetic networks composed of recurrently appearing network motifs with reasonable accuracy. The MASK method allows the determination of model parameters representing the contribution of regulators to transcription rate from time-series microarray data. Using a virtual regulatory network and a Saccharomyces cerevisiae ribosomal protein gene module, we confirmed that a MASK model can predict expression profiles for various conditions as accurately as a conventional kinetic model.
We have demonstrated the MASK method for the construction of dynamic simulation models of genetic networks from time-series microarray data, initial mRNA copy number and first-order degradation constants of mRNA. The quantitative accuracy of the MASK models has been confirmed, and the results indicated that this method enables the prediction of quantitative dynamics in genetic networks composed of commonly used network motifs, which cover considerable fraction of the whole network.
With the advent of high-throughput biotechnologies in the last decade of the 20th century, enormous amounts of data have been generated on intracellular molecules [1–5]. The ongoing accumulation of such large-scale information presents a significant challenge to the scientific community: Namely, to understand the cell-wide molecular network as a living system [6–8]. In particular, modelling the behaviour of genetic regulatory networks has been one of the most significant milestones in systems biology [9–12]. In many previous studies, the dynamic behaviours of genetic networks were quantitatively predicted and analyzed in terms of non-linear ordinary differential equations based on reaction kinetics [13–15]. However, because it is arduous to obtain a complete set of sufficiently accurate kinetic properties of molecular interactions, the application of this method is limited to small regulatory networks, such as the tryptophan operon  and the lysis / lysogeny circuit of the bacteriophage lambda[13, 14].
Recently, there have been a few attempts to construct mathematical models of gene expression from large-scale data sets. These include generating reproductions of time series microarray data by 'time translation matrix', a parameterization of the E. coli SOS module model using green fluorescent protein (GFP) reporter plasmids, a qualitative simulation method based on piecewise linear differential equations and network model inferences from microarray data using a dynamic Bayesian network or a system identification technique. However, each of these approaches has limitations. Time translation matrix models are incapable of explaining dynamic gene expression patterns beyond the actual training data set, i.e. the expression profiles used to generate the matrix models themselves. The usefulness of the GFP approach is restricted to groups of genes regulated by one regulator. By definition, qualitative simulation is not capable of predicting quantitative dynamics. Finally, it is not clear how kinetic models that are inferred via a dynamic Bayesian network or a system identification method can generate accurate, quantitative predictions even though they could infer regulatory connections of genetic networks. Hence, the establishment of dynamic simulation methods for large-scale genetic regulatory networks remains a challenging problem in systems biology.
Here, we present a microarray data-based semi-kinetic (MASK) method for dynamic simulation of genetic regulatory networks composed of common network motifs. The quantitative accuracy of the MASK method was validated using a virtual genetic network described in a previous study, as well as genetic module of Saccharomyces cerevisiae inferred from expression profiles and genome-wide location analysis data. The virtual genetic network and the yeast network were employed to test the applicability of the MASK method to the frequently appearing network motifs: Single input motifs (SIMs) and multi-input motifs (MIMs), respectively. The yeast genetic module model is composed of 13 ribosomal protein (RP) genes regulated by Fhl1, Gal4 and Rap1. Recent experimental studies confirmed that Fhl1 and Rap1 bind upstream of yeast RP genes[4, 23]. With respect to the galactose-sensitive regulator Gal4, it has been reported that galactose addition triggers a three- to five-fold increase in the mRNA levels of RP genes.
The MASK model accurately predicted not only the training data sets, but also the test data sets. A test data set comprises microarray data that is not used for model estimation. Since SIMs and MIMs appear recurrently in genetic regulatory networks[4, 7], the results support the contention that the MASK method is applicable to a large fraction of the whole network.
Method validation using a hypothetical model
The R values of gene C in the MASK version of the model were adjusted to reproduce the expression levels represented in the original data. This meant that the accuracy of the MASK method could be evaluated by mean relative error of the target gene, G, under the same conditions as the original kinetic model (See Additional Text 1 for the detailed procedure of R value adjustment). The mean relative errors of gene G generated by both the original kinetic model and the MASK model were calculated with respect to 12 points sampled from the time courses.
Next, the inferred MASK model was applied to predict an expression time course of gene G in another condition, without any parameter change. Note that this 'test data set' was not used to train the MASK model. As well as the previous comparison of the predicted time course of gene G to the training data set, the mean relative error of gene G was calculated under identical regulatory conditions.
Both in the training and the test data sets, the expression time course of gene G generated by the MASK model was similar to that of the original model (Figures 1c and 1d). A regression analysis using the training data sets (Figure 1b) revealed that the relationship between the R terms of genes C and G was R G = 1.15 R C - 0.81(t-190 min). The mean relative error over the time series was 3.95% in the training data set. This MASK model was then employed for the prediction of time evolutions in another condition to validate whether a MASK model can perform accurate computer simulations of various states, other than those represented by the training data sets. As mentioned above, the predicted time course of gene G mRNA was very similar for the MASK and the original kinetic models (Figure 1d). In the test data set, the mean relative error of the gene G time series expression profile was 4.19%.
Application to a yeast genetic module using microarray data
Mean relative error of the RP genes.
The MASK model reproduced the dynamic behaviour of the virtual network and the yeast genetic module with a sufficient degree of accuracy. Since the tested networks are examples of network motifs including a SIM and a MIM, the coverage of the MASK method is as wide as the frequency of the motifs. This successful example of a MIM regulated by Rap1, Fhl1 and Gal4 supports the contention that the MASK method is capable of representing synergistic effects between multiple co-regulators, since it has been reported that Rap1 binding at promoters is required for Fhl1 binding. Furthermore, it has been theoretically demonstrated that the power-law equation can capture synergism of non-linear equations which are comprised of sums and products of elementary functions i.e. nearly all types of rate equations. Presumably, the 3–5% errors observed between the mathematical models of the virtual genetic network are attributable to power-law approximation, microarray sampling interval and abstraction of translation by time delay. In particular, the error caused by power-law approximation may reflect the residuals of each data point from the regression line (Figure 1b). With respect to the RP gene module model, the mean relative errors between the prediction and the experimental time series are larger than those observed in the comparative study of the conventional kinetic and MASK models. We consider that the error increment is due to measurement errors in the microarray data, which does not occur in the 'virtual microarray data'. Examining replicated microarray data, such as that presented in Refs.[32, 33], it is observed that on average, relative errors between the replicates are in the range 20–50% (data not shown), whereas the error between replicated GFP measurements is approximately 10%[17, 34]. We did not employ replicated time series microarray data in this study, because no such data sets were found in the databases. Despite having a smaller measurement error than microarray data, the kinetic model based on GFP time series data still exhibited mean relative errors of 10–20%. Thus, it is satisfactory that a microarray data-based model predicts gene expression dynamics with an error level of 10–30%. Moreover, microarray is significantly superior to GFP in terms of availability and comprehensiveness of data. This provides a rationale for immediate application of the MASK method to regulatory networks in as large a scale as microarray data allow.
Microarray data sets for training a MASK model should preferably have prominent variations in expression level and many time points within a short time interval. These desirable features of microarray data restrain the representation space of a MASK model. If the time series expression profile of both a regulator and its target gene are almost flat, it is obvious that their data points will not provide a significant regression line. For a meaningful regression, expression levels should be widely distributed by dynamic variations in transcription to provide sufficiently long confidence bands (e.g. Figure 1b), which guarantee broad representation space of the model. For microarray data, the resolution of time delay is restrained by time interval duration. This reflects the fact that the local clustering method quantifies the time delay by the number of time intervals. Therefore, short time intervals are preferable for quantifying time delays precisely.
Network architecture also restrains the application of the MASK method. The MASK method implicitly assumes that transcription rates of regulator genes are independent of those of target genes. Therefore, it is not appropriate in principle to employ the MASK method on particular genetic networks in which target genes largely influence the expression of their regulators – for example a pair of mutually regulating genes or a 'multi-component loop'. Fortunately, this restriction does not substantially constrain the extensive application of the MASK method because only three multi-component loops have so far been identified in a yeast genome-wide location analysis.
As a consequence, it is plausible that there will be a drastic reduction in the requirement for detailed kinetic data given that all yeast genes in SIMs and MIMs, with the exception of regulators, could be modelled without kinetic data. Thus, the MASK method facilitates the prediction of quantitative, dynamic behaviour of gene networks with sufficient accuracy.
We have demonstrated a novel method for the construction of dynamic simulation models of gene networks from time-series microarray data, initial mRNA copy number and first-order degradation constants of mRNA. An appropriately trained MASK model calculated time-series gene expression profiles as accurately as a conventional kinetic model, in both a training and a test data set. The microarray data-based model also predicted expression profiles of yeast RP genes, controlled by multiple regulators, under various conditions. These validation results indicate that once a MASK model has been estimated from a microarray data set in which expression levels vary widely, that model is applicable to broad conditions. Thus, the MASK method will facilitate the prediction and elucidation of dynamic behaviours of genetic regulatory networks, which will be a major methodological advance in systems biology.
A rate equation for RNA synthesis
The RNA synthesis rate was assumed to be a product of the basal level transcription rate (L) and magnitude of regulation (R). The basal level transcription rate is hyperbolic with respect to RNA polymerase concentration (Figure 4a). The rate equation is as follows:
where [RNAP], [Act] and [Rep] denote the concentration of RNA polymerase, activator and repressor, respectively. The kinetic parameters, K s and k a , represent the dissociation constant of RNA polymerase to DNA and the rate constant for RNA synthesis from the DNA-RNA polymerase complex, respectively (Figure 4b).
With respect to regulator genes, the R term is a function of their activators or repressors which should be described in terms of reaction kinetics. On the other hand, the R term of a target gene is defined as a power-law function of the R values of its regulators (Eq. (2)).
where R g (t) and R i (t-τ i ) denotes the R value of a target gene g at time t and that of the i th regulator at time t-τ i , respectively. The term τ i represents time delay for transmitting regulatory effect of the i th regulator to the target gene g. The coefficients a and b i are parameters which can be estimated from microarray data. Regulatory effects at the translational level are abstracted by the coefficients of the R terms, such as exponential parameters and time delays. These equations were implemented on E-Cell Simulation Environment version 3.1.102 for Linux (Fedora Core 2/i386).
Parameter estimation from microarray data
A multiple regression analysis of time series of R values provides the coefficients in Eq. (2). A time-series of R values is obtained by following the data processing steps summarized in Figure 5: (i) differentiation of time-series microarray data with respect to time (ii) calculation of RNA degradation rate from first-order degradation constant (iii) summing up degradation rate and time derivative of expression level to obtain RNA synthesis rate (iv) normalizing RNA synthesis rate as rate = 1 at initial condition. Consequently, the R value at time t can be calculated by following Eq. (3) (See Additional Text 2 for derivation):
where array (t), and k deg denotes the relative expression level at time point t, the time difference of the first and second time points and the first order degradation constant of mRNA, respectively. Taking the natural logarithm of Eq. (2), we obtain,
Note that multiple regression analysis of the time series of lnR yields an equation in the same form as Eq. (4). Thus, the least square estimates of ln a and b i were obtained via regression analysis of lnR time series data which are readily calculable from time series microarray data via Eq. (3). Target genes with regression p-values of more than 0.05 were not included in the mathematical models. The length of time delay, τ i , was calculated using the local clustering method .
Estimation of k a from array data
The rate constant k a in Eq. (1) was determined for each gene to minimize mean relative error between experimental data and predictions. The mean relative error E of the two time series data sets was defined as follows:
where X i and P i denote the expression level at the i th time point of experimental data and predicted data, respectively. The symbol n represents the total number of time points. See Additional Text 3 for the detailed algorithm to calculate an optimal k a value for each gene.
We thank Yuichiro Kamishima for improving implementation of the equations. This work was supported in part by a grant from CREST, JST; a grant from New Energy and Industrial Technology Development and Organization (NEDO) of the Ministry of Economy, Trade and Industry of Japan (Development of a Technological Infrastructure for Industrial Bioprocess Project); and a grant-in-aid from the Ministry of Education, Culture, Sports, Science and Technology for the 21st Century Center of Excellence (COE) Program (Understanding and Control of Life's Function via Systems Biology).
- Fleischmann RD, Adams MD, White O, Clayton RA, Kirkness EF, Kerlavage AR, Bult CJ, Tomb JF, Dougherty BA, Merrick JM: Whole-genome random sequencing and assembly of Haemophilus influenzae Rd. Science 1995, 269: 496–512.View ArticlePubMedGoogle Scholar
- Ghaemmaghami S, Huh WK, Bower K, Howson RW, Belle A, Dephoure N, O'Shea EK, Weissman JS: Global analysis of protein expression in yeast. Nature 2003, 425: 737–741. 10.1038/nature02046View ArticlePubMedGoogle Scholar
- Fiehn O, Kopka J, Dormann P, Altmann T, Trethewey RN, Willmitzer L: Metabolite profiling for plant functional genomics. Nature Biotechnology 2000, 18: 1157–1161. 10.1038/81137View ArticlePubMedGoogle Scholar
- Lee TI, Rinaldi NJ, Robert F, Odom DT, Bar-Joseph Z, Gerber GK, Hannett NM, Harbison CT, Thompson CM, Simon I, Zeitlinger J, Jennings EG, Murray HL, Gordon DB, Ren B, Wyrick JJ, Tagne JB, Volkert TL, Fraenkel E, Gifford DK, Young RA: Transcriptional regulatory networks in Saccharomyces cerevisiae. Science 2002, 298: 799–804. 10.1126/science.1075090View ArticlePubMedGoogle Scholar
- Hughes TR, Marton MJ, Jones AR, Roberts CJ, Stoughton R, Armour CD, Bennett HA, Coffey E, Dai H, He YD: Functional discovery via a compendium of expression profiles. Cell 2000, 102: 109–126. 10.1016/S0092-8674(00)00015-5View ArticlePubMedGoogle Scholar
- Ibarra RU, Edwards JS, Palsson BO: Escherichia coli K-12 undergoes adaptive evolution to achieve in silico predicted optimal growth. Nature 2002, 420: 186–189. 10.1038/nature01149View ArticlePubMedGoogle Scholar
- Shen-Orr SS, Milo R, Mangan S, Alon U: Network motifs in the transcriptional regulation network of Escherichia coli. Nature Genetics 2002, 31: 64–68. 10.1038/ng881View ArticlePubMedGoogle Scholar
- Almaas E, Kovacs B, Vicsek T, Oltvai ZN, Barabasi AL: Global organization of metabolic fluxes in the bacterium Escherichia coli. Nature 2004, 427: 839–843. 10.1038/nature02289View ArticlePubMedGoogle Scholar
- Ideker T, Thorsson V, Ranish JA, Christmas R, Buhler J, Eng JK, Bumgarner R, Goodlett DR, Aebersold R, Hood L: Integrated genomic and proteomic analyses of a systematically perturbed metabolic network. Science 2001, 292: 929–934. 10.1126/science.292.5518.929View ArticlePubMedGoogle Scholar
- Luscombe NM, Babu MM, Yu H, Snyder M, Teichmann SA, Gerstein M: Genomic analysis of regulatory network dynamics reveals large topological changes. Nature 2004, 431: 308–312. 10.1038/nature02782View ArticlePubMedGoogle Scholar
- Guet CC, Elowitz MB, Hsing W, Leibler S: Combinatorial synthesis of genetic networks. Science 2002, 296: 1466–1470. 10.1126/science.1067407View ArticlePubMedGoogle Scholar
- Elowitz MB, Leibler S: A synthetic oscillatory network of transcriptional regulators. Nature 2000, 403: 335–338. 10.1038/35002125View ArticlePubMedGoogle Scholar
- McAdams HH, Shapiro L: Circuit simulation of genetic networks. Science 1995, 269: 650–656.View ArticlePubMedGoogle Scholar
- Arkin A, Ross J, McAdams HH: Stochastic kinetic analysis of developmental pathway bifurication in phage lambda-infected Escherichia coli cells. Genetics 1998, 149: 1633–1648.PubMed CentralPubMedGoogle Scholar
- Santillan M, Mackey MC: Dynamic regulation of the tryptophan operon: a modeling study and comparison with experimental data. Proceedings of the National Academy of Sciences of the United States of America 2001, 98: 1364–1369. 10.1073/pnas.98.4.1364PubMed CentralView ArticlePubMedGoogle Scholar
- Holter NS, Maritan A, Cieplak M, Fedoroff NV, Banavar JR: Dynamic modeling of gene expression data. Proceedings of the National Academy of Sciences of the United States of America 2001, 98: 1693–1698. 10.1073/pnas.98.4.1693PubMed CentralView ArticlePubMedGoogle Scholar
- Ronen M, Rosenberg R, Shraiman BI, Alon U: Assigning numbers to the arrows: parameterizing a gene regulation network by using accurate expression kinetics. Proceedings of the National Academy of Sciences of the United States of America 2002, 99: 10555–10560. 10.1073/pnas.152046799PubMed CentralView ArticlePubMedGoogle Scholar
- de Jong H, Geiselmann J, Hernandez C, Page M: Genetic Network Analyzer: qualitative simulation of genetic regulatory networks. Bioinformatics 2003, 19: 336–344. 10.1093/bioinformatics/btf851View ArticlePubMedGoogle Scholar
- Nachman I, Regev A, Friedman N: Inferring quantitative models of regulatory networks from expression data. Bioinformatics 2004, 20: i248-i256. 10.1093/bioinformatics/bth941View ArticlePubMedGoogle Scholar
- Gardner TS, di Bernardo D, Lorenz D, Collins JJ: Inferring Genetic Networks and Identifying Compound Mode of Action via Expression Profiling. Science 2003, 301: 102–105. 10.1126/science.1081900View ArticlePubMedGoogle Scholar
- Zak DE, Gonye GE, Schwaber JS, Doyle FJ: Importance of input perturbations and stochastic gene expression in the reverse engineering of genetic regulatory networks: Insights from an identifiability analysis of an in silico network. Genome Research 2003, 13: 2396–2405. 10.1101/gr.1198103PubMed CentralView ArticlePubMedGoogle Scholar
- Bar-Joseph Z, Gerber GK, Lee TI, Rinaldi NJ, Yoo JY, Robert F, Gordon DB, Fraenkel E, Jaakkola TS, Young RA, Gifford DK: Computational discovery of gene modules and regulatory networks. Nature Biotechnology 2003, 21: 1337–1342. 10.1038/nbt890View ArticlePubMedGoogle Scholar
- Lieb JD, Liu X, Botstein D, Brown PO: Promoter-specific binding of Rap1 revealed by genome-wide maps of protein-DNA association. Nature Genetics 2001, 28: 327–334. 10.1038/ng569View ArticlePubMedGoogle Scholar
- Qian J, Dolled-Filhart M, Lin J, Yu H, Gerstein M: Beyond synexpression relationships: local clustering of time-shifted and inverted gene expression profiles identifies new, biologically relevant interactions. Journal of Molecular Biology 2001, 314: 1053–1066. 10.1006/jmbi.2000.5219View ArticlePubMedGoogle Scholar
- Wang Y, Liu CL, Storey JD, Tibshirani RJ, Herschlag D, Brown PO: Precision and functional specificity in mRNA decay. Proceedings of the National Academy of Sciences of the United States of America 2002, 99: 5860–5865. 10.1073/pnas.092538799PubMed CentralView ArticlePubMedGoogle Scholar
- Kimura M, Sakurai H, Ishihama A: Intracellular contents and assembly states of all 12 subunits of the RNA polymerase II in the fission yeast Schizosaccharomyces pombe. European Journal of Biochemistry 2001, 268: 612–619. 10.1046/j.1432-1327.2001.01911.xView ArticlePubMedGoogle Scholar
- Spellman PT, Sherlock G, Zhang MQ, Iyer VR, Anders K, Eisen MB, Brown PO, Botstein D, Futcher B: Comprehensive identification of cell cycle-regulated genes of the yeast Saccharomyces cerevisiae by microarray hybridization. Molecular Biology of the Cell 1998, 9: 3273–3297.PubMed CentralView ArticlePubMedGoogle Scholar
- Zhu G, Spellman PT, Volpe T, Brown PO, Botstein D, Davis TN, Futcher B: Two yeast forkhead genes regulate the cell cycle and pseudohyphal growth. Nature 2000, 406: 90–94. 10.1038/35021046View ArticlePubMedGoogle Scholar
- Schawalder SB, Kabani M, Howald I, Choudhury U, Werner M, Shore D: Growth-regulated recruitment of the essential yeast ribosomal protein gene activator Ifh1. Nature 2004, 432: 1058–1061. 10.1038/nature03200View ArticlePubMedGoogle Scholar
- Wade JT, Hall DB, Struhl K: The transcription factor Ifh1 is a key regulator of yeast ribosomal protein genes. Nature 2004, 432: 1054–1058. 10.1038/nature03175View ArticlePubMedGoogle Scholar
- Savageau MA, Voit EO: Recasting nonlinear differential equations as S-Systems: a canonical nonlinear form. Mathematical Biosciences 1987, 87: 83–115. 10.1016/0025-5564(87)90035-6View ArticleGoogle Scholar
- Dunham MJ, Badrane H, Ferea T, Adams J, Brown PO, Rosenzweig F, Botstein D: Characteristic genome rearrangements in experimental evolution of Saccharomycescerevisiae. PNAS 2002, 99: 16144–16149. 10.1073/pnas.242624799PubMed CentralView ArticlePubMedGoogle Scholar
- Lee K, Bernstein JA, Cohen SN: RNase G complementation of rne null mutation identifies functional interrelationships with RNase E in Escherichia coli. Molecular Microbiology 2002, 43: 1445–1456. 10.1046/j.1365-2958.2002.02848.xView ArticlePubMedGoogle Scholar
- Zaslaver A, Mayo AE, Rosenberg R, Bashkin P, Sberro H, Tsalyuk M, Surette MG, Alon U: Just-in-time transcription program in metabolic pathways. Nature Genetics 2004, 36: 486–491. 10.1038/ng1348View ArticlePubMedGoogle Scholar
- Takahashi K, Kaizu K, Hu B, Tomita M: A multi-algorithm, multi-timescale method for cell simulation. Bioinformatics 2004, 20: 538–546. 10.1093/bioinformatics/btg442View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.