- Research article
- Open Access
Detecting sequence dependent transcriptional pauses from RNA and protein number time series
- Frank Emmert-Streib^{1},
- Antti Häkkinen^{2} and
- Andre S Ribeiro^{2}Email author
https://doi.org/10.1186/1471-2105-13-152
© Emmert-Streib et al.; licensee BioMed Central Ltd. 2012
- Received: 13 March 2012
- Accepted: 20 June 2012
- Published: 28 June 2012
Abstract
Background
Evidence suggests that in prokaryotes sequence-dependent transcriptional pauses affect the dynamics of transcription and translation, as well as of small genetic circuits. So far, a few pause-prone sequences have been identified from in vitro measurements of transcription elongation kinetics.
Results
Using a stochastic model of gene expression at the nucleotide and codon levels with realistic parameter values, we investigate three different but related questions and present statistical methods for their analysis. First, we show that information from in vivo RNA and protein temporal numbers is sufficient to discriminate between models with and without a pause site in their coding sequence. Second, we demonstrate that it is possible to separate a large variety of models from each other with pauses of various durations and locations in the template by means of a hierarchical clustering and a random forest classifier. Third, we introduce an approximate likelihood function that allows to estimate the location of a pause site.
Conclusions
This method can aid in detecting unknown pause-prone sequences from temporal measurements of RNA and protein numbers at a genome-wide scale and thus elucidate possible roles that these sequences play in the dynamics of genetic networks and phenotype.
Keywords
- Feature Vector
- Premature Termination
- Hairpin Loop
- Random Forest Classifier
- Pause Duration
Background
Noise is inherent in gene expression and affects the behavior of genetic circuits and thus phenotype determination. It is unknown to what extent this noise is evolvable. One mechanism that likely contributes to transcriptional noise in prokaryotes is RNA polymerase (RNAP) pausing during elongation[1, 2]. Pausing enhances the propensity for collisions between consecutive RNAPs in the template[3] and, in some cases, of premature terminations[4], particularly when hairpin loops form in the transcript, facilitating the recruitment of Rho-factor, a protein that dissociates the RNA from the DNA template and RNA polymerase[5]. The distance of the hairpin from the RNA 3^{ ′ } end and the RNA sequence affect pause duration and proneness for premature termination[4], indicating that the kinetics of this process is sequence dependent[6]. This feature makes transcriptional pausing a plausible mechanism via which natural selection may act upon noise in gene expression.
Long-duration pauses usually occur only at specific DNA sequences[4], while short-duration pauses occur at random locations[7]. Observations in bacteria suggest that the RNAP pauses, on average, every 100 to 200 bp, for a few seconds[6] and, less frequently, for one to several minutes[4].
One of the best studied long-pause sites is the his pause sequence. This sequence causes the RNAP to pause for, on average, 47 s, with an efficiency that can go up to 80%[5]. The long duration of this event relies on the formation of a hairpin loop in the elongating RNA sequence that stabilizes the RNAP[7]. By removing the region of the DNA that codes for loop, the duration is reduced to 4.6 s, and becomes exponentially distributed[7]. Unlike his pauses, other sequence dependent long pause sites do not require the formation of RNA secondary structures[8].
Studies of transcriptional pausing have focused on the physical-chemical causes and its physiological role in gene expression[4]. Biochemical experiments to single-molecule measurements suggest that there are several kinds of transcriptional pauses, which differ in the causal mechanism and in duration once occurring[6, 9–12]. One hypothesis regarding the role of pausing is that it facilitates the coupling of transcription and translation by halting the RNAP, allowing a translating ribosome to catch up[4]. Recently, it was suggested that pauses affect transcriptional noise[1]. Also, the location of the pause-prone sequence, the duration, and the proneness for pausing influence the extent to which the pause affects the kinetics of RNA production[2]. These effects on RNA numbers may be of relevance in prokaryotes, particularly because RNAs usually exist in very small amounts (from one to a few molecules)[13, 14].
So far there are only hypotheses regarding what may be the roles of sequence-dependent pauses on the dynamics of gene expression and genetic circuits[1, 4, 7]. To determine the role of pauses, a better knowledge is required regarding which sequences enhance the occurrence of pauses. Also, more knowledge is needed on the kinetics of the various pausing mechanisms and on their location in the genome to determine which genes’ expression is affected by pauses. For that, methods are needed to recognize the existence of pauses from temporal gene expression profiles. It is also necessary to identify the sequences responsible for the occurrence of transcriptional pauses.
With this aim, here we investigate whether, from temporal RNA and protein numbers, we can determine if there is a long-duration pause site in the elongation region of a gene. Additionally, we aim to estimate, at least by comparison, the mean duration of a pause and its location relative to the transcription start site. For that, we simulate stochastic gene expression dynamics at the nucleotide and codon levels[3, 15–17] of genes whose sequence includes long-duration pause sites that promote the occurrence of pauses with identical kinetics to that of the his pause[5]. Namely, we produce temporal series of RNA and protein numbers assuming that these molecules can be detected at the single-molecule level, as soon as they are produced, which is possible using MS2-GFP tagging[18, 19] for RNA, and tsr-venus sequences for proteins[20]. We use this information to search for pause sites and characterize their kinetic properties making use of statistical methods for classification using features extracted from time series of RNA and protein numbers.
Methods
Modeling gene expression
We use a delayed stochastic model of prokaryotic transcription and translation at the nucleotide and codon level that includes the closed and the open complex formation, stepwise elongation, as well as alternative pathways to elongation, namely pausing, arrests, editing, pyrophosphorolysis, RNA polymerase traffic, and premature termination. Stepwise translation can begin after the formation of the ribosome binding site and accounts for variable codon translation rates, ribosome traffic, back-translocation, drop-off, and trans-translation[3, 15].
Reactions and kinetic parameters for the gene expression model
# | Chemical reaction(s) | Parameters |
---|---|---|
1 | $\text{Pro}+\text{Rp}\stackrel{{k}_{\mathrm{tc}}}{\to}\text{Rp}\xb7\text{Pro}\left({\tau}_{\mathrm{oc}}\right)$ | k_{ tc }=0.0245, τ_{ oc }∼N(40,4^{2}) |
2 | $\text{Rp}\xb7\text{Pro}+{\text{U}}_{[1,({\Delta}_{\text{P}}+1\left)\right]}\stackrel{{k}_{m}}{\to}{\text{O}}_{1}+\text{Pro}$ | k_{ m }=150 |
3 | ${\text{O}}_{n}\stackrel{{k}_{a}}{\to}{\text{A}}_{n}$ | k_{ a }=150 for n>10, k_{ a }=30 for n≤10 |
4 | ${\text{A}}_{n}+{\text{U}}_{n+{\Delta}_{\text{P}}+1}\stackrel{{k}_{m}}{\to}{\text{O}}_{n+1}+{\text{U}}_{n-{\Delta}_{\text{P}}}+{\text{U}}_{n-{\Delta}_{\text{P}}}^{R}$ | k_{ m }=150 |
5 | ${\text{O}}_{n}\underset{1/{\tau}_{p}}{\overset{{k}_{p}}{\rightleftharpoons}}{\text{O}}_{{n}_{p}}$ | k_{ p }=0.55,τ_{ p }=3 |
6 | ${\text{O}}_{{n}_{p}}+{\text{A}}_{n-2{\Delta}_{\text{P}}-1}\stackrel{0.8{k}_{m}}{\to}{\text{O}}_{n}+{\text{A}}_{n-2{\Delta}_{\text{P}}-1}$ | k_{ m }=150 |
7 | ${\text{O}}_{n}+{\text{A}}_{n-2{\Delta}_{\text{P}}-1}\stackrel{0.2{k}_{m}}{\to}{\text{O}}_{{n}_{p}}+{\text{A}}_{n-2{\Delta}_{\text{P}}-1}$ | k_{ m }=150 |
8 | ${\text{O}}_{n}\underset{1/{\tau}_{\mathrm{ar}}}{\overset{{k}_{\mathrm{ar}}}{\rightleftharpoons}}{\text{O}}_{{n}_{\mathrm{ar}}}$ | ${k}_{\mathrm{ar}}=2.78\xb71{0}^{-4}$, τ_{ ar }=100 |
9 | ${\text{O}}_{n}\underset{1/{d}_{\mathrm{ed}}}{\overset{{k}_{\mathrm{ed}}}{\rightleftharpoons}}{\text{O}}_{{n}_{\mathrm{corr}}}$ | k_{ ed }=0.009, d_{ ed }=5 |
10 | ${\text{O}}_{n}\stackrel{{k}_{\mathrm{pre}}}{\to}\text{Rp}+{\text{U}}_{\left[\right(n-{\Delta}_{\text{P}}),(n+{\Delta}_{\text{P}}\left)\right]}$ | k_{ pre }=1.9·10^{−4} |
11 | ${\text{O}}_{n}+{\text{U}}_{n-{\Delta}_{\text{P}}-1}+{\text{U}}_{n-{\Delta}_{\text{P}}-1}^{R}\stackrel{{k}_{\mathrm{pyr}}}{\to}{\text{O}}_{n-1}+{\text{U}}_{n+{\Delta}_{\text{P}}-1}$ | k_{ pyr }=0.75 |
12 | ${\text{A}}_{\mathrm{last}}\stackrel{{k}_{f}}{\to}\text{Rp}+{\text{U}}_{[\text{last},\text{last}-{\Delta}_{\text{P}}]}+\text{mRNA}$ | k_{ f }=2 |
13 | $\text{mRNA}\stackrel{{k}_{\mathrm{dr}}}{\to}\varnothing $ | k_{ dr }=0.025 |
14 | $\text{Rib}+{\text{U}}_{[1,{\Delta}_{\text{R}}+1]}^{\text{R}}\stackrel{{k}_{\mathrm{tl}}}{\to}{\text{O}}_{1}^{\text{R}}+{\text{Rib}}^{\text{R}}$ | k_{ tl }=0.53 |
15 | ${\text{O}}_{n}^{\text{R}}\stackrel{{k}_{\mathrm{tr}\{A,B,C\}}}{\to}{\text{A}}_{n}^{\text{R}}$ | k_{ trA }=35, k_{ trB }=8, k_{ trC }=4.5 |
16 | ${\text{A}}_{n-3}^{\text{R}}+{\text{U}}_{[n+{\Delta}_{\text{R}}-3,n+{\Delta}_{\text{R}}-1]}^{\text{R}}\stackrel{{k}_{\mathrm{tm}}}{\to}{\text{O}}_{n-2}^{\text{R}}$ | k_{ tm }=10,000 |
17 | ${\text{O}}_{n-2}^{\text{R}}\stackrel{{k}_{\mathrm{tm}}}{\to}{\text{O}}_{n-1}^{\text{R}}$ | see above |
18 | ${\text{O}}_{n-1}^{\text{R}}\stackrel{{k}_{\mathrm{tm}}}{\to}{\text{O}}_{n}^{\text{R}}+{\text{U}}_{[n-{\Delta}_{\text{R}}-2,n-{\Delta}_{\text{R}}]}^{\text{R}}$ | see above |
19 | ${\text{O}}_{n}^{\text{R}}+{\text{U}}_{[n-{\Delta}_{\text{R}}-2,n-{\Delta}_{\text{R}}]}^{\text{R}}\stackrel{{k}_{\mathrm{bt}}}{\to}{\text{A}}_{n-3}^{\text{R}}+{\text{U}}_{[n+{\Delta}_{\text{R}}-3,n+{\Delta}_{\text{R}}-1]}^{\text{R}}$ | k_{ bt }=1.5 |
20 | ${\text{O}}_{n}^{\text{R}}\stackrel{{k}_{\mathrm{drop}}}{\to}\text{Rib}+{\text{U}}_{[n-{\Delta}_{\text{R}},n+{\Delta}_{\text{R}}]}^{\text{R}}$ | k_{ drop }=1.14·10^{−4} |
21 | $\text{mRNA}\stackrel{{k}_{\mathrm{tt}}}{\to}\left[{\text{Rib}}^{\text{R}}\right]\times \text{Rib}$ | k_{ tt } is sequence dependent |
22 | ${\text{A}}_{\mathrm{last}}^{\text{R}}\stackrel{{k}_{t{l}_{f}}}{\to}\text{Rib}+{\text{U}}_{[\mathrm{last},\mathrm{last}-{\Delta}_{\text{R}}]}^{\text{R}}+\text{P}\left({\tau}_{\mathrm{fold}}\right)$ | ${k}_{t{l}_{f}}=2$, τ_{ fold }∼N(420,100^{2}) |
23 | $\text{P}\stackrel{{k}_{\mathrm{dp}}}{\to}\varnothing $ | k_{ dp }=0.0029 |
The model of transcription accounts for the binding of the RNAP to the template and diffusion along the template (reaction 1 in Table1), promoter open complex formation (τ_{ oc } in reaction 1)[23], promoter clearance (reaction 2), nucleotide activation followed by stepwise elongation at each nucleotide (reactions 3 and 4, respectively), and termination (reaction 12). The reactions competing with stepwise elongation are transcriptional pauses (reactions 5), collisions between RNAPs, which may release (reaction 6) or induce pauses (reaction 7), arrests (reactions 8), misincorporation and editing (reactions 9), premature terminations (reaction 10), and pyrophosphorolysis (reaction 11). The number of nucleotides (2Δ_{P} + 1) occupied by the RNAP on the strand while elongating is 25[24]. Finally, mRNA can undergo degradation (reaction 13)[15].
The model of translation includes translation initiation (reaction 14 in Table1) and ribonucleotide activation (reaction 15) followed by stepwise translocation (reactions 16 to 18)[25, 36]. Reactions competing with translocation are the back-translocation (reaction 19), ribosome drop-off (reaction 20), and trans-translation (reaction 21). After elongation completion, it follows protein folding (reaction 22). The model accounts for codon-specific translation rates[37] and for the ribonucleotides occupied by a ribosome when on the RNA strand[15]. Finally, protein molecules undergo degradation (reaction 23). Note that each time we generate the sequence of a model gene, we generate the codon sequence randomly, according to the statistical frequency of each codon in Escherichia coli (extracted from NCBI GenBank as of Dec. 1st, 2011)[38].
Modeling sequence-dependent pauses
Two types of transcriptional pauses have been identified: i) ubiquitous pauses, which can occur at any nucleotide with approximately uniform probability of occurrence[7], and ii) sequence-dependent pauses, which occur at specific regions of the sequence[4].
where${k}_{{n}_{p}}={k}_{a}{\left({{\epsilon}_{{n}_{p}}}^{-1}-1\right)}^{-1}$ is the rate of pausing,${\tau}_{{n}_{p}}$ is the mean duration of the pause, and${\epsilon}_{{n}_{p}}$ denotes the pause efficiency, that is, the probability that an RNAP pauses when at the n th nucleotide.
As specified in reaction 1, the duration of these pauses is randomly drawn from an exponential distribution with the appropriate mean pause duration each time it occurs. It is noted that the assumption of exponential duration of each pause event is based on measurements where the sequence causing the pause is present, but the subsequent sequence where hairpin loops form (stabilizing the paused state) is not[7]. Unfortunately, there are yet no measurements available informing of the distribution of the durations of these long pauses, and thus we opted to make this assumption.
When a pause occurs, the ribosomes translating the RNA proceed only until the point where the RNAP is stranded. At that point, ribosomes pause until the RNAP is released[4]. Due to this, the pauses are expected to affect protein number dynamics[1].
Detecting the presence of a sequence-dependent pause site
Simulations of the models are initialized without RNA or proteins in the system. For our analyses we use only the stationary part of a time series. The methods assume the time series to be weakly stationary, meaning that the first two moments (i.e. mean and variance) do not vary over time. This condition is, in all cases, tested by a two-sample t-test for the ensemble mean values for a sample size of 10.
We first present a method to detect a sequence-dependent pause site from the time series of RNA and protein numbers. We denote by R_{ M },${R}_{{M}^{\prime}}$ two matrices of size F×L containing the number of mRNAs generated from two models, M and M^{ ′ }. F is the number of time series generated for each model and L is the length of the part of a time series that is assumed to be stationary. R_{ M }(i,) is a vector of length L containing the number of mRNAs of the i th time series for model M. Analogously, P_{ M },${P}_{{M}^{\prime}}$ are two matrices of size F×L containing the number of proteins for the two models. A thorough discussion of the generated data, i.e., how it was sampled, can be found in the results section.
- 1.
sample i∼unif(1:F)
- 2.
sample L_{ s }∼unif(1:L−ΔL)
- 3.estimate the mean number of mRNAs for model M and M’:${m}_{M}^{R}\left(s\right)=\frac{1}{\mathrm{\Delta L}+1}\sum _{t={L}_{s}}^{{L}_{s}+\mathrm{\Delta L}}{R}_{M}(i,t)$(2)${m}_{{M}^{\prime}}^{R}\left(s\right)=\frac{1}{\mathrm{\Delta L}+1}\sum _{t={L}_{s}}^{{L}_{s}+\mathrm{\Delta L}}{R}_{{M}^{\prime}}(i,t)$(3)
This test results in a p-value, p, indicating for p≤α the statistical significance of the test, i.e., the rejection of the null hypothesis, for a given significance level α. This p-value should be denoted as${p}_{M,{M}^{\prime}}$ since it results from a comparison of data from model M and model M^{ ′ }. Repeating the above procedure N times results in N different p-values that reflect the behavior of the population. Finally, we apply the same procedure to P_{ M }and${P}_{{M}^{\prime}}$ to obtain similar information for the protein levels.
Definition of feature vectors
For each of the models with pauses with distinct kinetic characteristics, we measure the number of mRNAs and of proteins, and the cumulative number of proteins as a function of time, represented by matrices, R_{ M }, P_{ M } and E_{ M }, respectively. Following the previous notation, each matrix has size F×L, where F is the number of repeated time series and L is the length of the stationary time series.
with 0≤l<T−1 and${\stackrel{\u0304}{m}}_{y}=\sum _{t=1}^{T}{y}_{t}/T$ is the mean of the time series {y_{ t }}. Also, for the cross-correlation function we estimate m(r_{ xy }) and s(r_{ xy }) up to lag K for R_{ M }and P_{ M }.
holds during the time series R_{ M }(i,). A component of vector d therefore gives the number of consecutive steps for which the number of mRNAs does not increase. From the resulting vector d(R_{ M }(i,)) we estimate its mean, m(d(R_{ M }(i,))), and standard deviation, s(d(R_{ M }(i,))).
Features used for classification
# | Feature | Description | Data |
---|---|---|---|
1 | m(r_{ xx };R_{ M }) | mean autocorrelation function | R _{ M } |
2 | s(r_{ xx };R_{ M }) | standard deviation of autocorrelation function | R _{ M } |
3 | m(r_{ xx };P_{ M }) | mean autocorrelation function | P _{ M } |
4 | s(r_{ xx };P_{ M }) | standard deviation of autocorrelation function | P _{ M } |
5 | m(r_{ xy };R_{ M },P_{ M }) | mean cross-correlation function | R_{ M } and P_{ M } |
6 | s(r_{ xy };R_{ M },P_{ M }) | standard deviation of cross-correlation function | R_{ M } and P_{ M } |
7 | m(r_{ xy };P_{ M },E_{ M }) | mean cross-correlation function | P_{ M } and E_{ M } |
8 | s(r_{ xy };P_{ M },E_{ M }) | standard deviation of cross-correlation function | P_{ M } and E_{ M } |
9 | m(d(R_{ M })) | mean decay time | R _{ M } |
10 | s(d(R_{ M })) | standard deviation of decay time | R _{ M } |
We would like to emphasize that all three types of measures introduced above, based on autocorrelation, cross-correlation and the decay time, are fundamentally different from each other. Whereas the first two types of measures are based on a different usage of correlation coefficients within (nr. 1, 2, 3, 4 see Table2) and between time series (nr. 5, 6, 7, 8 see Table2), the latter measure is not referential. Instead, it provides information about the continuity of the transcription process. In the results section, we will provide quantitative information for this argument.
Results and discussion
We model genes 1,000 nucleotides long. Unless otherwise stated, the long-pause site is at nucleotide 500 and has the same kinetic properties as a his pause, i.e., the efficiency of pausing is${\epsilon}_{{n}_{p}}=0.8$ (measurements indicate that it ranges from 0.5 to 0.8[5]) and the mean duration is${\tau}_{{n}_{p}}=47$ s[5]. We do not model an enhancement in the premature terminations at this location, since measurements of the kinetic properties of this process are not yet available. However, the occurrence of pauses may nevertheless lead to an increase of premature terminations due to increasing the expected duration of the elongation process which, on its own, may lead to an enhanced chance of premature termination of RNAPs preceding the paused one[1]. The models are implemented and simulated in SGN Sim[17].
Six different models used for detection of pauses
Model | Features |
---|---|
A | No sequence-dependent pause sites. |
B | Pause site at nucleotide 500. |
C | Pause site at nucleotide 250. |
D | Pause site at nucleotide 750. |
E | Pause site with mean duration${\tau}_{{n}_{p}}=23.5$ s at nucleotide 500. |
F | Pause site with mean duration${\tau}_{{n}_{p}}=94$ s at nucleotide 500. |
The comparison between models A and B tests if the presence of a long pause is detectable from time series of RNA and protein numbers. The other models are used to test whether the location and kinetic properties of the pause can be classified. For each model, we simulate 10 instances, each for 1,000,000 s. The sampling frequency of the number of RNAs and proteins is 1 s^{−1}. The different instances of each model differ in the codon sequences, as these are randomly generated as described in the Methods section. However, it is noted that the length of the sequence used here was found to be sufficient to not expect significant differences in the kinetics of translation elongation due to differences in the codon sequence.
We found that for t≥50,000 s the time series for the models A through F are weakly stationary, as hypothesized by the methods. Additionally, the time series appear ergodic, i.e., the ensemble average over different realizations corresponds to the time average over an individual time series[42]. Despite these properties, the average number of proteins estimated from a (small) sample size S≪1,000,000 is not a reliable variable that could serve as a feature, e.g., for clustering or classification of different models.
We would like to emphasize that, theoretically, different models can be distinguished from each other by calculating the asymptotic average number of proteins, however, in practice (i.e., for small sample sizes S≪1,000,000) the fluctuations increase the uncertainty of these estimates. This is especially important if one aims at studying the dynamics of expression of real genes since, given the present methods, asymptotic results are unreachable.
Detecting a sequence-dependent pause site
First, we test if a sequence-dependent pause with the aforementioned characteristics is detectable. Such a detection would discriminate a model with a pause site from a model without one. To study this, we compare model A with model B with the hypotheses tests described in the methods section.
It is visible that, with larger sample sizes, the median p-values fall below the α=0.05 significance level (horizontally dashed line), which means that the two models can be discriminated from each other in a statistical manner. The p-values for ΔL=200 are in general higher than for ΔL=1,000, as expected, because a shorter time series contains more variability with respect to the estimation of the mean number of mRNAs or proteins.
It is interesting to note that the information provided by the protein level allows a better discrimination for ΔL=200 compared to the mRNA level. Specifically, for sample size 10, the median p-value of the number of proteins is clearly significant, whereas the p-value for the mRNAs is not. For longer time series this difference vanishes. Further increasing ΔL leads to an even better distinction between the model A and B by requiring a smaller number of samples (not shown).
To demonstrate that the null hypothesis is not rejected if the data come from the same model, i.e., when the null hypothesis is true, we repeat the above analysis to obtain p-values for the cases p_{A,A} and p_{B,B}. The second column in Figure2 shows the result for a comparison of data from model A. In this case, the probability to reject the null hypothesis falsely is very low, because almost all p-values are much larger than our significance level of α=0.05. For model B we obtain qualitatively similar results (not shown).
Classification of models
We hypothesize that despite the intricate dynamics of the gene expression model where, e.g., RNAPs can bump into each other causing mutual delays of transcription, the information captured on the mRNA and protein numbers suffices to distinguish models with different parameter configurations. To demonstrate this, we estimate feature vectors for each model, based on the 10 features defined in the methods section, and show numerically their discriminative power.
The rationale of the following analysis is, first, to use an unsupervised clustering analysis to demonstrate that our features are not only sufficient to recover different models in an unsupervised manner but also that such clusters are robust. Second, we use a random forest classifier to classify the models based on our feature vectors. This allows a precise quantification of the errors made by such a categorization.
The sensible cluster formations of our hierarchical clustering in Figure3 demonstrate that time series data from different models carry indeed different information, which can be captured by our 10 features. This implies that our 10 dimensional feature vectors are sufficient to accomplish their separation. Further, it shows that the formation of these clusters is robust because the differences in the height of the lowest clusters compared to the major branches is up to 30-fold larger. This is confirmed by a Bootstrap analysis using only a subset of all available data to cluster the models, which leads essentially to the same cluster formations (not shown).
Next, we quantify the classification abilities of the feature vectors. We use a random forest classifier (RFC)[45–47] to categorize all models. A RFC is an ensemble method that is based on decision trees. Due to the fact that it consists of multiple (usually thousands) decision trees and not just one, it is called a forest (of decision trees). Each decision tree is only capable of performing a linear classification, however, Breiman[45, 46] showed that an ensemble of decision trees performs actually a non-linear classification. Training a RFC with 5,000 trees and averaging over 100 bootstrap[48] data sets results in a classification error of 11.75%(±0.37% standard deviation). If, instead, we are classifying models A, C and D and models B, E and F separately, then we obtain a classification error of 3.1%(±0.34%) for A, C and D, and 8.5%(±0.37%) for B, E and F.
Overall, these findings demonstrate that the information measured by the mRNA and protein numbers suffice to distinguish the models from each other, however, not without error. We studied many additional variables by enlarging the dimension of the feature vectors and found that the above classification errors can be further lowered. However, due to the moderate decrease in the classification errors (3%−4%) and the considerable increase in the complexity of the model (up to 24 dimensions), we focused on lower dimensional feature vectors as these suffice to provide affirmative information for our hypothesis.
Estimating the location of a pause site
Finally, we estimate the location of a pause site from time series data. For this, we consider the location of a pause site as a parameter of the gene expression model and estimate its optimal value with a maximum likelihood estimation[49].
Here, y is a S×V matrix where S is the sample size and V corresponds to the dimension of the random variable${\mathbf{y}}_{i}\in {\mathbb{R}}^{V}$, which are the row vectors of matrix y. The components of y_{ i }, whereas the index refers to the i-th sample, correspond to the variables defined in Table2, i.e., y_{ i }=(v_{1}(i),…,v_{ V }(i)) with V=10.
For simplicity, we assume that the multivariate density p(y_{ i }|θ) can be written as the product of its components, i.e.,$p\left({\mathbf{y}}_{i}\right|\theta )={\pi}_{j=1}^{V}p({v}_{j}\left(i\right)\left|\theta \right)$, implying the independence of v_{ i }from each other. In the previous section we saw that all random variables v_{ j } are required to obtain a sensible classification of the models. This justifies the independence assumption, because if these variables were strongly dependent, the dimension of the feature vector could have been reduced.
Here, the probability densities f and g correspond to models${M}_{{\theta}^{\prime}}$ and M_{ θ }, respectively. f and g are unknown and need to be estimated. We use a Gaussian density estimator[50] to estimate${\widehat{f}}_{{N}^{\prime}}\left(x\right|{M}_{{\theta}^{\prime}})$ and${\u011d}_{N}\left(x\right|{M}_{\theta})$ from samples. The density${\widehat{f}}_{{N}^{\prime}}\left(x\right|{M}_{{\theta}^{\prime}})$ is estimated from the data y, with sample size S. In contrast,${\u011d}_{N}\left(x\right|{M}_{\theta})$ is estimated from simulated data using model M_{ θ } to generate data with sample size S^{ ′ }. Theoretically, S^{ ′ }≠S is possible, however here we used S^{ ′ }=S. The meaning of p(x|θ) is that, if f≡g then p(x|θ)=1. On the other hand, if$min\left\{f\right(x\left|{M}_{{\theta}^{\prime}}\right),g\left(x\right|{M}_{\theta}\left)\right\}=0$ for all x (f and g do not overlap) then p(x|θ)=0.
To motivate our approach, we note that the parameter θ^{ ′ } in model${M}_{{\theta}^{\prime}}$ corresponds to the true but unknown position of a pause site in the model from which we observed the data set y, and θ is the unknown position of a pause site in model M_{ θ } that needs to be estimated. To estimate the probabilities, p(x|θ), in Equation 12, we simulate data from M_{ θ }for varying values of the parameter θ(position of a pause site). That means that we compensate for the lack of the availability of a likelihood function by the simulation of additional data sets to estimate some approximation thereof. When using only one variable, i.e., V=1, the likelihood function becomes L(θ|y)=p(θ|y) with$\mathbf{y}\in {\mathbb{R}}^{S}$. From this, the maximum likelihood parameter is estimated by$\widehat{\theta}=\text{argmax}\left\{L\right(\theta \left|\mathbf{y}\right)\}$. Because of the definition of the joint probability p(θ|y) (Equation 12), it follows that$\widehat{\theta}={\theta}^{\prime}$, which justifies its definition. For the multivariate case, the interpretation is similar.
Overall, due to the likelihood principle[52], our results justify the usage of Equation 11 as an approximate likelihood function.
Conclusions
So far the identification of pause-prone sequences has relied on in vitro studies that make use of complex measurement procedures to characterize the kinetics of elongation of the RNAP[4, 6, 7, 53]. These difficulties have hampered a proper assessment of possibly existing pause-prone sequences and thus a genome wide study of their role in the dynamics of gene regulatory networks. Further, there is a need for a better understanding of the role of these sequence-dependent and thus, evolvable events on the in vivo kinetics of gene expression.
Here we proposed a set of novel statistical methods that allow detecting the presence of pause sites, their location relative to the TSS, and their kinetics (mean duration), from time series data of mRNA and protein numbers at the single molecule level. This is motivated by the fact that such measurements are already possible to obtain in an almost genome-wide scale[14, 18, 20]. The methods proved to be efficient in all aims proposed when applied to a stochastic, sequence-level model of coupled transcription and translation in prokaryotes[15], found to be able to match measurements of gene expression at the single RNA and protein molecule level[18, 20].
For the cases studied, there may be alternative features that perform better, in one sense or another. For example, to detect the existence of a pause site we used the mean RNA and protein numbers. This feature is only suitable if the induction level is strong enough for several collisions between RNAPs to occur during the simulations. Additionally, this feature is affected by the codon sequences, which here are randomly generated in each simulation. In this case, and for the realistic parameter values used, this feature proved to be sufficient. In other conditions, the use of different or additional features may be required.
At the moment there is no means to experimentally validate the results. For that, one needs to measure, in vivo, RNA numbers at the single molecule level. The MS2-GFP tagging system of RNA molecules is likely to not be usable, not only because it immortalizes the RNA, but it most likely affects the secondary and tertiary structure of RNA as the binding of MS2 is likely to hamper formation of structures such as hairpin loops, which are needed to confer transcriptional pauses with stability[4]. Instead, the best approach may be to engineer two genes that code for a tsr-Venus protein[20] and are under the control of the same promoter. In one of the genes, a his-pause would then be introduced, while the other would be used as a null model. Controlling the expression of these sequences, one should use a strong promoter, capable of transcribing RNA at a rate of 200 s^{−1} or faster (the lac promoter is a tentative choice[54]).
The methods used here require data from different models to compare them with each other. This is regardless of the type of the statistical method employed. For example, to detect whether a pause exists from real gene expression data, one must provide a certain amount of data of the dynamics of expression of a gene that indeed contains a pause and data of a gene that does not contain the pause. Similar data are required if one wants to determine the location of pause sites and their durations. Hence, regardless if a hypothesis test, clustering or a classification method is used, one needs data that can be compared with each other in a statistical manner. We believe that this is not a problem. It is feasible to engineer genes, with the same promoters as the native genes, while having elongation sequences that follow those requirements and are known. From the data resultant from these engineered genes, we can train the algorithms prior to providing data on the native genes that may or may not possess pauses. If these have similar kinetic properties to the pauses of the synthetic genes, their presence is bound to be identifiable by the trained algorithm.
From the above, the method proposed here to identify unknown pause-prone sequences is rather laborious on the experimental side. Nevertheless, it is feasible using known, relatively simple experimental techniques[14, 18–20]. Also, to the best of our knowledge, it is the first method that can detect pause sequences from in vivo measurements of RNA and protein numbers. Finally, this method is not more extensive than the one presently used to detect pauses by in vitro techniques, which relies on the use of polystyrene beads held in optical traps[7].
A recent work[55] proposed a model of transcription elongation that allows, based on the DNA sequence, to predict to some extent the occurrence and duration of ubiquitous pauses. From measured rates of incorporation of nucleotides (that depend on the previously added one and on the one to be added), they derive a distribution of durations of these events for a certain DNA length. This distribution shows that some of these events can take several seconds to occur, thus providing an explanation for the occurrence of ubiquitous pauses during elongation. Unfortunately, the model is unable to predict long-duration pauses[55] as these are due to processes not accounted for by their model, such as the formation of hairpin loops in the elongating RNA and their interaction with the RNA polymerase, as in the case of his pauses[4]. Nevertheless, this approach, provided the inclusion of further details on the kinetics of transcription and translation (some of which may be unknown at the moment), may allow in the future to predict the occurrence of long pauses as well. In that case, the combined of use of this method along with ours (which allows determining the occurrence of pauses from the kinetics of RNA and protein production), may be of great aid in detecting and better understanding the nature of sequence dependent pauses.
In another work[56], a model of transcription elongation was proposed that was able to predict the kinetics of a specific type of transcriptional pauses, based on the sequence dependent translocation of the RNAp. Namely, the model accurately matched the kinetics of the tR2 pause[57]. It is yet unknown if this model can be extended to also be able to predict, from the DNA sequence, the occurrence of pauses such as the his pause, which require the formation of secondary RNA structures[4]. A similar work[58] proposed a method to predict sites for backtracking pauses. The method cannot be used for hairpin-induced pauses, since it cannot determine their stability. Again, in our understanding, these methods, provided their extension to include the long-duration pauses, can be used in parallel with the method proposed here since these methods aim to predict pauses from the sequences while we aim to detect the pause, its kinetics, and its location from RNA and protein numbers.
In conclusion, our methods provide means to detect unknown pause-prone sequences from temporal gene expression measurements and to determine their location in the sequence relative to the transcription start site and their kinetic properties. It may thus facilitate their identification from genome-wide temporal gene expression measurements. From this mapping, and by correlating these findings with the functions of the various proteins in the cells, we may enhance our understanding of whether and how this sequence-dependent mechanism is used in the regulation of genetic network dynamics[59, 60]. Finally, this knowledge may aid in developing novel means by which one can regulate the degree of noise in the dynamics of engineered genetic circuits.
Declarations
Acknowledgements
The work of FES is partly supported by the Engineering and Physical Sciences Research Council (EPSRC, UK) EP/H048871/1. ASR and AH are partially supported by by Academy of Finland (ASR) and FiDiPro program of Finnish Funding Agency for Technology and Innovation (AH and ASR). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Authors’ Affiliations
References
- Rajala T, Hakkinen A, Healy S, Yli-Harja O, Ribeiro AS: Effects of transcriptional pausing on gene expression dynamics. PLoS Comput Biol 2010, 6(3):e1000704. 10.1371/journal.pcbi.1000704PubMed CentralView ArticlePubMedGoogle Scholar
- Ribeiro AS, Hakkinen A, Healy S, Yli-Harja O: Dynamical effects of transcriptional pause-prone sites. Computational Biology and Chemistry 2010, 34(3):143–148. 10.1016/j.compbiolchem.2010.04.003View ArticlePubMedGoogle Scholar
- Ribeiro AS, Smolander OP, Rajala T, Hakkinen A, Yli-Harja O: Delayed stochastic model of transcription at the single nucleotide level. J Comp Biol 2009, 16(4):539–553. 10.1089/cmb.2008.0153View ArticleGoogle Scholar
- Landick R: The regulatory roles and mechanisms of transcriptional pausing. Biochem Soc Trans 2006, 34(6):1062–1066.View ArticlePubMedGoogle Scholar
- Toulokhonov I, Landick R: The flap domain is required for pause RNA hairpin inhibition of catalysis by RNA polymerase and can modulate intrinsic termination. Mol Cell 2003, 12(5):1125–1136. 10.1016/S1097-2765(03)00439-8View ArticlePubMedGoogle Scholar
- Adelman K, La Porta A, Santangelo TJ, Lis JT, Roberts JW, Wang MD: Single molecule analysis of RNA polymerase elongation reveals uniform kinetic behavior. Proc Natl Acad Sci USA 2002, 99(21):13538–13543. 10.1073/pnas.212358999PubMed CentralView ArticlePubMedGoogle Scholar
- Herbert KM, La Porta A, Wong BJ, Mooney RA, Neuman KC, Landick R, Block SM: Sequence-resolved detection of pausing by single RNA polymerase molecules. Cell 2006, 125(6):1083–1094. 10.1016/j.cell.2006.04.032PubMed CentralView ArticlePubMedGoogle Scholar
- Ramamoorthy R, Schmidt FJ: Transcript hairpin structures are not required for RNA polymerase pausing in the gene encoding the E. coli RNase P RNA , M1 RNA. FEBS Lett 1991, 295(1–3):226–229.View ArticleGoogle Scholar
- Kassavetis GA, Chamberlin MJ: Pausing and termination of transcription within the early region of bacteriophage T7 DNA in vitro. J Biol Chem 1981, 256(6):2777–2786.PubMedGoogle Scholar
- Wang D, Meier TI, Chan CL, Feng G, Lee DN, Landick R: Discontinuous movements of DNA and RNA in E. coli RNA polymerase accompany formation of a paused transcription complex. Cell 1995, 81(3):341–350. 10.1016/0092-8674(95)90387-9View ArticlePubMedGoogle Scholar
- Davenport RJ, Wuite GJL, Landick R, Bustamante C: Single-molecule study of transcriptional pausing and arrest by E. coli RNA polymerase. Science 2000, 287(5462):2497–2500. 10.1126/science.287.5462.2497View ArticlePubMedGoogle Scholar
- Neuman KC, Abbondanzien EA, Landick R, Gelles J, Block SM: Ubiquitous transcriptional pausing is independent of RNA polymerase backtracking. Cell 2003, 115(4):437–447. 10.1016/S0092-8674(03)00845-6View ArticlePubMedGoogle Scholar
- Bernstein JA, Khodursky AB, Lin PH, Lin-Chao S, Cohen SN: Global analysis of mRNA decay and abundance in Escherichia coli at single-gene resolution using two-color fluorescent DNA microarrays. Proc Natl Acad Sci USA 2002, 99(15):9697–9702. 10.1073/pnas.112318199PubMed CentralView ArticlePubMedGoogle Scholar
- Taniguchi Y, Choi PJ, Li GW, Chen H, Babu M, Hearn J, Emili A, Xie XS: Quantifying E. coli Proteome and Transcriptome with Single-Molecule Sensitivity in Single Cells. Science 2010, 329(5991):533–538. 10.1126/science.1188308PubMed CentralView ArticlePubMedGoogle Scholar
- Makela J, Lloyd-Price J, Yli-Harja O, Ribeiro AS: Stochastic sequence-level model of coupled transcription and translation in prokaryotes. BMC Bioinf 2011, 12: 121. 10.1186/1471-2105-12-121View ArticleGoogle Scholar
- Ribeiro AS, Zhu R, Kauffman SA: A general modeling strategy for gene regulatory networks with stochastic dynamics. J Comp Biol 2006, 13(9):1630–1639. 10.1089/cmb.2006.13.1630View ArticleGoogle Scholar
- Ribeiro AS, Lloyd-Price J: SGN Sim, a stochastic genetic networks simulator. Bioinf 2007, 23(6):777–779. 10.1093/bioinformatics/btm004View ArticleGoogle Scholar
- Golding I, Paulsson J, Zawilski SM, Cox EC: Real-Time Kinetics of Gene Activity in Individual Bacteria. Cell 2005, 123: 1025–1036. 10.1016/j.cell.2005.09.031View ArticlePubMedGoogle Scholar
- Kandhavelu M, Mannerstrom H, Gupta A, Hakkinen A, Lloyd-Price J, Yli-Harja O, Ribeiro JJ: In vivo kinetics of transcription initiation of the lar promoter in Escherichia coli. Evidence for a sequential mechanism with two rate limiting steps. BMC Syst Biol 2011, 5: 149. 10.1186/1752-0509-5-149PubMed CentralView ArticlePubMedGoogle Scholar
- Yu J, Xiao J, Run X, Lao K, Xie XS: Probing gene expression in live cells, one protein molecule at a time. Science 2006, 311(5767):1600–1603. 10.1126/science.1119623View ArticlePubMedGoogle Scholar
- Roussel MR, Zhu R: Validation of an algorithm for delay stochastic simulation of transcription and translation in prokaryotic gene expression title. Phys Biol 2006, 3(4):274–284. 10.1088/1478-3975/3/4/005View ArticlePubMedGoogle Scholar
- Gillespie DT: Exact stochastic simulation of coupled chemical reactions. J Phys Chem 1977, 81(25):2340–2361. 10.1021/j100540a008View ArticleGoogle Scholar
- Lutz R, Lozinski T, Ellinger T, Bujard H: Dissecting the functional program of Escherichia coli promoters: the combined mode of action of Lac repressor and AraC activator. Nucl Acids Res 2001, 29(19):3873–3881.PubMed CentralView ArticlePubMedGoogle Scholar
- Greive SJ, von Hippel PH: Thinking quantatively about transcriptional regulation. Nat Rev Mol Cell Biol 2005, 6(3):221–232.View ArticlePubMedGoogle Scholar
- Moore SD, Sauer RT: Ribosome rescue: tmRNA tagging activity and capacity in Escherichia coli. Mol Microbiol 2005, 58(2):456–466. 10.1111/j.1365-2958.2005.04832.xView ArticlePubMedGoogle Scholar
- Zhu R, Ribeiro AS, Salahub D, Kauffman SA: Studying genetic regulatory networks at the molecular level: Delayed reaction stochastic models. J Theor Biol 2007, 246(4):725–745. 10.1016/j.jtbi.2007.01.021View ArticlePubMedGoogle Scholar
- Erie DA, Hajiseyedjavadi O, Young MC, von Hippel PH: Multiple RNA polymerase conformations and GreA: control of the fidelity of transcription. Science 1993, 262(5135):867–873. 10.1126/science.8235608View ArticlePubMedGoogle Scholar
- Lewin B: Genes IX. Jones & Bartlett, USA; 2008.Google Scholar
- Proshkin S, Rahmouni AR, Mironov A, Nudler E: Cooperation between translating ribosomes and RNA polymerase in transcription elongation. Science 2010, 328(5977):504–508. 10.1126/science.1184939PubMed CentralView ArticlePubMedGoogle Scholar
- Epshtein V, Nudler E: Cooperation between RNA polymerase molecules in transcription elongation. Science 2003, 300(5620):801–805. 10.1126/science.1083219View ArticlePubMedGoogle Scholar
- Wen JD, Lancaster L, Hodges C, Zeri AC, Yoshimura SH, Noller HF, Bustamante C, Tinoco I: Following translation by single ribosomes one codon at a time. Nature 2008, 452(7187):598–603. 10.1038/nature06716PubMed CentralView ArticlePubMedGoogle Scholar
- Mitarai N, Sneppen K, Pedersen S: Ribosome collisions and translation efficiency: Optimization by codon usage and mRNA destabilization. J Mol Biol 2008, 382: 236–245. 10.1016/j.jmb.2008.06.068View ArticlePubMedGoogle Scholar
- Shoji S, Walker SE, Fredrick K: Ribosomal translocation: One step closer to the molecular mechanism. ACS Chem Biol 2009, 4(2):93–107. 10.1021/cb8002946PubMed CentralView ArticlePubMedGoogle Scholar
- Jorgensen F, Kurland CG: Processivity errors of gene expression in Escherichia coli. J Mol Biol 1990, 215(4):511–521. 10.1016/S0022-2836(05)80164-0View ArticlePubMedGoogle Scholar
- Megerle JA, Fritz G, Gerland U, Jung K, Radler JO: Timing and dynamics of single cell gene expression in the arabinose utilization system. Biophys J 2008, 95(4):2103–2115. 10.1529/biophysj.107.127191PubMed CentralView ArticlePubMedGoogle Scholar
- Keiler KC: Biology of trans-translation. Annu Rev Microbiol 2008, 62: 133–151. 10.1146/annurev.micro.62.081307.162948View ArticlePubMedGoogle Scholar
- Sorensen MA, Pedersen S: Absolute in vivo translation rates of individual codons in Escherichia coli: The two glutamic acid codons GAA and GAG are translated with a threefold difference in rate. J Mol Biol 1991, 222(2):265–280. 10.1016/0022-2836(91)90211-NView ArticlePubMedGoogle Scholar
- Benson D, Karsch-Mizrachi I, Lipman D, Ostell J, Wheeler D: GenBank: update. Nucleic Acids Res 2004, 32: D23-D26. 10.1093/nar/gkh045PubMed CentralView ArticlePubMedGoogle Scholar
- Sheskin DJ: Handbook of Parametric and Nonparametric Statistical Procedures. RC Press, Boca Raton, FL; 3rd edition 2004.Google Scholar
- Shumway RH, Stoffer DS: Time series analysis and its applications. Springer, New York, NY; 2000.View ArticleGoogle Scholar
- Tsay RS: Analysis of financial time series. Wiley Interscience, Hoboken, NJ; 2005.View ArticleGoogle Scholar
- DasGupta A: Asymptotic theory of statistics and probability. Springer, New York; 2008.Google Scholar
- Hastie TJ, Tibshirani RJ: Generalized Additive Models. Chapman and Hall, New York; 1990.Google Scholar
- McQuitty LL: Similarity Analysis by Reciprocal Pairs for Discrete and Continuous Data. Educational and Psychological Measurement 1966, 26(4):825–831. 10.1177/001316446602600402View ArticleGoogle Scholar
- Breiman L: Random forests. Mach Learn 2001, 45: 5–32. 10.1023/A:1010933404324View ArticleGoogle Scholar
- Breiman L: Bagging predictors. Mach Learn 1996, 24(2):123–140.Google Scholar
- Zhang H, Singer BH: Recursive partitioning and applications. Springer, New York, NY; 2010.View ArticleGoogle Scholar
- Efron B, Tibshirani RJ: An introduction to the bootstrap. Chapman & Hall/CRC, New York, NY; 1994.Google Scholar
- Pawitan Y: In all likelihood: statistical modelling and inference using likelihood. Oxford University Press, Oxford; 2001.Google Scholar
- Givens GH, Hoeting JA: Computational statistics. Wiley Interscience, New York, NY; 2005.Google Scholar
- Davison AC: Statistical models. Cambridge University Press, Cambridge, UK; 2009.Google Scholar
- Young GA, Smith RL: Essentials of statistical inference. Cambridge University Press, Cambridge, UK; 2005.View ArticleGoogle Scholar
- Greive SJ, Weitzel SE, Goodarzi JP, Main LJ, Pasman Z, von Hippel PH: Monitoring RNA transcription in real time by using surface plasmon resonance. Proc Natl Acad Sci USA 2008, 105(9):3315–3320. 10.1073/pnas.0712074105PubMed CentralView ArticlePubMedGoogle Scholar
- Kennell D, Riezman H: Transcription and translation initiation frequencies of the Escherichia coli lac operon. J Mol Biol 1977, 114: 1–21. 10.1016/0022-2836(77)90279-0View ArticlePubMedGoogle Scholar
- Yamada YR, Peskin CR: A look-ahead model for the elongation dynamics of transcription. Biophys J 2009, 96(8):3015–3031. 10.1016/j.bpj.2008.12.3955PubMed CentralView ArticlePubMedGoogle Scholar
- Bai L, Fulbright R, Wang M: Mechanochemical Kinetics of Transcription Elongation. Phys Rev Lett 2007, 98: 068103.View ArticlePubMedGoogle Scholar
- Shundrovsky A, Santangelo T, Roberts J, Wang M: A Single-Molecule Technique to Study Sequence-Dependent Transcription Pausing. Biophys J 2004, 87(6):3945–3953. 10.1529/biophysj.104.044081PubMed CentralView ArticlePubMedGoogle Scholar
- Tadigotla V, Maoileidigh D, Sengupta A, Epshtein V, Ebrigh R, Nudler E, Ruckenstein A: Thermodynamic and kinetic modeling of transcriptional pausing. Proc Natl Acad Sci USA 2006, 103(12):4439–4444. 10.1073/pnas.0600508103PubMed CentralView ArticlePubMedGoogle Scholar
- Emmert-Streib F, Glazko G: Network Biology: A direct approach to study biological function. Wiley Interdiscip Rev Syst Biol Med 2011, 3(4):379–391. 10.1002/wsbm.134View ArticlePubMedGoogle Scholar
- Lindstrom ME, Konopka MC: The role of physiological heterogeneity in microbial population behavior. Nat Chem Biol 2010, 6(10):705–712. 10.1038/nchembio.436View ArticleGoogle Scholar
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.