Volume 11 Supplement 6
Promoter prediction in E. coli based on SIDD profiles and Artificial Neural Networks
© Newsome et al; licensee BioMed Central Ltd. 2010
Published: 7 October 2010
One of the major challenges in biology is the correct identification of promoter regions. Computational methods based on motif searching have been the traditional approach taken. Recent studies have shown that DNA structural properties, such as curvature, stacking energy, and stress-induced duplex destabilization (SIDD) are useful in promoter prediction, as well. In this paper, the currently used SIDD energy threshold method is compared to the proposed artificial neural network (ANN) approach for finding promoters based on SIDD profile data.
When compared to the SIDD threshold prediction method, artificial neural networks showed noticeable improvements for precision, recall, and F-score over a range of values. The maximal F-score for the ANN classifier was 62.3 and 56.8 for the threshold-based classifier.
Artificial neural networks were used to predict promoters based on SIDD profile data. Results using this technique were an improvement over the previous SIDD threshold approach. Over a wide range of precision-recall values, artificial neural networks were more capable of identifying distinctive characteristics of promoter regions than threshold based methods.
Identification of promoters is an important issue in biology, given that they are central in understanding the process by which genes are regulated. Wet-lab methods for promoter identification provide accuracy but suffer from being time-consuming. In order to facilitate faster processing, computational methods are required. Although far from perfect, they do provide a means for quickly identifying potential targets for experimental validation.
Several computational methods for promoter prediction have been proposed. Most include some analysis of patterns commonly found in promoter regions, such as -10 and -35 motifs [1, 2]. However, these patterns are not always sufficiently conserved to allow for adequate prediction. Furthermore, there are clearly other factors not directly related to sequence motifs that are closely associated with promoter regions.
Recent studies have reported impressive results using DNA structural properties as predictors of promoter regions . These methods include DNA curvature , relative stability , and stress-induced duplex destabilization (SIDD) [6, 7]. Of interest in this paper is promoter prediction using SIDD properties. In , some of the most impressive results to date are reported for E. coli K12. These were achieved simply using a minimum SIDD threshold value for distinguishing promoters from non-promoters. The current study proposes a more sophisticated approach, involving the use of artificial neural networks (ANNs), along with SIDD profiles, for promoter prediction.
Results and discussion
A comparison of threshold and ANN methods for SIDD-based promoter prediction was assessed using E. coli K12. First, the SIDD profile for the E. coli K12 genome was obtained from Benham . For this dataset, each base pair (bp) is represented by its destabilization free energy, G(x). G(x) corresponds to the incremental free energy needed for the base pair at position x to always remain open.
Training and testing sets construction
Comparison of prediction methods
Promoters are strongly associated with regions of low SIDD energy (see Figure 1). This forms the basis for prediction by thresholds. For this method, the sum of the SIDD energies, sumG, for each of the 250 bp testing set instance was calculated. Instances with sumG less than or equal to a selected threshold, T, were tagged promoters. For predictions using the ANNs, classifiers were built from the training set and evaluated on the testing set.
Predictions were impressive for both classifiers and show that SIDD can be useful in distinguishing promoter and non-promoter regions. With exceptions for conditions of high precision where the two classifiers were nearly equal, predictions for ANNs outperformed sumG over a wide range. For example, at equal precision of 61% for both classifiers, the recall of the ANN was at 60%, while sumG was at 50%. This represents 305 correctly predicted promoters for the ANN and 255 for sumG.
In order to compare predictions using a one-dimensional performance measure, the weighted average (or more specifically, the harmonic mean) over all precision-recall pairs was computed for the ANN and sumG methods. This measure is known as the F-score. The maximal F-score score for all precisions-recall pairs was identified. The resulting values were 62.3 (precision 59, recall 66) for the ANN and 56.8 (precision 54, recall 60) for sumG. Again, the ANN classifier showed a noticeable improvement over sumG.
A comparison was also made for a combined ANN-sumG classifier. Using F-scores of 60 and 57 for the ANN and sumG classifiers, respectively, a decision tree was built from their combined predictions using the Weka data mining suite’s J48 algorithm . The F-score of the resulting classifier was 60. Because a large percentage of the correct predictions made by sumG were also made by the ANN, there was no significant improvement.
The differences in the prediction ability of the ANN and sumG methods result from the way they recognize promoter regions. The sumG method is only able to identify SIDD regions whose summations fall above or below a specified threshold. This differs from ANNs, which are known for their ability to detect patterns. For example, Figure 1 shows the average G( x) at each position in the range from -500 to +500, relative to TSSs. It can be seen that a particular pattern emerges. The lowest energy values are present near the TSSs and gradually increase with distance; more so in the downstream direction. Other noticeable patterns also appear near the TSSs. ANNs were able to recognize differences in SIDD energy levels, as with sumG. But, it is likely that their additional ability to recognize patterns such as in Figure 1, that gives them the advantage over the threshold method.
DNA structural features are increasingly being recognized as an important tool for detecting promoters. Promoter prediction based on SIDD information has shown promising results. However, the current prediction method used is based simply on determining if the energy values of particular SIDD regions fall below a threshold. Artificial neural networks were used to predict promoters based on SIDD profile data. Results using this technique showed noticeable improvements over the current threshold method.
Future research will involve combining SIDD-based ANN promoter predictors with other methods. In  it was shown that SIDD was not directly related to primary sequences or unique motifs, and not positively correlated with DNA curvature. Thus, using SIDD with other predictive sequence and structural properties, particularly those not strongly correlated, may be gainful. This was the approach taken in .
In addition, it may be useful to determine whether neural networks trained on one genome predict well on others. Wang and Benham  noted nearly identical thresholds for SIDD summation parameters for E. coli K12 and B. subtilis predictions, when illustrating how SIDD properties could be used for estimating the probability that a DNA fragment contained a promoter. This will become practical as SIDD profiles for other genomes become more readily available.
The whole genome of E. coli K12, which contains 4,639,675 nucleotides, was downloaded from NCBI [GenBank: NC_000913.2]. Experimentally verified transcription start sites for E. coli K12 were obtained from the Regulon database (Release: 6.4, updated on 10th August, 2009) . This database release provided a compilation of 1771 promoter sequences. The dataset was filtered for unique promoters with known TSS locations, resulting in 1648 records. The SIDD profile for E. coli was obtained from Benham  and used for constructing training and testing sets, as described below.
Details of training and testing sets construction
The training/testing dataset was constructed from the E. coli K12 SIDD profile. Positive instances (promoters) were defined as the 250 bp region from -200 to +50, with respect to filtered TSSs and with no bp at position 0. This range covers the areas of lowest SIDD energy levels surrounding promoters regions, as shown in Figure 1. The negative instances were randomly selected 250 bp regions, with restrictions on proximity to TSSs. Negative instances used for the threshold method excluded any located within 250 bases of TSSs. However, instances used for ANNs excluded only those located within 50 bases. Allowing the neural networks to train on non-promoters that were similar to actual promoters slightly improved their ability to distinguish the two. This dataset was composed on 1648 positive instances and 4944 negative instances, which represents a 3:1 ratio of negatives and positives. A randomly selected two-third and one-third split was used for training and testing data, respectively.
Details of artificial neural network promoter prediction
ANNs, included in the Tiberius v5.5.0 data mining software , were used to build predictive models for promoters, based on SIDD energy values. Each network was composed of three layers: input, hidden, and output. The input layer consisted of 250 input nodes. This corresponds to the number of SIDD energy values from the training and testing instances. The hidden layer was composed of two neurons, and the output layer one neuron. The neural networks were trained on the training set, and the generated networks were exported outside of Tiberius for testing.
Details of SIDD-based promoter prediction
Prediction by the threshold method was done by first calculating the sum of the destabilization free energies, sumG, for each of the 250 bp testing set instances. sumG is defined as follows
where G(x) corresponds to the destabilization free energy at position x. Instances with sumG less than or equal to a selected threshold, T, were tagged promoters. Otherwise they were tagged non-promoters.
Precision, recall, and F-score
Precision, recall, and F-score were defined as follows,
where TP, TN, and FP are the numbers of true positives, true negatives, and false positives, respectively.
We wish to thank Dr. Craig Benham for providing the E. coli K12 SIDD profile.
This article has been published as part of BMC Bioinformatics Volume 11 Supplement 6, 2010: Proceedings of the Seventh Annual MCBIOS Conference. Bioinformatics: Systems, Biology, Informatics and Computation. The full contents of the supplement are available online at http://www.biomedcentral.com/1471-2105/11?issue=S6.
- Hertz GZ, Stormo GD: Escherichia coli promoter sequences: analysis and prediction. Methods Enzymol 1996, 273: 30–42. full_textView ArticlePubMedGoogle Scholar
- Huerta AM, Collado-Vides J: Sigma 70 promoters in Escherichia coli: specific transcription in dense regions of overlapping promoter-like signals. J Mol Biol 2003, 333: 261–278. 10.1016/j.jmb.2003.07.017View ArticlePubMedGoogle Scholar
- Kanhere A, Bansal M: Structural properties of promoters: similarities and differences between prokaryotes and eukaryotes. Nucleic Acids Research 2005, 33: 3165–3175. Pacific Symposium on Biocomputing, 6:103–114 Pacific Symposium on Biocomputing, 6:103-114 10.1093/nar/gki627PubMed CentralView ArticlePubMedGoogle Scholar
- Kozobay-Avraham L, Hosid S, Bolshoy A: Involvement of DNA curvature in intergenic regions of prokaryotes. Nucleic Acids Research 2006, 34: 2316–2327. 10.1093/nar/gkl230PubMed CentralView ArticlePubMedGoogle Scholar
- Rangannan V, Bansal M: Relative stability of DNA as a generic criterion for promoter prediction: whole genome annotation of microbial genomes with varying nucleotide base composition. Mol Biosyst 2009, 5: 1758–1769. 10.1039/b906535kView ArticlePubMedGoogle Scholar
- Wang H, Noordewier M, Benham CJ: Stress-induced DNA duplex destabilization (SIDD) in the E. coli genome: SIDD sites are closely associated with promoters. Genome Res 2004, 14: 1575–1584. 10.1101/gr.2080004PubMed CentralView ArticlePubMedGoogle Scholar
- Wang H, Benham CJ: Promoter prediction and annotation of microbial genomes based on DNA sequence and structural responses to superhelical stress. BMC Bioinformatics 2006, 7: 248. 10.1186/1471-2105-7-248PubMed CentralView ArticlePubMedGoogle Scholar
- Weka Data Mining[http://www.cs.waikato.ac.nz/ml/weka/]
- RequlonDB promoters[http://regulondb.ccg.unam.mx/data/PromoterSet.txt]
- Tiberius Data Mining[http://www.tiberius.biz/]
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.