OHMM: a Hidden Markov Model accurately predicting the occupancy of a transcription factor with a self-overlapping binding motif
- Amar Drawid1, 2,
- Nupur Gupta†3, 4,
- Vijayalakshmi H Nagaraj†1,
- Céline Gélinas3, 5 and
- Anirvan M Sengupta1, 6Email author
© Drawid et al; licensee BioMed Central Ltd. 2009
Received: 20 June 2008
Accepted: 07 July 2009
Published: 07 July 2009
DNA sequence binding motifs for several important transcription factors happen to be self-overlapping. Many of the current regulatory site identification methods do not explicitly take into account the overlapping sites. Moreover, most methods use arbitrary thresholds and fail to provide a biophysical interpretation of statistical quantities. In addition, commonly used approaches do not include the location of a site with respect to the transcription start site (TSS) in an integrated probabilistic framework while identifying sites. Ignoring these features can lead to inaccurate predictions as well as incorrect design and interpretation of experimental results.
We have developed a tool based on a Hidden Markov Model (HMM) that identifies binding location of transcription factors with preference for self-overlapping DNA motifs by combining the effects of their alternative binding modes. Interpreting HMM parameters as biophysical quantities, this method uses the occupancy probability of a transcription factor on a DNA sequence as the discriminant function, earning the algorithm the name OHMM: O ccupancy via H idden M arkov M odel. OHMM learns the classification threshold by training emission probabilities using unaligned sequences containing known sites and estimating transition probabilities to reflect site density in all promoters in a genome. While identifying sites, it adjusts parameters to model site density changing with the distance from the transcription start site. Moreover, it provides guidance for designing padding sequences in gel shift experiments. In the context of binding sites to transcription factor NF-κB, we find that the occupancy probability predicted by OHMM correlates well with the binding affinity in gel shift experiments. High evolutionary conservation scores and enrichment in experimentally verified regulated genes suggest that NF-κB binding sites predicted by our method are likely to be functional.
Our method deals specifically with identifying locations with multiple overlapping binding sites by computing the local occupancy of the transcription factor. Moreover, considering OHMM as a biophysical model allows us to learn the classification threshold in a principled manner. Another feature of OHMM is that we allow transition probabilities to change with location relative to the TSS. OHMM could be used to predict physical occupancy, and provides guidance for proper design of gel-shift experiments. Based upon our predictions, new insights into NF-κB function and regulation and possible new biological roles of NF-κB were uncovered.
Identification of short, degenerate DNA sequences (sites) that bind to a transcription factor is a difficult problem . The particular sub-problems of identification of sites corresponding to self-overlapping motifs, determination of a threshold for this purpose, biophysical interpretation of statistical quantities used in probabilistic site identification methods and estimation of occupancy of these sites by a transcription factor have not been addressed in detail before. These problems form the focus of this study.
Several transcription factors bind to self-overlapping DNA motifs. When a motif overlaps with itself with a particular shift, the transcription factor can bind in more than one sequence windows, i.e. to overlapping sites. Examples include Drosophila developmental transcription factor Hunchback , worm PHA-4 , human Sp-1, C/EBPalpha, yeast ADR1, MIG1, chicken Cdx-1, Arabidopsis Agamous, etc. . Furthermore, when binding by the transcription factor in either orientation is permissible, the corresponding DNA site and its reverse complement can be considered as two different types of sites that are overlapping, as long as the motif is not exactly palindromic. Problems similar to the identification of overlapping sites also arise in the context of prediction of nucleosome positioning .
Self-overlapping motif of NF-κB family of factors
Ignoring the self-overlapping nature of the motif can also complicate the interpretation of in vitro experiments. For example, a 3' padding sequence, starting with nucleotide C, in a gel shift experiment can form a spurious strong κB site and thus confer higher binding affinity to the experimental sequence even when the test sequence, in the context of the native promoter, makes for a very weak κB site. A computational method that naturally considers multiple binding windows and help in the design of padding sequences is useful for avoiding this problem.
The commonly used site identification methods often assume equal probability of a site everywhere in a particular window around the transcription start site (TSS) and thus fail to adjust according to the observed distribution of sites within the gene structure. Whereas proximal promoters, up to 200 bp upstream of the TSS, contain several sites, further upstream distal promoters contain fewer sites [9, 10]. While identifying sites, a method should adjust its parameters to reflect this change in the density of sites with respect to the distance from the TSS.
A computational method that links to the biophysical process of transcriptional regulation can offer more biological insight than most of the current site identification methods [11, 12]. Such a method can interpret statistical quantities as biophysical variables like binding energy and transcription factor concentration. It can also estimate how often a transcription factor is bound to the gene promoter, i.e. its occupancy probability. Interestingly, the use of occupancy probability as a discriminant function during site identification has a number of advantages (discussed later). One advantage of this approach is that it goes beyond just site identification and provides a measure of the importance of a site in modulating gene regulation. For example, for an activator, highly occupied sites may result in high gene expression and thus may be biologically more significant. Most methods that identify transcription factor binding sites or regulatory modules, however, leave unexplored the occupancy of the transcription factor on the promoter and its impact on gene regulation.
The lack of biophysical interpretation prevents these methods from using a natural threshold for classifying sequences into sites. They declare that a sequence is a site if its score is above an arbitrary threshold or is statistically significant compared to the score of the random background. They often have a high threshold resulting in several false negatives or a low threshold resulting in several false positives. Thus, identification of weak sites is difficult. On the contrary, saturation effects in the physical occupancy provides a natural threshold and this fact has been utilized to develop class support vector machines like QPMEME [11, 12]. Alternatively, Hidden Markov Models (HMMs), when interpreted as biophysical models, overcome this problem by learning the threshold based on the transition probability to the motif state, namely the hidden state associated with a sequence pattern which is distinct from the background.
HMM for binding site identification
HMMs, now popular in Bioinformatics for more than a decade , have been used in two different ways for motif identification. (1) For identification of one or more occurrences of non-overlapping sites: 'Profile HMMs' [14–16], originally designed to model protein domains, have more recently been used to identify binding sites of transcription factors, for example, of cAMP receptor protein in cyanobacterium Anabaena , liver X receptor  and CREB . A profile HMM library was built using TRANSFAC sequences to classify transcription factors . In a profile HMM, each position within a motif has three states. A match state is associated with a nucleotide being present at that position and has corresponding emission probabilities. A deletion state corresponds to absence of any nucleotide at that position. An insertion state allows for insertion of nucleotides between the current position and the next position within the motif, and has its own emission probabilities. (2) For identification of cis-regulatory modules (CRMs) that contain multiple sites of different types: This is usually performed using 'motif HMMs' [21–26]. In a motif HMM, the entire motif, i.e. all positions within the motif, is represented by one state. Different states correspond to different motif types (i.e. motifs associated with different transcription factors). Phylogenetic conservation has been incorporated in motif HMMs to reduce false positives [23, 27–31].
Both types of HMMs, however, do not generally train their parameters properly. A profile HMM has a complicated architecture and requires a large number of parameters as a consequence. Because the number of known sites is generally small, training of a profile HMM using known sites in their native promoters (which effectively requires their simultaneous alignment) is usually not possible. Therefore, a profile HMM is generally trained using pre-aligned sites. Because the whole promoters containing the training sites are not used, transition probability to the motif z from background is not trained, and the relationship between transition and emission probabilities is likewise not captured. Motif HMMs, on the other hand, are more focused on identifying motifs of multiple types. But while they attempt to estimate the transition probability to the motif z, they generally use only the promoters containing the motifs for training z and thus overestimate z. Moreover, they usually train emission probabilities of motifs separately using pre-aligned training sites, thus ignoring the effect of z on emission probabilities.
Many of these HMMs use the likelihood or the Viterbi algorithm for scoring (see the Discussion section), and thus end up using an arbitrary classification threshold. Furthermore, they leave their relationship with biophysical models rather obscure and thus fail to calculate the occupancy probability. These shortcomings are in addition to their basic failure to explicitly consider the effect of multiple overlapping sites in the Viterbi method.
Methods specifically developed for κB site identification
In an original approach to specifically identify κB sites, Udalova et al. developed a principal coordinate model [32–34]. They determined relative binding affinities of κB sites using experimental quantitative binding data. They selected a subset of the 256 possible variants of the fully palindromic NF-κB binding consensus sequence GGRRNNYYCC such that no variant differed from the selected sequences or their reverse complements by more than one nucleotide. They mapped these sequences to a Euclidean space and used the largest principal components for least-square linear regression of the logarithm of binding affinity in a gel shift assay or microarray. This model automatically incorporated effects of interactions between base pair positions in the binding site, its predictions were highly correlated with experimental binding data and it identified site positions responsible for differential binding of NF-κB family members consistent with crystallographic studies. However, the model's disadvantages are that it (1) requires experimental quantitative binding data of all selected sequences and (2) only includes variants of the consensus sequence. Because several known κB sites do not fit the consensus sequence , inclusion of all possible 10-mer variants for this model will require binding experiments with a large number of sequences, making this model infeasible. Furthermore, this model also suffers from the limitations of site identifications described above.
Alternative interpretation of HMM as a physical binding model
Even though in the context of site identification an HMM is usually interpreted as a sequence generative model, we focus on a less familiar interpretation as a physical binding model of a transcription factor on DNA. This interpretation leads us to transform the statistical HMM model into a biophysical one. We can then determine the occupancy probability of a transcription factor on a DNA sequence, and think of the prior probability of the motif (transition probability to the motif z) as a measure of transcription factor concentration and the weight matrix (motif emission probabilities) as a measure of binding energies. More importantly, the biophysical model offers a principled threshold for classifying sequences into sites. The statistical mechanics model was utilized in  while the equivalent HMM representation is used in . Although we do not know of a paper explicitly describing the equivalence of these two approaches, the work on nucleosome positioning by Segal et al.  utilizes this relationship.
An HMM is commonly used as a generative model of a spatial or time series sequence in the machine learning field . In our context, the HMM consisting of two kinds of states – the background state and motif states – generates a sequence from 5' to 3'. At any position in the sequence, the HMM (1) determines the probabilities of the motif and background states at the previous position, (2) calculates the probability of either state at the current position using the transition probabilities and (3) generates the new nucleotide based upon the hidden states' emission probabilities.
We could also consider the HMM as a physical binding model that estimates the occupancy probability of a transcription factor on a particular position of a DNA sequence, i.e. how often the transcription factor is bound to that position of the DNA sequence. The relation between the two interpretations of an HMM, are as follows. In our particular HMM, the start positions of a motif state, with a particular orientation, specifies the hidden states. One could ask define the conditional probability distribution of the hidden states, or, equivalently these positions, is given the parameters and the observed sequence. It turns out that this conditional distribution is exactly the same as that of the edge positions of bound transcription factors on DNA in the statistical mechanical model. The occupancy probability at a position is the probability of finding a motif state at that position in the HMM language.
If we ignore the possibility of binding in multiple overlapping windows, then, the probability at the j th position of sequence s being the beginning of a motif is , where W j is the weight matrix score of the motif starting at the j th position of the sequence (see Methods). We claim that this quantity can be mapped to the occupancy probability, as we will see below. Thus, the two factors determining occupancy probability are (i) the transition probability to the motif z and (ii) the measure of distinctness of the emission probabilities of the motif from that of the background (weight matrix). Both these factors need to be high for the transcription factor to be bound to a particular position in a DNA sequence with high probability. For example, even if the weight matrix score is high, occupancy probability cannot reach one if z is really small. A site identification method based only on a weight matrix has no way of dealing with this interplay with z.
The HMM training techniques offer two advantages over the calculations made using first principles. First, the HMM Baum-Welch procedure trains the transition and emission probabilities. This produces optimized values of z and the weight matrix, which are essential for an accurate estimation of occupancy probability. Secondly, as mentioned above, the HMM training procedure also calculates an intermediate variable called the gamma (γ) variable. The occupancy probability at a particular position is given simply by the gamma variable of the motif state at that position: , where and are the gamma values of the motif and background states at that position, respectively (see Additional file 1). Thus, the calculation of occupancy probability in a new sequence requires a simple extension of the scoring procedure in which the gamma variable is computed just like during the training procedure.
In a biophysical model, based on thermodynamics principles, occupancy probability can be written as , where [P] is the concentration of a free transcription factor at equilibrium, E j (s) is the binding energy at position j, where K b is the Boltzmann's constant, and T is the absolute temperature . A comparison of this equation with the equation of probability obtained from the HMM gives us W j = - βE j (s) and z = [P]. Thus, the weight matrix represents binding energy . In addition, the transition probability to the motif z corresponds to the free transcription factor concentration. As the transcription factor concentration increases, the transition probability to the motif increases and we expect higher occupancy by the transcription factor on the DNA.
One main focus of this study is to determine a good threshold for the classification of sequences into binding sites. Use of an arbitrary threshold while using a purely statistical quantity as a discriminant function is prone to a high number of false positives or false negatives. A good discriminant function has a physical interpretation, it relates to the biological significance of a sequence and it offers a natural threshold for classification. Moreover, the classification method needs to be able define the above threshold based on training sequences.
We use occupancy probability as a discriminant function to classify sequences into sites because it has the following benefits. First, unlike a purely statistical entity, it has a straightforward physical interpretation. A transcription factor's occupancy on the promoter determines gene expression. Second, highly occupied binding sites may be physiologically more significant. Thus, occupancy probability not only helps in classifying sequences as binding sites but also offers insight into their influence on gene expression. Third, occupancy probability has a "natural" threshold at 0.5 due to its Fermi-Dirac distribution with respect to binding energy . Sequences with binding energy less than the chemical potential have occupancy probability greater than 0.5 and hence can be classified as sites. Because of our focus on occupancy, we call this model OHMM (O ccupancy via H idden M arkov M odel).
The greatest benefit of the transformation of an HMM to a biophysical model is that it enables the HMM to learn the threshold for classification of sequences into sites in a principled way. We have seen above that the occupancy probability depends upon the transition probability to the motif z and the weight matrix, both of which are trained by an HMM. Thus, when an HMM uses occupancy probability as a discriminant function, it learns the natural threshold based on the training sequences. Because of this accurate estimation of the threshold, an HMM is expected to identify weak sites much more accurately with a fewer false positives.
Training OHMM consists of estimating two sets of parameters: (1) the emission probabilities of each motif state (motif profile) and the background, and (2) the transition probabilities that depend upon the transition probability to the motif (z). While an HMM needs to be trained using site-rich sequences to learn the motif profile, training on random sequences is required to learn z reflecting the site density in the promoters of all genes in the human genome. We therefore estimated HMM parameters in two steps. We first trained all HMM parameters using site-rich sequences and thus learned the emission probabilities. We then fixed the emission probabilities and trained the transition probabilities using randomly selected human promoters to estimate z separately for the TSS-800:TSS (upstream 800 bp) and TSS:TSS+100 (downstream 100 bp) regions, where TSS is the transcription start site. The reason for separate z estimation in these two types of regions is that κB site density is different upstream and downstream of the TSS.
Training the emission probabilities
Estimation of the transition probability to the motif
In the second training step, we estimated z by training the transition probabilities of the above surround-50 HMM using random sequences while keeping its emission probabilities constant. We estimated z separately for the upstream 800 bp and downstream 100 bp regions. In each case, we determined human promoters with known κB sites in that region, progressively added randomly selected human promoters to the list and estimated z. As expected, the z estimate decreased with the addition of random sequences until it stabilized after the addition of a few thousand promoters (see Figure 3B). The estimated z's for the upstream 800 bp and downstream 100 bp regions of all genes in the human genome are 0.00017 and 0.00012, respectively.
Effect of the nature and length of training sequences, initial transition probability to the motif (initial z) and training of motif profile on trained z
Varying z with respect to the distance from the TSS while scoring
As mentioned in the background, site density decreases in locations that are increasingly further upstream of the TSS [9, 10]. Also, site density at a location in a sequence is proportional to the transition probability to the motif (z) at that location. Therefore, while predicting sites in upstream 800 bp regions, we modeled z using an exponential functional form such that a sequence close to the TSS had a higher site density than a sequence further upstream. The maximum likelihood estimate of the mean distance of κB sites upstream of the TSS was 170 bases. Interestingly, the estimate of the mean distance using the median was about the same (169 bases). By equating the expressions for the site density per promoter when z had a uniform or exponential function form, the scale factor in the exponential form was z0 = 0.137 for the uniform z = 0.00017 obtained in training (see Methods for details). A different transition probability matrix was generated for each upstream position based on the value of z at that position and was used to calculate occupancy probability. On the other hand, when identifying κB sites in the downstream 100 bp regions, we used location-independent transition probabilities based on the uniform z of 0.00012 obtained in training. This choice was made due to the paucity of evidence of positional dependence of site density in these regions.
OHMM performs better than a WM
Many κB sites predicted by OHMM are evolutionarily conserved and regulated after NF-κB over-expression
Quantitative measure of biological significance
Correlation with gel shift experiments
A common way to measure affinity of a TF for a particular DNA sequence is the gel shift assay, some times also called electrophoretic mobility shift assay or EMSA. In this assay, oligonucleotides (usually radio-labeled) with the particular DNA sequence is mixed with the TF at a certain concentration. At equilibrium, a certain fraction of these oligonulcotides will be bound to the TF. The oligonucleotides are then passed through a polymer gel under electric field. DNA bound to TF moves at a different rate (usually slower) than the unbound ones, producing a shift between the two bands. The relative amount of DNA in each of these two bands could be measured, usually by scanning for radioactivity, allowing us to calculate the occupancy probability.
Effect of z on HMM-predicted occupancy probability
HMM reveals the importance of selection of padding sequences of self-overlapping motifs
The occupancy probabilities calculated using the sites in their native chicken promoters did not correlate as well with the experimental binding affinities as those calculated in the previous section using the sites and their padding sequences in the gel shift construct. When we observed that the difference was due to a C in the padding sequence 3' of the predicted κB sites in the oligonucleotides used for gel shift, we performed a systematic combinatorial analysis using HMM to determine the padding sequences that did not form spurious overlapping binding sites and hence affected native binding the least. We found that the use of the padding sequences in the above experiment (the 5' padding sequence is GATCTGAATTCGT and the 3' padding sequence is CACCTCTCCTTA) may misrepresent NF-κB binding. The predicted occupancy probabilities suggest that a gel shift oligonucleotide containing an A 5' to the 10-mer and a T 3' to the 10-mer in the padding sequence has the least chance of forming spurious binding sites (e.g. AGGGAATTCCC T, where the 10-mer is shown in italics). Any other nucleotide forms a spurious site shifted one position from the 10-mer, and in some cases may even change the binding occupancy by more than 50%. Any of the C, G or T in the 5' end creates a site beginning with CGG..., GGG... or TGG.... An A, C or G in the 3' end creates a site on the opposite strand beginning with TGG..., GGG... or CGG.... In addition, a C at the 3'end also creates a site on the same strand ending with ...CCC.
Identification of NF-κB targets in the human genome
Enriched pathways, functions and diseases
NFKB2*, CD40*, IL1F9, IKBKB, RRAS, TNFAIP3*, BCL3*, TLR7, TRAF5, NFKBIB, NFKB1*, LTA*, PIK3C3, NFKBIA*, RELB*, BTRC, PIK3R2, ZAP70, TRAF3, IL1RN*, PLCG2, MAP3K8
Glucocorticoid Receptor Signaling
VCAM1*, ICAM1*, MED1, SMAD3, IKBKB, RRAS, MAPK12, BCL3*, IL13*, CCL5*, NFKBIB, NFKB1*, IL8*, PIK3C3, NFKBIA*, NR3C1*, STAT1, CXCL3*, CREB1, PIK3R2, JAK3, SELE*, IL1RN*, IL6*
Antigen Presentation Pathway
B2M*, PSMB9*, HLA-A, CD74, HLA-B*, HLA-DQA1, TAPBP*
Acute Phase Response Signaling
SAA1*, IL1F9, RBP1, IKBKB, RRAS, MAPK12, BCL3*, SERPINA3*, NFKBIB, CFB*, NFKBIA*, NR3C1*, PIK3R2, NOLC1, SAA2*, SOCS2, IL1RN*, IL6*
B Cell Receptor Signaling
IKBKB, RRAS, MAPK12, BCL3*, NFKBIB, CALML5, NFATC1, PTPN6, NFKBIA*, PIK3C3, CREB1, MAP3K11, PIK3R2, PLCG2, MAP3K8
Death Receptor Signaling
NFKBIA*, BIRC3, DIABLO, IKBKB, BCL3*, TANK, NFKBIB, TNFSF15*
NFKBIA*, BIRC3, DIABLO, IKBKB, RRAS, BCL3*, MAPK6, TP53*, NFKBIB, RPS6KA1, PLCG2, MAP3K8
Cell Cycle: G1/S Checkpoint Regulation
BTRC, SMAD3, SIN3A, TP53*, HDAC8, E2F6
CCL4*, RRAS, CCR3, MAPK12, CCL5*, PLCG2, CALML5
T Cell Receptor Signaling
NFATC1, PIK3C3, NFKBIA*, IKBKB, RRAS, PIK3R2, ZAP70, CALML5
DLL1, NOTCH2, RBPJ, MAML2
BBC3, PIK3C3, SIRT1, PPP1R13B, MED1, PIK3R2, TP53*
Xenobiotic Metabolism Signaling
IL4I1, SULT1C2, MED1, RRAS, MAPK12, NFKB1*, NFKB2*, GSTP1*, PIK3C3, PPP2CB, ALDH3B2, EIF2AK3, PIK3R2, NFE2L2, IL6*, IL1RN*, GSTA5
PIK3C3, CREB1, RRAS, PIK3R2, RPS6KA1
Protein Ubiquitination Pathway
UBE2H, UBE2D3, B2M*, UBE2M*, BIRC3, BTRC, PSMB9*, HLA-A, HLA-B*
Skeletal and Muscle Development and Function
CD40*, CSF1*, CXCL11*, DLL1, IKBKB, IL6*, IL13*, IL1RN*, MED1, NFATC1, NFKB1*, NFKB2*, NFKBIA*, RBPJ, SMAD3, STAT1, VCAM1*, WNT10B*
Infection of Virus
CCL4*, CCL5*, CLEC4M, DEFA1, ICAM1*, IL13*, IRF8, XPO1
ACACA, AIM2, B2M*, BBC3, BCL2L10, BIRC3, BTRC, C6ORF66, CARD8, CD40*, CREB1, CTGF, CYLD, DBC1, DIABLO, DLL1, DPP4, DUT, EGR2, EIF2AK3, GNB1, GNB2L1*, HINT1, HUWE1, IER3*, IFNB1*, IGFBP6, IL6*, IL8*, IL13*, IL1RN*, IRF1*, IRF8, ITGA5, LCN2*, LTA*, LTB*, MAML2, MAP3K11, MAPK12, MEN1, MIA, MSX1, MYB*, NFKB1*, NFKB2*, NFKBIA*, NFKBIZ, NR3C1*, OAS3, PLCG2, PPP1R13B, PPP5C*, PTPN6, RBM17, REL*, RHOC, RPS6KA1, RUNX1T1, SMPD2, STAT1, THOC1, TNFAIP3*, TNFSF13, TP53*, TRAF3, TWIST1*
ACAN, ACTA1, ADAMTS7, B2M*, BLR1*, CARD8, CCL1*, CCL4*, CCL5*, CCL19*, CD40*, CD69*, CD70, CD74, CD83*, CD86*, CD274*, CFB*, CXCL1*, CXCL2*, CXCL3*, CXCL5*, CXCL6*, CXCL10*, DEFA1, DPP4, GP1BA, HLA-A, HLA-DQA1, HPRT1, ICAM1*, IFNB1*, IL6*, IL8*, IL13*, LTA*, LTB*, MAPK12, NFKB1*, NFKBIA*, NR3C1*, PSMB9*, SAA1*, SAA2*, TNFAIP3*, TNFRSF13B, TNFSF15*, TP53*, TPM2, VIM*, WNT10B*
Experimental Autoimmune Encephalomyelitis
B2M*, CD40*, CD86*, CXCL10*, DPP4, HLA-DQA1, IFNB1*, IKBKB, IL6*, LTA*, LTB*, NR3C1*, REL*, STAT1
Similarly, OHMM pinpointed κB sites for IKBKB (commonly known as IKKBeta or IKK2), which is the key NF-κB activating kinase in the canonical NF-κB signaling pathway (see the discussion below), as well as for Toll-like receptor 7 (TLR7) that serves as a coreceptor for RNA-associated autoantigens and participates in the innate immune response to microbial agents, potentially extending the list of NF-κB-regulated TLRs (TLR2, TLR9). If validated as genuine NF-κB targets, identification of IKKBeta and TLR7 by OHMM may have uncovered novel positive feedback loops for amplification of NF-κB signaling.
Our analysis suggests that NF-κB could play new roles in some of the pathways in which it is already known to participate, as seen in the protein ubiquitination pathway that can either regulate protein activation/function or target proteins for proteolytic degradation via the proteasome. For instance, while it is known that NF-κB activates the expression of deubiquitinating enzymes CYLD and A20 (TNFAIP3) that negatively regulate NF-κB signaling [41–44] as well as expression of the proteasome subunit LMP2 (PSMB9) and proteasome activators PA28-alpha and PA28-beta [45–47], OHMM identified the E2 ubiquitin-conjugating enzymes UBE2H, UBE2D3 and UBE2M that promote protein ubiquitination, as putative NF-κB targets. Incidentally, UBE2M was previously observed in microarray studies to be induced by Epstein-Barr virus that leads to increased NF-κB activity, although it remains to be determined if UBE2M is directly controlled by NF-κB .
Interestingly, our analysis also pinpointed κB sites in BTRC (better known as beta-TrCP). BTRC is the substrate recognition component of a SKP1-CUL1-F- box protein (SCF) E3 ubiquitin ligase complex that mediates ubiquitination and subsequent proteasomal degradation of target proteins including the NF-κB inhibitor proteins IkappaB alpha (NFKBIA), IkappaB beta (NFKBIB) and IkappaB epsilon (NFKBIE), allowing free NF-κB dimers to translocate to the nucleus and activate transcription. BTRC also mediates ubiquitination and subsequent proteasomal processing of the phosphorylated NFKB1/p105 and NFKB2/p100 precursor proteins that respectively participate in the canonical and non-canonical NF-κB signaling pathways [49, 50]. If BTRC is a true target of NF-κB, this would suggest that upregulation of BTRC by NF-κB could set up a positive feedback loop to amplify degradation of IkappaB alpha, thereby providing a novel means for magnifying NF-κB signaling. Overall, these results highlight a potential new role for NF-κB in promoting protein ubiquitination by modulating expression of E2 ubiquitin-conjugating enzymes and E3 ubiquitin ligases, thus expanding on its previously documented role in inducing expression of deubiquitinases, proteasome activators and proteasome subunits.
OHMM also revealed new insights into the cross-talk between NF-κB and other signaling pathways. For example, we identified κB sites in several key mediators in the Notch signaling pathway that is involved in cell-cell communications to regulate a broad spectrum of cell-fate determinations. These include the delta-like 1 ligand for Notch receptors DLL1, the Notch2 receptor, transcriptional regulator RBP that acts as a transcriptional repressor in absence of Notch but is a transcriptional activator when associated with activated Notch, and mastermind-like 2 (MAML2) that serves as a transcriptional coactivator for Notch. Prior studies have suggested multiple cross-talk mechanisms between the Notch and NF-κB signaling pathways, most of them suggesting activation of NF-κB downstream of Notch, as well as protein-protein interactions between components of these two pathways (reviewed in ). Our finding that key mediators of Notch signaling harbor κB sites supports the notion that NF-κB might in turn modulate Notch signaling to influence cell fate determination during development, immunity and cancer. This would be consistent with recent work showing that NF-κB stimulates the expression of Notch targets HES-5 and Deltex-1 to stimulate marginal zone (MZ) B-cell development  and with prior observations from our group that NF-κB can trigger Notch signaling by inducing expression of the Notch ligand Jagged1, although it remains to be determined if its effect on Jagged1 expression is direct .
Other genes uncovered by OHMM could be intimately associated with NF-κB's role in transcriptional regulation, and in particular, with its recently uncovered role in gene-specific transcriptional repression [36, 54, 55]. For example OHMM predicts κB sites for deacetylases HDAC8 and SIRT1, as well as for transcriptional corepressor SIN3A. While NF-κB is known to engage in protein-protein interactions with histone deacetylases and corepressors to modulate gene transcription, OHMM raises the possibility of a new mode of action for NF-κB in this context.
Also highlighted were candidate targets in xenobiotic metabolism, including κB sites in sulfotransferase SULT1C2, aldehyde dehydrogenase 3 family gene ALDH3B2, and transcription factor nuclear factor erythroid derived 2-like 2 (NFE2L2) that regulates the oxidative stress response, in addition to the previously documented NF-κB target glutathione S-transferase (GSTP1; ). This points to a possible role for NF-κB in drug metabolism, multidrug resistance and detoxification of poisonous compounds, with possible impact for treatment of infectious diseases, anti-cancer therapy and/or environmental science.
Finally, OHMM pinpointed possible involvement of NF-κB in new pathways, such as the neurotrophin/Trk signaling cascade, in which its role is emerging. In addition to the recently recognized NF-κB target phosphatidylinositol 3-kinase catalytic subunit PIK3C3 , OHMM identified κB sites for its regulatory subunit PIK3R2, as well as for the ras-related G-protein RRAS, ribosomal protein S6 kinase 1 RPS6KA1 and transcription factor cyclic AMP-responsive element-binding protein 1 (CREB1). In this regard, CREB3 (better known as LZIP-alpha) was recently described to be controlled by NF-κB  as is the critical neurotrophin nerve growth factor NGF that controls neuronal cell fate . These results may warrant further investigation in view of the emerging role of NF-κB in the regulation of neuronal survival and function in the nervous system, its effect on cognition and behavior and its suggested roles in epilepsy, stroke, Alzheimer's, Parkinson's diseases and other neurological disorders (reviewed in [60, 61]).
Verification of some of the predicted NF-κB sites in the human genome
Gel shift experiments were performed on several of the predicted NF-kB sites using two of the NF-κB family members: RelA and c-Rel. Three low occupancy sequences were chosen as negative control and the known NFKB1A site was taken as the positive control. We chose the predicted target sites to be tested from some of the top categories that were extracted by pathway analysis. The sites to be tested were from the promoters of following genes: IKBKB and TLR7, involved in the NF-kB signaling pathway; DIABLO, TANK, BCL2L10 and BNIP3, involved in the death receptor signaling and apoptosis categories; HDAC8, SIRT1 and SIN3A, involved in cell cycle G1/S and transcriptional regulation; and BTRC, UBE2D3 and UBE2M, involved in ubiquitination pathway.
The tested sites, organized according to this classification, are listed below.
High conservation and high occupancy: IFBKB, UBE2D3 and SIN3A
High conservation and low occupancy: TANK-1, TANK-2, BCL2L1 and UBE2M
Medium conservation and high occupancy: SIRT1
Medium conservation and low occupancy: TLR7, HDAC8 and BTRC
Low conservation and high occupancy: BIVIP1 and DIABLO
In general, the high occupancy sites are better binders, the exceptions being SIN3A (weak), HDAC8 (strong) and TLR7 (strong). For HDAC8, the occupancy is only slightly lower than the cut-off threshold. In comparison, most highly conserved low occupancy sites have weak gel shifts, suggesting OHMM occupancy measure is a better predictor of binding affinity than the sequence conservation score.
While the use of an HMM is thus advantageous in identifying sites, we have discovered that an HMM offers tremendous benefits for the special case of identifying self-overlapping motifs. When putative sites overlap, the overall occupancy probability in a position in the DNA sequence depends upon the strength of all sites containing that position. Calculation of the overall occupancy probability over the entire sequence using the gamma variables in the HMM method enables us to compute the occupation probability in presence of overlapping sites. In this regard, our approach has a distinct advantage over the two HMM scoring methods in vogue at the present time, viz. the likelihood method and the Viterbi method. The likelihood of a sequence scored over a long stretch of sequence is greater when more sites are present in that sequence. It is perfect for discovering clusters of sites, as evident from the work on fly regulatory modules. The likelihood score by itself does not indicate the location of sites in a promoter. In contrast, the Viterbi method proclaims the presence of sites at positions where the state path with the highest probability contains the motif state. It, however, fails to consider overlapping sites because only the best site would be present in the optimal state path.
Training OHMM is a non-trivial two-step process. In the first step, we trained both the emission and transition probabilities using short sequences rich in known sites with the aim of accurately estimating the motif profile. In the second step, we kept the emission probabilities constant, and trained the transition probabilities on promoters containing known sites as well as random promoters to accurately estimate the transition probability to the motif z reflecting the site density in the promoters of all genes in the human genome. Unlike most HMMs in the literature, we successfully trained the HMM emission probabilities without requiring pre-alignment of training sites.
One interesting feature is that trained z is inversely related to the strength of the motif profile. In other words, when the motif profile is kept constant and only z is trained, the weaker the motif profile used (i.e. closer to the background), the higher the trained z. This is probably the result of the compensating mechanism between the motif profile and z discussed above. Interestingly, this competition between z and the motif profile also determines the occupancy probability as we saw before.
The goal of the second training step was to estimate the transition probability to the motif z reflecting the site density in the promoters of all genes in the human genome. This z corresponds to the appropriate threshold when identifying sites in all human promoters. Obviously, z trained in the first step was not appropriate due to the high site density in the site-rich training sequences. Instead of training z on all human promoters, which is computationally expensive, we train it on a sufficient number of promoters to get a reasonable estimate of z. Our procedure of beginning with the human promoters containing known sites as the training set and progressively adding promoters of randomly selected human genes to the training set leads to decreasing z, until the training set reached a few thousand promoters and z stabilized (Figure 3B). We expect that, for a particular transcription factor, the speed of convergence of this procedure depends upon overall number of target genes of the factor: larger the number of targets/sites, quicker the convergence.
One shortcoming of most site identification methods is that they assume equal probability of the site in a window of arbitrary length around the TSS. The majority of known κB sites are located just upstream of the TSS in gene promoters and the number of known κB sites decreases further upstream. Specifically, of the 36 known κB sites upstream of the TSS, 16 are located within 100 bp and 28 are located within 200 bp of the TSS. Liu et al. have also made a similar observation in the promoters of NF-κB-regulated immune genes . To counter the claim that such an observation for binding sites may be due experimental bias, we cite Tabach et al. who showed in a wide-scale bioinformatic study that functional binding sites are more likely to be present in the 200 bp region upstream of the TSS than any other upstream region for most human transcription factors and specifically for NF-κB . They defined functional binding sites as those over-represented in functionally related genes (in the same Gene Ontology categories) and conserved in related species. To bolster their conclusion, they showed location dependence of binding sites for the transcription factor Myocardin in a controlled experiment. Xie et al. also arrived at a similar conclusion based on binding site conservation . Even though the exact reasons for the occurrence of such a phenomenon are not known at the present time, a better interaction of the transcription factor with the transcription machinery if it is bound close to the TSS and the low density of nucleosomes near the TSS  heuristically explain why this phenomenon may occur.
While we agree that a great number experiments need to be conducted to definitively prove the location dependence of functional κB sites, we feel that a site identification method must be able to take it into account. Noticing that site density decreases sharply with the upstream disease from the TSS and that transition probability to the motif z is proportional to site density, we modelled z using an exponential functional form such that the probability of identifying a site decreases further upstream but never reaches zero (and the transition probability matrix varies accordingly). Even though this approach may fail to identify sites in distal promoters and enhancers, we believe that it allows site search in large upstream regions without identifying too many false positives.
A κB site exerts influence on the occupancy probabilities at the positions surrounding the site in either direction. Because overlapping binding sites are usually present when the scoring window is moved by one position, occupancy probability stays high at all positions in that window. When the window is moved by more positions, the occupancy probability at the new positions dips slightly below the average due to the high motif probability at the site. The occupancy probability returns to the average background value when the scoring window moves by ten positions.
The relationship between the occupancy probabilities of sites located close to each other is quite instructive. When two sites are in tandem without any space between them, occupancy probabilities of both of them are lower due to the small motif-to-motif transition probability. Occupancy probabilities are not very high even when the sites are one position apart because a window shift by one position from a κB site usually contains an overlapping κB site. The sites need to be at least two positions apart so that they do not exert significant influence on each other's occupancy probabilities. Please note that in any case, the overall occupancy in a region containing two nearby sites is quite high.
A strong correlation exists between the occupancy probabilities predicted by OHMM and the in vitro binding affinity of the NF-κB family members c-Rel and RelA for oligonucleotides in a gel shift experiment (Figure 8). This validates our physical binding model because the HMM-predicted occupancy probabilities appear to correspond to observed binding affinities. In the process of the study, we found how the padding sequence affects the results. The current practice for performing gel shift experiments in the NF-κB community consists of using particular padding sequences around the 10-mer corresponding to a potential κB site (for example see [63–66]). The commonly used padding sequences, however, can form spurious κB sites due to the self-overlapping nature of κB motif, and hence the experiment may not represent binding of the 10-mer in the native promoter. OHMM offers guidance on the selection of correct padding sequences when designing experiments. A gel shift oligonucleotide should have an A 5' to the κB site and a T 3' to the κB site for minimum interference, and that a 3' C should be avoided at all cost. Ideally, oligonucleotides containing a few bases corresponding to those surrounding the κB site in the promoter of the gene should be used to pad the site. This will capture the effects of all the overlapping putative binding sites in the native promoter and will avoid creation of artefacts based on the nucleotides present in the padding sequence.
The NF-κB family of transcription factors consists of some of the most important proteins for an organism's development and survival. In resting cells, inactive NF-κB dimers reside in the cytoplasm, bound to inhibitors in the IκB family . Many different stimuli can activate latent NF-κB/IκB complexes, including pro-inflammatory cytokines that trigger rapid activation of the classical (canonical) NF-κB signaling cascade via the IKK kinase complex . Consequent phosphorylation and degradation of IκB via the proteasome culminates in nuclear translocation of active NF-κB dimers and their binding to κB sites. This commonly results in transcriptional activation, or occasionally in repression, of genes important for the immune and inflammatory response, cell proliferation, adhesion, angiogenesis and inhibition of apoptosis [36, 40, 54, 55, 69–71]. The non-canonical (alternative) NF-κB signaling cascade is activated via the lymphotoxin and BAFF receptors, leading to activation of IKKα, nuclear translocation of p52/RelB complexes and plays a role in lymphoid organogenesis and B-cell function.
Hundreds of NF-κB-regulated genes have been identified (reviewed in ). Among them, binding of activated NF-κB to the IκBα promoter can trigger its resynthesis, giving rise to an autoregulatory loop that terminates the activation process [72–74]. Consequently, under normal conditions, Rel/NF-κB activation is tightly regulated and transient. However sustained activation of Rel/NF-κB can promote cell survival, proliferation and/or cell death depending upon the nature and the extent of the stimulus, and is implicated in many pathological conditions including immune system disorders, chronic inflammation and cancer [39, 75]. Although several NF-κB target genes have been identified, whether other NF-κB-regulated genes are its direct or indirect targets is not known.
In addition to identifying many of these known NF-κB target genes, OHMM pinpointed several novel candidate NF-κB targets that are yet to be shown as controlled by NF-κB. While further studies will be needed to determine which of the candidate genes identified by OHMM are genuine transcriptional targets of NF-κB, these are likely to yield important new insights into the less well-characterized roles of NF-κB in the induction of apoptotic cell death, its recently uncovered role in transcriptional repression, the regulation of protein ubiquitination and its role in other signaling pathways, to name a few. In addition to identifying multiple genes with key roles in haematological and immune cell development and function, OHMM pinpointed κB sites in genes with roles in drug metabolism, skeletal and muscle system development and function, as well as in disease conditions ranging from immune and inflammatory disorders to infectious diseases, cancer, skeletal muscular disorders and neurological diseases (Table 1; see Additional file 5). These findings are consistent with experimental evidence suggesting a role for NF-κB in immunological and inflammatory diseases, cancer and therapy-resistance, in skeletal myogenesis and cachexia, as well as in cognition, behavior and neurological disorders like epilepsy, stroke, Alzheimer's, Parkinson's diseases, and amyotrophic lateral sclerosis (ALS) (reviewed in [76–79]). OHMM is thus a unique tool to shed new light on the multifaceted biological functions of NF-κB and the mechanisms involved, and to identify critical mediators of dysregulated NF-κB activity in human disorders that may ultimately help to develop new approaches for treatment.
Let us finish the discussion by mentioning possible shortcomings of the method. OHMM requires a complicated two-step training procedure, which might only work practically for factors with many targets. We have not considered insertions or deletions inside the motif, making OHMM well suited for the simultaneous training of emission and transition probabilities. In addition, we have considered the transition probability to the motif z in the upstream region to decrease exponentially during the scoring procedure. This density function may not be accurate, especially for enhancers. We will need many more sites to establish a more accurate density function.
Our method is the first attempt to deal specifically with self-overlapping binding motifs, providing guidance in the selection of padding sequences in gel shift experiments. When the HMM is considered as a biophysical model, it interprets the weight matrix as binding energy, the transition probability to the motif as transcription factor concentration and the gamma variable as occupancy probability. Because it uses occupancy probability as the discriminant function, it learns the associated natural threshold in a principled manner during the training procedure. Another unique feature of OHMM is that transition probabilities change with sequence location to reflect site density. Transcription factor's occupancy probability on a site can be accurately estimated using our method, as seen by the high correlation with experimental binding affinities. High evolutionary conservation scores and enrichment in experimentally regulated genes suggest that κB sites predicted by our method might be functional. Our results may provide important new insights into the function and regulation of NF-κB and uncover possible new biological roles for this important transcription factor family.
Calculation of occupancy probability with overlapping sites using an HMM
The probability that a position in a sequence is occupied by a transcription factor or the occupancy probability at that position can be calculated using either first principles or the standard HMM techniques. We first review these two methods for the case of non-overlapping sites . We then apply these methods to the case of overlapping sites, which is a novel feature of this publication, and show how an HMM provides a simpler solution.
For the purpose of demonstration, let us consider a non-overlapping site and assume that binding is allowed only on one orientation. (A more general case is discussed in Additional file 1.) In calculating occupancy probability using first principles, let's denote the motif state, representing the entire site, as m and the background state as b. The emission probability of the motif state corresponds to its weight matrix, whereas the transition probability to the motif state from either state is the prior probability of the motif z. Let p(b) be the probability that a long sequence s does not contain any motifs (i.e. it is all background), and P j (m) be the probability that the sequence has one motif m starting at the j th position. This latter probability can be written as , where the transition probability to the motif state at any particular position in a sequence is small (z ≈ 0), ℓ is the length of the motif, is the probability that the nucleotide α at the (j + i - 1)th position of the sequence is emitted by the i th position of the motif state, and is the probability that the nucleotide α at the (j - 1)th position of the sequence is emitted by the background state. Note that this formulation fits into the general Bayesian probabilistic framework such that the product of the w terms is the likelihood and the product of the z terms is the prior. We can write , where (l - z)ℓ ≈ 1 and is the probability that the nucleotide α at the (j + i - 1)th position of the sequence is emitted by the background state. Also, such that is the weight matrix score of the motif starting at the j th position of the sequence. Then, the occupancy probability at the j th position of the sequence is . Thus, both the motif's weight matrix and prior probability are required to determine occupancy probability.
As described in the Discussion section, the probability of a motif at a particular position in a sequence can be thought of as the occupancy probability of the site at that position. The value of the gamma (γ) variable of a state at a particular position in the sequence is the probability of that state at that position. Therefore, , where and are the γ of the motif and background states at that position, respectively. The gamma variable is an intermediate variable computed during Baum-Welch training. For each state at each position, the gamma variable is the normalized product of the forward and backward variables for that state at that position. When calculating occupancy probability, the gamma variable is also calculated during scoring.
When sites overlap, the occupancy probability at a position needs to combine the effect of binding in all sequence windows containing that position. Moreover, an extra motif type, where emission probabilities are flipped from 5' to 3', takes into account the binding strength of the reverse strand sequence. As described in more detail in Additional file 1, occupancy probability at the j th position based on first principles is given by , where k corresponds to the first position of each sequence window containing position j, m is the motif type (including the one corresponding to the site on the other strand), ℓ m is the length the m th motif type, and z m is the transition probability to the m th motif type.
To determine the occupancy probability in the case of overlapping sites using an HMM, we divide up each motif type into ℓ states each corresponding to one position in the motif. The emission probabilities of each state are the weights corresponding to that position of the weight matrix. Occupancy probability at a position is then simply , which is similar as in the case of non-overlapping sites. We use this simple formula to calculate occupancy probability.
OHMM consists of 21 states: one background state and a state corresponding to each of the ten positions within the κB motif on the two DNA strands. Because the κB motif is not known to contain insertions or deletions, the transition probabilities between the states corresponding to successive positions within the motif on a strand are fixed to one. The nine transition probabilities available for training are the transition probabilities from (i) the motif states corresponding to the last position in the motif on both strands and (ii) the background state to (i) the motif states corresponding to the first position in the motif on both strands and (ii) the background state. The rest of the transition probabilities are fixed to zero. The emission probabilities of the motif states on the two strands are flipped from 5' to 3' so as to represent identical binding irrespective of the motif strand. Because initial probabilities are a special case of the transition probabilities at one edge of the sequences, we do not mention them separately.
HMM training and scoring
The transition probabilities were initiated using the transition probability to the motif z chosen by us. The motif emission probabilities (motif profile) were initiated using the 97 κB sites generated in unbiased experiments and obtained from TRANSFAC 9.3 [4, 81–84]. We will refer to this motif profile as the initial motif profile. The promoters were defined as the regions starting at 800 bp upstream of the TSS (transcription start site) and ending at 100 bp downstream of the TSS. The background state's emission probabilities were assigned from the nucleotide distribution of the promoters corresponding to the reference sequences of all human genes in RefSeq Release 19  associated with human assembly hg18, NCBI Build 36.1 available at the UCSC genome bioinformatics site http://genome.ucsc.edu/[86, 87]. The background probabilities were also used as pseudocounts when generating the motif profile initially and during subsequent training.
The HMM was trained using the Baum-Welch expectation-maximization algorithm  in two steps. In the first step, we used two types of site-rich sequences of different lengths as well as various initial z's to train all HMM parameters and determine the emission probabilities to be used in the second step. The following two types of site-rich sequences were used. (1) The "TSS-n promoters" consist of n nucleotides upstream of the TSS of the 42 human genes known to contain a κB site [4, 89, 90]. (2) The "Surround-n promoters" consist of 34 promoters containing the 36 known κB sites whose exact genomic locations were identified (two promoters each contained two closely located known κB sites) and the surrounding regions. Each surround-n promoter is n nucleotides long. The HMMs trained on these promoters were called "TSS-n HMMs" and "surround-n HMMs," respectively. After each training iteration, the emission probabilities of the motif states of the corresponding motif positions on both strands were averaged to ensure that the learned motif profiles on both strands were exactly flipped 5' to 3'. After training, the sum of the transition probabilities from the background state to the motif states corresponding to the first motif position on both strands was estimated as z (the transition probabilities to the motif states on the two strands are nearly identical).
In the second training step, only the transition probabilities were trained. The various training sets consisted of human promoters containing the known κB sites and a different number of randomly selected human promoters added to them. Training in the upstream 800 bp and downstream 100 bp regions with respect to the TSS was done separately.
To identify binding sites, promoter regions 800 bp upstream of the TSS were scored using the HMM γ variable and location-dependent transition probabilities. For this, transition probability to the motif z was modeled using an exponential functional form such that a region close to the TSS had a higher site density than a region further upstream. The mean of this exponential functional form was estimated as follows. z can be written as at x positions upstream of the TSS, where θ is the mean distance of κB sites upstream of the TSS (in number of nucleotide positions) and z0 is the scale factor. Based on the position of known upstream κB sites, the maximum likelihood estimate of the mean for the exponential form was 170, and the estimate of the mean using the median was quite close at . The maximum likelihood estimate was used in further analysis. To determine the scale factor z0, we noted that the site density per promoter is 800* z if z has a uniform functional form and if z has an exponential functional form. Equating these two expressions for uniform z = 0.00017 obtained from training and θ = 170 results in z0 = 0.137.
Location-dependent transition probabilities based on the above calculations were used to compute occupancy probability (γ variable) and identify sites in the upstream promoter regions. The value of z was calculated at each upstream position. Accordingly, a different transition probability matrix was generated at each upstream position as follows. We assigned the transition probability from (i) the background and (ii) the motif states corresponding to the last motif position on either strand to the background state as 1 - z, and the transition probability from (i) the background and (ii) the motif states corresponding to the last motif position on either strand to the motif states corresponding to the motif first position on either strand as z/2. The forward (α) and backward (β) variables were calculated using the standard HMM recursion relations incorporating the position-specific transition probabilities (for example, the probability of observing the partial sequence O1...O t until position t and being in state j at position t is given by the recursion relation , where the transition probability α ij from state i to state j varies with position t, b j (O t ), is the emission probability of state j that generates the nucleotide at position t and n is the number of states). The probability of state i at position t is the gamma variable . The 100 bp regions downstream of the TSS were scored using the HMM γ variable and location-independent transition probabilities with z of 0.00012 (as obtained from training for these regions).
We compared the performance of OHMM to that of a weight matrix (WM) as follows. WM scoring was performed using the initial motif profile. All overlapping windows on both strands were considered and the highest WM score was recorded. Positive examples consist of the 36 known human κB sites present in upstream 800 bp regions (in their native promoters). Negative examples consist of all 10-mers in the upstream 800 bp regions in 100 randomly selected human genes that have no association with inflammation or cancer. Leave-one-out cross-validation was performed, where each site was scored using an HMM trained on the surround-50 promoters of the other 35 known κB sites. The lists of HMM and WM scores of the negative examples were compressed by taking the maxima of the consecutive scores above a threshold (0.03 for HMM, 4 for WM) to ensure that overlapping binding sites were represented by the score of the strongest site.
Conservation, expression and functional annotation
To calculate the conservation score of a site, its multiple alignment was retrieved from UCSC. Only mammalian sequences with at least five nucleotides present in the alignment were included. Consensus nucleotides were determined at all positions in the alignment where the human sequence did not contain a gap, and the number of sequences containing the consensus nucleotide was counted for each position. The conservation score was calculated as the ratio of the sum of these counts at all positions to the product of the number of sequences in the alignment and the number of nucleotides in the site (generally 11 or 12 for overlapping κB sites, 10 for non-overlapping κB sites), multiplied by 100. The perfect score, when all aligned sequences are identical, is 100. Kernel-smoothing density estimates of the conservation scores of sets of κB sites were calculated using default MATLAB parameters.
We used the chicken microarray experiment described in  to determine if chicken genes regulated by over-expressed NF-κB proteins were enriched with κB sites predicted by OHMM. Human orthologs of the regulated chicken genes were obtained using Ensembl .
For comparison with gel shift binding affinities, occupancy probabilities need to be calculated based on an accurate transition probability to the motif (z), which corresponds to the protein concentration as described in the Discussion section. However, protein concentration in a gel is higher than in the cellular context, and is difficult to determine. We therefore estimated z as follows: (1) calculate the occupancy probabilities of all the sequences in the gel shift experiment using various z's, (2) compute the sum of KL divergences of the occupancy probabilities of all the sequences with their binding affinities in the gel shift experiment, and (3) estimate z as the one corresponding to the minimum sum. The rationale behind this procedure is that the occupancy probabilities resulting from the correct z should be in the same ballpark range as gel shift binding affinities. KL divergence can be used as a measure to determine if they are indeed in the same ballpark range. The estimated z is 0.001 for both RelA and c-Rel.
To determine the cellular pathways, biological functions and diseases in which the predicted NF-κB targets were over-represented, genes containing κB sites with predicted occupancy probability greater than 0.5 were analyzed through the use of Ingenuity Pathways Analysis (Ingenuity® Systems, http://www.ingenuity.com) and DAVID [92–94].
The computational analysis was performed using Perl and MATLAB (version R2006b, The MathWorks, Inc.). The κB motif logos were generated using MATLAB .
Gel shift experiments for chicken sequences
Gel shift assays were performed as described  with protein lysates (15 μg) from human 293T cells transfected with either c-Rel or RelA. Radiolabeled double-stranded oligonucleotide probes contained either a palindromic κB DNA site , or the predicted NF-κB sites from chicken blnk site 1 (GTGGCTTCCC), or blnk site 2 (CGGGATCCCC); pdcd4 (CGGGCGTCCC); itm2b (GGGAGATTCC), pp1e (GGGGATGTCC), bcap (TGGGATCCCC), igλ (GGGGCATCCC), or mip-1β (GGGGTTTCCC) with the 5' padding sequence GATCTGAATTCGT and the 3' padding sequence CACCTCTCCTTA.
Gel shift assays for human sequences
Gel shift assays were performed as in  with the following modifications. Protein lysates used were the same as described for the chicken sites except 4 μg of protein was used. Radiolabeled double-stranded oligonucleotide probes were prepared by annealing a shorter 9 bp oligo, which is complimentary to 3'end of the 21 bp longer oligo and by incorporating α32P dCTP and α32P dATP and cold isotopes during a fill in reaction using Klenow Polymerase. The probes were purified using Amersham Microspin G-25 Columns (Cat# 27-5325-01) according to the manufacturer's protocols. The radio-labeled double stranded oligonucleotide probes, with the native padding sequences on either side (taken from the human genome), consist of the NFKB1A site as the positive control (TGGCTTGGAAATTCCC CGAGC); the predicted NF-kB sites from human IFBKB (GGCGCGGGAAATTCCA CCGAG); UBE2D3 (AGTCTGGGGAATTCCA TTTCC);SIN3A (TGGGCGGGATTTCCC GGGTA); TANK-1 (CTCAGTGGAAGTTCCC ACTTC); TANK-2 (AAGTTGGGGGATTTCTC AGTGG); BCL2L10 (GCAGGTGGGATTCCCA TCAAA);UBE2M (TGAACGGAAATGCCC GAGTC); BNIP1 (GTCAGGGAAAGTCCC AACTC); DIABLO (CACCAGGAAATTCCC TTCAA); SIRT1 (AGACGTGGAAATTCCC AGGGC); TLR7 (TAGTTGGAAACTCCA GGGCT); HDAC8 (GGTCTGGGAAGTCCC ATCCA); BTRC (CCTGGGGGAAGTTCC AGAAC) and 3 negative control sites, site 1 (AACCACAACCTGCAGCTATTA); site 2 (AAAATGTGGTAGATAATGGTG); and site 3 (TAAGTAAACATGATATTAGGA).
The binding reaction was performed exactly as described for chicken sites and the Products were resolved on an 8% gel. The gels were run in 0.25× TBE buffer for 3 hrs at 150 volts. The gels were wrapped in thin plastic sheet protectors and exposed to a Molecular Dynamics Phosphoimager.
AMS's work was supported by a NHGRI grant R01HG03470. NG and CGs' work was supported by NIH grant CA054999. We thank Jeff Delrow for analyzing and providing the chicken microarray data.
- Stormo GD: DNA binding sites: representation and discovery. Bioinformatics 2000, 16(1):16–23.View ArticlePubMedGoogle Scholar
- Gupta M, Liu JS: De novo cis-regulatory module elicitation for eukaryotic genomes. Proc Natl Acad Sci USA 2005, 102(20):7079–7084.PubMed CentralView ArticlePubMedGoogle Scholar
- Vavouri T, Walter K, Gilks WR, Lehner B, Elgar G: Parallel evolution of conserved non-coding elements that target a common set of developmental regulatory genes from worms to humans. Genome Biol 2007, 8(2):R15.PubMed CentralView ArticlePubMedGoogle Scholar
- Matys V, Fricke E, Geffers R, Gossling E, Haubrock M, Hehl R, Hornischer K, Karas D, Kel AE, Kel-Margoulis OV, et al.: TRANSFAC: transcriptional regulation, from patterns to profiles. Nucleic Acids Res 2003, 31(1):374–378.PubMed CentralView ArticlePubMedGoogle Scholar
- Segal E, Fondufe-Mittendorf Y, Chen L, Thastrom A, Field Y, Moore IK, Wang JP, Widom J: A genomic code for nucleosome positioning. Nature 2006, 442(7104):772–778.PubMed CentralView ArticlePubMedGoogle Scholar
- Bonizzi G, Karin M: The two NF-kappaB activation pathways and their role in innate and adaptive immunity. Trends Immunol 2004, 25(6):280–288.View ArticlePubMedGoogle Scholar
- Hayden MS, Ghosh S: Signaling to NF-kappaB. Genes Dev 2004, 18(18):2195–2224.View ArticlePubMedGoogle Scholar
- Baeuerle PA: The inducible transcription activator NF-kappa B: regulation by distinct protein subunits. Biochim Biophys Acta 1991, 1072(1):63–80.PubMedGoogle Scholar
- Tabach Y, Brosh R, Buganim Y, Reiner A, Zuk O, Yitzhaky A, Koudritsky M, Rotter V, Domany E: Wide-scale analysis of human functional transcription factor binding reveals a strong bias towards the transcription start site. PLoS ONE 2007, 2(8):e807.PubMed CentralView ArticlePubMedGoogle Scholar
- Liu R, McEachin RC, States DJ: Computationally identifying novel NF-kappa B-regulated immune genes in the human genome. Genome Res 2003, 13(4):654–661.PubMed CentralView ArticlePubMedGoogle Scholar
- Djordjevic M, Sengupta AM, Shraiman BI: A biophysical approach to transcription factor binding site discovery. Genome Res 2003, 13(11):2381–2390.PubMed CentralView ArticlePubMedGoogle Scholar
- Sengupta AM, Djordjevic M, Shraiman BI: Specificity and robustness in transcription control networks. Proc Natl Acad Sci USA 2002, 99(4):2072–2077.PubMed CentralView ArticlePubMedGoogle Scholar
- Eddy SR: Hidden Markov models. Curr Opin Struct Biol 1996, 6(3):361–365.View ArticlePubMedGoogle Scholar
- Eddy SR: Profile hidden Markov models. Bioinformatics 1998, 14(9):755–763.View ArticlePubMedGoogle Scholar
- Krogh A: An introduction to Hidden Markov Models for biological sequences. In Computational methods in molecular biology. Edited by: Salzberg SL, Searls DB, Kasif S. New York: Elsevier; 1998:45–63.View ArticleGoogle Scholar
- Krogh A, Brown M, Mian IS, Sjolander K, Haussler D: Hidden Markov models in computational biology. Applications to protein modeling. J Mol Biol 1994, 235(5):1501–1531.View ArticlePubMedGoogle Scholar
- Suzuki T, Yoshimura H, Ehira S, Ikeuchi M, Ohmori M: AnCrpA, a cAMP receptor protein, regulates nif-related gene expression in the cyanobacterium Anabaena sp. strain PCC 7120 grown with nitrate. FEBS Lett 2007, 581(1):21–28.View ArticlePubMedGoogle Scholar
- Varga G, Su C: Classification and predictive modeling of liver X receptor response elements. BioDrugs 2007, 21(2):117–124.View ArticlePubMedGoogle Scholar
- Conkright MD, Guzman E, Flechner L, Su AI, Hogenesch JB, Montminy M: Genome-wide analysis of CREB target genes reveals a core promoter requirement for cAMP responsiveness. Mol Cell 2003, 11(4):1101–1108.View ArticlePubMedGoogle Scholar
- Stegmaier P, Kel AE, Wingender E: Systematic DNA-binding domain classification of transcription factors. Genome Inform 2004, 15(2):276–286.PubMedGoogle Scholar
- Frith MC, Hansen U, Weng Z: Detection of cis-element clusters in higher eukaryotic DNA. Bioinformatics 2001, 17(10):878–889.View ArticlePubMedGoogle Scholar
- Rajewsky N, Vergassola M, Gaul U, Siggia ED: Computational detection of genomic cis-regulatory modules applied to body patterning in the early Drosophila embryo. BMC Bioinformatics 2002, 3: 30.PubMed CentralView ArticlePubMedGoogle Scholar
- Sinha S, van Nimwegen E, Siggia ED: A probabilistic method to detect regulatory modules. Bioinformatics 2003, 19(Suppl 1):i292–301.View ArticlePubMedGoogle Scholar
- Frith MC, Spouge JL, Hansen U, Weng Z: Statistical significance of clusters of motifs represented by position specific scoring matrices in nucleotide sequences. Nucleic Acids Res 2002, 30(14):3214–3224.PubMed CentralView ArticlePubMedGoogle Scholar
- Grundy WN, Bailey TL, Elkan CP, Baker ME: Meta-MEME: motif-based hidden Markov models of protein families. Comput Appl Biosci 1997, 13(4):397–406.PubMedGoogle Scholar
- Bailey TL, Noble WS: Searching for statistically significant regulatory modules. Bioinformatics 2003, 19(Suppl 2):ii16–25.View ArticlePubMedGoogle Scholar
- Siepel A, Bejerano G, Pedersen JS, Hinrichs AS, Hou M, Rosenbloom K, Clawson H, Spieth J, Hillier LW, Richards S, et al.: Evolutionarily conserved elements in vertebrate, insect, worm, and yeast genomes. Genome Res 2005, 15(8):1034–1050.PubMed CentralView ArticlePubMedGoogle Scholar
- Emberly E, Rajewsky N, Siggia ED: Conservation of regulatory elements between two species of Drosophila. BMC Bioinformatics 2003, 4: 57.PubMed CentralView ArticlePubMedGoogle Scholar
- Zhou Q, Wong WH: Coupling hidden Markov models for the discovery of Cis-regulatory modules in multiple species. The Annals of Applied Statistics 2007, 1(1):36–65.View ArticleGoogle Scholar
- Siepel A, Haussler D: Combining phylogenetic and hidden Markov models in biosequence analysis. J Comput Biol 2004, 11(2–3):413–428.View ArticlePubMedGoogle Scholar
- Wong WS, Nielsen R: Finding cis-regulatory modules in Drosophila using phylogenetic hidden Markov models. Bioinformatics 2007, 23(16):2031–2037.View ArticlePubMedGoogle Scholar
- Linnell J, Mott R, Field S, Kwiatkowski DP, Ragoussis J, Udalova IA: Quantitative high-throughput analysis of transcription factor binding specificities. Nucleic Acids Res 2004, 32(4):e44.PubMed CentralView ArticlePubMedGoogle Scholar
- Nijnik A, Mott R, Kwiatkowski DP, Udalova IA: Comparing the fine specificity of DNA binding by NF-kappaB p50 and p52 using principal coordinates analysis. Nucleic Acids Res 2003, 31(5):1497–1501.PubMed CentralView ArticlePubMedGoogle Scholar
- Udalova IA, Mott R, Field D, Kwiatkowski D: Quantitative prediction of NF-kappa B DNA-protein interactions. Proc Natl Acad Sci USA 2002, 99(12):8167–8172.PubMed CentralView ArticlePubMedGoogle Scholar
- Rabiner LR: A tutorial on hidden Markov models and selected applications in speech recognition. Proc IEEE 1989, 77(2):257–286.View ArticleGoogle Scholar
- Gupta N, Delrow J, Drawid A, Sengupta AM, Fan G, Gelinas C: Repression of B-cell linker (BLNK) and B-cell adaptor for phosphoinositide 3-kinase (BCAP) is important for lymphocyte transformation by rel proteins. Cancer Res 2008, 68(3):808–814.PubMed CentralView ArticlePubMedGoogle Scholar
- Pahl HL: Activators and target genes of Rel/NF-kappaB transcription factors. Oncogene 1999, 18(49):6853–6866.View ArticlePubMedGoogle Scholar
- Rel/NF-kB Transcription Factors[http://www.nf-kb.org]
- Dutta J, Fan Y, Gupta N, Fan G, Gelinas C: Current insights into the regulation of programmed cell death by NF-kappaB. Oncogene 2006, 25(51):6800–6816.View ArticlePubMedGoogle Scholar
- Kucharczak J, Simmons MJ, Fan Y, Gelinas C: To be, or not to be: NF-kappaB is the answer – role of Rel/NF-kappaB in the regulation of apoptosis. Oncogene 2003, 22(56):8961–8982.View ArticlePubMedGoogle Scholar
- Brummelkamp TR, Nijman SM, Dirac AM, Bernards R: Loss of the cylindromatosis tumour suppressor inhibits apoptosis by activating NF-kappaB. Nature 2003, 424(6950):797–801.View ArticlePubMedGoogle Scholar
- Kovalenko A, Chable-Bessia C, Cantarella G, Israel A, Wallach D, Courtois G: The tumour suppressor CYLD negatively regulates NF-kappaB signalling by deubiquitination. Nature 2003, 424(6950):801–805.View ArticlePubMedGoogle Scholar
- Krikos A, Laherty CD, Dixit VM: Transcriptional activation of the tumor necrosis factor alpha-inducible zinc finger protein, A20, is mediated by kappa B elements. J Biol Chem 1992, 267(25):17971–17976.PubMedGoogle Scholar
- Trompouki E, Hatzivassiliou E, Tsichritzis T, Farmer H, Ashworth A, Mosialos G: CYLD is a deubiquitinating enzyme that negatively regulates NF-kappaB activation by TNFR family members. Nature 2003, 424(6950):793–796.View ArticlePubMedGoogle Scholar
- Marques L, Brucet M, Lloberas J, Celada A: STAT1 regulates lipopolysaccharide- and TNF-alpha-dependent expression of transporter associated with antigen processing 1 and low molecular mass polypeptide 2 genes in macrophages by distinct mechanisms. J Immunol 2004, 173(2):1103–1110.View ArticlePubMedGoogle Scholar
- Ossendorp F, Fu N, Camps M, Granucci F, Gobin SJ, Elsen PJ, Schuurhuis D, Adema GJ, Lipford GB, Chiba T, et al.: Differential expression regulation of the alpha and beta subunits of the PA28 proteasome activator in mature dendritic cells. J Immunol 2005, 174(12):7815–7822.View ArticlePubMedGoogle Scholar
- Wright KL, White LC, Kelly A, Beck S, Trowsdale J, Ting JP: Coordinate regulation of the human TAP1 and LMP2 genes from a shared bidirectional promoter. J Exp Med 1995, 181(4):1459–1471.View ArticlePubMedGoogle Scholar
- Carter KL, Cahir-McFarland E, Kieff E: Epstein-barr virus-induced changes in B-lymphocyte gene expression. J Virol 2002, 76(20):10427–10436.PubMed CentralView ArticlePubMedGoogle Scholar
- Fong A, Sun SC: Genetic evidence for the essential role of beta-transducin repeat-containing protein in the inducible processing of NF-kappa B2/p100. J Biol Chem 2002, 277(25):22111–22114.View ArticlePubMedGoogle Scholar
- Orian A, Gonen H, Bercovich B, Fajerman I, Eytan E, Israel A, Mercurio F, Iwai K, Schwartz AL, Ciechanover A: SCF(beta)(-TrCP) ubiquitin ligase-mediated processing of NF-kappaB p105 requires phosphorylation of its C-terminus by IkappaB kinase. Embo J 2000, 19(11):2580–2591.PubMed CentralView ArticlePubMedGoogle Scholar
- Osipo C, Golde TE, Osborne BA, Miele LA: Off the beaten pathway: the complex cross talk between Notch and NF-kappaB. Lab Invest 2008, 88(1):11–17.View ArticlePubMedGoogle Scholar
- Moran ST, Cariappa A, Liu H, Muir B, Sgroi D, Boboila C, Pillai S: Synergism between NF-kappa B1/p50 and Notch2 during the development of marginal zone B lymphocytes. J Immunol 2007, 179(1):195–200.View ArticlePubMedGoogle Scholar
- Bash J, Zong WX, Banga S, Rivera A, Ballard DW, Ron Y, Gelinas C: Rel/NF-kappaB can trigger the Notch signaling pathway by inducing the expression of Jagged1, a ligand for Notch receptors. Embo J 1999, 18(10):2803–2811.PubMed CentralView ArticlePubMedGoogle Scholar
- Campbell KJ, Rocha S, Perkins ND: Active repression of antiapoptotic gene expression by RelA(p65) NF-kappa B. Mol Cell 2004, 13(6):853–865.View ArticlePubMedGoogle Scholar
- Majid SM, Liss AS, You M, Bose HR: The suppression of SH3BGRL is important for v-Rel-mediated transformation. Oncogene 2006, 25(5):756–768.View ArticlePubMedGoogle Scholar
- Xia C, Hu J, Ketterer B, Taylor JB: The organization of the human GSTP1–1 gene promoter and its response to retinoic acid and cellular redox status. Biochem J 1996, 313(Pt 1):155–161.PubMed CentralView ArticlePubMedGoogle Scholar
- Yang N, Huang J, Greshock J, Liang S, Barchetti A, Hasegawa K, Kim S, Giannakakis A, Li C, O'Brien-Jenkins A, et al.: Transcriptional regulation of PIK3CA oncogene by NF-kappaB in ovarian cancer microenvironment. PLoS ONE 2008, 3(3):e1758.PubMed CentralView ArticlePubMedGoogle Scholar
- Jang SW, Kim YS, Kim YR, Sung HJ, Ko J: Regulation of human LZIP expression by NF-kappaB and its involvement in monocyte cell migration induced by Lkn-1. J Biol Chem 2007, 282(15):11092–11100.View ArticlePubMedGoogle Scholar
- Heese K, Inoue N, Sawada T: NF-kappaB regulates B-cell-derived nerve growth factor expression. Cell Mol Immunol 2006, 3(1):63–66.PubMedGoogle Scholar
- Boersma MC, Meffert MK: Novel roles for the NF-kappaB signaling pathway in regulating neuronal function. Sci Signal 2008, 1(6):pe7.View ArticlePubMedGoogle Scholar
- Mattson MP, Meffert MK: Roles for NF-kappaB in nerve cell survival, plasticity, and disease. Cell Death Differ 2006, 13(5):852–860.View ArticlePubMedGoogle Scholar
- Xie X, Mikkelsen TS, Gnirke A, Lindblad-Toh K, Kellis M, Lander ES: Systematic discovery of regulatory motifs in conserved regions of the human genome, including thousands of CTCF insulator sites. Proc Natl Acad Sci USA 2007, 104(17):7145–7150.PubMed CentralView ArticlePubMedGoogle Scholar
- Ballard DW, Walker WH, Doerre S, Sista P, Molitor JA, Dixon EP, Peffer NJ, Hannink M, Greene WC: The v-rel oncogene encodes a kappa B enhancer binding protein that inhibits NF-kappa B function. Cell 1990, 63(4):803–814.View ArticlePubMedGoogle Scholar
- Ganchi PA, Sun SC, Greene WC, Ballard DW: I kappa B/MAD-3 masks the nuclear localization signal of NF-kappa B p65 and requires the transactivation domain to inhibit NF-kappa B p65 DNA binding. Mol Biol Cell 1992, 3(12):1339–1352.PubMed CentralView ArticlePubMedGoogle Scholar
- Walker WH, Stein B, Ganchi PA, Hoffman JA, Kaufman PA, Ballard DW, Hannink M, Greene WC: The v-rel oncogene: insights into the mechanism of transcriptional activation, repression, and transformation. J Virol 1992, 66(8):5018–5029.PubMed CentralPubMedGoogle Scholar
- Doerre S, Sista P, Sun SC, Ballard DW, Greene WC: The c-rel protooncogene product represses NF-kappa B p65-mediated transcriptional activation of the long terminal repeat of type 1 human immunodeficiency virus. Proc Natl Acad Sci USA 1993, 90(3):1023–1027.PubMed CentralView ArticlePubMedGoogle Scholar
- Karin M: How NF-kappaB is activated: the role of the IkappaB kinase (IKK) complex. Oncogene 1999, 18(49):6867–6874.View ArticlePubMedGoogle Scholar
- Karin M, Ben-Neriah Y: Phosphorylation meets ubiquitination: the control of NF-[kappa]B activity. Annu Rev Immunol 2000, 18: 621–663.View ArticlePubMedGoogle Scholar
- Karin M, Lin A: NF-kappaB at the crossroads of life and death. Nat Immunol 2002, 3(3):221–227.View ArticlePubMedGoogle Scholar
- Rocha S, Martin AM, Meek DW, Perkins ND: p53 represses cyclin D1 transcription through down regulation of Bcl-3 and inducing increased association of the p52 NF-kappaB subunit with histone deacetylase 1. Mol Cell Biol 2003, 23(13):4713–4727.PubMed CentralView ArticlePubMedGoogle Scholar
- Ghosh S, May MJ, Kopp EB: NF-kappa B and Rel proteins: evolutionarily conserved mediators of immune responses. Annu Rev Immunol 1998, 16: 225–260.View ArticlePubMedGoogle Scholar
- Chiao PJ, Miyamoto S, Verma IM: Autoregulation of I kappa B alpha activity. Proc Natl Acad Sci USA 1994, 91(1):28–32.PubMed CentralView ArticlePubMedGoogle Scholar
- Scott ML, Fujita T, Liou HC, Nolan GP, Baltimore D: The p65 subunit of NF-kappa B regulates I kappa B by two distinct mechanisms. Genes Dev 1993, 7(7A):1266–1276.View ArticlePubMedGoogle Scholar
- Sun SC, Ganchi PA, Ballard DW, Greene WC: NF-kappa B controls expression of inhibitor I kappa B alpha: evidence for an inducible autoregulatory pathway. Science 1993, 259(5103):1912–1915.View ArticlePubMedGoogle Scholar
- Fan Y, Dutta J, Gupta N, Fan G, Gelinas C: Regulation of programmed cell death by NF-kappaB and its role in tumorigenesis and therapy. Adv Exp Med Biol 2008, 615: 223–250.View ArticlePubMedGoogle Scholar
- Bakkar N, Wang J, Ladner KJ, Wang H, Dahlman JM, Carathers M, Acharyya S, Rudnicki MA, Hollenbach AD, Guttridge DC: IKK/NF-kappaB regulates skeletal myogenesis via a signaling switch to inhibit differentiation and promote mitochondrial biogenesis. J Cell Biol 2008, 180(4):787–802.PubMed CentralView ArticlePubMedGoogle Scholar
- Basseres DS, Baldwin AS: Nuclear factor-kappaB and inhibitor of kappaB kinase pathways in oncogenic initiation and progression. Oncogene 2006, 25(51):6817–6830.View ArticlePubMedGoogle Scholar
- Hayden MS, West AP, Ghosh S: NF-kappaB and the immune response. Oncogene 2006, 25(51):6758–6780.View ArticlePubMedGoogle Scholar
- Memet S: NF-kappaB functions in the nervous system: from development to disease. Biochem Pharmacol 2006, 72(9):1180–1195.View ArticlePubMedGoogle Scholar
- van Nimwegen E: Finding regulatory elements and regulatory motifs: a general probabilistic framework. BMC Bioinformatics 2007, 8(Suppl 6):S4.PubMed CentralView ArticlePubMedGoogle Scholar
- Kunsch C, Ruben SM, Rosen CA: Selection of optimal kappa B/Rel DNA-binding motifs: interaction of both subunits of NF-kappa B with DNA is required for transcriptional activation. Mol Cell Biol 1992, 12(10):4412–4421.PubMed CentralView ArticlePubMedGoogle Scholar
- Schreck R, Zorbas H, Winnacker EL, Baeuerle PA: The NF-kappa B transcription factor induces DNA bending which is modulated by its 65-kD subunit. Nucleic Acids Res 1990, 18(22):6497–6502.PubMed CentralView ArticlePubMedGoogle Scholar
- Urban MB, Baeuerle PA: The role of the p50 and p65 subunits of NF-kappa B in the recognition of cognate sequences. New Biol 1991, 3(3):279–288.PubMedGoogle Scholar
- Zabel U, Schreck R, Baeuerle PA: DNA binding of purified transcription factor NF-kappa B. Affinity, specificity, Zn2+ dependence, and differential half-site recognition. J Biol Chem 1991, 266(1):252–260.PubMedGoogle Scholar
- Pruitt KD, Tatusova T, Maglott DR: NCBI reference sequences (RefSeq): a curated non-redundant sequence database of genomes, transcripts and proteins. Nucleic Acids Res 2007, (35 Database):D61–65.Google Scholar
- Lander ES, Linton LM, Birren B, Nusbaum C, Zody MC, Baldwin J, Devon K, Dewar K, Doyle M, FitzHugh W, et al.: Initial sequencing and analysis of the human genome. Nature 2001, 409(6822):860–921.View ArticlePubMedGoogle Scholar
- Karolchik D, Hinrichs AS, Furey TS, Roskin KM, Sugnet CW, Haussler D, Kent WJ: The UCSC Table Browser data retrieval tool. Nucleic Acids Res 2004, 32: D493–496.PubMed CentralView ArticlePubMedGoogle Scholar
- Alpaydin E: Introduction to machine learning. Cambridge, Mass.: MIT Press; 2004.Google Scholar
- Hoffmann A, Leung TH, Baltimore D: Genetic analysis of NF-kappaB/Rel transcription factors defines functional specificities. Embo J 2003, 22(20):5530–5539.PubMed CentralView ArticlePubMedGoogle Scholar
- Zhou A, Scoggin S, Gaynor RB, Williams NS: Identification of NF-kappa B-regulated genes induced by TNFalpha utilizing expression profiling and RNA interference. Oncogene 2003, 22(13):2054–2064.View ArticlePubMedGoogle Scholar
- Hubbard TJ, Aken BL, Beal K, Ballester B, Caccamo M, Chen Y, Clarke L, Coates G, Cunningham F, Cutts T, et al.: Ensembl 2007. Nucleic Acids Res 2007, (35 Database):D610–617.Google Scholar
- Sherman BT, Huang da W, Tan Q, Guo Y, Bour S, Liu D, Stephens R, Baseler MW, Lane HC, Lempicki RA: DAVID Knowledgebase: a gene-centered database integrating heterogeneous gene annotation resources to facilitate high-throughput gene functional analysis. BMC Bioinformatics 2007, 8: 426.PubMed CentralView ArticlePubMedGoogle Scholar
- Huang da W, Sherman BT, Tan Q, Kir J, Liu D, Bryant D, Guo Y, Stephens R, Baseler MW, Lane HC, et al.: DAVID Bioinformatics Resources: expanded annotation database and novel algorithms to better extract biology from large gene lists. Nucleic Acids Res 2007, (35 Web Server):W169–175.Google Scholar
- Dennis G Jr, Sherman BT, Hosack DA, Yang J, Gao W, Lane HC, Lempicki RA: DAVID: Database for Annotation, Visualization, and Integrated Discovery. Genome Biol 2003, 4(5):P3.View ArticlePubMedGoogle Scholar
- Schneider TD, Stephens RM: Sequence logos: a new way to display consensus sequences. Nucleic Acids Res 1990, 18(20):6097–6100.PubMed CentralView ArticlePubMedGoogle Scholar
- Fan Y, Rayet B, Gelinas C: Divergent C-terminal transactivation domains of Rel/NF-kappa B proteins are critical determinants of their oncogenic potential in lymphocytes. Oncogene 2004, 23(5):1030–1042.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.