- Methodology article
- Open Access
- Published:

# Efficient pairwise RNA structure prediction using probabilistic alignment constraints in Dynalign

*BMC Bioinformatics*
**volume 8**, Article number: 130 (2007)

## Abstract

### Background

Joint alignment and secondary structure prediction of two RNA sequences can significantly improve the accuracy of the structural predictions. Methods addressing this problem, however, are forced to employ constraints that reduce computation by restricting the alignments and/or structures (i.e. folds) that are permissible. In this paper, a new methodology is presented for the purpose of establishing alignment constraints based on nucleotide alignment and insertion posterior probabilities. Using a hidden Markov model, posterior probabilities of alignment and insertion are computed for all possible pairings of nucleotide positions from the two sequences. These alignment and insertion posterior probabilities are additively combined to obtain probabilities of *co-incidence* for nucleotide position pairs. A suitable alignment constraint is obtained by thresholding the co-incidence probabilities. The constraint is integrated with Dynalign, a free energy minimization algorithm for joint alignment and secondary structure prediction. The resulting method is benchmarked against the previous version of Dynalign and against other programs for pairwise RNA structure prediction.

### Results

The proposed technique eliminates manual parameter selection in Dynalign and provides significant computational time savings in comparison to prior constraints in Dynalign while simultaneously providing a small improvement in the structural prediction accuracy. Savings are also realized in memory. In experiments over a 5S RNA dataset with average sequence length of approximately 120 nucleotides, the method reduces computation by a factor of 2. The method performs favorably in comparison to other programs for pairwise RNA structure prediction: yielding better accuracy, on average, and requiring significantly lesser computational resources.

### Conclusion

Probabilistic analysis can be utilized in order to automate the determination of alignment constraints for pairwise RNA structure prediction methods in a principled fashion. These constraints can reduce the computational and memory requirements of these methods while maintaining or improving their accuracy of structural prediction. This extends the practical reach of these methods to longer length sequences. The revised Dynalign code is freely available for download.

## 1 Background

With the widespread availability of data sets of genome and protein sequences, methods for analyzing the sequences to extract biologically salient information have emerged as powerful techniques in computational bioinformatics [1]. In this arena, comparative sequence analysis has proven extremely powerful, whereby sequence segments across different genomes are examined for similarities. Segments identified as similar represent evolutionarily conserved *homologs* and are deemed to be biologically significant due to their apparent preservation across the genomes. The postulated significance can then be tested with experiments, which can also help establish functional correlates. Because the biological experiments are time-consuming and expensive, the comparative analysis serves to improve efficiency by "pre-filtering" the relatively large genome to determine relatively smaller segments over which the experimental effort may be concentrated. The effectiveness of this pre-filtering step is, of course, determined by its accuracy in correctly identifying meaningful homologs and by the computational efficiency of the algorithmic implementations.

In the identification of homologous segments of genomes, sequence-alignment has been the primary workhorse since it can be directly deployed on readily available sequence data. Commonly used methods assign a score to an alignment of a pair of sequences based on nucleotide matches/mis-matches and gaps in the alignment. The similarity score for a pair of genome segments is then computed as the maximum value of this score over all potential alignments, which serves as an alignment-based measure of homology. Through algorithmic innovations (primarily dynamic programming formulations), computationally-efficient methods have been developed for sequence-alignment that can be effectively deployed over large genomes [1], The computational speed-up, however, does not ameliorate a limitation of these methods in that they rely on pure sequence-alignment whereas biological function is actually determined largely by structure, which is not necessarily in one-to-one correspondence with sequence. Structurally conserved biomolecular elements with differing sequences directly illustrate this problem. The divergence between structural and sequence homology is particularly true of non-coding RNAs (ncRNAs), where it is commonly believed that secondary structure, i.e. the sum of the canonical base pairs, is more conserved than the nucleotide sequence [2]. As a ncRNA sequence evolves, compensating changes occur that allow the sequence to drift without affecting the secondary structure. Compensating base pair changes by which secondary structure is conserved, but sequence is not, are therefore used to identify the conserved structure [3].

Given the strong correlation between structure and function observed in biological systems, it is more meaningful to explore homologies based on structure rather than sequence alone. In general, the determination of structural homology scores, i.e. a structural similarity measure for the most "similar" (or common) 3-D structure corresponding to genomic/proteomic sequence segments is a challenging problem. In the case of ncRNA, however, the problem may be rendered tractable, i.e. polynomial time complexity, by focusing one's attention on secondary structure. Sankoff [4] first proposed a dynamic programming approach to this problem that addresses a large class of secondary structures (excluding pseudoknots). Furthermore, he also illustrated how the approach can be extended to include a composite score that accounts for both sequence and structure similarity while retaining the polynomial complexity.

Though polynomial in complexity, Sankoff's proposed algorithm in its original form is still too computationally demanding for deployment on long sequences, such as 16S or 23S rRNA, in the near future (the computational complexity is *O*(*N*^{6}) for two sequences of length *N*). A simplified version of the algorithm, Dynalign, implemented by Mathews et al. [5, 6] constitutes one of the practical computational realizations. The method uses a heuristic to improve computational efficiency by restricting the number of possibilities examined in each dynamic programming step. However, its computational burden remains significant and no analytic guidance is available on the selection of parameter values for the heuristic simplification.

In this paper, this limitation is addressed by developing a principled mechanism for significantly improving the computational efficiency of Dynalign. The motivation for our technique arose from the "*a posteriori*" probability decoding methods developed for error correction in electrical communication systems in the early 1970s [7]. These have seen a recent re-resurgence of research interest due to the development of turbo codes [8] and re-discovery of low-density parity check codes [9] that now constitute active areas of research and development in electrical communication systems. An adoption of the *a posteriori* probability methodology allows us to determine the confidence in local accuracy of sequence alignment in a computationally efficient fashion using a Hidden Markov Model [1, 10]. These probabilistic estimates of confidence in local alignment accuracy are utilized in order to define constraint windows for limiting the choices in the dynamic programming step in Dynalign. Intuitively, this process can be understood as follows: In regions with strong confidence in the alignment accuracy, the possibilities explored in the dynamic programming steps are severely restricted to options mandated by the corresponding alignment and in regions with low confidence in the alignment a wider range of possibilities are allowed in the dynamic programming steps. The method is superior to the prior heuristic of restricting the number of possibilities to an arbitrary fixed number at each step since the restrictions are based on confidence estimates in the sequence alignment and therefore cuts computation where it is not required (where the sequence similarity alone provides high confidence) and does not restrict it when it is in fact required (when sequence similarity provides little confidence). The resulting method provides a very significant decrease in the time required for Dynalign computations while simultaneously increasing (by a small margin) the accuracy of estimating the common secondary structure between two homologous RNA sequences.

It is worth noting that even though the present effort focuses entirely on Dynalign, the methodology is more general. The computed alignment constraints can be utilized with other packages for joint sequence alignment and structure prediction that permit their use for computational simplification, e.g. as "alignment envelopes" in StemLoc [11, 12].

The rest of the paper is organized as follows. Section 2 provides background on the problem of RNA structure prediction and references to current related work in this area. The proposed methodology for determining alignment constraints based on nucleotide alignment posterior probabilities is summarized in Section 3. Results evaluating the performance of the proposed method and comparisons with other techniques are presented in Section 4. Section 6 summarizes the main findings of the paper. Details of our algorithmic methodology are included in Section 7.

## 2 Overview of RNA Secondary Structure Prediction Methods

RNA structure is hierarchical [13]. The *primary structure* comprises a linear chain of nucleotides joined together by covalent phosphodiester bonds. This is identified by the ordered sequence of nitrogenous bases that determine the four types of individual nucleotides: adenine (A), guanine (G), cytosine (C), and uracil (U). This primary structure is determined by "sequencing" and is the starting point of most computational methods for structure estimation. The nucleotides within a chain interact through the formation of hydrogen bonds between the pairs *A* – *U*, *G* – *C*, and *G* – *U*. The set of these base pairings is referred to as the *secondary structure*. *Tertiary structure* includes structural contacts arising from additional interactions on top of secondary structure. These define the three-dimensional structure of the RNA. Quaternary structure is the interaction with other molecules, such as with proteins or other strands of RNA. Secondary structure contacts are stronger [14–16] and form faster [17] than tertiary structure contacts, therefore secondary structure can be largely determined without knowledge of tertiary structure.

Comparative sequence analysis can be used to accurately determine the secondary structure of functional RNAs for which there are a large number of known homologs [3]. The secondary structure is the common structure to all homologs, as determined by an alignment of the structures. Over 97% of base pairs predicted for ribosomal RNA in this manner were subsequently found in high resolution crystal structures [18].

There has been a long-standing interest in the prediction of secondary structure for a single sequence and free energy minimization methods are currently the most accurate and popular. Using dynamic programming algorithms, the lowest free energy structure is determined according to a set of nearest neighbor parameters that predict conformational stability [19–23]. These parameters were empirically derived to fit stabilities determined by optical melting experiments on small model systems [19, 24, 25]. The accuracy of free energy minimization has been benchmarked as high as 73% for predicting known base pairs for a diverse set of sequences as long as 700 nucleotides with structures determined by comparative analysis [19], For different sequences, including longer sequences, the average accuracy is lower [26, 27]. The use of dynamic programming algorithms to predict low free energy structures has been recently reviewed [28, 29].

A recently introduced alternative to free energy minimization is the determination of the most probable structure using a stochastic context-free grammar (SCFG) [1]. The transition probabilities for the SCFG are trained on sets of sequences with known structure. An SCFG has been reported that is nearly as accurate as structure prediction as free energy minimization [26].

To improve the accuracy of structure prediction, a number of methods have been developed that determine a secondary structure common to two or more sequences. These methods have the advantage of including comparative data, and, in general, they fall into three classes. The first class takes a fixed sequence alignment as input. A second class predicts structures for each sequence and then sorts through the structures to find those common to all sequences. The third class finds the structure common to two or three sequences by simultaneously aligning the sequences and finding the most likely structure. In general, the third class is the most rigorous and accurate, but also the most time-consuming. A number of these methods have been reviewed [29, 30].

Algorithms that find the secondary structure common to the multiple, unaligned sequences are either genetic [31] or dynamic programming algorithms. The dynamic programming approaches trace their lineage to the theoretical paper by Sankoff [4], which provides for a computational complexity of *O*(*N*^{6}) in time and *O*(*N*^{4}) in memory where *N* is the length of the smaller of the two sequences. A number of different implementations of the Sankoff algorithm have been developed to find the secondary structure common to two sequences. Each of these implementations restricts the search space to make the program runtime feasible. The first, FOLDALIGN [32], maximized an empirical score and originally did not allow multibranch loops to improve runtime. FOLDALIGN was later revised to allow multibranch loops and use a subset of the free energy nearest neighbor parameters [33]. The revised FOLDALIGN restricts the alignment space to reduce runtime. Two SCFG-based programs are available, StemLoc package [11, 12] and Consan [34]. To reduce runtime, StemLoc introduced the concept of fold and alignment envelopes that restrict, respectively, the search space for possible base pairs and possible nucleotide alignments. In the structure domain, the set of allowed base pairs for each sequence are those found by the prediction of set of probable structures for each single sequence. For the alignment domain, the allowed nucleotide alignments are those found in the "*N* most probable" sequence alignments for some choice of *N*. In a recent similar advance [34], Consan improves its runtime by using highly probable nucleotide alignments as "pins" at which the exact alignment is constrained. Highly probable nucleotide alignments, exceeding a specified threshold, are forced to occur in the simultaneous prediction of the alignment and common sequence.

Dynalign [5, 6] is an implementation of the Sankoff algorithm that predicts the lowest free energy structure common to two sequences. To make the calculation time tractable, a restriction of the alignment domain was introduced [5]. In the most recent publication [35], for nucleotide *i* from sequence one to align to *k* from sequence two, the following constraint must be met:

where *M* is a user-specified parameter, *N*_{1} is the length of sequence one, and *N*_{2} is the length of sequence two. This restriction on maximum insertion length imposes a heuristic constraint on possible alignments. This implies a constraint on the maximum insertion length, which is reasonable for homologous sequences [5]. Equation (1) corresponds to a restricted search interval in the 2^{nd} sequence for alignment of *i*^{th} nucleotide in the 1^{st} sequence. The restriction reduces the computation burden since *M* can typically be chosen much smaller than the shorter sequence length *N*. The computations are more tractable with *M* parameter heuristic: *O*(*M*^{3}*N*^{3}) in time and *O*(*M*^{2}*N*^{2}) in memory (as compared with *O*(*N*^{6}) and *O*(*N*^{4}) in time and memory, respectively, without the *M* parameter) where *M is* the measure of maximum permissible insertion length and *N* is length of shorter sequence. Dynalign also restricts the set of allowed base pairs for each sequence to those found in low free energy structures by single sequence secondary structure prediction [35].

In this paper, a new method for estimating alignment constraints is proposed and incorporated in Dynalign. Instead of using the most probable sequence alignments the method utilizes the *a posteriori* probabilities for nucleotide alignments in order to establish the alignment constraints. This method makes Dynalign more robust by eliminating the need for the *M* parameter above.

## 3 Alignment Constraints from Posterior Probabilities

The *M* parameter mediates a trade-off between the computation and accuracy. A smaller value of the parameter is desirable in order to reduce the computation time to practically useful values. On the other hand, a small value can be overly-restrictive and thereby reduce the accuracy of the structure and alignment prediction from Dynalign. Thus, an 'educated guess' for the *M* parameter is vital to the accuracy of secondary structure prediction. The value of *M* has hitherto been empirically determined and found to vary over different RNA families. The lack of an analytical methodology for determining the *M* parameter has been a limitation for Dynalign. In addition, a large *M* parameter is typically required for longer sequences since they typically can have longer insertions. This tends to make the computation time for Dynalign with the *M* parameter particularly onerous for longer sequences.

In this paper, a new principled methodology is proposed for the introduction of alignment constraints in Dynalign. Instead of the heuristic *M* parameter, alignment constraints are determined through a probabilistic analysis. For this purpose, the alignment between homologous sequences is modeled by a Hidden Markov Model (HMM). Using the model, the posterior probability *P*(*n*_{1} ↔ *n*_{2} | **x**_{1}, **x**_{2}) is determined, which denotes the probability that nucleotide position *n*_{1} in the first sequence **x**_{1} is *co-incident* with nucleotide position *n*_{2} in the second sequence **x**_{2}, given that the sequences are produced by the model. Two nucleotide positions (one from each of the two sequences) are said to be *co-incident* if they are either aligned, or if one nucleotide position (from one of the sequences) occurs in an insertion in that sequence that begins at a nucleotide position aligned with the second nucleotide position (from the other sequence). Formally, a nucleotide position *i* from the first sequence and nucleotide position *j* from the second sequence are said to form a co-incident pair (*i*, *j*) if: a) nucleotide positions *i* and *j* are aligned, or b) nucleotide position *i* occurs in an insertion in the first sequence and nucleotide position *j* in the second sequence aligns with nucleotide position *i* _ from the first sequence, where *i* _ denotes the largest position index less than *i* in the first sequence that aligns with a nucleotide position from the second sequence, or c) nucleotide position *j* occurs in an insertion in the second sequence and nucleotide position *i* in the first sequence aligns with nucleotide position *j* _ from the second sequence, where *j* _ denotes the largest position index less than *j* in the second sequence that aligns with a nucleotide position from the first sequence. As an example, consider the alignment shown in Figure 1(a). The co-incident nucleotide position pairs for this alignment are: (1,1), (2,2), (3,2), (4,2), (5,3), (6,4). Figure 1(b) illustrates the map of co-incident positions in the alignment of Figure 1(a) in a planar matrix of blocks, where the nucleotide position *n*_{1} for the first sequence indexes the abscissa of the block and the nucleotide position *n*_{2} indexes the ordinate of the block. In this graphical matrix representation, co-incident positions indicated above are depicted in Figure 1(b) as black blocks (for aligned locations) or cross-hatched blocks (for insertions). Figure 1(b) illustrates that for any alignment the set of co-incident positions defines an unbroken path from the lower corner of the matrix to the upper corner of the matrix (see Remark 1 in Appendix Section 8). In the dynamic programming step in Dynalign, at any given point, the sequence alignment component of the iteration searches over positions of the matrix that are adjacent to the current location (see Remark 2 in Appendix Section 8). For an alignment to be allowable, constraints specified in Dynalign (and also in alternate methods for joint structure prediction over multiple-sequences) must allow all the co-incident position pairs corresponding to the alignment.

Now, if *P*(*n*_{1} ↔ *n*_{2} | **x**_{1}, **x**_{2}) is small, correspondingly it is rather improbable that the nucleotide position *n*_{1} in the first sequence **x**_{1} will be co-incident with nucleotide *n*_{2} in the second sequence **x**_{2}. This suggests that alignments (in Dynalign) may be constrained by excluding highly improbable alignments as indicated by extremely low values of the posterior co-incidence probability. Correspondingly, an alignment constraint may be defined by thresholding the posterior co-incidence probability with a suitably low threshold *P*_{thresh}. Formally, an alignment constraint set is defined as

**C** = {(*n*_{1}, *n*_{2}) | P(*n*_{1} ↔ *n*_{2} | **x**_{1}, **x**_{2}) > *P*_{thresh}}

where **C** denotes the alignment constraint set. Elements of **C** represent nucleotide position pairs that may co-incide between the sequences and elements outside of **C** are nucleotide alignment position pairs whose co-incidences are disallowed.

The posterior probabilities of co-incidence between nucleotide positions are efficiently computed using the HMM forward-backward algorithm. The process is schematically illustrated in Figure 2. The posterior probability is computed in terms of forward and backward variables as

where the sum is over the three possible states for nucleotide co-incidence, i.e., *m* = *ALN*, *INS* 1, *INS* 2, the forward variable *α*_{
m
}(*n*_{1}, *n*_{2}) represents the probability that the subsequences {}_{1}{}^{{n}_{1}}\mathbf{x}_{1} and of the first and second sequence, respectively, are produced and the nucleotide positions *n*_{1} and *n*_{2} are in the state *m*, and the backward variable *β*_{
m
}(*n*_{1}, *n*_{2}) represents the probability that subsequences {}_{{n}_{1}+1}{}^{{N}_{1}}\mathbf{x}_{1} and {}_{{n}_{2}+1}{}^{{N}_{2}}\mathbf{x}_{2} are observed given that the {n}_{1}^{th} and {n}_{2}^{th} nucleotide positions are in state *m*. Details of the model and the computation of posterior probabilities are provided in Section 7.

Figure 3 shows a surface plot of the (logarithm of) the posterior probability in (3) as a function of sequence nucleotide indices *n*_{1} and *n*_{2}, for an exemplary case of two homologous RNA sequences. At locations where the "probability surface" is close to unity, there is good confidence that the corresponding nucleotide positions are co-incident and conversely near zero values of the "probability surface" reflect near certainty that the corresponding nucleotide positions are not co-incident as per the model. The process of determining the alignment constraint set in (2), may be thought of as slicing the "probability surface" Figure 3 at a sufficiently low level close to the (*n*_{1}, *n*_{2}) plane.

The choice of the threshold *P*_{thresh} in Eqn (2) represents a trade-off between computation and the accuracy of the alignment constraint (in a manner analogous to the *M*-parameter). A smaller *P*_{thresh} offers higher confidence that all actual alignments will lie within the corresponding constraint sets but also requires more computation due to the increased choices and region of computation in the Dynalign phase. A high value of this threshold, on the other hand, results in more a stringent alignment constraint set and thereby reduced computation requirements. However, there is a higher probability that actual alignments will not lie within the constraint set, whereby the prediction accuracy for Dynalign is (likely to be) reduced (see Remark 3 in Appendix Section 8).

Suitable HMM parameter and threshold values are required in order to determine effective constraint sets. In order to have parameters that accurately capture statistical characteristics, sequence pairs are grouped into bins based on the percentage of nucleotides that are identical in the optimal (maximum-likelihood) alignment and the parameter and threshold values are established for each bin. This ensures that the diverse range of statistical variation observed in sequence pairs is divided up into clusters where the parameters for each cluster better represent the statistics of sequence pairs in the cluster than would be feasible with a single global model. This process is analogous to binning employed in previously published work [11, 36], Details of the binning and parameter estimation can be found in Section 7.

A sample alignment constraint set obtained for two tRNA sequences, X57045 and X57046, is shown in Figure 4, where the constraint set is also compared against the actual (hand curated) alignment from RFAM database [37] and the constraints implied by Eqn. (1) for a value of *M* = 7. In Figure 4(b), the true alignment in black clearly indicates an insertion run in the second sequence. It is also clear that the probabilistic alignment constraint set includes the true alignment (as desired). A comparison of Figs. 4(a) and 4(c) is also instructive: while the *M* parameter constraint allows a uniform band of nucleotide alignments about the "diagonal" line, the probabilistic alignment constraints are adaptive to the confidence in the alignment and provide tighter constraint in regions where this confidence is high and a looser constraint where this confidence is low (in the vicinity of the insertion run). Finally, Figure 4(d), illustrates the difference between the probabilistic and the *M*-parameter constraint sets. The significantly larger light gray area in comparison to the dark gray area in this figure illustrate the computational savings of this method in comparison to the *M*-parameter constraint.

## 4 Results

Three sets of experiments are performed: 1) Experiments for verifying accuracy of probabilistic alignment constraints, 2) Experiments for determining structural prediction accuracy, and 3) Experiments for comparing the computation and memory requirements. The latter two sets of experiments also compare performance of Dynalign with the new constraint proposed here against the previous version of the Dynalign (with the *M* parameter constraint) and against other secondary structure prediction methods. The parameters for the algorithms and software version numbers used are summarized in Section 7.6.

### 4.1 Accuracy of Probabilistic Alignment Constraints

The experiments for accuracy of probabilistic alignment constraints are performed over 5S RNA and tRNA alignments in the RFAM database [37]. The accuracy is determined by how probabilistic alignment constraint performs with respect to actual annotated alignment in RFAM database. Sensitivity and specificity of alignment constraint will be used to report accuracy of probabilistic alignment constraint and compare it with the *M* parameter alignment constraint. Sensitivity for alignment constraint accuracy is defined as:

where *N*_{
tp
}is number of true positive predictions corresponding to number of alignment positions which are in actual (annotated as in RFAM database) alignment and within the alignment constraint set. *N*_{
fn
}is number of false negative predictions corresponding to number of alignment positions which are outside alignment constraint set but are in the annotated alignment. Sensitivity is therefore the fraction of known alignment positions that are allowed in the alignment constraint set.

Specificity for alignment constraint accuracy is similarly defined as:

where *N*_{
tn
}is number of true negative predictions (i.e. not in RFAM annotation) corresponding to alignment positions which are outside the probabilistic alignment constraints. *N*_{
fp
}is number of false positive predictions corresponding to alignment positions which are alignment constraint but are not annotated as aligned in RFAM. Specificity, therefore, is the fraction of alignments known to not occur that are not allowed in the alignment constraint set.

Since the alignment constraint serves as a "pre-filter" in Dynalign, a high sensitivity is desirable even at the cost of some degradation in specificity (see Remark 4 in Appendix Section 8). In order to better distinguish between high specificity values, the fraction of nucleotide alignment positions missed are computed and tabulated in Table 1 far the proposed probabilistic alignment constraints and the *M* parameter constraints, used with *M* = 7 [35]. The values in Table 1 indicate that the proposed method for determining alignment constraints offers very high sensitivity and performs significantly better than the *M* constraint that was previously employed. At the same time, the proposed method also has better average specificity than the *M* parameter. Note also that the hand curated alignments in the RFAM database include some nucleotide position alignments that are obtained using considerations that are exogenous to sequence nucleotide similarity, e.g. by structural alignments. This, in part, limits the sensitivity that may be obtained using most methods based on sequence nucleotide similarity alone (including ours).

Table 2 summarizes the average values of sensitivity and specificity over tRNA and 5S RNA alignments in RFAM database for the proposed probabilistic alignment constraint, the previously employed *M* constraint, and for single sequence prediction [19]. Once again, the average values indicate the superior performance of the proposed method over the previous *M* constraint. The maximum and minimum values indicate the limits of the performance of these two methods. Note that the probabilistic alignment constraint exhibits greater variability in the minimum and maximum specificity as can be expected due to the adaptive nature of the constraint.

### 4.2 Accuracy of Structural Prediction

An evaluation of the structural prediction accuracy obtained with the proposed constraints is important in order to establish that the constraints are not overly stringent. For this purpose, an archive containing 309 5S RNAs [38] and 484 tRNAs [39] with known secondary structures is utilized. Three methods for secondary structure prediction are compared over 2000 randomly selected 5S RNA and 2000 randomly selected tRNA sequence pairs from this archive: a) Dynalign with probabilistic alignment constraints, b) Dynalign with *M* constraint with *M* = 7 and c) single sequence structure prediction [19].

Structural prediction accuracy for each of the methods is quantified in terms of sensitivity and positive predictive value (PPV). Sensitivity is defined as the fraction of canonical pairings in the known (or true) structure that are correctly predicted and PPV is defined as the fraction of predicted base pairings that are in agreement with the known structure. In both cases, a single nucleotide shift on any one side is allowed. Detailed definitions of the sensitivity and PPV can be found in the methods part in Section 7.5.

The average values of PPV and sensitivity for the three methods are listed in Tables 3 and 4 for the tRNAs and 5S RNAs, respectively. The tables for the tRNA dataset include two columns indicated by + and - that correspond, respectively, to versions of the algorithms that do or do not utilize available knowledge of modified nucleotides that cannot accommodate the canonical A-form helix. For the results in the + columns, these nucleotides are forced single-stranded to improve structure prediction [24] whereas the information is not utilized for the results in the – column. From the tabulated numbers it is clear that Dynalign with the proposed probabilistic alignment constraint is improved compared to the previously used *M* constraints. Both Dynalign methods outperform single structure prediction.

### 4.3 Computation and Memory Requirements

In order to compare the computational and memory requirements for Dynalign with the proposed probabilistic alignment constraints against the prior *M*-parameter heuristic, these requirements were estimated by sampling 100 tRNA and 5S RNA sequence pairs each at random from the RFAM database and recording the CPU time and memory usage. An Opteron 270 (dual core, 2 GHz) machine with 4 GB of RAM using Fedora Core running Linux Core 4 and gcc compiler were utilized for these experiments. For the *M* parameter constraint a value of *M* = 7 was used throughout as established in the most recent publication on Dynalign [35].

Minimum, maximum, and average CPU times per Dynalign execution (for a sequence pair) are reported in Table 5. The CPU time in these tables is as reported by *Linux* and it refers to time in seconds that the (Dynalign) process occupies the CPU excluding dispatches and input/output wait times. The major benefit of the proposed methodology is immediately apparent from the numerical figures in this table. On average, the incorporation of the probabilistic constraints reduces the CPU time by a factor of approximately 2 for the 5S RNA experiments, where the average sequence length was 119.59 nucleotides. For the tRNA experiments, where the average sequence length was much shorter (77.44 nucleotides), the method requires almost the same computation time as the previous version of Dynalign (with the *M* parameter). In fact, the computational time requirement for this case favors the *M*-parameter Dynalign by a small amount. This is the result of computational optimizations that have been incorporated in Dynalign due to which the computation is now significantly faster than prior versions. As a result of this speed-up, for smaller sequences, the overhead of computing the alignment envelope for the new method and of performing the resulting dynamic memory allocations is no longer negligible in comparison to the overall run time, whereas in the *M* constraint, these are pre-determined.

The significance of these timing gains is even greater when taken in conjunction with the results in the preceding sections that indicate that the improvement is not at the cost of prediction accuracy. Furthermore, it is worth noting that the speed-up factor is larger for the longer 5S RNA sequences. Since these require significantly more time than the shorter tRNA sequences the overall impact of the speed-up is very significant and in fact increases the length of sequences on which Dynalign can be deployed.

The memory requirements for the two methods are compared in Table 5, where the minimum, maximum, and average memory (in megabytes) required for the 100 sequence pairs each of tRNAs and 5S RNAs are indicated. Memory requirements are as reported in the *size* entry of *Linux ps* command after all requisite dynamic allocations are done. This number corresponds to approximate value of virtual memory usage of the (Dynalign) process. The tabulated numbers indicate that the proposed method also offers a memory advantage. As might be anticipated, the advantage is relatively minor for short sequence lengths (e.g. tRNAs) but quite significant for longer sequences (e.g. 5S RNAs). The savings for longer sequences are particularly attractive since often memory is a limitation that restricts the length of sequences for which Dynalign may be utilized.

### 4.4 Benchmarking Against Other Structure Prediction Methods

For benchmarking purposes, the implementation of the new principled alignment constraint (using the threshold of posterior co-incidence probabilities) and the previous Dynalign banding constraint (*M* constraint) [35] were also compared against three other dynamic programming algorithms. The three other programs are FOLDALIGN [33], which uses a free energy-based scoring function, and StemLoc [11] and Consan [34], which use SCFG models. Each program was run using default parameters. Our interest is both in the accuracy of the methods and in their use of resources, CPU time and memory.

Tables 6 and 7 show the accuracy of structure prediction for the methods with tRNA [39] and 5S rRNA [38], respectively. In each case, 2000 pairs of sequences were randomly chosen from a database of sequences with known structure. These tables also show the comparison of the programs that find the structure common to two sequences to the accuracy of single sequence secondary structure prediction. Sensitivity and positive predictive value (PPV) are both scored [22], where sensitivity is the fraction of known pairs correctly predicted and positive predictive value is the fraction of predicted pairs in the known structure. Results are stratified by percent similarity of the two sequences and the final column summarizes the results over all values of sequence pair similarities.

For determining computation and memory resource requirements, calculations were performed using one core on a dual Opteron 270 (dual core, 2 GHz) machine with 4 GB of RAM under Fedora Core Linux with the gcc compiler.

Table 8 compares the computation times for the different methods benchmarked in this study and the memory requirements for these methods are listed in Table 9. Dynalign performs favorably as compared to the other programs. Each method has similar average accuracy on the tRNA database. The free energy minimization approaches, Dynalign, FOLDALIGN and single sequence prediction, provide lower accuracy than the SCFG-based methods at high sequence identity and higher accuracy at low sequence identity. For 5S rRNA, however, Dynalign has higher average accuracy than all the other methods tested. In particular, Dynalign does well on cases with both high and low pairwise identity. In general, the SCFG-based methods show lower average accuracy as pairwise identity decreases. Each structure prediction method that finds the structure common to two sequences is significantly more accurate than single sequence secondary structure prediction. Dynalign is faster and uses less memory than the other programs.

## 5 Discussion

In this paper, a novel technique is presented for reducing the alignment search space for finding the common secondary structure and alignment for two RNA sequences. The allowed nucleotide alignments are those determined to be reasonable (posterior nucleotide co-incidence probability greater than a chosen threshold) as determined by a forward-backward calculation using a Hidden Markov Model (HMM). This new method provides a significant improvement in rigor and speed as compared to previous versions of Dynalign, in which the user was required to empirically choose a parameter that set a band of allowed alignments [5, 35]. The HMM is significantly more flexible in the application of constraints because the allowed region is narrow where the alignment is well-defined by sequence conservation alone, but also wide when the alignment is poorly defined.

Other pairwise implementations of the Sankoff algorithm have also explored alignment constraints to speed execution time. For StemLoc, Holmes introduced the alignment "envelope," which is the set of allowed nucleotide alignments as determined by the union of "N-best alignments," i.e. only nucleotide position alignments occurring in the *N* most likelihood sequence alignments [11, 12]. This has the disadvantage that regions of the nucleotide alignment can be poorly resolved and therefore not well sampled with *N* alignments. For Consan, Dowell and Eddy use a forward-backward HMM to determine nucleotide alignments of high probability, called "pins" [34]. In Consan, these high probability nucleotide alignments are forced to occur. This approach has the drawback that there are no constraints between pins and, for sequence pairs with low identity, it is possible that no pins will be found.

The present manuscript describes the combination of the proposed method for determining alignment constraints with Dynalign. The technique, however, is general and would apply to other implementations of the Sankoff algorithm, including Consan [34], FOLDALIGN [33], PMcomp [40], and StemLoc [11]. Two pairwise calculations of alignment constraints could also be used to accelerate X-Dynalign, a program that finds the common structure and alignment for three homologous sequences [41]. Aside from the improved speed of Dynalign for determining secondary structure, this new method will have a significant impact in the discovery of non-coding RNA (ncRNA) sequences in genome scans. Two papers have reported the use of algorithms that can find the secondary structure common to two unaligned sequences as generic RNA gene finders [35, 42]. These programs have high sensitivity for ncRNAs, especially for regions of genome alignment that have low pairwise identity. The principal drawback is that they are slow compared to programs that find ncRNAs by scanning fixed, predetermined alignments [43, 44]. The method used here to accelerate Dynalign mitigates some of the computational cost and will allow faster scanning of genomes for novel ncRNAs. The success of the methodology also suggests that iterative methods based on *a posteriori* probability estimates that have been extremely successful in communication systems [8, 9] may offer parallels in biological problems involving sequence and structure similarity [45].

Since the method adaptively computes alignment constraints for each pair of input sequences, its complexity varies depending on the input sequence pair. In practice, the computational complexity will depend on the extent of sequence conservation between the two homologous sequences. In the worst case, it can require as much computation as the full unrestricted Sankoff algorithm, viz. *O*(*N*^{6}) in computation and *O*(*N*^{4}) in memory. In the best case, where the alignment constraint actually corresponds to a single alignment, i.e. a band of width *M* = 1, the complexity reduces to *O*(*N*^{3}) in computation and *O*(*N*^{2}) in memory. From the computational perspective, the best case scenario is encountered for the case of identical sequences with sufficient nucleotide diversity (within a sequence). In this case, however, comparative analysis offers little benefit for the overall problem of joint structure prediction. The worst case scenario is rare for homologous sequences.

Finally, note that the alignment constraint constitutes only one element (out of at least three) that determine the structural prediction accuracy. The accuracy depends also on the thermodynamic scoring model and on the "fold constraints" utilized in the computation. In particular, experimental results for some of the situations in which the proposed method fails demonstrate that the thermodynamic model actually predicts a lower free energy for the structure determined by Dynalign (with the new constraint) than for the true structure.

## 6 Conclusion

A new procedure is proposed for establishing alignment constraints in joint alignment and secondary structure prediction problems for RNA sequences. The proposed technique when integrated in Dynalign eliminates the need for manual parameter selection and provides significant computational savings (a factor of 2 over a 5S RNA database with average sequence length of approximately 120 nucleotides) while simultaneously providing a small improvement in the structural prediction accuracy. The revised version of Dynalign can be downloaded, either as source code or as part of the RNAstructure package for Microsoft Windows [46].

## 7 Methods

A Hidden Markov Model (HMM) formulation is utilized in order to estimate a *posteriori* symbol-to-symbol alignment probabilities. HMMs have been previously used in sequence analysis [1], in speech recognition [47], and in error correction coding [7].

### 7.0.1 Notation

Individual output sequences are denoted by lowercase boldface letters specifically **x**_{1} and **x**_{2} for the case of two sequences. Specific nucleotides or subsequences selected from a sequence are indicated by prescripts: {}_{{n}_{1}}x denotes the *n*_{1}^{th} nucleotide of the 1^{st} sequence and {}_{{n}_{1}}{}^{{n}_{2}}x denotes the subsequence of nucleotides from index *n*_{1} to *n*_{2} in sequence **x**. An alignment between the two sequences is specified by a sequence of states from the set

*M* = {ALN, INS1, INS2}

These states define an alignment by relating nucleotide positions between the two sequences as illustrated by means of an example in Figure 5. The ALN state represents *aligned* nucleotide positions, where each of the two sequences has a nucleotide (identical nucleotides in these positions are evidence of evolutionary conservation and differences represent mutations). An INS1 state represents an insertion of the first sequence, where there is a nucleotide in the first sequence **x**_{1} but no corresponding nucleotide in the second sequence **x**_{2}. In Figure 5 this is denoted by pairing the nucleotide in sequence **x**_{1} with the null or *gap* symbol. Similarly, the INS2 state represents the complementary situation of an insertion in the second sequence. The letter *m* (possibly subscripted) will denote a specific state, i.e., an element of the set *M*.

A nucleotide position *n*_{1} from the first sequence is said to be *co-incident* with a nucleotide position *n*_{2} from the second sequence if either of the following three conditions hold:

1. *n*_{1} and *n*_{2} are aligned.

2. *n*_{1} occurs in an "insertion run" in the first sequence that began at a nucleotide position aligned with position *n*_{2} in the second sequence. Formally, this may be described as follows: the nucleotide at position *n*_{1} is an insertion in the first sequence and nucleotide position {{n}^{\prime}}_{1} from sequence 1 is aligned with nucleotide position *n*_{2} from sequence 2, where {{n}^{\prime}}_{1} denotes the largest nucleotide position index in sequence 1 under *n*_{1} that is aligned (with a nucleotide position from sequence 2).

3. *n*_{2} occurs in an "insertion run" in the second sequence that began at a nucleotide position aligned with position *n*_{1} in the first sequence, i.e., the nucleotide at position *n*_{2} is an insertion in the first sequence and nucleotide position {{n}^{\prime}}_{2} from sequence 2 is aligned with nucleotide position *n*_{1} from sequence 1, where {{n}^{\prime}}_{2} denotes the largest nucleotide position index in sequence 2 under *n*_{2} that is aligned (with a nucleotide position from sequence 1).

#### 7.1 Hidden Markov Model for Homologous Sequences

The HMM models the relation between two homologous nucleotide sequences, **x**_{1} and **x**_{2} by a two-stage probabilistic model. The first stage comprises the sequence of states that represents the alignment and the second stage models the nucleotides in the sequences. Specifically, the sequence of states in the first stage of the model are assumed to constitute a time-invariant (see Remark 5 in Appendix Section 8).

Markov process. This three-state Markov process can be represented in terms of the state transition diagram illustrated in Figure 6 and is characterized by the state transition probabilities {\{\tau ({m}_{1},{m}_{2})\}}_{{m}_{1},{m}_{2}\in M} where *τ*(*m*_{1}, *m*_{2}) ≡ *P*(*m*_{2} *| m*_{1})represents the probability that the next state is *m*_{2} given that the current state is *m*_{1}. In each stage, the HMM emits an ordered symbol pair from the alphabet set {A, C, G, U, ⊓}. The chronological progression of the first elements of the emitted ordered pair constitute the first sequence and the second elements make up the second sequence. As indicated before, the ⊓ represents a null symbol or a gap where no nucleotide is emitted in the sequence. The emission probabilities for all possible ordered pairs, for each of the states, characterize the second stage of the model. The probability that the symbol pair (*u*, *v*) is emitted in state *m* is denoted by *γ*_{
m
}(*u*, *v*). Each state of the alignment Markov process allows emission of only a subset of the total set of ordered symbol pairs. Ordered symbol pairs emitted in the aligned states can only be nucleotide pairs (no gaps), those emitted in the INS1 state can only be of the type (*X*, ⊓) where *X* is a nucleotide, and those emitted in the INS2 state can only be of the type (⊓, *X*) where *X* is a nucleotide. A gap pair (⊓, ⊓) is a disallowed output in any state. Disallowed outputs are readily handled in the model by requiring that the corresponding emission probabilities are zero. Observe that the ALN state can output ordered pairs which are mismatched (i.e. pairs of differing nucleotides). As a final remark on the model, note that the alignment states are in fact hidden and unobservable since only the sequences are observed.

The HMM parameters consist of the state transition probabilities for the first stage Markov process and the emission probabilities for the second stage. The model is useful because with appropriately chosen parameters it captures observed statistics of homologous sequences. For instance, in homologous sequences, aligned base pairs are more likely to have matching rather than differing nucleotides. Higher probabilities for emission of these matching nucleotide pairs in the ALN state allow for this statistical behavior to be modeled. Similarly, gaps in homologous sequences tend to occur in long runs rather than as single nucleotide insertions; a characteristic that the HMM can represent through a high probability of self transitions for the states in Figure 6. Thus the HMM provides a suitable model for homologous sequences.

The HMM formulation is advantageous because it can provide answers to several meaningful questions in a computationally tractable and efficient manner. For instance, given any two sequences one can determine the most probable alignment between them (as per the model) and the corresponding probability that sequences are related by the model. If this probability is high (and the model is good), one may infer that the sequences are likely to be homologs. This method is in fact utilized for sequence alignment and computing probabilistic similarity scores. However, as indicated in Section 1 for ncRNA sequence similarity alone is a poor metric for homology, particularly in regions with poor sequence similarity (since these may still have high structural similarity). Therefore, instead of determining the best alignment and the corresponding probability, the proposed method computes the posterior probability of each nucleotide position in one sequence being aligned with each nucleotide position in the other sequence. Subsequently, we can use these posterior probability estimates in order to restrict the search space for Dynalign and improve its computational efficiency. Specifically, as described in Section 3, an alignment constraint is computed by thresholding posterior alignment probabilities of nucleotide positions of two sequences. The estimation of these posterior alignment probabilities using the HMM is described next.

#### 7.2 Posterior Probabilities for Pairwise Sequence Alignment

The posterior probability *P*(*n*_{1} ↔ *n*_{2}*|* **x**_{1}, **x**_{2}) in (3) denotes the probability that nucleotide position *n*_{1} in the first sequence **x**_{1} is co-incident with nucleotide position *n*_{2} in the second sequence **x**_{2}, given that the HMM emits the two sequences. Conceptually, this probability may be determined by computing the probability of each possible alignment between the two sequences and summing up the probabilities for the alignments for which the {n}_{1}^{th} position of **x**_{1} is co-incident with the {n}_{2}^{th} position of **x**_{2} to obtain the desired posterior probability (and dividing by the probability that the sequences are emitted by the model). The process, however, would require computation and memory that are exponential in the sequence lengths and is infeasible for practical sequence lengths of interest. Using the HMM forward-backward algorithm, which constitutes a dynamic programming approach for the problem, these probabilities may be computed in a computationally efficient manner. The forward-backward algorithm provides a set of efficient recursions using which the posterior probabilities can be determined. For the general HMM setting, these recursions may be found in [47]. The specific situation of pairwise alignment HMMs will be considered here.

### 7.2.1 Trellis Representation of the Hidden Markov Process

In order to present the forward-backward recursions, it is convenient to represent the HMM in the form of a three-dimensional trellis of nodes {(*n*_{1}, *n*_{2}, *m*)}, where the first two coordinates correspond to the sequence indices and the third corresponds to the hidden state variable. An alignment between two sequences can be represented in the form of a *feasible* path in the trellis (described subsequently in this section). A sample trellis is shown in Figure 7, which depicts the nucleotide sequences and alignment path corresponding to the example of Figure 5.

The transitions between the trellis nodes represent the (hidden) Markov process for the alignment. The process can be thought of as evolving in "time" by transitioning from a *current* node position ({{n}^{\prime}}_{1}, {{n}^{\prime}}_{2}, *m'*) in the trellis to the *next* node (*n*_{1}, *n*_{2}, *m*) and emitting a pair of symbols (for the two sequences). In this process (see Remark 6 in Appendix Section 8), the transition probabilities (for the next state) are determined by the current state and the emission probabilities (for the emitted symbol pair) are determined by the next state. Furthermore, the next node (*n*_{1}, *n*_{2}, *m*) is determined by the current node ({{n}^{\prime}}_{1}, {{n}^{\prime}}_{2}, *m'*) and the next state *m as* follows:

and

These constraints reflect the state dependent constraints on emitted symbol pairs that were outlined earlier and restrict the allowable paths for the process within the trellis. Only (directed) edges ({{n}^{\prime}}_{1}, {{n}^{\prime}}_{2}, *m'*) → (*n*_{1}, *n*_{2}, *m*) between adjacent (in a 3-D neighborhood) nodes in the trellis that satisfy the above constraint are allowed or *feasible* transitions between trellis nodes. The allowed or *feasible* paths are then a sequence of feasible edges such that the end node of each edge is identical to the beginning node of the next edge. A section of the trellis illustrating the feasible paths corresponding to a specific node is shown in Figure 8.

### 7.2.2 Forward-Backward Algorithm for Posterior Probability Computation

From Bayes' rule, the posterior probability in (3) may be written as

where *P*(*n*_{1} ↔ *n*_{2}, **x**_{1}, **x**_{2}) represents the joint probability that nucleotide *n*_{1} of sequence 1 is co-incident with nucleotide *n*_{2} of sequence 2 and the sequences **x**_{1} and **x**_{2} are emitted (by the HMM). The computation of this joint probability is expressed in terms of recursions involving a *forward-variable* and a *backward-variable* (see Remark 7 in Appendix Section 8). In order to define these variables, denote by *S*_{
m
}(*n*_{1}, *n*_{2}) the event that the state is *m* at the point when *n*_{1} nucleotides corresponding to the first sequence and *n*_{2} nucleotides corresponding to the second sequence have been emitted. Equivalently, this is the event that the path of the HMM process through the trellis visits the trellis node (*n*_{1}, *n*_{2}, *m*).

The forward-variable is then defined as the joint probability

i.e., the probability that the subsequence {}_{1}{}^{{n}_{1}}\mathbf{x}_{1} of *n*_{1} nucleotides is emitted in the first sequence, the subsequence of *n*_{2} nucleotides is emitted in the second sequence, and the state (of the alignment Markov process) is to *m*. The backward variable is defined as the conditional probability

i.e., the probability that subsequences {}_{{n}_{1}+1}{}^{{N}_{1}}\mathbf{x}_{1} and {}_{{n}_{2}+1}{}^{{N}_{2}}\mathbf{x}_{2} are observed given that state is *m* when *n*_{1} and *n*_{2} nucleotides have been emitted in the first and second sequence, respectively. Here *N*_{1} and *N*_{2} represent the lengths of sequences **x**_{1} and **x**_{2}, respectively.

From the Markov property of the hidden alignment process, the joint probability in (9) can be written as*P*(*n*_{1} ↔ *n*_{2}, **x**_{1}, **x**_{2}) = *α*_{
ALN
}(*n*_{1}, *n*_{2})*β*_{
ALN
}(*n*_{1}, *n*_{2})

The forward variable can be computed recursively by noting that each node in the trellis has three distinct incoming feasible edges corresponding to the three possible values for the immediately previous state (see Figure 8). Hence, the forward variable is obtained as

where in accordance with (7) and (8),

and

Now using the HMM state transition probabilities and the symbol emission probabilities defined in Section 7.1, it can be seen that the forward variable expression in (13), yields the recursion formula,

Following a similar procedure, recursions for the backward variable are obtained:

The joint probability that the sequences are emitted in the denominator of (9) can also be obtained from the forward variable as,

Using (12) and (18) in Equation (9) the posterior probability of co-incidence of two nucleotides can be obtained as,

### 7.2.3 Boundary Conditions

Boundary conditions are required to initiate the recursions in Equations (16) and (17). The forward variable recurses on the previous states and backward algorithm recurses on next states. As a result forward variable needs a boundary condition at the starting symbol pairs and backward algorithm needs the boundary condition at the ending pairs. Since the method is employed over ncRNAs rather than arbitrarily chosen RNA segments, special dummy symbol pairs are introduced at the beginning, i.e., nucleotide positions (0,0) and at the end, viz, nucleotide positions (*N*_{1}*+* 1, *N*_{2} + 1).

The beginning state is then specified by:

Similarly the end state is specified by:

#### 7.3 Probabilistic Alignment Constraint Computation

As indicated in Section 3 the alignment constraints are computed by utilizing a threshold on the posterior probability of co-incidence. This process can be summarized as follows:

1. Using the boundary condition (20) and the recursions (16), calculate the forward variable *α*_{
m
}(*n*_{1}, *n*_{2}) over 3D trellis ((*n*_{1}, *n*_{2}, *m*) ∈ [1 : *N*_{1}] × [1 : *N*_{2}] × *M*).

2. Using the boundary condition (21) and the recursions (17), calculate backward variable *β*_{
m
}(*n*_{1}, *n*_{2}) over same trellis.

3. Calculate probability P(**x**_{1}, **x**_{2}) of emission of the observed sequences using (18).

4. Using (19), compute the alignment posterior probability P(*n*_{1} ↔ *n*_{2} | **x**_{1}, **x**_{2}), for all possible nucleotide alignment positions, i.e. for (*n*_{1}, *n*_{2}) ∈ [1 : *N*_{1}] × [1 : *N*_{2}].

5. Determine a statistical confidence threshold *P*_{thresh} such that pair-wise alignments with a probability of lower than *P*_{thresh} may be considered improbable and therefore excluded (from the computations in subsequent Dynalign stage).

6. Determine the constraint set **C** of allowable nucleotide position alignments between the sequences by thresholding the posterior probability at the chosen statistical confidence level *P*_{thresh}, i.e.

**C** = {(*n*_{1}, *n*_{2}) | P(*n*_{1} ↔ *n*_{2} | **x**_{1}, **x**_{2}) > *P*_{thresh}} (22)

Note that (22) is identical to equation (2) in Section 3.

The constraints on alignment are then imposed a priori in Dynalign by considering (in the dynamic programming step) only the pair-wise alignment positions in **C**.

#### 7.4 Model Parameter and Threshold Estimation

Seed alignments from the RFAM database [37], are utilized to estimate HMM parameters and thresholds required for the determination of alignment constraint sets. The process uses multiple sequence alignments for the 10 RNA families: 5S RNA, archaeal RNAseP, bacterial RNAseP classA, bacterial RNAseP classB, bacterial SRP, eukaryotic SRP, Group1 catalytic intron, Group2 catalytic intron, Nuclear RNAseP, and tRNA. Within each family the set of sequences available are randomized and half are utilized in the training process for determining the HMM parameters and the other half are used for testing and for establishing threshold probability values as will be described subsequently. The RFAM database includes multiple alignments and in order to obtain pairwise alignments, all possible (unique) pairwise sequence alignments implied by the multiple alignments of member sequences within a family are used.

In order to allow the model to better represent observed statistics, sequence pairs are grouped into a number of "bins" and HMM parameters are estimated for each bin. Bins are established based on estimates of percent nucleotide-identity – an approach that has been commonly used for several probabilistic models [11, 36]. A brief description of the process follows. First, a "universal" set of HMM parameters is obtained by utilizing all alignments in the training set (from the 10 RNA families). Using this universal set of parameters, for any sequence pair, a maximum-likelihood (ML) alignment is performed which is then utilized to compute the percentage nucleotide-identity, i.e., the percentage of positions in the ML alignment that are aligned and have matching nucleotides. The seed alignments in the training set are then utilized to estimate the HMM model parameters, i.e., the state-transition and emission probabilities, for sequence pairs with percent nucleotide identities corresponding to the bins (see Remark 8 in Appendix Section 8): < 30%, 30 – 40%,40 – 50%,50 – 60%, 60 – 70%, 70 – 80%, 80 – 90%, and 90 – 100%. Once the HMM parameters are known, for any pair of sequences, first using the ML alignment with the universal model, the percent nucleotide identity is computed which is then used to identify the corresponding bin for the HMM parameters. Using these parameters, the posterior probability of nucleotide co-incidence may be calculated as described in Section 7.2.

Once the HMM parameters are established, suitable values of probability thresholds (*P*_{thresh} in (2)), are determined by empirically evaluating the performance of the alignment constraint set over test sequences (not included in the training). Since nucleotide alignments outside the alignment constraint set are disallowed, it is desirable that as few as possible of the true nucleotide alignment positions are outside the constraint sets. Figure 9 shows a plot of the fraction of missed alignment position pairs as a function of the (logarithm of) threshold *P*_{thresh} for the 7 different bins indicated above (over 5s and tRNA sequences in the test set). Figure 10 illustrates the fraction of missed alignments, i.e., alignments for which even one nucleotide alignment position is outside the corresponding constraint set. Using Figure 9, values of the threshold probability (*P*_{thresh}) were determined for each of the 7 bins that ensured that less than one in 10,000 alignment positions were missed, i.e., the empirical probability of missing an alignment position was less than 10^{-4}. These threshold values were then utilized in subsequent experiments to determine alignment constraints for Dynalign.

#### 7.5 Scoring Structure Predictions

The accuracy in correctly predicting canonical base pairings is utilized for the purpose of scoring the performance of the structural prediction methods. The performance is quantified using *sensitivity*, i.e., the fraction of canonical pairings in the known (or true) structure that are correctly predicted by the method and the *positive predictive value* (PPV), which is defined as the fraction of predicted base pairings that are in agreement with the known structure. In both cases, a "slippage" of one nucleotide on one side of the base pairing is allowed. Thus a base pairing *i* - *j* in the known structure is considered correctly predicted (for computation of sensitivity) if the predicted structure contains a base pairing in one of the 5 positions: *i* - *j*, (*i* ± 1) - *j*, *i* - (*j* ± 1). Likewise, a base pairing *i* - *j* in the predicted structure is considered correctly predicted (for computation of PPV) if the known structure contains a base pairing in one of the *5* positions: *i* - *j*, (*i* ± 1) - *j*, *i* - (*j* ± 1).

Thus,

where {N}_{c}^{k} is the number of base pairings in the known (k) structure that are correctly (c) predicted as per the above definition, and {N}_{t}^{k} is the total (t) number of base pairings in the known structure.

Similarly,

where {N}_{c}^{p} is the number of base pairings in the predicted (p) structure that are correct (c) as per the above definition, and {N}_{t}^{p} is the total (t) number of base pairings in the predicted structure.

The motivation for allowing the one nt slippage is twofold: firstly, the slippage of one nt does not typically change the predicted topology of the secondary structure, which is much more significant than the exact pairing predicted. Secondly, the "correct" pairings are obtained using experiments and comparative sequence analysis, which also have uncertainty due to dynamics of base pairings and limited resolution of the methods. The scoring methodology based on the one nt slippage has also been used in prior published literature [6, 24, 48]. The scoring method adopted yields values of sensitivity and PPV roughly 2–3% higher than when an exact match criterion is used for scoring, where a base pairing *i* - *j* in the known structure is deemed correctly predicted for the purpose of sensitivity computation if and only if the *exact* base pairing *i* - *j* is also predicted (and likewise exact match is used for PPV computation). For completeness, sensitivity and PPV values obtained with the exact match constraints for scoring are included as Tables 10 and 11.

#### 7.6 Parameters for Dynalign and Other Programs used for Benchmarking

For all the experiments, Dynalign is run with constraints on folding where base pairs whose minimum free energy structure is above 70% of minimum free energy structure as determined by single sequence secondary structure prediction are not allowed to pair [35]. This is the default setting and is used in both Dynalign with *M* constraints and Dynalign with probabilistic alignment constraints. In addition, Dynalign with the *M* constraint uses *M* = 7 as explained in [35]. Only the minimum free energy structures were predicted, i.e. suboptimal foldings are not generated. The thermodynamic parameters used in both versions of Dynalign are those compiled in references [19, 25]. Dynalign with *M* constraint used all parameters identical to the ones for the new method with the exception of the alignment constraint, which was replaced instead by the banded constraint implied by *M* and defined in Equation (1).

For the purposes of benchmarking, the new proposed method was compared against single structure prediction [19] and four other pairwise structural prediction methods: Dynalign with the previous *M* constraint [35], StemLoc [11], Consan [34], and FOLDALIGN [33]. These programs were utilized in their default configuration. A summary description of these methods and the runtime options utilized in the benchmarking experiments follows:

*StemLoc*: *StemLoc*[11]*is a pairwise structural alignment prediction program based on stochastic context-free grammars. It uses "fold" and "alignment" envelopes to reduce computation and memory. The benchmarking experiments utilized StemLoc version 0.19b in global alignment mode ('-g' option) with 100 best alignments ('-na 100' option) and 1000 ('-nf 1000' option) best folds*.

Consan: Consan [34] is a pair-SCFG for making pairwise structural alignment. It utilizes the concept of "pins", i.e. nucleotide positions that are constrained to be aligned, in order to constrain the alignment space and thereby limit computation and memory. Pins are selected based on posterior probabilities of alignment. The benchmarking was performed using Consan version 1.2. The training required for Consan was performed over the dataset of LSU and SSU RNAs included with the package (using 'mltrain -s mixed80.mod mixed80.stk'). The resulting model file "mixed80.mod" is used for Consan runs (using 'sfold -S -m mixed80.mod fastal fasta2'). The '-S' option is used for suppressing all messages to standard output except the structural information that Consan predicts.

*FOLDALIGN: FOLDALIGN*[33]*is free energy minimization based Sankoff implementation for local structural alignment of multiple sequences. The benchmarks were computed using FOLDALIGN version 2.0.3 in global alignment mode ('-global' option) since the input consisted of homologous tRNA or 5S RNA pairs*.

Single Prediction: The single sequence prediction method is based on thermodynamic free energy minimization [49]. Our implementation utilized the version included in the current version of RNA Structure and Dynalign [19].

Dynalign and the single sequence prediction method can utilize knowledge of modified nucleotides that cannot accommodate the canonical A-form helix (communicated in the form of lower case alphabets for the corresponding bases in the input). These are forced single-stranded in the structural prediction and the knowledge therefore improves the overall prediction [24]. The tRNA database includes knowledge of modified nucleotides whereas the 5S RNA database does not include any knowledge of modified nucleotides. Since the other methods benchmarked do not utilize knowledge of modified nucleotides, for the benchmarking results of Section 4.4, the knowledge of modified nucleotides was *not utilized* for the Dynalign and single sequence predictions. Results in Section 4 list the performance both with and without the use of this knowledge in prediction.

Computation times for all the methods are determined by using the *time* command under Linux. Memory requirements for the programs are as reported in the *size* entry of *Linux ps* command. For the Dynalign methods the memory usage is estimated after all requisite dynamic allocations are done. For other programs, the memory usage is estimated at exactly half of the run time for each sequence pair, except for sequences with computation times over 120 seconds, for which the memory usage is evaluated at 60 seconds.

## 8 Appendix

1. Note that the set of aligned positions alone (black blocks) does not satisfy this requirement.

2. The actual search is 4-dimensional, which can be thought of as combination of a two-dimensional search over possible alignments between the sequences along with a two-dimensional search over (identical) folds for the sequences.

3. The prediction accuracy for Dynalign also depends on the thermodynamic model employed for scoring secondary structures and hence the dependence on the alignment constraint is indirect.

4. A reasonably high value of specificity is also advantageous because it reduces computation time and memory.

5. The assumption of time invariance may be dropped if necessary. It is adopted for notational simplicity.

6. Some of the details of the trellis representation are a matter of convention and there exist other valid conventions that may be adopted instead.

7. In computational biology literature, the terms forward matrix and backward matrix are alternately used for the forward and backward variables.

8. Note that random nucleotide sequences of the same length can be expected to have a sequence similarity of 25%.

## References

- 1.
Durbin R, Eddy SR, Krogh A, Mitchison G: Biological Sequence Analysis : Probabilistic Models of Proteins and Nucleic Acids. 1999, Cambridge, UK: Cambridge University Press

- 2.
Eddy SR: Non-coding RNA Genes and the modern RNA World. Nat Rev. 2001, 2: 919-929. 10.1038/35103511.

- 3.
Pace NR, Thomas BC, Woese CR: Probing RNA structure, function and history by comparative analysis. The RNA World. 1999, Cold Spring Harbor Laboratory Press, 113-141. second

- 4.
Sankoff D: Simultaneous Solution of RNA Folding, Alignment and Protosequence Problems. SIAM J App Math. 1985, 45 (5): 810-825. 10.1137/0145048.

- 5.
Mathews DH, Turner DH: Dynalign: An Algorithm for Finding the Secondary Structure Common to two RNA Sequences. J Mol Biol. 2002, 317: 191-203. 10.1006/jmbi.2001.5351.

- 6.
Mathews DH: Predicting a set of minimal free energy RNA secondary structures common to two sequences. Bioinformatics. 2005, 21 (10): 2246-2253. 10.1093/bioinformatics/bti349.

- 7.
Bahl LR, Cocke J, Jelinek F, Raviv J: Optimal Decoding of Linear Codes for Minimizing Symbol Error Rate. IEEE Trans Info Theory. 1974, 20 (2): 284-287. 10.1109/TIT.1974.1055186."IEEE Trans. Info. Theory",

- 8.
Berrou C, Glavieux A, Thitimajshima P: Near Shannon limit error-correcting coding and decoding: Turbo-codes. Proc IEEE Intl Conf Communications. 1993, Geneva, Switzerland, 2: 1064-1070.

- 9.
MacKay DJC: Good Error Correcting Codes based on Very Sparse Matrices. IEEE Trans Info Theory. 1999, 45 (2): 399-431. 10.1109/18.748992. [Also see errata [50]]

- 10.
Rabiner LR, Juang BH: An Introduction to Hidden Markov Models. "IEEE ASSP Mag". 1986, 3: 4-16.

- 11.
Holmes I: Accelerated probabilistic inference of RNA structure evolution. BMC Bioinformatics. 2005, 6: 73-10.1186/1471-2105-6-73.

- 12.
Holmes I, Rubin GM: Pairwise RNA structure comparison using stochastic context-free grammars. Pacific Symposium on Biocomputing. 2002, 191-203.

- 13.
Tinoco I, Bustamante C: How RNA folds. J Mol Biol. 1999, 293 (2): 271-281. 10.1006/jmbi.1999.3001.

- 14.
Crothers DM, Cole PE, Hilbers CW, Schulman RG: The molecular mechanism of thermal unfolding of Escherichia coli formylmethionine transfer RNA. J Mol Biol. 1974, 87: 63-88. 10.1016/0022-2836(74)90560-9.

- 15.
Banerjee AR, Jaeger JA, Turner DH: Thermal unfolding of a group I ribozyme: The low temperature transition is primarily a disruption of tertiary structure. Biochemistry. 1993, 32: 153-163. 10.1021/bi00052a021.

- 16.
Mathews DH, Banerjee AR, Luan DD, Eickbush TH, Turner DH: Secondary structure model of the RNA recognized by the reverse transcriptase from the R2 retrotransposable element. RNA. 1997, 3: 1-16.

- 17.
Woodson SA: Recent insights on RNA folding mechanisms from catalytic RNA. Cell Mol Life Sci. 2000, 57 (5): 796-808. 10.1007/s000180050042.

- 18.
Gutell RR, Lee JC, Cannone JJ: The accuracy of ribosomal RNA comparative structure models. Curr Opin Struct Biol. 2002, 12: 301-310. 10.1016/S0959-440X(02)00339-1.

- 19.
Mathews DH, Disney MD, Childs JL, Schroeder SJ, Zuker M, Turner DH: Incorporating chemical mod ification constraints into a dynamic programming algorithm for prediction of RNA secondary structure. Proc Natl Acad Sci USA. 2004, 101: 7287-7292. 10.1073/pnas.0401799101.

- 20.
Ding Y, Lawrence CE: A statistical sampling algorithm for RNA secondary structure prediction. Nucleic Acids Res. 2003, 31 (24): 7280-7301. 10.1093/nar/gkg938.

- 21.
Hofacker IL: Vienna RNA secondary structure server. Nucleic Acids Res. 2003, 31: 3429-3431. 10.1093/nar/gkg599.

- 22.
Mathews DH: Using an RNA secondary structure partition function to determine confidence in base pairs predicted by free energy minimization. RNA. 2004, 10: 1178-1190. 10.1261/rna.7650904.

- 23.
Wuchty S, Fontana W, Hofacker IL, Schuster P: Complete suboptimal folding of RNA and the stability of secondary structures. Biopolymers. 1999, 49: 145-165. 10.1002/(SICI)1097-0282(199902)49:2<145::AID-BIP4>3.0.CO;2-G.

- 24.
Mathews DH, Sabina J, Zuker M, Turner DH: Expanded sequence dependence of thermodynamic pa rameters provides improved prediction of RNA secondary structure. J Mol Biol. 1999, 288: 911-940. 10.1006/jmbi.1999.2700.

- 25.
Xia T, SantaLucia JJ, Kierzek R, Schroeder SJ, Jiao X, Cox C, Turner DH: Thermodynamic Parameters for an Expanded nearest-neighbor model for formation of RNA duplexes with Watson-Crick pairs. Biochemistry. 1998, 37: 14719-14735. 10.1021/bi9809425.

- 26.
Dowell RD, Eddy SR: Evaluation of several lightweight stochastic context-free grammars for RNA secondary structure prediction. BMC Bioinformatics. 2004, 5: 71-10.1186/1471-2105-5-71.

- 27.
Doshi KJ, Cannone JJ, Cobaugh CW, Gutell RR: Evaluation of the suitability of free-energy minimization using nearest-neighbor energy parameters for RNA secondary structure prediction. BMC Bioinformatics. 2004, 5: 105-10.1186/1471-2105-5-105.

- 28.
Mathews DH: Revolutions in RNA secondary structure prediction. J Mol Biol. 2006, 359: 526-532. 10.1016/j.jmb.2006.01.067.

- 29.
Mathews DH, Schroeder SJ, Turner DH, Zuker M: Predicting RNA secondary structure. The RNA World. 2005, Cold Spring Harbor Laboratory Press, 631-657. third

- 30.
Mathews DH, Turner DH: Prediction of RNA secondary structure by free energy minimization. Curr Opin Struct Biol. 2006, 16 (3): 270-278. 10.1016/j.sbi.2006.05.010.

- 31.
Chen J, Le S, Maizel JV: Prediction of common secondary structures of RNAs: A genetic algorithm approach. Nucleic Acids Res. 2000, 28: 991-999. 10.1093/nar/28.4.991.

- 32.
Gorodkin J, Heyer LJ, Stormo GD: Finding the most significant common sequence and structure in a set of RNA sequences. Nucleic Acids Res. 1997, 25: 3724-3732. 10.1093/nar/25.18.3724.

- 33.
Havgaard JH, Lyngso RB, Stormo GD, Gorodkin J: Pairwise local structural alignment of RNA sequences with sequence similarity lessthan 40%. Bioinformatics. 2005, 21 (9): 1815-1824. 10.1093/bioinformatics/bti279.

- 34.
Dowell RD, Eddy SR: Efficient Pairwise RNA Structure Prediction and Alignment Using Sequence Alignment Constraints. BMC Bioinformatics. 2006, 7 (400):

- 35.
Uzilov AV, Keegan JM, Mathews DH: Detection of non-coding RNAs on the basis of predicted secondary structure formation free energy change. BMC Bioinformatics. 2006, 7: 173-10.1186/1471-2105-7-173.

- 36.
Notredame C, Higgins DG, Heringa J: T-Coffee: A Novel Method for Fast and Accurate Multiple Sequence Alignment. J Mol Biol. 2000, 302: 205-217. 10.1006/jmbi.2000.4042.

- 37.
Griffiths-Jones S, Bateman A, Marshall M, Khanna A, Eddy SR: RFAM: An RNA family database. Nucleic Acids Res. 2002, 31: 439-441. 10.1093/nar/gkg006.

- 38.
Szymanski M, Barciszewska MZ, Barciszewski J, Erdmann VA: 5S ribosomal RNA database Y2K. Nucleic Acids Res. 2000, 28: 166-167. 10.1093/nar/28.1.166.

- 39.
Sprinzl M, Horn C, Brown M, Ioudovitch A, Steinberg S: Compilation of tRNA sequences and sequences of tRNA genes. Nucleic Acids Res. 1998, 26: 148-153. 10.1093/nar/26.1.148.

- 40.
Hofacker IL, Bernhart SH, Stadler PF: Alignment of RNA base pairing probability matrices. Bioinformatics. 2004, 20 (14): 2222-2227. 10.1093/bioinformatics/bth229.

- 41.
Masoumi B, Turcotte M: Simultaneous alignment and structure prediction of three RNA sequences. Int J Bioinformatics Research and Applications. 2005, 1: 230-245. 10.1504/IJBRA.2005.007581.

- 42.
Torarinsson E, Sawera M, Havgaard JH, Fredholm M, Gorodkin J: Thousands of corresponding human and mouse genomic regions unalignable in primary sequence contain common RNA structure. Genome Res. 2006, 16 (7): 885-889. 10.1101/gr.5226606.

- 43.
Rivas E, Eddy SR: Noncoding RNA gene detection using comparative sequence analysis. BMC Bioinformatics. 2001, 2: 8-10.1186/1471-2105-2-8.

- 44.
Washietl S, Hofacker IL, Stadler PF: Fast and Reliable Prediction of noncoding RNAs. Proc Nat Acad Sci. 2005, 102 (7): 2454-2459. 10.1073/pnas.0409169102.

- 45.
Harmanci AO, Sharma G, Mathews DH: Toward Turbo Decoding of RNA Secondary Structure. Proc IEEE Intl Conf Acoustics Speech and Sig Proc. 2007, 365-368.

- 46.
RNA Structure and Dynalign. 2007, [http://rna.urmc.rochester.edu]

- 47.
Rabiner LR: A tutorial on hidden Markov models and selected applications in speech recognition. Proc IEEE. 1989, 77 (2): 257-286. 10.1109/5.18626.

- 48.
Lu ZJ, Turner DH, Mathews DH: A set of neighbor parameters for predicting the enthalpy change of RNA secondary structure formation. Nucleic Acids Res. 2006, 34: 13-10.1093/nar/gkl472.

- 49.
Zuker M: Computer prediction of RNA structure. Methods in Enzymology. 1989, 180: 262-288.

- 50.
MacKay DJC: Errata for "Good Error Correcting Codes based on Very Sparse Matrices". IEEE Trans Info Theory. 2001, 47 (5): 2101-10.1109/TIT.2001.930952.

## Acknowledgements

The authors thank Paul Tymann, Glenn Katzen, Chris Connett, and Andrew Yohn, Rochester Institute of Technology Computer Science Department, for optimizing the time performance of Dynalign. We also thank the anonymous reviewers of the manuscript for their comments and suggestions, which have contributed to a significantly improved manuscript. DHM is a Alfred P. Sloan Foundation Research Fellow. This work was partially supported by National Institutes of Health grant GM076485 to DHM.

## Author information

### Affiliations

### Corresponding author

## Additional information

### Authors' contributions

G.S. proposed the use of *a posteriori* probability estimates for the purpose of determining alignment constraints. All three authors worked together on the conceptual development of the technique. A.O.H. implemented the proposed algorithm and conducted the experiments for obtaining the reported results. In this effort he was guided and supervised by G.S. and D.H.M. D.H.M. also provided assistance in the integration of the software with existing Dynalign code. The three authors collectively wrote, edited, and revised the manuscript. Significant connections to related work in the biological and bioinformatics literature were recognized by D.H.M. and in electrical communications literature by G.S., respectively. All authors read and approved the final manuscript.

## Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

## Rights and permissions

**Open Access**
This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License (
https://creativecommons.org/licenses/by/2.0
), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

## About this article

### Cite this article

Harmanci, A.O., Sharma, G. & Mathews, D.H. Efficient pairwise RNA structure prediction using probabilistic alignment constraints in Dynalign.
*BMC Bioinformatics* **8, **130 (2007). https://doi.org/10.1186/1471-2105-8-130

Received:

Accepted:

Published:

DOI: https://doi.org/10.1186/1471-2105-8-130

### Keywords

- Positive Predictive Value
- Hide Markov Model
- Nucleotide Position
- Free Energy Minimization
- Nucleotide Alignment