More accurate recombination prediction in HIV-1 using a robust decoding algorithm for HMMs
- Jakub Truszkowski^{1}Email author and
- Daniel G Brown^{1}
DOI: 10.1186/1471-2105-12-168
© Truszkowski and Brown; licensee BioMed Central Ltd. 2011
Received: 7 August 2010
Accepted: 17 May 2011
Published: 17 May 2011
Abstract
Background
Identifying recombinations in HIV is important for studying the epidemiology of the virus and aids in the design of potential vaccines and treatments. The previous widely-used tool for this task uses the Viterbi algorithm in a hidden Markov model to model recombinant sequences.
Results
We apply a new decoding algorithm for this HMM that improves prediction accuracy. Exactly locating breakpoints is usually impossible, since different subtypes are highly conserved in some sequence regions. Our algorithm identifies these sites up to a certain error tolerance. Our new algorithm is more accurate in predicting the location of recombination breakpoints. Our implementation of the algorithm is available at http://www.cs.uwaterloo.ca/~jmtruszk/jphmm_balls.tar.gz.
Conclusions
By explicitly accounting for uncertainty in breakpoint positions, our algorithm offers more reliable predictions of recombination breakpoints in HIV-1. We also document a new domain of use for our new decoding approach in HMMs.
Background
We consider the problem of locating recombination breakpoints in viral genomes. The Human Immunodeficiency Virus has been classified into several major phylogenetic groups called subtypes[1]. Recombination between those groups is common [2], so a viral genome can be composed of several regions arising from different subtypes. Given a viral genome sequence, we would like to identify whether it is a recombinant, and which subtypes gave rise to which regions of its sequence.
Identifying recombinations is important for epidemiological monitoring of the virus, as well as for the design of potential vaccines and treatments. For example, some subtypes develop more resistance to anti-retroviral drugs than others [3]. Accurate identification of recombination patterns is also crucial to detecting superinfections in patients [4].
We apply a novel algorithm to further improve the accuracy of predictions provided by a jpHMM. Our key observation is that in many cases, high similarity between different subtypes makes it impossible to pinpoint breakpoint positions. We focus on approximately predicting breakpoint positions rather than maximizing the probability of being exactly correct. We have demonstrated the efficiency of a similar decoding strategy for transmembrane protein topology prediction in previous work [9], where we also developed much of our algorithmic framework.
Related work
Many tools have been developed for HIV recombination detection. These tools can be divided into two groups: those based solely on comparisons between sequences and those which are additionally based on phylogenetic reconstruction.
Among the tools based solely on sequence comparison, Simplot [10] is perhaps the most well-known. It provides a graph showing the local similarity of a query sequence to a set of reference sequences. Another tool, RIP [11] also operates on the same principle. The jumping profile hidden Markov model (jpHMM) [7] uses profile hidden Markov models to model different subtypes and predict recombinations. Here, comparisons are made between the query sequence and profile HMMs describing collections of sequences belonging to the same subtype.
Tools using phylogenetic information try to detect recombinations by reconstructing phylogenies for different regions of sequence alignment and comparing them to detect topology changes, which suggest recombination took place. The REGA HIV subtyping tool [12] uses a sliding window approach to reconstruct phylogenies for different regions in the alignment, though it only identifies the subtypes without predicting breakpoint positions. DualBrothers [13] and cBrother [14] divide the sequence alignment into segments with different evolutionary parameters and different phylogenetic histories. They then use Markov Chain Monte Carlo to sample from the posterior distribution of such partitions and their corresponding trees. GARD [15] uses a genetic algorithm to find a maximum-likelihood partition of the alignment into segments with different evolutionary histories. De Oliveira Martins and Kishino [16] try to account for uncertainty of segment assignments by using a distance measure between mosaic structures and applying a centroid estimator.
Several phylogeny-based tools use phylogenetic HMMs (phylo-HMMs) to model topology changes along the sequence alignment. Each state in a Phylo-HMM corresponds to a phylogenetic tree and emits a column of the multiple sequence alignment. Husmeier and Wright [17] use a phylogenetic HMM with three states to detect recombinations between four sequences. Kedzierska and Husmeier [18] propose a heuristic technique using an HMM that emits tree topologies. Westesson and Holmes [19] use a version of the EM algorithm to train a phylogenetic HMM with a fixed, user-defined number of tree topologies. Webb, Holmes and Hancock [20] integrate out the branch lengths in the phylogenies to speed up the MCMC inference.
We note that the HMMs used in these phylogeny-based approaches are very different from the jpHMM model we employ. A state in a phylo-HMM emits a column in the multiple sequence alignment of the analyzed sequences. In contrast, a jpHMM is a single-sequence HMM where each state emits a base of the sequence under analysis. While phylogeny-based methods take a multiple sequence alignment as an input, the jpHMM's input is only the single recombinant sequence to be analyzed: the multiple alignments already built are encapsulated in the probabilistic properties of the profile HMM. A state path through the jpHMM corresponds to an assignment of regions of the input sequence to the subtypes modelled by the profile HMMs.
Phylogeny-based methods provide more flexibility in modelling sequence evolution, but they often require the knowledge of evolutionary parameters to work properly and are computationally expensive. In contrast, profile-based approaches are simpler. They do require parameters that summarize existing multiple alignments, though this is perhaps easier data to infer than are evolutionary rates. Profile methods are also typically faster, as they do not require the evaluation of tree likelihoods for a number of different topologies; their computation is also accelerated using heuristics such as beam search [21]. Phylogenetic approaches which do not enumerate over many tree topologies, but instead efficiently compute the optimal ones, could in principle give fast runtimes, but have not been used widely for HIV.
The jpHMM does not use any phylogenetic information, but it differs from other phylogeny-free approaches in that it compares the input sequence to profile HMMs rather than single sequences representing different subtypes. Here, we focus on improving the prediction accuracy of jpHMM by applying a new decoding algorithm to infer recombination breakpoints.
Recently, some other approaches have also been proposed to account for uncertainty of boundary locations in recombination detection. Schultz et al. [8] detect uncertainty regions in the Viterbi prediction where the posterior probability of the predicted subtype is below a certain threshold. Nánási et al. [22] devised a novel decoding algorithm for HMMs which maximizes the expected number of breakpoints predicted up to a certain error tolerance, but does not assess the joint probability of all breakpoints; more detail is in Nánási's thesis [23].
These methods have drawbacks. The algorithm by Nánási et al. is too computationally expensive to be practical on full-length viral sequences and has only been evaluated on a small region of HIV alignment. The newer approach of Schultz et al. [8] still uses the Viterbi algorithm to locate breakpoints, although it gives more insight into their credibility.
While our approach bears some resemblance to the two methods mentioned above, it differs from both in that it optimizes a global objective while allowing for small local errors in our prediction.
Our approach
Schultz et al. [7] use the classical Viterbi algorithm for jpHMM decoding, despite its many drawbacks. The Viterbi path may have extremely small probability and is unlikely to be correct overall for sequences having more than a few elements. Also, we are interested in finding a correct labelling, rather than an optimal state path in the model. In many situations, likely labellings consist of a large number of low-probability paths. In such cases, the Viterbi algorithm chooses the labelling that corresponds to the most likely state path, but the posterior probability of such labelling may be much lower than the posterior probability of a labelling composed of many low-probability paths. This phenomenon is known as the path/labelling problem[24]. Even in the absence of the path/labelling problem, the Viterbi path is unlikely to be exactly correct in cases where there is much uncertainty about exact border positions. Many different labellings will then have similar probabilities, and the most probable labelling will not necessarily be correct.
In our previous work on robust HMM decoding [9], we ameliorate some of these problems by searching for the centre of the most probable ball of predictions rather than a single prediction. A ball of radius r centred at a specific labelling λ for the sequence contains a number of paths with labellings at distance less than an upper bound r from λ. The number of such paths grows exponentially with r. We often find balls of large posterior probability, giving us more confidence that the centre of the ball is close to the true labelling. We define balls on labellings rather than paths, so the path/labelling problem is avoided.
Our ball algorithms, with our border shift distance (defined in the next section), are a natural choice for the problem of recombination prediction. Our priority in this problem is accurately predicting which subtypes have occured in our sequence. Since subtypes are highly similar in many places, exactly predicting breakpoints appears impossible, meaning that we should instead focus on approximately predicting breakpoints. Where subtype similarity is low, we obtain quite accurate predictions by shrinking the ball radius.
Preliminaries
A labelled HMM is defined by a transition matrix A, an emission matrix E, and a labelling function l. The matrix A is a stochastic m × m transition matrix where a_{ ij } gives the probability of transition from state i to state j; E is an m × |∑| emission matrix where e_{ kσ } gives the probability of emitting symbol σ ∈ ∑ in state k. The labelling function l assigns to each state a single label from the set Λ of possible labels. Many states often share a single label. We assume that the model starts in a state x_{0}.
In the context of recombination detection with jpHMM, each state corresponds to a column in the alignment of sequences from a particular subtype. For each subtype and each consensus column in the alignment of the subtype, we have a match, insert, and a delete state. Each state is labelled by the subtype it belongs to. An HMM constructed this way has a large number of states: around 3 · 9000 · 14 = 378000, where the factor of 9000 is the number of consensus columns in each subtype alignment, and 14 is the number of subtypes modelled by the jpHMM. This number of subtypes is higher than the usual number of HIV subtypes reported in the literature [1] because the creators of the jpHMM-HIV chose to model the sub-subtypes A1, A2, F1 and F2, and the CRF 01_AE, as well as HIV group O and the Simian Immunodefficiency Virus, as separate subtypes [7]. The number of labels is 14, one for each subtype.
A path in an HMM is a sequence of states x = x_{0}, x_{1}, . . . , x_{ n } visited by the model at each step. We denote the corresponding sequence of emissions as y_{1}, . . . , y_{ n } . The labelling λ corresponding to path x is defined as λ = ℓ(x_{0}), ℓ(x_{1}), ℓ(x_{2}), . . . , ℓ(x_{ n } ). For a generic sequence z_{1}, . . . z_{ n } , we write to denote the subsequence z_{ i } , . . . , z_{ j } . We write to denote z_{ i } , . . . , z_{ j } = u, . . . , u.
Since a typical sequence contains only a few breakpoints, a labelling for a sequence will usually have many consecutive positions with the same label. Given a labelling λ = ℓ(x_{0}), f_{1}, f_{1}, . . . , f_{1}, f_{2}, f_{2}, . . . , f_{2}, . . . , f_{ k } , . . . , f_{ k } , which consists of λ_{0} followed by a number of positions labelled f_{1}, then a number of positions labelled f_{2} (which is different from f_{1}), and so on, we define its footprint to be the sequence f = f_{1}, . . . , f_{ k } ; this corresponds to the overall labelling of the sequence, but with the label boundaries entirely flexible. Typically, regions with the same label correspond to features: in our application, they are sequence intervals derived from a single subtype. Footprints are typically much shorter than a sequence of emissions.
Consider two different labellings λ and λ' for the same sequence y. We define their border shift distance d(λ, λ') as a function of the feature boundaries, as follows.
A ball of radius r centered at a labelling λ, denoted as B(λ, r), is defined as the set of all labellings λ' having distance at most r from λ.
Methods
Computing ball probabilities
Our first algorithm computes, for a given labelling λ, the probability of a ball of radius r centered at λ. We use a variant of the traditional forward algorithm for HMMs [6], which computes the probability that an HMM generates a sequence y, in O(nm^{2}) time.
We also restrict the set of possible states visited at each position of the sequence. We require that transition from the initial state has to be made to one of the states in G_{1}. The other entries in the first column of the forward table will be set to 0. Likewise, states from group G_{ i } can only be visited at positions b_{i-1}- r to b_{ i } + r -1 - to ensure that the shift from G_{ i } to G_{i+1}occurs between b_{ i } - r and b_{ i } + r. Finally, we require that the state at the last position of the sequence is in group G_{ k } . The standard forward algorithm computes the probability of B(λ, r) on this HMM.
Let L be the size of the largest label set. The runtime of this algorithm is where t_{ i } is the number of allowed labels at the i-th position of the sequence. For r = 0, which corresponds to computing the probability of a single labelling, we only allow 1 label at each position, so computing the probability of a labelling requires O(L^{2}n) time. Now observe that increasing r by 1 increases the overall number of active labels by at most 2k. This gives us the runtime of O(L^{2}(n + kr)). In the case of jpHMMs for HIV recombination detection, this runtime is small compared to the standard forward algorithm because L ≈ m /14 (there are 14 subtypes and sub-subtypes represented in the jpHMM for HIV) and both k and the chosen value of r are small compared to n.
Optimization
Finding the most probable ball of radius r is NP-hard even when we restrict the centres to being consistent with a fixed footprint [9]. In practice, however, we can find high-probability balls efficiently by sampling from the distribution of state paths and using local search. If there exists a high-probability ball in the space of paths, we likely sample a path within that ball; then, the local search procedure moves us towards the centre of the ball. We used this method to predict transmembrane protein topology [9]. Unfortunately, our previous local search algorithm requires performing many forward and backward passes, which makes it too computationally expensive for use with jpHMMs. Here, we present a more efficient local search algorithm that exploits the fact that the distances between breakpoints are large.
If the size of the footprint is 2 (only one breakpoint), we can recover the most probable ball of radius r by doing exhaustive search. We could calculate the ball probability for every possible placement of the breakpoint, for every choice of two recombining subtypes. This requires (n - 1|Λ|^{2} ball computations, or a total runtime of O(n^{2}L^{2}|Λ|^{2}), which is too large.
We now reduce this runtime. For any HMM M, let be the probability that M, started at the initial state x_{0}, emits y_{1}, . . . , y_{ i } while visiting only states with label h and that x_{ i } = k. Obviously, ϕ_{ i,h } (k) = 0 if the label of state k is not h. Analogously, let be the probability that M, started at state k, emits y_{i+1}. . . y_{ n } while visiting only states labelled with j. For a labelling λ(h, j, i + 1) consisting of two intervals labelled h and j with a breakpoint at position i + 1, the probability of λ(h, j, i + 1) is the dot product of ϕ_{i,h}and β_{i,j}. We obtain all forward vectors ϕ_{i,h}by running the algorithm for computing the probability of a labelling for a labelling where all positions are labelled with h. Similarly, we obtain the backward vectors β_{i,j}by running a similar backward algorithm for a labelling consisting only of j. Once we have all the vectors, we can find the most probable ball by a linear scan. The overall runtime of this procedure amounts to O(nL^{2}|Λ|^{2}).
In many cases, this runtime can be further improved if we know the location of some reference ball B(λ', r) with posterior probability over 0.5. Since the path probabilities add up to 1, we know that the maximum probability ball must intersect B(λ', r) The centres of intersecting balls must have distance at most 2r, and the footprints must be the same, so we are left with only 4r + 1 candidate ball centres as opposed to n -1. We need to compute only around 6r dot products, giving runtime O(nL^{2}). The asymptotic runtime is dominated by the forward and backward passes and not dependent on r since computing each dot product takes O(L) time, so computing dot products at all positions would take O(nL) time. Nevertheless, considering only 6r positions yields a substantial practical improvement in the constant factor.
The initial guess about the location of the reference ball can be obtained by sampling several paths from the conditional distribution using standard algorithms [25, 26] and computing the probability of a ball containing all (or most) of the sampled paths.
Similar exhaustive search procedures quickly become impractical as the number of breakpoints grows. However, we can use this approach as a heuristic to optimize each breakpoint separately. If distances between subsequent breakpoints are large, compared to the ball radius, there may be very little dependence between subsequent breakpoints, so optimizing for each breakpoint separately yields a good approximation to the globally optimal ball centre. For the first breakpoint, computing the probability of the breakpoint occuring at every position is carried out as in the one-breakpoint case except that we assume that the borders 2 to k occur within a reference ball for which backward table values were previously calculated. As we move to the next breakpoint, we calculate the forward values based on the optimal location of previous breakpoints, while the backward vectors still come from the calculation for the reference ball. This way, our algorithm only requires performing one additional forward pass after the backward pass for the reference ball has been performed.
Our complete optimization algorithm is as follows. First, we sample 10 paths from the HMM to determine a reference ball for our local search. We determine the majority footprint in the sample set and discard samples with a different footprint. We estimate the mean and variance of each breakpoint position from the sample. From this estimate, we derive a biased estimate of the standard deviation which we multiply by to get a biased estimate of the ball radius r_{0.5} such that a ball centered at the mean labelling with radius r_{0.5} has 0.5 posterior probability (the factor of follows from Chebyshev's inequality). We then compute the probability of the ball centered at the mean labelling with radius (in case where there are multiple breakpoints, we take the maximum across all estimates). For each breakpoint, we perform the optimization procedure described above.
Choosing the ball radius adaptively
The choice of r in the algorithm above may greatly influence the results, as we shall see in our experimental results. For breakpoints which occur in places where the two subtypes are highly similar, the uncertainty about breakpoint positions will be greater than in low-similarity regions. Thus, we may automatically adapt the ball size to the amount of uncertainty in a particular breakpoint. For a sequence with many breakpoints, the uncertainty about breakpoint positions may vary between breakpoints, so we alter our definition of balls to accomodate this.
For each breakpoint, we require that the interval chosen for that breakpoint has overall probability of at least half of the probability if that breakpoint was free to occur anywhere in the sequence. In other words, if we start from the reference ball as our initial interval region, then the probability is decreased at most by half each time we update an interval. Subject to that requirement, we identify the smallest possible interval for each breakpoint. This enables intervals for different breakpoints to have different width, thus accomodating different levels of uncertainty about the position of different breakpoints.
The algorithm for finding small interval regions is analogous to the algorithm for finding most probable balls. As in the previous case, we optimize each interval separately after computing the probability of the breakpoint occuring at each position of interest. We find the optimal interval for a single breakpoint with a simple greedy linear-time algorithm: traverse the list of probabilities {p_{1}, p_{2}, ..., p_{ n } } and maintain a variable v. At step i, v denotes the maximal index such that (if no such index exists, we set v = 0). When the algorithm moves to the (i + 1)-st step, v is increased if possible. The minimum interval corresponds to the minimum value of i - v found during the execution of the algorithm.
Reducing the number of active states by beam search
Since our jpHMM has over 300, 000 states, running the standard forward and backward algorithms is computationally infeasible. We speed up the runtime of the algorithm by noticing that, at any sequence position, most entries in the forward table contain values very close to zero. Ignoring those entries has little impact on predictions but can greatly reduce computation time. Beam search[21] limits the number of active states at each position, by ignoring every entry in the dynamic programming table whose value is below ξp* where p* is the entry with the highest value and ξ is some predefined threshold. Following the decision made by the creators of jpHMM [7], we set ξ to 10^{-20}.
Results and Discussion
Data used
We have evaluated the performance of our local search algorithms on several semi-synthetic data sets and one real data set. All of the semi-synthetic data sets were produced by artificially recombining real viral sequences from different subtypes. We have also run our algorithms on real recombinants and compared their predictions to published breakpoints and to the predictions made by other algorithms. It is not possible to fully evaluate our approach on real recombinants because their precise breakpoints are unknown, and human annotations are performed with the assistance of a variety of tools including ones we are comparing our work against [27]. By artificially recombining real sequences, we hope to create data sets that resemble real sequences as closely as possible while still having known ground truth values. Our implementations are available at http://www.cs.uwaterloo.ca/~jmtruszk/jphmm_balls.tar.gz.
We compared our method to the standard implementation of jpHMM decoding using the Viterbi algorithm, and to DualBrothers [13], which was chosen as a representative of phylogeny-based methods for recombination detection. We also tried to run ST-HMM [20], but it appears prohibitively slow for this task. DualBrothers takes as input a multiple alignment of subtype reference sequences and the query sequence and outputs a collection of trees together with their posterior probabilities for each column of the alignment. We chose one sequence from each subtype to serve as reference. For each query sequence, we used MAFFT [28] to align it to the reference sequences. We then ran the MCMC sampler for 50000 steps, discarding the initial 25000 steps as burn-in. For each position in the query sequence, its subtype was assigned by taking the most probable phylogeny at this position and finding the subtype that was topologically closest to the query sequence in that phylogeny. We broke ties arbitrarily.
We used three data sets from Schultz et al. [8] which we call the 1000-1000, 500-1500 and 300-1500 data sets. In all data sets, each artificial sequence was created by taking two real sequences from different subtypes, aligning them and composing them into one sequence by alternating intervals from each parent sequence. For example, in the 300-1500 data set, the first interval consisted of roughly 300 initial positions from the first sequence, followed an interval of length 1500 from the second sequence starting immediately after the base that was aligned to the last base from the first interval. The third interval had 300 positions taken from the first sequence and so on. The parental sequences were taken from the 6 most common HIV subtypes (A, B, C, D, F, G) and CRF 01_AE. Each of these three data sets has 40 sequences generated this way.
In another data set from Schultz [29], with single breakpoints, each sequence consisted of two intervals taken from two parental sequences. The breakpoint locations were chosen uniformly at random. Here, parental sequences from all subtypes and sub-subtypes were used. This data set contains 106 sequences. In a second set of experiments, we tested the ability of the Viterbi algorithm and our ball algorithms to identify short inserted regions in the sequence that come from a different subtype than the rest of the sequence. If a region is too short, it will not be detected by any algorithm since the model will favour paths that do not make two low-probability jumps into and out of a different subtype. Our ball algorithms should be more capable of identifying such short regions. To test this hypothesis, we generated sequences with two breakpoints, with a fixed distance between the breakpoints. Each sequence was a recombinant of two out of eleven most common subtypes, with one sequence for every choice of the two subtypes. We generated four data sets this way for different insertion lengths (see Additional file 1).
In the final set of experiments, we run all the algorithms on 20 real CRFs taken from the Los Alamos HIV sequence database [27]. We used the reference strains for CRFs 2 to 9, 11 to 21, and CRF 23. When comparing the predictions to the published breakpoints, we discarded the 5 CRFs whose annotation had been produced with the aid of jpHMM for a more fair comparison; we also discarded all CRFs whose annotation contained intervals labelled as ambiguous or unknown. This produced a set of 9 CRFs. When comparing the predictions of various algorithms, we used the whole data set of 20 CRFs.
We used two accuracy measures to evaluate the algorithms. For each true breakpoint recovered by an algorithm, we calculated the distance between the predicted and actual (or reported) breakpoint positions. We report the median of these distances for each experiment. In addition, we report the breakpoint sensitivity, defined as the fraction of the true breakpoints that were identified by an algorithm. We consider a true breakpoint identified if a prediction contains a breakpoint within 300 positions of the true breakpoint and the subtypes on both sides of the predicted breakpoint match the true subtypes. If the prediction contains a breakpoint that does not correspond to a true breakpoint in the above way, we report it as a false positive.
Overall results
Comparison of different algorithms
Method | Single breakpoint | 1000-1000 | 500-1500 | 300-1500 |
---|---|---|---|---|
Viterbi | 7 (3..17) | 6 (2..17) | 7 (2..20) | 7 (3..16) |
max ball, r = 1 | 6 (2..16) | 6 (2..18) | 7 (1..19) | 7 (2..16) |
max ball, r = 2 | 5 (2..16) | 6 (1..17) | 6 (2..18) | 6 (2..15) |
max ball, r = 5 | 4 (1..12) | 5 (3..14) | 5 (3..15) | 5 (2..13) |
max ball, r = 7 | 4 (2..12) | 5 (3..14) | 6 (3..14) | 6 (3..12) |
max ball, r = 10 | 6 (3..10) | 7 (3..14) | 8 (3..14) | 7 (3..10) |
max ball, r = 15 | 7 (3..11) | 9 (4..14) | 10 (5..15) | 7 (4..12) |
min region | 4 (1..13) | 5 (2..14) | 6 (2..16) | 5 (2..14) |
DualBrothers | 57(45..71) | 51 (42..67) | 48(37..54) | 45 (40..51) |
We used the Wilcoxon signed rank test to compare the distribution of breakpoint errors between Viterbi and ball algorithms. For r = 5, the p-values for the four data sets in Table 1 are 4 ·10^{-10}, 3 ·10^{-8}, 3 ·10^{-6}, and 3 ·10^{-14}, respectively.
Number of breakpoints recovered
Method | Single breakpoint | 1000-1000 | 500-1500 | 300-1500 |
---|---|---|---|---|
Viterbi | 105/106 | 359/360 | 327/360 | 344/360 |
max ball, r = 5 | 105/106 | 360/360 | 326/360 | 350/360 |
max ball, r = 7 | 105/106 | 360/360 | 326/360 | 350/360 |
max ball, r = 10 | 105/106 | 360/360 | 326/360 | 350/360 |
max ball, r = 15 | 105/106 | 360/360 | 326/360 | 350/360 |
min region | 105/106 | 360/360 | 326/360 | 350/360 |
DualBrothers | 76/106 | 146/360 | 81/360 | 27/360 |
True positives on short intervals
Method | 250 | 200 | 150 | 100 |
---|---|---|---|---|
Viterbi | 96/110 | 79/110 | 45/110 | 25/110 |
max ball, r = 5 | 100/110 | 85/110 | 58/110 | 29/110 |
False positives on short intervals
Method | 250 | 200 | 150 | 100 |
---|---|---|---|---|
Viterbi | 2/110 | 4/110 | 8/110 | 10/110 |
max ball, r = 5 | 2/110 | 4/110 | 11/110 | 14/110 |
Comparison with published breakpoints
Method | predicted | not predicted | extra breakpoints | distance |
---|---|---|---|---|
Viterbi | 39 | 33 | 5 | 17(4..54) |
max ball, r = 5 | 41 | 31 | 5 | 21(6..53) |
DualBrothers | 22 | 50 | 19 | 65(37..82) |
There was not much agreement between DualBrothers and the other two programs on all real recombinants. Only 38 out of 150 breakpoints identified by DualBrothers for all 20 recombinants were also identified by jpHMM. In contrast, 136 out of 146 breakpoints identified by the ball algorithm were identified by jpHMM. The median distance between corresponding breakpoints was 61 between DualBrothers and jpHMM, compared to 4 between balls and jpHMM. This is not surprising since the ball algorithm uses the same model parameters as jpHMM.
The balls found by our ball algorithm often contain most of the probability mass given the model and the sequence. Out of the 106 sequences in the single-breakpoint dataset, 81 of the balls found by our algorithm had over 0.5 posterior probability, for r = 5.
Our prototype C++ implementation of ball algorithms processed the 1000-1000 dataset in about 15.5 hours on a standard desktop computer. The approximate time to analyze a sequence (average length 9256) is 23 minutes with our ball algorithms, which compares well with the 17.5 minutes required to use the simpler Viterbi algorithm, in our prototype. Schultz et al. [7] achieve a substantial speedup, to 6.7 minutes per sequence, using their implementation of Viterbi, but we expect that optimizing our methods in this domain will require only small overhead, compared to their jpHMM-HIV package. The running time of DualBrothers was about 120 minutes per sequence. While a faster implementation of DualBrothers exists [14], we were not able to compile it on our system.
Error analysis
The strikingly lower sensitivity in all experiments on the 500-1500 data set is due to an artifact of the data set rather than flaws in the algorithms. In 33 sequences from that data set, some of the true breakpoints were located after the last consensus column of the multiple sequence alignment of HIV sequences. The bases in that region are modelled by an additional insert state emitting letters according to a background frequency, so the model cannot distinguish between any two subtypes in that region. Consequently, no algorithm that uses jpHMM will be able to predict any recombination breakpoints in the unconserved region at the end of the sequence.
The higher median breakpoint error for ball algorithms with larger radii is because in many cases, most of the probability mass is concentrated in a small fragment of the most probable ball which is located away from the centre. Moving away from the concentration region might increase the ball probability by a very small amount, which causes the algorithm to pick a ball whose centre is relatively far from the region where the breakpoint is likely. On the other hand, if the ball radius is too small (e.g. r = 2) the algorithm often picks small regions of high probability and ignores many other likely breakpoint locations, which causes errors similar to those made by Viterbi.
Conclusions
We have presented two novel algorithms for predicting recombinations in viral genomes. The ball algorithm identifies recombination breakpoints up to a user-defined accuracy, while the interval region algorithm attempts to choose the accuracy adaptively based on the observed uncertainty of breakpoint locations. Both algorithms account for the inherent uncertainty about precise breakpoint locations. This leads to an improvement over the Viterbi algorithm for jpHMM in both identifying the correct breakpoints and their approximate locations. Our algorithms also show improvement on difficult instances of the problem where distances between breakpoints are small.
Both algorithms have similar accuracies in our experiments. Contrary to our expectations, the interval region algorithm does not perform better than the ball algorithm with suitable parameter choices. The interval region algorithm may still be preferred in situations where there is a lot of uncertainty about some breakpoint positions but little uncertainty about others.
Declarations
Acknowledgements
We thank Anne-Kathrin Schultz, Mario Stanke, Michal Nánási, Broňa Brejová and Tomáš Vinař for helpful discussions. In addition, we would particularly like to thank Anne-Kathrin Schultz for explaining her previous work and generating some of the data sets used in our experiments, as well as providing the script that was used to generate them. Comments from the anonymous peer reviewers have helped us convey our ideas more clearly and have sharpened our focus.
Our research is supported by the Natural Sciences and Engineering Research Council of Canada and by an Early Researcher Award by the Province of Ontario to DB. JT is supported by a David R. Cheriton Scholarship at the University of Waterloo.
Authors’ Affiliations
References
- Robertson D, Anderson J, Bradac J, Carr J, Foley B, Funkhouser R, Gao F, Hahn B, Kalish M, Kuiken C, Learn G, Leitner T, McCutchan F, Osmanov S, Peeters M, Pieniazek D, Salminen M, Sharp P, Wolinsky S, Korber B: HIV-1 nomenclature proposal. Science 2000, 288: 55–6.View ArticlePubMedGoogle Scholar
- Hoelscher M, WE D, Sanders-Buell E, Carr J, Harris M, Thomschke A, Robb M, Birx D, McCutchan F: Detection of HIV-1 subtypes, recombinants, and dual infections in East Africa by a multi-region hybridization assay. AIDS 1999, 16: 2055–2064.View ArticleGoogle Scholar
- Thomson M, Pérez-Alvarez L, Nájera R: Molecular Epidemiology of HIV-1 Genetic Forms and its Significance for Vaccine Development and Therapy. Lancet Infectious Diseases 2002, 2: 461–471. 10.1016/S1473-3099(02)00343-2View ArticlePubMedGoogle Scholar
- Ntemgwa M, Gill MJ, Brenner BG, Moisi D, Wainberg MA: Discrepancies in Assignment of Subtype/Recombinant Forms by Genotyping Programs for HIV type 1 Drug Resistance Testing May Falsely Predict Superinfection. AIDS Research and Human Retroviruses 2008, 24: 995–1002. 10.1089/aid.2008.0064View ArticlePubMedGoogle Scholar
- Eddy SR: Profile hidden Markov models. Bioinformatics 1998, 14(9):755–763. 10.1093/bioinformatics/14.9.755View ArticlePubMedGoogle Scholar
- Durbin R, Eddy S, Krogh A, Mitchison G: Biological sequence analysis. Probabilistic models of proteins and nucleic acids. Cambridge University Press; 1998.View ArticleGoogle Scholar
- Schultz AK, Zhang M, Leitner T, Kuiken C, Korber B, Morgenstern B, Stanke M: A jumping profile Hidden Markov Model and applications to recombination sites in HIV and HCV genomes. BMC Bioinformatics 2006, 7: 265. 10.1186/1471-2105-7-265PubMed CentralView ArticlePubMedGoogle Scholar
- Schultz AK, Zhang M, Bulla I, Leitner T, Korber B, Morgenstern B, Stanke M: jpHMM: Improving the reliability of recombination prediction in HIV-1. Nucleic Acids Research 2009, (37 Web-Server):647–651.Google Scholar
- Brown DG, Truszkowski J: New decoding algorithms for Hidden Markov Models using distance measures on labellings. BMC Bioinformatics 2010, 11(Suppl 1):S40. 10.1186/1471-2105-11-S1-S40PubMed CentralView ArticlePubMedGoogle Scholar
- Lole KS, Bollinger RC, Paranjape RS, Gadkari D, Kulkarni SS, Novak NG, Ingersoll R, Sheppard HW, Ray SC: Full-Length Human Immunodefficiency Virus Type 1 Genomes from Subtype C-Infected Seroconverters in India, with Evidence of Intersubtype Recombination. Journal of Virology 1999, 73: 152–160.PubMed CentralPubMedGoogle Scholar
- [http://www.hiv.lanl.gov/content/sequence/RIP/RIP.html]
- de Oliveira T, Deforche K, Cassol S, Salminen M, Paraskevis D, Seebregts C, Snoeck J, van Rensburg EJJ, Wensing AMJ, van de Vijver DA, Boucher CA, Camacho R, Vandamme AM: An automated genotyping system for analysis of HIV-1 and other microbial sequences. Bioinformatics 2005, 21(19):3797–3800. 10.1093/bioinformatics/bti607View ArticlePubMedGoogle Scholar
- Minin VN, Dorman KS, Fang F, Suchard MA: Dual multiple change-point model leads to more accurate recombination detection. Bioinformatics 2005, 21(13):3034–3042. 10.1093/bioinformatics/bti459View ArticlePubMedGoogle Scholar
- Fang F, Ding J, Minin VN, Suchard MA, Dorman KS: cBrother: relaxing parental tree assumptions for Bayesian recombination detection. Bioinformatics 2007, 23(4):507–508. 10.1093/bioinformatics/btl613View ArticlePubMedGoogle Scholar
- Kosakovsky Pond SL, Posada D, Gravenor MB, Woelk CH, Frost SDW: GARD: a genetic algorithm for recombination detection. Bioinformatics 2006, 22(24):3096–3098. 10.1093/bioinformatics/btl474View ArticlePubMedGoogle Scholar
- de Oliveira Martins L, Kishino H: Distribution of distances between topologies and its effect on detection of phylogenetic recombination. Annals of the Institute of Statistical Mathematics 2010, 62: 145–159. 10.1007/s10463-009-0259-8View ArticleGoogle Scholar
- Husmeier D, Wright F: Detection of Recombination in DNA Multiple Alignments with Hidden Markov Models. Journal of Computational Biology 2002, 8(4):401–427.View ArticleGoogle Scholar
- Kedzierska A, Husmeier D: A Heuristic Bayesian Method for Segmenting DNA Sequence Alignments and Detecting Evidence for Recombination and Gene Conversion. Statistical Applications in Genetics and Molecular Biology 2006., 5:Google Scholar
- Westesson O, Holmes I: Accurate Detection of Recombinant Breakpoints in Whole-Genome Alignments. PLoS Computational Biology 2009, 5(3):3034–3042.View ArticleGoogle Scholar
- Webb A, Hancock JM, Holmes CC: Phylogenetic inference under recombination using Bayesian stochastic topology selection. Bioinformatics 2009, 25(2):197–203. 10.1093/bioinformatics/btn607PubMed CentralView ArticlePubMedGoogle Scholar
- Plötz T, Fink G: Accelerating the Evaluation of Profile HMMs by Pruning Techniques. Tech. rep., University of Bielefeld, Faculty of Technology; 2004.Google Scholar
- Nánási M, Vinar T, Brejová B: The Highest Expected Reward Decoding for HMMs with Application to Recombination Detection. In CPM, Volume 6129 of Lecture Notes in Computer Science. Edited by: Amir A, Parida L. Springer; 2010:164–176.Google Scholar
- Nánási M: Biological sequence annotation with hidden Markov models. In Master's thesis. Comenius University in Bratislava; 2010.Google Scholar
- Brejová B, Brown DG, Vinar T: The Most Probable Labeling Problem in HMMs and Its Application to Bioinformatics. Proceedings of WABI 2004 2004, 426–437.Google Scholar
- Cawley SL, Pachter L: HMM sampling and applications to gene finding and alternative splicing. Bioinformatics 2003, 19(Suppl 2):36–41.View ArticleGoogle Scholar
- Stanke M, Keller O, Gunduz I, Hayes A, Waack S, Morgenstern B: AUGUSTUS: ab initio prediction of alternative transcripts. Nucleic Acids Research 2006, 34: W435-W439. 10.1093/nar/gkl200PubMed CentralView ArticlePubMedGoogle Scholar
- [http://www.hiv.lanl.gov/]
- Katoh K, Misawa K, Kuma K, Miyata T: MAFFT: a novel method for rapid multiple sequence alignment based on fast Fourier transform. Nucleic Acids Research 2002., 30:Google Scholar
- Schultz AK: personal communication. 2010.Google Scholar
- [http://www.hiv.lanl.gov/content/sequence/DRAW%5fCRF/recom%5fmapper.html]
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.