Volume 13 Supplement 19

## Proceedings of the Tenth Annual Research in Computational Molecular Biology (RECOMB) Satellite Workshop on Comparative Genomics

# Approximating the edit distance for genomes with duplicate genes under DCJ, insertion and deletion

- Mingfu Shao
^{1}Email author and - Yu Lin
^{1}Email author

**13(Suppl 19)**:S13

**DOI: **10.1186/1471-2105-13-S19-S13

© Shao and Lin; licensee BioMed Central Ltd. 2012

**Published: **19 December 2012

## Abstract

Computing the edit distance between two genomes under certain operations is a basic problem in the study of genome evolution. The double-cut-and-join (DCJ) model has formed the basis for most algorithmic research on rearrangements over the last few years. The edit distance under the DCJ model can be easily computed for genomes without duplicate genes. In this paper, we study the edit distance for genomes with duplicate genes under a model that includes DCJ operations, insertions and deletions. We prove that computing the edit distance is equivalent to finding the optimal cycle decomposition of the corresponding adjacency graph, and give an approximation algorithm with an approximation ratio of 1.5 + *∈*.

## Introduction

The combinatorics and algorithmics of genomic rearrangements have been the subject of much research since the problem was formulated in the 1990s [1]. The advent of whole-genome sequencing has provided us with masses of data on which to study genomic rearrangements and has motivated further work. Genomic rearrangements include inversions, transpositions, block exchanges, circularizations, and linearizations, all of which act on a single chromosome, and translocations, fusions, and fissions, which act on two chromosomes. These operations are all implemented in terms of the single double-cut-and-join (DCJ) operation [2, 3], which has formed the basis for much algorithmic research on rearrangements over the last few years [4–7]. A DCJ operation makes two cuts in the genome, either in the same chromosome or in two different chromosomes, producing four cut ends, then rejoins the four cut ends.

A basic problem in genome rearrangements is to compute the edit distance, i.e., the minimum number of operations needed to transform one genome into another. For unichromosomal genomes, Hannenhalli and Pevzner gave the first polynomial-time algorithm to compute the edit distance under signed inversions [8], which was later improved to linear time [9]. For multichromosomal genomes, the edit distance under the Hannenhalli-Pevzner model (signed inversions and translocations) has been studied through a series of papers [8, 10–12], culminating in a fairly complex linear-time algorithm [4]; under DCJ operations, the edit distance can be computed in linear time in a simple and elegant way [2].

All of the above algorithms for computing edit distances assume equal gene content and no duplicate genes. El-Mabrouk [13] first extended the results of Hannenhalli and Pevzner to compute the edit distance for inversions and deletions. Chen *et al.* [14] studied the problem of computing the inversion distance for genomes with equal gene content in the presence of duplicate genes--a problem that comes up in determining orthologies, where greedy heuristics were used. Yancopoulos *et al.* [7] proposed some rules on how to incorporate insertions and deletions into the DCJ model, but no specific algorithms are given. Braga *et al.* [15] presented a linear-time algorithm to compute the edit distance for DCJ operations, insertions and deletions, but still without duplications. Sébastien Angibaud *et al.* [16, 17] studied several model-free measures between genomes with duplicate genes; they first established a one-to-one correspondence between genes of both genomes, and then computed the measure between two genomes without duplicate genes.

In this paper, we focus on the problem of computing the edit distance between two genomes in the presence of duplications. We define the edit distance at the adjacency set level on a unit-cost model including DCJ operations, insertions and deletions (duplications are a special case of insertions). We reduce the problem of computing such an edit distance to finding the maximum number of certain cycles in the adjacency graph, Finally we give a (1.5 + *∈*)-approximation algorithm.

## Edit distance

We represent the genomes using the notations introduced by Bergeron *et al.* [2]. Denote each gene *g* with its two *extremities*, the head as *g*_{
h
} and the tail as *g*_{
t
}. Two consecutive genes *a* and *b* can be connected by one *adjacency*, which is represented by a pair of extremities; thus adjacencies come in four types: *a*_{
t
}*b*_{
t
}, *a*_{
h
}*b*_{
t
}, *a*_{
t
}*b*_{
h
}, and *a*_{
h
}*b*_{
h
} (there is no order for these two extremities, i.e., *a*_{
h
}*b*_{
t
} = *b*_{
t
}*a*_{
h
}). If gene *g* lies at one end of a linear chromosome, then this end can be represented by a single extremity, *g*_{
t
} or *g*_{
h
}, called a *telomere*. The adjacencies and telomeres of a genome form a multiset, called the *adjacency set*.

- 1.
*DCJ (double-cut-and-join)*[2], which acts on one or two elements (adjacencies or telomeres) in one of the following ways: {*pq*,*rs*} → {*pr*,*qs*} or {*ps*,*qr*}(see Figure 1(a)); {*pq*,*r*} → {*pr*,*q*} or {*p*,*qr*}(see Figure 1(b)); {*p*,*q*} → {*pq*}or {*pq*} → {*p*,*q*}(see Figure 1(c)). - 2.
*Insertion*, which inserts a single gene (a pair of extremities)*g*_{ h }*g*_{ t }in one of the following ways: {*pq*} → {*pg*_{ t },*g*_{ h }*q*} or {*pg*_{ h },*g*_{ t }*q*} (see the upper arrow in Figure 1(d)); {*p*} → {*pg*_{ t },*g*_{ h }} or {*pg*_{ h },*g*_{ t }} (see the upper arrow in Figure 1(e)); ∅ → {*g*_{ t }*g*_{ h }} (see the upper arrow in Figure 1(f)); ∅ → {*g*_{ t },*g*_{ h }} (see the upper arrow in Figure 1(g)). - 3.
*Deletion*, which deletes a single gene*g*_{ h }*g*_{ t }in one of the following ways: {*pg*_{ t },*g*_{ h }*q*} → {*pq*} (see the lower arrow in Figure 1(d)); {*pg*_{ t },*g*_{ h }} → {*p*} (see the lower arrow in Figure 1(e)); {*g*_{ t }*g*_{ h }} → ∅ (see the lower arrow in Figure 1(f)); {*g*_{ t },*g*_{ h }} → ∅ (see the lower arrow in Figure 1(g)).

The *edit distance* between two adjacency sets *S*_{1} and *S*_{2}, denoted as *d*(*S*_{1}, *S*_{2}), is the minimum number of operations (including DCJ operations, insertions and deletions) that transform *S*_{1} into *S*_{2}. Here we use a unit-cost model, in which all operations have the same cost.

*d*(

*S*

_{1},

*S*

_{2}) defined above is a lower bound for the edit distance between the two genomic structures. Given two adjacency sets

*S*

_{1}and

*S*

_{2}from two genomes, let

*E*

_{ i }be the multiset of extremities collected from all elements in

*S*

_{ i },

*i*= 1, 2. We pair extremities in

*E*

_{1}\

*E*

_{2}into

*ghost adjacencies*(named for the similar

*ghost genes*of [7]) to yield the adjacency set

*T*

_{1}; similarly, we produce

*T*

_{2}from

*E*

_{2}\

*E*

_{1}. Clearly, to transform

*S*

_{1}into

*S*

_{2}, atleast |

*T*

_{1}| deletions and |

*T*

_{2}| insertions are needed. The following theorem shows that these insertions and deletions are both necessary and sufficient.

**Theorem 1**. *Given two adjacency sets S*_{1} *and S*_{2}*, there exists an optimal series of operations with exactly |T*_{1}*| deletions, exactly |T*_{2}*| insertions and some DCJ operations that transforms S*_{1} *into S*_{2}.

*Proof*. We prove this theorem by contradiction. Suppose that every optimal series of operations contains more than |

*T*

_{1}| deletions and more than |

*T*

_{2}| insertions. Assume that

*O*

_{1}

*O*

_{2}...

*O*

_{ m }is an optimal series of operations that contains a minimum number of insertions and deletions. Let

*S*

^{0}

*S*

^{1}

*S*

^{2}...

*S*

^{ m }be the trace of

*S*

_{1}in the process of transformation, where

*S*

^{0}=

*S*

_{1}and

*S*

^{ m }=

*S*

_{2}. Note that for any insertion (or deletion) beyond the |

*T*

_{1}| deletions and |

*T*

_{2}| insertions, there must be a matching deletion (or insertion) to preserve gene content. Thus every optimal series of operations has at least a pair of insertion and deletion on the same gene. Without loss of generality, assume

*O*

_{ i }inserts a pair of extremities

*g*

_{ h }

*g*

_{ t }and

*O*

_{ j }deletes

*g*

_{ h }

*g*

_{ t }(

*i*<

*j*), and operations between

*O*

_{ i }and

*O*

_{ j }do not contain insertion or deletion on

*g*

_{ h }

*g*

_{ t }. Now we will build a new series of operations ${O}_{i}^{\prime}{O}_{i+1}^{\prime}\dots {O}_{j}^{\prime}$ without the pair of insertion and deletion on

*g*

_{ h }

*g*

_{ t }to replace

*O*

_{ i }...

*O*

_{ j }, which produce the trace ${S}^{{i}^{\prime}}{S}^{i+{1}^{\prime}}\cdots {S}^{{j}^{\prime}}$ and satisfy ${S}^{{j}^{\prime}}={S}^{j}$. This process is shown in Figure 3. Denote the two extremities inserted in

*O*

_{ i }as ${g}_{h}^{*}$ and ${g}_{t}^{*}$ to distinguish them from other

*g*

_{ h }and

*g*

_{ t }. For

*k*=

*i*,

*...*,

*j*-1, we will keep the invariant ${S}^{k-{1}^{\prime}}=\left({S}^{k}\backslash \left\{{p}^{k}{g}_{h}^{*},{q}^{k}{g}_{t}^{*}\right\}\right)\cup \left\{{p}^{k}{q}^{k}\right\}$, where

*p*

^{ k }(

*q*

^{ k }) is the extremity that shares an adjacency with ${g}_{h}^{*}\left({g}_{t}^{*}\right)$in

*S*

^{ k }. Note that

*p*

^{ k }or

*q*

^{ k }might be empty if ${g}_{h}^{*}$or ${g}_{t}^{*}$ forms a telomere, or ${g}_{h}^{*}{g}_{t}^{*}$forms an adjacency in

*S*

^{ k }. Clearly this holds for

*k*=

*i*, since we have both ${S}^{i-{1}^{\prime}}={S}^{i-1}$ and ${S}^{i}=\left({S}^{i-1}\backslash \left\{{p}^{i}{q}^{i}\right\}\right)\cup \left\{{p}^{i}{g}_{h}^{*},{q}^{i}{g}_{t}^{*}\right\}$. To make this invariant hold for

*k*=

*i*+ 1, ...,

*j*- 1, our new operation ${O}_{k-1}^{\prime}$ will mimic operation

*O*

_{ k }as follows: if

*O*

_{ k }does not affect the adjacencies or telomeres containing ${g}_{h}^{*}$ or ${g}_{t}^{*}$, then set ${O}_{k-1}^{\prime}={O}_{k}$, and the invariant holds; if

*O*

_{ k }acts on at least one of ${g}_{h}^{*}$ or${g}_{t}^{*}$, we will build ${O}_{k-1}^{\prime}$ from

*O*

_{ k }by replacing ${g}_{h}^{*}\left({g}_{t}^{*}\right)$with

*p*

^{ k }(

*q*

^{ k }) in

*O*

_{ k }. For example, if

*O*

_{ k }is the DCJ operation given by $\left\{{p}^{k-1}{g}_{h}^{*},cd\right\}\to \left\{{p}^{k-1}c,{g}_{h}^{*}d\right\}$, then ${O}_{k-1}^{\prime}$ would be {

*p*

^{ k }

^{-1}

*q*

^{ k }

^{-1},

*cd*} → {

*p*

^{ k }

^{-1}

*c*,

*q*

^{ k }

^{-1}

*d*}.

Since *O*_{
k
} does not affect, ${g}_{t}^{*}$ we have *q*^{
k
} = *q*^{
k
}^{-1}. Besides, we have *p*^{
k
} = *d*. Thus we have ${S}^{k}\backslash \left\{{p}^{k}{g}_{h}^{*},{q}^{k}{g}_{t}^{*}\right\}\cup \left\{{p}^{k}{q}^{k}\right\}={S}^{k-{1}^{\prime}}$. Other types of operations can be expressed similarly.

Recall that *O*_{
j
} is a deletion, i.e., {*ag*_{
h
}*, bg*_{
t
}} → {*ab*}. If *g*_{
h
} and *g*_{
t
} are the same as ${g}_{h}^{*}$ and, ${g}_{t}^{*}$ then we have ${S}^{j-{2}^{\prime}}={S}^{j}$, and we can skip ${O}_{j-1}^{\prime}$ and ${O}_{j}^{\prime}$ in our constructed series. If *g*_{
h
} and *g*_{
t
} are different from ${g}_{h}^{*}$ and, ${g}_{t}^{*}$ then we have $\left\{a{g}_{h,}b{g}_{t},{p}^{j-1}{g}_{h}^{*},{q}^{j-1}{g}_{t}^{*}\right\}\subset {S}^{j-1}$. We can set ${O}_{j-1}^{\prime}$ to be {*ag*_{
h
}*, bg*_{
t
}} → {*ab, g*_{
h
}*g*_{
t
}}, and set ${O}_{j}^{\prime}$ to be {*p*^{
j
}^{-1}*q*^{
j
}^{-1}, *g*_{
h
}*g*_{
t
}} → {*p*^{
j
}^{-1}*g*_{
h
}*, q*^{
j
}^{-1}*g*_{
t
}}. We can verify ${S}^{{j}^{\prime}}={S}^{j}$, and our constructed series contradicts the optimality of ${O}_{1}{O}_{2}\cdots {O}_{m}$.

## Adjacency graph decomposition

Given two adjacency sets *S*_{1} and *S*_{2} from two genomes, their corresponding *adjacency graph* is defined as a bipartite multigraph, *A* = {*S*_{1} ∪ *T*_{2}, *S*_{2} ∪ *T*_{1}, *E*},in which *u* ∈ *S*_{1} ∪ *T*_{2} and *v* ∈ *S*_{2} ∪ *T*_{1} are linked by *one* edge if *u* and *v* share one extremity, by *two* edges if they share two extremities. Note that *S*_{1} ∪ *T*_{2} and *S*_{2} ∪ *T*_{1} have the same set of extremities; we use *n* to denote half of the number of extremities. In the case of genomes with the same gene content and without duplicate genes, *T*_{1} = *T*_{2} = ∅, and each vertex in the adjacency graph has degree 2, which means that the adjacency graph consists of vertex-disjoint cycles and paths. We define the *length* of a cycle or a path to be the number of edges it contains. Based on Theorem 1, *T*_{1} = *T*_{2} = ∅ implies there exists an optimal solution without insertion and deletion, thus *d*(*S*_{1}, *S*_{2}) is just the minimum number of DCJ operations needed to transform *S*_{1} into *S*_{2}. When *S*_{1} has been transformed into *S*_{2}, the corresponding adjacency graph only consists of cycles of length 2 and paths of length 1. Since each DCJ operation can increase the number of cycles at most by 1, or increase the number of odd-length paths at most by 2, and we can always find out this kind of operation when *S*_{1} and *S*_{2} are different, we have *d*(*S*_{1}, *S*_{2})= *n* - *c* -*o*/2, where *c* is the number of cycles and *o* is the number of odd-length paths in the adjacency graph [2].

*alternating*if no two adjacent edges in this cycle (or path) share the same extremity. A valid

*decomposition*of the adjacency graph is a set of vertex-disjoint alternating cycles and paths that cover all vertices. We say that a cycle of length ℓ is

*helpful*if at most ℓ/2 - 1 vertices are

*ghost*adjacencies,

*unhelpful*if at least ℓ/2 vertices are

*ghost*adjacencies. In fact, an

*unhelpful*cycle has exactly ℓ/2

*ghost*adjacencies (all in

*T*

_{1}or all in

*T*

_{2}), since adjacencies in

*T*

_{1}and adjacencies

*T*

_{2}do not have common extremities and thus cannot be linked in the adjacency graph. Now we show how to perform DCJ operations, insertions and deletions to transform

*S*

_{1}into

*S*

_{2}based on a decomposition of the corresponding adjacency graph.

**Lemma 1**. *Given two adjacency sets S*_{1} *and S*_{2}*, and a decomposition D of the adjacency graph A* = {*S*_{1} ∪ *T*_{2}, *S*_{2} ∪ *T*_{1}, *E*} *with c helpful cycles and o odd-length paths, we can perform n - c - o*/2 *operations to transform S*_{1} *into S*_{2}*, among which there are |T*_{1}*| deletions, |T*_{2}*| insertions and n - c - o*/2 *- |T*_{1}*|-|T*_{2}*| DCJ operations*.

*Proof*. We prove this lemma in a constructive way. We will perform operations under the guidance of the graph decomposition. The goal is to transform the adjacency graph into a collection of cycles of length 2 and paths of length 1 without ghost adjacencies, indicating that *S*_{1} has been transformed into *S*_{2}. In the following, we will prove that an *unhelpful* cycle of length ℓ costs ℓ/2 operations, a path of even length ℓ costs ℓ/2 operations, a *helpful* cycle of length ℓ costs ℓ/2 -1 operations, and a path of odd length ℓ costs (ℓ - 1)/2 operations. In other words, a *helpful* cycle requires one less operation than an *unhelpful* cycle or an even-length path of the same length.

*helpful*cycle of length ℓ with

*d*adjacencies in

*T*

_{1}and

*i*adjacencies in

*T*

_{2}, we first perform

*d*deletions guided by this cycle to reduce the size of the cycle to ℓ - 2

*d*. Then for each adjacency in

*T*

_{2}, we choose one of its non-

*ghost*neighbors in

*S*

_{1}and perform an insertion to create one more

*helpful*cycle of length 2. After all adjacencies in

*T*

_{2}are handled, we transform the cycle of length ℓ into one of length ℓ - 2

*d*- 2

*i*without

*ghost*adjacencies, on which finally we can perform ℓ/2 -

*d*-

*i*- 1 DCJ operations to create ℓ/2 -

*d*-

*i*cycles of length 2. An example is shown in Figure 5(a).

For a *unhelpful* cycle of length ℓ with ℓ/2 adjacencies in *T*_{1}, we can perform ℓ/2 deletions to remove the adjacencies in *S*_{1}. For a *unhelpful* cycle of length ℓ with ℓ/2 adjacencies in *T*_{2}, we can first insert a gene as initial operand, then perform ℓ/2 - 1 insertions to create ℓ/2 cycles of length 2--see Figure 5(b)(d).

For a path with odd length ℓ, we need (ℓ - 1)/2 operations, and for a path with even length ℓ, we need ℓ/2 operations--see Figure 5(c)(e).

In sum, there are |*T*_{1}| deletions, |*T*_{2}| insertions and *n* - *c* - *o*/2 - |*T*_{1}| - |*T*_{2}| DCJ operations.

Lemma 1 states that any decomposition of the adjacency graph gives an upper bound on the edit distance. The following lemma shows that an optimal decomposition also provides a lower bound.

**Lemma 2**. $d\left({S}_{1},{S}_{2}\right)\ge n-{\text{max}}_{D\in \mathcal{D}}\left({c}_{D}+{o}_{D}/2\right)$, *where* $\mathcal{D}$*is the space of all decompositions of A* = {*S*_{1} ∪ *T*_{2}*, S*_{2} ∪ *T*_{1}*, E}, c*_{
D
} *and o*_{D} *is the number of helpful cycles and odd-length paths in D, respectively*.

*Proof*. Let ${\text{\Delta}}_{P}={\text{max}}_{D\in {\mathcal{D}}^{\u2033}}\left({c}_{D}+{o}_{D}/2\right)-{\text{max}}_{D\in {\mathcal{D}}^{\prime}}\left({c}_{D}+{o}_{D}/2\right)$, where ${\mathcal{D}}^{\prime}$ and ${\mathcal{D}}^{\u2033}$ are the space of the decomposition before and after performing operation *P*, and *P* ∈ {*DCJ, INS, DEL*}. By Theorem 1, there exists an optimal series of operations with exactly |*T*_{1}| deletions and |*T*_{2}| insertions. Summing over all Δ_{
P
} for these operations in this optimal solution yields ${\sum}_{i=1}^{d\left({S}_{1,}{S}_{2}\right)}{{\text{\Delta}}_{P}}_{{}_{i}}=\left(n-\left|{T}_{1}\right|\right)-{\text{max}}_{D\in \mathcal{D}}\left({c}_{D}+{o}_{D}/2\right)$, where (*n* - |*T*_{1}|) is the sum of the number of *helpful* cycles and half of the number of odd-length paths in the optimal decomposition of the adjacency graph when *S*_{1} has been transformed into *S*_{2}. Define *δ*_{
DCJ
} = 1, *δ*_{
INS
} = 1 and *δ*_{
DEL
} = 0. In the following, we will prove Δ_{
P
} ≤ *δ*_{
P
}*, P* ∈ {*DCJ, INS, DEL*}, which implies that ${\sum}_{i=1}^{d\left({S}_{1,}{S}_{2}\right)}{{\text{\Delta}}_{P}}_{{}_{i}}\le d\left({S}_{1},{S}_{2}\right)-\left|{T}_{1}\right|$. The combination of these two formulas proves this lemma.

We prove Δ_{
P
} ≤ *δ*_{
P
} by contradiction. Let *A'* and *A"* be the adjacency graphs before and after performing the operation *P*. Let *σ*(*A'*) and *σ*(*A"*) be the optimal decomposition of *A'* and *A"*, respectively. Suppose Δ_{
P
} >*δ*_{
P
}, namely, (*c*_{
σ
}(_{
A"
})+ *o*_{
σ
}(_{
A"
})/2) - (*c*_{
σ
}(_{
A′
};)+ *o*_{
σ
}(_{
A'
})) >*δ*_{
P
}. Note that *P* is reversible; we denote the reversed operation as $\widehat{P}$, and $\widehat{P}$ simultaneously transforms *σ*(*A"*) into a decomposition of *A'*, denoted *γ*(*A'*). Since *σ*(*A'*) is optimal, we have *c*_{
σ
}(_{
A'
})+ *o*_{
σ
}(_{
A'
})/2 ≥ *c*_{
γ
}(_{
A'
})+ *o*_{
γ
}(_{
A'
})/2. Thus, to get the contradiction, we only need to prove (*c*_{
σ
}(_{
A"
})+ *o*_{
σ
}(_{
A"
})/2) - (*c*_{
γ
}(_{
A'
})+ *o*_{
γ
}(_{
A'
})/2) ≤ *δ*_{
P
}. Recall that *γ*(*A'*) is obtained from *σ*(*A"*) by performing operation $\widehat{P}$, and both *σ*(*A"*) and *γ*(*A'*) are decompositions, which includes only vertex-disjoint cycles and paths.

If *P* is a DCJ operation, then $\widehat{P}$ is still a DCJ operation. A DCJ operation may merge two cycles into one cycle, split one cycle into two cycles, merge two paths into one path, split one path into two paths, merge one path and one cycle into one path, split one path into one cycle and one path, rearrange two odd(even)-length paths into two even(odd) paths or make no change in the number of cycles and odd-length paths. Among those possible operations, the following four cases can reduce the number of *helpful* cycles or odd-length paths: (i) merge two *helpful* cycles into one *helpful* cycle; (ii) merge two odd-length paths into one even-length path; (iii) rearrange two odd-length paths into two even-length paths; (iv) merge one *helpful* cycle and one odd-length path into one odd-length path. For any of these four cases, we have (*c*_{
σ
}(_{
A"
})+ *o*_{
σ
}(_{
A"
})/2) - (*c*_{
γ
}(_{
A'
})+ *o*_{
γ
}(_{
A'
})/2) = 1. For other possible DCJ operations, we have (*c*_{
σ
}(_{
A"
})+ *o*_{
σ
}(_{
A"
})/2) - (*c*_{
γ
}(_{
A'
})+ *o*_{
γ
}(_{
A'
})/2) ≤ 0.

If *P* is an insertion, then $\widehat{P}$ is a deletion. Similarly, among all possible deletions, the following five cases can reduce the number of *helpful* cycles or odd-length paths: (i) merge two *helpful* cycles into one *helpful* cycle; (ii) merge two odd-length paths into one even-length path; (iii) rearrange two odd-length paths into two even-length paths; (iv) merge one *helpful* cycle and one odd-length path into one odd-length path; (v) change a *helpful* cycle into an *unhelpful* one. For any of these five cases, we have (*c*_{
σ
}(_{
A"
})+ *o*_{
σ
}(_{
A"
})/2) - (*c*_{
γ
}(_{
A'
})+ *o*_{
γ
}(_{
A'
})/2) = 1. For other possible deletions, we have (*c*_{
σ
}(_{
A"
})+ *o*_{
σ
}(_{
A"
})/2) - (*c*_{
γ
}(_{
A'
})+ *o*_{
γ
}(_{
A'
})/2) ≤ 0.

If *P* is a deletion, then $\widehat{P}$ is an insertion. A insertion may split one cycle into two cycles, split one path into two paths, or split one path into one cycle and one path. All these possible insertions will not reduce the number of *helpful* cycles or odd-length paths. Thus, any deletion will not increase the number of *helpful* cycles or the number of odd-length paths, and we have *c*_{
σ
}(_{
A"
})+ *o*_{
σ
}(_{
A"
})/2 ≤ *c*_{
γ
}(_{
A'
})+ *o*_{
γ
}(_{
A'
})/2. □

Combining Lemma 1 and Lemma 2, we have the following theorem.

**Theorem 2**. $d\left({S}_{1},{S}_{2}\right)=n-{\displaystyle {\text{max}}_{D\in \mathcal{D}}}\left({c}_{D}+{o}_{D}/2\right)$, *where* $\mathcal{D}$ *is the space of all decompositions of A*= {*S*_{1} ∪ *T*_{2}, *S*_{2} ∪ *T*_{1}, *E*}, *c*_{
D
} *and o*_{
D
} *are the numbers of helpful cycles and odd-length paths in D, respectively*.

## Approximation algorithm

We design an approximation algorithm by using techniques employed on the problem of BREAKPOINT GRAPH DECOMPOSITION[5, 6, 18–20]. The basic idea is to find the maximum number of vertex-disjoint *helpful* cycles of length 4 in the adjacency graph. This problem can be reduced to the problem of K-SET PACKING problem with *k* = 4, for which the best-to-date algorithm has an approximation ratio of 2 + ∈ [21, 22].

To make use of such algorithm, we must remove telomeres and keep only cycles in the adjacency graph. This can be done by introducing *null extremities τ* and *null adjacencies ττ*, which are different from other extremities and adjacencies (the same definition is introduced in [7]). Given two adjacency sets *S*_{1} and *S*_{2} with 2*k*_{1} and 2*k*_{2} telomeres respectively, we replace each telomere *x* by the adjacency *xτ*. If we additionally have *k*_{1} <*k*_{2}, we must add (*k*_{2} - *k*_{1}) null adjacencies *ττ* to *S*_{1} in order to balance the degrees. The corresponding adjacency graph is constructed in the same way as the case without null extremities: two adjacencies are linked by one edge if they share one extremity, by two edges if they share two extremities. Now we prove that this "telomere-removal" operation does not change *d*(*S*_{1}, *S*_{2}).

**Theorem 3**. Let *S*_{1} *and S*_{2} *be two adjacency sets and denote by* ${S}_{1}^{\prime}$ and ${S}_{2}^{\prime}$*the adjacency sets obtained from S*_{1} *and S*_{2} *by removing telomeres. Then we can write* $d\left({S}_{1},{S}_{2}\right)=d\left({S}_{1}^{\prime},{S}_{2}^{\prime}\right)$.

*Proof*. We first prove $d\left({S}_{1},{S}_{2}\right)\ge d\left({S}_{1}^{\prime},{S}_{2}^{\prime}\right)$. Let

*A*= {

*S*

_{1}∪

*T*

_{2},

*S*

_{2}∪

*T*

_{1},

*E*} be the adjacency graph with respect to

*S*

_{1}and

*S*

_{2}and

*σ*(

*A*) be the optimal decomposition of

*A*. Let $A\prime =\left\{{S}_{\mathsf{\text{1}}}^{\prime}\cup {T}_{\mathsf{\text{2}}},{S}_{2}^{\prime}\cup {T}_{\mathsf{\text{1}}},E\right\}$ be the adjacency graph with respect to ${S}_{1}^{\prime}$ and ${S}_{2}^{\prime}$ and

*σ*(

*A'*) be the optimal decomposition of

*A'*. Suppose

*σ*(

*A*) contains

*c helpful*cycles,

*o*odd-length paths and

*e*even-length paths, and among these

*e*even-length paths,

*e*

_{1}of them contain two telomeres in

*S*

_{1}and

*e*

_{2}of them contain two telomeres in

*S*

_{2}. Suppose

*S*

_{1}and

*S*

_{2}contains 2

*k*

_{1}and 2

*k*

_{2}telomeres respectively (w.l.o.g., assume

*k*

_{1}≤

*k*

_{2}). Since an odd-length path contains one telomere in each adjacency set while an even-length path contains two telomeres in one adjacency set, we have

*o*+ 2

*e*

_{1}= 2

*k*

_{1}and

*o*+ 2

*e*

_{2}= 2

*k*

_{2}. We can perform the following modifications on

*σ*(

*A*) to transform it into a decomposition of

*A'*(see Figure 6). Nothing needs to be done for cycles. For odd-length paths, link their two telomeres to form a

*helpful*cycle; for each even-length path with both telomeres in

*S*

_{1}, arbitrarily choose one even-length path with both telomeres in

*S*

_{2}and link these two paths to form a

*helpful*cycle; for the remaining

*e*

_{2}-

*e*

_{1}even-length paths, use

*e*

_{2}-

*e*

_{1}=

*k*

_{2}-

*k*

_{1}null adjacencies

*ττ*to transform each such path into a

*helpful*cycle. Thus, there are

*c*+

*e*

_{2}helpful cycles in this decomposition of

*A'*, so that the upper bound on $d\left({{S}^{\prime}}_{1},{{S}^{\prime}}_{2}\right)$ is (

*n*+

*k*

_{2}) -

*c*-

*e*

_{2}=

*n*-

*c*-

*o*/2 =

*d*(

*S*

_{1},

*S*

_{2}). Now we prove $d\left({S}_{\mathsf{\text{1}}},{S}_{\mathsf{\text{2}}}\right)\le d\left({S}_{\mathsf{\text{1}}}^{\prime},{S}_{\mathsf{\text{2}}}^{\prime}\right)$. Note that

*σ*(

*A'*) only consists of vertex-disjoint cycles, and

*unhelpful*cycles cannot contain any null extremity. We claim that, for each

*helpful*cycle in

*σ*(

*A'*), there must be no more than two null extremities

*τ*on each side. Otherwise, we can always choose two nonadjacent edges that are linked through

*τ*, exchange four ends of them, and divide this cycle into two cycles (see Figure 7), contradicting the optimality of

*σ*(

*A'*). Now we transform

*σ*(

*A'*) into a decomposition of

*A*by recovering all removed telomeres (see Figure 6). Each cycle falls into one of three cases: (a) it contains one

*xτ*adjacency on each side, then the recovery will yield one odd-length path; (b) it contains one

*ττ*adjacency on one side, then the recovery will yield one even-length path; (c) it contains two

*xτ*-like adjacencies on each side, then the recovery will yield two even-length paths. In all three cases the value

*n*-

*c*-

*o*/2 remains unchanged, and after the recovery we obtain a decomposition of

*A*. Thus we have $d\left({S}_{\mathsf{\text{1}}},{S}_{\mathsf{\text{2}}}\right)\le d\left({S}_{\mathsf{\text{1}}}^{\prime},{S}_{\mathsf{\text{2}}}^{\prime}\right)$. □

In summary, based on Theorems 2 and 3, we have stated the equivalence of the problem of computing the edit distance and that of finding a valid decomposition with a maximum number of *helpful* cycles in an adjacency graph without telomeres. The latter problem is NP-hard by a reduction from the NP-hard problem--BREAKPOINT GRAPH DECOMPOSITION[23], since any instance of the BREAKPOINT GRAPH DECOMPOSITION is indeed an adjacency graph without ghost adjacencies. Thus, the problem of computing the edit distance is also NP-hard.

Now we give the approximation algorithm and prove that its approximation ratio is 1.5 + *∈*.

**Approximation Algorithm**

**Input:** Two adjacency sets *S*_{1} and *S*_{2} from two genomes

**Output:** A series of operations to transform *S*_{1} into *S*_{2}.

**Step 1** Add null adjacencies to *S*_{1} and *S*_{2} to obtain ${S}_{\mathsf{\text{1}}}^{\prime}$ and ${S}_{\mathsf{\text{2}}}^{\prime}$ without telomeres. Build the adjacency graph $A\prime =\left\{{S}_{\mathsf{\text{1}}}^{\prime}\cup {T}_{\mathsf{\text{2}}},{S}_{2}^{\prime}\cup {T}_{\mathsf{\text{1}}},E\right\}$.

**Step 2** Collect all *helpful* cycles of length 4 in *A'* as $\mathcal{C}$. Find a subset $\mathcal{S}$ of $\mathcal{C}$ in which no two cycles share one adjacency using the (2 + *ε*)-approximation algorithm for the K-SET PACKING problem with *k* = 4.

**Step 3** Remove the adjacencies covered by cycles in $\mathcal{S}$. Arbitrarily decompose the remaining part of *A'* into cycles, denoting this set as ${\mathcal{S}}^{\prime}$.

**Step 4** Remove the null adjacencies of cycles in $\mathcal{S}\cup {\mathcal{S}}^{\prime}$ to obtain a decomposition of *A*. Transform *S*_{1} into *S*_{2} according to Lemma 1 guided by these cycles and paths.

The running time of the above algorithm is dominated by the time complexity of the (2 + *ε*)-approximation algorithm for the K-SET PACKING problem with *k* = 4, which is $O\left(|\mathcal{C}{|}^{{\text{log}}_{4}1/\epsilon}\right)$ and $\left|\mathcal{C}\right|=O\left({n}^{\mathsf{\text{4}}}\right)$[21, 22].

**Theorem 4**. *The approximation ratio of the above algorithm is* 1.5 + *ε*.

*Proof*. Suppose the optimal decomposition of

*A'*contain

*p helpful*cycles of length 4 and

*q*longer

*helpful*cycles. Clearly, we have

*n*≥ 2

*p*+3

*q*. Based on Theorem 2 and Theorem 3, we know that

*d*(

*S*

_{1},

*S*

_{2}) =

*n*-

*p*-

*q*. In the algorithm, we find at least $\left|\mathcal{S}\right|$

*helpful*cycles, which implies that the number of operations that our algorithm outputs is at most $n-\left|\mathcal{S}\right|$. Since $\mathcal{S}$ is a (2 +

*∈*)-approximation solution, we have $\left(2+\epsilon \right)\left|\mathcal{S}\right|\phantom{\rule{2.77695pt}{0ex}}\ge OPT\ge p$, where

*OPT*is the maximum number of independent

*helpful*cycles of length 4 in $\mathcal{C}$. The approximation ratio is thus

## Conclusion

We studied the edit distance problem for two genomes under a unit-cost model including DCJ operations, insertions (including duplications) and deletions. We proved that this problem is equivalent to finding maximum number of *helpful* cycles in the adjacency graph and gave a (1.5 + *∈*)-approximation algorithm. We made two main assumptions in this work: single-gene insertions and deletions; and unit cost for DCJ operations, insertions and deletions. Both are clearly unrealistic. For example, large segmental duplications are common in many mammalian genomes [24], paracentric rearrangements are more common than pericentric ones, at least in two Drosophila species [25], and short inversions are more common than long ones, in some prokaryotes and in the aforementioned Drosophila [26]. These constraints should be incorporated into our distance computation. Any additional constraint naturally creates complications, but we expect that at least a few natural constraints can be handled within the framework described here.

## Declarations

### Acknowledgements

We thank Bernard Moret for helpful discussions.

This article has been published as part of *BMC Bioinformatics* Volume 13 Supplement 19, 2012: Proceedings of the Tenth Annual Research in Computational Molecular Biology (RECOMB) Satellite Workshop on Comparative Genomics. The full contents of the supplement are available online at http://www.biomedcentral.com/bmcbioinformatics/supplements/13/S19

## Authors’ Affiliations

## References

- Fertin G, Labarre A, Rusu I, Tannier E, Vialette S: Combinatorics of Genome Rearrangements. 2009, MIT PressView ArticleGoogle Scholar
- Bergeron A, Mixtacki J, Stoye J: A unifying view of genome rearrangements. Proc 6th Workshop Algs in Bioinf (WABI'06), Volume 4175 of Lecture Notes in Comp Sci. 2006, Springer Verlag, Berlin, 163-173.Google Scholar
- Yancopoulos S, Attie O, Friedberg R: Efficient sorting of genomic permutations by translocation, inversion and block interchange. Bioinformatics. 2005, 21 (16): 3340-3346. 10.1093/bioinformatics/bti535.View ArticlePubMedGoogle Scholar
- Bergeron A, Mixtacki J, Stoye J: A new linear-time algorithm to compute the genomic distance via the double cut and join distance. Theor Comput Sci. 2009, 410 (51): 5300-5316. 10.1016/j.tcs.2009.09.008.View ArticleGoogle Scholar
- Chen X: On sorting permutations by double-cut-and-joins. Proc 16th Conf Computing and Combinatorics (COCOON'10), Volume 6196 of Lecture Notes in Comp Sci. 2010, Springer Verlag, Berlin, 439-448.Google Scholar
- Chen X, Sun R, Yu J: Approximating the double-cut-and-join distance between unsigned genomes. BMC Bioinformatics. 2011, 12 (Suppl 9): S17-10.1186/1471-2105-12-S9-S17.PubMed CentralView ArticlePubMedGoogle Scholar
- Yancopoulos S, Friedberg R: Sorting genomes with insertions, deletions and duplications by DCJ. recombcg08. 2008, 170-183.Google Scholar
- Hannenhalli S, Pevzner P: Transforming cabbage into turnip (polynomial algorithm for sorting signed permutations by reversals). Proc 27th Ann ACM Symp Theory of Comput (STOC'95). 1995, ACM Press, New York, 178-189.View ArticleGoogle Scholar
- Bader D, Moret B, Yan M: A fast linear-time algorithm for inversion distance with an experimental comparison. J Comput Biol. 2001, 8 (5): 483-491. 10.1089/106652701753216503.View ArticlePubMedGoogle Scholar
- Jean G, Nikolski M: Genome rearrangements: a correct algorithm for optimal capping. Inf Proc Letters. 2007, 104: 14-20. 10.1016/j.ipl.2007.04.011.View ArticleGoogle Scholar
- Ozery-Flato M, Shamir R: Two notes on genome rearrangement. J Bioinf Comp Bio. 2003, 1: 71-94. 10.1142/S0219720003000198.View ArticleGoogle Scholar
- Tesler G: Efficient algorithms for multichromosomal genome rearrangements. J Comput Syst Sci. 2002, 65 (3): 587-609. 10.1016/S0022-0000(02)00011-9.View ArticleGoogle Scholar
- El-Mabrouk N: Sorting signed permutations by reversals and insertions/deletions of contiguous segments. Journal of Discrete Algorithms. 2001, 1: 105-122.Google Scholar
- Chen X, Zheng J, Fu Z, Nan P, Zhong Y, Lonardi S, Jiang T: Assignment of orthologous genes via genome rearrangement. ACM/IEEE Trans on Comput Bio & Bioinf. 2005, 2 (4): 302-315. 10.1109/TCBB.2005.48.View ArticleGoogle Scholar
- Braga M, Willing E, Stoye J: Genomic distance with DCJ and indels. Algorithms in Bioinformatics. 2010, 90-101.View ArticleGoogle Scholar
- Angibaud S, Fertin G, Rusu I, Vialette S: A pseudo-boolean framework for computing rearrangement distances between genomes with duplicates. jcb. 2007, 14 (4): 379-393.Google Scholar
- Angibaud S, Fertin G, Rusu I, Thévenin A, Vialette S: On the approximability of comparing genomes with duplicates. Journal of Graph Algorithms and Applications. 2009, 13: 19-53. 10.7155/jgaa.00175.View ArticleGoogle Scholar
- Caprara A, Rizzi R: Improved approximation for breakpoint graph decomposition and sorting by reversals. J of Combin Optimization. 2002, 6 (2): 157-182. 10.1023/A:1013851611274.View ArticleGoogle Scholar
- Christie D: A 3/2-approximation algorithm for sorting by reversals. Proc 9th Ann ACM/SIAM Symp Discrete Algs (SODA'98). 1998, SIAM Press, Philadelphia, 244-252.Google Scholar
- Lin G, Jiang T: A further improved approximation algorithm for breakpoint graph decomposition. J of Combin Optimization. 2004, 8 (2): 183-194.View ArticleGoogle Scholar
- Halldórsson M: Approximating discrete collections via local improvements. Proceedings of the sixth annual ACM-SIAM symposium on Discrete algorithms, Society for Industrial and Applied Mathematics. 1995, 160-169.Google Scholar
- Hurkens C, Schrijver A: On the size of systems of sets every t of which have an SDR, with an application to the worst-case ratio of heuristics for packing problems. SIAM Journal on Discrete Mathematics. 1989, 2: 68-72. 10.1137/0402008.View ArticleGoogle Scholar
- Kececioglu J, Sankoff D: Exact and approximation algorithms for sorting by reversals, with application to genome rearrangement. Algorithmica. 1995, 13: 180-210. 10.1007/BF01188586.View ArticleGoogle Scholar
- Bailey J, Eichler E: Primate segmental duplications: crucibles of evolution, diversity and disease. Nature Reviews Genetics. 2006, 7 (7): 552-564. 10.1038/nrg1895.View ArticlePubMedGoogle Scholar
- York T, Durrett R, Nielsen R: Dependence of paracentric inversion rate on tract length. BMC Bioinformatics. 2007, 8 (115):
- Lefebvre JF, El-Mabrouk N, Tillier E, Sankoff D: Detection and validation of single gene inversions. Proc 11th Int'l Conf on Intelligent Systems for Mol Biol (ISMB'03), Volume 19 of Bioinformatics. 2003, Oxford U Press, i190-i196.Google Scholar

## Copyright

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.