 Research article
 Open Access
Flexible taxonomic assignment of ambiguous sequencing reads
 José C Clemente^{1, 2},
 Jesper Jansson^{3} and
 Gabriel Valiente^{4}Email author
https://doi.org/10.1186/14712105128
© Clemente et al; licensee BioMed Central Ltd. 2011
Received: 6 July 2010
Accepted: 7 January 2011
Published: 7 January 2011
Abstract
Background
To characterize the diversity of bacterial populations in metagenomic studies, sequencing reads need to be accurately assigned to taxonomic units in a given reference taxonomy. Reads that cannot be reliably assigned to a unique leaf in the taxonomy (ambiguous reads) are typically assigned to the lowest common ancestor of the set of species that match it. This introduces a potentially severe error in the estimation of bacteria present in the sample due to false positives, since all species in the subtree rooted at the ancestor are implicitly assigned to the read even though many of them may not match it.
Results
We present a method that maps each read to a node in the taxonomy that minimizes a penalty score while balancing the relevance of precision and recall in the assignment through a parameter q. This mapping can be obtained in time linear in the number of matching sequences, because LCA queries to the reference taxonomy take constant time. When applied to six different metagenomic datasets, our algorithm produces different taxonomic distributions depending on whether coverage or precision is maximized. Including information on the quality of the reads reduces the number of unassigned reads but increases the number of ambiguous reads, stressing the relevance of our method. Finally, two measures of performance are described and results with a set of artificially generated datasets are discussed.
Conclusions
The assignment strategy of sequencing reads introduced in this paper is a versatile and a quick method to study bacterial communities. The bacterial composition of the analyzed samples can vary significantly depending on how ambiguous reads are assigned depending on the value of the q parameter. Validation of our results in an artificial dataset confirm that a combination of values of q produces the most accurate results.
Keywords
Background
Microbes play a fundamental role as symbionts in the gut of mammals [1], and are strongly correlated with human health [2]. They also control some of the most important environmental processes, such as nitrogen fixation [3], and have been successfully used in the treatment of sewage [4] and to convert waste into usable fuels [5]. The importance of microbes is reflected in the large number of recent studies of bacterial communities in a variety of environments, including aquatic [6–11], soil [12–17], animal [18–23], and plant [24–29] habitats. The use of highthroughput sequencing technologies has greatly benefited the analysis of microbial populations [30], and different methodologies have been developed to characterize the diversity, richness, and similarity of bacterial communities [31–33]. Together with the introduction of new sequencing technologies, several challenges have emerged that need to be overcome to gain a better understanding of the diversity of bacteria that inhabit both the environment and ourselves [34].
Microbial communities are commonly characterized by mapping sequencing reads to a bacterial taxonomy based on the 16S rRNA gene. The effectiveness of this approach is not limited by the length of the read but by the choice of an adequate region of the 16S rRNA gene [35, 36]. The structure of microbial communities has a high degree of variability, both in environmental [7] and gut samples [22]. In particular, human microbial communities differ greatly among individuals [23] and depending on the location of the body and time when the sample was taken [21]. Metabolic profiling has nevertheless shown that the functionality of communities is more conserved for particular environments [37], indicating that different species distributions can achieve a similar core functionality. Understanding the correlation between function and distribution of species therefore requires accurate measurements of both variables.
We have previously shown that a large proportion of reads in metagenomic studies can be assigned with equal significance to more than one species in the taxonomy [38]. The assignment of such ambiguous reads to the lowest common ancestor (LCA) of the matched species [39–42] introduces many false positives (leaves in the subtree rooted at the LCA that were not originally matched to the read), and thus we consider other possible nodes below the LCA to assign such reads. Implicitly, assignments at the LCA maximize the coverage but lower the accuracy, and we demonstrated that an assignment based on the Fmeasure, a combination of precision and recall, produces a significantly different distribution of taxonomic ranks to which reads are assigned.
In the absence of a reference taxonomy, the assignment of ambiguous reads is usually made by either mapping each read to the best BLAST hit in the reference sequences [43] or by using the reference sequences as a template for a multiple alignment of the reads, which defines pairwise similarities that are used to group the reads into clusters of related species [39, 42, 44]. In the absence of reference sequences, DNA composition can be used to group the reads into clusters of related species [45].
In this paper, we present a new method to assign ambiguous short reads to a node in the reference taxonomy minimizing a penalty score that generalizes our previous mapping based on the Fmeasure. Our algorithm is both fast and versatile, allowing a finegrained assignment of reads closer to the LCA or the species depending on the value of a single parameter q. This parameter can be specified to have any value between 0 and 1, where setting q = 0 implies that each ambiguous read has an optimal assignment to a leaf, q = 1 always assigns to the LCA level, and q = 0.5 optimizes a combination of precision and recall. The use of this parameter provides the biologist with an intuitive tool to determine how to assign ambiguous reads, and results on six metagenomic datasets show the usefulness of our approach. The use of information on the quality of the sequencing reads results in a decrease in the number of unassigned reads but increases the number of ambiguous reads, thus making the assignment of such reads even more relevant. A method to validate our assignment algorithm is introduced and results for a set of artificial datasets are presented. Finally we discuss possible causes for the large proportion of ambiguous reads observed in these datasets.
Methods
Materials
We have initially studied six bacterial communities represented by 454 sequencing tags amplified from different 16S rRNA variable regions: a marine environment (V6 region) [7], the human gut (V3 and V6 regions) [20], the gut of lean and obese twins (V2 and V6 regions) [22], chicken gut (V6 region) [46], and rat gut (V4 region) [47]. The samples were between 50 and 329 bp in length and, for each of these communities, our algorithm assigned all the ambiguous sequencing reads at the best possible taxonomic rank, utilizing a reference bacterial taxonomy of 5,165 nearfulllength type cultures of high quality [39], ranging in length between 1,202 and 1,780 bp, with a uniform scheme of seven taxonomic ranks (domain, phylum, class, order, family, genus, species). The taxonomy covers the whole spectrum of known bacteria, and the dominant phyla are Proteobacteria (1,925 species), Actinobacteria (1,285), Firmicutes (1,178), Bacteroidetes (355), and Tenericutes (160 species).
To test the effect of sequencing errors in the sequencing reads, we have also studied a dataset obtained from a bacterial community in the Priest Pot Lake [48], which included the quality scores for each read. Two taxonomies were used for this experiment, one based on the 5,165 highquality type cultures only and the other one using all 322,864 16S rRNA sequences found in the Ribosomal Database Project [39].
Validation of our assignment algorithm was performed using artificial datasets generated with MetaSim [49], as follows. A first dataset was created importing 5,148 16S rRNA sequences from the taxonomy into MetaSim, and creating a dataset of short sequencing reads with the following parameters: 454 error model; 5,000,000 of reads per run; normal DNA clone size distribution with mean 500 and standard deviation 20; and expected read length 100, 150, and 200. Reads of less than 75% the expected length were discarded. A second dataset was created by extracting first 300 base pairs roughly corresponding to hypervariable regions V1 and V2 in each of the 5,148 rRNA sequences, and then importing those subsequences into MetaSim to generate a new set of short reads using the same set of parameters as before.
Taxonomic Assignment Method
In this section, we introduce a new method for accurately assigning a sequencing read R_{ i } to a single node in a fixed reference taxonomy tree T with a leaf set L. We assume that each leaf in L has an associated known sequence. The input is a set R of sequencing reads and a positive integer k. For each R_{ i } ∈ R, there is a subset M_{ i } ⊆ L of leaves whose sequences contain a substring with at most k mismatches to R_{ i } ; these leaves are referred to as hits or matches below. The goal is to output, for each R_{ i } ∈ R with M_{ i }  ≥ 1, one node in T which represents all of M_{ i } in a "good" way.
For any R_{ i } ∈ R, if M_{ i } = 1 then R_{ i } can be trivially assigned to a unique leaf. However, if M_{ i } ≥ 2 then R_{ i } is called an ambiguous read and it is not immediately obvious how to optimally assign Ri to one node in T.
 1.
Apply a read mapping tool, such as GEM [50] for instance, to R to compute the set of hits M_{ i } for every R_{ i } ∈ R.
 2.
Let the user specify a value in the interval [0, 1] for the parameter q.
 3.
For each R_{ i } ∈ R:
 (a)
If M _{ i } = 0 then output null.
 (b)
If M _{ i } = 1 then output the leaf in M_{ i } .
 (c)
Else, output all nodes j of T that have the smallest possible penalty score PS _{i,j}with respect to q.
In the following sections we give the formal definition of the penalty score PS_{ i,j } and study some of its properties. Then, we consider how to implement Step 3c of our method efficiently, that is, how to compute the PS_{ i,j } values quickly.
Definition of the Penalty Score PS_{ i,j }
Let T be a (fixed) rooted tree with a leaf set L, let M_{ i } ⊆ L, and let q be a real number in the interval 0[1].
We need some additional notation. Let Ti be the subtree of T that is rooted at the LCA of M_{ i } . For every node j in T_{ i } , define:

T_{ i,j }= The subtree of tree T_{ i }rooted at node j.

True positives: TP_{ i,j }= Leaves in T_{ i,j }that belong to M_{ i }.

False positives: FP_{ i,j }= Leaves in T_{ i,j }that do not belong to M_{ i }.

True negatives: TN_{ i,j }= Leaves in T_{ i }\T_{ i,j }that do not belong to M_{ i }.

False negatives: FN_{ i,j }= Leaves in T_{ i }\T_{ i,j }that belong to M_{ i }.
For every node j of T that does not belong to T_{ i } , we define PS_{ i,j } = ∞. In case TP_{ i,j }  = 0 then we also define PS_{ i,j } = ∞.
Different Values of q
Recall that our method for taxonomic assignment assigns each ambiguous read R_{ i } to a node j that minimizes the value of PS_{ i,j } for the particular value of q specified by the user. We now study how varying the value of q affects the resulting taxonomic assignments.
First, it is easy to see that selecting q = 0 implies that a read R_{ i } may have several different optimal assignments, but there always exists an optimal assignment of R_{ i } to a leaf in T_{ i } since then FP_{ i,j }  (and hence, PS_{ i,j } ) will be zero. On the other hand, q = 1 always assigns each R_{ i } to the unique LCA of M_{ i } because this gives FN_{ i,j }  = 0 and PS_{ i,j } = 0. Thus, the special case q = 1 corresponds to the currently commonly used methods for assigning ambiguous reads [39–42].
Furthermore, we observe that PS_{ i,j } is a generalization of the mapping based on the Fmeasure that we previously introduced in [38]. If the precision of classifying read R_{ i } into T_{ j } is P_{ i,j } = TP_{ i,j }/(TP_{ i,j }  + FP_{ i,j } ) and the recall is R_{ i,j } = TP_{ i,j }/(TP_{ i,j }  + FN_{ i,j } ), then the Fmeasure is F_{ i,j } = 2P_{ i,j }R_{ i,j }/(P_{ i,j } + R_{ i,j } ) = 2TP_{ i,j }/(FN_{ i,j }  + FP_{ i,j }  + 2TP_{ i,j } )). This yields:
Lemma 1. Any node m that minimizes the penalty score for q = 0.5 also maximizes the Fmeasure.
To summarize, the parameter q directly influences where in the reference taxonomy ambiguous reads will be assigned to. The user can adjust q to obtain representatives for ambiguous reads at the leaf level (q = 0), the LCA level (q = 1), or somewhere inbetween (0 < q < 1). Interestingly, q = 0.5 is equivalent to maximizing the Fmeasure, which optimizes a combination of precision and recall. The distribution of taxonomic ranks resulting from setting various values of q in [0, 1] is further investigated for some real datasets in the "Results" Section.
Computation of the Penalty Scores PS_{i,j}
Here, we focus on how to compute the penalty scores PS_{ i,j } in Step 3c of our method efficiently. For any tree T, let T denote the number of nodes in T. As before, let M_{ i } be a set of hits in the reference taxonomy tree T and let T_{ i } be the subtree of T that is rooted at the LCA of M_{ i } . We may assume that M_{ i } ≥ 2. Below, we first describe a simple method to obtain PS_{ i,j } for every node j in T_{ i } in O(T_{ i } ) total time (Theorem 1). Then, we show that if O(T_{ j } ) time preprocessing of T is allowed, we can reduce the time complexity to obtain PS_{ i,j } for every node j in T_{ i } in O(M_{ i } ) total time (Theorem 2). (The preprocessing of T will be done once, before any other computations in our taxonomic assignment method.) This modification gives a significant speedup in case R contains many reads that induce small sets of hits whose LCA are located at high taxonomic ranks in T.
For every node j in T_{ i } , define T_{ i,j } as the subtree of tree T_{ i } rooted at j. The set of all leaves in T_{ i } is denoted by L_{ i } , and N_{ i } is the set of all leaves in T_{ i } that do not belong to M_{ i } (hence, L_{ i } = M_{ i } ∪ N_{ i } ). Similarly, the set of all leaves in T_{ i,j } that belong to M_{ i } is denoted by M_{ i, j } , N_{ i,j } is the set of all leaves in T_{ i,j } that do not belong to M_{ i, j } , and L_{ i,j } = M_{ i,j } ∪ N_{ i, j } . Using this notation, we can write the previously defined TP_{ i, j } , FP_{ i, j } , TN_{ i, j } , and FN_{ i,j } as:

True positives: TP_{ i,j }= M_{ i, j }

False positives: FP_{ i,j }= N_{ i, j }

True negatives: TN_{ i,j }= N_{ i } \N_{ i, j }

False negatives: FN_{ i,j }= M_{ i } \M_{ i, j }
Since M_{ i } is given, the value of M_{ i }  is fixed. For any node j in T_{ i } , the values of M_{ i, j }  and N_{ i, j }  may be expressed recursively as follows:

If j is a leaf in T_{ i }and j ∉ M_{ i }: Then M_{ i, j } = 1, N_{ i, j } = 0, and L_{ i, j } = 1.

If j is a leaf in T_{ i }and j ∉ M_{ i }: Then M_{ i, j } = 0, N_{ i, j } = 1, and L_{ i, j } = 1.

If j is an internal node in T_{ i }: Then M_{ i,j } = ∑_{ j' }M_{ i,j' } and L_{ i,j } = ∑_{ j' }L_{ i,j' }, where j' ranges over the children of j in T_{ i }, and N_{ i, j } = L_{ i, j }  M_{ i, j }.
Hence, the values of PS_{ i,j } for all nodes in T_{ i } can be obtained by two traversals of T_{ i } : a (partial) bottomup traversal [51, 52] to identify the root of the subtree T_{ i } of T (start at the leaves belonging to M_{ i } and end when a node that is an ancestor of all leaves from M_{ i } is reached; which can be determined by storing, for each node, the number of descendent leaves from M_{ i } , because the first node in the bottomup traversal that is an ancestor of all leaves from M_{ i } has exactly M_{ i } descendent leaves from M_{ i } ) followed by a topdown traversal to identify the subtree T_{ i } of T while computing M_{ i, j } , N_{ i, j } , L_{ i, j } , and PS_{ i,j } for all nodes in T_{ i } by applying the above relations. There are O(T_{ i } ) nodes in T_{ i } , and so we have:
Theorem 1. We can find a node j in T that minimizes the value of PS_{ i,j } for any M_{ i } ⊆ L in O(T_{ i } ) time.
Next, we present an alternative method that improves the time complexity stated in Theorem 1 if preprocessing of the reference taxonomy tree T is allowed.
We start by explaining how to preprocess T. Fix an arbitrary lefttoright ordering of the nodes in T and perform a lefttoright postorder traversal of T in O(T) time while enumerating the nodes from 1 to T in accordance with the order in which they are first visited. Associate each node j with its number and, moreover, keep track of the smallest numbered leaf in the subtree rooted at j and denote it by m(j). Subsequently, for any two nodes j, j' in T, it holds that j is a proper ancestor of j' if and only if m(j) ≤ m(j') ≤ j' < j, and this condition can be checked in O(1) time. (The intervals [m(j), j] induced by nodes in T therefore exhibit a nested structure that will be utilized below.) Next, apply the O(T)time preprocessing of [53, 54] to T so that the LCA of any pair of specified leaves from T can be obtained in O(1) time, unless the height of T is bounded by a constant (usual taxonomical classifications as kingdomphylumclassorderfamilygenusspecies have height 8, and the NCBI taxonomy [55] has a few more levels to account for finer distinctions), in which case the LCA of any pair of specified leaves from T can readily be obtained in O(1) time, without any preprocessing [52]. Lastly, do a O(T)time bottomup traversal of T to compute and store the number of leaves L_{ i } in the subtree rooted at each node i in T .
Now, suppose the preprocessing has been taken care of and we are given a set M_{ i } ⊆ L of hits. Any node j in T_{ i } is called relevant if it is equal to a leaf in M_{ i } or equal to the LCA of two or more leaves in M_{ i } . We have:
Lemma 2. For each node j in T_{ i } , there exists a relevant node j' such that PS_{ i, j' } ≤ PS_{ i, j } .
Proof. Suppose that j is a node in T_{ i } that is not relevant. Let j' be the LCA of the leaves in M_{ i, j } . Clearly, j' is relevant and, furthermore, M_{ i, j } = M_{ i, j' } while N_{ i, j } > N_{ i, j' } since T_{ i, j' } is a subtree of T_{ i, j } . It follows that $P{S}_{i,{j}^{\prime}}P{S}_{i,j}=(1q)\cdot \frac{\left{N}_{i,{j}^{\prime}}\right}{\left{M}_{i,{j}^{\prime}}\right}(1q)\cdot \frac{\left{N}_{i,j}\right}{\left{M}_{i,j}\right}=(1q)\cdot \frac{\left{N}_{i,{j}^{\prime}}\right\left{N}_{i,j}\right}{\left{M}_{i,j}\right}\le 0$.
Lemma 2 implies that PS_{ i,j } only needs to be computed for nodes in T_{ i } that are relevant. Define the topological restriction of T_{ i } to M_{ i } , denoted by T_{ i }  M_{ i } , as the tree obtained by deleting from T_{ i } all nodes that are not on a path from the root to a leaf in M_{ i } along with their incident edges, and then contracting every edge between a node having just one child and its child. Then, the nodes of T_{ i }  M_{ i } are precisely the relevant nodes in T_{ i } . Observe that T_{ i }  M_{ i } contains O(M_{ i } ) nodes.
To construct T_{ i }  M_{ i } for any specified M_{ i } ⊆ L in O(M_{ i } ) time, proceed as follows. Sort the leaves in M_{ i } in O(M_{ i } ) time according to their lefttoright postordering numbers by a radix sort and write ${M}_{i}=\{{\ell}_{1},{\ell}_{2},\dots ,{\ell}_{\left{M}_{i}\right}\}$ with ${\ell}_{1}<{\ell}_{2}<\cdots <{\ell}_{\left{M}_{i}\right}$. For x ∈ {1, 2, ..., M_{ i } , perform an O(1)time LCA query on the pair (ℓ_{ x }, ℓ_{x+1}) and let k_{ x } be the answer. The set $U={M}_{i}\int \{{k}_{1},{k}_{2},\dots ,{k}_{\left{M}_{i}\right1}\}$ then gives the set of nodes in T_{ i }  M_{ i } . To obtain the edges of T_{ i }  M_{ i } , first use O(M_{ i } ) time to perform a radix sort on the set of ordered pairs {(m(j), j): j ∈ U} in nondecreasing order for the first coordinate and decreasing order for the second coordinate so that in the resulting ordering, for any j, j'∈ U, it holds that (m(j), j) < (m(j'), j') if and only if either (1) m(j) < m(j'), or (2) m(j) = m(j') and j > j'. Thus, whenever a node j is a proper ancestor of a node j', the pair (m(j), j) appears somewhere before (m(j'), j') in the sorted list. Then, it is straightforward to recover the edges of T_{ i }  M_{ i } in O(M_{ i } ) time by traversing the sorted list of pairs while using a stack to store all proper ancestors of the currently considered node (recall that it takes O(1) time to check the condition m(j) ≤ m(j') ≤ j' < j for any node j' in the list and any element j on the top of the stack).
Finally, the values of PS_{ i,j } for all relevant nodes can be obtained by a bottomup traversal of T_{ i }  M_{ i } . There are O(M_{ i } ) relevant nodes, and so we can compute the values of PS_{ i,j } for all relevant nodes j in Step 3c according to formula (2) using O(M_{ i } ) time. To do this, note that if j is an internal node in T_{ i }  M_{ i } then M_{ i } , j = ∑ _{ j' } M_{ i }, j', where j' ranges over the children of j in T_{ i }  M_{ i } , and N_{ i } ,j = L_{ i } ,j  M_{ i } ,j, where L_{ i } ,j = L_{ j }  has been precomputed. In total:
Theorem 2. After O(T) time preprocessing, we can find a node j in T that minimizes the value of PS_{ i,j } for any M_{ i } ⊆ L in O(M_{ i } ) time.
Validation: Performance in ROC Space
Each read found in a metagenomic dataset must have originated from a unique original 16S rRNA sequence but, due to sequencing errors and incomplete taxonomic information, a significant percentage of the reads end up being assigned at higher taxonomic levels. Using an artificial metagenomic dataset, we can know a priori the original sequence and therefore measure how accurately our algorithm classifies ambiguous reads. We used MetaSim to generate an artificial set of sequencing reads R with a 454 error model, and where each read R_{ i } is derived from a randomly selected fulllength 16S rRNA gene sequence annotated in the taxonomy, denoted by H_{ i } . Because of the errors introduced in R_{ i } by the simulation, a search for the most similar fulllength sequences to the read produces a set of hits, M_{ i } , among which the true hit is usually found. The tree T_{ i } rooted at the LCA of M_{ i } can therefore include three kinds of leaves: the true hit H_{ i } , not true but ambiguous hits M_{ i } \{H_{ i } }, and false hits L_{ i } \M_{ i } = N_{ i } .
When using our qassignment schema, the sets M_{ i } , N_{ i } , M_{ i,j } , and N_{ i,j } are defined with respect to the set of plausible hits but without knowledge of the true hit H_{ i } , as shown in Figure 1. Our objective here is to measure how different values of q perform in including H_{ i } among the selected leaves. Assignments to the LCA will in most cases include H_{ i } but the precision will be very poor if the size of T_{ i } is large, while lower values of q can increase the precision at the risk of excluding H_{ i } .
A common measure of performance for binary classifiers is the area under the ROC curve [56]. For a given read R_{ i } and a particular value of q, let us define the true positive rate with respect to the true hit H_{ i } as $TP{R}_{{H}_{i}}=\leftT{P}_{{H}_{i}}\right/(T{P}_{{H}_{i}}+F{N}_{{H}_{i}})$ when H_{ i } ∈ T_{ i } and 0 otherwise (if H_{ i } ∉ T_{ i } both $T{P}_{{H}_{i}}$ and $F{N}_{{H}_{i}}$ would be empty). Notice that when previously calculating the assignment we used the sets TP, FP, TN, and FN with respect to M_{ i }, while here we calculate $T{P}_{{H}_{i}},F{P}_{{H}_{i}},T{N}_{{H}_{i}}$, and $F{N}_{{H}_{i}}$ taking into account H_{ i } only. In a similar way we define $FP{R}_{{H}_{i}}=\leftF{P}_{{H}_{i}}\right/(F{P}_{{H}_{i}}+T{N}_{{H}_{i}})$. However, $TP{R}_{{H}_{i}}$ can only be 1 (when H_{ i } is in the subtree rooted at the node to which R_{ i } was assigned) or 0 (when H_{ i } is not in the subtree) and therefore, plotting TPR versus FPR would result in degenerated ROC curves.
We need to define $T{P}_{{H}_{i}},F{P}_{{H}_{i}},T{N}_{{H}_{i}},F{N}_{{H}_{i}}$ as sets of leaves. That is, $\leftT{P}_{{H}_{i}}\right=1$ if H_{ i } ∈ T_{ i } , and $\leftT{P}_{{H}_{i}}\right=0$ otherwise. Then, $\leftT{P}_{{H}_{i}}\right=\left\{{H}_{i}\right\}$ if H_{ i } ∈ T_{ i } , and $T{P}_{{H}_{i}}=\varnothing $ otherwise.
We will call this measure of performance the expected distance metric. The value of q (and the corresponding node) that maximizes the expected distance for R_{ i } is chosen as the most appropriate if the distance is positive, otherwise the assignment to the LCA is preferred. It can be easily seen that assignments to the LCA when the true hit H_{ i } is among its leaves have expected distance 0, since M_{ i } ,j = M_{ i } . Lemma 3 shows that the true distance for assignments to the LCA is always zero and, therefore, such assignments have no predictive power.
Lemma 3. Assignments to the LCA have no predictive power when the true hit H_{ i }is among its leaves.
Proof. Since the true hit H_{ i } is among the leaves of the subtree rooted at the LCA, the $TP{R}_{{H}_{i}}$ is 1. The $FP{R}_{{H}_{i}}$ is $\leftF{P}_{{H}_{i}}\right/(F{P}_{{H}_{i}}+T{N}_{{H}_{i}})$ and, since assigning to the LCA selects all possible leaves, $T{N}_{{H}_{i}}=\varnothing $ and $FP{R}_{{H}_{i}}=1$. Therefore, $TP{R}_{{H}_{i}}$ is equal to $FP{R}_{{H}_{i}}$ and the point representing such assignment in ROC space lies on the main diagonal, thus having no predictive power.
Results
A suffix array was constructed for the 5,165 reference sequences in the bacterial taxonomy, and each of the sequencing reads was mapped to these sequences using the GEMdoindex and GEMmapper tools [50]. GEMdoindex constructs a suffix array from the set of fulllength 16S rRNA sequences using the BurrowsWheeler Transform [57]. Once the sequences have been efficiently indexed, GEMmapper finds the closest sequences in the suffix array for each of the short sequencing reads in a metagenomic dataset.
Performance of GEM and BLAST
dataset  GEMmapper  BLAST  

no hits  1 hit  ≥ 2 hits  no hits  1 hit  ≥ 2 hits  
marine  194,015  4,655  23,621  66,493  8,741  147,057 
human  527,727  334,521  91,335  31,881  812,392  109,310 
twins V2  990,094  128,649  776  89  1,068,762  50,668 
twins V6  523,161  199,782  94,999  36,603  648,975  132,364 
chicken  10,442  7,140  4,395  1,548  13,084  7,345 
Rat  273,114  27,226  31,509  2  287,971  43,876 
Although BLAST hits a larger number of sequencing reads, those reads assigned to one or more species using GEM show a more significative BLAST average evalue than reads with no hits (data not shown). GEM provides a more conservative mapping, discarding those reads that get assigned with lower significance. Allowing for more mismatches with GEM results in a higher number of assigned reads with a higher percentage of ambiguous ones, at the cost of a lower average evalue of the assigned reads (data not shown). The results discussed in this paper, using GEM with up to 2 mismatches, should therefore be considered a conservative estimate.
Sequencing Error Bias
Priest Pot Lake sample: Assignment
Priest Pot Lake environmental samples  reference microbial taxonomy  

5,165 type cultures  322,864 sequences  
no hits  1 hit  ≥ 2 hits  no hits  1 hit  ≥ 2 hits  
FASTA  26,458  642  1,261  19,715  991  7,655 
FASTQ  26,045  769  1,547  19,182  1,213  7,966 
Priest Pot Lake sample: Taxonomic Distribution
leaves  Fmeasure  LCA  

rank  0.0  0.1  0.2  0.3  0.4  0.5  0.6  0.7  0.8  0.9  1.0 
domain  0  0  0  0  0  0  0  0  0  0  3 
phylum  0  0  0  0  0  0  0  0  0  0  0 
class  0  0  0  0  0  0  0  0  0  0  4 
order  0  0  0  0  0  1  1  1  1  2  366 
family  0  0  1  5  20  47  105  204  232  242  345 
genus  0  190  424  455  467  445  561  754  733  727  543 
species  1,261  1,071  836  801  774  768  594  302  295  290  0 
leaves  F measure  LCA  
rank  0.0  0.1  0.2  0.3  0.4  0.5  0.6  0.7  0.8  0.9  1.0 
domain  0  0  0  0  0  0  0  0  0  0  27 
phylum  0  0  0  0  0  0  0  0  0  0  0 
Class  0  0  0  0  0  0  0  0  0  0  15 
order  0  0  0  0  1  2  2  2  3  7  419 
family  0  2  7  19  43  75  136  266  315  347  393 
genus  0  290  529  561  587  568  689  938  902  892  693 
species  1,547  1,255  1,011  967  916  902  720  341  327  301  0 
Assignment Performance
To validate our assignment algorithm we generated six artificial metagenomic datasets using MetaSim, with read lengths 100, 150, and 200 bp for sequences extracted from the whole 16S rRNA sequence or from the V1V2 hypervariable region only. Out of the original 5,000,000 reads, there were 195,580 (100 bp), 36,462 (150 bp), and 7,637 (200 bp) ambiguous reads when using the whole 16S sequence; and 123,486 (100 bp), 13,147 (150 bp), and 100 (200 bp) ambiguous reads when using the V1V2 region.
Validation of Results: Gq
metric  length  ∑ D_{ i }  0.0  0.1  0.2  0.3  0.4  0.5  0.6  0.7  0.8  0.9  1.0 

G_{ q } [16S]  100  0.096  0.42  0.13  0.06  0.01  0.01  0.03  0.05  0.07  0.08  0.09  0.00 
150  0.048  0.32  0.14  0.09  0.05  0.02  0.00  0.01  0.02  0.03  0.04  0.00  
200  0.028  0.24  0.13  0.09  0.06  0.04  0.02  0.01  0.00  0.01  0.03  0.00  
G _{ q } [V1V2]  100  0.036  0.23  0.12  0.08  0.04  0.03  0.01  0.00  0.01  0.02  0.03  0.00 
150  0.015  0.16  0.11  0.08  0.05  0.04  0.02  0.01  0.00  0.00  0.01  0.00  
200  0.005  0.09  0.05  0.01  0.00  0.00  0.00  0.00  0.00  0.00  0.00  0.00 
Validation of Results: Assignments.
metric  length  ∑ D _{ i }  0.0  0.1  0.2  0.3  0.4  0.5  0.6  0.7  0.8  0.9  1.0 

E(D_{ i }) [16S]  100  0.125  2.3%  3.9%  4.5%  5.1%  5.0%  5.4%  5.7%  6.2%  7.0%  9.6%  45.0% 
150  0.080  3.5%  4.5%  4.9%  5.4%  4.9%  5.2%  5.2%  5.2%  5.2%  5.4%  50.0%  
200  0.070  4.3%  4.8%  5.1%  5.5%  4.8%  5.2%  5.1%  4.8%  4.4%  4.1%  51.4%  
E(D_{ i }) [V1V2]  100  0.077  4.6%  5.2%  5.6%  5.9%  5.3%  5.5%  5.3%  5.0%  4.9%  5.0%  47.1% 
150  0.056  5.7%  6.0%  6.1%  6.3%  5.5%  5.7%  5.5%  4.7%  4.1%  3.4%  46.5%  
200  0.023  7.1%  7.3%  7.3%  7.4%  6.2%  6.2%  5.4%  4.5%  4.0%  3.0%  41.0% 
Validation of Results: Precision and Recall.
full 16S rRNA  V1V2 region  

100 bp  150 bp  200 bp  100 bp  150 bp  200 bp  
q  p  r  p  r  p  r  p  r  p  r  p  r 
0.0  0.1827  0.1827  0.2503  0.2503  0.3038  0.3038  0.3085  0.3085  0.3553  0.3553  0.4021  0.4021 
0.1  0.1820  0.4416  0.2480  0.4296  0.3003  0.4252  0.3059  0.4246  0.3530  0.4194  0.4085  0.4536 
0.2  0.1791  0.5165  0.2448  0.4920  0.2954  0.4793  0.3026  0.4819  0.3502  0.4644  0.4119  0.4948 
0.3  0.1742  0.5773  0.2401  0.5551  0.2863  0.5367  0.2960  0.5319  0.3453  0.5071  0.4012  0.5464 
0.4  0.1677  0.6343  0.2314  0.6205  0.2752  0.5996  0.2873  0.5924  0.3394  0.5688  0.3741  0.6020 
0.5  0.1633  0.6653  0.2262  0.6500  0.2707  0.6322  0.2816  0.6205  0.3326  0.5939  0.3558  0.6224 
0.6  0.1548  0.7054  0.2147  0.6938  0.2586  0.6779  0.2687  0.6666  0.3198  0.6417  0.3427  0.6633 
0.7  0.1436  0.7483  0.2001  0.7393  0.2399  0.7295  0.2476  0.7156  0.2924  0.7000  0.3343  0.7143 
0.8  0.1284  0.7941  0.1767  0.7898  0.2123  0.7909  0.2189  0.7718  0.2571  0.7620  0.3108  0.7551 
0.9  0.1081  0.8519  0.1465  0.8506  0.1735  0.8544  0.1815  0.8383  0.2146  0.8366  0.2480  0.8367 
1.0  0.0532  0.9628  0.0719  0.9700  0.0818  0.9788  0.0807  0.9726  0.0893  0.9788  0.1084  0.9700 
Discussion
Comparison of results between GEM and BLAST show that, although BLAST can map more reads, there is still a large number of reads that either cannot be assigned to any species in the taxonomy, or can be assigned to more than one species. GEM provides a more conservative assignment, with assigned reads having a more significant evalue in BLAST. The combined speed of GEM in assigning species to each read and of our algorithm in mapping ambiguous reads to the taxonomic rank minimizing the penalty score provides a useful tool to quickly test hypotheses about microbial communities.
Ambiguous reads are assigned to different taxonomic ranks depending on the value of q, as shown in Figure 5 Figure 6 and Table 3. As the value of q increases, more reads get assigned at higher taxonomic ranks, with clearly different distributions between the extreme values q = 0 and q = 1. Ambiguous and unassigned reads could either belong to species not present in the taxonomy or be artifacts due to errors in the experimental process. Bacterial taxonomies are biased towards cultivable species, but the human gut and oceanic environments are known to harbor many rare, uncultivable bacteria [7, 20]. Even if a large number of reads come from unknown species, most of them have a small number of hits (as seen in Figure 3) and would only introduce a moderate amount of error. Reads with a large number of hits, such as some of the reads coming from the twins V2 region dataset, might be chimeric sequences product of the PCR amplification step [60], or reads belonging to species from yet to be identified taxonomic groups. Reads not uniquely mapped can also be caused by sequencing errors, most commonly homopolymer indels when using 454 sequencing [61]. We would expect to observe differences in the distributions of homopolymers between the sets of ambiguous and unambiguous reads, but we could not find a significantly higher number of homopolymers for any of these sets across all our datasets (data not shown). Analysis of the distributions of homopolymer lengths versus the number of homopolymers per read was also inconclusive, and we could not clearly differentiate the distributions in ambiguous and unambiguous reads. A BLAST search using reads with no hits as both query and database showed that the vast majority can be aligned with high significance (often perfect matches) to other nohit reads, indicating that either the same type of sequencing error occurred frequently or that these reads cannot be mapped because the corresponding 16S rRNA sequence is not in the taxonomy. On the other hand, incorporating read quality information reduces the number of unassigned reads but increases the number of ambiguous reads more significantly than that of uniquely assigned reads (see Table 3), stressing the importance of an assignment of ambiguous reads that minimizes bias in the estimation of diversity.
Artificial datasets produced through simulations contained a lower percentage of ambiguous reads when compared to experimental datasets for similar read lengths, and most ambiguous reads were assigned at lower taxonomic ranks. The simulations using the V1V2 hypervariable region to extract short reads were expected to mimic experimental conditions more closely, but they showed even less ambiguity than simulations using the fulllength 16S rRNA sequence to obtain the short reads. The results described in Section "Assignment Performance", therefore, represent a low estimate of performance, and datasets with a higher proportion of ambiguous reads would further benefit from our assignment algorithm. Tables 4 and 5, in fact, show how simulations with a higher proportion of ambiguous reads benefit more from our taxonomic mapping algorithm. Although the sequencing error models utilized in the simulations probably differ slightly from the actual errors, we believe the increased ambiguity observed in the experimental datasets is due to a combination of several factors: sequencing errors, PCR artifacts, and incomplete taxonomic information for some of the species present in the samples. Selecting a unique q value to assign ambiguous reads based on these simulations might therefore produce biased results and, until more realistic simulations can be performed, we suggest the use of the estimated distance metric instead, which does not require an estimation of an optimal value for q. It should be noticed that, both in the q metric and in the expected distance metric, the distances are relevant to determine whether the assignment to the LCA can be outperformed, but the true measure of significance is given by the observed differences in the distribution of taxonomic ranks, as seen in Figure 5 and Figure 6.
Conclusions
In this paper, we have introduced a new method for the taxonomic assignment of ambiguous sequencing reads based on a generalization of the Fmeasure that minimizes a penalty score combining the precision and recall of the mapping. There is, to the best of our knowledge, no other taxonomic assignment method concerning precision and recall, apart of the assignment to the LCA. By using a suffix array representation of the sequences in the leaves of the taxonomy and preprocessing the taxonomy for fast search of relevant nodes, our assignment algorithm can work in time linear in the number of sequences matching a read. Our algorithm can analyze large metagenomic datasets even on a small PC. For instance, on a MacBook Pro with 8GB of memory, the analysis of the Priest Pot Lake dataset takes approximately 30 minutes for GEM to analyze (up to 7 mismatches), and another 30 minutes to assign ambiguous reads. The use of a single parameter to control whether precision or recall should be prioritized results in assignments with clearly different distributions of taxonomic ranks. The assignment strategy of sequencing reads introduced in this paper is therefore both a versatile and a quick method to study bacterial communities.
The study of six different datasets of environmental and gut samples shows that the composition and diversity of bacterial species observed in a sample can vary significantly depending on whether ambiguous or unambiguous reads are used, and on the particular value of the q parameter. Results with a dataset where read quality information is provided shows that the number of ambiguous reads increases when such information is used, making our algorithm more relevant. Validation of the assignment schema in an artificial dataset shows that a combination of different q values produces the most accurate results. The fact that a unique set of sequencing reads can produce very different distributions depending on how the large number of ambiguous reads are assigned has deep implications for metagenomic studies in general, and in particular for those trying to correlate bacterial composition with disease states. A more accurate characterization of these reads can therefore provide a better understanding of the microbial diversity around and within us.
Availability
The software and data sets are available under the GNU GPL at the supplementary material web page http://www.lsi.upc.edu/~valiente/tango/.
Declarations
Acknowledgements
JJ was supported by the Special Coordination Funds for Promoting Science and Technology (Japan). The authors would like to thank Daniel L. Hartl, Chaysavanh Manichanh, Paolo Ribeca, Roderic Guigó, and everybody at the Center for Informational Biology (Ochanomizu University) and the Laboratory for DNA Data Analysis (National Institute of Genetics) for helpful discussions.
Authors’ Affiliations
References
 Ley RE, Hamady M, Lozupone C, Turnbaugh PJ, Ramey RR, Bircher JS, Schlegel ML, Tucker TA, Schrenzel MD, Knight R, Gordon JI: Evolution of mammals and their gut microbes. Science 2008, 320(5883):1647–1651. 10.1126/science.1155725PubMed CentralView ArticlePubMedGoogle Scholar
 Dethlefsen L, McFallNgai M, Relman DA: An ecological and evolutionary perspective on humanmicrobe mutualism and disease. Nature 2007, 449(7164):811–818. 10.1038/nature06245View ArticlePubMedGoogle Scholar
 Alberts B, Johnson A, Lewis J, Raff M, Roberts K, Walter P: Molecular Biology of the Cell. 5th edition. New York, USA: Garland Science; 2008.Google Scholar
 Gray NF: Biology of Wastewater Treatment. 2nd edition. London, UK: Imperial College Press; 2004.Google Scholar
 Jeffries T, Jin YS: Metabolic engineering for improved fermentation of pentoses by yeasts. Appl Microbiol Biotechnol 2004, 63(5):495–509. 10.1007/s0025300314500View ArticlePubMedGoogle Scholar
 Venter J, Remington K, Heidelberg J, Halpern A, Rusch D, Eisen J, Wu D, Paulsen I, Nelson K, Nelson W, Fouts D, Levy S, Knap A, Lomas M, Nealson K, White O, Peterson J, Hoffman J, Parsons R, BadenTillson H, Pfannkoch C, Rogers Y, Smith H: Environmental genome shotgun sequencing of the Sargasso Sea. Science 2004, 304(5667):66–74. 10.1126/science.1093857View ArticlePubMedGoogle Scholar
 Sogin ML, Morrison HG, Huber JA, Welch DM, Huse SM, Neal PR, Arrieta JM, Herndl GJ: Microbial diversity in the deep sea and the underexplored "rare biosphere". Proc Natl Acad Sci USA 2006, 103(32):12115–12120. 10.1073/pnas.0605127103PubMed CentralView ArticlePubMedGoogle Scholar
 Humbert JF, Dorigo U, Cecchi P, Berre BL, Debroas D, Bouvy M: Comparison of the structure and composition of bacterial communities from temperate and tropical freshwater ecosystems. Environ Microbiol 2009, 11(9):2339–2350. 10.1111/j.14622920.2009.01960.xView ArticlePubMedGoogle Scholar
 Pašić L, RodriguezMueller B, MartinCuadrado AB, Mira A, Rohwer F, RodriguezValera F: Metagenomic islands of hyperhalophiles: the case of Salinibacter ruber . BMC Genomics 2009, 10: 570.PubMed CentralView ArticlePubMedGoogle Scholar
 Kirchman DL, Cottrell MT, Lovejoy C: The structure of bacterial communities in the western Arctic Ocean as revealed by pyrosequencing of 16S rRNA genes. Environ Microbiol 2010, 12(5):1132–1143. 10.1111/j.14622920.2010.02154.xView ArticlePubMedGoogle Scholar
 Revetta RP, Pemberton A, Lamendella R, Iker B, Domingo JWS: Identification of bacterial populations in drinking water using 16S rRNAbased sequence analyses. Water Res 2010, 44(5):1353–1360. 10.1016/j.watres.2009.11.008View ArticlePubMedGoogle Scholar
 Martín HG, Ivanova N, Kunin V, Warnecke F, Barry KW, McHardy AC, Yeates C, He S, Salamov AA, Szeto E, Dalin E, Putnam NH, Shapiro HJ, Pangilinan JL, Rigoutsos I, Kyrpides NC, Blackall LL, McMahon KD, Hugenholtz P: Metagenomic analysis of two enhanced biological phosphorus removal (EBPR) sludge communities. Nat Biotechnol 2006, 24(10):1263–1269.View ArticleGoogle Scholar
 Schloss PD, Handelsman J: Toward a Census of Bacteria in Soil. PLoS Comput Biol 2006, 2(7):e92. 10.1371/journal.pcbi.0020092PubMed CentralView ArticlePubMedGoogle Scholar
 Tarlera S, Jangid K, Ivester AH, Whitman WB, Williams MA: Microbial community succession and bacterial diversity in soils during 77 000 years of ecosystem development. FEMS Microbiol Ecol 2008, 64: 129–140. 10.1111/j.15746941.2008.00444.xView ArticlePubMedGoogle Scholar
 Fierer N, Carney KM, HornerDevine MC, Megonigal JP: The Biogeography of AmmoniaOxidizing Bacterial Communities in Soil. Microb Ecol 2008, 58(2):435–445. 10.1007/s0024800995179View ArticleGoogle Scholar
 Hao DC, Ge GB, Yang L: Bacterial diversity of Taxus rhizosphere: cultureindependent and culturedependent approaches. FEMS Microbiol Lett 2008, 284(2):204–212. 10.1111/j.15746968.2008.01201.xView ArticleGoogle Scholar
 Chu H, Fierer N, Lauber CL, Caporaso JG, Knight R, Grogan P: Soil bacterial diversity in the Arctic is not fundamentally different from that found in other biomes. Environ Microbiol 2010, 12(11):2998–3006. 10.1111/j.14622920.2010.02277.xView ArticlePubMedGoogle Scholar
 Eckburg PB, Bik EM, Bernstein CN, Purdom E, Dethlefsen L, Sargent M, Gill SR, Nelson KE, Relman DA: Diversity of the human intestinal microbial flora. Science 2005, 308(5728):1635–1638. 10.1126/science.1110591PubMed CentralView ArticlePubMedGoogle Scholar
 Aas JA, Griffen AL, Dardis SR, Lee AM, Olsen I, Dewhirst FE, Leys EJ, Paster BJ: Bacteria of dental caries in primary and permanent teeth in children and young adults. J Clin Microbiol 2008, 46(4):1407–1417. 10.1128/JCM.0141007PubMed CentralView ArticlePubMedGoogle Scholar
 Dethlefsen L, Huse SM, Sogin ML, Relman DA: The Pervasive Effects of an Antibiotic on the Human Gut Microbiota, as Revealed by Deep 16S rRNA Sequencing. PLoS Biol 2008, 6(11):e280. 10.1371/journal.pbio.0060280PubMed CentralView ArticlePubMedGoogle Scholar
 Costello EK, Lauber CL, Hamady M, Fierer N, Gordon JI, Knight R: Bacterial Community Variation in Human Body Habitats Across Space and Time. Science 2009, 326(5960):1694–1697. 10.1126/science.1177486PubMed CentralView ArticlePubMedGoogle Scholar
 Turnbaugh PJ, Hamady M, Yatsunenko T, Cantarel BL, Duncan A, Ley RE, Sogin ML, Jones WJ, Roe BA, Affourtit JP, Egholm M, Henrissat B, Heath AC, Knight R, Gordon JI: A core gut microbiome in obese and lean twins. Nature 2009, 457(7228):480–484. 10.1038/nature07540PubMed CentralView ArticlePubMedGoogle Scholar
 Fierer N, Lauber CL, Zhou N, McDonald D, Costello EK, Knight R: Forensic Identification using skin bacterial communities. Proc Natl Acad Sci USA 2010, 107(14):6477–6481. 10.1073/pnas.1000162107PubMed CentralView ArticlePubMedGoogle Scholar
 Lambais MR, Crowley DE, Cury JC, Büll RC, Rodrigues RR: Bacterial Diversity in Tree Canopies of the Atlantic Forest. Science 2006, 312(5782):1917. 10.1126/science.1124696View ArticlePubMedGoogle Scholar
 Leveau JHJ: The magic and menace of metagenomics: prospects for the study of plant growthpromoting rhizobacteria. Eur J Plant Pathol 2007, 119(3):279–300. 10.1007/s1065800791869View ArticleGoogle Scholar
 Sun L, Qiu F, Zhang X, Dai X, Dong X, Song W: Endophytic Bacterial Diversity in Rice ( Oryza sativa L.) Roots Estimated by 16S rDNA Sequence Analysis. Microb Ecol 2008, 55(3):415–424. 10.1007/s0024800792871View ArticlePubMedGoogle Scholar
 Wang HX, Geng ZL, Zeng Y, Shen YM: Enriching plant microbiota for a metagenomic library construction. Environ Microbiol 2010, 10(10):2684–2691. 10.1111/j.14622920.2008.01689.xView ArticleGoogle Scholar
 Adams IP, Glover RH, Monger WA, Mumford R, Jackeviciene E, Navalinskiene M, Samuitiene M, Boonham N: Nextgeneration sequencing and metagenomic analysis: a universal diagnostic tool in plant virology. Mol Plant Pathol 2009, 10(10):2684–2691.Google Scholar
 Redford AJ, Bowers RM, Knight R, Linhart Y, Fierer N: The ecology of the phyllosphere: geographic and phylogenetic variability in the distribution of bacteria on tree leaves. Environ Microbiol 2010, 12(11):2885–2893. 10.1111/j.14622920.2010.02258.xPubMed CentralView ArticlePubMedGoogle Scholar
 Shendure J, Ji H: Nextgeneration DNA sequencing. Nat Biotechnol 2008, 26(10):1135–1145. 10.1038/nbt1486View ArticlePubMedGoogle Scholar
 Lozupone C, Knight R: UniFrac: A new phylogenetic method for comparing microbial communities. Appl Environ Microbiol 2005, 71(12):8228–8235. 10.1128/AEM.71.12.82288235.2005PubMed CentralView ArticlePubMedGoogle Scholar
 Schloss PD, Handelsman J: A statistical toolbox for metagenomics: Assessing functional diversity in microbial communities. BMC Bioinformatics 2008, 9: 34. 10.1186/14712105934PubMed CentralView ArticlePubMedGoogle Scholar
 Singleton D, Furlong M, Rathbun S, Whitman W: Quantitative comparisons of 16S rRNA gene sequence libraries from environmental samples. Appl Environ Microbiol 2001, 67(9):4374–4376. 10.1128/AEM.67.9.43744376.2001PubMed CentralView ArticlePubMedGoogle Scholar
 Hamady M, Knight R: Microbial community profiling for human microbiome projects: Tools, techniques, and challenges. Genome Res 2009, 19(7):1141–1152. 10.1101/gr.085464.108PubMed CentralView ArticlePubMedGoogle Scholar
 Liu Z, Lozupone C, Hamady M, Bushman FD, Knight R: Short pyrosequencing reads suffice for accurate microbial community analysis. Nucleic Acids Res 2007, 35(18):e120. 10.1093/nar/gkm541PubMed CentralView ArticlePubMedGoogle Scholar
 Manichanh C, Chapple CE, Frangeul L, Gloux K, Guigó R, Dore J: A comparison of random sequence reads versus 16S rDNA sequences for estimating the biodiversity of a metagenomic library. Nucleic Acids Res 2008, 36(16):5180–5188. 10.1093/nar/gkn496PubMed CentralView ArticlePubMedGoogle Scholar
 Dinsdale EA, Edwards RA, Hall D, Angly F, Breitbart M, Brulc JM, Furlan M, Desnues C, Haynes M, Li L, McDaniel L, Moran MA, Nelson KE, Nilsson C, Olson R, Paul J, Brito BR, Ruan Y, Swan BK, Stevens R, Valentine DL, Thurber RV, Wegley L, White BA, Rohwe F: Functional metagenomics profiling of nine biomes. Nature 2008, 452(7187):629–632. 10.1038/nature06810View ArticlePubMedGoogle Scholar
 Clemente JC, Jansson J, Valiente G: Accurate Taxonomic Assignment of Short Pyrosequencing Reads. In Proc. 15th Pacific Symposium on Biocomputing. Volume 15. World Scientific; 2010:3–9.Google Scholar
 Cole JR, Wang Q, Cardenas E, Fish J, Chai B, Farris RJ, KulamSyedMohideen AS, McGarrell DM, Marsh T, Garrity GM, Tiedje JM: The Ribosomal Database Project: Improved Alignments and New Tools for rRNA Analysis. Nucleic Acids Res 2009, 37(D):141–145. 10.1093/nar/gkn879View ArticleGoogle Scholar
 Huson DH, Auch AF, Qi J, Schuster SC: MEGAN Analysis of Metagenomic Data. Genome Res 2007, 17(3):377–386. 10.1101/gr.5969107PubMed CentralView ArticlePubMedGoogle Scholar
 Liu Z, DeSantis TZ, Andersen GL, Knight R: Accurate Taxonomy Assignments from 16S rRNA Sequences produced by Highly Parallel Pyrosequencers. Nucleic Acids Res 2008, 36(18):e120. 10.1093/nar/gkn491PubMed CentralView ArticlePubMedGoogle Scholar
 Wang Q, Garrity GM, Tiedje JM, Cole JR: Naïve Bayesian classifier for rapid assignment of rRNA sequences into the new bacterial taxonomy. Appl Environ Microbiol 2007, 73(16):5261–5267. 10.1128/AEM.0006207PubMed CentralView ArticlePubMedGoogle Scholar
 Caporaso JG, Kuczynski J, Stombaugh J, Bittinger K, Bushman FD, Costello EK, Fierer N, Peña AG, Goodrich JK, Gordon JI, Huttley GA, Kelley ST, Knights D, Koenig JE, Ley RE, Lozupone CA, McDonald D, Muegge BD, Pirrung M, Reeder J, Sevinsky JR, Turnbaugh PJ, Walters WA, Widmann J, Yatsunenko T, Zaneveld J, Knight R: QIIME allows analysis of highthroughput community sequencing data. Nat Methods 2010, 7(5):335–6. 10.1038/nmeth.f.303PubMed CentralView ArticlePubMedGoogle Scholar
 Schloss PD, Westcott SL, Ryabin T, Hall JR, Hartmann M, Hollister EB, Lesniewski RA, Oakley BB, Parks DH, Robinson CJ, Sahl JW, Stres B, Thallinger GG, Horn DJV, Weber CF: Introducing mothur: opensource, platformindependent, communitysupported software for describing and comparing microbial communities. Appl Environ Microbiol 2009, 75(23):7537–41. 10.1128/AEM.0154109PubMed CentralView ArticlePubMedGoogle Scholar
 Teeling H, Waldmann J, Lombardot T, Bauer M, Glöckner FO: TETRA: a webservice and a standalone program for the analysis and comparison of tetranucleotide usage patterns in DNA sequences. BMC Bioinformatics 2004, 5: 163. 10.1186/147121055163PubMed CentralView ArticlePubMedGoogle Scholar
 VAMPS:Visualization and Analysis of Microbial Population Structure project. 2009.[http://vamps.mbl.edu/] [AGT CKN Bv6Chicken intestinal microbiota]Google Scholar
 Manichanh C, Reeder J, Gibert P, Varela E, Llopis M, Antolin M, Guigó R, Knight R, Guarner F: Reshaping the gut microbiome with bacterial transplantation and antibiotic intake. Genome Res 2010, 20(10):1411–1419. 10.1101/gr.107987.110PubMed CentralView ArticlePubMedGoogle Scholar
 Quince C, Lanzén A, Curtis TP, Davenport RJ, Hall N, Head IM, Read LF, Sloan WT: Accurate determination of microbial diversity from 454 pyrosequencing data. Nat Methods 2009, 6(9):639–641. 10.1038/nmeth.1361View ArticlePubMedGoogle Scholar
 Richter DC, Ott F, Auch AF, Schmid R, Huson DH: MetaSim  a sequencing simulator for genomics and metagenomics. PLoS One 2008, 3(10):e3373. 10.1371/journal.pone.0003373PubMed CentralView ArticlePubMedGoogle Scholar
 Ribeca P:GEMGEnomic Multitool. 2009. [http://gemlibrary.sourceforge.net/]Google Scholar
 Valiente G: Algorithms on Trees and Graphs. Berlin, Heidelberg: Springer; 2002.View ArticleGoogle Scholar
 Valiente G: Combinatorial Pattern Matching Algorithms in Computational Biology using Perl and R. Boca Raton, London, New York: Taylor & Francis/CRC Press; 2009.View ArticleGoogle Scholar
 Bender M, FarachColton M, Pemmasani G, Skiena S, Sumazin P: Lowest common ancestors in trees and directed acyclic graphs. J Algorithms 2005, 57(2):75–94. 10.1016/j.jalgor.2005.08.001View ArticleGoogle Scholar
 Harel D, Tarjan RE: Fast algorithms for finding nearest common ancestors. SIAM J Comput 1984, 13(2):338–355. 10.1137/0213024View ArticleGoogle Scholar
 Wheeler DL, Chappey C, Lash AE, Leipe DD, Madden TL, Schuler GD, Tatusova TA, Rapp BA: Database resources of the National Center for Biotechnology Information. Nucleic Acids Res 2000, 28: 10–14. [http://www.ncbi.nlm.nih.gov/Taxonomy/] 10.1093/nar/28.1.10PubMed CentralView ArticlePubMedGoogle Scholar
 Fawcett T: An introduction to ROC analysis. Pattern Recogn Lett 2006, 27(8):861–874. 10.1016/j.patrec.2005.10.010View ArticleGoogle Scholar
 Burrows M, Wheeler D: A block sorting lossless data compression algorithm. Tech. Rep. 124, Digital Equipment Corporation 1994.Google Scholar
 Altschul SF, Gish W, Miller W, Myers EW, Lipman DJ: Basic Local Alignment Search Tool. J Mol Biol 1990, 215(3):403–410.View ArticlePubMedGoogle Scholar
 Kunin V, Engelbrektson A, Ochman H, Hugenholtz P: Wrinkes in the rare biosphere: pyrosequencing errors can lead to artificial inflation of diversity estimates. Environ Microbiol 2001, 12: 118–123. 10.1111/j.14622920.2009.02051.xView ArticleGoogle Scholar
 Pääbo S, Irwin DM, Wilson AC: DNA damage promotes jumping between templates during enzymatic amplification. J Biol Chem 1990, 265(8):4718–4721.PubMedGoogle Scholar
 Huse SM, Huber JA, Morrison hilaryG, Sogin ML, Welch DM: Accuracy and quality of massively parallel DNA pyrosequencing. Genome Biol 2007, 8(7):R143. 10.1186/gb200787r143PubMed CentralView ArticlePubMedGoogle Scholar
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.