- Research article
- Open Access
Bayesian DNA copy number analysis
- Paola MV Rancoita^{1, 2, 3}Email author,
- Marcus Hutter^{4},
- Francesco Bertoni^{2} and
- Ivo Kwee^{1, 2}
https://doi.org/10.1186/1471-2105-10-10
© Rancoita et al; licensee BioMed Central Ltd. 2009
- Received: 19 May 2008
- Accepted: 08 January 2009
- Published: 08 January 2009
Abstract
Background
Some diseases, like tumors, can be related to chromosomal aberrations, leading to changes of DNA copy number. The copy number of an aberrant genome can be represented as a piecewise constant function, since it can exhibit regions of deletions or gains. Instead, in a healthy cell the copy number is two because we inherit one copy of each chromosome from each our parents.
Bayesian Piecewise Constant Regression (BPCR) is a Bayesian regression method for data that are noisy observations of a piecewise constant function. The method estimates the unknown segment number, the endpoints of the segments and the value of the segment levels of the underlying piecewise constant function. The Bayesian Regression Curve (BRC) estimates the same data with a smoothing curve. However, in the original formulation, some estimators failed to properly determine the corresponding parameters. For example, the boundary estimator did not take into account the dependency among the boundaries and succeeded in estimating more than one breakpoint at the same position, losing segments.
Results
We derived an improved version of the BPCR (called mBPCR) and BRC, changing the segment number estimator and the boundary estimator to enhance the fitting procedure. We also proposed an alternative estimator of the variance of the segment levels, which is useful in case of data with high noise. Using artificial data, we compared the original and the modified version of BPCR and BRC with other regression methods, showing that our improved version of BPCR generally outperformed all the others. Similar results were also observed on real data.
Conclusion
We propose an improved method for DNA copy number estimation, mBPCR, which performed very well compared to previously published algorithms. In particular, mBPCR was more powerful in the detection of the true position of the breakpoints and of small aberrations in very noisy data. Hence, from a biological point of view, our method can be very useful, for example, to find targets of genomic aberrations in clinical cancer samples.
Keywords
- Root Mean Square Error
- Hide Markov Model
- Piecewise Constant Function
- Segment Level
- Segment Number
Background
Lesions at DNA level represent the cause of cancer and of many congenital or hereditary disorders. The change of the number of copies of DNA in a genomic region is one of the most common aberrations. In normal cells each genomic segment is present in two copies, but, for example, in tumor cells the genome can present regions of deletions (copy number one or zero), gains (copy number three or four) or amplifications (copy number greater than four). Thus, in general, the DNA copy number along the genome can be represented as a piecewise constant function.
With microarray technology it is possible to simultaneously measure the copy number along the genome at hundred thousands of positions (see for example [1]). However, raw copy number data are generally very noisy. Hence, it is important to define a method which allows one to estimate the number of regions with different copy number, the endpoints of these regions (called breakpoints) and their copy number. Several methods have been developed to solve this issue. Many methods consider the log_{2} ratio of the data (the ratio is computed with respect to a normal reference sample) and model it as a normal random variable, since they assume that the errors are normally distributed. We can roughly subdivide all of these methods into two classes: those ones that estimate the copy numbers as a piecewise constant function and the others that estimate the copy numbers as a continuous curve. The methods belonging to the latter group are called smoothing methods.
Among the methods belonging to the first class, we can find the following. The Circular Binary Segmentation (CBS) approach is a recursive method in which the breakpoints are determined on the basis of a test of hypothesis, with null hypothesis that in the interval considered there is no change in copy number [2]. Picard et al. [3] used a piecewise constant regression model, where the parameters are estimated maximizing a penalized likelihood (i.e. the likelihood with the addition of a penalty function). This method is usually denoted with the abbreviation CGHseg. The GLAD method is another piecewise constant regression method, but in this case the parameters are estimated maximizing a weighted likelihood [4]. Fridlyand et al. [5] applied Hidden Markov Models (HMM), while Marioni et al. [6] defined an HMM method which takes into account the distance among the data points (BioHMM). Recently, Nilsson et al [7] derived a segmentation method based on total variation minimization, called Rendersome. It is optimized for gene expression data, but the authors affirm that it can be used also on copy number data.
Among the smoothing methods, Hsu et al. [8] used a wavelet regression method with Haar wavelet. Eilers and de Menez [9] applied a quantile smoothing regression (quantreg), with the solution found by minimizing a loss function based on the L_{1} norm, to obtain a flatter curve. Huang et al. [10] proposed smoothseg, i.e. a smooth segmentation method based on a doubly heavy-tailed random-effect model.
We propose a piecewise constant regression method, using Bayesian statistics, which appears appropriate when regions contain only few data points. The original version of the method (called Bayesian Piecewise Constant Regression, BPCR) was presented by Hutter [11, 12]. In this paper we propose improved Bayesian estimators of the parameters involved and we apply the model to DNA copy number estimation. Finally, we compare our algorithm with some among the most cited or more recent methods, on artificial and real data.
Our method was implemented in R and is freely available at http://www.idsia.ch/~paola/mBPCR/ or in Additional file 1. Furthermore, an R package will be soon available.
Methods
In the first two subsections, we briefly describe the original Bayesian Piecewise Constant Regression method, explaining the hypothesis of the model and the estimation of its parameters with Bayesian regression. We emphasize the definitions of the original parameter estimators in order to show how we changed some of these estimators in the other subsections.
A brief explanation of the dynamic program for the computation of the estimators can be found in the Additional file 2 (more details can be found in [11, 12]).
Regarding notations, we do not indicate explicitly the random variable to which a distribution is referred, if it is clear from the context. For example, p_{ K }(k) ≡ p(k) or f_{Y, M}(y, μ) ≡ f(y, μ).
Hypotheses of the model
Suppose also that Y represents a noisy observation of a piecewise constant function, which consists of k_{0} horizontal segments. Then, the segment level at a generic position i (${\tilde{\mu}}_{i}^{0}$) does not assume different values for each i, but the data are divided into k_{0} intervals (with boundaries $0={t}_{0}^{0}<{t}_{1}^{0}<\cdots <{t}_{{k}_{0}-1}^{0}<{t}_{{k}_{0}}^{0}=n$) where ${\tilde{\mu}}_{{t}_{q-1}+1}^{0}=\mathrm{...}={\tilde{\mu}}_{{t}_{q}}^{0}=:{\mu}_{q}^{0}$ for each q = 1,...,k_{0}. Hence, ${\mu}_{q}^{0}$ represents the level of the q^{ th }segment. Our goal is to estimate the levels ${\mu}^{0}=({\mu}_{1}^{0},\mathrm{...},{\mu}_{{k}_{0}}^{0})$ of all the segments. In order to do that, we first need to estimate the number of the segments k_{0} and the partition of the data t^{0}. From a Bayesian point of view, μ^{0}, t^{0} and k_{0} are treated as random variables, hence we denote them with the corresponding upper case letters (M, T and K). Moreover, because of their randomness, we need to define a prior distribution for each of them to complete the model.
where $\mathbb{K}$ = {1,...,k_{max}} and ${\mathbb{T}}_{k,n}$ is the subspace of ${\mathbb{N}}_{0}^{k+1}$ such that t_{0} = 0, t_{ k }= n and t_{ q }∊ {1,...,n - 1} for all q = 1,...,k - 1, in an ordered way and without repetitions.
where ν∊ ℝ^{ k }, such that ν_{ q }= ν for each q = 1,...,k, and $\mathbb{I}$ ∊ ℝ^{k × k}, such that $\mathbb{I}$_{p, q}= δ_{p,q}for each p, q = 1,...,k.
Instead of these assumptions, we could assume a Cauchy distribution for each Y_{ i }or M_{ q }in order to model an observation whose noise has heavier tails, as previously done by Hutter [11, 12].
Original estimation: the BPCR method
The statistical procedure consists in a sequence of estimations due to the relationship among the parameters.
for all m = 1,...,$\widehat{k}$. When the sample contains only one segment, the Bayesian estimation of the posterior distribution of the levels should theoretically lead to a normal distribution, similar to a Dirac delta function centered at $\widehat{\nu}$, since the levels can assume only one value from the data. In fact, in this case, if we estimate ρ^{2} only using the data (without using any prior or other information), then this value will be close to zero (the variance of a constant random variable) and so the level will be estimated with $\widehat{\nu}$, the mean of the data (see Equation (9)).
for all s = 1,...,n. The vector $\widehat{\tilde{\mathit{\mu}}}$ is called Bayesian Regression Curve (BRC).
Improved estimators of the number of segments
To understand the real meaning of the MAP estimator $\widehat{K}$, we need to introduce the theory of the construction of a generic Bayesian estimator.
Obviously, if we use different types of errors, we can obtain different estimators. In the following, we will use $\widehat{K}$ to denote any estimator of K, while $\widehat{K}$_{01} to denote the parameter estimator $\widehat{K}$ based on the 0–1 error.
Using the 0–1 error, we give the same penalty to each value different from the true value, whether it is close to or far away from the true one. To take into account the distance of the estimated value from the true one, we need to use other types of errors, which are based on different definitions of distance, such as,
absolute error := |θ - θ'|
squared error := (θ - θ')^{2}.
If the parameter θ ∊ ℝ, then the estimators corresponding to these errors are the median and the mean of its posterior distribution, respectively. In our case, we denote these estimators of k_{0} with ${\widehat{K}}_{1}$ and ${\widehat{K}}_{2}$.
Improved estimators of the boundaries
Similarly to the previous subsection, we derive alternative boundary estimators, by considering different types of errors. We denote the MAP boundary estimator defined in Equation (4) with ${\widehat{\mathit{T}}}_{01}$.
Meaning of the estimator ${\widehat{\mathit{T}}}_{01}$
Definition of the estimator ${\widehat{\mathit{{\rm T}}}}_{\text{joint}}$
Definition of the estimators $\widehat{\mathit{{\rm T}}}$_{BinErr} and $\widehat{\mathit{{\rm T}}}$_{BinErrAk}
We must notice that the estimators considered until now have the same length of the true vector of the boundaries. In practice, the number of segments k_{0} is unknown, so that we should use $\widehat{k}$. As a consequence, if $\widehat{k}$ is different from k_{0}, then, strictly speaking, we cannot minimize the previous types of error because the vectors have different length.
We denote with $\mathcal{T}{\mathcal{T}}_{k,n}$ the set of all the possible τ with τ_{0} = 1, τ_{ n }= 1 and k - 1 of the other components equal to 1.
Improved regression curve
Unfortunately, the computation of this quantity requires time $O({n}^{2}{k}_{\mathrm{max}}^{2})$ (see section "The dynamic program" in Additional file 2), hence it could be a problem with samples of big size. This new type of ${\tilde{\text{M}}}_{s}$ estimation is referred to as Bayesian Regression Curve Averaging over k (BRCAk).
The same procedure cannot be applied for the level estimation, because in that case we need to know the partition of the whole interval.
Properties of the hyper-parameter estimators and definition of new estimators
In order to study the properties of the hyper-parameter estimators defined in Equations (9), (11) and (10), first we need to compute the moments of the data $\mathit{Y}{|}_{\nu ,{\rho}^{2},{\sigma}^{2}}$. In the following, we will denote with n_{ q }the number of data points in the q^{ th }segment.
It follows that the covariance between two data points, which belong to the same segment, is
Cov(Y_{ i }, Y_{ j }|ν, ρ^{2}, σ^{2}) = ρ^{2} i ≠ j,
and
E[Y_{ j }|ν, ρ^{2}, σ^{2}] = ν
Var(Y_{ j }|ν, ρ^{2}, σ^{2}) = σ^{2} + ρ^{2},
for each j = 1,...,n, independently of the segment to which it belongs.
Furthermore, from the hypotheses of the model, given the segmentation t^{0}, data points belonging to different segments are independent.
Expected value and variance of the estimator $\widehat{\nu}$
Hence, the variance is always greater than $O\left(\frac{{\rho}^{2}}{{k}_{0}}\right)$, even if we use a denser sampling, i.e. we augment the number of data points in the interval in which we are estimating the piecewise constant function.
New definition of the estimator $\widehat{{\sigma}^{2}}$ and its expected value
where we considered two cases in the computation: (a) when k_{0} = 1, Y_{1} and Y_{ n }belong to the same segment (thus they are dependent), (b) when k_{0} ≥ 2, we supposed that the first and the last segments have different levels and so Y_{1} and Y_{ n }are independent. If the first and the last segments had the same level, then the two segments would be joined together and thus Y_{1} and Y_{ n }would be dependent. In this case, the expected value would be the same but with k_{0} - 1 instead of k_{0}, since the number of segments would be k_{0} - 1. In any case, for k_{0} = 1, the estimator $\widehat{{\sigma}^{2}}$ is unbiased, while for k_{0} ≪ n but k_{0} ≠ 1, $\widehat{{\sigma}^{2}}$ is almost unbiased.
Expected value of the estimator $\widehat{{\rho}^{2}}$
Note that when k_{0} = 1 (i.e. having only one segment), $E[\widehat{{\rho}^{2}}]={\sigma}^{2}\left(1-\frac{1}{n}\right)$. In this degenerate case, the variance of the segment levels ρ^{2} should be estimated with zero but $\widehat{{\rho}^{2}}$ estimates it with the variance of the data points.
Hence, if n is large the expected value is between σ^{2} and σ^{2} + ρ^{2}, so that, if ρ^{2} ≪ σ^{2}, the estimator is almost unbiased for σ^{2} (instead of ρ^{2}).
Definition of alternative estimator of ρ^{2}: $\widehat{{\rho}_{1}^{2}}$
In the computation we considered two cases: k_{0} = 1 and k_{0} ≥ 2. When k_{0} = 1, Y_{1} and Y_{ n }belong to the same segment and so they are dependent; when k_{0} ≥ 2, we suppose that the first and the last segment have not the same level value and so Y_{1} and Y_{ n }are independent. If k_{0} ≥ 2 and the first and the last segment had the same level value (event with a very low probability), then the first and the last segments would be joined together and so Y_{1} and Y_{ n }would be dependent. In this case, the expected value of the estimator would have the same formula, but with k_{0} - 1 instead of k_{0}.
We can observe that, when k_{0} = 1, the expected value is negative, while, when k_{0} ≥ 2, it can be negative or positive. Moreover, the coefficient of σ^{2} is $-\frac{1}{n}$ and so this addendum does not contribute so much to the unbiasedness of the estimator.
Results and discussion
In this section we show and discuss results obtained on both the simulated and the real data. We used the simulated data with a twofold aim. The first was to choose empirically the best estimators among those proposed in the previous section. The second was to compare the original version of BPCR/BRC and their modified versions with each other and with other existing methods estimating DNA copy number value [2–10]. On the basis of the results, we selected the best modified version of BPCR, called mBPCR, and of BRC.
Finally, we compared the performance of mBPCR, CBS, CGHseg, GLAD, HMM, BioHMM and Rendersome on the real data.
Simulation description
In the comparisons, we used several types of artificial data. We call sample a sequence of data which represents the copy number data of a genomic region, we call dataset a set of samples, while collection a set of datasets.
Sometimes we needed datasets where all samples had the same true profile of the segment levels (i.e. K, T and M were sampled one time and only the noise varied in all samples). This type of dataset is called dataset with replicates. Otherwise, the dataset is called without replicates (i.e. each time we sampled K, T, M and added the noise to the profile). The number of samples per dataset was 100, for datasets with replicates, and 300 otherwise. We considered datasets with replicates in order to be able to compare the goodness of different types of estimations for a given profile.
We also compared the behavior of our boundary estimators using the artificial dataset already employed in [13], where three methods for copy number estimation were examined. This dataset contained 500 samples consisting of 20 chromosomes, each of 100 probes, which emulated the real copy number data. This dataset is referred to as Simulated Chromosomes.
To assess the performance of the several methods, we used three types of artificial datasets. The first type consisted of four datasets with replicates used in the comparison among the estimators. This collection of datasets is called Cases.
The second type consisted of datasets adapted from the datasets used in [14] to compare several methods for copy number estimation. In these datasets, each sample was an artificial chromosome of 100 probes, where the copy number value was zero apart from the central part where there was an aberration. The Authors considered several widths of aberration: 40, 20, 10 and 5 probes. The noise was always distributed as $\mathcal{N}$(0, 0.25^{2}), while the signal to noise ratio (SNR) was 4, 3, 2 or 1. The SNR was defined as the ratio between the height of the aberration and the standard deviation of the noise. The data of the paper consisted of datasets of 100 samples for each combination of width and SNR.
We defined our datasets in the following way. For a fixed SNR value, we constructed a chromosome with four aberrations of width of 40, 20, 10 and 5 probes, respectively, by joining the corresponding four types of chromosome of the previous datasets. This collection of datasets is called Four aberrations. In the following, we will consider only the datasets with SNR = 3 (medium noise) and SNR = 1 (high noise).
The third type of dataset used was the Simulated Chromosomes dataset.
Comparison among the estimators on simulated data
In this subsection, we present how we selected the best estimators among those proposed in the Section Methods, on the basis of their results obtained on the artificial datasets. The comparisons were accomplished using both the true and the estimated values of the other parameters involved in the estimation.
Comparison among the hyper-parameter estimators
Comparison among the hyper-parameter estimators
σ^{2} = 0.1 | σ^{2} = 0.3 | σ^{2} = 0.5 | σ^{2} = 0.5 | σ^{2} = 0.5 | σ^{2} = 0.7 | σ^{2} = 1 | σ^{2} = 1.2 | |
---|---|---|---|---|---|---|---|---|
ρ^{2} = 0.5 | ρ^{2} = 0.05 | ρ^{2} = 0.02 | ρ^{2} = 0.05 | ρ^{2} = 0.1 | ρ^{2} = 0.5 | ρ^{2} = 0.05 | ρ^{2} = 0.5 | |
${\text{MSE}}_{\widehat{\nu}}$ | 0.0904 | 0.0091 | 0.0059 | 0.0094 | 0.021 | 0.067 | 0.0169 | 0.0729 |
${\text{MSE}}_{{\widehat{\sigma}}^{2}}$ | 0.0042 | 0.0014 | 0.0041 | 0.0036 | 0.0037 | 0.0114 | 0.0123 | 0.0272 |
${\text{MSE}}_{{\widehat{\rho}}^{2}}$ | 0.0633 | 0.0871 | 0.2508 | 0.2404 | 0.2426 | 0.4271 | 0.9921 | 1.3254 |
${\text{MSE}}_{{\widehat{\rho}}_{1}^{2}}$ | 0.068 | 0.0009 | 0.0008 | 0.0014 | 0.0047 | 0.0593 | 0.0024 | 0.0623 |
From the results, we can deduce that ${\widehat{\sigma}}^{2}$ is a good estimator because it was quite precise in all situations, while $\widehat{\nu}$ was sometimes poor but in general acceptable. About the ρ^{2} estimation, it is better to use ${\widehat{\rho}}_{1}^{2}$ than ${\widehat{\rho}}^{2}$, when the variance of the noise is higher than the variance of the levels. Otherwise, it seems better to use ${\widehat{\rho}}^{2}$ because it does not underestimate ρ^{2} (see Section Methods).
Comparison among the segment number estimators
We evaluated the quality of the estimators of the number of segments, using datasets with and without replicates for different values of the hyper-parameters σ^{2} and ρ^{2}. The estimations were made using either the true values of the hyper-parameters or the estimated ones. In this way, we could also observe the behavior of the boundary estimators without the influence of the hyper-parameter estimation.
Comparing the absolute, squared and 0–1 errors, we found that ${\widehat{K}}_{2}$ generally had the lowest upper bound (or its upper bound is very close to the lowest one) of the confidence interval at level 95%, for any type of error and any type of value of the parameter ρ^{2} (see, for example, Figures S.2 and S.3 in Additional file 2). Moreover, all estimators always had a similar confidence interval of the 0–1 error, while using ${\widehat{\rho}}^{2}$, in most cases the upper bound of the confidence interval of the absolute and the squared error was lower than using ${\widehat{\rho}}_{1}^{2}$. All these results support the suggestion to use ${\widehat{K}}_{2}$ with ${\widehat{\rho}}^{2}$.
We should also observe that in general $\widehat{K}$_{01} underestimates k_{0}, while ${\widehat{K}}_{1}$ and ${\widehat{K}}_{2}$ overestimate it. In addition, the percentage of the underestimations increases using ${\widehat{\rho}}^{2}$.
Comparison among the boundary estimators
which corresponds to the mean square error over the whole vector of estimated boundaries. As observed in Section Methods, when the estimated segment number is used in the estimation of the boundaries, we are only able to compute the binary error, because it does not require that the vector of estimated boundaries has the same length as the vector of the true boundaries.
Comparison among the several boundary estimators
σ^{2} = 0.1 | σ^{2} = 0.3 | σ^{2} = 0.5 | σ^{2} = 1.2 | |
---|---|---|---|---|
method | ρ^{2} = 0.5 | ρ^{2} = 0.05 | ρ^{2} = 0.1 | ρ^{2} = 0.5 |
${\widehat{\mathit{T}}}_{01}$, ${\widehat{\rho}}^{2}$ | 11.5967 ± 0.4562 | 18.0933 ± 0.6388 | 18.2 ± 0.6177 | 17.6833 ± 0.5781 |
${\widehat{\mathit{T}}}_{joint}$, ${\widehat{\rho}}^{2}$ | 8.8667 ± 0.3329 | 17.6333± 0.6224 | 17.4833± 0.5898 | 16.6167 ± 0.5367 |
${\widehat{\mathit{T}}}_{BinErr}$, ${\widehat{\rho}}^{2}$ | 8.6833 ± 0.3437 | 17.3833 ± 0.6219 | 17.2467 ± 0.5983 | 15.8967 ± 0.5278 |
${\widehat{\mathit{T}}}_{BinErrAk}$, ${\widehat{\rho}}^{2}$ | 8.7267 ± 0.3449 | 17.3933 ± 0.6226 | 17.2567 ± 0.5978 | 15.9133 ± 0.5303 |
${\widehat{\mathit{T}}}_{01}$, ${\widehat{\rho}}_{1}^{2}$ | 11.4767 ± 0.4532 | 15.2867 ± 0.5325 | 15.6867 ± 0.536 | 16.1933 ± 0.5301 |
${\widehat{\mathit{T}}}_{joint}$, ${\widehat{\rho}}_{1}^{2}$ | 8.7933 ± 0.3294 | 13.73 ± 0.4731 | 13.81 ± 0.4691 | 14.1667 ± 0.451 |
${\widehat{\mathit{T}}}_{BinErr}$, ${\widehat{\rho}}_{1}^{2}$ | 8.47 ± 0.3372 | 13.0567 ± 0.4635 | 13.18 ± 0.4725 | 13.2367 ± 0.4344 |
${\widehat{\mathit{T}}}_{BinErrAk}$, ${\widehat{\rho}}_{1}^{2}$ | 8.4567 ± 0.3361 | 13.0467 ± 0.4676 | 13.08 ± 0.4695 | 13.2233 ± 0.4361 |
To choose between the estimators ${\widehat{\mathit{T}}}_{BinErrAk}$ and ${\widehat{\mathit{T}}}_{joint}$, we performed the segment level estimation, considering both ρ^{2} estimators. Then, we computed the MSE of the estimated segment level per probe and its upper bound of the confidence interval at level 95% (the corresponding graphs regarding some datasets can be found in Figure S.5 in Additional file 2). The results showed that, for a given estimator of ρ^{2}, in general ${\widehat{\mathit{T}}}_{BinErrAk}$ was better than ${\widehat{\mathit{T}}}_{joint}$ and the upper bound of the confidence interval of the MSE of the former estimator was lower than that one of the latter. Moreover, using ${\widehat{\rho}}_{1}^{2}$ the error was generally lower.
In addition, we compared the behavior of our boundary estimators on dataset Simulated Chromosomes. To assess the goodness of their estimation, we measured the sensitivity (proportion of true breakpoints detected) and the false discovery rate (FDR, i.e. proportion of false estimated breakpoints among the estimated ones), while to assess the influence of the boundary estimation on the profile estimation, we calculated the sum of squared distance (SSQ), the median absolute deviation (MAD) and the accuracy (proportion of probes correctly assigned to an altered or unaltered state). The sensitivity and the FDR were computed not only looking at the exact position of the breakpoints (w = 0), but also accounting for a neighborhood of 1 or 2 probes around the true positions (w = 1, 2). We also computed the accuracy inside and outside the aberrations separately, since the samples of dataset Simulated Chromosomes contained only few small copy number changes and thus the accuracy depended more on the correct estimation/classification of the probes in the "normal" regions. A more detailed explanation of these measures can be found in [13].
Comparison among the boundary estimators on Simulated Chromosomes
method | SSQ | MAD | accuracy | accuracy inside aberrations | accuracy outside aberrations |
---|---|---|---|---|---|
${\widehat{\mathit{T}}}_{01}$, ${\widehat{\rho}}^{2}$ | 14.23 | 0.00877 | 0.889 | 0.961 | 0.883 |
${\widehat{\mathit{T}}}_{joint}$, ${\widehat{\rho}}^{2}$ | 2.22 | 0.00840 | 0.904 | 0.992 | 0.892 |
${\widehat{\mathit{T}}}_{BinErrAk}$, ${\widehat{\rho}}^{2}$ | 1.70 | 0.00733 | 0.936 | 0.992 | 0.932 |
${\widehat{\mathit{T}}}_{01}$, ${\widehat{\rho}}_{1}^{2}$ | 9.74 | 0.00952 | 0.881 | 0.960 | 0.877 |
${\widehat{\mathit{T}}}_{joint}$, ${\widehat{\rho}}_{1}^{2}$ | 2.67 | 0.00970 | 0.882 | 0.993 | 0.867 |
${\widehat{\mathit{T}}}_{BinErrAk}$, ${\widehat{\rho}}_{1}^{2}$ | 1.85 | 0.00781 | 0.929 | 0.993 | 0.920 |
In conclusion, we suggest to use ${\widehat{\mathit{T}}}_{BinErrAk}$, even if ${\widehat{\mathit{T}}}_{joint}$ is also a quite good estimator in some cases. Regarding the estimation of ρ^{2}, it seems that it is better to use ${\widehat{\rho}}_{1}^{2}$ in presence of high noise.
Comparison among the regression curves
We compared the estimation of the levels of BRC with the one of BRCAk, also taking into account the influence of the different estimators of the parameters on the final results. To valuate the performance of the methods, we used the root mean square error (RMSE) per probe and per sample, computed with respect to the true profile of the levels. For this purpose, we necessarily needed datasets with replicates. Using BRCAk we generally obtained a better or equal result with respect to the BRC (see, for example, Figures S.7 and S.8 in Additional file 2). Moreover, we observed that, using BRC, it was better to estimate the segment number with ${\widehat{K}}_{1}$ or ${\widehat{K}}_{2}$.
Note that we still have to solve the problem to determine which is the best estimator of ρ^{2}. In most cases, the profile obtained by using ${\widehat{\rho}}_{1}^{2}$ was better than using ${\widehat{\rho}}^{2}$ (for example, see the plots at the bottom of Figure S.9 in Additional file 2). This is due to the fact that sometimes ${\widehat{\rho}}_{1}^{2}$ slightly underestimated ρ^{2}, leading to overfitting. Still we recommend to use ${\widehat{\rho}}_{1}^{2}$, even if it could lead to a slight overfitting especially in the case of few segments.
Comparison with other methods on simulated data
In this subsection we compare the original and modified versions of BPCR and BRC, with other existing methods for genomic copy number estimation [2–10].
Error measures used in the comparison
We used two different measures to examine the behavior of the different methods on the collections Cases and Four aberrations: the root mean square error (for both) and the ROC curve (only for the latter). Each point of the ROC curve has as coordinates the false positive rate (FPR) and the true positive rate (TPR) for a certain threshold. The TPR is defined as the fraction of probes in the true aberrations whose estimated value is above the threshold considered, while the FPR consists in the fraction of probes outside the true aberrations whose estimated value is above the threshold. Hence, the ROC curve measures the accuracy of the method in the detection of the true aberrations.
Instead, the evaluation of the several methods on dataset Simulated Chromosomes was accomplished using the error measures described in [13], already used in the study of the boundary estimators.
Before showing the results, we need to remember that some methods estimate the copy numbers as a piecewise constant function, while other algorithms estimate them as a continuous curve. Hence, BPCR was compared to the former group of methods, while the Bayesian regression curves to the latter. Since some error measures of [13] suppose that the estimated profile is piecewise constant, we applied only the former group of methods on dataset Simulated Chromosomes.
The piecewise constant estimation
In general, in presence of medium noise, the GLAD method performed worst, since it had a high error in the level estimation of the small peaks, while, for high noise, often both GLAD and Rendersome failed to detect the aberrations (Figures S.12 and S.13 in Additional file 2). The CGHseg method did not usually exhibit an appropriate level estimation except sometimes for segments of large width (for example in Figure S.11 in Additional file 2). This is due to the fact that CGHseg estimates the level of a segment with the arithmetic mean of the data points in the segment and this estimator performs poorly if the segment contains few data points and the breakpoint estimation is not accurate. The CBS method, in general, performed quite well, but it was unable to detect aberrations of small width, especially when the noise was high (Figure S.13 in Additional file 2).
On the collection Cases and the dataset of Four aberrations with SNR = 3, the RMSE plots and the ROC curves of the HMM method showed that it generally estimated the profile well, but sometimes it exhibited high errors near breakpoint positions (see, for example, Figure S.11 in Additional file 2), likely because it was unable to determine the true position of the breakpoints precisely. Moreover, on the dataset with SNR = 1, we recognized the true issues of the estimation with HMM. The RMSE plot showed that it had a high error outside the regions of the aberrations, while inside these regions the error was always more or less the same. Hence, it often failed also in the estimation of the largest aberration, the easiest one to detect (see the corresponding errors in Figure S.13 in Additional file 2). The reason of this behavior of the RMSE is the following. The method estimated the true profile either with only one segment, or more often with a profile consisting of a lot of small segments, but all with the same level. Since in the latter case the estimated levels were close to that one of the true aberrations, the RMSE was low in the regions of the aberrations but high outside them. However, the estimated profiles were not similar to the true one. In presence of medium noise (SNR = 3), the method BioHMM was more precise than HMM in the determination of the breakpoint positions and in the level estimation (Figure S.11 in Additional file 2), while for high noise it behaved similarly to HMM (Figure S.13 in Additional file 2).
In general we found that, when σ^{2} <ρ^{2} (when σ^{2} > ρ^{2}), the version of BPCR with ${\widehat{\mathit{T}}}_{BinErrAk}$ and ${\widehat{\rho}}^{2}$ (${\widehat{\rho}}_{1}^{2}$) generally gave the best estimation compared to the other versions of BPCR and to the other methods (Figures S.10, S.11, S.12 and S.13 in Additional file 2). In the following, we will call this modified version of BPCR, mBPCR.
Only on the dataset with SNR = 1, we could not choose the "best" method, because this case showed the limits of all the methods considered. The problem regarding the modified versions of BPCR was essentially the estimation of the number of segments. The ROC curves (Figure S.12 in Additional file 2) of the modified versions of BPCR with ${\widehat{\rho}}_{1}^{2}$ were the closest to the left and the top sides of the box, while the RMSE plot (Figure S.13 in Additional file 2) showed that these methods were the best methods in the estimation of the levels inside the aberrations, but not outside them. In general, in case of very high noise, all the modified versions of BPCR well detected the aberrations, but had problems in the estimation of the profile outside them because of the poor estimation of the number of segments. In fact, ${\widehat{K}}_{2}$ tends to overestimate the number of segments and this problem worsens using ${\widehat{\rho}}_{1}^{2}$. In conclusion, in a situation with very high noise, using ${\widehat{\rho}}_{1}^{2}$ the BPCR methods detect better the small segments, but, at the same time, the large ones are divided in small segments. On the other hand, using ${\widehat{\rho}}^{2}$, smaller segments are not detected and are joined to the closest large segment.
Comparison among the piecewise constant methods on Simulated Chromosomes
method | SSQ | MAD | accuracy | accuracy inside aberrations | accuracy outside aberrations |
---|---|---|---|---|---|
mBPCR ${\widehat{\rho}}^{2}$ | 1.70 | 0.00733 | 0.936 | 0.992 | 0.932 |
mBPCR ${\widehat{\rho}}_{1}^{2}$ | 1.85 | 0.00781 | 0.929 | 0.993 | 0.920 |
CBS | 1.56 | 0.00705 | 0.953 | 0.985 | 0.950 |
CGHseg | 5.42 | 0.00795 | 0.925 | 0.885 | 0.956 |
HMM | 4.47 | 0.00350 | 0.993 | 0.968 | 0.997 |
GLAD | 4.15 | 0.00846 | 0.939 | 0.930 | 0.952 |
BioHMM | 5.69 | 0.003647 | 0.990 | 0.949 | 0.999 |
Rendersome | 19.13 | 0 | 0.920 | 0.289 | 1 |
Estimation with a continuous curve
In general, we found that all methods detected the regions of aberration quite well (see, for example, Figures S.16 and S.18 in Additional file 2). The wavelet method showed a higher error in the level estimation of the aberrations in the datasets SNR = 3 and SNR = 1 (Figures S.16 and S.18 in Additional file 2). The methods lowess and quantreg had the highest RMSE in the collection Cases, while their error was not significantly different outside and inside the aberrations on datasets with SNR = 1, 3. Therefore, in the last cases the error was low inside the aberrations and high outside them in comparison with the other methods. The method smoothseg showed a similar behavior, but with a lower error.
Moreover, we found that the ROC measure was affected by oscillations in the estimated curve, which lead to ROC curves intersected and difficult to be interpreted (Figure S.15 in Additional file 2). This complex behavior is a consequence of the way in which lowess, wavelet, quantreg and smoothseg yielded oscillating curves with positive and negative values outside the aberrations; while BRCs estimated the true profile with a line almost flat and close to zero (see the examples in Figure 3).
In conclusion, the version of BRC with ${\widehat{K}}_{2}$ and BRCAk gave in general a better estimation than the other BRCs and the other smoothing methods considered. Regarding the ρ^{2} estimation, we found that it is better to use ${\widehat{\rho}}^{2}$, if σ^{2} <ρ^{2}, and ${\widehat{\rho}}_{1}^{2}$, if σ^{2} > ρ^{2}.
Application to real data
In this subsection, we show how mBPCR performed compared to other piecewise constant estimation methods on the real data. We used samples from three mantle cell lymphoma cell lines (JEKO-1, GRANTA-519, REC-1) previously analyzed by us with the Affymetrix GeneChip Mapping 10K Array (Affymetrix, Santa Clara, CA), an oligonucleotides-based microarray [15]. We also used the data obtained on JEKO-1, by using the higher density Affymetrix GeneChip Mapping 250K Nsp Array. We considered eight recurrent gene regions of aberration in lymphoma plus other two gene regions (BIRC3 and LAMP1) and we compared the corresponding copy numbers obtained by the several piecewise constant methods with those obtained by the FISH technique in [15]. In the end, we also show a comparison among the estimated profiles of chromosome 11 of JEKO-1.
The 10K Array data used are freely available at the public repository Gene Expression Omnibus [16] with GEO accession: GSM95567, GSM95568 and GSM95570. The 250K Array data of cell line JEKO-1 will be soon available in the same repository.
With the current implementation, on a computer with dual CPU (AMD Opteron 250, 2.4 GHz) and 4 GB RAM, the algorithm needed about 4 minutes to analyze a 10K Array sample, while about 1 day to estimate the profile of a 250K Array sample. The computations were performed by chromosome (and by arm for the longest chromosomes in the 250K Array data) and using k_{max} = 100.
Gene copy number estimation
To properly evaluate the methods, the knowledge of the true underling profile is required. In general, large aberrations on chromosomes can be detected with conventional karyotype analysis or with SKY-FISH and one could use this information for the evaluation procedure, but the width of these aberrations is so large that all the methods can detect them well, leading to a useless comparison. For this reason, we decided to take into account only genes to compare the piecewise constant methods.
In the comparison, as previously published [15], when two FISH copy numbers had been assigned to one gene, the first number should correspond to the copy number detected in the majority of the cells. We assigned two estimated copy numbers to one gene, when the position of the gene is between two SNPs and the method assigned two different values to these SNPs.
The results on REC-1 (Table S.3 in Additional file 2) did not show any significant difference among the methods, instead those on GRANTA-519 (Table S.4 in Additional file 2) showed that GLAD was unable to detect the true copy number in five cases, while HMM, BioHMM and Rendersome detected an amplification on MALT1 greater than what detected by FISH analysis. All methods did not detect the true copy number of ATM, probably because the SNPs around ATM are far away from the corresponding FISH region (about 1 Mb) and the deletion affects only this region. Only mBPCR with ${\widehat{\rho}}_{1}^{2}$ and HMM detected a breakpoint between the two SNPs around ATM region, indicating a copy number change.
Copy number estimation results obtained on 10K Array data of sample JEKO-1
mBPCR | |||||||||
---|---|---|---|---|---|---|---|---|---|
gene region | FISH CN | ${\widehat{\rho}}^{2}$ | ${\widehat{\rho}}_{1}^{2}$ | CBS | CGHseg | HMM | GLAD | BioHMM | Rendersome |
BCL6 | 3/2 | 2.97 | 2.99 | 2.97 | 2.90 | 2.92 | 2.92 | 3.14 | 2.92 |
C-MYC | ampl | 12.11 | 9.35 | 10.27 | 10.27 | 13.95 | 9.82 | 8.26 | 13.10/3.11 |
CCND1 | 2 | 4.08 | 3.77 | 4.08 | 4.08 | 3.84 | 3.79 | 3.14 | 3.50 |
BIRC3 | 4/5 | 4.08 | 4.29 | 4.08 | 4.08 | 3.84 | 3.79 | 3.14 | 3.50 |
ATM | 4 | 4.08 | 4.29 | 4.08 | 4.08 | 3.84 | 3.79 | 3.14 | 3.50/2.39 |
D13S319 | 4 | 3.72 | 3.59 | 3.57 | 3.72 | 3.62 | 3.58 | 3.14 | 3.43 |
LAMP1 | 4 | 3.41 | 3.82 | 3.41 | 3.41 | 3.62 | 2.49 | 3.14 | 3.43 |
TP53 | 2/3 | 2.81 | 3.00 | 2.83 | 2.50 | 3.52 | 2.93 | 3.14 | 2.93 |
MALT1 | 4 | 3.63 | 3.62 | 3.48 | 3.64 | 3.42 | 3.42 | 3.14 | 3.42 |
BCL2 | 4 | 3.63 | 3.62 | 3.48 | 3.64 | 3.42 | 3.42 | 3.14 | 3.42 |
Profile estimation
To compare the profile estimations, we chose the sample JEKO-1 because, using the results obtained on both types of array, we could at least understand which regions were more realistically estimated. For now, whole validated chromosomic profiles are not available. Among all chromosomes, we chose chromosome 11 since three of the previous genes belong to that: CCND1 (around 69.17 Mb), BIRC3 (around 101.7 Mb) and ATM (around 107.6 Mb).
Conclusion
We introduced new estimators for the parameters involved in BPCR and we selected the best ones on the basis of theoretic and empirical results. In particular, we found that the best way is to estimate the segment number with ${\widehat{K}}_{2}$ and the boundaries with ${\widehat{\mathit{T}}}_{BinErrAk}$ (or possibly ${\widehat{\mathit{T}}}_{joint}$). We call mBPCR the BPCR version which uses ${\widehat{K}}_{2}$ and ${\widehat{\mathit{T}}}_{BinErrAk}$.
Concerning the estimation of the variance of the segment levels, we found that the original estimator ${\widehat{\rho}}^{2}$ overestimates ρ^{2} (variance of the segment levels) by an addendum proportional to σ^{2} (variance of the noise), see Equation (31). Hence, the estimation fails when σ^{2} > ρ^{2}. The new estimator ${\widehat{\rho}}_{1}^{2}$ is more precise but slightly underestimates ρ^{2}, leading to an overestimation of the segment number. Applying both estimators on artificial datasets, we found that, in general, the best way is to use ${\widehat{\rho}}^{2}$ when σ^{2} <ρ^{2} (low noise), but to use ${\widehat{\rho}}_{1}^{2}$ when σ^{2} > ρ^{2} (high noise), even if it could lead to a slight overfitting. On real DNA copy number data, commonly σ^{2} > ρ^{2}.
We also compared mBPCR with other methods which also estimate the copy number as a piecewise constant function: CBS, HMM, CGHseg, GLAD, BioHMM and Rendersome. As a whole, the results showed that mBPCR gave the best estimation on the dataset used. However, when σ^{2} ≫ ρ^{2} it is hard to understand which method is the most appropriate. Most of the other methods were not able to detect aberrations with a small width (5 and 10 probes) and the same was true for mBPCR using ${\widehat{\rho}}^{2}$. On the other hand, the use of ${\widehat{\rho}}_{1}^{2}$ led to the detection of the smaller segments, but the larger ones were often divided in small segments and sometimes the segments consisted of only one point. The optimal choice of the ρ^{2} estimator is still not fully determined.
The new estimators improved also BRC, which is a Bayesian regression with a smooth curve. Moreover, we derived a formula to estimate BRC without employing the estimated number of segments. We referred to it as BRCAk. Applying these methods to artificial data, the best estimators were found to be the BRC version with ${\widehat{K}}_{2}$ and BRCAk. About the choice of the two estimators of ρ^{2}, we found a similar conclusion as before, with the advantage of being less problematic when σ^{2} ≫ ρ^{2}. We compared these two regression methods with other methods which estimate the copy number data as a continuous curve: wavelet, lowess, quantreg and smoothseg. The results showed that our modified regression methods were the most appropriate for the estimation of the segment levels on the datasets considered.
Even though these smoothing methods seem to have less problems in the estimation and the error measures (for example, the ROC curve) suggest that their estimation is even better than the piecewise constant estimation, these methods do not detect the position of the breakpoints explicitly and hence the changes in the value of the segment level. Thus, they seem to be less adequate in practice.
For this reason, we feel that the ROC curve cannot be used as the only measure to compare methods, as previously done in [14]. The RMSE is generally an acceptable measure, but we observed that in some cases even this is not sufficient, due to the overfitting. Willenbrock and Fridlyand [13] proposed other measures to compare methods for copy number estimation, regarding both breakpoint and level estimation. In particular, the sensitivity measure of breakpoint estimation is useful to select which methods should be used, because it quantifies the precision of the methods in determining the position of the breakpoints.
Finally, we have applied mBPCR and all other piecewise constant regression methods to real data. The comparisons showed that mBPCR estimated well the copy number of the genes. On these data, in most cases the choice of the ρ^{2} estimator did not affect the analysis.
In comparison with the other methods, the current implementation of our algorithm is computationally intensive. The real computational time can be reduced linearly diminishing k_{max} and quadratically diminishing the number of probes. Moreover, the computation can be easily parallelized by arm and by chromosome, reducing further the calculation time.
In cancer research, the accuracy in the DNA copy number estimation is crucial for the correct determination of the mutations that characterize the disease. In particular, the estimation of the breakpoints must be precise to detect correctly which genes are affected by these genomic aberrations. As recently shown [17], SNP microarrays can also potentially detect the breakpoints involved in unbalanced translocations, allowing the identification of fusion genes (i.e. hybrid genes created by joining portions of two different genes). In this context, the use of our method can highly improve the disease investigation, because it accurately determines breakpoints, is less sensitive to high noise and generally outperforms all the methods considered in our comparisons. Moreover, smoothing algorithms are clearly not suitable for such analysis.
Availability and requirements
Project name: mBPCR.
Project home page: http://www.idsia.ch/~paola/mBPCR/.
Operating systems: the software should run in Linux, Mac-OS or Windows. Tests were performed on Windows and Linux systems.
Programming language: R.
Other requirements: none.
Licence: GNU GPL.
Any restrictions to use by non-academics: none.
Declarations
Acknowledgements
This work was supported by the grant 205321-112430 of the Swiss National Science Foundation and by Oncosuisse Grant OCS 1939-08-2006.
Authors’ Affiliations
References
- Huang J, Wei W, Zhang J, Liu G, Bignell GR, Stratton MR, Futreal PA, Wooster R, Jones KW, Shapero MH: Whole Genome DNA Copy Number Changes Identified by High Density Oligonucleotide Arrays. Human Genomics. 2004, 1 (4): 287-299.PubMed CentralView ArticlePubMedGoogle Scholar
- Olshen AB, Venkatraman ES, Lucito R, Wigler M: Circular Binary Segmentation for the Analysis of Array-based DNA Copy Number Data. Biostatistics. 2004, 5 (4): 557-572. 10.1093/biostatistics/kxh008.View ArticlePubMedGoogle Scholar
- Picard F, Robin S, Lavielle M, Vaisse C, Daudin JJ: A Statistical Approach for Array CGH Data Analysis. BMC Bioinformatics. 2005, 6 (27):Google Scholar
- Hupé P, Stransky N, Thiery JP, Radvanyi F, Barillot E: Analysis of array CGH data: from signal ratio to gain and loss of DNA regions. Bioinformatics. 2004, 20 (18): 3413-3422. 10.1093/bioinformatics/bth418.View ArticlePubMedGoogle Scholar
- Fridlyand J, Snijders AM, Pinkel D, Albertson DG, Jain AN: Hidden Markov Models approach to the analysis of array CGH data. Journal of Multivariate Analysis. 2004, 90: 132-153. 10.1016/j.jmva.2004.02.008.View ArticleGoogle Scholar
- Marioni J, Thorne N, Tavare S: BioHMM: a heterogeneous hidden Markov model for segmenting array CGH data. Bioinformatics. 2006, 22: 1144-1146. 10.1093/bioinformatics/btl089.View ArticlePubMedGoogle Scholar
- Nilsson B, Johansson M, Heyden A, Nelander S, Fioretos T: An improved method for detecting and delineating genomic regions with altered gene expression in cancer. Genome Biology. 2008, 9:Google Scholar
- Hsu L, Self SG, Grove D, Randolph T, Wang K, Delrow JJ, Loo L, Porter P: Denoising array-based comparative genomic hybridization data using wavelets. Biostatistics. 2005, 6 (2): 211-226. 10.1093/biostatistics/kxi004.View ArticlePubMedGoogle Scholar
- Eilers PHC, de Menezes RX: Quantile smoothing of array CGH data. Bioinformatics. 2005, 21 (7): 1146-1153. 10.1093/bioinformatics/bti148.View ArticlePubMedGoogle Scholar
- Huang J, Gusnanto A, O'Sullivan K, Staaf J, Borg Å, Pawitan Y: Robust smooth segmentation approach for array CGH data analysis. Bioinformatics. 2007, 23 (18): 2463-2469. 10.1093/bioinformatics/btm359.View ArticlePubMedGoogle Scholar
- Hutter M: Bayesian Regression of Piecewise Constant Functions. Bayesian Statistics 8: Proceedings of the Eighth Valencia International Meeting. Edited by: Bernardo JM, Bayarri MJ, Berger JO, David AP, D Heckerman D, Smith AFM, West M. 2007, Oxford University Press, 607-612.Google Scholar
- Hutter M: Exact Bayesian Regression of Piecewise Constant Functions. Bayesian Analysis. 2007, 2 (4): 635-664.View ArticleGoogle Scholar
- Willenbrock H, Fridlyand J: A comparison study: applying segmentation to array CGH data for downstream analyses. Bioinformatics. 2005, 21 (7): 4084-4091. 10.1093/bioinformatics/bti677.View ArticlePubMedGoogle Scholar
- Lai WR, Johnson M, Kucherlapati R, Park PJ: Comparative analysis of algorithms for identifying amplifications and deletions in array CGH data: from signal ratio to gain and loss of DNA regions. Bioinformatics. 2005, 21 (19): 3763-3770. 10.1093/bioinformatics/bti611.PubMed CentralView ArticlePubMedGoogle Scholar
- Rinaldi A, Kwee I, Taborelli M, Largo C, Uccella S, Martin V, Poretti G, Gaidano G, Calabrese G, Martinelli G, Baldini L, Pruneri G, Capella C, Zucca E, Cotter FE, Cigudosa JC, Catapano CV, Tibiletti MG, Bertoni F: Genomic and expression profiling identifies the B-cell associated tyrosine kinase Syk as a possible therapeutic target in mantle cell lymphoma. British Journal of Haematology. 2006, 132: 303-316. 10.1111/j.1365-2141.2005.05883.x.View ArticlePubMedGoogle Scholar
- Gene Expression Omnibus. [http://www.ncbi.nlm.nih.gov/geo/]
- Kawamata N, Ogawa S, Zimmermann M, Niebuhr B, Stocking C, Sanada M, Hemminki K, Yamatomo G, Nannya Y, Koeler R, Flohr T, Miller CW, Harbott J, Ludwing WD, Stanulla M, Shrappe M, Bartram CR, Koeffer HP: Cloning og genes involving in chromosomal translocations by high-resolution single nucleotide polymorphism genomic microarray. Proceedings of the National Academy of Sciences. 2008, 105 (33): 11921-11926. 10.1073/pnas.0711039105.View ArticleGoogle Scholar
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.