 Proceedings
 Open Access
 Published:
Timeseries alignment by nonnegative multiple generalized canonical correlation analysis
BMC Bioinformatics volume 8, Article number: S4 (2007)
Abstract
Background
Quantitative analysis of differential protein expressions requires to align temporal elution measurements from liquid chromatography coupled to mass spectrometry (LC/MS). We propose multiple Canonical Correlation Analysis (mCCA) as a method to align the nonlinearly distorted time scales of repeated LC/MS experiments in a robust way.
Results
Multiple canonical correlation analysis is able to map several time series to a consensus time scale. The alignment function is learned in a supervised fashion. We compare our approach with previously published methods for aligning mass spectrometry data on a large proteomics dataset. The proposed method significantly increases the number of proteins that are identified as being differentially expressed in different biological samples.
Conclusion
Jointly aligning multiple liquid chromatography/mass spectrometry samples by mCCA substantially increases the detection rate of potential biomarkers which significantly improves the interpretability of LC/MS data.
Background
Liquid chromatography coupled to mass spectrometry (LC/MS) has emerged as the technology of choice for the quantitative analysis of proteins over the last decade. Technically, the liquid chromatography process separates solute molecules of a multi component chemical mixture which are measured by LC detectors as a time series of solute mass. A major problem when comparing two biological samples measured with LC/MS is a nonlinear deformation of the time scale between two experiments. A LC/MS device generates mass peaks along the time axis. When two mass spectrometry experiments are aligned, it is our goal to generate matching hypotheses for as many peaks as possible between the two runs, while ensuring that most of these hypotheses are correct.
One of the standard methods for aligning mass spectrometry experiments is called correlation optimized warping (COW) [1], where piecewise linear functions are fitted to align pairs of time series. A hidden Markov model [2] was proposed to align the mass spectrometry data as well as acoustic time series. In [3] the model was extended to use more than one m/z bin for aligning. Tibshirani [4] proposed hierarchical clustering for aligning. Kirchner et al. [5] resorted to robust point matching as developed in medical image analysis. All these previous methods did not utilize the information of identified peptides that are available in tandem mass spectrometry. In our previous work on LC/MS alignment [6] we addressed this problem by way of a semisupervised nonlinear ridge regression model that maps one time scale onto the other. While this model has been demonstrated to outperform other approaches, it still suffers from two methodological shortcomings: (i) the regression approach is nonsymmetric. By mapping the first experiment onto the second one can yield results different from mapping the second onto the first; (ii) the method is limited to aligning only pairs of time series, whereas in many experiments we have access to more than two replica. In this paper we will extend the ideas proposed in [6] by a symmetric approach based on canonical correlation analysis. mCCA is capable of aligning multiple time series and, thus, effectively benefits from an enlarged training set.
Biological motivation
In quantitative proteomics one is interested in classifying a protein sample (e.g. blood plasma) according to some phenotypes, e.g. distinguishing between cancer and noncancer on the basis of a blood plasma sample. Moreover, in many applications it is of particular interest to identify those proteins that are relevant for the discrimination between different biological conditions. In bottomup proteomics, the proteins are first digested by an enzyme into smaller sized pieces, called peptides. Let $p{a}_{i}^{(1)}$ and $p{a}_{i}^{(2)}$ be the (measured) amount of ions of peptide i in sample 1 and 2. According to [6] the differential protein expression estimate ${\widehat{\delta}}_{p}$ can be estimated as
The above differential protein expression estimate is the mean of the logratios of peptide expressions over all peptides that correspond to a particular protein. Due to unknown ionization efficiency and digestion rate only the differential protein expression value can be reliably estimated [6, 7]; absolute expression level cannot be robustly measured in precision experiments. The basis for estimating differential protein expressions is a large set of peptides that are measured in both samples. This work primarily addresses the issue to reliably find correspondences between peptide measurements in several replicated samples. Liquid chromatography/mass spectrometry (LC/MS) allows us to measure the amount of peptide ions. Figure 1 schematically depicts two LC/MS experiments. The time corresponds to the retention time when the peptide ion elutes from the liquid chromatography column. Ions with the same peptide structure will elute within a small time window. After some preprocessing (see [6]) one gets a list of peaks within the two dimensional image with a mass/charge coordinate and a time coordinate. Each cross in Figure 1 depicts a peptide (with a certain charge state). In addition, the amount of peptide ions pa_{ i }is measured by the peak intensities.
For some peaks we have access to the underlying peptide sequence. The machine randomly selects a small number of peaks (typically 3) among the largest peaks of the MS spectrum. Peptide ions within a small mass/charge window are selected and stabilized in an ion trap. The selected peptide ions are further fragmented by a collision with a noble gas. A tandem mass spectrum (MS/MS) is acquired from these fragment ions. These peptide sequences are estimated based on MS/MS data, which contain a dissociation pattern of the peptide ions (see [8, 9] for details about peptide identification). In Figure 1 peaks with known peptide sequence are marked with a circle. In practice, this subset of identified peaks appears like a random selection (since the peptide masses for subsequent MS/MS spectra acquisition are selected randomly) and, consequently, the overlap of jointly identified peptides between replicated experiments is small. Since the measurement process is rather time consuming, the LC/MS machine selects only a small number of peaks for MS/MS scans and further identification.
When an experiment is repeated several times (technical replicates), one often observes that the mass axis is usually conserved very well, but the time axis shows substantial nonlinear deformations. Since the mass axis is expected to contain only negligible errors and to keep the notation simple, we will not explicitly mention the mass measurement in the sequel.
In summary we have two different sets of objects for every experiment:

1.
A large list of peaks at various time points without knowledge about the underlying peptide sequence (typically 2000–3000 peaks).

2.
A moderate list of peaks with known peptide sequence (typically 100–300 peaks). The overlap of identified peptide sequences between experiments is small (typically 10–40 peaks).
The main idea behind our approach is to increase the number of identified peaks by aligning all replicated runs of the experiment. The individual time scales are warped to a canonical time scale which allows us to generate matching hypothesis even if the peptide sequences are missing. Focusing on the time measurements, we analyze the correctness of the predicted correspondences in terms of precisionrecall statistics.
Results and discussion
Our model for estimating the time warping function is based on multiple canonical correlation analysis (mCCA). Individual time scales are projected on a canonical scale such that the joint correlation in the projected space is maximized. The projection has to obey the constraint that the warping models the correspondence of monotonic temporal evolutions (i.e. negative time gradients are forbidden). This constraint is satisfied by projecting the time coordinates on a basis of hyperbolic tangent basis functions (generalized CCA) and by including a nonnegativity constraint when optimizing the correlation (see the methods section).
As a test set for our aligning method we use 10 different sample pairs from an Arabidopsis thaliana cell culture. Each sample pair contains two slightly different biological samples. The different conditions are designed as follows: Given three different samples A, B, and C (in our case consecutive slices of a 1Dgel), the first sample contains a pool of A and B and the second sample contains a pool of B and C. Since the protein abundances on different gel slices are similar to each other, we measure the difference of protein abundance between consecutive gel slices. The two samples (pool A/B and pool B/C) are measured in two single experiments. For every sample 3 technical replicates are available for the analysis. Thus we have 3 LC/MS runs for the pool A/B and additional 3 LC/MS runs for the pool B/C.
The robust mCCA method is used for jointly aligning all 6 experiments available for a pair of samples. The results are then compared to the analysis based on the robust ridgeregression method which has been proposed in [6] as well as thin plate spline fitting [5]. The robust ridge regression technique possibly violates the monotonicity constraint of temporal warping and it has also not been developed for computing multiple alignments. All 6·5/2 pairs of LC/MS experiment are aligned by ridge regression. In addition we compare our method to a pairwise alignment method based on thinplate splines [5] which is freely available. Instead of implicitly estimating the point correspondences, we fixed the given correspondences. All three methods produce a (possible empty) list of peaks where every peak is either identified by MS/MS or by prediction. Contradictions are resolved by majority vote.
Validation of peak matching with known peptide sequence
The three methods are compared by 10fold cross validation using the known labels of the peaks. All peptides that are identified in one of the 6 LC/MS experiments, are partitioned in 10 folds. Ridge regression, thin plate splines and multiple CCA have then been trained on 9 folds and the agreement on peptide sequence is then tested on the remaining fold. To measure the agreement, the number of peptides that are assigned to the same peak, are summed over all test peptides that are identified jointly in one pair of experiments and over all 6·5/2 pairs of experiments. We like to emphasize here, that even if a test peptide is compared in a pair of alignments, this test peptide did not appear in the training set of any other experiment.
The following three cases are considered in the evaluation:

1.
no match. The peak is not assigned to any peak in the second time series.

2.
correct. The peak is assigned to the peak with the same label.

3.
wrong. The peak is assigned to the peak with another label.
From these categories we then compute precision and recall values as follows:
The recall is defined as the number of peaks that are assigned to a peak with the same peptide sequence relative to the total number of (labeled) peaks. Each labeled peak can either be assigned to a peak correctly, to a wrong peak or to no peak. The precision value is the number of peaks that are assigned to the correct peak among the set of peaks that could be assigned to any other peak (excluding the peaks that could not be assigned: ${f}_{k,l}({t}_{j}^{k})=\varnothing $ in Equation 8). In Figure 2 the precisionrecall curves are plotted. We conclude that robust multiple CCA outperforms robust ridge regression consistently by more than five percent in recall for a given precision value. The thin plate splines perform much worse than the robust mCC and robust ridge regression. The runtime for the different methods for the whole dataset are 33 sec. for robust ridge regression, 6 min. 28 sec. for the robust mCCA and 19 hours 45 min. for the thin plate spline implementation by Kirchner [5]. The runtime for the thin plate splines are only for one parameter setting whereas the runtime for ridge regression and CCA includes a model selection over ten different parameter (polynomial degree and σ of hyperbolic tangent functions). There possibly exists a better parameter choice for the thin plate splines, but due to the enormous runtime, we could only select the parameters on a small sized example.
Validation of differential protein expression values
In practical applications, the most important quality criterion for alignment methods of this kind is the number of proteins that are detected as significantly over/underexpressed. In order to estimate this number, all six experiments are pairwise aligned and logpeptide abundance ratios are estimated for all jointly identified peptides. Equation 1 suggests to calculate the mean logpeptide abundance ratio averaged over all peptides which originate from a particular protein. If this average log ratio deviates with ttest significance level α from zero then we declare this protein as strongly under or overexpressed between the two conditions. The ttest with significance level α provides us with a list of differently expressed proteins. This test can be applied to two samples measured (i) under different biological conditions or (ii) as technical replicates. If the percentage of proteins detected as differentially abundant in different biological conditions p_{diff} substantially exceeds the percentage of proteins detected as differentially abundant in replicates p_{rep}, then we can conclude that the difference in these biological conditions significantly influences the proteome. The reader should note that one should compare against biological replicates, to detect significant biomarkers. Unfortunately for our analysis, no biological replicates are available. But the technical replicates are still sufficient to show that the underlying method is able to detect differences in biological samples from different experimental conditions.
A detection rate p_{rep} = α for a ttest with significance level α can be expected due to statistical fluctuations. We observed for our experiments that p_{rep} usually varies between 4% and 5% for α = 3% which is acceptable. The ratio p_{rep}/p_{diff} gives us now an estimate of the false discovery rate in the set of proteins detected as significantly different abundant. Changes in the significance level α controls the false discovery rate. The number of truepositive proteins are now estimated by the formula #positive·(1  false discovery rate).
Figure 3 shows the number of significantly different abundant proteins as a function of the false discovery rate. Multiple CCA clearly outperforms ridge regression in the number of estimated differential protein abundance levels at the same false discovery rate.
To compare the sensitivities of the alignment methods, we compare the number of differently abundant proteins detected by multiple CCA with the detections by ridge regression. The ratio of these two detection rates is shown as a function of the false discovery rate in Figure 4. The gain by multiple CCA is between 2% and 22% for different false discovery rates. The choice of a suitable false discovery rate depends on the proteomics application. In a biomarker discovery scenario we are interested in a fairly small false discovery rate to reduce the amount of work for experimental validation. In high throughput screening scenarios, bioscientists are interested to find potential biomarkers that are further investigated by an additional subsequent analysis, and, therefore, they can accept more false discovery detections.
Conclusion
In this paper we are concerned with one of the critical steps in the data analysis of quantitative differential proteomics experiments. If an experiment with a liquid chromatography unit is repeated, one typically observes a nonlinear deformation of the time scales.
A novel technique for aligning such time scales is proposed where the alignment method is based on generalized canonical correlation analysis with a builtin nonnegativity constraint. Two severe problems of previous approaches are solved with the novel technique: (i) nonsymmetry of the time prediction function and (ii) a potential violation of the monotonicity constraint which is inherent in temporal alignments. On a large proteomics dataset we demonstrate that jointly aligning multiply replicated experiments increases both precision and recall: the total number of peptide correspondences is increased as well as the quality of these matches is improved by the novel technique. These improvements directly influence estimates of differential protein expression values, because the number of proteins are significantly increased that are detected as differentially abundant in our experiments.
Methods
Formal problem description
Assume we have to align K different time scales. Each time scale k is described by a list of peaks with time coordinates
Furthermore, a set of known correspondence points between time scales k and l
are provided by data base search. These time points are defined by those peptides that have been identified in both samples. For a peak p ∈ P_{ k }we try to find a corresponding peak q ∈ P_{ l }(if there exists one), which formally amounts to determine a mapping
f_{k,l}: P_{ k }→ P_{ l }∪ {∅} (6)
from the set of peaks P_{ k }to the set of peaks P_{ l }extended by the symbol ∅. This symbol ∅ represents the case that no corresponding peak can be found on the time scale l. Note that Eq. (6) defines a mapping between finite sets of time points.
To find a suitable mapping between the peaks, a continuous transformation between the time scales has to be learned. The function
g_{k,l}: ℝ → ℝ (7)
transforms the (continuous) time scale k into the (continuous) time scale l. Given the time transformation g_{k,l}we create the mapping f_{k,l}as
The peak ${t}_{j}^{(k)}$ is mapped to the peak closest to the predicted time on time scale l within a window of size w. The window size w controls the number of accepted correspondences. A smaller window size leads to a lower total number of accepted matches, but to a higher precision of the accepted correspondences, i.e. to an increased fraction of correct matches. A continuous time transformation g_{k,l}(see the next section for details) is learned and the transformation is evaluated using the mapping function f_{k,l}.
Robust ridge regression
Fischer et al. [6] used robust ridge regression with polynomial basis functions to estimate the time transformation functions g_{k,l}. Let $({x}_{i},{y}_{i})=\left({t}_{i}^{(k)},{t}_{i}^{(l)}\right)\in {C}_{k,l}$ be a tuple of known time correspondences between time series k and l. The time is explicitly transformed to the polynomial basis $\phi ({x}_{i})={(1,{x}_{i},{x}_{i}^{2},\mathrm{...},{x}_{i}^{d})}^{t}$. Without loss of generality it is assumed that the sample vectors φ(x_{ i }) have zero mean and unit covariance, otherwise the vectors are normalized accordingly. Robust ridge regression finds the parameter vector β that minimizes
where L(ξ) is Huber's loss function [10]
However, the use of ridge regression to align time series has two disadvantages:

1.
ridge regression is not symmetric in the sense that g_{l,k}is not an inverse of g_{k,l}: x ≠ g_{l,k}(g_{k,l}(x));

2.
the time transformation function is not necessarily monotonically increasing. It might, thus, violate the monotonicity constraint that is inherent in temporal alignments.
Canonical correlation analysis
To overcome the above problems of ridge regression we propose to address the alignment task by way of canonical correlation analysis [11]. The two time scales are both mapped on a canonical time axis. Correlation analysis aims to find a linear projection on a canonical time axis such that the correlation between the two random variables is maximized. Again we assume that the sample vectors φ(x_{ i }) have zero mean and unit covariance. The objective is to find parameter vectors β_{1} and β_{2} that maximize the correlation between the linear projections φ(x_{ i })^{t}β_{1} and φ(x_{ i })^{t}β_{2}
The denominator of Equation 11 can be reformulated as β_{1}·β_{2}, since the covariance matrices ${\Phi}_{X}{\Phi}_{X}^{t}$ and ${\Phi}_{Y}{\Phi}_{Y}^{t}$ are normalized to unit covariance before. The problem can be solved directly by a transformation to the eigenvalue problem (see [12])
The vector β_{2} is then obtained by ${\beta}_{2}={\Phi}_{Y}{\Phi}_{X}^{t}{\beta}_{1}$. In order to include the timemonotonicity constraint and robustness, however, it is advantageous to use an alternative formalization of the optimization problem, which can be equivalently restated as follows (see [13]):
The function g_{ k }(x_{ i }) = φ(x_{ i })^{t}β_{ k }denotes the transformation from the time scale k to the canonical time scale. Even for this reformulated problem, however, no guarantee is given that the transformation is monotonically increasing. In the case of a nonmonotone function it is impossible to find an unambiguous transformation between time scales k to l, because in general g_{ k }is not invertible.
To overcome this problem we propose two changes in the setting of canonical correlation analysis:

1.
A set of hyperbolic tangent basis functions is used.

2.
A nonnegativity constraint on the regression parameters is introduced.
The basis functions are defined as
The set of vectors z_{1},...,z_{ d }can either be chosen as the set of vectors x_{1},...,x_{ n }or as a set of d time points equally distributed over the range of the respective time scale. The scaling parameter σ controls the smoothness of the estimated alignment function.
If the parameters β_{1} and β_{2} are nonnegative, the function g_{ k }(x_{ i }) = φ(x_{ i })^{t}β_{ k }is monotonically increasing, because it is a linear combination with nonnegative coefficients of monotonically increasing (hyperbolic tangent) functions. Instead of hyperbolic tangent functions, any other monotonically increasing and bounded basis functions can be used. The alignment problem can now be defined as nonnegative canonical correlation analysis with hyperbolic tangent basis functions. Learning the time warping requires to find the parameter vectors β_{1} and β_{2} that minimize the objective function
We solve this problems iteratively by gradient descent. In a first step the objective function is minimized over β_{1} while keeping β_{2} fixed. Then the length of the vector β_{1} is normalized to fulfill the constraint β_{1} = 1. In a second step the objective is minimized over β_{2} while keeping β_{1} fixed, and β_{2} is normalized accordingly. In each step of the iteration we have to solve a nonnegative leastsquares problem for which we use the LawsonHanson algorithm [14].
Using the above definition of the correlation problem we can easily extend the correlation coefficient to a robust version that is less sensitive to outliers. For that purpose the squared loss is replaced by Huber's robust loss function (Eq. 10)
Optimization of the robust CCA functional is similar to its quadratic counterpart (15), but with an additional inner loop that solves the robust nonnegative leastsquares problems by an iteratively reweighted nonnegative leastsquares algorithm.
Multiple canonical correlation analysis
Sometimes there are only a very few peptides that are measured in both runs. In the case where one has more than two experiments one can benefit from multiple datasets to increase the size of the training dataset. The problem of canonical correlation analysis can be extended to multiple correlation analysis [15, 16]. First notice that one can alternatively reformulate the two constraints β_{1} = 1 and β_{2} = 1 in Equation (13) to one single constraint β_{1} + β_{2} = 2 [17]. A possible extension of canonical correlation analysis to K time series is then defined by
This problem is again solved iteratively by minimizing the objective function with respect to one vector β_{ k }while keeping the other vectors β_{ l }, l ≠ k fixed. The pseudo code is given in Figure 5.
References
 1.
Nielsen NPV, Carstensen JM, Smedsgaard J: Aligning of single and multiple wavelength chromatographic profiles for chemometric data analysis using correlation optimised warping. J of Chromatography A. 1998, 805: 1735. 10.1016/S00219673(98)000211.
 2.
Listgarten J, Neal RM, Roweis ST, Emili A: Multiple alignment of continuous time series. Neural Information Processing Systems. 2005, 17: 817824.
 3.
Listgarten J, Neal RM, Roweis ST, Wong P, Emili A: Difference detection in LCMS data for protein biomarker discovery. Bioinformatics. 2007, 23: e1981204. 10.1093/bioinformatics/btl326.
 4.
Tibshirani R, Hastie T, Narasimhan B, Soltys S, Shi G, Koong A, Le QT: Sample classification from protein mass spectrometry, by peak probability contrasts. Bioinformatics. 2004, 20: 30343044. 10.1093/bioinformatics/bth357.
 5.
Kirchner M, Saussen B, Steen H, Steen JA, Hamprecht FA: amsrpm: robust point matching for retention time alignment of LC/MS data with R. Journal of Statistical Software. 2007, 18:
 6.
Fischer B, Grossmann J, Roth V, Baginsky S, Gruissem W, Buhmann JM: Semisupervised LC/MS alignment for differential proteomics. Bioinformatics. 2006, 22 (14): e132e140. 10.1093/bioinformatics/btl219.
 7.
Tang H, Arnold RJ, Alves P, Xun Z, Clemmer DE, Novotny MV, Reilly JP, Radivojac P: A computational approach toward labelfree protein quantification using predicted peptide detectability. Bioinformatics. 2006, 22 (14): e481e488. 10.1093/bioinformatics/btl237.
 8.
Aebersold R, Mann M: Mass spectrometrybased proteomics. Nature. 2003, 422: 198207. 10.1038/nature01511.
 9.
Sadygov RG, Cociorva D, JRY : Largescale database searching using tandem mass spectra: looking up the answer in the back of the book. Nature Methods. 2004, 1 (3): 195202. 10.1038/nmeth725.
 10.
Huber P: Robust statistics. 1981, New York: Wiley
 11.
Hotelling H: Relations between two sets of variates. Biometrica. 1936, 28: 321377.
 12.
Hardoon DR, Szedmak S, ShaweTaylor J: Canonical correlation analysis: an overview with application to learning methods. Neural Computation. 2004, 16: 26392664. 10.1162/0899766042321814.
 13.
Kuss M, Graepel T: The geometry of kernel canonical correlation analysis. Tech Rep TR108. 2003, Max Planck Institute for Biological Cybernetics, Tübingen, Germany
 14.
Lawson CL, Hanson RJ: Solving least square problems. 1974, Prentice Hall, chap 23:
 15.
Yamanishi Y, Vert JP, Nakaya A, Kanehisa M: Extraction of correlated gene clusters from multiple genomic data by generalized kernel canonical correlation analysis. Bioinformatics. 2003, 9 (Suppl 1): i323i330. 10.1093/bioinformatics/btg1045.
 16.
Bach FR, Jordan MI: Kernel independent component analysis. Journal of Machine Learning Research. 2002, 3: 148. 10.1162/153244303768966085.
 17.
Via J, Santamaria I, Perez J: Canonical correlation analysis (CCA) algorithms for multiple data sets: application to blind simo equalization. European Signal Processing Conference. 2005
Acknowledgements
The authors like to thank J. Grossmann, S. Baginsky and W. Gruissem for valuable discussions and the competence center of systems physiology and metabolic diseases (ETH Zurich), for support.
This article has been published as part of BMC Bioinformatics Volume 8 Supplement 10, 2007: Neural Information Processing Systems (NIPS) workshop on New Problems and Methods in Computational Biology. The full contents of the supplement are available online at http://www.biomedcentral.com/14712105/8?issue=S10.
Author information
Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors' contributions
All authors developed the methods, designed and performed comparisons of methods, and wrote the manuscript.
Rights and permissions
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Fischer, B., Roth, V. & Buhmann, J.M. Timeseries alignment by nonnegative multiple generalized canonical correlation analysis. BMC Bioinformatics 8, S4 (2007). https://doi.org/10.1186/147121058S10S4
Published:
Keywords
 False Discovery Rate
 Canonical Correlation Analysis
 Ridge Regression
 Thin Plate Spline
 Differential Protein Expression