 Methodology article
 Open Access
 Published:
Using Generalized Procrustes Analysis (GPA) for normalization of cDNA microarray data
BMC Bioinformatics volume 9, Article number: 25 (2008)
Abstract
Background
Normalization is essential in duallabelled microarray data analysis to remove nonbiological variations and systematic biases. Many normalization methods have been used to remove such biases within slides (Global, Lowess) and across slides (Scale, Quantile and VSN). However, all these popular approaches have critical assumptions about data distribution, which is often not valid in practice.
Results
In this study, we propose a novel assumptionfree normalization method based on the Generalized Procrustes Analysis (GPA) algorithm. Using experimental and simulated normal microarray data and boutique array data, we systemically evaluate the ability of the GPA method in normalization compared with six other popular normalization methods including Global, Lowess, Scale, Quantile, VSN, and one boutique arrayspecific housekeeping gene method. The assessment of these methods is based on three different empirical criteria: acrossslide variability, the KolmogorovSmirnov (KS) statistic and the mean square error (MSE). Compared with other methods, the GPA method performs effectively and consistently better in reducing acrossslide variability and removing systematic bias.
Conclusion
The GPA method is an effective normalization approach for microarray data analysis. In particular, it is free from the statistical and biological assumptions inherent in other normalization methods that are often difficult to validate. Therefore, the GPA method has a major advantage in that it can be applied to diverse types of array sets, especially to the boutique array where the majority of genes may be differentially expressed.
Background
The cDNA microarray is a widely used highthroughput technique for gene expression profiling, especially for organisms whose genome sequences are unavailable. However, in microarray experiments, there exist many nonrandom variations and systematic biases, which can confound the extraction of the true fluorescence intensity signals, and thus compromise downstream data analysis and interpretation of the experimental data. Therefore, proper data normalization is required to remove these biases before accurate identification of differential gene expression [1–4].
The main objective of normalization is to ensure that measured intensities within and across slides are comparable. Based on different biological or statistical assumptions about data distribution or experimental design, various normalization methods have been proposed. The housekeeping gene method [5] is an early normalization method, which assumes that the expression levels of housekeeping genes remain constant even when the expression of many other genes is substantially changed. However, many socalled housekeeping genes have been reported to exhibit considerable variability under different experimental conditions and different tissues [6], making them unsuitable and unrepresentative of the whole expression intensity range. The Global normalization approach [5] assumes that the center (mean or median) of the distribution of log ratio M values in each slide is zero. However, the Global normalization method does not consider intensitydependent and spatiallydependent effects, which are usually major biases among the slides. In order to remove such biases, Yang et al. [4] proposed one local regression smoothing procedure (Lowess) that is applied to each slide separately to normalize the log ratio intensities. Lowess normalization has been one of the most popular methods but it has two important assumptions. Lowess assumes that most genes on the array are not differentially expressed across the experiments and also that the numbers of up and downregulated genes at each intensity level are roughly equal in each slide. Other methods including the semiparametric [2], neural network [7], and common array dyeswap methods [8] have been proposed to remove intensitydependent biases.
These various methods can effectively remove the intensitydependent or spatiallydependent biases within each slide. However, they do not account for the intensitydependent differences across multiple slides, which can introduce undue weighting of some slides to an average of logratios across slides in the subsequent data analysis [4]. Scale normalization [4] is one popular approach for such acrossslide normalization [3, 9], in which log ratio intensities are assumed to follow a normal distribution with expectation zero and homogeneity of variance across replicated arrays. Other effective acrossslide normalization methods include Quantile [10] and Variance stabilization normalization (VSN) [11]. Quantile normalization was initially developed for the Affymetrix single channel chip [10], and then extended for two colour cDNA microarrays in the Limma package of the Bioconductor project [12]. It relies on the assumption that the probe intensities for each array in a set of replicated arrays are approximately equally distributed. The goal therefore is to adjust for the difference in distribution among multiple slides, and data points are shifted such that the sample densities of slides are identical. In contrast, the VSN method assumes that most of the genes on the arrays are not differentially expressed in a given experiment and utilizes the arcsine rather than log transformation to stabilize the variance so as to remove the dependence of the variance on the total intensity. This gives genes with higher intensities an equal chance of being ranked high as genes with lower intensity. VSN has been used for both the Affymetrix [13] and cDNA microarray platforms [14].
While many different normalization methods are available and diverse strategies are implicated, most of them require certain critical biological or statistical assumptions about data distribution. For example, one usual assumption underlying the Global, Scale, Lowess and VSN methods is that the array contains many nondifferentially expressed genes. The assumption on data distribution inherent in these methods may not be valid in practice. For example, in custommade boutique arrays most of genes are expected to be differentially expressed [15, 16]. Most of the above normalization methods are inappropriate. Although some novel methods have been proposed for such boutique arrays, including the housekeeping gene [15], Zipf's law [17] and the mixture model based methods [18], they still have their own assumptions. The commonly used housekeeping gene method assumes that a set of prior housekeeping genes exists in the microarray in similar expression patterns, and could be utilized for Lowess normalization. However, the hybridization signals from these proposed housekeeping genes may not span the entire fluorescence range produced by boutique arrays. Zipf's law method [17] assumes that the microarray data set exhibits an observed powerlaw distribution with an exponent close to 1, whereas the mixture model based method [18] assumes that the log ratio of intensity in each channel has a Gamma distribution. Although many available normalization methods are effective for removing some types of biases among arrays, their own assumptions about data distribution may limit their application, or even introduce new biases. There is a clear need for developing versatile and robust methods for normalization of microarray data.
Here we present evidence to show that the Generalized Procrustes Analysis [19–21], or GPA, is a powerful statistical method for normalization of microarray data. The GPA method differs from other methodologies in that it has no assumptions about data distributions, which delineates its main advantage over the other methods. Procrustes analysis is one of the leastsquares methods for translation, rotation, scaling and aligning matrices of corresponding coordinates to maximize their agreement [19–21]. The transformation parameters are computed in a direct and efficient manner based on a selected set of corresponding point coordinates. Microarray data are matrices of colour intensities. Replicated slides are matrices of similar configurations and are therefore amenable to Procrustes analysis. On the basis of publicly available and simulated data, our GPAbased normalization strategy is systemically compared with six other popular normalization methods including two withinslide methods (Global and Lowess), three acrossslide methods (Scale, Quantile and VSN), and one boutique array specific housekeeping gene method. The assessment of these methods is based on three empirical criteria: variability among replicated slides [3, 22], the KolmogorovSmirnov statistic [17, 23] and the mean square error [10].
Results
Generalized Procrustes Analysis (GPA) in normalization of microarray data
GPA is a standard multivariate statistical method widely applied in shape analysis to find the optimal superimposition of two or multiple configurations [19–21]. The algorithm involves three transformations: translation, rotation and scaling. Translation is a movement in which the centroid of each configuration is shifted to the common origin by subtracting centroid coordinate. Rotation is a fixed displacement of all points by a constant angle, keeping the distance of each point from the centroid unchanged. Scaling is a stretching or shrinking of all points by a constant amount in a straight line from the point to the centroid of the configuration. The optimal transformation is defined as one with the smallest sum of the squared distances among corresponding points in the configurations. In our study GPA method is used to minimize the deviation of signal intensities among microarray slides. A detailed geometric transformation of microarray MA plots in GPA normalization is illustrated in Figure 1 with one set of simulated microarray data. Figure 1(a) shows the transformations for one slide and Figure 1(b) shows the superimposition among multiple slides (4 here) after each GPA transformation procedure. Two characters of GPA normalization are that it does not change the relative position of points (genes) within each MA plot and the transformations (translation, rotation and scaling) are based on a global optimization instead of local optimization.
Strategy for comparison of normalization methods
Based on the different data sets, we compared our GPAbased method with six other normalization methods, including Global [5], Lowess [4], Scale [4], Quantile [10], VSN [11], and the housekeeping gene method for boutique array [15]. The comparison includes three levels. We firstly evaluated the performance of these different normalization methods in removing biases individually, no matter what strategies are behind them. Thereafter, we systematically compared several pairs of withinslide and acrossslide normalization methods to (1) evaluate the potential of combinations of different methods in normalization procedures, and (2) assess the ability of decreasing acrossslide bias of the GPA method compared to other acrossslide normalization methods based on the same withinslide normalization background. This bears significance in practice since it is often necessary to combine different normalization strategies to decrease variation and potential bias within each slide and across slides. Thirdly, for the boutique data in which common normalization methods are not suitable, we evaluated the GPA method with the housekeeping gene normalization method without other methods involved.
We first evaluated the performance of these normalization methods on two real microarray data sets through comparing data variability and similarity of data distribution among replicated slides. The rationale behind these two criteria is that an effective normalization method should result in lower replicate variability, and more similar (ideally identical) data distributions for replicated slides. Then we applied two simulation methods to simulate several types of microarray data. Mean square error (MSE) was used to evaluate different normalization methods through calculating the true difference between simulated data and normalized data. For the boutique array type, both real data and simulated data were utilized and subjected to these three empirical criteria. In addition, the differential effects of these normalization methods on MA plots for both real data and simulated data are showed in Additional files 1, 2.
Comparison based on the criterion of replicate variability
The criterion of replicate variability is based on the rationale that the expression level of a gene should ideally remain the same across multiple replicated slides. For N replicated slides, the variability of N values for each gene can therefore be used to compare normalization methods [3, 22]. The standard deviation for gene g (σ_{g}) can be estimated as
where N is the number of replicates in the data set, ${M}_{gi}^{\ast}$ is the normalized log_{2}(R/G) value for gene g in slide i, while ${\overline{M}}_{g.}$ is the average log ratio intensity over the slides for gene g. A smaller ${\widehat{\sigma}}_{g}$ is indicative of a more effective normalization procedure. The mean of such ${\widehat{\sigma}}_{g}$ estimates over all genes is a global measure of the performance of the normalization methods, with smaller mean ${\widehat{\sigma}}_{g}$ indicative of better performance of the normalization methods.
Figure 2 shows bar plots of the variance estimates for the (a) swirl zebrafish and (b) HCT116 cancer data sets. Each bar represents the mean value of replicate variability ${\widehat{\sigma}}_{g}$ for all genes. For both data sets, all normalization methods decrease variability of the raw data. However, the GPA method alone yields lower variability than the Lowess, Quantile, Global, and Scale methods do. A Wilcoxon test indicates that the differences are significant (p < 0.01). Here the VSN method performs better than the GPA method, which is expected because VSN method specifically aims to stabilize the variance across the replicated arrays.
When we compare the acrossslide normalization methods based on the same withinslide normalization background (after Global or Lowess normalization), we can see (1) different combinations of within and acrossslide normalization methods can further reduce the variability values (Figure 2), and (2) the GPA method can result in a greater decrease than Scale and Quantile do (p < 0.01). It is particularly evident in the combination of Lowess and GPA methods compared with other dual normalizations including GlobalScale, GlobalQuantile, as well as LowessScale, LowessQuantile pairs. It is also somewhat better than that of the VSN method (0.1102 in swirl data and 0.2793 in HCT116 cancer data) (p < 0.01). In conclusion, our GPA method provides greater reduction of replicate error individually and in combination with other methods such as Lowess.
Comparison using the KolmogorovSmirnov (KS) test
The KolmogorovSmirnov (KS) test is a goodnessoffit test of two continuous distributions. It is used as a criterion for assessing normalization methods and is based on the rationale that an effective normalization procedure should result in two similar (ideally identical) distributions with a small, ideally zerovalued, KS statistic [17, 23]. In contrast, two different distributions will generate a large KS statistic.
Figure 3(a) shows that for the swirl data set the KS statistic for the GPA normalization method is much lower than that for the Global, Lowess, Scale and VSN methods alone. However, as expected, the KS statistic is lowest with Quantile which forces the empirical distributions in different slides to be identical. This also reveals that the Quantile method is an aggressive normalization process as originally noted by [10]. Except for Quantile normalization, the different combinations of within and acrossslide normalization methods show that Scale, VSN, GPA can decrease the discrepancy of data distribution after withinslide normalization (Global or Lowess), but GPA effect is particularly evident (Figure 3(a)). The combination of Lowess and GPA methods produces a lower KS value than other methods or method pairs. A similar result can be observed with the HCT116 cancer data set (Figure 3(b)) except that VSN is slightly better than GPA alone, but is somewhat outperformed by the LowessGPA pair (0.1003 vs. 0.097). For the HCT116 cancer data, although variability is decreased after Lowess or Global normalizations (Figure 2(b)), and an ideal MA plot is produced after Lowess normalization, the discrepancies of data distribution among slides are increased. This is an example that the contributions of withinslide based normalization (Lowess) and acrossslide based normalization differ in various data types. Overall, the GPA method results in a more similarly distributed data than the other four normalization methods.
Comparison using the mean square error (MSE) criterion
We used a data simulation study to further test the GPA method. The advantage of using a simulated data set is that the true intensities are known, so we can assess the accuracy and precision of normalized data more systematically. Mean square error (MSE) is a widely used comparison criterion, which can calculate the true difference between simulated and normalized data [10, 24]. Denote M_{ ji }as the true expression logratio for the jth gene of ith replicate, ${\widehat{M}}_{ji}$ as the estimated value for M_{ ji }, and ${\overline{M}}_{j.}$ as the mean of ${\widehat{M}}_{ji}$(i = 1,2, ...N, j = 1, 2, ..., the number of genes) in N replicates. MSE for the jth gene is defined as
Note that MSE is decomposed into variance and squared bias. The variance component (ν) is an index of precision and the bias component (β) is an index of accuracy. Obtaining data with satisfactory precision and accuracy has been one of the biggest challenges in the application of microarrays. For this reason, MSE is an excellent criterion for evaluating alternative normalization methods [3, 10], with smaller ν and β values indicating better normalization.
Two different methods to simulate microarray data were used: one is a parameterized random signal model from the study of [25], which is flexible and has been widely utilized; the other is recently published SIMAGE method [26], which simulates microarray data based on the estimated parameters from real microarray data. Based on the first method, two types of data are simulated, one without dye bias and one with the bananashaped dye bias. Four different levels (3, 5, 10 and 30%) of differentially expressed genes are considered. The ratio of the upregulated genes to the downregulated genes is 1:1. The MSE values for the data set with 5% differential genes following different normalization methods are shown in Table 1. In both cases, the median of variance (ν) is several times lower with the GPA normalization individually than with the other normalization methods. The median of bias (β) with GPA normalization is also significantly lower than with the other methods (p < 0.01 by Wilcoxon test). This trend is observed for other data sets with 3, 10, 30% differentially expressed genes (Additional file 3). Based on the SIMAGE method, three sets of microarray data are simulated with 5, 10, 30 % differential expressed genes (up:down = 1:1). As shown in Table 2, our GPA method produced the lowest ν and β values compared with all other methods in three data sets (p < 0.01 by Wilcoxon test). These results indicate that the GPA method performs effectively and consistently better in reducing acrossslide variability and removing systematic bias.
Since the accuracy and efficiency of acrossnormalization method may depend on the number of replicate slides, we also conducted a series of simulation studies to verify the effect of number of replicate slides on the performance of the GPA method compared with other methods. In practice, four slides are commonly considered as the minimum number for one reliable cDNA array experiment. For this reason we have simulated microarray data from four to eight replicates. We found that, with replicate slides from 4 to 8, the GPA method yields lower MSE (sum of variance and squared bias) than other methods. In general, GPA has the best and most consistent performance in decreasing variance and bias across slides (in GlobalGPA and LowessGPA pairs). Given these results, we recommend using the GPA method with withinslide normalization methods such as Lowess whenever feasible, especially when the number of replicate slides is smaller than four.
Application of the GPA method for boutique arrays
Being relatively assumptionfree, the GPA method may be particularly useful in analyzing boutique arrays where the majority of genes may be differentially expressed. Here we show that the GPA method is superior to the popular housekeeping gene normalization approach. We used one real apoptosis microarray data set to evaluate these two methods. The hypothesis behind this type of microarray data is that the expression of most genes changed significantly, so most normalization methods are not appropriate. Table 3 shows that our GPA normalization can yield lower replicate variability and more similar data distribution (KS statistic) compared to housekeeping gene normalization. This is further supported in the simulated boutique arrays with two simulation methods (Tables 4, 5). The simulation data sets used here are an extreme example for boutique arrays. Approximately 60 percent of the genes are differentially expressed and three different values (5:5, 7:3 and 9:1) are applied for the ratio of upregulated to downregulated genes. The medians of ν and β are smaller with GPA normalization than with the housekeeping gene normalization for diverse cases. These results demonstrate that the GPA method performs better, with consistently smaller ν and β values, than the housekeeping gene method.
In order to further test the ability of GPA on boutique arrays and illustrate its advantage of being assumptionfree, we simulate another extreme example of boutique arrays with 90% upregulated genes at 10 fold and 10% downregulated genes at 2 fold. In this case, the housekeeping gene normalization method cannot work since there are no assumed prior housekeeping genes in the experiment, whereas the GPA method can solve this problem. Figure 4 shows a geometric transformation of such extreme boutique arrays after GPA normalization procedures.
Discussion
We demonstrate the potential of a GPAbased method for normalizing microarray data. Data normalization is an essential step for the spotted cDNA array and exerts important effects on the subsequent data analysis leading to identification of differentially expressed genes, and clustering and pathway analyses. Many normalization methods have been proposed, however, almost all the available normalization methods are based on biological or statistical assumptions about data distribution which are often not valid in practice. For example, the usual assumption that the array contains a large enough assortment of random genes, most of which are not differentially expressed across the experiments, is inherent in many existing methods including the Global, Scale, Lowess and VSN methods considered here. The assumption is particularly problematic for custommade boutique arrays where most genes are expected to be differentially expressed, or are directly implicated in the biological process being studied. Although some novel methods have been proposed for such boutique arrays, including the housekeeping gene method [15], Zipf's law method [17] and the mixture model based method [18], these too have their own assumptions about data distribution and suffer from similar problems. Therefore normalization methods without such assumptions must be developed. We were motivated to address this question largely because we have developed a custom cDNA array [27]. With GPA normalization, there is no need to assume that expression data follow any particular distribution, for example, that the distributions of up and downregulated genes are symmetric.
Procrustes analysis is a powerful leastsquares approach by translating, rotating and isotropic scaling to achieve a better fit among matrices of similar configurations. It has been widely applied in many fields such as statistical analysis of shapes [19], analytical chemistry [28], photogrammetry [29] and protein structural alignment [30]. Its strength in dealing with similarity among shapes or configurations led us to consider its potential for microarray data normalization analysis in balancing signal intensity level across different slides. The GPA method only requires replicate slides in the experiment, but conducting replicate experiments is a very popular experimental design since it can greatly ascertain experimental errors and reduce noise bias in the measurement and greatly help us to analyze the variability across slides.
We utilized both the real and simulated data to compare the GPAbased approach with six other normalization methods: Global, Lowess, Scale, Quantile, VSN, and one boutique array specific housekeeping gene method. For both real data sets, the GPA method showed a relatively better performance in decreasing replicate variability and increasing similarity of data distribution than other methods. Global and Scale methods performed worse in both criteria. Both VSN and Quantile performed best only in one case of variance or KS statistic because their assumptions specifically favour one of them. Although the Lowess method can decrease variability, it showed no advantage in decreasing discrepancy of data distribution. A better performance of GPA than other acrossslide based methods can still be observed on the same withinslide normalization background. The LowessGPA pair performed better than other dual normalizations, implying a better combination potential. Furthermore, we utilized two different parameter models to simulate several types of microarray data, which were used to accurately evaluate normalization effects through assessing true difference between known true data and normalized data. The results indicate that our GPA method outperformed other methods in reducing acrossslide variability and removing systematic bias in microarray data. Overall the GPA normalization can effectively decrease the replicate variability, discrepancy of data distribution among slides and retrieve underlying biological information. It not only can be used individually to balance the bias across slides, but also in practice can be combined with other methods such as Lowess to produce better results. Moreover, the combination of GPA with Lowess can reduce discrepancies in data distribution as a result of Lowess. This is logical because Lowess and GPA have different withinslide based and acrossslide based strategies. Furthermore, the application of GPA normalization in analyzing the boutique array was demonstrated in both the real and simulated boutique arrays. The GPA method not only performs consistently better than the popular boutique arrayspecific housekeeping gene normalization method, but can also be used where other methods are inapplicable.
Conclusion
We have shown that GPA is a promising normalization method for microarray data analysis. In particular, GPA method is free of assumptions about data distribution inherent in other existing approaches. This makes GPA versatile and robust for diverse types of array sets, especially for custommade boutique arrays where the majority of genes may be differentially expressed.
Methods
Experimental data
Swirl zebrafish data set
The swirl zebrafish data set is available at Bioconductor [31]. The data set has been previously utilized in several studies on normalization procedures [7, 32]. The main goal of this experiment was to identify genes with altered expression in the Swirl mutant compared to the wild type zebrafish. There are 8448 genes in each slide and all experiments were replicated four times including two dyeswaps.
HCT116 data set
The microaray data set of HCT116 cancer cell line was retrieved from [33] which identified the dose and timedependent changes of gene expression in HCT116 cell lines after treatment of the topoisomerase inhibitor 1 camptothecin compound (CPT). There are 10 slides in total and each slide contains 2208 cDNA clones. This set of data was used previously in one study to compare the effectiveness of different normalization methods [34].
Mouse apoptosis boutique microarray
The custom boutique array data set was retrieved from [35]. The microarray experiment aimed to identify differences in apoptotic mechanisms between two different mouse cell lines. There are 5 replicated slides and each slide contains 1024 spots. The genes selected for this array are involved in apoptosis; therefore it is expected that a high proportion of genes are highly differentially expressed. The data set has been used previously for Zipf's law method in boutique microarray data normalization [17].
Data simulation study
Simulation based on Balagurunathan's method
The generation of our first simulation is based on a parameterized random signal model [25], which has been utilized in several papers [24, 36–41]. The precise simulation procedure is described in the Additional file 4. A series of data sets were produced with 1000 genes in 10 replicated slides. For each realization, we replicated the data set 100 times. Specific characteristics of these data sets are given below.

1.
Simulation data 1 is a 1000 × 10 log ratio intensity of expression matrix. Based on the general assumption that most genes are not differentially expressed (normal array), our data was simulated to hold 3, 5, 10, and 30 percent levels of differentially expressed genes, at the same time the proportion of upregulated genes equals that of downregulated genes without dye bias.

2.
Simulation data 2 is the same as Simulation data 1, but with dye bias which generates the banana shaped MA plot which is commonly observed in real cDNA microarray data sets.

3.
Simulation data 3 is a 1000 × 10 log ratio intensity of expression matrix which is simulated as the boutique arrays in which 60 percent of genes are differentially expressed. The ratios of the upregulated genes to the downregulated genes are 5:5, 7:3, and 9:1.
Simulation based on the SIMAGE method
With the SIMAGE method [26], simulated microarray data are divided into gene expression and biases from several sources including a raw background gradient signal, a channel effect, a spot pin effect, a nonlinear effect, a quantization and saturation effect, and random error due to unknown factors. All these effects are specified in 29 parameters in SIMAGE, which were roughly estimated from real microarray data. Based on these estimated parameters, the SIMAGE method simulated microarray data mimicking the real experimental data as close as possible. The detailed input parameters in this study were described in the Additional file 5. All microarray dataset included 1000 genes in 50 replicated slides. For normal microarray data, three differential levels (5, 10, 30 %) were considered with same ratio (1:1) of upregulated gene to downregulated gene. For boutique array, 60 percent genes were differentially expressed and three ratios (5:5, 7:3 and 9:1) of upregulated to downregulated genes were considered.
Generalized Procrustes Analysis (GPA)
The Procrustes analysis method described in this paper is available as the package vegan in the R project [42]. Scripts can be requested from the first author.
We consider the logtransformed data, log ratio intensity M = log_{2}(R/G) and the mean log intensity $A={\mathrm{log}}_{2}\sqrt{RG}$ where R and G are the red and green signal intensities respectively. We organized our logtransformed data in N replicated arrays as N series of matrices with g rows and two columns where g is the number of gene probes on the slide and the two columns are the log ratio intensity and mean log intensity on a scale (M,A). For each cDNA spot j in the ith slide, it corresponds to a vector ${\overrightarrow{w}}_{ji}=({M}_{ji},{A}_{ji})$ (j = 1,2,...,g; i = 1,2,...N). M_{ ji }and A_{ ji }are the measurement of M and A for gene j in replication i. Our expression level matrix of the ith slide becomes the matrix ${S}_{i}={({\overrightarrow{w}}_{1i},{\overrightarrow{w}}_{2i},\mathrm{...},{\overrightarrow{w}}_{gi})}^{T}$, where i = 1, 2, ..., N. Firstly, a reference array S_{0} is generated through computing the median intensity of each gene over all slides. Then each slide S_{ i }(i = 1,2,..., N) is translated so that its centroid is at the centroid point of the reference array S_{0}. Let S_{ i }be rotated and scaled such that the residual discrepancy between S_{ i }and S_{0} is minimized. We wish to find the orthogonal matrix H_{ i }with (H_{ i }H_{ i }^{T}= I) and scale factor c_{ i }so as to minimize the sum of squared distances between the corresponding points in S_{ i }and S_{0}, i.e.
where $L={S}_{i}{H}_{i}^{T}{S}_{0}^{T}$
A perfect match gives M^{2} = 0. To minimize M^{2}, we need
H_{ i }= VU^{T}, where V and U are products of the singular value decomposition of S_{ i }${S}_{0}^{T}$ = ULV^{T}[43].
Therefore, the output data after our Procrustes normalization method on S_{ i }is S_{ i }* = c_{ i }S_{ i }H_{i.}
In this study GPA normalization employs a reference array which is established from median values across all slides. This idea of a reference array is popularly utilized in several other normalization methods including Qspline [3, 22], Iset [10], Zipf [17], and Quantile [10]. Median or mean valuebased reference array is believed to be a better choice for such kind of strategy [10, 44], which is also supported by our further study. Using different types of experimental and simulated data above, we found GPA normalizations with median and mean valuebased reference arrays always exhibit a stable and relatively better performance than ones with individual reference arrays (details in Additional files 6, 7, 8 and 9).
The GPA method needs approximately a few seconds on a regular PC platform to normalize the data. Since the GPA algorithm computes the matrix from all the spots, it requires that all the spots have values. Here we used Knearest neighbor averaging scheme [45] to impute missing values.
Other normalization methods
In our study six other normalization methods were compared against our GPAbased method. These include two withinslide methods (Global [5] and Lowess [4]), three acrossslide methods (Scale [4], Quantile [10] and VSN [11]) and the housekeeping gene method for boutique array [15]. All these normalization methods are available at Bioconductor [31]. To obtain the detailed algorithms and formulae used in these approaches please refer to the original references.
References
 1.
Chou JW, Paules RS, Bushel PR: Systematic variation normalization in microarray data to get gene expression comparison unbiased. J Bioinform Comput Biol 2005, 3(2):225–241. 10.1142/S0219720005001028
 2.
Eckel JE, Gennings C, Therneau TM, Burgoon LD, Boverhof DR, Zacharewski TR: Normalization of twochannel microarray experiments: a semiparametric approach. Bioinformatics 2005, 21(7):1078–1083. 10.1093/bioinformatics/bti105
 3.
Park T, Yi SG, Kang SH, Lee S, Lee YS, Simon R: Evaluation of normalization methods for microarray data. BMC Bioinformatics 2003, 4: 33. 10.1186/14712105433
 4.
Yang YH, Dudoit S, Luu P, Lin DM, Peng V, Ngai J, Speed TP: Normalization for cDNA microarray data: a robust composite method addressing single and multiple slide systematic variation. Nucleic Acids Res 2002, 30(4):e15. 10.1093/nar/30.4.e15
 5.
Zien A, Aigner T, Zimmer R, Lengauer T: Centralization: a new method for the normalization of gene expression data. Bioinformatics 2001, 17 Suppl 1: S323–31.
 6.
Kouadjo KE, Nishida Y, CadrinGirard JF, Yoshioka M, StAmand J: Housekeeping and tissuespecific genes in mouse tissues. BMC genomics 2007, 8: 127. 10.1186/147121648127
 7.
Tarca AL, Cooke JE, Mackay J: A robust neural networks approach for spatial and intensitydependent normalization of cDNA microarray data. Bioinformatics 2005, 21(11):2674–2683. 10.1093/bioinformatics/bti397
 8.
Dabney AR, Storey JD: A New Approach to IntensityDependent Normalization of TwoChannel Microarrays. Biostatistics 2006.
 9.
Smyth GK, Speed T: Normalization of cDNA microarray data. Methods 2003, 31(4):265–273. 10.1016/S10462023(03)001555
 10.
Bolstad BM, Irizarry RA, Astrand M, Speed TP: A comparison of normalization methods for high density oligonucleotide array data based on variance and bias. Bioinformatics 2003, 19(2):185–193. 10.1093/bioinformatics/19.2.185
 11.
Huber W, von Heydebreck A, Sultmann H, Poustka A, Vingron M: Variance stabilization applied to microarray data calibration and to the quantification of differential expression. Bioinformatics (Oxford, England) 2002, 18 Suppl 1: S96–104.
 12.
Smyth GK, Ritchie M, Thorne N, Wettenhall J: Limma: linear models for microarray data. User’s guide.2005. [http://bioinf.wehi.edu.au/limma/]
 13.
Hummel M, Bentink S, Berger H, Klapper W, Wessendorf S, Barth TF, Bernd HW, Cogliatti SB, Dierlamm J, Feller AC, Hansmann ML, Haralambieva E, Harder L, Hasenclever D, Kuhn M, Lenze D, Lichter P, MartinSubero JI, Moller P, MullerHermelink HK, Ott G, Parwaresch RM, Pott C, Rosenwald A, Rosolowski M, Schwaenen C, Sturzenhofecker B, Szczepanowski M, Trautmann H, Wacker HH, Spang R, Loeffler M, Trumper L, Stein H, Siebert R: A biologic definition of Burkitt's lymphoma from transcriptional and genomic profiling. N Engl J Med 2006, 354(23):2419–2430. 10.1056/NEJMoa055351
 14.
Gurok U, Steinhoff C, Lipkowitz B, Ropers HH, Scharff C, Nuber UA: Gene expression changes in the course of neural progenitor cell differentiation. J Neurosci 2004, 24(26):5982–6002. 10.1523/JNEUROSCI.080904.2004
 15.
Wilson DL, Buckley MJ, Helliwell CA, Wilson IW: New normalization methods for cDNA microarray data. Bioinformatics (Oxford, England) 2003, 19(11):1325–1332. 10.1093/bioinformatics/btg146
 16.
Yauk CL, Williams A, Boucher S, Berndt LM, Zhou G, Zheng JL, RowanCarroll A, Dong H, Lambert IB, Douglas GR, Parfett CL: Novel design and controls for focused DNA microarrays: applications in quality assurance/control and normalization for the Health Canada ToxArray. BMC genomics 2006, 7: 266. 10.1186/147121647266
 17.
Lu T, Costello CM, Croucher PJ, Hasler R, Deuschl G, Schreiber S: Can Zipf's law be adapted to normalize microarrays? BMC Bioinformatics 2005, 6: 37. 10.1186/14712105637
 18.
Zhao Y, Li MC, Simon R: An adaptive method for cDNA microarray normalization. BMC Bioinformatics 2005, 6: 28. 10.1186/14712105628
 19.
Goodall C: Procrustes methods in the statistical analysis of shape. Journal of the Royal Statistical Society B 1991, 53(2):285–339.
 20.
Gower JC: Generalized procrustes analysis. Psychometrika 1975, 40: 33–55. 10.1007/BF02291478
 21.
Ten Berge JMF: Orthogonal Procrustes Rotation for Two or More Matrices. Psychometrika 1977, 42(2):267–276. 10.1007/BF02294053
 22.
Workman C, Jensen LJ, Jarmer H, Berka R, Gautier L, Nielser HB, Saxild HH, Nielsen C, Brunak S, Knudsen S: A new nonlinear normalization method for reducing variability in DNA microarray experiments. Genome Biol 2002, 3(9):research0048. 10.1186/gb200239research0048
 23.
Metchev SA, Grindlay JE: A twodimensional KolmogorovSmirnov test for crowded field source detection: ROSAT sources in NGC. MonNotRoyAstronSoc 2002, 335: 73–83.
 24.
Wang D, Huang J, Xie H, Manzella L, Soares MB: A robust twoway semilinear model for normalization of cDNA microarray data. BMC bioinformatics 2005, 6: 14. 10.1186/14712105614
 25.
Balagurunathan Y, Dougherty ER, Chen Y, Bittner ML, Trent JM: Simulation of cDNA microarrays via a parameterized random signal model. Journal of biomedical optics 2002, 7(3):507–523. 10.1117/1.1486246
 26.
Albers CJ, Jansen RC, Kok J, Kuipers OP, van Hijum SA: SIMAGE: simulation of DNAmicroarray gene expression data. BMC bioinformatics 2006, 7: 205. 10.1186/147121057205
 27.
Martyniuk CJ, Xiong H, Crump K, Chiu S, Sardana R, Nadler A, Gerrie ER, Xia X, Trudeau VL: Gene expression profiling in the neuroendocrine brain of male goldfish (Carassius auratus) exposed to 17alphaethinylestradiol. Physiological genomics 2006, 27(3):328–336. 10.1152/physiolgenomics.00090.2006
 28.
Andradea JM, GómezCarracedoa, Krzanowski W, Kubista M: Procrustes rotation in analytical chemistry,a tutorial. Chemometrics and Intelligent Laboratory Systems 2004, 72: 123–132. 10.1016/j.chemolab.2004.01.007
 29.
Akça MD, Institut für Geodäsie und Photogrammetrie (Zürich): Generalized Procrustes analysis and its applications in photogrammetry. Zürich , ETH Swiss Federal Institute of Technology Zurich Institute of Geodesy and Photogrammetry; 2003:OnlineDatei.
 30.
Theobald DL, Wuttke DS: Empirical Bayes hierarchical models for regularizing maximum likelihood estimation in the matrix Gaussian Procrustes problem. Proceedings of the National Academy of Sciences of the United States of America 2006, 103(49):18521–18527. 10.1073/pnas.0508445103
 31.
Bioconductor[http://www.bioconductor.org/]
 32.
Wettenhall JM, Smyth GK: limmaGUI: a graphical user interface for linear modeling of microarray data. Bioinformatics 2004, 20(18):3705–3706. 10.1093/bioinformatics/bth449
 33.
Zhou Y, Gwadry FG, Reinhold WC, Miller LD, Smith LH, Scherf U, Liu ET, Kohn KW, Pommier Y, Weinstein JN: Transcriptional regulation of mitotic genes by camptothecininduced DNA damage: microarray analysis of dose and timedependent effects. Cancer Res 2002, 62(6):1688–1695.
 34.
Yoon D, Yi SG, Kim JH, Park T: Twostage normalization using background intensities in cDNA microarray data. BMC Bioinformatics 2004, 5: 97. 10.1186/14712105597
 35.
Zipf’s normalization software.[http://www.mucosa.de/zipfs/zipfs_normalization.html]
 36.
Zhou X, Wang X, Dougherty ER: Binarization of microarray data on the basis of a mixture model. Molecular cancer therapeutics 2003, 2(7):679–684.
 37.
Balagurunathan Y, Wang N, Dougherty ER, Nguyen D, Chen Y, Bittner ML, Trent J, Carroll R: Noise factor analysis for cDNA microarrays. Journal of biomedical optics 2004, 9(4):663–678. 10.1117/1.1755232
 38.
Hua JB Yoganand and Chen, Yidong and others: Normalization Benefits MicroarrayBased Classification. EURASIP Journal on Bioinformatics and Systems Biology 2006, 2006: Article ID 43056, 13 pages. 10.1155/BSB/2006/43056
 39.
Demirkaya O, Asyali MH, Shoukri MM: Segmentation of cDNA microarray spots using markov random field modeling. Bioinformatics (Oxford, England) 2005, 21(13):2994–3000. 10.1093/bioinformatics/bti455
 40.
Fujita A, Sato JR, Rodrigues Lde O, Ferreira CE, Sogayar MC: Evaluating different methods of microarray data normalization. BMC bioinformatics 2006, 7: 469. 10.1186/147121057469
 41.
Nykter M, Aho T, Ahdesmaki M, Ruusuvuori P, Lehmussola A, YliHarja O: Simulation of microarray data with realistic characteristics. BMC bioinformatics 2006, 7: 349. 10.1186/147121057349
 42.
The R project[http://www.rproject.org/]
 43.
Krzanowski WJ: Principles of Multivariate Analysis: A User's Perspective. In Oxford Statistical Science Series. Oxford , Clarendon Press; 1988.
 44.
Wu W, Dave N, Tseng GC, Richards T, Xing EP, Kaminski N: Comparison of normalization methods for CodeLink Bioarray data. BMC bioinformatics 2005, 6: 309. 10.1186/147121056309
 45.
Troyanskaya O, Cantor M, Sherlock G, Brown P, Hastie T, Tibshirani R, Botstein D, Altman RB: Missing value estimation methods for DNA microarrays. Bioinformatics (Oxford, England) 2001, 17(6):520–525. 10.1093/bioinformatics/17.6.520
Acknowledgements
We would like to dedicate this work to Dr. A. Dabrowski (Dept. of Mathematics, University of Ottawa), who passed away on October 7, 2006. He was keenly interested in microarray data normalization. This project was supported by the NSERC Discovery, Strategic Research, and Research Tools and Instruments Grants (to V.L.T. and X.X.), OGSST (to H.X.), and University of Ottawa International Scholarship (to D.Z.). We thank M. Andrade, K. H. Cheung, L. Jiang, members in Xia Lab for their helpful suggestions and comments on the manuscript.
Author information
Affiliations
Corresponding author
Additional information
Authors' contributions
HX performed all data analysis, programming and wrote the manuscript. DZ, CJM and VLT participated in the design and discussion of this study and editing the manuscript. XX proposed the original idea and supervised the project. All authors have read, and approved the final manuscript.
Electronic supplementary material
The MA plots for real swirl zebrafish data after different normalization methods
Additional file 1: . MA plots were used to give a general description about the effect of different normalizations on the raw microarray data. Based on different assumptions, these normalization methods result in various geometrical effects on the raw Swirl zebrafish data. Lowess method produces an ideal Lowess line along the mean of log intensity. For other methods including GPA without such Lowess type assumption, they can't make the Lowess line around zero along log ratio intensity in each plot. Global method shifts the central of log ratio intensity to zero. Scale method changes the scaling of data along the log ratio intensity directions for every slide. The MA plots for Quantile and VSN are apparently similar to Lowess. For MA plot after GPA normalization, the shifting and rotation of the data in each slide can be observed. Also a more obvious scaling can be observed in MA plot of HCT116 cancer data (Figure not shown). Combinations of different methods produce combinatorial effect for plots. (TIFF 473 KB)
12859_2007_2010_MOESM2_ESM.TIFF
Additional file 2: The MA plots for SIMAGE simulated microarray data after different normalization methods. This data set includes 1000 genes in 50 slides. 5 percent genes are differentially expressed. The ratio of upregulated to downregulated genes is 1:1. Here we showed MA plots for first 10 slides in this data set. (TIFF 420 KB)
12859_2007_2010_MOESM3_ESM.DOC
Additional file 3: The median of the two components of MSE: variance (v) and bias (β) in the simulated data without and with dye bias based on [25] method The levels of differential genes in data set are 3, 5, 10, 30%. The ratio of upregulated to downregulated genes is 1:1. (DOC 131 KB)
12859_2007_2010_MOESM7_ESM.TIFF
Additional file 7: Replicate variability and KS statistic for the swirl zebrafish data set after GPA normalizations with different reference arrays. The upper dashed and lower straight lines indicate variability and KS value for Lowess method, respecitively. (TIFF 1 MB)
12859_2007_2010_MOESM8_ESM.TIFF
Additional file 8: Replicate variability and KS value for swirl zebrafish data after GPA normalizations based on different reference slides, and other normalization methods. Although the GPA normalizations differ based on different reference slides, the overall better performance compared to other methods can be still observed here. (TIFF 4 MB)
12859_2007_2010_MOESM9_ESM.TIFF
Additional file 9: The MSE results for simulated data after GPA normalizations with different reference arrays. The data is simulated by SIMAGE method, include 1000 genes in 50 slides with 5% differentially expressed genes and ratio of upregulated to downregulated genes is 1:1. Med represents median reference slide and Mea represents mean reference slide. (TIFF 2 MB)
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Xiong, H., Zhang, D., Martyniuk, C.J. et al. Using Generalized Procrustes Analysis (GPA) for normalization of cDNA microarray data. BMC Bioinformatics 9, 25 (2008). https://doi.org/10.1186/14712105925
Received:
Accepted:
Published:
Keywords
 Mean Square Error
 Microarray Data
 Normalization Method
 Reference Array
 Generalize Procrustes Analysis