 Methodology article
 Open Access
 Published:
svdPPCS: an effective singular value decompositionbased method for conserved and divergent coexpression gene module identification
BMC Bioinformatics volume 11, Article number: 338 (2010)
Abstract
Background
Comparative analysis of gene expression profiling of multiple biological categories, such as different species of organisms or different kinds of tissue, promises to enhance the fundamental understanding of the universality as well as the specialization of mechanisms and related biological themes. Grouping genes with a similar expression pattern or exhibiting coexpression together is a starting point in understanding and analyzing gene expression data. In recent literature, gene module level analysis is advocated in order to understand biological network design and system behaviors in disease and life processes; however, practical difficulties often lie in the implementation of existing methods.
Results
Using the singular value decomposition (SVD) technique, we developed a new computational tool, named svdPPCS (SVDbased P attern P airing and C hart S plitting), to identify conserved and divergent coexpression modules of two sets of microarray experiments. In the proposed methods, gene modules are identified by splitting the twoway chart coordinated with a pair of left singular vectors factorized from the gene expression matrices of the two biological categories. Importantly, the cutoffs are determined by a datadriven algorithm using the welldefined statistic, SVDp. The implementation was illustrated on two time series microarray data sets generated from the samples of accessory gland (ACG) and malpighian tubule (MT) tissues of the line W^{118} of M. drosophila. Two conserved modules and six divergent modules, each of which has a unique characteristic profile across tissue kinds and aging processes, were identified. The number of genes contained in these models ranged from five to a few hundred. Three to over a hundred GO terms were overrepresented in individual modules with FDR < 0.1. One divergent module suggested the tissuespecific relationship between the expressions of mitochondrionrelated genes and the aging process. This finding, together with others, may be of biological significance. The validity of the proposed SVDbased method was further verified by a simulation study, as well as the comparisons with regression analysis and cubic spline regression analysis plus PAM based clustering.
Conclusions
svdPPCS is a novel computational tool for the comparative analysis of transcriptional profiling. It especially fits the comparison of time series data of related organisms or different tissues of the same organism under equivalent or similar experimental conditions. The general scheme can be directly extended to the comparisons of multiple data sets. It also can be applied to the integration of data sets from different platforms and of different sources.
Background
Comparative analysis of gene expression profiling of multiple biological categories, such as different species of organisms or different kinds of tissue, promises to enhance the fundamental understanding of the universality as well as the specialization of molecular biochemistry mechanisms and related biological themes. Recent studies in this field have led to remarkable results in providing insights to the transcriptional programs of several organisms [1–5]. Grouping genes with a similar expression pattern or exhibiting coexpression together is a starting point in the analysis of gene expression data. In recent literature, gene module level analysis is advocated in order to understand biological network design and system behaviors in diseases and life processes. Various statistical methods, such as clustering algorithms [5], matrix decomposition techniques [6, 7], topology network [8, 9], and the procedure of gene specific model analysis followed by gene clustering (or grouping) [10] have been proposed to identify the individually defined gene modules without much consistency.
Singular value decomposition (SVD) is a wellknown matrix factorization method that has been widely applied in the analysis of microarray data [11–17]. Assume that the data matrix is in the form with genes in rows and arrays in columns, the profiles of the leading right singular vectors of the decomposition (eigengenes) suggest the fundamental gene expression patterns across the arrays, which in turn represent a biological theme if the data is well organized [18]. The squares of the nonnegative singular values represent the relative importance of the corresponding patterns. The left singular vectors contain elements which can be used as confidence scores for separating genes with the same or similar pattern from others [6, 17]. Given a cutoff and a direction (positive or negative), we can extract a gene group which is naturally a coexpression cluster. Such a cluster can also be viewed as a functional module related to the addressed biological theme, such as the aging process analyzed in this paper.
A main challenge in implementing SVDbased module identification algorithms is how to choose the cutoffs. One naïve method is to test the gradient values (such as 0.1, 0.2, ...) and then the decision is made according to the results of functional analysis and comparison. However, practical difficulties often lie in choosing the methods for functional analysis and comparison of gene sets. Another method indirectly decides the cutoffs by specifying the module size or the gene proportion assigned to each module. A variant of the latter method is to set the cutoff at a magnitude equivalent to k (such as 3) multiplies the standard deviation of the vector elements [14]. These methods are widely used but cannot guarantee insights in both the statistical and biological aspects of the cluster. The "gene shaving" algorithm [13] represents a substantial advance in addressing this challenge. It was designed to optimize the size of a gene cluster by maximizing the Gap statistic. Gap is defined as the difference of the ratio of the between and within "mean" gene variances of the cluster and the corresponding ratio of a cluster defined from a null data set. However, in the calculation of between "mean" gene variance, the effects of random arrays and sample groups (or time points for temporal data) can be ambiguous. Furthermore, the sizes of clusters are not directly considered in Gap statistic calculation.
In this paper, we developed a novel computational tool, named svdPPCS (SVDbased P attern P airing and C hart S plitting), to identify the conserved and divergent coexpression modules of two sets of microarray experiments. Our definition of gene modules is proposed in the spirit of Ihmels et al. [6]. The conserved module is defined as a gene group which shows similar coexpression patterns across a set of experimental conditions or a biological theme in the two addressed biological categories. The divergent module is defined as a gene group which demonstrates a coexpression pattern only in one of the two biological categories or whose patterns in them are different. The method is novel and important in that: (1) the conserved and divergent modules are defined in the context of the addressed biological theme, such as in the aging process; (2) the modules are identified through splitting the twoway chart coordinated with a pair of left singular vectors factorized from the gene expression matrices of the two biological categories; and (3) the cutoffs are determined by a datadriven algorithm using a welldefined statistic. The proposed scheme is comparable to the widelyused procedure of genespecific model analysis followed by gene clustering. The advantages of svdPPCS over this routine practice include: (1) the correlations among genes can be considered in the initial stage; (2) the complicated patterns can be easily captured; and (3) the implementation is less subject to the restrictions on the number of time points of temporal microarray data. The proposed method was showcased with two time series microarray data sets generated from the samples of accessory gland (ACG) and malpighian tubule (MT) of wildtype line W^{118} of M. drosophila. The modules identified by svdPPCS were compared with those identified using two alternate methods. A simulation study was further conducted to validate the efficacy of the SVDbased method in data with more complicated patterns.
Results
General scheme of svdPPCS
The svdPPCS method for identifying conserved and divergent modules across two biological categories is depicted in Figure 1. It includes four steps, namely, recognition of fundamental patterns, generation of primary clusters (PCLs), pattern pairing, and extraction of gene modules. In this section, we present this general scheme in combination with the comparative study of two kinds of tissue of M. drosophila. Each of the time series gene expression data sets contains 10 arrays representing 5 time points (see the section of Study on M. drosophila data for details). The techniques to calculate SVDp and to determine the cutoffs are described subsequently.
First of all, the singular value decomposition (SVD) of the n × m matrix measuring n genes and m arrays is calculated individually for each data set. The fundamental patterns of biological importance [3, 12] hidden in the data are recognized through the visualization of the right singular vectors (eigengenes) of the decompositions. In the M. drosophila data, the arrays were previously arranged according to the ages of the flies. Thus, the biological significance of an eigengene regarding the aging process was suggested by the profile of its plot versus arrays (ages). As shown in Figures 2A and 2B, the first eigengene of the ACG data and the second eigengene of the MT data are meaningful because their plots demonstrated apparent structures.
In the second step, primary clusters (PCLs) are generated according to the projections of the gene expression vectors across the arrays onto the eigengenes. That is, if the magnitude of the projection of gene i onto eigengene j is the largest among all the m projections, it will be assigned to the j^{th} PCL. For each data set, the genes are divided into k (<=m) mutually exclusive PCLs. Each PCL is characterized by the profile of the corresponding eigengene. The number of genes assigned to these PCLs is approximately proportional to the magnitudes of the corresponding eigenvalues. The PCL corresponding to the leading fundamental pattern contains the largest proportion of genes. In the analysis of the two M. drosophila data sets, we emptied the PCLs corresponding to the eigengenes 610, and allocated their genes into the remaining PCLs. Figure 2C shows the distribution of the numbers of genes in the five nonempty PCLs on ACG and MT data, respectively. This step is optional and can be skipped in the scenario that only the leading eigengene holds the pattern of biological importance in both data sets.
In the third step, the similarity of the fundamental patterns between the two data sets is assessed through the visualization or correlation analysis of their right singular vectors. Based on the assessment, one or multiple pattern pairs are established. In the M drosophila data, the first eigengene of the ACG subset and the second eigengene of the MT subset had a high correlation (r = 0.88, p < 0.01), thus they formed a pattern pair which can provide biological insights to both tissue kinds. Corresponding to the pattern pair is a couple of primary clusters consisting of the genes to which the contribution of the two eigengenes was the largest among all eigengenes. This process can be directly extended to the comparisons of multiple data sets.
In the fourth step, the genes in either of these two PCLs are mapped onto a coordination system with the two left singular value vectors corresponding to the pattern pair as the xaxis and yaxis, respectively. Given two sets of cutoffs, (a, b) and (c, d), the genes can be divided into at most nine subclusters as shown in Figure 2D. The genes contained in the subcluster at the center of Figure 2D will be excluded from further study, and the remaining nonempty subclusters are called modules. In the example analysis, two conserved modules (green and red) and six divergent modules (cyan, blue, golden, magenta, purple, and violet) were identified. The cutoffs are determined by a datadriven algorithm using the welldefined statistic, SVDp. Figure 2E shows that SVDp decreases gradually toward zero with the increase of the magnitudes (absolute values) of the cutoffs. The employed algorithm is presented in the section of Determination of cutoffs.
An additional step is the visualization of the results. As shown in Figure 2F, for each pattern pair we can have a heatmap of 18 plots. Each plot is characterized with the unique coexpression pattern of a gene module across the arrays and tissue kinds.
It should be noted that a special data polishing procedure is usually required prior to SVD analysis. In the M. drosophila data, we firstly centralized the gene expression by columns and scaled the new values with the standard deviations. After that, rowwide centralization and scaling (with the square roots of inner products rather than the standard deviation) were conducted. The process was repeated twice. Such a twoway centralization has been shown to be effective in unraveling the patterns hidden in a data matrix [12, 19].
A note on the second step
Reintroducing the genes of the discarded primary clusters (corresponding to the less significant eigengenes) is tricky at this step. The initial purpose is to reduce the potential loss of information due to the exclusion of these genes. However, at the same time, this procedure can introduce undesirable noise to the receiving clusters. Therefore, it should be cautious of doing so. More specifically, the reintroduction needs to be conducted based on the projections of the same gene onto different eigengenes. For example, suppose gene X has the largest projection onto eigengene10 and the second largest projection onto the eigengene2, X would be reintroduced into the PCL2 when PCL10 is discarded. In general, we recommend (1) keeping the primary clusters corresponding to the first k eigengenes with the total contribution up to 60%; and (2) only the eigengene(s) with the pattern(s) related to the addressed biological theme, such as the aging process, are considered in deriving the defined coexpression modules.
A note on the third step
The generation of pattern pairs included two steps. (1) From each data set, identify the eigengenes with the patterns being meaningful for the addressed biological themes, such as the aging process; and (2) Select all pattern pairs by calculating the correlations between the eigenvectors of the two data sets and conducting significance tests. If the experimental conditions of the two data sets are simply similar to each other but not fully equivalent, the generation of the pattern pairs should be based on the visualization of the eigengenes.
Calculation of SVDp
SVDp is defined to measure the importance of the leading latent factor (representing the leading pattern) in explaining the variance of the entries of a matrix. It integrates the variance ratio and the dimensions of the matrix by the F distribution function in an ad hoc way. Given a matrix A_{r×c}, the SVDp is determined as follows:
(1) Calculate the statistic with formula
where s_{ 1 } , u_{1}, and are the leading singular value, left singular vector and right singular vector, respectively, and ·^{2} represents the summation of the squares of the entries. For centralized data (rowwide, columnwide, or both), this statistic can be directly calculated by
(2) Refer to a standard F distribution with υ_{1} = r + c  2 and υ_{2} = rc  2r  c + 2 as the degrees of freedom to calculate the probability of x > and use it as SVDp.
While SVDp does not hold the meaning of a pvalue in a statistical test, it has the desired property of integrating the information of both cluster size and tightness. That is, the matrix of a larger cluster will have a lower SVDp than a smaller cluster with the same tightness. The calculation is based on the assumption that, underlying a well refined gene cluster, there is a unique and exclusive pattern that can be well described by a statistical model. In this context, it is reasonable to approximate the expression matrix A_{r×c}with a firstorder bilinear equation A = ŝû' + Ê, where ŝ is a scalar, û and are r × 1 and c × 1 vectors respectively, and Ê is an r × c matrix representing the remained noise. According to EckartYoung theorem, and Householder and Young [20], the least square estimates of the model parameters are the leading singular value, left singular vector, and right singular vector of the matrix, respectively [17, 19]. There are r + c  2 independent parameters in total.
Determination of cutoffs
In Figure 2D, the twoway chart is split by two lines parallel to the xaxis and two lines parallel to the yaxis. The intercepts of these lines with the xaxis or yaxis are the cutoffs to be determined. A cutoff, like a, is decided by using the following algorithm that can be easily adapted to determine other cutoffs.

(1)
Assume l _{1} is a line parallel to the xaxis. Beginning at zero, gradually move it along the positive direction of yaxis.

(2)
Calculate the SVDp of the matrix that measures the ACG tissue and the genes mapped onto the area above the line.

(3)
When the SVDp (decreasing gradually) reaches a threshold ø (0.05 as the default), the process stops and the cutoff a is specified by the ycoordinate reading.

(4)
If the threshold ø can never be reached, repeat (1) and (2) until the number of genes above the line is less than three (the assumed lower limit of the gene module size), and then decide the cutoff with the last ycoordinate reading.
As mentioned, the cutoffs determined by the algorithm are based on SVDp. Using such cutoffs, we expect to establish a balance between the tightness (measured with ) and the size of a cluster from which gene modules are derived. This expectation holds due to the property of this statistic as mentioned above.
Study on M. drosophila data
Data
With an inhouse platform, twocolor microarray data were generated from the samples of accessory gland (ACG) and malpighian tubule (MT) tissues of the W^{118} line of M. drosophila, at 15, 20, 30, 45 and 60 days with two replicates at each time point. The features with more than three missing values in ten arrays of either tissue kind were excluded from further analysis, and the remaining missing values were imputed by the knearest neighbor algorithm [21]. Withinarray and betweenarray normalizations were conducted using LOESS and quantile methods [22, 23], respectively. The multiple probes corresponding to the same gene symbol were combined by calculating the average of their expression intensities [24]. After removing the genes that lacked change across arrays (the maximum foldchange smaller than 2), we kept about 4500 genes for further analysis. The same preprocessing procedure was performed on the two data sets independently. A more detailed description of the data sets can be found in [25] and Gene Expression Omnibus (GSE 6314).
Coexpression modules
Both ACG and MT data did not exhibit a strong structure. The first two eigengenes only amounted to 31% and 37% of variance in the ACG and MT data sets, respectively (Additional file 1). The profiles of the leading eigengene in the ACG data and the second eigengene in the MT data demonstrated apparent patterns related to the aging process. A pattern pair was established because of the high correlation (r = 0.88, p < 0.01). The significance test was conducted using tdistribution. The two primary clusters (PCLs) corresponding to this pattern pair contained 2040 genes in total. These genes were mapped to a coordination system with the first left singular vector of the ACG data as the yaxis and the second left singular vector of the MT data as the xaxis. The twoway chart, split by the four lines, determined the defined SVDp criterion (ø = 0.05). Eight coexpression gene modules, M1M8, were identified in this way. Each of them had a unique profile across the aging process and tissue kinds as shown in Figure 3. M1 was a conserved module consisting of 23 genes. A downregulation tendency across the ages was shown in both ACG and MT data. The average Pearson correlations among the member genes were 0.586 for ACG and 0.580 for MT. M4 was another conserved module containing 51 genes. The average Pearson correlations among the member genes were 0.540 and 0.552 for the two tissue kinds, respectively. M4 was different from M1 in that the coexpression pattern in the two data sets demonstrated an upregulation tendency. M2, M3, M5 and M6 were four divergent modules. The number of genes within them ranged from 114 to 516. In each of these modules, the downregulation or upregulation patterns appeared only in one data set. The corresponding average correlations among the member genes ranged from 0.542 to 0.571. All these correlations were significant (p < 0.01). The pvalues were determined on the empirical distribution of the average betweengenes correlations of 500 randomly sampled null gene sets with each containing 10500 genes. M7 and M8 were two special modules, and their sizes were relatively small. The gene expression demonstrated opposite tendencies in ACG data and MT data.
Gene ontology analysis
Functional enrichment analysis was conducted by using DAVID tool [26] for each of the identified gene modules. At the level l of FDR < 0.01, M1  M7 had 7, 23, 31, 6, 109, 20, and 2 overrepresented GO terms, respectively. The top terms (9 or less) of each module are listed in Table 1. Most significant terms for the first conserved module (M1) were under the general category of cellular component (CC). The majority of the significant terms for another conserved module (M4) were under the category of biological process (BP). The results of the divergent modules were also interesting. For example, the top GO terms of M3 included oxidoreductase activity (MF), organelle ATP synthesis coupled electron transport (BP), mitochondrial inner membrane (CC), mitochondrial respiratory chains (MF), and others. It is well known that these biological functions are related to aging and longevity of fly and other organisms [27–30]. However, the downregulation tendency of the genes in the module was only observed in MT. This implies that the relationship between the activity of mitochondrial related genes and the aging process is tissuespecific. A similar result was suggested by our previous study using a supervised machine learning method [25].
Comparison with regression analysis
As shown in Figures 2A and 2B, the biologically significant patterns hidden in both data sets were not complicated. The linear regression analysis was naturally a competitive method for identifying gene modules similar to those (M1M8) identified by svdPPCS. For this consideration, we scanned the regression coefficients of the expression of the 4500 genes in both data sets versus the ages of the flies when the samples were taken. And then, according to the pvalues (set the cutoff at 0.05) and signals (+ or ) of the coefficients of individual genes, we extracted eight gene modules (G1G8) corresponding to the modules M1M8. For example, G1, the counterpart of M1, consisted of the genes with p < 0.05 and negative regression coefficients in both data sets. After that, we counted the number of overrepresented (FDR < 0.01) GO terms in G1G8 as well as in M1M8. For each module, we also calculated an information index. The index was the ratio of the number of overrepresented GO terms to the number of genes. As summarized in Tables 1, 2 and Additional file 2, in general, modules identified by svdPPCS were partially overlapped with those identified using regression analysis but had comparably higher information indexes.
Comparison with cubic spline regression analysis plus PAM based clustering
Theoretically, the nonlinear model (NLM) is more appropriate than the simple linear regression for timeseries gene expression data analysis. However, its statistical power may not be guaranteed when there are limited arrays and/or time points. Storey et al. used NLM, including cubic spline regression and other methods, to analyze two timeseries gene expression data sets from human and developed the software EDGE [31]. Using cubic spline regression implemented in EDGE, we identified agerelated gene expression changes on ACG and MT data sets respectively. The genes with ordinary pvalue less than 0.05 were stated as significant. After that, we divided these genes using PAM (Partitioning Around Medoids) clustering algorithm [32]. Based on Siliinfo average width criterion [33], the "optimal" number of clusters was two for both data sets. From the four clusters (two from ACG data and two from MT data), we extracted four divergent coexpression modules with the gene number greater than five. No conserved modules were identified. The four divergent modules contained 169, 61, 81 and 80 genes, and had 9, 47, 0 and 4 overrepresented GO terms (FDR < 0.1), respectively. The GO terms in these modules are listed in Additional file 3. The welldocumented agerelated terms about mitochondrion and electron transport (see the section of Gene ontology analysis) were not overrepresented in any of these modules. It is evident that, this approach is inferior to svdPPCS and the simple linear regression analysis in terms of the number of the identified modules and the provided biological insights.
Application of Gap statistic as the alternative to SVDp
Gene shaving is a special clustering method. It selects coexpression gene sets based on the first loading of the gene expression matrix or the orthogonalized matrices (after the first round). The Gap statistic on which gene shaving depends is a natural alternative to SVDp on which svdPPCS relies. Therefore, based on the previously identified pattern pairs in the ACG and MT data sets, we calculated the Gap curves using a similar procedure documented in [13]. The results are summarized in Additional file 4. It is evident that the magnitudes of the cutoffs optimized on Gap curves are too large. Applying these cutoffs to the scatter chart in Figure 2 does not lead to informative results. In particular, among the 2040 genes mapped onto the chart, only 31 genes are above the line a, 50 genes are below the line b, 17 genes are on the right of the line c, and 13 genes are on the left of the line d. The gene modules obtained from such splitting are too small in size to provide meaningful biological insights through functional enrichment analysis. This suggests Gap statistic is not applicable to the addressed scenario.
Simulation study
One advantage of svdPPCS over regression analysis is that the relationship between the expressions of individual genes is considered in the former, but not in the latter. In addition, svdPPCS can address a data set with more complicated patterns, such as a sine curve, which cannot be well fitted by a simple linear model. In this section, we conducted a simulation study to demonstrate the validity of svdPPCS in analyzing this kind of data.
Data simulation
Two data sets, "mouse" and "human" were simulated. Each of them contained 338 orthologous genes and had 18 arrays representing a set of experimental conditions (118 h). The noise terms of the "expression" of these genes were generated using a true microarray data set sourced from 36 samples of mouse and human stem cell [34]. All the genes were involved in cell cycle process. The arrays were divided into four groups, i.e. mouse ES (undifferentiated), mouse EB (earlydifferentiated), human ES, and human EB. A linear model with the species (mouse or human) and status (ES or EB) as fixed factors was implemented on each gene. By subtracting the estimated fixed effects from the expression measures, we generated the noise vector for a gene as well as the noise matrix for all the 338 genes. The noise matrix was divided into two submatrices and each of them contained 18 columns. Finally, two synthetic data sets were generated by adding patterns that simulated several statistical functions to the noise matrices. From the 338 genes, six classes (C1  C6) were simulated and each class contained 30 genes. The coexpression patterns added to them are listed as follows:
C1: sine curve across the 18 time points for both mouse and human data sets.
C2: sine curve across the 18 time points for mouse data.
C3: sine curve across the 18 time points for human data.
C4: gamma(9, 2) density curve across the 18 time points for mouse data.
C5: gamma(9, 2) density curve with a time shift of 1.5 hours across the 18 time points for human data.
C6: beta(6, 6) density curve across the 18 time points for both mouse and human data sets. The other entries of the synthetic data sets had the same values as the counterparts in the noise matrices.
Result
Figure 4A presents the four statistical curves used in the simulation. Figures 4B and 4C listed the plots of the first four eigengenes versus the time points for the human and mouse data sets, respectively. It is quite apparent that eigengene1 and eigengene3 recognized the patterns of the sine curve and the dbeta(t, 6,6) curve respectively in both data sets. The dgamma(t, 9, 2) curve was only simulated in the mouse data set. The eigengenene2 of the data set corresponded approximately to the curve but demonstrated some deviation. Similarly, the dgamma(t+1.5, 9,2) curve was simulated only in the human data. The plot of the second eigengene of the data approximately recognized the structure. Based on the correlations between these eigengenes, four pattern pairs were established. They were:
Pair1: eigengene1 in mouse and eigengene1 in human (r = 0.992, p < 0.01).
Pair2: eigengene3 in mouse and eigengene3 in human (r = 0.873, p < 0.01).
Pair3: eigengene2 in mouse and eigengene18 in human.
Pair4: eigengene2 in human and eigengene18 in mouse.
Because the pattern of the eigengene2 in human data does not match any eigengenes of the mouse data, we paired it with the eigengene18. Eigengene18 corresponds to an empty primary cluster (PCL) of the mouse data. The pair4 formed due to a similar consideration.
Using svdPPCS, we identified two major conserved coexpression gene modules (CL1 and CL6) and four divergent modules (CL2CL5). They approximately matched the simulated gene class C1, C6, and C2C5 as presented in Table 3 and Figure 5. It should be noted that several identified small gene modules with the size less than five were discarded.
Comparison with standard clustering algorithms
Two clustering methods, agglomerative hierarchical clustering (HC) [35] and PAM algorithm [32], were also applied to the simulated human and mouse data sets respectively. HC was trained with complete linkage and Euclidean distance as the parameters. As shown in the dendrograms (Additional file 5), this method has difficulties in correctly identifying the true structure of the simulated gene groups (three groups each carrying a unique pattern and containing 30 or 60 genes, and one null group of 218 genes) in both human and mouse data sets. On the other hand, for both data sets, the optimized number of clusters suggested by PAM based on Siliinfo average criterion is three (Additional file 6), one less than the true number of the simulated four groups. These results indicate that both clustering algorithms cannot precisely assess the determined true structures of the data sets. Therefore, compared to svdPPCS, they are not ideal candidates for this simulation study.
Discussion
The implementation of the SVD technique for grouping genes to identify transcriptional modules is not entirely new but still active. We developed the methodology from two aspects. The first aspect is represented in the optional step to establish the primary clusters (PCLs). As a result, the gene modules identified in the subsequent steps will be largely exclusive of each other. This is important because the discovered modules can explicitly catch the main interest in some transcriptional programs such as in the M. Drosophila data sets analyzed in this paper. Skipping this step will lead to gene modules that can substantially overlap with each other when the modules are derived from two multiple pairs of left singular value vectors. The underlying principle of this classification is the rule of maximum confidence score adopted in supervised learning [36, 37]. Each right singular vector (eigengene) represents a latent class. The projections of gene expression profiles onto the eigengene can be considered as confidence scores assigning genes to the classes. The voting mechanism is similar to that in solving a multiple classification problem [36, 38].
The second aspect is the SVDp statistic. In SVDbased algorithms, the generation or refinement of a gene cluster as well as the derived modules is based on the magnitudes of the elements of the corresponding left singular vector. A gene will be assigned to the (refined) cluster only if its value in the vector is larger (or smaller) than a threshold. The choice of the cutoff remains a major challenge in applying the related algorithms. In this study, the cutoffs are determined by a datadriven algorithm using the welldefined SVDp statistic. It integrates the variance ratio and the dimensions of the matrix by an Fdistribution function in an ad hoc way. Based on this formulation, the matrix of a big cluster will have a lower SVDp than a cluster with the same tightness but a smaller size. Using SVDp as the criterion to select the cutoffs, we established a balance between the tightness and size of a gene cluster from which gene modules are derived. The validity was verified by the analysis of the experimental data sets and the simulation study.
Biologically meaningful results were obtained by applying the proposed method to a couple of time series microarray data sets generated from the samples of accessory gland (ACG) and malpighian tubule (MT) tissues of the line W^{118} of M. drosophila. Two conserved modules and six divergent modules, each of which had its unique characteristic profile across tissue kinds and aging process, were identified. The number of genes contained in these models ranged from five to a few hundred. Three to over a hundred GO terms were overrepresented in individual modules with FDR < 0.1. By summarizing the results of functional enrichment analysis, we had two findings that may be important in biology. First, in one conserved module (M4) where gene expression was upregulated across ages, several significant GO terms are involved in DNA metabolic process, DNA packaging, and the maintenance of chromosome architecture. This may suggest an antiaging mechanism in eukaryote. Second, one divergent module (M3) showed the tissuespecific relationship between the expressions of mitochondrionrelated genes and the aging process.
The comparison with other alternate methods further demonstrated the strength of svdPPCS. On the fly data sets, svdPPCS proved to be superior to linear regression analysis and cubic spline regression plus PAM based clustering in terms of the number of the identified modules and the biological insights inferred from the modules. The cutoffs determined by SVDp were shown to be more reasonable than those decided from calculating Gap statistic with respect to the identification of coexpression gene modules of biological interest. On the simulated data sets, compared to aggregative hierarchical clustering and PAM, svdPPCS was able to perfectly identify the simulated patterns of true structures and grouped the genes with high precision.
It should be emphasized that the effectiveness of svdPPCS depends mainly on the existence of gene expression pattern(s) related to the addressed biological theme, rather than the magnitudes of the singular values corresponding to the first eigengenes. It is true that if the data do not exhibit a strong structure, the singular values are relatively small for the first eigengenes. However, svdPPCS still can perform well in such a case as actually demonstrated in the analyzed fly data. In this scenario, the first two eigengenes only accounted for 31% and 37% of variance in the ACG and MT data sets, respectively. This was an important reason why svdPPCS outperformed other alternative methods in identifying the biologically significant gene groups hidden in the data sets.
As demonstrated above, svdPPCS is a promising tool for identifying conserved and divergent coexpression modules of multiple sets of microarray experiments. However, it is worth noting that current implementation still has some limitations. First, svdPPCS requires the data sets hold comparable experimental conditions, although full equivalence is not necessary. For example, in comparing the agerelated coexpression gene modules of human and mouse, we can "align" the physical ages of these two species, but such alignment may be unrealistic in comparison of mouse and fly. Second, when there are multiple patterns in the data sets or the only pattern of interest is not indicated by the leading eigengene, the generation of primary clusters (PCL) is a necessary step. In such a case, only the genes of the related primary clusters will be mapped onto the scatter chart in Figure 2D. This may cause a loss of information due to the exclusion of some genes with multiple patterns. Third, there lack "golden criteria" to decide how many primary clusters should be kept as well as if the genes with the largest projection on less important eigengenes should be reintroduced into the existing primary clusters. Further studies to rigorously address those issues are on our agenda.
Conclusions
Using the SVD technique, we have developed a computational tool (svdPPCS) to identify conserved and divergent coexpression modules of two sets of microarray experiments. The proposed methods can be directly extended to the comparisons of multiple data sets. It is based on the assumption that under each of the coexpression patterns there is a characteristic mode [11] which can be represented by the profile of a right singular vector of the gene expression matrix. The conserved and divergent modules are identified via splitting a twoway chart defined by a pair of left singular value vectors corresponding to a pattern common or similar in the two data sets. That is, the twoway chart is divided into nine blocks with two vertical lines and two horizontal lines as four cutoffs, and the genes projected onto a single block are assigned to the same subcluster. We excluded the genes contained in the subcluster at the center of the chart from further analysis, and named the remaining nonempty subclusters as modules. The proposed method is generally applicable to the comparative analysis of transcriptional profiling and the integration of data sets from different platforms or of different sources, especially for the comparison of time series data sets of related organisms and different tissue kinds of the same organism under equivalent or similar experimental conditions.
Availability and Requirements
Project name: svdPPCS
Operating system: Windows
Programming language: R
License: Free for noncommercial use. Source code available upon request.
References
 1.
Su AI, Cooke MP, Ching KA, Hakak Y, Walker JR, Wiltshire T, Orth AP, Vega RG, Sapinoso LM, Moqrich A, Patapoutian A, Hampton GM, Schultz PG, Hogenesch JB: Largescale analysis of the human and mouse transcriptomes. PNAS 2002, 99: 4465–70. 10.1073/pnas.012025199
 2.
Stuart JM, Segal E, Koller D, Kim SK: A genecoexpression network for global discovery of conserved genetic modules. Science 2003, 302: 249–55. 10.1126/science.1087447
 3.
Alter O, Brown PO, Botstein D: Generalized singular value decomposition for comparative analysis of genomescale expression data sets of two different organisms. PNAS 2003, 100: 3351–3356. 10.1073/pnas.0530258100
 4.
McCarroll SA, Murphy CT, Zou S, Pletcher SD, Chin CS, Jan YN, Kenyon C, Bargmann CI, Li H: Comparing genomic expression patterns across species identifies shared transcriptional profile in aging. Nat Genet 2004, 36: 197–204. 10.1038/ng1291
 5.
Ihmels J, Bergmann S, Berman J, Barkai N: Comparative gene expression analysis by differential clustering approach: application to the Candida albicans transcription program. PLoS Genet 2005, 1(3):e39. 10.1371/journal.pgen.0010039
 6.
Ihmels J, Bergmann S, Barkai N: Defining transcription modules using largescale gene expression data. Bioinformatics 2004, 20: 1993–2003. 10.1093/bioinformatics/bth166
 7.
Li H, Sun Y, Zhan M: The discovery of transcriptional modules by a twostage matrix decomposition approach. Bioinformatics 2007, 23: 473–439. 10.1093/bioinformatics/btl640
 8.
Wang X, Dalkic E, Wu M, Chan C: Gene module level analysis: identification to networks and dynamics. Curr Opin Biotechnol 2008, 19: 482–491. 10.1016/j.copbio.2008.07.011
 9.
Mao L, Van Hemert JL, Dash S, Dickerson JA: Arabidopsis gene coexpression network and its functional modules. BMC Bioinformatics 2009, 10: e346. 10.1186/1471210510346
 10.
Loor JJ, Dann HM, Everts RE, Oliveira R, Green CA, Guretzky NA, RodriguezZas SL, Lewin HA, Drackley JK: Temporal gene expression profiling of liver from periparturient dairy cows reveals complex adaptive mechanisms in hepatic function. Physiol Genomics 2005, 23: 217–26. 10.1152/physiolgenomics.00132.2005
 11.
Alter O, Brown PO, Botstein D: Singular value decomposition for genomewide expression data processing and modeling. PNAS 2000, 97: 10101–06. 10.1073/pnas.97.18.10101
 12.
Holter NS, Mitra M, Maritan A, Cieplak M, Banavar JR, Fedoroff NV: Fundamental patterns underlying gene expression profiles: simplicity from complexity. PNAS 2000, 97: 8409–14. 10.1073/pnas.150242097
 13.
Hastie T, Tibshirani R, Eisen MB, Alizadeh A, Levy R, Staudt L, Chan WC, Botstein D, Brown P: 'Gene shaving' as a method for identifying distinct sets of genes with similar expression patterns. Genome Biol 2000, 1(2):RESEARCH0003. 10.1186/gb200012research0003
 14.
Wall ME, Dyck PA, Brettin TS: SVDMANsingular value decomposition analysis of microarray data. Bioinformatics 2001, 17: 566–568. 10.1093/bioinformatics/17.6.566
 15.
Zhu D: Semisupervised gene shaving method for predicting low variation biological pathways from genomewide data. BMC Bioinformatics 2009, 10(Suppl 1):S54. 10.1186/1471210510S1S54
 16.
Zhang W, Rekaya R, Bertrand K: A method for predicting disease subtypes in presence of misclassification among training samples using gene expression: application to human breast cancer. Bioinformatics 2006, 22: 317–325. 10.1093/bioinformatics/bti738
 17.
Liu L, Hawkins DM, Ghosh S, Young SS: Robust singular value decomposition analysis of microarray data. PNAS 2003, 100: 13167–72. 10.1073/pnas.1733249100
 18.
Wall ME, Rechtsteiner A, Rocha LA: Singular value decomposition and principal component analysis. In A Practical Approach to Microarray Data Analysis. Edited by: Berrar DP, Dubitzky W, Granzow M. Kluwer, Norwell, MA; 2003:91–109. full_text
 19.
Zhang L, Marron JS, Shen H, Zhu Z: Singular value decomposition and its visualization. Journal of Computational and Graphical Statistics 2007, 16(4):833–854. 10.1198/106186007X256080
 20.
Householder AS, Young G: Matrix Approximations and Latent Roots. American mathematical Monthly 1938, 45: 165–171. 10.2307/2302980
 21.
Troyanskaya O, Cantor M, Sherlock G, Brown P, Hastie T, Tibshirani R, Botstein D, Altman RB: Missing value estimation methods for DNA microarrays. Bioinformatics 2001, 17: 520–525. 10.1093/bioinformatics/17.6.520
 22.
Yang YH, Dudoit S, Luu P, Lin DM, Peng V, Ngai J, Speed TP: Normalization for cDNA microarray data: a robust composite method addressing single and multiple slide systematic variation. Nucleic Acids Res 2002, 30(4):e15. 10.1093/nar/30.4.e15
 23.
Bolstad BM, Irizarry RA, Astrand M, Speed TP: A Comparison of Normalization Methods for High Density Oligonucleotide Array Data Based on Bias and Variance. Bioinformatics 2003, 19: 185–193. 10.1093/bioinformatics/19.2.185
 24.
Zahn JM, Sonu R, Vogel H, Crane E, MazanMamczarz K, Rabkin R, Davis RW, Becker KG, Owen AB, Kim SK: Transcriptional profiling of aging in human muscle reveals a common aging signature. PLoS Genet 2006, 2(7):e115. 10.1371/journal.pgen.0020115
 25.
Zhang W, Zou S, Song J: Termtissue specific models for prediction of gene ontology biological processes using transcriptional profiles of aging in drosophila melanogaster. BMC Bioinformatics 2008, 9: e129. 10.1186/147121059129
 26.
Huang DW, Sherman BT, Lempicki RA: Systematic and integrative analysis of large gene lists using DAVID Bioinformatics Resources. Nature Protoc 2009, 4: 44–57. 10.1038/nprot.2008.211
 27.
Miquel J, Economos AC, Fleming J, Johnson JE Jr: Mitochondrial role in cell aging. Exp Gerontol 1980, 15: 575–591. 10.1016/05315565(80)900108
 28.
Ozawa T: Genetic and functional changes in mitochondria associated with aging. Physiol Rev 1997, 77: 425–464.
 29.
Genova ML, Bianchi C, Lenaz G: Structural organization of the mitochondrial respiratory chain. Ital J Biochem 2003, 52: 58–61.
 30.
Rea SL, Ventura N, Johnson TE: Relationship between mitochondrial electron transport chain dysfunction, development, and life extension in Caenorhabditis elegans. PLoS Biol 2007, 5(10):e259. 10.1371/journal.pbio.0050259
 31.
Storey JD, Xiao W, Leek JT, Tompkins RG, Davis RW: Significance analysis of time course microarray experiments. PNAS 2005, 102(36):12837–42. 10.1073/pnas.0504609102
 32.
Kaufman L, Rousseeuw P: Finding Groups in Data: An Introduction to Cluster Analysis. Wiley, New York; 1990.
 33.
Rousseeuw PJ: Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. Journal of Computational and Applied Mathematics 1987, 20: 53–65. 10.1016/03770427(87)901257
 34.
Sun Y, Li H, Liu Y, Mattson MP, Rao MS, Zhan M: Evolutionarily conserved transcriptional coexpression guiding embryonic stem cell differentiation. PLoS One 2008, 3(10):e3406. 10.1371/journal.pone.0003406
 35.
Eisen MB, Spellman PT, Brown PO, Botstein D: Cluster analysis and display of genomewide expression patterns. PNAS 1998, 95(25):14863–68. 10.1073/pnas.95.25.14863
 36.
Ramaswamy S, Tamayo P, Rifkin R, Mukherjee S, Yeang CH, Angelo M, Ladd C, Reich M, Latulippe E, Mesirov JP, Poggio T, Gerald W, Loda M, Lander ES, Golub TR: Multiclass cancer diagnosis using tumor gene expression signatures. PNAS 2001, 98: 15149–54. 10.1073/pnas.211566398
 37.
Keerthikumar S, Bhadra S, Kandasamy K, Raju R, Ramachandra YL, Bhattacharyya C, Imai K, Ohara O, Mohan S, Pandey A: Prediction of candidate primary immunodeficiency disease genes using a support vector machine learning approach. DNA Res 2009, 16: 345–51. 10.1093/dnares/dsp019
 38.
Zhang W, Robbins K, Wang Y, Bertrand K, Rekaya R: A jackknifelike method for classification and uncertainty assessment of multicategory tumor samples using gene expression information. BMC Genomics 2010, 11: 273. 10.1186/1471216411273
Acknowledgements
This work was supported by NIH grants (RCMI 1G12RR02626001KZ, R21LM010137DZ), and a Louisiana BOR award (LEQSF(200811)RDA32KZ). The authors thank Dr. Sige Zou and Dr. Ming Zhan at NIA for providing the M. drosophila data and stem cell data. The authors are grateful to the two reviewers for their insightful comments which greatly improve this paper.
Author information
Affiliations
Corresponding authors
Additional information
Authors' contributions
WZ carried out the statistical analysis and drafted the manuscript. AE, WF, DZ and KZ contributed to the method development. AE, WF, DZ and KZ provided editorial comments and participated in writing. KZ supervised and coordinated the project. All authors read and approved the final manuscript.
Electronic supplementary material
12859_2010_3795_MOESM1_ESM.PDF
Additional file 1: Distributions of proportions of variance explained by individual eigengenes on ACG and MT data sets. (PDF 41 KB)
12859_2010_3795_MOESM3_ESM.PDF
Additional file 3: Functional enrichment analysis of the gene modules identified by cubic spline regression plus PAM clustering. (PDF 50 KB)
12859_2010_3795_MOESM4_ESM.PDF
Additional file 4: Curves of Gap statistic based on the left singular vectors of the singular value decompositions of ACG and MT data. (PDF 23 KB)
12859_2010_3795_MOESM6_ESM.DOC
Additional file 6: The optimal number of clusters suggested by PAM algorithm and Siliinfo average width criterion on the simulated data sets. (DOC 124 KB)
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Zhang, W., Edwards, A., Fan, W. et al. svdPPCS: an effective singular value decompositionbased method for conserved and divergent coexpression gene module identification. BMC Bioinformatics 11, 338 (2010). https://doi.org/10.1186/1471210511338
Received:
Accepted:
Published:
Keywords
 Singular Value Decomposition
 Singular Vector
 Accessory Gland
 Malpighian Tubule
 Biological Theme