A Latent Variable Approach for Meta-Analysis of Gene Expression Data from Multiple Microarray Experiments
- Hyungwon Choi^{1},
- Ronglai Shen^{1},
- Arul M Chinnaiyan^{2} and
- Debashis Ghosh^{3}Email author
https://doi.org/10.1186/1471-2105-8-364
© Choi et al; licensee BioMed Central Ltd. 2007
Received: 26 February 2007
Accepted: 27 September 2007
Published: 27 September 2007
Abstract
Background
With the explosion in data generated using microarray technology by different investigators working on similar experiments, it is of interest to combine results across multiple studies.
Results
In this article, we describe a general probabilistic framework for combining high-throughput genomic data from several related microarray experiments using mixture models. A key feature of the model is the use of latent variables that represent quantities that can be combined across diverse platforms. We consider two methods for estimation of an index termed the probability of expression (POE). The first, reported in previous work by the authors, involves Markov Chain Monte Carlo (MCMC) techniques. The second method is a faster algorithm based on the expectation-maximization (EM) algorithm. The methods are illustrated with application to a meta-analysis of datasets for metastatic cancer.
Conclusion
The statistical methods described in the paper are available as an R package, metaArray 1.8.1, which is at Bioconductor, whose URL is http://www.bioconductor.org/.
Background
With the increasing availability of published microarray data sets, there is a tremendous need for developing approaches to validate and integrate results across multiple studies. One major issue to deal with in the meta-analysis of DNA microarrays is the lack of a single standard experimental platform for data generation. The dominant technologies so far have been two-color microarrays and oligonucleotide (e.g., Affymetrix GeneChip) arrays. Because these technologies measure fundamentally differing genetic materials designed to represent identical targets, many properties of expression measurements may vary across platforms including scale of measurements, sensitivity in detecting fold changes, control of cross-hybridization, and so forth. The heterogeneity in array design poses a great challenge for cross-platform comparisons and integration of results across independent microarray studies. The general area of combining data across multiple studies is referred to as meta-analysis [1, 2].
Many approaches have been proposed for meta-analysis of microarray data. Rhodes et al. [3] combined evidence of differential expression using a summary statistic involving the p-values from comparing cancer versus normal samples across multiple gene profiling studies and adjusted for multiple testing using q-values [4]. Choi et al. [5] proposed a Bayesian model for the effect size for genes from multiple microarray experiments. In a more recent study [6], data from one study were used to generate a prior distribution of the differences in logarithm of gene expression between diseased and normal groups, whose distribution was then updated using other microarray studies. These methods all model the effect size [1], or a transformation thereof, across multiple studies.
Recently, we proposed a Bayesian mixture model-based transformation of DNA microarray data based on a proposal of Parmigiani et al. [7] and applied it to develop a signature of breast cancer recurrence across multiple microarray experiments from different platforms [8]. The scale which was combined across studies is termed probability of expression (POE). The focus of Shen et al. [8] was on the breast cancer application; here, we wish to examine the technical aspects of the modelling used there. Based on the probabilistic model that underlies the POE methodology, one can exploit the notion of using latent variables for combining genomic data from multiple genomic studies. This is a very important idea that can have more general applications than that considered by Parmigiani et al. [7]. In Methods, we describe the data structure and define two general probabilistic models for quantities that are combinable across studies. The first is the model used in [8]; we present it here for completeness. The second is a two-component mixture model that can be fit using an expectation-maximization algorithm. We also relate the latent variables to recent statistical methodologies for differential expression as well as false discovery rate [4, 9]. We then illustrate the proposed methods with an application to a meta-analysis of data comparing metastatic to localized cancer across multiple microarray studies in the Results section.
Results
Metastatic Cancer Study
We now discuss the application of the proposed methodology to a study looking at metastatic cancer. Based on the availability of expression data for metastatic samples and clinical information regarding the distinction of primary and metastatic tumors, we selected three studies from publicly available data sources [10–12]. These three studies were selected based on two criteria: 1) both localized and metastatic samples are profiled, and 2) a reasonable number of common genes appear across datasets. It should be noted that generally only a small number of metastatic samples are profiled, which was the case in all three datasets. Throughout the article, the terms primary and localized will be used interchangeably.
The goal of this meta-analysis is to identify the set of genes that best distinguishes metastatic tumors from primary tumors in human cancer tissue samples across distinct organ sites. The method mentioned in the previous section is applied to the three training sets to transform the data to POE using both the EM and MCMC algorithms, and an optimal signature based on leave-one-out cross-validation logistic regression framework is obtained. The method will be compared to a few alternative meta-analytic approach ([5, 13]) in terms of the selected gene signatures and the clustering of primary and metastatic tumors based on them. Although the validation of methodology is challenging, we used our gene signature to predict metastasis-free survival time in the breast cancer study proposed by van't Veer et al. [14] as a possible validation. The hypothesis presumed here is that the profile for distinguishing metastatic from nonmetastatic tumors can be used to predict aggressive cancer prognosis.
Data Description
Description of data used in meta-analysis
Data Source | Array Type | Organ Site | Sample | # Metastatic | # Primary |
---|---|---|---|---|---|
Chen et al. | cDNA | Liver | 75 | 9 | 69 |
Garber et al. | cDNA | Lung | 33 | 6 | 27 |
Latulippe et al. | Affy U95 Human | Prostate | 32 | 9 | 23 |
Garber et al. [11] describe the diversity of gene expression patterns in squamous cell carcinomas (SCC), large cell lung carcinomas (LCLC), small cell lung carcinomas (SCLC), and adenocarcinoma (AC) using cDNA microarrays. These four subtypes of lung cancer are often detected in epithelial cells that line different sections of airways in the lung, and their treatment options differ by these types due to the pathological distinction among them. We first selected all 6 unique metastatic tumors and removed their paired samples profiled at primary stage. Identifying and removing duplicate samples was performed the same way as for the Chen et al. data. The subset of patients included in our meta-analysis were 27 primary adenocarcinoma samples and 6 samples with lymph node metastases.
Finally, the Latulippe et al. [10] study identifies genes that differentiates primary and metastatic cancers in the prostate. Using Affymetrix oligonucleotide array U95 human gene arrays, they reported gene expression profiles of nearly 25,000 genes/ESTs. All samples were included in our meta-analysis. The details for the three studies are summarized in Table 1.
An important aspect of this collection of data is that the organ sites are different. We are postulating a hypothesis that there is a common profile separating localized tumors from metastatic tumors across the three sites. Similar evidence for this type of hypothesis has been suggested before [15]. The microarray platform differs by studies, so we mapped clone/probeset IDs to Unigene cluster IDs (UGIDs) of its most recent build through SOURCE [16]. UGIDs are constantly updated. Because our initial mapping was done in the year 2004, we translated these UGIDs to the June 2006 build (No. 191) in the NCBI database. The genes we report here and their annotation in the remainder of the paper is consistent with all annotations associated with the most up-to-date Unigene clusters. When multiple clones are mapped to the same UGID, we averaged the expression over the clones within each sample. Such a mapping produced 1633 common UGIDs.
POE
Before combining 140 samples from different sources into a single dataset, we transformed the raw data to POE from each study by normalizing the distribution of expression values in metastatic samples to that of localized samples. Note that the localized or primary tumors represent the baseline group, since our goal is to select gene signature that distinguishes metastatic tumors from localized tumors, for which many conflicting hypotheses have been postulated. The output of POE from each study was then combined to form a single expression dataset with 1633 genes and 140 samples.
In the following, the POE data transformations by the EM and MCMC algorithms will be analyzed in parallel for the sake of comparison. All primary tumors are color-coded in red and metastatic tumors in green. In terms of computational speed, estimation of POE based on the EM algorithm takes less than a minute for 1633 genes per dataset, while that using MCMC takes about 50 minutes for 2000 iterations and 4 periodic skips in the sampler. As the numbers of genes and samples grow, this difference will be substantial. For example, it usually takes 4 hours to fit POE for a dataset with 10,000 genes using full Bayesian modelling as opposed to 3 minutes for the maximum likelihood approach using the EM algorithm. The reason for the computational difference is that the EM algorithm is fit to one gene at a time, while the MCMC algorithm involves fitting to expression measurements for all genes simultaneously.
Although both genes are in the signature obtained by our methods, they clearly represent different types of genes. Based on Figure 1, F2 is under-expressed in the metastatic liver samples of Chen et al., weakly under expressed in the lung samples of Garber et al., and not differentially expressed in the Latulippe et al. data. It was found significant only in the liver study among the three studies we considered here. On the other hand, TGFB1 is a gene whose expression is uniformly under expressed in metastatic samples across all three studies.
This observation on the two types of expression pattern on POE scale suggests that our signature will contain both types of genes. As will be shown later, a conventional meta-analytic approach that combines strength of differential expression across studies on the raw scale tends to select genes that behave similarly to TGFB1, whereas our method picks up both types of genes. Unless genes with expression patterns similar to F2 dominate the entire signature, the gene set from our method tends not to be influenced by a single study.
Signature Selection
As we proposed POE transformations using two different implementations, we will refer to the signatures from the data transformed by the EM and MCMC algorithms as the POE EM signature and the POE MCMC signature, respectively.
To obtain a gene signature that distinguishes metastatic samples from localized samples, we calculated risk indices for all samples. What we call a risk index is described in the Methods section. A logistic regression is fitted for each gene with one sample held out at a time. The response variable is metastasis status (1 = metastatic, 0 = localized). For all genes we iterated the same procedure holding each sample out while recording coefficients β and p-values. Following the risk index approach for classification expalined in Methods section, we calculated risk indices for all 140 subjects at various sizes of the gene signature. The optimal signature size p was then determined based on classification performance.
Comparison and Validation
Classification error rates
Chen | Garber | Latulippe | |
---|---|---|---|
Chen (50) | 0 | 27 | 21 |
Garber (25) | 18 | 12 | 18 |
Latulippe (30) | 17 | 21 | 0 |
POE EM (80) | 2 | 6 | 0 |
POE MCMC (80) | 1 | 6 | 0 |
Effect Size (80) | 1 | 12 | 0 |
Conlon et al. (80) | 7 | 27 | 0 |
We also compared our methods with two meta-analysis techniques developed in [5] and [13]. The former performs Bayesian inference on the classical Hedges-Olkin pooled effect sizes for each gene from multiple studies, and the latter uses Bayesian hierarchical model to pool datasets across studies through group-specific mean and variance parameterization and selects gene signature based on their Bayesian estimate of FDR.
Meanwhile, the Conlon signature had an overlap of two genes with the ES signature and one gene with the POE EM and MCMC signatures. The poor overlap of Conlon signature with others is consistent with the high Bayesian FDR estimated above.
We note that clustering with all signatures give fairly accurate results in all three studies. In the ES signature, only a few metastatic samples are grouped together with two other primary tumors for the Chen liver study (Figure 6). Two metastatic samples are situated under the same node with primary tumors in Garber lung study (Figure 7), Finally, one primary and another three metastatic samples are in the opposite clusters in Latulippe prostate study (Figure 8). Overall, the clustering can differentiate metastatic tumors from primary tumors, although some metastatic tumors were grouped with primary tumors. The Conlon signature had no classification error in Latulippe prostate study, but essentially there was no tight clustering in Garber lung study at all, although 4 out of 6 metastatic samples were clustered together in a local tree.
The POE EM and MCMC signatures give comparably good clusterings of the two types of tumors across all studies. In Figures 9 and 10, all metastatic tumors except for two samples from the Garber lung study are grouped together, and some primary tumors from the Chen liver study are separated from other primary tumors. Furthermore, the lengths of the edges to the leaf nodes in the dendrogram are shorter than that in the ES signature, which suggests that the clustering of primary tumors is tighter than that using the ES signature. This is a consequence of normalizing the expression level of metastatic tumors to the distribution of primary tumors by utilizing phenotypic information in the estimation of POE. The heatmaps visually demonstrate the difference between the ES signatures and the POE signatures. We next used NIH DAVID [18] to determine if there were functional groups enriched for in our gene expression signatures. In terms of gene annotation, the POE EM and MCMC signatures share many common functional categories because they have many UGIDs in common such as response to stress, immune response, endopeptidase and enzyme inhibitor activity, cell organization and biogenesis, and regulation of cell cycle. The class of functions common to the POE and ES signatures is cell cycle processes. GO terms such as antigen processing, endogenous antigen via MHC class I, DNA repair, many metabolism and transport activities appear in the ES signatures only. Also, a literature search has suggested the association of POE signature genes and their corresponding GO terms with tumor invasion and metastasis in various cancer types. For example, ALDH1A1 (stress response) and MAPK3 (cell proliferation) are targets of the HGF/MET signaling pathway which has been associated with tumor metastasis and poor prognosis in human hepatocellular carcinomas [19]. In another example, overexpression of PFN2 (Regulation of actin cytoskeleton) and UBS (stress response) has been associated with lymph node metastasis of gastric cancer [20] and colon cancer [21] respectively. These observations indicate that the POE signatures lead to relevant findings toward understanding the potential mechanism of differentiation of metastatic tumors from primary tumors.
Finally, an additional validation of the method was attempted to see if the resulting gene expression signature can discriminate lethal from nonlethal cancers in an early detected population of cancers. Note that the signature selection was primarily oriented toward the distinction of metastatic tumors from primary tumors. Thus validation here is based on the conjecture that many metastatic tumors are highly likely to initiate lethal condition. We addressed this issue by using the data from the van't Veer et al. [14] study. Their study profiled 98 primary breast cancer samples in Hu25K inkjet arrays. Among these patients, 34 patients developed distant metastases within 5 years, 44 patients continued to be disease-free after a period of at least 5 years. Other 20 patients either had BRCA1 germline mutations or were BRCA2 carriers; we excluded these samples from the analysis.
The study was based on a large inkjet microarray profiling over 25,000 probes. About two-thirds of 1633 genes used in the three cancer studies appear in the Van't Veer et al. data. Based on the classifier trained from the three cancer datasets described above, we mapped the genes from the signatures to those in the van't Veer et al. data. We generated risk indices for subjects in van't Veer et al. Specifically, we first transformed the van't Veer et al. data to the POE scale using both the EM and MCMC algorithms without using the phenotypic information to prevent overfitting. Note that we did not consider the effect size and Conlon signatures here. Then we calculate the log odds ratio for each patient using the coefficients trained from training data and the newly generated POE data. Note that the estimated regression coefficients for the risk score came from the training set. As expected, the derived risk indices using the data from the EM and MCMC algorithms are highly correlated (Pearson correlation 0.83).
Results of EM POE-based survival analysis
Analysis | Variable | Coef | p-value |
---|---|---|---|
Univariate | Risk Index | 0.015 | 0.005 |
Multivariate | Risk Index | 0.010 | 0.049 |
Estrogen Receptor Pos | -0.697 | 0.058 | |
Age | -0.059 | 0.021 |
Results of MCMC POE-based survival analysis
Analysis | Variable | Coef | p-value |
---|---|---|---|
Univariate | Risk Index | 0.036 | < 0.001 |
Multivariate | Risk Index | 0.027 | 0.008 |
Estrogen Receptor Pos | -0.580 | 0.120 | |
Age | -0.056 | 0.030 |
Discussion
Ideally, we wish to use all common genes from the available studies for meta-analysis. However, one issue that has been debated recently is that of reproducibility of genes across studies [24, 25]. A technique that has proven to be useful as a filtering device to enhance comparability across arrays of different platforms is the integrative correlation coefficient or correlation of correlation coefficients [24, 25]. The idea underlying this method is that while raw expression values vary from study to study, the intergene correlations do not vary as much. The intergene correlations are calculated across all samples; this yields a N × N matrix for each study. The row-wise averages are taken for each study and then calculated, and the correlations of these averages between these studies is then calculated. Thus, one would consider combining genes that have similar intergene correlations across the studies. For normally distributed data, the sample correlation is independent of the sample mean. Thus, genes selected based on an integrative correlation filter need not necessarily be highly expressed genes. We could perform this as a filtering step before applying the proposed meta-analysis methodologies; we did not do so here. The drawback to such a measure is that the filtering of genes might reduce the chance of finding subtypes in the datasets because the genes that define such subtypes may be excluded based on the integrative correlation coefficient.
One limitation of our methodology is that it is still subject to the usual meta-analysis assumption that the transformed expression measurements (the POE values) are directly combinable across studies. If in fact we are trying to combine measurements for fundamental different quantities across multiple studies, then this in fact renders the meta-analysis invalid. However, for that situation most meta-analytical approaches are invalid, and one would need more sophisticated modelling assumptions.
A related issue to this is that of heterogeneity. The results of the analysis here should be interpreted with some caution in that we are comparing metastatic versus nonmetastatic tumors across a variety of tissue types. We made the assumption that the differences between the two types of tumors are the same across the three studies. If this is not true, then it might be quite possible that what we are detecting are in fact tissue-specific differences between metastatic and non-metastatic tissues. It is of interest to develop methods for assessing heterogeneity in meta-analyses of genomic data so that they may be applied before using the proposed methodology in the paper.
Conclusion
With the proliferation of genomic datasets from related studies by different scientific groups, an important method for increasing power will be to combine results across the different studies. In this article, we have proposed a model-based approach to doing this. Being able to integrate and interpret multiple genomic datasets will be an important enterprise for data analysts working in bioinformatics to address in the future.
A question orthogonal to that looked at in this paper but of equal scientific importance is that of identifying genes whose expression is correlated across a subset of the samples. This is referred to as molecular subtype analysis and was in fact one motiviation of the POE algorithm proposed by Parmigiani et al. (2002). However, finding such gene signatures would require the use of completely different statistical methods than those proposed here and is beyond the scope of the current paper.
Several important issues to consider when integrating microarray studies include use of different gene expression measurement scales, varying analytical power and reliability of the results for individual studies. To address these issues in a meta-analysis framework, we proposed a two-stage mixture modeling strategy. The goal of the mixture model-based transformation is to transform the preprocessed data to the probability scale, which are then integrated across datasets. In particular, the signed probability of differential expression p^{ d }is easily interpretable and is platform-independent. The Normal-Uniform mixture distribution under a Bayesian hierarchical model setting has several desirable properties. We have also proposed an alternative model based on a two-component mixture and estimation using the EM algorithm. We briefly compare the MCMC and EM algorithms. The advantage of the former method is that it pools information across all genes, while the latger approach does not. However, the EM algorithm is computationally much faster than the MCMC scheme. In our example, we find that there is substantial overlap between the two approaches for the metastasis data considered here. However, we also expect that for cancer studies, the EM algorithm would fare better with larger phenotypic differences (e.g., non-cancer versus cancer tissue), while the MCMC approach would be of use when the phenotypic differences in samples are subtle (e.g., Gleason score ≤ 7 versus > 7 in prostate cancer).
Combining samples on the probability scale mitigates the influence of potential artifacts from a single study. The effect is reflected on two counts. One, integrated sample cohorts improve the reliability of the findings by guarding against false positive results from a single study. Two, it increases the statistical power to detect small consistent effects that can be otherwise masked by inadequacy of the sample size of an individual data set. By implementing this modeling approach, we were able to combine information from three microarray studies to build an inter-study validated signature for discriminating metastatic cancer from non-metastatic cancer.
The statistical methods described in the paper are available as an R package, metaArray, which is available through the Bioconductor project at [26].
Methods
Data Structures and Probabilistic Models
Let ${x}_{ij}^{k}$ denote the gene expression measurement for gene i from sample. j in study k, transformed using the base two logarithm, i = 1, ..., N, j = 1, ..., M_{ k }, k = 1, ..., K. Note that we assume that there are N common genes in all K studies, but the number of arrays in studies may vary. We also assume that preprocessing has been done, either by a lowess normalization for two-channel microarray data [27] or a robust multichip average analysis for Affymetrix data [28]. Then the available data can be denoted by ${\left\{{X}^{k}\right\}}_{k=1}^{K}$, where X^{ k }is a N × M_{ k }matrix whose (i, j)th entry is ${x}_{ij}^{k}$. Note that the value and interpretation of ${x}_{ij}^{k}$ is inherently different across array platforms and is not necessarily comparable if they are measured from independent studies.
Corresponding to ${x}_{ij}^{k}$, let ${{\displaystyle e}}_{ij}^{k}$ be a variable that takes one of three values {1, 0, -1}, indicating over-, baseline- or under- expression respectively for gene i in sample j for the study k. If ${{\displaystyle e}}_{ij}^{k}$ were known, then this is a gene-specific quantity that would provide a platform-free scale which could be combined across multiple studies. We approach this problem by treating ${{\displaystyle e}}_{ij}^{k}$ as a latent variable that is inferred from the data using a mixture model. We now present two probabilistic specifications for making inference about ${{\displaystyle e}}_{ij}^{k}$. The first was presented in [8]; we describe it here for the sake of completeness. The second assumes ${{\displaystyle e}}_{ij}^{k}$, take two values of 0 and 1 and involves fitting a two-component mixture model using the EM algorithm. Both specifications aim to map the original expression values to POE values within a study. We then can combine the POE values across the multiple studies. In the simplest case, a direct group comparison can be made by calculating t-statistics or applying significance analysis of microarrays [29] to the combined data. In the remainder of this section, we describe the two approaches for obtaining POE expression values. From here on, we suppress the study indicator k throughout this section because estimation is performed within each study separately, with the only exception being the use of M_{ k }to denote the number of samples in study k.
Bayesian Model-based Approach and Algorithm
This approach was first explored for a single study setting in [7] and used in the meta-analysis setting in [8]. We present it here for the sake of completeness. The estimation of the POE values involves borrowing information across all genes.
where μ_{ i }is the gene-specific effect of gene i, α_{ j }is the sample-specific effect in sample j. For the purposes of identifiability, sample effects ${\left\{{\alpha}_{i}\right\}}_{i=1}^{{M}_{k}}$ are constrained to sum to zero. The parameters ${\kappa}_{i}^{+}$ and ${\kappa}_{i}^{-}$ provide limits to the uniform distribution in the mixture of gene i, and are set to be at least either 3σ_{ i }away from the mean of normal distribution or farther away than the most outlying expression. The parameters ${\pi}_{i}^{+}$ ≡ P(e_{ ij }= 1) and ${\pi}_{i}^{-}$ ≡ P(e_{ ij }= -1) are the multinomial probabilities for the latent variable ${{\displaystyle e}}_{ij}^{k}$. Conceptually, we can think of gene expression for the i-th gene arising from three types of genes in model (1). The first component in the model represents the type of genes whose expression levels are overexpressed in the cancer samples relative to the normal samples. The second corresponds to genes that do not change between cancer and normal samples, and the third is for genes that are underexpressed in cancer samples relative to normal.
where f_{0i}is the normal density function, and f_{1i}, f_{-1i}are the corresponding uniform densities for the differential expression categories for the gene i in each study. In the numerator of (2), f_{1i}= 1/${\kappa}_{i}^{+}$ if x_{ ij }∈ [μ_{ i }+ α_{ j }, μ_{ i }+ α_{ j }+ ${\kappa}_{i}^{+}$] and 0 otherwise. In the numerator of (3), f_{-1j}= 1/${\kappa}_{i}^{-}$ if x_{ ij }∈ [-${\kappa}_{i}^{-}$ + μ_{ i }+ α_{ j }, μ_{ i }+ α_{ j }] and 0 otherwise.
We then construct the following expression measurement: ${p}_{ij}^{d}={p}_{ij}^{+}-{p}_{ij}^{-}$, ranging from -1 to 1. This is the probability of expression (POE); it can be interpreted as the signed conditional probability of differential expression of gene i in sample j in an individual study. On first glance, our formula differs from that in [7] in that their POE measure, corresponding to ${p}_{ij}^{d}$, involves addition, while ours involves subtraction. The two are equivalent, however, since their second probability is constrained to be negative, while ${p}_{ij}^{-}$ is constrained to be positive.
To sample from the posterior distributions of the parameters, a Gibbs sampling algorithm (with Metropolis-Hastings step for mixture proportion parameters) was then implemented where the gene-specific parameters were repeatedly sampled from the corresponding full conditional distributions [See Additional File 4]. We thus fit the Bayesian algorithm to each microarray dataset separately. Note that there is one normal component distribution to the mixture, while the other two are uniform distributions. The reason we prefer this to a three-component normal mixture model is so that the probabilities of expression are monotonic functions of absolute gene expression. It can be shown that using a three-component normal mixture model, the POE is no longer a monotonic function of gene expression. It is desirable to have the monotonicity property as we would like larger differences in gene expression relative to a baseline group to be associated with greater statistical evidence of differential expression. Note that this is a standard assumption made in the meta-analysis methodologies.
There are several advantages to the mixture model-based transformation. First, the method estimates the posterior distribution for the latent variables e_{ ij }, which can then be combined across multiple studies. Second, the transformed values carry meaningful interpretations as signed probabilities of differential expression of a gene in a particular sample. Third, the underlying normal and uniform mixture distributions give equal density in the tails and is effective in reducing the influence of extreme expression values. Finally, the Bayesian hierarchical modeling approach borrows strength across genes, resulting in shrinkage-type estimators for the gene-specific parameters. Consequently, the high-dimensional gene expression data are denoised. However, the algorithm for inferring the posterior distribution of the latent variables is fairly computationally intensive. In the next section, we discuss an alternative mixture model specification that leads to a more computationally efficient algorithm.
Maximum Likelihood Approach using EM algorithm
Maximum likelihood estimation (MLE) using the EM algorithm leads to greater increases in computational speed for mixture models. Such an approach might be useful since what we are interested in eventually is estimates of POE that we can integrate across studies. There is a difficulty in implementing an EM algorithm for the three-component mixture model we considered in the previous section. Recall the restriction that the uniform components must have the same heights. Since the MLE of end points of uniform distributions are the most outlying observations, we have found in some examples that the EM algorithm with these MLEs provides parameter estimates that are unstable.
where μ_{ i }is the mean of the normal distribution, π_{ i }is the mixing proportion and a_{ i }, b_{ i }are the two end points of Uniform distribution respectively. Conceptually, there are only two populations of genes in model (4). There is a constitutively expressed population common to both tumor and normal samples (the normal component) as well as a differentially expressed part (the uniform component). Such a model has been proposed in the situation for K = 1 in [30]. Their interest was in determining differentially expressed genes within one study, while ours is in combining results across multiple studies.
As mentioned in [30], a_{ i }and b_{ i }are estimated by the minimum and maximum of the x_{ ij }for a fixed j. We obtain estimates of e_{ ij }, ${\widehat{e}}_{ij}$, after the EM algorithm converges. To construct estimates of POE, we take ${\widehat{e}}_{ij}$ and make it negative for those samples whose observed expression was to the left of the mean of the baseline distribution of expression for each gene. This places the POE values from this model on the same scale as those from the three-component mixture model. In terms of initial values for the mixture model and in particular e_{ ij }, they were set at zero for all points except those that were three standard deviations from the mean expression.
Such an approach is much less computationally challenging compared to the Markov chain Monte Carlo described in the previous section. In particular, the MCMC method requires iterating over all N genes, while the EM algorithm is calculated for one gene at a time. Letting S and I denote the periodic skip in Gibbs sampler and the number of iteration respectively, the computation speed is O(NSI) for the MCMC algorithm, while it is O(N) for the EM algorithm. We compare the performances of the two methods on a real dataset in the Results section.
where |A| denotes the cardinality of the set A.
The resulting POE can be easily calculated using the simple estimate P(${\mathcal{G}}_{M}$) = |${\mathcal{G}}_{M}$|/M_{ k }, where M_{ k }is the number of samples in the k th study. We plug this estimate into the calculation of POE for all genes and samples. However, at the end of the iteration, we use Bayes' rule to get the posterior probability of e_{ ij }being one so that the POE values are not zero.
To see what effects this procedure has, let us consider two hypothetical situations. For the first situation, if the distribution of expression in localized samples overlaps with that of metastatic samples, then most POE values will be near zero. This implies that not many samples will show differential expression between the two groups. By contrast, if the expression values in metastatic samples are concentrated in either tail relative to the distribution of expression in localized samples, then resulting POE values will be larger in absolute value. POE values referenced to one group may reveal the contrast between the two groups, and will help denoise relative expression differences in the two groups when merging across independent datasets, which is otherwise potentially susceptible to other grouping or study-specific effects. Such an adjustment can also be easily incorporated in the full Bayesian model. In our meta-analysis example, the basic principle for both estimation procedures is to fix e_{ ij }= 0 for localized tumor samples across all genes throughout, and estimate mixture proportion parameters π. With the π thus obtained, we can estimate POE for both localized and metastatic tumors. The Bayesian algorithm fixes e_{ ij }= 0 for the localized tumors during each iteration of the Gibbs sampling algorithm.
Interpretation of Latent Variables
Note that the e_{ ij }are the target quantities of interest within each study. In particular, we note that much of the meta-analysis literature for genomic data has focused on using gene-specific summaries and combining them across studies (e.g., [3, 6]). We instead transform the raw data directly; this may lead to potential gains in efficiency of analysis.
While we describe potential meta-analytic approaches in the next section, we mention two interpretations of the e_{ ij }themselves. First, we can define sample subtypes based on the e_{ ij }; this was also noted in [32]. Recently, the authors of [33] proposed an alternative to the t-test for biomarker discovery. In this approach, the idea was that a fraction of the cancer samples would be positive for the biomarker(s) of interest so that a t-test would fail to capture the difference. The mixture models described in this paper provide model-based alternatives to the nonparametric testing procedure proposed in [33]. A second interpretation of e_{ ij }pertains to the false discovery rate [9]. The false discovery rate is roughly defined to be the expected number of false discoveries divided by the number of rejected hypotheses, where the gene-specific null hypothesis is that there is no differential expression for the gene. It can be shown that for the mixture models in this paper, P(e_{ ij }= 0|X) represents the Bayesian false discovery rate [34].
Integration of Transformed Data: Analysis Tools
Let X_{ k }be the study-wise transformed expression data for the study k. After fitting one of the two types of models described previously, the data we have are ${X}_{k}^{\ast}\equiv {P}_{k}^{d}$, where ${P}_{k}^{d}$ is a probability matrix with entries ${p}_{ij}^{\ast}\equiv {p}_{ij}^{+}-{p}_{ij}^{-}$ as described earlier. For a common set of N genes that are profiled in each of the studies of interest, data integration is subsequently based on the rescaled values ${X}_{k}^{\ast}$, and results in a combined data matrix of dimension $N\times {\displaystyle {\sum}_{k=1}^{K}{M}_{k}}$. These are the estimated POE values obtained from fitting one of the two algorithms to each of the separate datasets.
Treating the ${X}_{k}^{\ast}$ as the new "data," we can now apply standard microarray methodologies to them. Note that one major assumption made is that the studies being combined show relatively little between-study heterogeneity. This is a crucial assumption in meta-analysis [1] and is not any different for the approach we describe here. If this assumption fails, then in effect we would be attempting to combine quantities representing fundamentally different things.
One goal in genomic data analyses is determining which genes are differentially expressed. There are many available methods for doing this, such as SAM [29], analysis using q-values [4] or Empirical Bayes methods [35]. These methods provide adjusted t-statistics for comparing two groups. The adjustment is for the multiple comparisons problem; we prefer approaches based on the false discovery rate because they tend to be less conservative and can provide investigators with calibrated lists of genes that they can then attempt to validate. In the example discussed in the Results section, the group label is the tumor type (localized/metastatic).
- (a)
Fit a univariate logistic regression model using group label as the response and gene expression as the predictor; obtain the estimated regression coefficient.
- (b)
Define a risk index as the weighted average of gene expression, where the weight is the estimated regression coefficient from step (a).
We will assess the performance of the genes found using classification accuracy. If we want to assess the performance of the classifier, we must deal with the issue of training and testing the model using the same data. An honest estimate of the prediction error rate is obtained using leave-one-out cross-validation. Define the risk index for sample j by $R{I}_{j}={\displaystyle {\sum}_{i=1}^{p}{\widehat{\beta}}_{i,-j}{x}_{ij}^{\ast}}$, where ${x}_{ij}^{\ast}$ is the POE value for gene i in sample j, j = 1, ..., $\sum}_{k=1}^{K}{M}_{k$ and ${\widehat{\beta}}_{i,-j}$ is the effect estimate for gene i in the combined dataset without the sample j. The risk index for sample j is a weighted linear combination of the expression profiles of the top p genes, where the ranking of the genes is based on their corresponding significance in the univariate logistic model fit. As a result, large positive values of RI indicate high risk of failure, whereas large negative values of RI indicate low risk of failure. Classification of sample j to the risk groups is then based on the j^{th} leave-one-out risk index. The classifier is ${\mathcal{C}}_{j}$(X*) = I{RI_{ j }> c}, with c being the empirical quantiles of the RI's. The number of genes p in a classifier is also treated as a parameter and optimized to minimize the prediction error rates. Note that to maintain unbiasedness of the procedure, we re-fit the univariate logistic regressions for each dataset with a withheld sample and re-rank genes based on the corresponding results. One other issue involves the use of POE values on training versus testing sets. As described in the previous section, we can obtain POE values either using or not using the class labels. In training sets, we typically use the class labels. We cannot use them in the test set as this will lead to overfitting. However, it is still possible to get POE values without using the phenotypic information for the test set.
Declarations
Acknowledgements
We thank T.R. Barrette, D.R. Rhodes, J. Yu, and R. Lnu for bioinformatics support on this project. We also thank Simens Zhong for his helpful comments on the implementation of metaArray. This research is supported in part by grants from the National Cancer Institute and from the National Science Foundation and National Institute of General Medical Sciences.
Authors’ Affiliations
References
- Hedges L, Olkin I: Statistical methods for meta-analysis. New York: Academic Press; 1985.Google Scholar
- Normand SLT: Meta-analysis: Formulating, Evaluating, Combining, and Reporting. Statistics in Medicine 1999, 18: 321–359. 10.1002/(SICI)1097-0258(19990215)18:3<321::AID-SIM28>3.0.CO;2-PView ArticlePubMedGoogle Scholar
- Rhodes D, Barrette TR, Rubin MA, Ghosh D, Chinnaiyan AM: Meta-Analysis of Microarrays: Interstudy Validation of Gene Expression Profiles Reveals Pathway Dysregulation in Prostate Cancer. Cancer Research 2002, 62: 4427–33.PubMedGoogle Scholar
- Storey JD: A direct approach to false discovery rates. J R Stat Soc B 2002, 64: 479–98. 10.1111/1467-9868.00346View ArticleGoogle Scholar
- Choi JK, Yu U, Kim S, Yoo OJ: Combining multiple microarray studies and modeling interstudy variation. Bioinformatics 2003, 19: 184–190. 10.1093/bioinformatics/btg1010View ArticleGoogle Scholar
- Wang J, Coombes K, Highsmith W, Keating M, Abruzzo L: Differences in gene expression between B-cell chronic lymphocytic leukemia and normal B cells: a meta-analysis of three microarray studies. Bioinformatics 2004, 20: 3166–78. 10.1093/bioinformatics/bth381View ArticlePubMedGoogle Scholar
- Parmigiani G, Garrett ES, Anbazhagan R, Gabrielson E: A statistical framework for expression-based molecular classification in cancer. J R Stat Soc B 2002, 64: 717–36. 10.1111/1467-9868.00358View ArticleGoogle Scholar
- Shen R, Ghosh D, Chinnaiyan AM: Prognostic meta-signature of breast cancer developed by two-stage mixture modeling of microarray data. BMC Genomics 2004, 5: 94. 10.1186/1471-2164-5-94PubMed CentralView ArticlePubMedGoogle Scholar
- Benjamini Y, Hochberg Y: Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing. J R Statist Soc Ser B 1995, 57: 289–30.Google Scholar
- LaTulippe E, Satagopan J, Smith A, Scher H, Scardino P, Reuter V, Gerald WL: Comprehensive gene expression analysis of prostate cancer reveals distinct transcriptional programs associated with metastatic disease. Cancer Res 2002, 62: 4499–506.PubMedGoogle Scholar
- Garber M, Troyanskaya O, Schluens K, Petersen S, Thaesler Z, Pacyna-Gengelbach M, van de Rijn M, Rosen G, Perou C, Whyte R, Altman R, Brown P, Botstein D, Petersen I: Diversity of gene expression in adenocarcinoma of the lung. Proc Natl Acad Sci USA 2001, 98: 13784–13789. 10.1073/pnas.241500798PubMed CentralView ArticlePubMedGoogle Scholar
- Chen X, Cheung ST, So S, Fan ST, Barry C, Higgins J, Lai KM, Ji J, Dudoit S, Ng IO, Van De Rijn M, Botstein D, Brown PO: Gene expression patterns in human liver cancers. Mol Biol Cell 2002, 13: 1929–1939. 10.1091/mbc.02-02-0023.PubMed CentralView ArticlePubMedGoogle Scholar
- Conlon EM, Song JJ, Liu JS: Bayesian models for pooling microarray studies with multiple sources of replications. BMC Bioinformatics 2006, 7: 247. 10.1186/1471-2105-7-247PubMed CentralView ArticlePubMedGoogle Scholar
- vant Veer LJ, Dai H, van de Vijver MJ, He YD, Hart AA, Mao M, Peterse HL, van der Kooy K, Marton MJ, Witteveen AT, Schreiber GJ, Kerkhoven RM, Roberts C, Linsley PS, Bernards R, Friend S: Gene expression profiling predicts clinical outcome of breast cancer. Nature 2002, 415: 530–6. 10.1038/415530aView ArticleGoogle Scholar
- Rhodes D, Yu J, Shanker K, Deshpande N, Varambally R, Ghosh D, Barrette T, Pandey A, Chinnaiyan A: Large-scale meta-analysis of cancer microarray data identifies common transcriptional profiles of neoplastic transformation and progression. Proc Natl Acad Sci USA 2004, 101: 9309–14. 10.1073/pnas.0401994101PubMed CentralView ArticlePubMedGoogle Scholar
- Diehn M, Sherlock G, Binkley G, Jin H, Matese JC, Hernandez-Boussard T, Rees CA, Cherry JM, Botstein D, Brown PO, Alizadeh AA: SOURCE: a unified genomic resource of functional annotations, ontologies, and gene expression data. Nucleic Acids Research 2003, 31: 219–223. 10.1093/nar/gkg014PubMed CentralView ArticlePubMedGoogle Scholar
- The BUGS Project[http://www.mrc-bsu.cam.ac.uk/bugs]
- DAVID 2007 Functional Annotation Bioinformatics Microarray Analysis[http://niaid.abcc.ncifcrf.gov/]
- Kaposi-Novak P, Lee JS, Gomez-Quiroz L, Coulouarn C, Factor VM, Thorgeirsson SS: Met-regulated expression signature defines asubset of human hepatocellular carcinomas with poor prognosis and aggresive phenotype. Journal of Clinical Investigation 2006, 116: 1582–1595. 10.1172/JCI27236PubMed CentralView ArticlePubMedGoogle Scholar
- Oue N, Aung PP, Mitani Y, Kuniyasu H, Nakayama H, Yasui W: Genes involved in invasion and metastasis of gastric cancer identified by array-based hybridization and serial analysis of gene expression. Oncology 2005, 69: 17–22. 10.1159/000086627View ArticlePubMedGoogle Scholar
- Grade M, Hormann P, Becker S, Hummon AB, Wangsa D, Varma S, Simon R, Liersch T, Becker H, Difilippantonio MJ, Ghadimi M, Ried T: Gene expression profiling reveals a massive aneuploidy-dependent transcriptional deregulation and distinct differences between lymph node-negative and lymph node-positive colon carcinomas. Cancer Research 2007, 67: 41–56. 10.1158/0008-5472.CAN-06-1514View ArticlePubMedGoogle Scholar
- Cox DR: Regression models and life tables (with discussion). J R Statist Soc Ser B 1972, 34: 187–220.Google Scholar
- Harrell FE, Lee KL, Mark DB: Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med 1996, 15: 361–387. Publisher Full Text 10.1002/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4View ArticlePubMedGoogle Scholar
- Lee J, Bussey K, Gwadry F, Reinhold W, Riddick G, Pelletier S, Nishizuka S, Szakacs G, Annereau J, Shankavaram U, Lababidi S, Smith L, Gottesman M, Weinstein J: Comparing cDNA and oligonucleotide array data: concordance of gene expression across platforms for the NCI-60 cancer cells. Genome Biology 2003, 4: R82. 10.1186/gb-2003-4-12-r82PubMed CentralView ArticlePubMedGoogle Scholar
- Parmigiani G, Garrett-Meyer ES, Anbazhagan R, Gabrielson E: A cross-study comparison of gene expression studies for the molecular classification of lung cancer. Clin Cancer Res 2004, 10: 2922–7. 10.1158/1078-0432.CCR-03-0490View ArticlePubMedGoogle Scholar
- metaArray[http://www.bioconductor.org/packages/2.0/bioc/html/metaArray.html]
- Yang YH, Dudoit S, Luu P, Lin DM, Peng V, Ngai J, Speed TP: Normalization for cDNA microarray data: a robust composite method addressing single and multiple slide systematic variation. Nucleic Acids Research 2002, 30: el5.View ArticleGoogle Scholar
- Irizarry RA, Hobbs B, Collin F, Beazer-Barclay YD, Antonellis KJ, Scherf U, Speed TP: Exploration, normalization, and summaries of high density oligonucleotide array probe level data. Biostatistics 2003, 4: 249–264. 10.1093/biostatistics/4.2.249View ArticlePubMedGoogle Scholar
- Tusher VG, Tibshirani R, Chu G: Significance analysis of microarrays applied to ionizing radiation response. Proc Natl Acad Sci 2001, 98: 5116–21. 10.1073/pnas.091062498PubMed CentralView ArticlePubMedGoogle Scholar
- Dean N, Raftery AE: Normal uniform mixture differential gene expression detection for cDNA microarrays. BMC Bioinformatics 2005, 6: 173. 10.1186/1471-2105-6-173PubMed CentralView ArticlePubMedGoogle Scholar
- Dempster AP, Laird NM, Rubin DB: Maximum Likelihood from Incomplete Data Via the EM Algorithm (C/R: P22–37). Journal of the Royal Statistical Society, Series B: Methodological 1977, 39: 1–22.Google Scholar
- Scharpf R, Garrett ES, Hu J, Parmigiani G: Statistical modeling and visualization of molecular profiles in cancer. BioTechniques 2003, 34: S22-S29.Google Scholar
- Lyons-Weiler J, Patel S, Becich MJ, Godfrey T: Tests for finding complex patterns of differential expression in cancers: towards individualized medicine. BMC Bioinformatics 2004, 5: 110. 10.1186/1471-2105-5-110PubMed CentralView ArticlePubMedGoogle Scholar
- Newton MA, Noueiry A, Sarkar D, Ahlquist P: Detecting differential gene expression with a semiparametric hierarchical mixture method. Biostatistics 2004, 5: 155–176. 10.1093/biostatistics/5.2.155View ArticlePubMedGoogle Scholar
- Kendziorski CM, Newton MA, Lan H, Gould MN: On parametric empirical Bayes methods for comparing multiple groups using replicated gene expression profiles. Stat Med 2003, 22: 3899–3914. 10.1002/sim.1548View ArticlePubMedGoogle Scholar
- Tukey JW: Tightening the Clinical Trial. Controlled Clinical Trials 1993, 14: 266–285. 10.1016/0197-2456(93)90225-3View ArticlePubMedGoogle Scholar
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.