Bayesian models for pooling microarray studies with multiple sources of replications
© Conlon et al; licensee BioMed Central Ltd. 2006
Received: 03 August 2005
Accepted: 05 May 2006
Published: 05 May 2006
Biologists often conduct multiple but different cDNA microarray studies that all target the same biological system or pathway. Within each study, replicate slides within repeated identical experiments are often produced. Pooling information across studies can help more accurately identify true target genes. Here, we introduce a method to integrate multiple independent studies efficiently.
We introduce a Bayesian hierarchical model to pool cDNA microarray data across multiple independent studies to identify highly expressed genes. Each study has multiple sources of variation, i.e. replicate slides within repeated identical experiments. Our model produces the gene-specific posterior probability of differential expression, which provides a direct method for ranking genes, and provides Bayesian estimates of false discovery rates (FDR). In simulations combining two and five independent studies, with fixed FDR levels, we observed large increases in the number of discovered genes in pooled versus individual analyses. When the number of output genes is fixed (e.g., top 100), the pooled model found appreciably more truly differentially expressed genes than the individual studies. We were also able to identify more differentially expressed genes from pooling two independent studies in Bacillus subtilis than from each individual data set. Finally, we observed that in our simulation studies our Bayesian FDR estimates tracked the true FDRs very well.
Our method provides a cohesive framework for combining multiple but not identical microarray studies with several sources of replication, with data produced from the same platform. We assume that each study contains only two conditions: an experimental and a control sample. We demonstrated our model's suitability for a small number of studies that have been either pre-scaled or have no outliers.
cDNA microarrays monitor gene expression for thousands of genes simultaneously. Two experimental conditions are compared by examining the ratio of expression between two samples, e.g. treatment versus control, wildtype versus mutant, or disease versus healthy. The primary goal of these experiments is to identify genes that are differentially expressed between the two conditions. The up-regulated and down-regulated genes shed light on biological mechanisms of the cell, such as functional pathways, response to treatments, and gene regulation.
Bayesian models have been used extensively in single microarray studies to identify differentially expressed genes (e.g. [1–3]); the discrete mixture model approach in particular has had considerable use [4–13]. Additional Bayesian methods for identifying differentially expressed genes include Bayesian ANOVA for microarrays (BAM) of Ishwaran and Rao [14, 15]. This approach redefines the search for differentially expressed genes as a Bayesian variable selection process and uses a hierarchical model that is tailored to adaptive shrinkage. Through the use of model averaging, BAM essentially shrinks only the effects of the non-differentially expressed genes relative to the least squares estimates. For a review of Bayesian approaches to microarray data analysis and their advantages over frequentist methods, see Yang et al. .
In addition to performing single microarray studies, biologists often conduct multiple but not identical studies to understand the same biological system. Pooling results of these studies can help identify truly differentially expressed genes. Meta-analyses for microarray studies have been used recently by many researchers in a non-Bayesian context [17–24]. Rhodes et al.  combined the results of four prostate cancer studies using a p-value approach. Genes were assigned a p-value in each study separately, and the results were combined to estimate a gene-specific p-value across all studies. This method avoids the necessity of integrating gene expression measures and thus can be used for data across multiple platforms. Choi et al.  presented a meta-analysis that integrated gene effect sizes, rather than p-values, into one mean effect. The effect sizes for each study were equal to the mean differences between affected and control groups, standardized by a pooled standard deviation. Due to this standardization, data was able to be integrated across platforms. A common parameter for inter-study variability was incorporated into the model, and statistical significance was determined by permutation tests. Parmigiani et al.  introduced an integrative correlation approach to combining data from multiple platforms. This procedure evaluated gene expression consistencies across platforms rather than pooling gene expression values. Using lung cancer data, this method identified genes with reproducible expression patterns across studies and improved correlation across studies. Additional theoretical approaches for combining data from different platforms include adding covariates to models to account for the differences among data types [24, 25], although this has not been applied in a microarray setting. While the studies of Rhodes et al. , Choi et al. , Parmigiani et al.  and others provide methods for integrating data across platforms, other authors have shown the difficulties in such an approach ([26, 27]; discussions in [25, 28]). Working with cell lines, Kuo et al.  and Jarvinen et al.  both conclude that combining data across platforms is unreliable. Due to these difficulties, other meta-analysis methods focus on incorporating data from one platform only [23, 24]. Here, we focus our approach to combine microarray data from the same platform, cDNA microarrays, and assume that the data has either been pre-normalized across studies or that there are no outlying studies.
Choi et al.  also provided an alternative Bayesian meta-analysis method to their random effects approach. In this Bayesian model, uninformative prior distributions were assigned to the overall mean effects and the inter-study variation parameter. Within-study gene effects were modelled as t-distributions, and posterior estimates of the overall mean effect for each gene were produced by smoothing effects across studies. The authors demonstrated that Bayesian meta-analysis is more robust and flexible than traditional methods, confirming the findings of DuMouchel and Harris . Bayesian models are also well-suited to data with many levels of replication, including replicate slides within repeated identical experiments. Due to these advantages, we introduce a Bayesian hierarchical model that provides a principled framework for incorporating data from multiple independent cDNA microarray studies with several sources of replication. Unlike the approach of Choi et al. , which smoothes the gene effects into one average, our method produces the posterior probability of differential expression based on gene expression levels across studies. Thus, inter-study variability does not need to be estimated by our model. The probability of differential expression provides a direct method for ranking genes, and also for estimating both integration-driven discovery rates and false discovery rates. In simulations, we illustrate that pooling studies increases the number of discovered genes for given thresholds of probabilities of differential expression and false discovery rates, compared to individual studies. In addition, for a fixed top number of genes, the pooled model identifies considerably more differentially expressed genes than separate studies. We also illustrate our method using experimental data from two independent studies in Bacillus (B.) subtilis.
Background on cDNA microarray experiments
cDNA microarrays measure the amount of messenger RNA (mRNA) contained in an experimental sample. They are produced by robotic arrayers, which place entire gene sequences complementary to mRNA onto glass slides. In an experiment, the mRNA in two samples, e.g. treated and control, are fluorescently labeled with two different dyes, typically red and green (Cy5 and Cy3), and mixed together. The combined sample is hybridized to the array, and complementary sequences bind to each other. The relative amounts of mRNA present in the two samples are measured by scanning the slide with two different wavelengths. The resulting fluorescent intensity values for the red and green-labeled mRNA are then compared by using the ratio of intensities. For further details, see [30–33]. We use log-ratios of intensities in each study since they even out highly skewed distributions and give a more realistic sense of variation .
Results and discussion
Bayesian model for pooling multiple studies
Biologists often conduct multiple but different studies that all target the same biological system or pathway. For example, when studying the effect of a key transcription factor σE in B. subtilis, Eichenberger et al.  conducted both the σE knockout and the σE over-expression experiments (i.e. the mutant and induction experiments, respectively; see Methods). Thus, those genes that are up-regulated in one experiment should be down-regulated in another. Pooling both experiments can help more accurately identify true target genes. More generally, we may imagine having available multiple independent studies of one specific biological system. We assume that each study contains only two conditions: an experimental and a control. It is desirable to combine information from these studies in a principled way. Our model to achieve this goal is as follows:
for j = 1,..., J independent studies. Here, y jgse is the microarray data, i.e. the normalized log-expression ratios for gene g, experiment e, slide s, and μ jge is the average over all slides S e within experiment e of study j. θ jg is the log-expression ratio for each gene of study j. Conjugate inverse chi-squared prior distributions are assigned to and , for which we use the notation and . Here, denotes the standard inverse χ2 distribution with k degrees of freedom, and and are scale parameters of the inverse chi-squared distribution and are derived from the data. The parameter is equal to slide variation, is equal to experiment variation for study j, and the degrees of freedom h, k are assumed known. We define I g ~Bernoulli(p) as the indicator variable for differential expression of gene g, i.e. θ jg ≠0, j = 1,..., J, where p is the percent of differentially expressed genes. Thus, Prob(I g = 1) = p, where
Here, genes are divided into two groups, non-expressed (I g = 0) and expressed (I g = 1), with respective probabilities (1-p) and p. The model produces the posterior distribution for D g = Prob(I g = 1|data), which is the basis for inference. For prior distributions, when I g = 0, we assume the θ jg are distributed normally with mean zero and small variance ; when I g = 1, we assume the θ jg are distributed normally with mean zero and large variance c × . A Markov chain Monte Carlo (MCMC) implementation of the model  simulates posterior distributions for each parameter. See Methods for more details on the prior distributions and the MCMC implementation. For each gene, we calculate the posterior probability D g of differential expression over all studies, and rank the genes based on D g . The prior estimates of the variance parameters and are similar to Tseng et al. . Our prior structure for a single experiment is similar to Gottardo et al.  except that we place a Uniform prior distribution on p rather than estimating p through an iterative algorithm. We also have one more level of variation than the model of Gottardo et al. , i.e. variation over slides within experiments. Our underlying hierarchical Gaussian model is also similar to the BAM models of Ishwaran and Rao [14, 15], except that the BAM models are designed for a two-sample problem, while our model assumes that the data are ratios of treatment and control intensities. We evaluate our model using false discovery rates and integration-driven discovery rates, defined in the following.
Choi et al.  define the integration-driven discovery rate (IDR) as the number of genes discovered in a meta-analysis that were not discovered in any of the individual studies alone, divided by the total number of discoveries. IDR represents the gain in information from combining studies versus individual studies. For our model, we fix a threshold value, γ, and label genes differentially expressed if (D g ≥ γ). The IDR is defined as the number of genes that are labelled differentially expressed in the pooled analysis and are not differentially expressed in any of the individual studies:
False discovery rate
Benjamini and Hochberg  introduced the false discovery rate (FDR), which is defined as the number of false discoveries divided by the number of discoveries. We refer to this as the true false discovery rate (t FDR), which can be exactly computed in our simulation studies since we know which genes are truly differentially expressed. Further applications of FDR to microarrays include [38–40]. Genovese and Wasserman  define the posterior expected FDR (pe FDR) as:
with δ g an indicator for differentially expressed genes (see also Do et al. ). In the simulated data, we use t FDR and compare t FDR to pe FDR; for the experimental data, we have no choice but to use pe FDR.
Simulation results for two studies
Results for two-study simulations. Integration-driven discovery rate (IDR) and the number of discovered genes for various threshold values of the posterior probability of differential expression, γ, and three simulated levels of the percent of differentially expressed genes p = 5%, 10%, 25%. The true false discovery rate (t FDR) is controlled at 5% for all pooled studies.
# Discovered genes
# Discovered genes
# Discovered genes
Number of differentially expressed (D.E.) genes for fixed top numbers of genes. The number of differentially expressed genes discovered by the pooled model and individual models for fixed threshold numbers of top genes, including the two-study simulation model, p = 5%, 10%, 25%, and the five-study simulation model, p = 10%.
Two-study simulation data
Threshold number of genes
# of D.E. genes, pooled model
# of D.E. genes, individual study 1
# of D.E. genes, individual study 2
p = 5%
p = 10%
p = 25%
# of D.E. genes, individual study number
Five-study simulation data
Threshold number of genes
# of D.E. genes, pooled model
p = 10%
Simulation results for five studies
We also show the number of differentially expressed genes identified by the pooled versus individual analyses for a fixed value of top expressed genes in Table 2. For the top 300 genes, the pooled model again identifies more differentially expressed genes than individual studies. We also compared pe FDR to t FDR in Figure 2d. The average difference was 0.54%, with maximum difference of 2.7%at t FDR = 0.36%. These values are smaller than the results for the two-study simulations, showing improved accuracy of pe FDR when pooling more data.
Experimental data results
Results for Bacillus subtilis experimental data. Integration-driven discovery rate (IDR), posterior expected false discovery rate (pe FDR) and the number of discovered genes for various threshold values of the posterior probability of differential expression, γ, for the pooled analysis of the B. subtilis mutant and induction experimental study data.
Posterior expected FDR
# Discovered genes
We demonstrated here the usefulness of a Bayesian hierarchical model for pooling data across independent microarray studies with several sources of variation. The pooled method provides a systematic analysis framework, producing probability estimates of differential expression for each gene. These estimates are used to rank genes, calculate IDR, and produce posterior expected FDR values.
In the simulation of two and five studies, we found an appreciable increase in the IDR for various thresholds of the probability of differential expression, with corresponding low levels of t FDR. When fixing t FDR, we found more genes discovered in the pooled analysis than the separate analyses. When setting a threshold for the top genes of interest, the pooled model identified more truly differentially expressed genes than individual analyses. In the simulation of five studies, the IDR was somewhat lower than for two studies, but was still considerable. When comparing the pe FDR to t FDR in simulations, we found reasonable agreement, with pe FDR overestimating t FDR on average by less than 3%. The difference between pe FDR and t FDR decreased for the simulation of five studies, indicating that pooling more data improves the posterior estimation of FDR. In our analysis of experimental data, the IDR was also large. One study had somewhat lower probabilities of differential expression, which resulted in more discoveries when the data was pooled. We conclude that combining information across studies strengthens the probabilities of differential expression, improves IDR, and increases the number of discovered genes for fixed t FDR, pe FDR and fixed top percent of genes than individual study analyses.
Our model is designed for studies from the same platform. In the B. subtilis experimental data, a common control sample was used for the mutant and induction studies. However, our model does not require a common reference sample across studies, and assumes the studies are independent. In addition, all studies do not need to have the same array-design layout. This is due to the studies being linked only through the common parameter of differential expression, p; no other parameters are shared between studies. For example, one study could have only replicate slides, and another study could have both replicate slides and replicate experiments. We also assume that there are either no outlying studies or that the data has been scaled across studies before analysis. Future work will address the issues of pooling studies from different platforms and sets of studies that may contain outliers.
Simulation data for two studies
We simulated data for two studies, with the same format as the B. subtilis mutant and induction experimental data (see Methods: Experimental data), with the percent of differentially expressed genes of p = 5%, 10% and 25%. Each study had 3,000 genes; the first study had 5 replicate slides within 3 replicate experiments, and the second study had 4 replicate slides within 3 replicate experiments. We simulated data from Model (1), with parameters similar to those found in the experimental data. For Study 1, we used = 0.015, and c = 66.67. The variance across slides was set to 0.074, and across experiments to 0.029. For Study 2, we used = 0.02, and c = 40. The variance across slides was set to 0.02, and across experiments to 0.026.
Between study variance for the experimental data was 0.067 for all 2,515 genes, and 0.296 for the top 10% of genes. The simulated data had similar between study variance for all genes, and higher variability for the top genes than the experimental data. The between study variance was 0.053 for p = 5%, 0.105 for p = 10% and 0.23 for p = 25% for all 3,000 genes, with between study variance for the top genes of 0.714 for p = 5%, 0.887 for p = 10% and 0.86 for p = 25%. For each gene, log-expression ratios are simulated from normal distributions, independently of other genes. Although expression is expected to have some correlation among genes, this is difficult to model, and we thus assume independence for simulation purposes. The independence assumption was also used in simulation studies by other authors (see, for example, [8, 9]).
Simulation data for five studies
For the simulation of five studies, we used the Study 1 and Study 2 data from the previous section, and simulated data for 3 additional studies, with p = 10% for all studies. For Studies 3, 4 and 5, we simulated 5 replicate slides within 3 replicate experiments. For the parameters ,c and variance across slides and experiments, we used a range of values that were either between the values for Study 1 and Study 2, or somewhat larger or smaller than these two studies. For the Study 3, we used = 0.017, and c = 70.6. The variance across slides was set to 0.05, and across experiments to 0.02. For Study 4, we used = 0.02, and c = 55. The variance across slides was set to 0.04, and across experiments to 0.022. For Study 5, we used = 0.015, and c = 60. The variance across slides was set to 0.06, and across experiments to 0.03. Between study variance ranged from 0.098 to 0.153 for all 5 studies for all 3,000 genes, and from 0.827 to 1.35 for the top 10% of genes, which was higher than the two-study experimental data.
The B. subtilis experiments were designed to identify sporulation genes under the control of sigma factor E (σE). Two complementary experimental setups were used, the first was a deletion of σE (mutant study) and the second an overexpression of σE (induction study), described in the following (for additional details, see [35, 42]).
In the mutant study, the treated sample contained sporulating cells with a null mutation in the gene for σE (i.e. the mutant sample), and the control sample contained sporulating cells that were wild type for σE. The wild-type/mutant ratios were examined; up-regulated genes were identified as belonging to the σE regulon. In total, five microarrays were produced from three independent identical experiments; the first experiment had three replicate arrays and the second and third experiments each had one array. The number of genes spotted on the five arrays ranged from 4,268 to 4,751; these values are larger than the B. subtilis genome size of 4,106 due to multiple spotting of selected genes on various arrays. The percent of low quality spots that were removed from analysis ranged from 18.6% to 64.5% of values across the five arrays. In total, there were 3,713 genes with measurable expression ratios in at least one microarray. Here, we analyze values after normalization using a rank-invariant method [2, 43].
In the induction study, σE was overexpressed in response to an inducer, i.e. cells that had been treated with an inducer were compared to control cells. The induction/wild-type ratios were examined; up-regulated genes were identified as belonging to the σE regulon. In total, four microarrays were produced from three independent identical experiments. The first two experiments each had one array, and the third experiment had two replicate arrays. The number of genes spotted on the four arrays ranged from 4,608 to 4,751; the percentage of genes detected on the arrays ranged from 33.0% to 47.4%. In total, there were 2,552 genes with measurable expression ratios in at least one microarray. Here, we again analyze the post-normalized values.
Markov chain Monte Carlo implementation
In the Markov chain Monte Carlo analysis, the full conditionals are simulated as follows.
Joint posterior distribution
For the hierarchical model of (1), the joint distribution of the data and parameters is:
where Ω j = (, c j ), j = study, g = gene, e = experiment, s = slide.
The prior distributions are specified as follow.
Here, denotes the standard inverse χ2 distribution with k degrees of freedom, and and are scale parameters of the inverse chi-squared distribution derived from the data. is produced as follows:
where yjg.eis the average log-ratio of expression over the slides within an experiment:
Similarly, the scale parameter for is calculated as follows:
where yjg..is the average log-ratio of expression over both slides and experiments. We use 3 degrees of freedom in each study for both and , i.e. h = k = 3. The prior distributions for the remaining parameters are as follow.
We choose a, so that the prior mean of is 1 with variance 0.1. We choose b, so that the prior mean of c j is 100 with variance 10,000.
Full conditional posterior distributions
Each parameter is sampled from the full conditional posterior distributions by the following.
Here, denotes the standard inverse χ2 distribution with (S 1 +...+ S E + k) degrees of freedom, with scale parameter:
For I g = 0, the following full conditionals are sampled:
For I g = 1, the following full conditionals are sampled:
For all iterations, the following are sampled:
Here G = total number of genes g, G' = set of genes with I g = 1 in an iteration, and Y g is the data from all studies. Since the full conditional posterior distributions are all closed form when conditioned on the values of I g , the Gibbs sampler  is used to generate samples from these distributions. We used 5,000 iterations for all analyses, except for the five study simulation, which required 8,000 iterations, which was more than adequate. The calculations are implemented using the WinBUGS software .
Availability and requirements
The WinBUGS code for executing the models is freely available.
Project name: BayesPoolMicro.
Project home page: http://www.math.umass.edu/~conlon/research/BayesPoolMicro/
Operating system: Windows 98 or later.
Other requirements: WinBUGS software version 1.4 or later .
We thank George Tseng, Jeffrey Townsend and John Staudenmayer for helpful discussion, and Patrick Eichenberger and the laboratory of Richard Losick for the B. subtilis microarray data and helpful advice. We also thank three anonymous referees for input that enhanced the manuscript. EMC was partially supported by a University of Massachusetts Healey Endowment Grant, and JSL was partially supported by the NIH Grant R01-HG02518-01, and the NSFChina Grant 10228102.
- Baldi P, Long AD: Bayesian framework for the analysis of microarray expression data: reguralized t-test and statistical inferences of gene changes. Bioinformatics 2001, 17: 509–519. 10.1093/bioinformatics/17.6.509View ArticlePubMedGoogle Scholar
- Tseng GC, Oh MK, Rohlin L, Liao JC, Wong WH: Issues in cDNA microarray analysis: quality filtering, channel normalization, models of variations and assessment of gene effects. Nucleic Acids Res 2001, 29: 2549–2557. 10.1093/nar/29.12.2549PubMed CentralView ArticlePubMedGoogle Scholar
- Townsend JP, Hartl DL: Bayesian analysis of gene expression levels: statistical quantification of relative mRNA level across multiple treatments or samples. Genome Biology 2002, 3: research0071.1–71.16. 10.1186/gb-2002-3-12-research0071View ArticleGoogle Scholar
- Efron B, Tibshirani R, Storey JD, Tusher VG: Empirical Bayes Analysis of a Microarray Experiment. Journal of the American Statistical Association 2001, 96: 1151–1160. 10.1198/016214501753382129View ArticleGoogle Scholar
- Newton MA, Kendziorski CM, Richmond CS, Blattner FR, Tsui KW: On Differential Variability of Expression Ratios: Improving Statistical Inference About Gene Expression Changes From Microarray Data. Journal of Computational Biology 2001, 8: 37–52. 10.1089/106652701300099074View ArticlePubMedGoogle Scholar
- Ibrahim JG, Chen M-H, Gray RJ: Bayesian Models for Gene Expression With DNA Microarray Data. Journal of the American Statistical Association 2002, 97: 88–99. 10.1198/016214502753479257View ArticleGoogle Scholar
- Broët P, Richardson S, Radvanyi F: Bayesian hierarchical model for identifying changes in gene expression from microarray experiments. Journal of Computational Biology 2002, 9: 671–683. 10.1089/106652702760277381View ArticlePubMedGoogle Scholar
- Gottardo R, Pannucci JA, Kuske CR, Brettin T: Statistical analysis of microarray data: a Bayesian approach. Biostatistics 2003, 4: 597–620. 10.1093/biostatistics/4.4.597View ArticlePubMedGoogle Scholar
- Lönnstedt I, Speed TP: Replicated microarray data. Statistica Sinica 2002, 12: 31–46.Google Scholar
- Pan W: A comparative review of statistical methods for discovering differentially expressed genes in replicated microarray experiments. Bioinformatics 2002, 18: 546–554. 10.1093/bioinformatics/18.4.546View ArticlePubMedGoogle Scholar
- Kendziorski CM, Newton MA, Lan H, Gould MN: On parametric empirical Bayes methods for comparing multiple groups using replicated gene expression profiles. Statistics in Medicine 2003, 22: 3899–3914. 10.1002/sim.1548View ArticlePubMedGoogle Scholar
- Newton MA, Noueiry A, Sarkar D, Ahlquist P: Detecting differential gene expression with a semiparametric hierarchical mixture method. Biostatistics 2004, 5: 155–176. 10.1093/biostatistics/5.2.155View ArticlePubMedGoogle Scholar
- Do KA, Müller P, Tang F: Bayesian mixture model for differential gene expression. Journal of the Royal Statistical Society C 2005, 54: 627–644. 10.1111/j.1467-9876.2005.05593.xView ArticleGoogle Scholar
- Ishwaran H, Rao JS: Detecting Differentially Expressed Genes in Microarrays Using Bayesian Model Selection. Journal of the American Statistical Association 2003, 98: 438–455. 10.1198/016214503000224View ArticleGoogle Scholar
- Ishwaran H, Rao JS: Spike and Slab Gene Selection for Multipgroup Microarray Data. Journal of the American Statistical Association 2005, 100: 764–780. 10.1198/016214505000000051View ArticleGoogle Scholar
- Yang D, Zakharkin SO, Page GP, Brand JP, Edwards JW, Bartolucci AA, Allison DB: Applications of Bayesian statistical methods in microarray data analysis. Am J Pharmacogenomics 2004, 4: 53–62. 10.2165/00129785-200404010-00006View ArticlePubMedGoogle Scholar
- Rhodes DR, Barrette TR, Rubin MA, Ghosh D, Chinnaiyan AM: Meta- analysis of microarrays: inter-study validation of gene expression profiles reveals pathway dysregulation in prostate cancer. Cancer Research 2002, 62: 4427–4433.PubMedGoogle Scholar
- Choi JK, Yu U, Kim S, Yoo OJ: Combining multiple microarray studies and modeling inter-study variation. Bioinformatics 2003, (Suppl 19):i84-i90. 10.1093/bioinformatics/btg1010Google Scholar
- Ghosh D, Barette TR, Rhodes D, Chinnaiyan AM: Statistical issues and methods for meta-analysis of microarray data: a case study in prostate cancer. Functional & Integrative Genomics 2003, 3: 180–188. 10.1007/s10142-003-0087-5View ArticleGoogle Scholar
- Parmigiani G, Garrett-Mayer ES, Anbazhagan R, Gabrielson E: A cross-study comparison of gene expression studies for the molecular classification of lung cancer. Clinical Cancer Research 2004, 10: 2922–2927. 10.1158/1078-0432.CCR-03-0490View ArticlePubMedGoogle Scholar
- Jiang H, Deng Y, Chen H, Tao L, Sha Q, Chen J, Tsai C, Zhang S: Joint analysis of two microarray gene-expression data sets to select lung adenocarcinoma marker genes. BMC Bioinformatics 2004, 5: 81. 10.1186/1471-2105-5-81PubMed CentralView ArticlePubMedGoogle Scholar
- Rhodes DR, Yu J, Shanker K, Deshpande N, Varambally R, Ghosh D, Barrette T, Pandey A, Chinnaiyan AM: Large-scale meta-analysis of cancer microarray data identifies common transcriptional profiles of neoplastic transformation and progression. Proc Natl Acad Sci USA 2004, 101: 9309–9314. 10.1073/pnas.0401994101PubMed CentralView ArticlePubMedGoogle Scholar
- Hu P, Greenwood CMT, Beyene J: Integrative analysis of multiple gene expression profiles with quality-adjusted effect size models. BMC Bioinformatics 2005, 6: 128. 10.1186/1471-2105-6-128PubMed CentralView ArticlePubMedGoogle Scholar
- Hedges LV, Olkin I: Statistical Methods for Meta-Analysis. San Diego, CA, Academic Press; 1985.Google Scholar
- Stevens JR, Doerge RW: Combining Affymetrix microarray results. BMC Bioinformatics 2005, 6: 57. 10.1186/1471-2105-6-57PubMed CentralView ArticlePubMedGoogle Scholar
- Kuo WP, Jenssen TK, Butte AJ, Ohno-Machado L, Kohane IS: Analysis of matched mRNA measurements from two different microarray technologies. Bioinformatics 2002, 18: 405–412. 10.1093/bioinformatics/18.3.405View ArticlePubMedGoogle Scholar
- Jarvinen AK, Hautaniemi S, Edgren H, Auvinen P, Saarela J, Kallioniemi OP, Monni O: Are data from different gene expression microarray platforms comparable? Genomics 2004, 83: 1164–1168. 10.1016/j.ygeno.2004.01.004View ArticlePubMedGoogle Scholar
- Hardiman G: Microarray platforms – comparisons and contrasts. Pharmacogenomics 2004, 5: 487–502. 10.1517/14622422.214.171.1247View ArticlePubMedGoogle Scholar
- DuMouchel WH, Harris JE: Bayes methods for combining the results of cancer studies in humans and other species. Journal of the American Statistical Association 1983, 78: 293–315. 10.2307/2288631View ArticleGoogle Scholar
- Lockhart DJ, Winzeler EA: Genomics, gene expression and DNA arrays. Nature 2000, 405: 827–836. 10.1038/35015701View ArticlePubMedGoogle Scholar
- Wu TD: Analyzing gene expression data from DNA microarrays to identify candidate genes. Journal of Pathology 2001, 195: 53–65. 10.1002/1096-9896(200109)195:1<53::AID-PATH891>3.0.CO;2-HView ArticlePubMedGoogle Scholar
- Hardiman G: Microarray technologies – an overview. Pharmacogenomics 2002, 3: 293–297. 10.1517/146224126.96.36.1993View ArticlePubMedGoogle Scholar
- Southern EM: DNA microarrays. History and overview. Methods Mol Biol 2000, 170: 1–15.Google Scholar
- Dudoit S, Yang YH, Callow MJ, Speed TP: Statistical methods for identifying differentially expressed genes in replicated cDNA microarray experiments. Statistica Sinica 2002, 12: 111–139.Google Scholar
- Eichenberger P, Jensen ST, Conlon EM, van Ooij C, Silvaggi J, Gonzalez-Pastor JE, Fujita M, Ben-Yehuda S, Stragier P, Liu JS, Losick R: The sigmaE regulon and the identification of additional sporulation genes in Bacillus subtilis . Journal of Molecular Biology 2003, 327: 945–972. 10.1016/S0022-2836(03)00205-5View ArticlePubMedGoogle Scholar
- Liu JS: Monte Carlo Strategies in Scientific Computing. New York, Springer-Verlag; 2001.Google Scholar
- Benjamini Y, Hochberg Y: Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society B 1995, 85: 289–300.Google Scholar
- Tusher VG, Tibshirani R, Chu G: Significance Analysis of Microarrays Applied to the Ionizing Radiation Response. Proceedings of the National Academy of Sciences USA 2001, 98: 5116–5121. 10.1073/pnas.091062498View ArticleGoogle Scholar
- Storey JD: A Direct Approach to False Discovery Rates. Journal of the Royal Statistical Society B 2002, 64: 479–498. 10.1111/1467-9868.00346View ArticleGoogle Scholar
- Storey JS, Tibshirani R: SAM Thresholding and False Discovery Rates for Detecting Differential Gene Expression in DNA Microarrays. In The Analysis of Gene Expression Data: Methods and Software. Edited by: Parmigiani G, Garrett ES, Irizarry RA, Zeger SL. Springer, NY; 2003.Google Scholar
- Genovese C, Wasserman L: Operating characteristics and extensions of the false discovery rate procedure. Journal of the Royal Statistical Society B 2002, 64: 499–518. 10.1111/1467-9868.00347View ArticleGoogle Scholar
- Conlon EM, Eichenberger P, Liu JS: Determining and analyzing differentially expressed genes from cDNA microarray experiments with complementary designs. Journal of Multivariate Analysis 2004, 90: 1–18. 10.1016/j.jmva.2004.02.007View ArticleGoogle Scholar
- Schadt EE, Li C, Ellis B, Wong WH: Feature extraction and normalization algorithms for high-density oligonucleotide gene expression array data. J CellBiochem Suppl 2001, 37: 120–125.View ArticleGoogle Scholar
- The BUGS Project[http://www.mrc-bsu.cam.ac.uk/bugs]
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.