Microarray platform consistency is revealed by biologically functional analysis of gene expression profiles
BMC Bioinformatics volume 10, Article number: S12 (2009)
Several different microarray platforms are available for measuring gene expression. There are disagreements within the microarray scientific community for intra- and inter-platform consistency of these platforms. Both high and low consistencies were demonstrated across different platforms in terms of genes with significantly differential expression. Array studies for gene expression are used to explore biological causes and effects. Therefore, consistency should eventually be evaluated in a biological setting to reveal the functional differences between the examined samples, not just a list of differentially expressed genes (DEG). In this study, we investigated whether different platforms had a high consistency from the biologically functional perspective.
DEG data without filtering the different probes in microarrays from different platforms generated from kidney samples of rats treated with the kidney carcinogen, aristolochic acid, in five test sites using microarrays from Affymetrix, Applied Biosystems, Agilent, and GE health platforms (two sites using Affymetrix for intra-platform comparison) were input into the Ingenuity Pathway Analysis (IPA) system for functional analysis. The functions of the DEG lists determined by IPA were compared across the four different platforms and two test sites for Affymetrix platform. Analysis results showed that there is a very high level of consistency between the two test sites using the same platform or among different platforms. The top functions determined by the different platforms were very similar and reflected carcinogenicity and toxicity of aristolochic acid in the rat kidney.
Our results demonstrate that highly consistent biological information can be generated from different microarray platforms.
Microarray technology has become one of the most important approaches to globally reveal gene expression changes to identify genes associated with biological processes of interests. At present, several different microarray platforms are commercially available. The different platforms often have diverse types and various numbers of gene probes. Even for the probes corresponding to the same genes, there are usually various levels of binding affinity and specificity in different platforms. Therefore, questions are raised on whether the different microarray platforms can generate similar gene expression results [1–4]. To answer the questions, the MicroArray Quality Control (MAQC) project compared gene expression data generated from different microarray platforms for a set of common samples and found certain consistencies among the different platforms for the differentially expressed genes (DEG) [5, 6].
Microarray methods are commonly used for examining thousands of genes simultaneously to reveal biological functional differences between examined samples. Therefore, biological functions should be considered as the ultimate endpoints for comparison of consistency across different microarray platforms. If different microarray platforms result in different DEGs but the same biological functions, we should acknowledge that these platforms are indeed comparable and reproducible because they tell us the same results. Although DEGs can be diverse when the experiments are performed at various times, in different laboratories or using dissimilar platforms, if most of the DEGs are true discoveries and enough of them are filled into distinct biological functional pathways, the altered biological functions can be identified. Therefore, it is logically hypothesized that high cross-platform concordance can be reached at biological function level.
In this study, we used the MAQC project data generated from kidney samples of rats treated with aristolochic acid (AA) . AA is an active component of herbal drugs, but it is a nephrotoxin and carcinogen. A high prevalence of urothelial carcinoma was found in patients that developed nephropathy due to AA exposure [7–9]. Animal models also demonstrated that AA treatment resulted in renal failure in rodents , and tumors in the kidney, forestomach, and other tissues of rats and mice [11–13]. AA was identified among the most potent 2% of the carcinogens . The International Agency for Research on Cancer (IARC) has classified products containing AA as human carcinogens . Our previous studies have demonstrated that AA exposure produced DNA adducts and mutations in rat kidney [16, 17] and induced carcinogenesis revealed by gene expression analysis of the same kidney samples . If different microarray platforms are comparable for biologically functional analysis, we would expect these toxicological processes or functions to appear on the top functions altered in the AA treatment in each testing platform.
Significant gene lists and common DEGs in different platforms
Unlike the MAQC study  in which the common genes across all platforms were used as a starting point for platform comparison, we used all genes in each platform microarray to independently select DEGs. Genes with q < 0.01 were considered as significantly changed. AA treatment of rats resulted in a number of DEGs in rat kidney, a carcinogenic target tissue of the carcinogen. The 1303 DEGs from Affymetrix test site 1 (AFX_1), 928 in Affymetrix test site 2 (AFX_2), 559 in Applied Biosystems site (ABI), 611 in Agilent (AG1), and 2346 in GE Health (GEH) were selected from 13713, 13713, 16280, 16135 and 12576 unique genes in each platform, respectively (See additional file 1: DEGs). Figure 1 is a heat map to compare the common DEGs from the different test sites. There are 130 DEGs common to all the five test sites, 252 DEGs common to four sites, 343 DEGs common to three sites, 545 DEGs common to two sites and 1970 present in only one site. The percentage of common DEGs in any two platforms is shown in Table 1. The percentages of common DEGs are low, ranging from 9% to 34%, except for the percentage between AFX_1 and AFX_2. The low percentages of common DEGs among the different platforms mainly resulted from the different gene probes in different platforms. There are only 5824 genes common to all the 4 platforms.
Intra-platform comparison of biological processes
To compare the consistency of intra-platform microarray studies, two sets of data generated from two test sites for Affymetrix (AFX_1 and AFX_2) were used. The two DEG lists were imported to Ingenuity Pathway Analysis system (IPA) to identify the functions that were altered by AA treatment. The altered function processes are listed in Additional file 2. The two sets of function processes corresponding to the two DEG lists were compared and the percentages of common functions at a given number of functions are displayed in Figure 2. These two function lists exhibit high levels of overlap, whereas the control function lists from randomly chosen genes show much lower percentages of overlapping functions. The percentage of overlapping functions for the first 5 ranks are over 80%, and remains stable at about 70%. The control function lists, however, show very low concordance. There are no common functions between the control function lists for the top 10 functions, and the percentage of overlapping functions increases slightly when more functions are considered. Table 2 is a snapshot of the overlapping at the top 30 functions from Figures 2 and 3. The percentage of common functions between AFX_1 and AFX_2 is the highest (77%) among the comparisons, indicating that the intra-platform reproducibility for gene expression is better than inter-platform reproducibility in terms of biological functions.
Inter-platform comparison of biological processes
Functional processes from the four platforms, ABI, AG1, GEH and AFX (AFX_1 was used for inter-platform comparison) were analyzed and compared. The percentages of overlapping AA-altered functions between any pair of two platforms vs. certain number of top functions are graphed and displayed in Figure 3. The patterns for the changes of common function ratio with number of top function are very similar in the six comparisons between the different platform microarrays. The highest concordance between platforms appear around top 10 functions, indicating that the major functional changes induced by AA treatment in rat kidney were commonly discovered by microarray analysis of gene expression from different platforms. The percentages of common functions at around top 50 of functions reach to the lowest and then slowly increase with function numbers in all of the comparisons. The percentages of common functions between the different platforms are from 47 to 70% while those between the control function lists are very low, from 0 to 10% (Table 2).
A comparison across all of the 4 platforms also shows high concordance for the top 20 functions (45%, Figure 4), considering that only 4% DEGs (130 DGEs common to all four sites/3240 total DGEs that were used for the analysis) are common in the gene lists from the different platforms (Figure 1). In contrast, the percentage of common functions among the 4 platforms in the randomly selected controls is close to 0 when up to 80 of top functions are selected (Figure 4).
Major biological processes changed by AA exposure in rat kidney
To examine whether each platform/site could reveal similar ongoing biological processes in rat kidneys exposed to AA, we compared the top 10 functions identified by IPA from the different platforms (Table 3). Since the major functions changed by a treatment normally appear to be the most significant, the top functions should reflect AA's carcinogenic characters in rat kidney. As expected, the major functions from all 5 platform/sites were carcinogenesis-related, such as cancer, tumor, neoplasm and tumorigenesis. Other functions like inflammatory disorder might reveal other toxicities of AA in rat kidney. When the top 20 functions were examined, carcinogenesis-related functions still remained as the main subject across all of the platforms (data not shown). In contrast, the top 10 functions derived from the control gene lists were diverse and inconsistent across the platforms/sites, and primarily were not cancer-related (Table 4).
The main purpose of gene expression studies using microarrays is to reveal the underlying biological differences between the two groups of samples. For example, examination of the lists of DEGs between controls and chemical-treated samples could reveal whether the chemical is toxic or not. DEG lists may change depending on the experiment, laboratory and platforms due to experimental variability, sample size, dissimilar probes in microarrays, different binding sites of probes for genes, and diverse methods for data normalization and selection. Therefore, DEG lists generated from identical RNA preparations could be considerably divergent if the microarray experiments are performed in different sites or with dissimilar microarray platforms [1, 3]. The different DEG lists from various sites/platforms, however, still can be considered comparable if they reveal the same biological truth between the two groups of samples. It should also be pointed out that the higher percentage of overlapping functions compared to overlapping genes may be attributed to the fact that each function contains many genes.
In our analysis, the DEG lists identified from the platforms are very different because we did not use the common set of genes in the platforms for their selection. Only about 4% DEGs are common in all of the lists (Figure 1) and 9–34% DEGs are common between any two of the platforms (Table 1). In contrast, IPA analysis of these different lists resulted in high concordances of biological functions within one platform, between any two platforms and among all the platforms, especially for the top functions. The reproducibility of AA-altered functions for intra-platform is very high. This result is not unexpected because the microarrays tested in the different sites have the same gene probes and chemistries and the DEG lists from the two test sites are also similar. Although the percentages of common functions among the different platforms are a little bit lower than that for intra-platform, the concordances are still pretty high.
It is not unexpected to find the high concordance among the different platforms in terms of biological functions. Although false positive genes generally exist in a DEG list, most genes identified by microarrays are true DEGs when a high threshold method is used for the selection. When a biological process or function is changed, it normally results from the common effects of many genes. Therefore, even when dissimilar DEGs are present in platform analyses, they may be still involved in the same functions. Tan et al. compared the results from three commercial platforms and found that only 4 of the 185 unique genes were universal whereas the common top function, cell cycle, was identified by analysis of the top 200 genes from the different platforms . This function reflects the differences in their samples, PANC-1 cells grown in serum-rich and serum-free media.
In this study, the rats were treated with AA using a similar protocol shown to result in the development of tumors in the rat kidney . Six-week-old rats were treated with 10 mg AA/kg body weight five times a week for 12 weeks. The animals were sacrificed one day after the last treatment so that the gene expression could reflect the carcinogenicity and toxicity induced by AA in rat kidney. Although adenomas and adenocarcinomas in the renal cortex and papillomas in the renal pelvis were observed three months after the AA treatment in the carcinogenic study, atypical cells with gigantic nuclei and enlarged basophilic nucleoli in the tubular epiththelium of the renal cortex and multifocal dedifferentiation of the renal tubular epithelium and hyperplasia of the transitional epithelium in the renal pelvis were found immediately after the 3 month's treatment with 10 mg/kg AA. Therefore, the true biological differences between AA-treated and control samples are known. If a microarray analysis of these samples is reliable, it should reflect the pathogenesis exerted by AA treatment. The biological functions identified by the different sites or platforms reflect the biological effects of AA treatment (Table 3). The carcinogenesis-related functions appear in the top list in every laboratory site or platforms. This concordance suggests that data generated on different microarray platforms are comparable in terms of biological responses.
In this study, we analyzed and compared microarray data generated by the MAQC project on AA-treated and control rat kidney samples from a biological function viewpoint. Our data demonstrated that there are high concordances of biological functions in intra- and inter-platform comparisons. Also, importantly, data from all the platforms or sites revealed the ongoing biological processes, carcinogenesis, in the kidneys of rats exposed to AA, a known carcinogen. These results suggest that highly consistent biological functions can be revealed when data from different microarray platforms are analyzed separately without restricting the analysis on a common set of genes found on all the platforms.
The microarray expression raw data were generated previously by the MAQC project to evaluate the consistency among different microarray platforms . The total RNAs for microarray analysis were isolated from 12 kidney samples of Big Blue® Transgenic Fisher 344 rats. Six of these rats were treated with 10 mg AA/kg body weight by gavage five times a week for 12 weeks while the other 6 rats were treated with the vehicle (0.9% sodium chloride). The treatment used induced DNA adducts, mutations and tumors in the kidneys of the AA-treated rats [12, 16, 17].
The microarray experiments were conducted at 5 test sites, including 2 sites using the AFX platform (Rat Genome 230 2.0). The other 3 sites used ABI (Rat Genome Survey Microarray), AG1 (Whole Rat Genome Oligo Microarray, G4131A) or GEH (Rat Whole Genome Bioarray, 300031) platforms. The total RNAs were isolated in our laboratory and distributed to each test site. Totally, 60 microarrays were used for AA-treated and control kidney samples at the 5 sites. Detailed information about animal treatment and microarray experiments can be found in an earlier publication .
Selection of differentially expressed and randomly selected genes for functional analysis
The microarrays from the 4 platforms contain different numbers of probes for gene expression analysis. Specifically, 31099, 26857, 41071 and 35129 probes (or probe-set for AFX) are present in AFX, ABI, AG1 and GEH microarrays, respectively. According to Entrez gene ID, these probes correspond to 13713, 16280, 16135 and 12576 genes in AFX, ABI, AG1 and GEH microarrays, respectively. There are 5824 genes that are common across all 4 platforms. In contrast to the MAQC study that used the common genes for cross-platform comparison, we used the whole gene set of each platform to select DEGs. The data analysis was conducted using ArrayTrack software (http://www.fda.gov/nctr/science/centers/toxicoinformatics/ArrayTrack/index.htm). The gene expression data were normalized by using quantile method. Significance Analysis of Microarrays (SAM) was used to calculate q values. Two class unpaired analysis with 500 permutations was performed. DEGs were selected based on q < 0.01.
Mock gene lists were created by randomly selecting genes for each platform or site to serve as negative controls for cross-platform comparison. To generate the control gene lists, every probe of a platform was assigned an integer number as ID. The probes were randomly chosen by ID. The number of genes randomly chosen from a platform/site is the same as the number in the DEG list.
Functional analysis was performed using IPA online software. The genes in the DEG lists and the control gene lists were uploaded into IPA. The biological meanings for each gene list were interpreted using Core analysis, selecting rat for the species and the Relaxed (only molecules are filtered) for the filter. Both up- and down-regulated genes were analyzed. Databases corresponding to each individual platforms for AFX, ABI and AG1 and Ingenuity Knowledge Base (Gene only) for GEH were used for the analysis. A total of 1303, 928, 559, 611, and 2346 genes were uploaded and 1297, 924, 558, 610 and 2325 genes were eligible for function/pathway analysis for AFX_1, AFX_2, ABI, AG1 and GEH platforms/sites, respectively. In IPA, the functional relevance of a gene list was evaluated at 3 levels, category, function and function annotation. Each category includes multiple functions and each function usually includes multiple function annotations. A p value was calculated for each category/function/function annotation by IPA to show the enrichment of the input gene list in this category/function/function annotation. The p values are calculated using the right-tailed Fisher Exact Test by considering the number of analyzing genes that participating in that function and the total number of molecules that are known to be associated with that function in Ingenuity Knowledge Base . Smaller p values indicate a higher level of enrichment in the input gene list of genes involved in the corresponding category/function/function annotation. The categories/functions/function annotations with p value < 0.05 were considered as significantly relevant with the analyzing genes and the top function annotations up to 500 were generated by the IPA. The functions related to these function annotations were selected for our analysis.
The proportion of common functions identified by microarray analysis from the different platforms/sites
With IPA analysis, we generated 5 significant and 5 control category/function/function annotation lists. We focused on the function level for our analysis since similar results were found for analysis with function annotations. Because category is a sketchy level that has only a few of them for analysis, functions in this level have been eliminated from our analysis. Each function list was sorted according to p values. The repetitive functions in a function list were merged and their p values were averaged. The percentage of common functions between two or across all of the platforms/sites was calculated within a set of functions at a specific rank. For example, to calculate a percentage of common functions between platforms A and B at rank 50, the top 50 functions in both platforms were used for comparison and the number of the common functions divided by 50 would give the results. The same method was used to calculate the percentage of common functions across all of the platforms.
Marshall E: Getting the noise out of gene arrays. Science 2004, 306(5696):630–631. 10.1126/science.306.5696.630
Frantz S: An array of problems. Nat Rev Drug Discov 2005, 4(5):362–363. 10.1038/nrd1746
Tan PK, Downey TJ, Spitznagel EL Jr, Xu P, Fu D, Dimitrov DS, Lempicki RA, Raaka BM, Cam MC: Evaluation of gene expression measurements from commercial microarray platforms. Nucleic Acids Res 2003, 31(19):5676–5684. 10.1093/nar/gkg763
Yauk CL, Berndt ML, Williams A, Douglas GR: Comprehensive comparison of six microarray technologies. Nucleic Acids Res 2004, 32(15):e124. 10.1093/nar/gnh123
Guo L, Lobenhofer EK, Wang C, Shippy R, Harris SC, Zhang L, Mei N, Chen T, Herman D, Goodsaid FM, et al.: Rat toxicogenomic study reveals analytical consistency across microarray platforms. Nat Biotechnol 2006, 24(9):1162–1169. 10.1038/nbt1238
Shi L, Reid LH, Jones WD, Shippy R, Warrington JA, Baker SC, Collins PJ, de Longueville F, Kawasaki ES, Lee KY, et al.: The MicroArray Quality Control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements. Nat Biotechnol 2006, 24(9):1151–1161. 10.1038/nbt1239
Cosyns JP, Jadoul M, Squifflet JP, De Plaen JF, Ferluga D, van Ypersele de Strihou C: Chinese herbs nephropathy: a clue to Balkan endemic nephropathy? Kidney Int 1994, 45(6):1680–1688. 10.1038/ki.1994.220
Nortier JL, Martinez MC, Schmeiser HH, Arlt VM, Bieler CA, Petein M, Depierreux MF, De Pauw L, Abramowicz D, Vereerstraeten P, et al.: Urothelial carcinoma associated with the use of a Chinese herb (Aristolochia fangchi). N Engl J Med 2000, 342(23):1686–1692. 10.1056/NEJM200006083422301
Vanherweghem JL, Tielemans C, Simon J, Depierreux M: Chinese herbs nephropathy and renal pelvic carcinoma. Nephrol Dial Transplant 1995, 10(2):270–273.
Mengs U: Acute toxicity of aristolochic acid in rodents. Arch Toxicol 1987, 59(5):328–331. 10.1007/BF00295084
Mengs U: Tumour induction in mice following exposure to aristolochic acid. Arch Toxicol 1988, 61(6):504–505. 10.1007/BF00293699
Mengs U, Lang W, Poch I: The carcinogenic action of aristolochic acid in rats. Arch Toxicol 1982, 51: 107–119. 10.1007/BF00302751
Mengs U: On the histopathogenesis of rat forestomach carcinoma caused by aristolochic acid. Arch Toxicol 1983, 52(3):209–220. 10.1007/BF00333900
Gold L, Zeiger E, (eds): Handbook of carcinogenic potency and genotoxicity databases.Boca Raton, Fla. CRC Press; 1997. [http://potency.berkeley.edu/]
IARC: Some traditional herbal medicines, some mycotoxins, naphthalene and styrene. In IARC monographs on the evaluation of carcinogenic risk of chemicals to humans. Volume 82. Lyons, France: IARC Press; 2002.
Chen L, Mei N, Yao L, Chen T: Mutations induced by carcinogenic doses of aristolochic acid in kidney of Big Blue transgenic rats. Toxicol Lett 2006, 165(3):250–256. 10.1016/j.toxlet.2006.04.008
Mei N, Arlt VM, Phillips DH, Heflich RH, Chen T: DNA adduct formation and mutation induction by aristolochic acid in rat kidney and liver. Mutat Res 2006, 602(1–2):83–91.
Chen T, Guo L, Zhang L, Shi L, Fang H, Sun Y, Fuscoe JC, Mei N: Gene Expression Profiles Distinguish the Carcinogenic Effects of Aristolochic Acid in Target (Kidney) and Non-target (Liver) Tissues in Rats. BMC Bioinformatics 2006, 7(Suppl 2):S20. 10.1186/1471-2105-7-S2-S20
IPA: Calculating and Interpreting the P-values for Functions, Pathways, and Lists in Ingenuity Pathways Analysis.Ingenuity Systems, Redwood City, CA, 94063; 2009. [http://www.ingenuity.com]
The views presented in this article do not necessarily reflect those of the Food and Drug Administration. We would like to thank Drs. Huixiao Hong and Li-Wu Guo for their valuable discussion and review of this manuscript.
This article has been published as part of BMC Bioinformatics Volume 10 Supplement 11, 2009: Proceedings of the Sixth Annual MCBIOS Conference. Transformational Bioinformatics: Delivering Value from Genomes. The full contents of the supplement are available online at http://www.biomedcentral.com/1471-2105/10?issue=S11.
The authors declare that they have no competing interests.
ZL performed the data analysis and wrote the manuscript. LS participated in the critical discussion on the data analysis and manuscript preparation. ZS and ZW wrote computer programs needed for the data analysis. TC originally designed the study and was involved in the data analysis and writing the manuscript. All authors have read and approved the final manuscript.
About this article
Cite this article
Li, Z., Su, Z., Wen, Z. et al. Microarray platform consistency is revealed by biologically functional analysis of gene expression profiles. BMC Bioinformatics 10 (Suppl 11), S12 (2009). https://doi.org/10.1186/1471-2105-10-S11-S12