 Methodology article
 Open Access
Statistical monitoring of weak spots for improvement of normalization and ratio estimates in microarrays
 Igor Dozmorov^{1}Email author,
 Nicholas Knowlton^{1},
 Yuhong Tang^{1} and
 Michael Centola^{1}
https://doi.org/10.1186/14712105553
© Dozmorov et al; licensee BioMed Central Ltd. 2004
 Received: 13 December 2003
 Accepted: 05 May 2004
 Published: 05 May 2004
Abstract
Background
Several aspects of microarray data analysis are dependent on identification of genes expressed at or near the limits of detection. For example, regressionbased normalization methods rely on the premise that most genes in compared samples are expressed at similar levels and therefore require accurate identification of nonexpressed genes (additive noise) so that they can be excluded from the normalization procedure. Moreover, key regulatory genes can maintain stringent control of a given response at low expression levels. If arbitrary cutoffs are used for distinguishing expressed from nonexpressed genes, some of these key regulatory genes may be unnecessarily excluded from the analysis. Unfortunately, no accurate method for differentiating additive noise from genes expressed at low levels is currently available.
Results
We developed a multistep procedure for analysis of mRNA expression data that robustly identifies the additive noise in a microarray experiment. This analysis is predicated on the fact that additive noise signals can be accurately identified by both distribution and statistical analysis.
Conclusions
Identification of additive noise in this manner allows exclusion of noncorrelated weak signals from regressionbased normalization of compared profiles thus maximizing the accuracy of these methods. Moreover, genes expressed at very low levels can be clearly identified due to the fact that their expression distribution is stable and distinguishable from the random pattern of additive noise.
Keywords
 Additive Noise
 Human Peripheral Blood Mononuclear Cell
 Weak Spot
 Duplicate Spot
 Local Background Subtraction
Background
Microarrays are powerful and costeffective tools for largescale analysis of gene expression. While the utility of this technology has been established [1, 2], analytical methods are evolving and a matter of contention. Key among the more controversial aspects is the treatment of data from weak spots, which significantly influences outcomes. For example, ratio analysis is commonly employed to determine expression differences between two samples. However any procedure that uses raw intensities to infer relative expression is limited due to the fact that accuracy is signal level dependent, with variation increasing dramatically for low intensity signals [1, 3]. Several methods have been developed to diminish the influence of additive noise. One solution is to ignore any genes whose transcripts are present at a low total abundance, to exclude weak spots – arbitrarily (in Kooperberg etal., [3] an intensity cutoff was used such that the relative error in ratios was less than 25%) or with some statistical procedures [4, 5]. Other methods proposed for discriminating expressed genes from those not expressed, such as the method of Greller and Tobin [6], are suitable only for bimodal distributions in which the distribution of intensities for these two subsets are nonoverlapping, unlike many empirical data sets. However even procedures for flagging and exclusion of weak spots based on solid statistical background [4] remains problematic as these methods discard potentially valuable data. This issue is compounded by the fact that in biological systems several key regulators may be expressed at low levels presumably so that modulation of these regulators can be tightly controlled [7].
The two main sources of heterogeneity in gene expression variations are indicated in Rocke and Durbin [7] as, the "additive component", prominent at low expression levels, and the "multiplicative component", prominent at high expression levels. The intensity measurement y_{i, j}for gene i ∈ I = {i_{1}, ..., i_{ n }} in sample j ∈ J = {j_{1}, ..., j_{ m }} is modeled by the equation: y_{i, j}= α_{i, j}+ μ_{i, j}× e^{η} + ε_{ι, j}, where α – is the normal background (and independent of expression level), μ – the expression level in arbitrary units, ε – is first within spot error term (additive), and η – is the second error term, which represents the proportional error (multiplicative) [8, 9]. Gene expression data obtained with standard procedure of the local background subtraction will include noisy spots – spots at which expression level is ignorably low and whose intensity ε_{ι, j}presents additive noise.
We have previously demonstrated the presence of normally distributed noise spots in radioactive labeled Clontech macroarrays and proposed an iterative algorithm for obtaining the parameters of this distribution [2, 10]. Herein we have extended the utility of this approach by demonstrating the noncorrelative nature of these spots in both internal and external comparisons. We also present new algorithm modifications for locating the additive noise in gene expression histograms and for estimation of its distribution parameters. Quantization of additive noise variation can therefore be used as a statistically robust criterion to identify measurable but lowlevel gene expression. It becomes possible to select even genes that are stably expressed at the additive noise level that can be discriminated from additive noise due to their stability.
Results
High quality membrane arrays
Atlas arrays (Clontech) are a good example of high quality membranebased arrays exemplifying high specificity and low levels of additive noise. Additive noise spots consist of up to 50% of all spots on the array. The nearly normal distribution of this noise can be seen in a histogram of all intensity values (Fig. 1A). Parameters of this distribution were estimated by excluding expressed genes one by one as their values exceeded the mean +/ 2 SD of the core of nondiscarded values. This process was repeated in an iterative manner until no additional spots were excluded and the resulting nondiscarded points (typically between 500 and 600 of the initial set of 1176) represent the set of nonexpressed genes. After these exclusions, parameters of additive noise are estimated by nonlinear fitting of a normal distribution function to the core of nonexcluded values.
The knowledge of the parameters of the additive noise distribution enables selection of expressed genes for the final profile adjustment. The threshold, 3 SDs above the mean of additive noise, is used for selecting genes expressed above additive noise from which the final adjustment is made. The necessity for this exclusion is illustrated in Fig. 1. Figure 1 data was collected experimentally from an early Clontech Atlas array with 600 genes spotted in duplicate and was subsequently normalized to additive noise as described in Materials and Methods. Duplicated spots give two sets of expressions for identical genes on the same membrane. Their ratios are expected to be distributed around 1 with small random variations. This was not true for expressions below some threshold that correlated with our determination of additive noise. These results support the idea about the necessity to exclude noncorrelated weak expressions from comparison. They also demonstrate the utility of excluding values expressed "3SD above mean" to eliminate noncorrelated noise from regression analysis and ratio calculations.
Moderate quality fluorescently labeled microarrays
For this case, a new histogram is created by substituting the right portion of the additive noise distribution with the mirror reflection of the left portion. Curve fitting is then applied to the new histogram, which is minimally altered by the presence of weak expressions (Solid line in Fig. 2A).
High quality fluorescently labeled microarrays
"Signal from noise" elicitation
With a clear delineation of additive noise parameters it is possible to identify genes expressed distinctly from additive noise using recognized statistical criteria. Genes expressed significantly higher than additive noise are easily identified by paired analysis. Genes with low level signals within additive noise can also be identified as distinctive from additive noise due to their higher stability (lower SD in replicated measurements). Discrimination of expressed vs. nonexpressed genes is not based on an arbitrary cutoff, but a StudentT test is performed to measure the probability that the gene expression belongs to the normally distributed additive noise.
As shown in a representative sample of results, some expressed genes have very low expression levels but high stability (lower SD and a resulting low p value). Conversely, some highly expressed genes are not statistically distinct from additive noise because their high variability (higher SD and a resulting high p value).
Spatial stability of the additive noise distribution
Discussion
Normalization of cDNA microarray data is an obligatory step during microarray experiments due to the relatively frequent nonspecific errors. Generally, normalization of microarray data is based on the null hypothesis and variance model. In the gene expression model [4, 8] at least two types of noises are included. One is additive noise and the other is multiplicative noise. Usually, background is considered as additive noise and the variation between the signal pixels is the representative of multiplicative noise. However, as we demonstrated previously [10, 11] and in this article, the additive noise is present even after subtraction of local background from signal (background correction) and is product of hybridization below technological specificity. This additive noise can be observed as isolated or partially overlapping normally distributed signals of low intensity spots. We would like to emphasize the difference between discussing additive noise from around spot local background intensities and additive noise that can vary at different locations within the individual chip [12]. The influence of these variations is removed by the local background correction procedure, subsequently; resulting in additive noise that is relative stable over different localizations on the slide (Fig. 4).
There are versatile distribution assumptions for the background and additive error term in the literature [13]. Rocke and Durbin [8] were the first to suggest using an iterative procedure, similar to what is presented here, for estimation of background parameters. The transformation introduced independently by several research groups has been called the Generalized Logarithm. More recently, Rocke and Durbin demonstrated [14] that there are some alternative logtransformations that produce approximate variance stabilizing transformations for microarray data that are nearly as good as the Generalized Logarithm. Several authors searched variancestabilizing transformations for geneexpression microarray data [15, 16]. It was demonstrated that for data obtained after background extraction these transformations converge to a logtransformation for relatively large expression levels. Our results go further and demonstrate that the apparent deviation of the additive noise distribution from normality is produced by the presence of the weak signals overlapping with the noise. These results enable the skewed distribution presented in Fig. 2 to be treated as a normally distributed additive noise distorted on its right side by the presence of low but distinctive (reproducible) gene expressions.
In this study, the influences of additive noise on the ratio estimates and normalization procedures were investigated. As was clearly demonstrated, it is necessary to exclude from comparisons the noncorrelated weak expressions with duplicated spots (two sets of expressions for each gene) on the Clontech Atlas membrane. The ratio variation was dramatically increased even for these identical expressions below some threshold corresponding to the previously described determination of additive noise [10]. This phenomenon represents a main obstacle for data normalization and ratio estimates in microarrays [1]. We presented various methods for localization of additive noise spots. The knowledge of these parameters enables the exclusion of noncorrelated noise from the biased adjustment of the compared profiles and also from ratio estimations – an additional and very helpful characteristic of comparative gene expression analysis.
In fact it is an ad hoc practice to eliminate weak spots on microarrays before subsequent data analyses [3–5]. We have demonstrated that additive noise can be used as an important inner standard for data normalization and for selection of weak signals statistically distinctive from nonspecific noise. In contrast to all previous attempts to exclude the influence of additive noise by cutting off low expressions, there are no meaningless low expressions in our method, only expressions statistically distinctive or not from additive noise: an important discrimination in light of the special importance of regulatory genes which are consistently expressed at low levels [7].
Methods
Microarray data
To demonstrate the applicability of the analysis presented herein data has been analyzed from several distinct array technologies. The first data set is from a previous publication in which liver tissue from Ames dwarf mice was screened using BD Atlas™ arrays (Clontech, CA) [10]. These macroarrays are nylon membranebased with 600 hundred mouse genes represented by cDNA clones spotted in duplicate. The second data set was obtained from human peripheral blood mononuclear cells from healthy donors screened on PerkinElmer Micromax cDNA arrays. These arrays are glass slidebased with 2,600 human genes represented as cDNA clones. The third set of data was obtained from human peripheral blood mononuclear cells from healthy donors screened on inhouse printed genomescale oligomicroarrays. These oligos are synthesized by Qiagen/Operon and printed on Corning UltraGAPS slides using a GeneMachines OmniGrid 100 microarray printer.
Outline of normalization and analysis procedures
Normalization for differences among experiments was conducted using the procedure described in detail elsewhere [10]. In brief, the procedure assumes that intensities corresponding to mRNA not expressed by the tissue will be normally distributed and computes the mean and SD of these nonexpressed genes using an iterative nonlinear curve fitting procedure.
The next step is normalization of each expression profile to its own additive noise, with selection of the genes expressed above additive noise for subsequent adjustment and comparison. For further analysis, data obtained after normalization of each profile to own additive noise are logtransformed with substitution of negative values by the minimal logarithmic value obtained within positive values.
Normalized profiles are adjusted to each other by means of a robust regression analysis of genes expressed above additive noise. All expression profiles of both control and experimental groups are rescaled to a common standard – the averaged profile of the control group. This analysis is based on the fact that majority of genes are presumably equally expressed in compared samples. In the scatter plot, genes with similar expression levels should be randomly distributed around a line of equity with a small portion of differentially expressed "outliers". Their contribution in the regression analysis is downweighted in an iterative manner. Our procedure for exclusion of outliers [10, 11] is based on the selection of equally expressed genes as a homogenous family of genes with normally distributed residuals (for logtransformed data with exclusion weak expressions) measured as deviations from the regression line calculated against the averaged profile. Outliers are thereafter determined as having deviations not associated with this normal distribution represented by several hundred members.
The next step is identifying a set of similarly expressed genes from the control samples, denoted "reference group", composed of genes expressed above additive noise with low variability of expression as determined by an Ftest, and whose residuals approximate a normal distribution, based on the KolmogorovSmirnov criterion.

Selection with a Student Ttest for replicates using the commonly accepted significance threshold of p < 0.05. It employs the commonly accepted sensitivity level used in biologic experiments, however a significant proportion of these genes identified as differentially expressed will be false positive determinations at this threshold level;

An associative Ttest in which the replicated residuals for each gene of the experimental group are compared with the entire set of residuals from the reference group defined above. Null hypotheses are checked to see if gene expressions in the experimental group presented as replicated residuals (deviations from averaged control group profile) are associated with the reference group. The significance threshold is corrected to make improbable the appearance of false positive determinations.

Genes expressed distinctively from additive noise were determined analytically by association of each replicated gene expression with a normal distribution of additive noise having average equal 0 and standard deviation equal 1. Genes expressed distinctively from additive noise in one group and not distinctive from additive noise in another are selected as another example of differential gene expression.
Declarations
Acknowledgements
This work was supported by grants NIH NCRR IDeA, and NIH 1 P20 RR1557 from the National Institutes of Health, and BRIN grant #P20RR16478.
Authors’ Affiliations
References
 Geiss GK, Bumgarner RE, An MC, Agy MB, van't Wout AB, Hammersmark E, Carter VS, Upchurch D, Mullins JI, Katze MG: Largescale monitoring of host cell gene expression during HIV1 infection using cDNA microarrays. Virology 2000, 266: 8–16. 10.1006/viro.1999.0044View ArticlePubMedGoogle Scholar
 Dozmorov I, Saban MR, Gerard NP, Lu B, Nguyen NB, Centola M, Saban R: Neurokinin 1 receptors and neprilysin modulation of mouse bladder generegulation. Physiol Genmics 2003, 12: 239–250.View ArticleGoogle Scholar
 Kooperberg C, Fazzio TG, Delrow JJ, Tsukiyama T: Improved background correction for spotted DNA microarrays. J Comput Biol 2002, 9: 55–66. 10.1089/10665270252833190View ArticlePubMedGoogle Scholar
 Yang MC, Ruan QG, Yang JJ, Eckenrode S, Wu S, McIndoe RA, She JX: A statistical method for flagging weak spots improves normalization and ratio estimates in microarrays. Physiol Genomics 2001, 7: 45–53.View ArticlePubMedGoogle Scholar
 Chen Y, Kamat V, Dougherty ER, Bittner ML, Meltzer PS, Trent JM: Ratio statistics of gene expression levels and applications to microarray data analysis. Bioinformatics 2002, 18: 1207–15. 10.1093/bioinformatics/18.9.1207View ArticlePubMedGoogle Scholar
 Greller LD, Tobin FL: Detecting selective expression of genes and proteins. Genome Res 1999, 9: 282–296.PubMed CentralPubMedGoogle Scholar
 Jin W, Riley RM, Wolfinger RD, White KP, PassadorGurgel G, Gibson G: The contributions of sex, genotype and age to transcriptional variance in Drosophila melanogaster. Nat Geneti 2001, 29: 389–395. 10.1038/ng766View ArticleGoogle Scholar
 Rocke DM, Durbin BA: A model for measurement error for gene expression arrays. J Comput Biol 2001, 8: 557–569. 10.1089/106652701753307485View ArticlePubMedGoogle Scholar
 Zien A, Aigner T, Zimmer R, Lengauer T: Centralization: a new method for the normalization of gene expression data. Bioinformatics 2001, 17(Suppl 1):S323–31.View ArticlePubMedGoogle Scholar
 Dozmorov IM, Centola M: An associative analysis of gene expression array data. Bioinformatics 2003, 19: 204–11. 10.1093/bioinformatics/19.2.204View ArticlePubMedGoogle Scholar
 Dozmorov I, Bartke A, Miller RA: Arraybased expression analysis of mouse liver genes: Effect of age and of the longevity mutant Prop1df. J Gerontol A Biol Sci Med Sci 2001, 56: B72B80.View ArticlePubMedGoogle Scholar
 Kim JH, Shin DM, Lee YS: Effect of local background intensities in the normalization of cDNA microarray data with a skewed expression profiles. Exp Mol Med 2002, 34: 224–32.View ArticlePubMedGoogle Scholar
 Strimmer K: Modeling gene expression measurement error: a quasilikelihood approach. BMC Bioinformatics 2003, 4: 10. 10.1186/14712105410PubMed CentralView ArticlePubMedGoogle Scholar
 Rocke DM, Durbin B: Approximate variancestabilizing transformations for geneexpression microarray data. Bioinformatics 2003, 19: 966–72. 10.1093/bioinformatics/btg107View ArticlePubMedGoogle Scholar
 Durbin BP, Hardin JS, Hawkins DM, Rocke DM: A variancestabilizing transformation for geneexpression microarray data. Bioinformatics 2002, 18(Suppl 1):S105–10.View ArticlePubMedGoogle Scholar
 Huber W, Von Heydebreck A, Sultmann H, Poustka A, Vingron M: Variance stabilization applied to microarray data calibration and to the quantification of differential expression. Bioinformatics 2002, 18(Suppl 1):S96–104.View ArticlePubMedGoogle Scholar
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article: verbatim copying and redistribution of this article are permitted in all media for any purpose, provided this notice is preserved along with the article's original URL.