Scanner calibration revisited
© Pozhitkov; licensee BioMed Central Ltd. 2010
Received: 29 May 2010
Accepted: 1 July 2010
Published: 1 July 2010
Calibration of a microarray scanner is critical for accurate interpretation of microarray results. Shi et al. (BMC Bioinformatics, 2005, 6, Art. No. S11 Suppl. 2.) reported usage of a Full Moon BioSystems slide for calibration. Inspired by the Shi et al. work, we have calibrated microarray scanners in our previous research. We were puzzled however, that most of the signal intensities from a biological sample fell below the sensitivity threshold level determined by the calibration slide. This conundrum led us to re-investigate the quality of calibration provided by the Full Moon BioSystems slide as well as the accuracy of the analysis performed by Shi et al.
Signal intensities were recorded on three different microarray scanners at various photomultiplier gain levels using the same calibration slide from Full Moon BioSystems. Data analysis was conducted on raw signal intensities without normalization or transformation of any kind. Weighted least-squares method was used to fit the data.
We found that initial analysis performed by Shi et al. did not take into account autofluorescence of the Full Moon BioSystems slide, which led to a grossly distorted microarray scanner response. Our analysis revealed that a power-law function, which is explicitly accounting for the slide autofluorescence, perfectly described a relationship between signal intensities and fluorophore quantities.
Microarray scanners respond in a much less distorted fashion than was reported by Shi et al. Full Moon BioSystems calibration slides are inadequate for performing calibration. We recommend against using these slides.
Shi et al.  published a paper in BMC Bioinformatics about the need to calibrate microarray scanners. Specifically, they reported a bias in microarray gene expression data if the scanner used to interpret signal intensity was not properly calibrated using a Full Moon BioSystems slide (Sunnyvale, CA, USA). This calibration slide is made of glass spotted with Cy3 and Cy5 dyes at various concentrations. Using this slide, a scanner calibration procedure does not involve any target hybridization. In our subsequent research, we followed their recommendations, converting signal intensities to actual number of fluorophores . Upon calibrating a new Agilent scanner, however, we noticed that most of the probe signal intensities were well below the sensitivity threshold determined by the calibration slide. A representative of Full Moon BioSystems revealed that the "buffer", used to make spots on their calibration slide, autofluoresces. This new understanding lead us to further investigate the utility of calibration slides (discussed below).
Our experiments show the sensitivity and linearity of the photomultipler tube (PMT) is significantly underestimated by the Full Moon BioSystems calibration slide. Because understanding the scanner response is crucial for the meaningful interpretation of microarrays, we feel it is appropriate to communicate this note to the readers, especially in light of the fact that the Shi et al. paper has been well cited.
Calibration slide description provided by Full Moon BioSystems.
1.47E + 05
7.35E + 04
3.68E + 04
1.84E + 04
9.19E + 03
4.59E + 03
2.30E + 03
1.15E + 03
5.74E + 02
2.87E + 02
1.44E + 02
7.18E + 01
3.59E + 01
1.79E + 01
8.97E + 00
4.49E + 00
Layout file downloaded from the Full Moon BioSystems web site.
Full Moon BioSystems calibration slide was scanned by three different scanners: Agilent, Bio-Rad and GenePix. Prior scanning, no hybridization was conducted, because the calibration slide already carries spots of dyes. With Agilent and Bio-Rad both color channels were investigated. In addition, several PMT settings were tested on the Agilent scanner.
Revised Calibration Model
Characteristics of microarray scanners.
In non-transformed coordinates, the new model introduces two parameters: B, the sensitivity of the photomultiplier and a, the curvature of the line. It is important not to confuse the slope in our model (B) with the slope reported by Shi et al., because the latter is in log-log coordinates, which corresponds to our parameter a. Although Figure 1 shows log-scaled coordinates for convenience of viewing, the log transformation was not used to treat the data. Also, the curvature parameter a means deviation from the straight line (a = 1). As our model predicts, the lower plateau does not apply to a PMT in reality (see Figure 1). The plateau is an artifact of the calibration slide. Hence there is no gross nonlinearity of the PMT response at the lower range of intensities. What distinguishes our study from the work of Shi et al. is that we provided a model that discovered two important properties of scanners: sensitivity (B) and curvature (a).
The reason why the above mentioned finding is relevant to the discussion of the Shi et al. paper is that calibration of a microarray scanner with Full Moon BioSystems slide is confounding the situation. The calibration slide introduces an artifact of the lower plateau. Moreover, one can see from the Shi et al. study that the span of the linear part (in log-log coordinates) of the PMT response curve depends on the PMT gain. Specifically, at the high gain, the linear part is short, same as at the low PMT gain. We argue that it is because of the lower plateau artifact the linear part is affected. At low PMT gain, the signal is drowned in background fluorescence, while at high gain, the background fluorescence is saturating the PMT. It may very well be that the linear (or slightly curvy) response line spans over much larger range of concentrations than it is reported by Shi et al. This explains why most of the signals were below the lower plateau in our ongoing gene expression studies. In retrospect, the only reason for calibrating a scanner could be to determine the saturation limit of the PMT.
Table 3 provides values for the autofluorescence (parameter g). Our model accurately captured the value of autofluorescence, because, as one would expect, the parameter g is independent on the PMT setting. The g values for other scanners are somewhat different from that of Agilent, which is because the calibration slides were from different batches. The g value itself (~8-12) is about 4 orders of magnitude larger than the lowest concentration of the dye on the slide. Obviously, with this level of autofluorescence the dilution series 15-27 have no utility (see Table 1).
There seems to be a particular PMT behavior of the Bio-Rad scanner, i.e. Figure 2, bottom left, shows a shoulder on the Cy3 curve. To the contrary, GenePix scanner does not display such a behavior. Specifically, the GenePix Cy3 curve is similar to that of Agilent (data not shown).
We propose that a new type of calibration slide with zero autofluorescence be developed and a model be devised that exactly describes behavior of the PMT.
Note: our analysis was based on purely raw signal intensities. In other words, none of the data values were normalized, removed or transformed.
Our study revealed two important facts. First, the lower plateau is an artifact introduced by the Full Moon BioSystems calibration slide. Second, the PMT response curvature is not significantly different between color channels and the curvature is the same for different PMT gains (voltages). We recommend against using Full Moon BioSystems calibration slides.
- Shi LM, Tong WD, Su ZQ, Han T, Han J, Puri RK, et al.: Microarray scanner calibration curves: characteristics and implications. BMC Bioinformatics 2005, 6(Suppl 2):S11. 10.1186/1471-2105-6-S2-S11View ArticlePubMedPubMed CentralGoogle Scholar
- Pozhitkov AE, Boube I, Brouwer MH, Noble PA: Beyond Affymetrix arrays: expanding the set of known hybridization isotherms and observing pre-wash signal intensities. Nucleic Acids Research 2010, 38(5):e28. 10.1093/nar/gkp1122View ArticlePubMedPubMed CentralGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.