Methodology article
Open Access

SAQC: SNP Array Quality Control

  • Hsin-Chou Yang1Email author,
  • Hsin-Chi Lin1,
  • Meijyh Kang2,
  • Chun-Houh Chen1,
  • Chien-Wei Lin1,
  • Ling-Hui Li2,
  • Jer-Yuarn Wu2,
  • Yuan-Tsong Chen2 and
  • Wen-Harn Pan2
BMC Bioinformatics201112:100

https://doi.org/10.1186/1471-2105-12-100

©  Yang et al; licensee BioMed Central Ltd. 2011

Received: 11 September 2010

Accepted: 18 April 2011

Published: 18 April 2011

Abstract

Background

Genome-wide single-nucleotide polymorphism (SNP) arrays containing hundreds of thousands of SNPs from the human genome have proven useful for studying important human genome questions. Data quality of SNP arrays plays a key role in the accuracy and precision of downstream data analyses. However, good indices for assessing data quality of SNP arrays have not yet been developed.

Results

We developed new quality indices to measure the quality of SNP arrays and/or DNA samples and investigated their statistical properties. The indices quantify a departure of estimated individual-level allele frequencies (AFs) from expected frequencies via standardized distances. The proposed quality indices followed lognormal distributions in several large genomic studies that we empirically evaluated. AF reference data and quality index reference data for different SNP array platforms were established based on samples from various reference populations. Furthermore, a confidence interval method based on the underlying empirical distributions of quality indices was developed to identify poor-quality SNP arrays and/or DNA samples. Analyses of authentic biological data and simulated data show that this new method is sensitive and specific for the detection of poor-quality SNP arrays and/or DNA samples.

Conclusions

This study introduces new quality indices, establishes references for AFs and quality indices, and develops a detection method for poor-quality SNP arrays and/or DNA samples. We have developed a new computer program that utilizes these methods called SNP Array Quality Control (SAQC). SAQC software is written in R and R-GUI and was developed as a user-friendly tool for the visualization and evaluation of data quality of genome-wide SNP arrays. The program is available online (http://www.stat.sinica.edu.tw/hsinchou/genetics/quality/SAQC.htm).

Background

Single-nucleotide polymorphisms (SNPs), the most abundant genetic markers in the human genome, have been widely used in genetic and genomic research such as studies of disease gene mapping [1–6], medical and clinical diagnostics [7–9], forensic tests [10–12], genome structure of linkage disequilibrium and recombination [13–18], chromosomal aberrations [19–24], and genetic diversity [25–27]. Modern high-throughput and high-resolution SNP array genotyping techniques, such as the Affymetrix GeneChip (Affymetrix Inc., Santa Clara, CA, USA) [28, 29] and Illumina BeadChip (Illumina Inc., San Diego, CA, USA) [30–32], provide genotype and fluorescence intensity data on hundreds of thousands of SNPs for each study sample. Many genomic studies are using such SNP genotyping techniques to find marker-trait association via genome-wide association studies [4, 6, 33] and to identify disease-related chromosomal aberrations via allelic-imbalance analyses [34–39], loss-of-heterozygosity analyses [24, 35, 40–43], and copy-number analyses [23, 24, 41, 44, 45].

Data quality of SNP arrays plays a key role in the accuracy and precision of downstream data analyses. An analysis of contaminated data from poor-quality SNP arrays or genotyping experiments may suggest false-positive and/or false-negative results. Differentiating between reliable and poor-quality SNP arrays is critical to performing downstream statistical data analyses. Quality control of SNP arrays is closely related to a quality assessment of the genotype call of a SNP. Some genotyping algorithms provide SNP-based quality metrics, such as a discrimination signal [46] and confidence scores [47–50]. These metrics mainly focus on a reliability assessment of the genotyping call for individual SNPs rather than an assessment of the overall quality of the SNP arrays. The empirical distributions of most of these metrics were not investigated. Therefore, threshold values for poor quality are often assigned heuristically and not according to a statistical rule. Published reports of systematic analyses to evaluate the data quality of SNP arrays are not available, and good indices that measure the data quality of SNP arrays still await development. Currently, the most broadly used quality measurement of SNP arrays is the genotype call rate (GCR) [51]. GCR, which is the proportion of SNPs whose genotypes can be called on a SNP array, provides a convenient measure for quantification of SNP array quality. GCR is informative and feasible, but this quality metric may be sensitive to the parameters used in genotyping algorithms. For example, "forced call" which leads to a GCR of 100% for a SNP array can always be attained if the least-stringent criterion is used [50].

This study aims to provide a reliable method and related software for the visualization and assessment of the data quality of SNP arrays. We developed new quality indices, derived their empirical distributions, and developed a confidence interval method to identify potentially poor-quality data caused by poor-quality SNP arrays and/or DNA samples. Visualization tools including quality index heatmap plot, quality index polygon plot, AF plot, and genotype call rate plot are integrated into user-friendly software for SNP Array Quality Control (SAQC).

Methods

DNA samples and SNP data used in the analyses

Samples used in our analyses were from three genomic projects, the Taiwan Han Chinese Cell and Genome Bank [52], the International HapMap Project [13–16], and the Taiwan Young-Onset Hypertension Study [5]. The first project provides 367 and 448 Han Chinese samples from the Taiwan (TWN) population genotyped using the Affymetrix Human Mapping 100K Set and 500K Set, respectively. Bayesian Robust Linear Model with Mahalanobis Distance Classifier (BRLMM) was used for genotype call analysis [53]. The second project was based on 90 African samples from 30 trios (YRI), 90 European samples from 30 trios (CEU), and 90 independent Asian samples (45 Han Chinese individuals in Beijing [CHB] and 45 Japanese individuals in Tokyo [JPT]). All 270 samples were genotyped using the Affymetrix Human Mapping 100K Set and 500K Set, where Dynamic Model Mapping Analysis [47] and BRLMM were used for genotype call analysis of the Affymetrix Human Mapping 100K Set and 500K Set, respectively. The genotype and hybridization intensity data are publicly available (http://hapmap.ncbi.nlm.nih.gov/). The third project provides 175 and 192 hypertensive patients and 175 and 198 normotensive controls from the TWN population genotyped using the Affymetrix Human Mapping 100K Set and 500K Set, respectively. BRLMM was used for genotype call analysis. We obtained informed consent from all TWN individuals whose samples were used in this study, and this study was approved by the Academia Sinica review board. Based on individual-level AFs in the first two genomic projects, quality indices were calculated for different SNP arrays (Xba and Hind of the Affymetrix 100K Set and Sty and Nsp of the Affymetrix 500K Set) based on samples in various reference populations (the Taiwanese population; ethnic-specific populations; and a combination of African, Asian, and European populations). DNA samples of individuals recruited in the third project were mixed to form four DNA pools with 56, 198, 52 and 192 individuals. Quality indices were calculated for different SNP arrays based on each DNA pool.

Indices for quantifying SNP array and DNA quality

We introduce the procedures for our new quality index calculations, where individual-level allele frequency (AF) is the key element in the estimation procedures. In contrast to population-level AF which represents a within-population relative frequency of alleles in a population, individual-level AF represents a within-individual relative frequency of alleles in an individual. We measure SNP array quality by quantifying a departure of estimated individual-level AFs from expected AFs via standardized distances. Let {G n,m , n = 1,⋯,N,m = 1,⋯,M} denote the genotype and {λ n,m ,n = 1,⋯,N,m = 1,⋯,M} denote the individual-level AF of the m th SNP of the n th array in a genotyping experiment of oligonucleotide SNP arrays such as Affymetrix GeneChip (Affymetrix Inc., Santa Clara, CA, USA) and Illumina BeadChip (Illumina Inc., San Diego, CA, USA). Genotypes can be obtained using genotyping calling algorithms [47, 49, 50, 53]. Individual-level AFs can be estimated by calculating adjusted hybridization intensities with the aid of the coefficient of preferential amplification/hybridization (CPA) [54].

To quantify SNP array quality, we first calculated the SNP-level quality index and then calculated the average of the quality indices of the SNPs to obtain an array-level quality index. Two SNP-level quality indices, genotype-based quality index and nearest-mean-based quality index, were developed. Both indices are standardized distances. Where the m th SNP with genotype G m is AA, Aa, or aa, the genotype-specific mean and standard deviation of individual-level AFs were calculated as follows:

and I[E] is an indicator taking a value of 1 if event E holds; otherwise, the value is 0.

AF references were established as a collection of genotype-specific mean and standard deviation of individual-level AFs. The genotype and individual-level AF data used to construct AF references can come from samples of the current study or from independent reference samples described in the Results. Genotype-based standardized distance of an individual-level AF was defined as follows:
In some situations, genotype information may be inaccurate. For example, genotypes of SNPs involved in regions of copy number change or chromosomal aberrations may not truly reflect the underlying combination of alleles. Therefore, we developed another index, nearest-mean-based index, without incorporating the genotypes from other genotype calling methods. This property also makes our methods more self-contained. The AF mean and standard deviation of the genotype closest to the observed individual-level AF λ n,m were calculated as follows:
The non-genotype-based (nearest-mean-based) standardized distance of an individual-level AF was calculated as follows:
Next, an array-level quality index was introduced. Let q x,n (ρ) denote the ρ quantile of genotype-based or nearest-mean-based SNP-level quality indices {q x,n,m ,m = 1,⋯,M} for the n th array. To include tolerance for the interference of a small proportion of extreme values that occasionally occurred at some SNPs because of uncontrollable factors, we used a robust statistic, the winsorized mean quality index, to summarize distances of overall SNPs interrogated on a SNP array as follows:

where the top ρ of standardized distances was winsorized (i.e., replaced with the observation of the ρ quantile) in the calculation. The proposed distance-based quality indices quantify discrepancies between the observed and expected individual-level AFs and tend to have a higher value if the quality of a SNP array is poor. Quality indices based on genotype-based standardized distance and non-genotype-based (nearest-mean-based) standardized distance were defined as Q1 and Q2, respectively.

In addition, a confidence interval method was developed to identify poor-quality SNP arrays and/or DNA samples. SNP arrays for which their quality indices exceeded an upper confidence limit based on reference samples were identified as questionable SNP arrays. Quality index references were established as a collection of the upper confidence limits that was obtained by calculating 95%, 97.5%, and 99% quantiles of the underlying empirical distributions of quality indices for different SNP arrays based on samples in various reference populations. Reference populations and empirical distributions of quality indices are described in the Results.

Performance analysis of quality indices

To evaluate performance of the proposed quality indices, we analyzed authentic data sets and simulated data sets. Details of authentic data sets are presented in the Methods. The simulation procedure was performed as follows. Genomic data from 100 SNP arrays were generated to mimic the real genomic patterns of chromosome 19 of Affymetrix Human Mapping 100K and 500K Sets. The number of SNPs on the chromosome was 690 and 6,396, respectively. The simulation was replicated 1,000 times. The data generation procedure for a SNP was performed as follows. First, at each SNP locus, the number of SNPs with genotypes AA, Aa, and aa on the 100 SNP arrays was generated from a multinomial distribution MNL(N = 100; ), where the cell probabilities were population-level genotype frequencies from our real data. Second, the individual-level AF of allele A for an individual with genotype G for the study SNP was randomly generated from a beta distribution λ G ~ Beta (α G , β G ), where and were derived using a moment estimation method, and μ G and σ G denote the sample mean and standard deviation of individual-level AFs. The variance reflects a t otal variation (VT, G ) of individual-level AFs in a SNP array, which is the sum of a s ystematic variation (Vs, G ) and an e xtra variation (VE, G ). The systematic variation reflects the variation of individual-level AFs from samples and arrays with good quality, and the extra variation represents the variation introduced by poor quality of SNP arrays or DNA samples additionally. Let r = VE, G /VT, G denote the relative extra error for different genotypes; the larger the value, the poorer the SNP array. In other words, AF plot shows broader bands for the larger r and, expectedly, a poor sample/array with the larger r should be easier to be detected. Third, to mimic practical scenarios, parameters μ G and Vs, G were assigned by empirical means and variances of individual-level AFs from the real data. A relative experimental error of r from 0 to 0.6 with increments of 0.025 was considered. and were calculated under specified values of , and r, and then individual-level AFs were generated from the beta distribution. The 95%, 97.5%, and 99% quantiles of quality index under r = 0 were derived to serve as an upper confidence limit for identification of poor-quality SNP arrays. For each relative experimental error r, a proportion of SNP arrays that were identified as poor-quality SNP arrays was calculated in each simulation replication. An average and a standard deviation of proportions of poor-quality SNP arrays in 1,000 simulations were calculated.

Results

Empirical distributions and upper confidence limits of quality indices

We calculated quality indices and established their empirical distributions based on SNP array data from the Taiwan Han Chinese Cell and Genome Bank [52] and the International HapMap Project [13–16]. Values of quality indices were fitted by lognormal distributions and examined by Kolmogorov-Smirnov goodness-of-fit tests [55]. P-values of all goodness-of-fit tests were >0.05 for SNP arrays and study populations, demonstrating that the quality index was well modeled by lognormal distributions (Additional file 1).

We compared quality indices among different ethnic groups. In addition to a pairwise comparison of histograms for quality indices from different ethnic groups, we also formally compared the distributions of quality indices from different ethnic groups by testing the equalities of their means (in log scale), variances (in log scale) and sampling distributions using two-sample Z test, F test and Kolmogorov-Smirnov goodness-of-fit test, respectively. We analyzed SNPs interrogated on the Affymetrix 500K Set with all chromosomes combined. The results showed that, with very few exceptions (highlighted in red), there were no significant differences in means, variances and distributions of quality indices across ethnic groups in general (Figure 1).
Figure 1

Comparison of the distributions of quality indices from the different ethnic groups based on the Affymetrix Human Mapping 500K Set. The subfigures in the diagonal show the names of ethnic groups (CEU, YRI, CHB, JPT, HapMap Asian, TWN, and TWN + HapMap). The subfigures in the lower diagonal part show the histograms and fitted curves of quality index Q2 for any two given ethnic groups. In each subfigure, distributions of quality indices from two ethnic groups are superimposed, with the purple bar and curve corresponding to the ethnic group named on the above, and the green bar and curve corresponding to the ethnic group named on the right. The subfigures in the upper diagonal part show the p-values for testing equality of means (in log scale), variances (in log scale) and sampling distributions for any two given ethnic groups, Pmean, Pvar and PKS. The names of the two ethnic groups compared are shown in the upper-left corner in each subfigure. P-values smaller than 0.05 are indicated in red.

We also evaluated the effect of laboratory on quality indices by controlling the population effect. We compared distributions of quality indices for the samples from two closely-related ethnic groups. The first group was Han Chinese residing in Taiwan and referred as TWN samples in this study (n = 448), and the second group was Han Chinese residing in Beijing and referred as CHB samples in the International HapMap Project (n = 45). These two groups of samples were genotyped in different laboratories. Kolmogorov-Smirnov goodness-of-fit test was employed to test the equality of quality indices for the two distributions. The p-value was 0.573, which suggested that genotyping done in different laboratories did not have a significant effect of the distribution of quality indices. The 95%, 97.5%, and 99% upper confidence limits of quality indices for different SNP arrays based on samples in various reference populations including the Taiwanese, African, Asian, and European populations (i.e., population-specific confidence limits) and the samples in all reference populations (i.e., combined-population confidence limits) were calculated and then provided in SAQC software. The confidence limits provided thresholds for identifying poor-quality SNP arrays and/or DNA samples using the proposed confidence interval method.

Quality evaluation of real SNP arrays and DNA samples

Eight experimentally designed bad-quality SNP assays were used to validate our new quality index calculations (Samples 1 - 8 in Figure 2). Samples 1 - 4 were individual DNA with good quality from the Taiwan Han Chinese Cell and Genome Bank [52] and genotyped using arrays beyond expiration date (expired arrays); Samples 5 - 8 were pooled DNA of multiple individuals from the Taiwan Young-Onset Hypertension Study [5] and genotyped using arrays prior to expiration date (unexpired arrays). All the eight samples were genotyped with the Affymetrix Human Mapping 500K Set (Nsp and Sty arrays), and the quality index Q2 was calculated for the Nsp array and Sty array and the "Merge" array which contains all SNPs on the Nsp array and Sty array. For the TWN population, the 95%, 97.5%, and 99% quantiles of the quality index in the reference samples are, respectively, 1.144, 1.246, and 1.385 for Nsp arrays; 1.133, 1.233, and 1.367 for Sty arrays; and 1.056, 1.129, and 1.224 for Merge arrays. A SNP array with a low quality index (good quality) is presented in green, and a SNP array with a high quality index (poor quality) is presented in white in the quality index heatmap plot. As shown in Figure 2, when the 95% quantile was applied, Samples 1 - 8 showed poor performance for both SNP arrays and were categorized as "poor quality". The performance of Samples 5 - 8 was worse than that of Samples 1 - 4. The same analysis method was applied to 448 unselected individuals, which were recruited by the Taiwan Han Chinese Cell and Genome Bank [52] and genotyped using unexpired arrays. The majority of the samples had low quality indices for both SNP arrays and was categorized as "good quality"; four representative samples (Samples 9 - 12) were shown in Figure 2 for illustration. Only few samples had high quality index for at least one SNP array and were categorized as "poor quality"; four of them (Samples 13 - 16) were shown in Figure 2 for illustration.
Figure 2

Quality index heatmap plot for SNP arrays of different quality and pooled DNA. This figure shows quality index Q2 for Nsp arrays, Sty arrays, and merged Nsp and Sty arrays for 16 DNA samples. The first four samples and the second four samples were genotyped using unexpired arrays. The third four samples were genotyped with expired arrays. The last four samples were DNA pools constructed by 56, 198, 52 and 192 individuals and genotyped using unexpired arrays, respectively. The magnitude of the quality index is presented using a heatmap plot for which a color spectrum from dark green to white represents the magnitude range. The levels of the quality index (μ, μ + σ, μ + 2σ, μ + 3σ, μ + 4σ, μ + 5σ and μ + 6σ) are given, where μ and σ denote the sample mean and standard deviation, respectively, of the quality index for the normal reference samples. Moreover, the upper limits of the quality index for arrays Nsp (N), Sty (S), and Merge (M) are also given in the key. For the 16 DNA samples, if the values of the quality indices of arrays Nsp, Sty and Merge are greater than these upper limits, arrays are presented in light-blue shaded views, respectively.

Furthermore, we picked up the first sample in each category, i.e., Samples 1, 5, 9 and 13, for exemplifying the problems that could be identified by our method. The four samples were further examined using AF plots (Additional file 2). Deviation from a typical AF profile (i.e., three AF bands) was observed in poor-quality SNP arrays with high quality indices. Sample 1 was genotyped using expired arrays and, as expected, showed high quality indices in Nsp and/or Sty array (QINsp = 1.521, QISty = 1.001, and QIMerge = 1.259) (Additional file 2, Supplemental Figure S2 (A1) and (A2)). A SNP array assay with a set of bad-quality arrays would behave like this. Sample 5 was derived from a DNA pool of 56 TWN individuals with hypertension, and the AF of a SNP reflected population-level AF. As expected, the AFs of this sample were deviated from the upper- and lower-bound of individual-level AFs across the genome, which resulted in extremely high quality indices (QINsp = 4.305, QISty = 4.577, and QIMerge = 4.433) and thus very poor quality (Additional file 2, Supplemental Figure S2 (B1) and (B2)). Samples with server DNA contamination would show similar AF profiles like that in this subgroup. Sample 9 had low quality indices for the Nsp, Sty, and Merge arrays (QINsp = 0.733, QISty = 0.776, and QIMerge = 0.753), signifying an accurate hybridization, thereby suggesting good quality of both the DNA sample and SNP arrays. This was typically observed for individual genotyping experiment in this study (Additional file 2, Supplemental Figure S2 (C1) and (C2)). Sample 13 showed poor quality in the Nsp array but good quality in the Sty array (QINsp = 1.446, QISty = 0.647, and QIMerge = 1.024), indicating that the unsatisfactory quality of this sample was caused by the Nsp array assay or genotyping error rather than the original DNA sample (Additional file 2, Supplemental Figure S2 (D1) and (D2)). If the error was caused by poor-quality DNA, inadequate performance should have been found in both the Nsp and Sty arrays.

Results of simulation studies

We defined detection rate as a proportion of poor-quality SNP arrays detected by the proposed confidence interval method according to a 95%, 97.5%, or 99% quantile of quality index. We calculated the mean and standard deviation of detection rates of 1,000 simulations at a relative experimental error (r) of 0-0.6 at increments 0.025. Results of the Affymetrix 100K and Affymetrix 500K Sets based on the TWN population are shown in Figure 3 and Figure 4.
Figure 3

Detection rate of quality indices in the simulation study based on the Affymetrix 100K SNP arrays. Averages and standard deviations of detection rates of the genotype-based and nearest-mean-based quality indices {Q1(ρ), Q2(ρ), ρ = 95%, 97.5%, 99%} for a relative experimental error r of 0-60%. The data were generated from the TWN population.

Figure 4

Detection rate of quality indices in the simulation study based on the Affymetrix 500K SNP arrays. Averages and standard deviations of detection rates of the genotype-based and nearest-mean-based quality indices {Q1(ρ), Q2(ρ), ρ = 95%, 97.5%, 99%} for a relative experimental error r of 0-60%. The data were generated from the TWN population.

First, the effect of the relative experimental error (r) is discussed. The false detection rates (i.e., detection rate at r = 0) were small, and true detection rates (i.e., detection rate at r > 0) increased as the relative experimental error r increased. The average detection rates followed S-shaped curves when plotted average detection rate versus r (Figure 3 and Figure 4). The precision of detection rates was assessed using the standard deviation of detection rates (Figure 3 and Figure 4). Second, the performance of two quality indices (Q1 and Q2) was compared. We found that the two indices have similar detection rates and precision in our simulation (Figure 3 and Figure 4). The impact of ethnic populations (TWN, CHB + JPT, and Combined) on the average detection rates and precision of detection rates was evaluated. The patterns of detection rates were quite similar in different ethnic populations although the simulation data were generated from genomic distributions of various populations (Additional file 3, Figure 3 and Figure 4). Fourth, the impact of the SNP genotyping platform (Affymetrix 100K and 500K Sets) was also assessed. In general, the Affymetrix 500K Set with a higher marker density (Figure 4) had a higher detection rate than the Affymetrix 100K Set (Figure 3). For the Affymetrix 100K Set, almost 100% of poor-quality SNP arrays were identified successfully when r was >0.35; and for the Affymetrix 500K Set, almost 100% of poor-quality SNP arrays were identified successfully when r was >0.15 (Figure 3 and Figure 4).

Fifth, the impact of winsorization thresholds (ρ) was also evaluated. In general, average detection rates presented similar S-shaped curves, whereas standard deviations of detection rates presented similar unimodal curves (Figure 3 and Figure 4). Quality indices with a lower winsorization threshold had higher true detection rates at r > 0 but were penalized by a slightly higher false detection rate and standard deviation of detection rate at r = 0 (Figure 3 and Figure 4).

SAQC software

SAQC software with R-GUI interfaces (Figure 5 and Figure 6) is available online (http://www.stat.sinica.edu.tw/hsinchou/genetics/quality/SAQC.htm). The test examples are also provided, and the examples can be run conveniently by simply clicking the button "Run" once SAQC software has been initialized. SAQC software consists of two components: (1) main functions (Figure 5), and (2) interactive visualization (Figure 6). The main functions provide statistical analyses of genotype and hybridization intensity data or AF data and produce both graphical and numerical results of quality indices. The interactive visualization provides an interactive mode to display the results of quality indices. The functions are illustrated in detail as follows:
Figure 5

Interface of main functions of new SAQC software to assess data quality of SNP arrays. The main functions of SAQC software contain five items: input/output path, data format, statistical analysis, graphical output and numerical output.

Figure 6

Interface of interactive visualization of new SAQC software to assess data quality of SNP arrays. The interactive visualization contains two items: input/output path and plot parameters.

Component 1 - Main functions

  1. (1)

    Input/output path: Users select the input data format, where either genotypes and hybridization intensity data or AF data can be selected. Data will be automatically loaded by searching data files in the specified input directory. Numerical outputs and graphical outputs will be saved in the specified output directory.

     
  2. (2)

    Data format: We provide CPA, AF, and QI reference databases for HapMap Asian (CHB + JPT), African (YRI), European (CEU), Taiwanese (TWN), and combined populations (TWN + CHB + JPT + YRI + CEU). Databases for the Affymetrix 100K/500K are provided, and databases for the Affymetrix Array 6.0 and Illumina 550K BeadChip are being constructed. Users can decide to analyze one array (e.g., Xba or Hind array of the Affymetrix 100K Set) or two arrays (e.g., both Xba and Hind array of the Affymetrix 100K Set).

     
  3. (3)

    Statistical analysis: SAQC software provides utilities including CPA calculation, AF estimation, AF reference calculation, QI calculation, and identification of poor-quality arrays. Users can select to construct their own CPA and AF references or to use the references provided by the SAQC databases. In addition, users can also select 95%, 97.5%, or 99% for the upper quantile of the quality index when identifying poor-quality arrays.

     
  4. (4)

    Graphical output: SAQC software provides different types of plots including intensity-based and genotype-based AF plots, QI heatmap plots, QI polygon plots, and GCR plots.

     
  5. (5)

    Numerical output: SAQC software provides the following numerical outputs including: data description, CPA estimate, AF estimate, QI estimate, and poor-quality SNP array. In addition, a file that shows a sample list and GCR for each SNP array, and a log file that shows the progress of program execution and error/warning messages are included.

     

Component 2 - Interactive visualization

  1. (1)

    Input/output path: Users can specify the input and output directories. Quality index data will be automatically loaded by searching data files in the specified input directory. Graphical outputs will be saved in the specified output directory.

     
  2. (2)

    Plot parameters: Users first select to display a QI heatmap plot (as in Additional file 4, Supplemental Figure S4 (A)) and/or QI polygon plot (as in Additional file 4, Supplemental Figure S4 (B)) and then choose suitable graphic settings for the plots. Users can either apply the parameters established from the SAQC databases of different ethnic populations and SNP array platforms, or they can also provide their own references.

     

Discussion

The sampling distribution of quality indices is important to systematically identify poor-quality SNPs and SNP arrays. Although other quality indices for single SNPs have been proposed [46–50], their sampling distributions were seldom investigated. In this report, we proposed new quality indices and tested them. We derived sampling distributions for the quality indices through empirical studies of several large genomic projects. We found that the proposed quality indices follow lognormal distributions. A similar conclusion was also reached in our simulation study. For example, for Q2, only a small proportion, 2.2% for the Affymetrix 100K Set and 4.0% for the Affymetrix 500K Set, of the Kolmogorov-Smirnov goodness-of-fit tests rejected the null hypothesis "quality indices follow lognormal distributions" (P-value < 0.05) at a relative experimental error r = 0, meaning that the proposed quality indices can be well modeled by lognormal distributions.

The proposed quality indices were compared with other indices. In addition to the winsorized mean, other robust metrics, such as the median and trimmed mean, can be used to calculate an array-level quality index. We thus compared the performance of the winsorized mean and median in simulation studies (compare Additional file 3 with Additional file 5). The results showed that the median statistic also was effective at evaluating SNP array quality. The winsorized mean statistic did, however, have a consistently higher true detection rate than did the median statistic, especially when r was <0.4 for the Affymetrix 100K Set and <0.175 for the Affymetrix 500K Set (compare Additional file 3 with Additional file 5). Moreover, we also compared the proposed quality indices with the commonly used index GCR. In general, SNP arrays with a low GCR often have poor quality indices. For example, for the Affymetrix 500K Set in our study, absolute-value correlation coefficients for the quality index Q2 and GCR in the merged Nsp and Sty arrays were 0.8264, 0.6732, 0.7951, and 0.8727 for the YRI, CEU, CHB, and JPT populations, respectively (data not shown). Nevertheless, the proposed indices can work in concert with plots of AFs and quality indices to provide complementary information for a GCR index to identify poor-quality SNP arrays and/or DNA samples that cannot be detected by GCR.

A confounding factor, chromosome aneuploidy, should be considered when drawing conclusions from an analysis of the proposed quality indices. A high value for the quality index may be caused by a poor-quality SNP array (true positive) or may be a reflection of DNA samples with chromosomal aneuploidy (false positive). An artifactual high-quality index may result from chromosomal aberrations of the test samples that deviated from the normal references that were used to establish SAQC databases. In fact, changes in the chromosomal structure of DNA samples can be indicative of important biological processes rather than of poor-quality SNP arrays with high experimental noise. One simulated example of a poor-quality SNP array is the triploid cancer patient with high quality indices of Hind, Xba and merged arrays (QIHind = 4.393, QIXba = 7.541, and QIMerge = 5.922) (Additional file 6), where ρ = 95% was considered. SAQC software overcomes this potential confounding issue by providing intensity-based AF plots. High quality indices that are due to polyploidy or aneuploidy can be easily identified via an intensity-based AF plot (Additional file 6). In addition, SAQC software can be used jointly with our recently developed analysis tool, ALOHA software [39], to identify regions of chromosomal aberrations, such as allelic imbalance, loss of heterozygosity and copy number changes. Although our quality index is not designed for directly detecting copy number alterations, it can be used to select the best ones (i.e., samples with good quality indices) from a set of samples to be used as references to compute absolute copy numbers.

For ethnic populations and laboratory effect, our analyses suggest that the effects of the ethnic population and laboratory are not significant (see Figure 1). Thus, the results will only be changed mildly for wrongly assigned population. SAQC software provides population-specific and combined-population databases of AFs and quality indices for identifying poor-quality SNP arrays and/or DNA samples. Use of the reference from the same population as the study group is recommended. If the desired population is not available in SAQC, users can use the reference from the combined population; alternatively, users can build or provide the references for their own population and their own laboratory using SAQC (see the SAQC software section).

The analysis of Sample 5 in Figure 2 illustrates that it is possible to use our proposed method to discern the origin of a bad hybridization signals is the DNA sample or the array for samples. However, the conclusion solely relies on the discordance between the two arrays for the same sample (e.g., Xba and Hind of the Affymetrix 100K Set and Sty and Nsp of the Affymetrix 500K Set), so this application can not be applied to the case of a single array system (e.g., Affymetrix Array 6.0 or Illumina 550K) if no experimental replicates available.

In addition to the Affymetrix Human Mapping 100K and 500K Sets, the new SAQC software can be extended to handle SNP arrays with a higher marker density. Currently, we are establishing CPA, AF, and QI reference databases for the Affymetrix Array 6.0 and Illumina 550K BeadChip. Completion of this task will further enhance the applications of our methods and SAQC software.

Conclusions

Quality control of SNP arrays plays an important role in downstream data analyses. As a result of our analysis, we have proposed new quality indices and have established their empirical distributions for different SNP array platforms and ethnic populations. We have also developed a detector to assist in identifying poor-quality SNP arrays and/or DNA samples based on empirical distributions of quality indices; this method has been evaluated by analyses of authentic data and simulated data. In addition, the newly developed SAQC software provides an easy-to-use analysis platform for SNP array quality control. In conclusion, an integrated analysis of quality indices (the quality index heatmap plot and quality index polygon plot), AF data (intensity-based AF plot and genotype-based AF plot), and GCR data (GCR plot) is helpful for determining the quality of genome-wide SNP arrays and thereby enhances the reliability of this sophisticated data analysis.

Availability and requirements

The SAQC software and test examples can be downloaded from the SAQC website: http://www.stat.sinica.edu.tw/hsinchou/genetics/quality/SAQC.htm.

Project name: SNP array quality control project

Project home page: http://www.stat.sinica.edu.tw/hsinchou/genetics/quality/SAQC.htm

Operating system: MS Windows®

Programming language: Language R and R-GUI

Other requirements: No

Any restrictions to use by non-academics: On request and citation

List of abbreviations used

AF: 

allele frequency

BRLMM: 

Bayesian Robust Linear Model with Mahalanobis Distance Classifier

CEU: 

CEPH Utah residents

CHB: 

Han Chinese in Beijing

CPA: 

coefficient of preferential amplification/hybridization

GCR: 

genotype call rate

JPT: 

Japanese in Tokyo

QI: 

quality index

SAQC: 

SNP Array Quality Control

SNP: 

single-nucleotide polymorphism

TWN: 

Han Chinese in Taiwan

YRI: 

Yoruba in Ibadan.

Declarations

Acknowledgements

We gratefully acknowledge the National Clinical Core and National Genotyping Center at Academia Sinica for providing DNA samples and genotyping support. The work was supported by a grant from the National Science Council of Taiwan (NSC 97-2314-B-001-006-MY3) and the National Research Program for Genomic Medicine (NSC 97-3112-B-001-027, NSC 98-3112-B-001-013, NSC 99-3112-B-001-009, and NSC99-3112-B-001029). We sincerely thank two anonymous reviewers for their very constructive and insightful comments in preparing our revision.

Authors’ Affiliations

(1)
Institute of Statistical Science, Academia Sinica
(2)
Institute of Biomedical Sciences, Academia Sinica

References

  1. Cardon LR, Bell JI: Association study designs for complex diseases. Nature Reviews Genetics 2001, 2(2):91–99. 10.1038/35052543View ArticlePubMedGoogle Scholar
  2. Collins A, Lonjou C, Morton NE: Genetic epidemiology of single-nucleotide polymorphisms. Proceedings of the National Academy of Sciences of the United States of America 1999, 96(26):15173–15177. 10.1073/pnas.96.26.15173PubMed CentralView ArticlePubMedGoogle Scholar
  3. Kruglyak L: Prospects for whole-genome linkage disequilibrium mapping of common disease genes. Nature Genetics 1999, 22(2):139–144. 10.1038/9642View ArticlePubMedGoogle Scholar
  4. The Wellcome Trust Case Control Consortium: Genome-wide association study of 14,000 cases of seven common diseases and 3,000 shared controls. Nature 2007, 447(7145):661–678. 10.1038/nature05911PubMed CentralView ArticleGoogle Scholar
  5. Yang H-C, Liang Y-J, Wu Y-L, Chung C-M, Chiang K-M, Ho H-Y, Ting C-T, Lin T-H, Sheu S-H, Tsai W-C, et al.: Genome-wide association study of young-onset hypertension in the Han Chinese population of Taiwan. PLoS ONE 2009, 4(5):e5459. 10.1371/journal.pone.0005459PubMed CentralView ArticlePubMedGoogle Scholar
  6. Wang WYS, Barratt BJ, Clayton DG, Todd JA: Genome-wide association studies: Theoretical and practical concerns. Nature Reviews Genetics 2005, 6(2):109–118. 10.1038/nrg1522View ArticlePubMedGoogle Scholar
  7. Monzon FA, Hagenkord JM, Lyons-Weiler MA, Balani JP, Parwani AV, Sciulli CM, Li J, Chandran UR, Bastacky SI, Dhir R: Whole genome SNP arrays as a potential diagnostic tool for the detection of characteristic chromosomal aberrations in renal epithelial tumors. Modern Pathology 2008, 21(5):599–608. 10.1038/modpathol.2008.20View ArticlePubMedGoogle Scholar
  8. Pomares E, Riera M, Permanyer J, Mendez P, Castro-Navarro J, Andres-Gutierrez A, Marfany G, Gonzalez-Duarte R: Comprehensive SNP-chip for retinitis pigmentosa-Leber congenital amaurosis diagnosis: new mutations and detection of mutational founder effects. European Journal of Human Genetics 2010, 18(1):118–124. 10.1038/ejhg.2009.114PubMed CentralView ArticlePubMedGoogle Scholar
  9. Pomares E, Marfany G, Brion MJ, Carracedo A, Gonzalez-Duarte R: Novel high-throughput SNP genotyping cosegregation analysis for genetic diagnosis of autosomal recessive retinitis pigmentosa and Leber congenital amaurosis. Human Mutation 2007, 28(5):511–516. 10.1002/humu.20479View ArticlePubMedGoogle Scholar
  10. Pomeroy R, Duncan G, Sunar-Reeder B, Ortenberg E, Ketchum M, Wasiluk H, Reeder D: A low-cost, high-throughput, automated single nucleotide polymorphism assay for forensic human DNA applications. Analytical Biochemistry 2009, 395(1):61–67. 10.1016/j.ab.2009.07.041View ArticlePubMedGoogle Scholar
  11. Lessig R, Zoledziewska M, Fahr K, Edelmann J, Kostrzewa M, Dobosz T, Kleemann WJ: Y-SNP-genotyping - a new approach in forensic analysis. Forensic Science International 2005, 154(2–3):128–136. 10.1016/j.forsciint.2004.09.129View ArticlePubMedGoogle Scholar
  12. Zhao G, Yang Q, Huang D, Yu C, Yang R, Chen H, Mei K: Study on the application of parent-of-origin specific DNA methylation markers to forensic genetics. Forensic Science International 2005, 154(2–3):122–127. 10.1016/j.forsciint.2004.09.123View ArticlePubMedGoogle Scholar
  13. The International HapMap Consortium: The International HapMap Project. Nature 2003, 426(6968):789–796. 10.1038/nature02168View ArticleGoogle Scholar
  14. The International HapMap Consortium: Integrating ethics and science in the international HapMap project. Nature Reviews Genetics 2004, 5(6):467–475. 10.1038/nrg1351PubMed CentralView ArticleGoogle Scholar
  15. The International HapMap Consortium: A haplotype map of the human genome. Nature 2005, 437(7063):1299–1320. 10.1038/nature04226PubMed CentralView ArticleGoogle Scholar
  16. The International HapMap Consortium: A second generation human haplotype map of over 3.1 million SNPs. Nature 2007, 449(7164):851–861. 10.1038/nature06258PubMed CentralView ArticleGoogle Scholar
  17. Reich DE, Cargill M, Bolk S, Ireland J, Sabeti PC, Richter DJ, Lavery T, Kouyoumjian R, Farhadian SF, Ward R, et al.: Linkage disequilibrium in the human genome. Nature 2001, 411(6834):199–204. 10.1038/35075590View ArticlePubMedGoogle Scholar
  18. Arnheim N, Calabrese P, Nordborg M: Hot and cold spots of recombination in the human genome: The reason we should find them and how this can be achieved. American Journal of Human Genetics 2003, 73(1):5–16. 10.1086/376419PubMed CentralView ArticlePubMedGoogle Scholar
  19. Sharp AJ, Locke DP, McGrath SD, Cheng Z, Bailey JA, Vallente RU, Pertz LM, Clark RA, Schwartz S, Segraves R, et al.: Segmental duplications and copy-number variation in the human genome. American Journal of Human Genetics 2005, 77(1):78–88. 10.1086/431652PubMed CentralView ArticlePubMedGoogle Scholar
  20. Sebat J, Lakshmi B, Troge J, Alexander J, Young J, Lundin P, Maner S, Massa H, Walker M, Chi MY, et al.: Large-scale copy number polymorphism in the human genome. Science 2004, 305(5683):525–528. 10.1126/science.1098918View ArticlePubMedGoogle Scholar
  21. Conrad DF, Andrews TD, Carter NP, Hurles ME, Pritchard JK: A high-resolution survey of deletion polymorphism in the human genome. Nature Genetics 2006, 38(1):75–81. 10.1038/ng1697View ArticlePubMedGoogle Scholar
  22. Feuk L, Carson AR, Scherer SW: Structural variation in the human genome. Nature Reviews Genetics 2006, 7(2):85–97. 10.1038/nrg1767View ArticlePubMedGoogle Scholar
  23. The Wellcome Trust Case Control Consortium: Genome-wide association study of CNVs in 16,000 cases of eight common diseases and 3,000 shared controls. Nature 2010, 464(7289):713–720. 10.1038/nature08979PubMed CentralView ArticleGoogle Scholar
  24. Stark M, Hayward N: Genome-wide loss of heterozygosity and copy number analysis in melanoma using high-density single-nucleotide polymorphism arrays. Cancer Research 2007, 67(6):2632–2642. 10.1158/0008-5472.CAN-06-4152View ArticlePubMedGoogle Scholar
  25. Abdulla MA, Ahmed I, Assawamakin A, Bhak J, Brahmachari SK, Calacal GC, Chaurasia A, Chen CH, Chen J, Chen YT, et al.: Mapping human genetic diversity in Asia. Science 2009, 326(5959):1541–1545. 10.1126/science.1177074View ArticlePubMedGoogle Scholar
  26. Campbell MC, Tishkoff SA: African genetic diversity: Implications for human demographic history, modern human origins, and complex disease mapping. Annual Review of Genomics and Human Genetics 2008, 9: 403–433. 10.1146/annurev.genom.9.081307.164258PubMed CentralView ArticlePubMedGoogle Scholar
  27. Goldstein DB, Cavalleri GL: Genomics - Understanding human diversity. Nature 2005, 437(7063):1241–1242. 10.1038/4371241aView ArticlePubMedGoogle Scholar
  28. Matsuzaki H, Dong SL, Loi H, Di XJ, Liu GY, Hubbell E, Law J, Berntsen T, Chadha M, Hui H, et al.: Genotyping over 100,000 SNPs on a pair of oligonucleotide arrays. Nature Methods 2004, 1(2):109–111. 10.1038/nmeth718View ArticlePubMedGoogle Scholar
  29. Kennedy GC, Matsuzaki H, Dong SL, Liu WM, Huang J, Liu GY, Xu X, Cao MQ, Chen WW, Zhang J, et al.: Large-scale genotyping of complex DNA. Nature Biotechnology 2003, 21(10):1233–1237. 10.1038/nbt869View ArticlePubMedGoogle Scholar
  30. Steemers FJ, Chang WH, Lee G, Barker DL, Shen R, Gunderson KL: Whole-genome genotyping with the single-base extension assay. Nature Methods 2006, 3(1):31–33. 10.1038/nmeth842View ArticlePubMedGoogle Scholar
  31. Steemers FJ, Gunderson KL: Whole genome genotyping technologies on the BeadArray™ platform. Biotechnology journal 2007, 2(1):41–49. 10.1002/biot.200600213View ArticlePubMedGoogle Scholar
  32. Gunderson KL, Steemers FJ, Lee G, Mendoza LG, Chee MS: A genome-wide scalable SNP genotyping assay using microarray technology. Nature Genetics 2005, 37(5):549–554. 10.1038/ng1547View ArticlePubMedGoogle Scholar
  33. Hirschhorn JN, Daly MJ: Genome-wide association studies for common diseases and complex traits. Nature Reviews Genetics 2005, 6(2):95–108. 10.1038/nrg1521View ArticlePubMedGoogle Scholar
  34. Wong KK, Tsang YTM, Shen J, Cheng RS, Chang YM, Man TK, Lau CC: Allelic imbalance analysis by high-density single-nucleotide polymorphic allele (SNP) array with whole genome amplified DNA. Nucleic Acids Research 2004, 32(9):e69. 10.1093/nar/gnh072PubMed CentralView ArticlePubMedGoogle Scholar
  35. Staaf J, Lindgren D, Vallon-Christersson J, Isaksson A, Goransson H, Juliusson G, Rosenquist R, Hoglund M, Borg A, Ringner M: Segmentation-based detection of allelic imbalance and loss-of-heterozygosity in cancer cells using whole genome SNP arrays. Genome Biology 2008., 9(9): 10.1186/gb-2008-9-9-r136Google Scholar
  36. Puputti M, Sihto H, Isola J, Butzow R, Joensuu H, Nupponen NN: Allelic imbalance of HER2 variant in sporadic breast and ovarian cancer. Cancer Genetics and Cytogenetics 2006, 167(1):32–38. 10.1016/j.cancergencyto.2004.09.023View ArticlePubMedGoogle Scholar
  37. Ishikawa S, Komura D, Tsuji S, Nishimura K, Yamamoto S, Panda B, Huang J, Fukayama M, Jones KW, Aburatani H: Allelic dosage analysis with genotyping microarrays. Biochemical and Biophysical Research Communications 2005, 333(4):1309–1314. 10.1016/j.bbrc.2005.06.040View ArticlePubMedGoogle Scholar
  38. Primdahl H, Wikman FP, von der Maase H, Zhou XG, Wolf H, Orntoft TF: Allelic imbalances in human bladder cancer: Genome-wide detection with high-density single-nucleotide polymorphism arrays. Journal of the National Cancer Institute 2002, 94(3):216–223.View ArticlePubMedGoogle Scholar
  39. Yang HC, Lin HC, Huang MC, Li LH, Pan WH, Wu JY, Chen YT: A new analysis tool for individual-level allele frequency for genomic studies. BMC Genomics 2010, 11(1):415. 10.1186/1471-2164-11-415PubMed CentralView ArticlePubMedGoogle Scholar
  40. Ogiwara H, Kohno T, Nakanishi H, Nagayama K, Sato M, Yokota J: Unbalanced translocation, a major chromosome alteration causing loss of heterozygosity in human lung cancer. Oncogene 2008, 27(35):4788–4797. 10.1038/onc.2008.113View ArticlePubMedGoogle Scholar
  41. Zhou XF, Mok SC, Chen Z, Li Y, Wong DTW: Concurrent analysis of loss of heterozygosity (LOH) and copy number abnormality (CNA) for oral premalignancy progression using the Affymetrix 10K SNP mapping array. Human Genetics 2004, 115(4):327–330. 10.1007/s00439-004-1163-1View ArticlePubMedGoogle Scholar
  42. Gunduz E, Gunduz M, Ali MA, Beder L, Tamamura R, Katase N, Tominaga S, Yamanaka N, Shimizu K, Nagatsuka H: Loss of heterozygosity at the 9p21–24 region and identification of BRM as a candidate tumor suppressor gene in head and neck squamous cell carcinoma. Cancer Investigation 2009, 27(6):661–668. 10.1080/07357900802563010View ArticlePubMedGoogle Scholar
  43. Huggins R, Li LH, Lin YC, Yu AL, Yang HC: Nonparametric estimation of LOH using Affymetrix SNP genotyping arrays for unpaired samples. Journal of Human Genetics 2008, 53(11–12):983–990. 10.1007/s10038-008-0340-9View ArticlePubMedGoogle Scholar
  44. Kurashina K, Yamashita Y, Ueno T, Koinuma K, Ohashi J, Horie H, Miyakura Y, Hamada T, Haruta H, Hatanaka H, et al.: Chromosome copy number analysis in screening for prognosis-related genomic regions in colorectal carcinoma. Cancer Science 2008, 99(9):1835–1840. 10.1111/j.1349-7006.2008.00881.xView ArticlePubMedGoogle Scholar
  45. Blauw HM, Veldink JH, van Es MA, van Vught PW, Saris CG, van der Zwaag B, Franke L, Burbach JPH, Wokke JH, Ophoff RA, et al.: Copy-number variation in sporadic amyotrophic lateral scleroses: A genome-wide screen. Lancet Neurology 2008, 7(4):319–326. 10.1016/S1474-4422(08)70048-6View ArticlePubMedGoogle Scholar
  46. Huang J, Wei W, Zhang J, Liu G, Bignell GR, Stratton MR, Futreal PA, Wooster R, Jones KW, Shapero MH: Whole genome DNA copy number changes identified by high density oligonucleotide arrays. Human Genomics 2004, 1(4):287–299.PubMed CentralView ArticlePubMedGoogle Scholar
  47. Di XJ, Matsuzaki H, Webster TA, Hubbell E, Liu GY, Dong SL, Bartell D, Huang J, Chiles R, Yang G, et al.: Dynamic model based algorithms for screening and genotyping over 100K SNPs on oligonucleotide microarrays. Bioinformatics 2005, 21(9):1958–1963. 10.1093/bioinformatics/bti275View ArticlePubMedGoogle Scholar
  48. Rabbee N, Speed TP: A genotype calling algorithm for affymetrix SNP arrays. Bioinformatics 2006, 22(1):7–12. 10.1093/bioinformatics/bti741View ArticlePubMedGoogle Scholar
  49. Hua JP, Craig DW, Brun M, Webster J, Zismann V, Tembe W, Joshipura K, Huentelman MJ, Dougherty ER, Stephan DA: SNiPer-HD: Improved genotype calling accuracy by an expectation-maximization algorithm for high-density SNP arrays. Bioinformatics 2007, 23(1):57–63. 10.1093/bioinformatics/btl536View ArticlePubMedGoogle Scholar
  50. Korn JM, Kuruvilla FG, McCarroll SA, Wysoker A, Nemesh J, Cawley S, Hubbell E, Veitch J, Collins PJ, Darvishi K, et al.: Integrated genotype calling and association analysis of SNPs, common copy number polymorphisms and rare CNVs. Nature Genetics 2008, 40(10):1253–1260. 10.1038/ng.237PubMed CentralView ArticlePubMedGoogle Scholar
  51. Laurie CC, Doheny KF, Mirel DB, Pugh EW, Bierut LJ, Bhangale T, Boehm F, Caporaso NE, Cornelis MC, Edenberg HJ, et al.: Quality control and quality assurance in genotypic data for genome-wide association studies. Genet Epidemiol 2010, 34(6):591–602. 10.1002/gepi.20516PubMed CentralView ArticlePubMedGoogle Scholar
  52. Pan WH, Fann CSJ, Wu JY, Hung YT, Ho MS, Tai TH, Chen YJ, Liao CJ, Yang ML, Cheng ATA, et al.: Han Chinese cell and genome bank in Taiwan: Purpose, design and ethical considerations. Human Heredity 2006, 61(1):27–30. 10.1159/000091834View ArticlePubMedGoogle Scholar
  53. Affymetrix Inc: BRLMM: An improved genotype calling method for the GeneChip human mapping 500K array set. 2006.Google Scholar
  54. Yang HC, Liang YJ, Huang MC, Li LH, Lin CH, Wu JY, Chen YT, Fann CSJ: A genome-wide study of preferential amplification/hybridization in microarray-based pooled DNA experiments. Nucleic Acids Research 2006, 34(15):e106. 10.1093/nar/gkl446PubMed CentralView ArticlePubMedGoogle Scholar
  55. Massey FJ: The Kolmogorov-Smirnov test for goodness of fit. Journal of the American Statistical Association 1951, 46(253):68–78. 10.2307/2280095View ArticleGoogle Scholar

Copyright

© Yang et al; licensee BioMed Central Ltd. 2011

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Advertisement