- Methodology article
- Open Access
Robust joint analysis allowing for model uncertainty in two-stage genetic association studies
BMC Bioinformatics volume 12, Article number: 9 (2011)
The cost efficient two-stage design is often used in genome-wide association studies (GWASs) in searching for genetic loci underlying the susceptibility for complex diseases. Replication-based analysis, which considers data from each stage separately, often suffers from loss of efficiency. Joint test that combines data from both stages has been proposed and widely used to improve efficiency. However, existing joint analyses are based on test statistics derived under an assumed genetic model, and thus might not have robust performance when the assumed genetic model is not appropriate.
In this paper, we propose joint analyses based on two robust tests, MERT and MAX3, for GWASs under a two-stage design. We developed computationally efficient procedures and formulas for significant level evaluation and power calculation. The performances of the proposed approaches are investigated through the extensive simulation studies and a real example. Numerical results show that the joint analysis based on the MAX3 test statistic has the best overall performance.
MAX3 joint analysis is the most robust procedure among the considered joint analyses, and we recommend using it in a two-stage genome-wide association study.
The two-stage design is often adopted in genome-wide association studies (GWASs) to search for genetic variants underlying susceptibility for complex diseases. The advantages of the two-stage design have been investigated extensively (see e.g., [1–12]). In a typical two-stage design for GWASs, a proportion of the available samples are genotyped at the initial stage on a large number of single nucleotide polymorphisms (SNPs) using a commercial genotyping platform. Based on association test results obtained at this stage, a small percentage of SNPs are selected and further genotyped on the remaining samples in the second stage. To analyze data generated from such a two-stage design, the joint analysis strategy has been recommended, which combines the test statistics from both stages as the final test statistic, and is shown to be more powerful than the replication-based analysis that only utilizes the second stage data .
The efficiency of joint analysis based on the allele-frequency-difference-based test (AFDT) was evaluated in detail in comparison to the replication-based analysis . It is commonly adopted as a single marker test in GWASs. The AFDT is valid when Hardy-Weinberg equilibrium (HWE) holds in the target population, and is powerful when the underlying genetic models are additive or multiplicative. The Cochran-Armitage trend test (CATT) [13, 14] derived under the additive (in log scale) genetic risk model is also used in single-maker analysis, which is optimal when the underlying additive genetic model is true. However, both tests are not so powerful compared with other methods such as MAX3  when the underlying genetic model is not additive. Since in most cases there is no evidence suggesting that the additive risk model is most appropriate for the underlying disease model, especially in the typical GWASs where we most likely evaluate only the tagging SNPs, but not the causal SNPs directly. Thus, it is advantageous to adopt a more robust single marker test that has a relatively good performance under all possible disease models. To this end, two types of such robust tests, the MERT (maximin efficiency robust test) [15, 16] and MAX3 (the maximum values of CATTs under recessive, additive and dominant models) have been recently considered [15, 17]. Nevertheless, their performances under the two-stage design have not been thoroughly investigated.
In this report we propose two types of joint test statistics for the two-stage design based on the two robust tests, MERT and MAX3. We derive closed-form formula to calculate the power of the MERT-based joint analysis, and propose a computationally efficient Monte Carlo procedure to evaluate the significance level of the MAX3-based joint analysis. Facilitated by these two procedures, we evaluate the performances of the two robust test based joint analyses, in comparison with the ones based on AFDT, under various two-stage design setups and disease models.
Suppose that r cases and s controls are randomly sampled from the source population in a GWAS. Denote the number of SNPs genotyped and the proportion of the subjects in Stage 1 by m and π, respectively. Throughout, we only consider biallelic SNPs with two alleles G and g, with G being the risk allele. Then there are three genotypes: gg, Gg, and GG. Using the disease risk at gg as the baseline, we define the relative risks of Gg and GG as λ1 = f1/f0 and λ2 = f2/f0, respectively, where f0 = Pr(case|gg) > 0, f1 = Pr(case|Gg), f2 = Pr(case|GG) are the penetrances. Let K = Pr(case) be the disease prevalence. Denote the genotype frequencies in case population as p0 = Pr(gg|case) = Pr(gg)f0/K, p1 = Pr(Gg|case) = Pr(Gg)f1/K, p2 = Pr(GG|case) = Pr(GG)f2/K and in control population as q0 = Pr(gg|control) = Pr(gg)(1-f0)/(1-K), q1 = Pr(Gg|control) = Pr(Gg)(1-f1)/(1-K), q2 = Pr(GG|control) = Pr(GG)(1-f2)/(1-K). Then the null hypothesis of no association is H0 : p i = q i , i = 0, 1, 2, which is equivalent to H0 : λ1 = λ2 = 1. The alternative hypothesis is H1 : λ2 ≥ λ1 ≥ 1 with λ2 > 1. The commonly used three genetic models, recessive, additive and dominant models are corresponding to λ2 >λ1 = 1, 2λ1 = λ2 +1 and λ1 = λ2 > 1, respectively. We assume that SNPs with p-values less than γ in Stage 1 will be further investigated in Stage 2 and α be the whole genome-wide type I error.
The notations for genotype frequencies in case population and control population of Stage 1 and Stage 2 are given in Table 1. It should be noted that p1i= p2iand q1i= q2ifor i = 0, 1, 2 in the table using the first subscript on behalf of Stage 1 or Stage 2 since they are the population parameters. However, the estimates of p1iand q1ifor i = 0, 1, 2 based on the data of Stage 1 and those of p2iand q2ifor i = 0, 1, 2 based on the data of Stage 2 might be different although the data of Stage 1 and Stage 2 are drawn from the same source population.
Allele-Frequency-Difference-Based Joint Analysis
Denote the risk allele frequencies in case population and control population by θ and ϖ, respectively. Let and be their maximum likelihood estimates in Stage 1, respectively. Then the test statistic for Stage 1 is
The threshold for selecting SNPs in Stage 1 is b1 = Φ-1(1-γ/2), where Φ(·) is the cumulative standard normal distribution function. Similarly, we can get the maximum likelihood estimates of the risk allele frequencies in case population and control population using the data from Stage 2, denoted by and . Then the test statistic for Stage 2 can be written as
The joint statistic is . The Bonferroni correction threshold (b J ) for Z J is the solution of the equation ,
where , . So the power of the joint test under the alternative hypothesis is given by , where , with , , , and .
The above approach is slightly different from the one considered in , where the authors constructed the test statistics by estimating the variance of the differences of allele frequency between case population and control population using the cases and controls separately under the null hypothesis. In our joint analysis, we estimated the variance using the combined data of case sample and control sample. Results (not show here) show that the two approaches have very similar performance.
Cochran-Armitage Trend Test under the Additive Model-Based Joint Analysis
Cochran-Armitage trend test under the additive model (CATTA) (see e.g., [13, 15]) is often used in the genetic association studies including GWASs. Denote CATTA for both stages by and , respectively. Then the threshold for selecting SNPs in Stage 1 is d1 = Φ-1(1-γ/2). The joint test statistic is . The threshold (d J ) for can be obtained by solving the equation . The power of the joint analysis is , which can be calculated again using the R package "mvtnorm". The joint distributions of under the null and alternative hypotheses are given in Appendix A in Additional file 1.
MERT-Based Joint Analysis
MERT was originally proposed in  to find robust test statistic in situations when multiple alternative models are plausible. It was used to define a robust test for single-marker analysis . Here we apply the test to two-stage design. Similar to and , we can obtain CATTs and under the recessive model and CATTs and under the dominant model for both stages. So MERT for both stages are and , respectively, where and are the correlation coefficients of and , and and under the null hypothesis, respectively, which are shown in Appendix B in Additional file 1. The joint analysis based on MERT can be defined as . The threshold for selecting SNPs in Stage 1 is u1 = Φ-1(1-γ/2). To control the false positive rate of the joint analysis, we can obtain the threshold u J , which is the solution to the equation
The power of the test is given by , whose numerical values can be calculated using the R package "mvtnorm". The joint distributions of under the null and alternative hypotheses are derived in Appendix B in Additional file 1.
MAX3-Based Joint Analysis
MAX3, the maximal value of CATT under three genetic models, is another commonly used robust test in the current GWASs (see e.g., [7, 15, 17]). Once we have and , the test statistic in Stage 1 is and the joint analysis based on MAX3 can be defined as , where , , and . For a given significance level γ in Stage 1, the threshold (v1) can be obtained by solving the equation .
According to Chapter 6 of , we have , where and , with and given in Appendix C in Additional file 1. Because , we can obtain v1 using the R package "mvtnorm". After that, we use the following computationally efficient algorithm to approximate the threshold (v J ) for the joint analysis:
Generate B identical and independently distributed bivariate normal random variates . Then calculate , and for i = 1, 2, ⋯, B. Without loss of generality, we assume for i = 1, 2, ⋯, B 1 and for i = B 1 + 1, B 1 + 2, ⋯. B.
Generate B 1 identical and independently distributed bivariate normal random variates . Then calculate , and , with and given in Appendix C in Additional file 1. For i = 1, 2, ⋯, B 1, calculate
Find v J that yields with and .
Once we have v1 and v J , we generate the data under the alternative hypothesis to calculate the power empirically. In the simulation studies, we generate 10,000 data sets under the alternative hypothesis. For the ith data set (i = 1, 2. ⋯, 10000), we calculate and , denote them again by and , respectively. Then the empirical power is .
In order to mimic the real GWAS, we choose the simulation parameters similar to [12, 22]. In a typical GWAS, there are thousands of individuals randomly chosen from the source population and the number of SNPs being examined in Stage 1 is usually from 0.1 million to 1 million. Based on the results of Stage 1 (p-values), the number of SNPs to be genotyped in Stage 2 is in tens or hundreds. For example, in a diabetes mellitus GWAS , there were 392,935 SNPs genotyped on 1,363 subjects in Stage 1, and 57 SNPs were genotyped in Stage 2 after removing those SNPs with p-values greater than 0.0001 based on the data of Stage 1. In a GWAS, the significance level in the whole genome is often set to be 0.05, and the Bonferroni-correction is often used to adjust for multiple comparisons and to control the false positive rate. So, in our simulation studies, we set the number of SNPs at Stage 1 m = 500,000 and the p-value threshold for significant SNPs to be 0.05/m = 1 ×10-7. The proportion of subjects genotyped in Stage 1 is set to be 0.5, 0.4 and 0.3, and the p-value threshold for SNPs selection at the end of Stage 1 be 0.0001 and 0.0002. The disease prevalence is set to be K = 0.1. Throughout our simulation procedures, we assume that Hardy-Weinberg equilibrium (HWE) holds in the general population. Furthermore, the risk allele is assumed to be the minor allele, with frequency (MAF) equal to 0.15, 0.25, 0.35 and 0.45. The considered genetic models are the recessive, additive, and dominant models. We specified different genotype relative risks λ1 and λ2 for the three genetic models (see details in Table 2, 3, 4 and 5). The critical values for MAX3 joint analysis are simulated, while thresholds for other three joint analysis are exactly calculated based on their asymptotic distributions under the null hypothesis where the genotype probabilities (p0, p1, p2) for cases and (q0, q1, q2) for controls are calculated by p0 = q0 = Pr(gg) = (1-MAF)2, p1 = q1 = Pr(Gg) = 2 × MAF ×(1-MAF) and p2 = q2 = Pr(GG) = MAF2. Under the alternative hypothesis, the genotype frequencies can be obtained using the formulas given in the Notations Subsection and f0 = K/[Pr(gg) + λ1 Pr(Gg) + λ2 Pr(GG)]. More details could be referred to  and . The genotype counts in case sample and control sample were generated from a multinomial distribution.
For convenience, we refer to the aforementioned four joint analysis approaches as, respectively, ALLEJ (allele-frequency-difference-based joint analysis), CATAJ (Cochran-Armitage trend test under the additive model-based joint analysis), MERTJ (MERT-based joint analysis), MAX3J (MAX3-based joint analysis). Table 2, 3, 4 and 5 report powers of the four joint analysis methods corresponding to MAF equal to 0.15, 0.25, 0.35 and 0.45, respectively. From these tables, we have the following observations. Under the recessive model, MERTJ and MAX3J are more powerful than ALLEJ and CATAJ, with MAX3J being most powerful among the four methods under consideration. In some cases, the advantage of MAX3J is quite impressive. For example, in Table 2, with π = 0.5, γ = 0.0001, the powers of ALLEJ, CATAJ, MERTJ and MAX3J are 0.070, 0.058, 0.385 and 0.759, respectively. Under the additive model, CATAJ and ALLEJ have comparable power and are more powerful than the other two tests. However, the power difference between CATAJ and MAX3J is mostly at the level of 6.6%, with the largest discrepancy of 7%. Under the dominant model, CATAJ and MAX3J are more powerful than ALLEJ and MERTJ. Both tests have comparable power when MAF = 0.15, and MAX3J is much more powerful than CATAJ when MAF = 0.25, 0.35 and 0.45. In summary, it appears that MAX3J has the best overall performance.
A Real Example: Type 2 Diabetes Mellitus
Type 2 diabetes mellitus is one of the most common diseases, and has been found to be associated with environmental factors and genetic variants. A two-stage GWAS for type 2 diabetes mellitus was reported in . In this study, 392,935 SNPs were genotyped on 1,363 subjects in Stage 1. Based on the statistical significance level of 1 × 10-4, 57 SNPs were selected and further screened on 2,617 cases and 2,894 controls in Stage 2. We applied the above four considered methods to two SNPs, rs1005316 and rs2876711, which were not reported in their Table 1, but were shown in their Appendix. Table 6 gives the genotype counts and p-values of these two SNPs. We found a genome-wide significant association between rs2876711 and the outcome. Although the association between rs2876711 and type 2 diabetes mellitus has not been reported by , our results show that we should be concerned with this SNP and its neighborhood area. Additional experiments should be further conducted to validate this association.
Discussion and Conclusions
In genetic association studies, the underlying genetic inheritance model is often unknown, and thus hinders the use of methods such as CATT, which has to be derived under an assumed genetic model. Robust tests, such as MERT and MAX3, had been proposed to relax the dependence on the underlying genetic models. Extending these tests to a two-stage setting, we construct two robust joint analyses based on MERT and MAX3. Numerical results show that MAX3J has the best overall performance among the four considered joint analysis approaches. For type 2 diabetes mellitus, based on MAX3J, we found that SNP rs2876711 was significantly associated with type 2 diabetes mellitus besides their findings.
Pearson Chi-square test is a robust test that was used in genetic association studies (see e.g., ). Recently, a comprehensive power comparison between MAX3 and Pearson Chi-square test and Cochran-Armitage trend test under the additive model was conducted in . They reported that MAX3 has the most robust performances. The proposed joint analysis combing the test statistics of both stages considers the between-stage heterogeneity. It is intractable for Pearson Chi-square test to consider the relative risk heterogeneity of both stages, especially when the relative risk in Stage 1 is larger than one and that in Stage 2 is less than one.
Recently, a joint analysis based on genetic model selection  to overcome the genetic model uncertainty was proposed in . Based on the data in Stage 1, they used Hardy-Weinberg disequilibrium trend test studied in  to determine a score that corresponds to a genetic model. This score was then used to construct the trend test based on the data of Stage 2. Results (not shown here) show that the proposed joint analysis has comparable power. Therefore, the proposed MAX3J can be used as an alternative procedure in two-stage genome-wide association studies.
genome-wide association study
single nucleotide polymorphism
minor allele frequency
Cochran-Armitage trend test
maximin efficiency robust test
maximum values of Cochran-Armitage trend tests under recessive, additive and dominant models
allele-frequency-difference-based joint analysis
Cochran-Armitage trend test under the additive model-based joint analysis
MERT-based joint analysis
MAX3-based joint analysis.
Zuo YJ, Zou GH, Zhao HY: Two-stage designs in case-control association analysis. Genetics 2006, 173: 1747–1760. 10.1534/genetics.105.042648
Goll A, Bauer P: Two-stage designs applying methods differing in costs. Bioinformatics 2007, 23: 1519–1526. 10.1093/bioinformatics/btm140
Muller HH, Pahl R, Schafer H: Including sampling and phenotyping costs into the optimization of two-stage designs for genome-wide association studies. Genetic Epidemiology 2007, 31: 844–852. 10.1002/gepi.20245
Satagopan JM, Elston RC: Optimal two-stage genotyping in population-based association studies. Genetic Epidemiology 2003, 25: 149–157. 10.1002/gepi.10260
Satagopan JM, Venkatraman ES, Begg CB: Two-stage designs for gene-disease association studies with sample size constraints. Biometrics 2004, 60: 589–597. 10.1111/j.0006-341X.2004.00207.x
Skol AD, Scott LJ, Abecasis GR, Boehnke M: Optimal designs for two-stage genome-wide association studies. Genetic Epidemiology 2007, 31: 776–788. 10.1002/gepi.20240
Sladek R, Rocheleau G, Rung J, Dina C, Shen L, Serre D, Boutin P, Vincent D, Belisle A, Hadjadj S, Balkau B, Heude B, Charpentier G, Hudson TJ, Montpetit A, Pshezhetsky AV, Prentki M, Posner BI, Balding DJ, Meyre D, Polychronakos C, Froguel P: A genome-wide association study identifies novel risk loci for type 2 diabetes. Nature 2007, 445: 881–885. 10.1038/nature05616
Thomas D, Xie R, Gebregziabher M: Two-stage sampling designs for gene association studies. Genetic Epidemiology 2004, 27: 401–414. 10.1002/gepi.20047
Wang H, Thomas DC, Pe'er I, Stram DO: Optimal two-stage designs for genome-wide association scans. Genetic Epidemiology 2006, 30: 356–368. 10.1002/gepi.20150
Yu K, Chatterjee N, Wheeler W, Li Q, Wang S, Rothman N, Wacholder S: Flexible design for following up positive findings. American Journal of Human Genetics 2007, 81: 540–551. 10.1086/520678
Zheng G, Meyer M, Li W, Yang Y: Comparison of two-phase analyses for case-control genetic association studies. Statistics in Medicine 2008, 27: 5054–5075. 10.1002/sim.3336
Skol AD, Scott LJ, Abecasis GR, Boehnke M: Joint analysis is more efficient than replication-based analysis for two-stage genome-wide association studies. Nature Genetics 2006, 38: 209–213. 10.1038/ng1706
Sasieni PD: From genotypes to genes: Doubling the sample size. Biometrics 1997, 53: 1253–1261. 10.2307/2533494
Zheng G, Gastwirth JL: On estimation of the variance in Cochran-Armitage trend tests for genetic association using case-control studies. Statistics in Medicine 2006, 25: 3150–3159. 10.1002/sim.2250
Zheng G, Friedlin B, Gastwirth JL: Comparison of robust tests for genetic association using case-control studies. In Optimality: The Second Erich L. Lehmann Symposium. Edited by: Rojo J. Beachwood: Institute of Mathematical Statistics; 2006:253–265. [DasGupta A (Series Editor): Lecture Notes-Monograph Series, vol 49.] [DasGupta A (Series Editor): Lecture Notes-Monograph Series, vol 49.]
Gastwirth JL: The use of maximin efficiency robust tests in combining contingency tables and survival analysis. Journal of the American Statistical Association 1985, 80: 380–384. 10.2307/2287901
Li Q, Zheng G, Liang X, Yu K: Robust tests for single-marker analysis in case-control genetic association studies. Annals of Human Genetics 2009, 73: 245–252. 10.1111/j.1469-1809.2009.00506.x
Genz A: Numerical computation of multivariate normal probabilities. Journal of Computational and Graphical Statistics 1992, 1: 141–150. 10.2307/1390838
Genz A: Comparison of methods for the computation of multivariate normal probabilities. Computing Science and Statistics 1993, 25: 400–405.
Tong YL: The multivariate normal distribution. New York: Springer-Verlag; 1990.
Zheng G, Yang Y, Zhu X, Elston RC: Case-control studies of genetic association. New York: Springer; 2010.
Kwak M, Joo J, Zheng G: A robust test for two-stage design in genome-wide association studies. Biometrics 2009, 65: 1288–1295. 10.1111/j.1541-0420.2008.01187.x
Schaid DJ, Sommer SS: Genotype relative risks: methods for design and analysis of candidate-gene association studies. American Journal of Human Genetics 1993, 53: 1114–1126.
Terwilliger JD, Ott J: Handbook of human genetic linkage. Baltimore: Johns Hopkins University Press; 1994.
Yeager M, Orr N, Hayes RB, Jacobs KB, Kraft P, Wacholder S, Minichiello MJ, Fearnhead P, Yu K, Chatterjee N, Wang Z, Welch R, Staats BJ, Calle EE, Feigelson HS, Thun MJ, Rodriguez C, Albanes D, Virtamo J, Weinstein S, Schumacher FR, Giovannucci E, Willett WC, Cancel-Tassin G, Cussenot O, Valeri A, Andriole GL, Gelmann EP, Tucker M, Gerhard DS, Fraumeni JF Jr, Hoover R, Hunter DJ, Chanock SJ, Thomas G: Genome-wide association study of prostate cancer identifies a second risk locus at 8q24. Nature Genetics 2007, 39: 645–649. 10.1038/ng2022
Zheng G, Ng HKT: Genetic model selection in two-phase analysis for case control association studies. Biostatistics 2008, 9: 391–399. 10.1093/biostatistics/kxm039
Song K, Elson RC: A powerful method of combining measures of association and Hardy-Weinberg disequilibrium for fine-mapping in case-control studies. Statistics in Medicine 2006, 25: 105–126. 10.1002/sim.2350
We would like to thank the editor and three anonymous reviewers for their very constructive comments and suggestions, which significantly improved our presentation. This work is partially support by the National Young Science Foundation of China, No. 10901155.
PD and LQ implemented the model. All authors read and approved the final manuscript.
Electronic supplementary material
Additional file 1:. The file (including Appendix A, B, C) is a Microsoft Word document. Appendix A gives a detailed description of the joint distribution of the additive trend test statistic in Stage 1 and the joint additive trend test statistic . Appendix B gives a detailed description of the correlation coefficient between the recessive trend test statistic and the dominant trend test statistic under the null hypothesis, and the joint distribution of and . Appendix C gives a detailed description of the correlation coefficient between the recessive trend test statistic and the additive trend test statistic, and the correlation coefficient between the additive trend test statistic and the dominant trend test statistic. (DOC 190 KB)
About this article
Cite this article
Pan, D., Li, Q., Jiang, N. et al. Robust joint analysis allowing for model uncertainty in two-stage genetic association studies. BMC Bioinformatics 12, 9 (2011). https://doi.org/10.1186/1471-2105-12-9
- Genetic Model
- Joint Analysis
- Genetic Association Study
- Robust Test
- Risk Allele Frequency