Effects of normalization on quantitative traits in association test
- Liang Goh^{1}Email author and
- Von Bing Yap^{2}
DOI: 10.1186/1471-2105-10-415
© Goh and Yap; licensee BioMed Central Ltd. 2009
Received: 29 June 2009
Accepted: 14 December 2009
Published: 14 December 2009
Abstract
Background
Quantitative trait loci analysis assumes that the trait is normally distributed. In reality, this is often not observed and one strategy is to transform the trait. However, it is not clear how much normality is required and which transformation works best in association studies.
Results
We performed simulations on four types of common quantitative traits to evaluate the effects of normalization using the logarithm, Box-Cox, and rank-based transformations. The impact of sample size and genetic effects on normalization is also investigated. Our results show that rank-based transformation gives generally the best and consistent performance in identifying the causal polymorphism and ranking it highly in association tests, with a slight increase in false positive rate.
Conclusion
For small sample size or genetic effects, the improvement in sensitivity for rank transformation outweighs the slight increase in false positive rate. However, for large sample size and genetic effects, normalization may not be necessary since the increase in sensitivity is relatively modest.
Background
Genome-wide association (GWA) studies have been used to identify over 200 potential causal loci in complex diseases such as metabolic/cardiovascular disorder, autoimmune disorder, and cancer [1–6]. The approach requires a stringent adherence to quality control, statistical analyses and replication studies [7]. In quantitative trait loci (QTL) analysis, there is an implicit assumption that the phenotype data follow a normal distribution. Violation of this assumption can severely affect the power and type I error [8].
In most cases, quantitative traits are not normally distributed and one strategy is to perform parametric transformation to approximate normality. In cases where the traits are left-skewed, the appropriate transformation may not be so straight-forward. Transformation is crucial for meta-analyses, where two or more populations are combined to improve statistical power. Preferably, the traits are transformed similarly to enable comparison of genetic effects. This may prove challenging when the traits from different populations are not similarly distributed and cannot be transformed in the same manner. Literature search in this area shows evaluation of normalization methods in pedigree studies [9–11], looking at the logarithm, power, and rank-based transformations, and giving mixed results. In Labbe and Wormald [10], Box-Cox and log were compared and Box-Cox was found to perform better. Peng et al [11] evaluated ENQT, a rank-based transformation in variance components and semi-parametric QTL models, showing ENQT improved power. For Diao and Lin [9], the question was not which normalization worked best but whether the semi-parametric QTL performed better than the variance-components models in terms of power and type I error, as well as robustness to outliers when the assumption of normality does not hold. Nevertheless, Diao and Lin's simulations showed that estimated and true transformations (i.e. which restored normality) gave higher power and lower Type I error for likelihood-ratio tests compared to the logarithm, the square-root (a special case of Box-Cox) and untransformed data.
In the absence of comprehensive study on various transformation methods for association studies, it is difficult to decide which transformation to apply. How much normality will suffice for the underlying assumption of association tests? In the context of sample size and genetic effects, what are the effects of these methods? Although it is generally accepted that deviation from normality can reduce the power of the study, the effects of different normalization methods are not clearly understood.
In this paper, we report the effects of these normalization methods in basic quantitative association tests on simulated data. Our objective was to quantify the effects of normalization in GWA studies. Since a large sample is needed to detect small effects, we also evaluated the effects of normalization on varying sample sizes and genetics effects. For simplicity, we limit our study on additive models. We also approached the evaluation by emulating GWA studies, measuring performance of the normalization based on the sensitivity of discovering causal single nucleotide polymorphism (SNP) and its respective ranking in association tests after Bonferroni corrections.
Results
Performance of simulations with PV = 0.01 (small effects) for 4 sample sizes and 4 quantitative traits (normal, left-skew, right-skew, bimodal) transformed using logarithm (log), inverse-logarithm (ilog), Box-Cox, and rank-based.
True Positive Rate | False Positive Rate | Displacement | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
1000 | 2000 | 4000 | 8000 | 1000 | 2000 | 4000 | 8000 | 1000 | 2000 | 4000 | 8000 | |
Normal | 4.27 | 18.26 | 43.59 | 50.86 | 0.03 | 0.11 | 0.10 | 0.21 | 24.03 | 17.11 | 15.06 | 10.04 |
Left-skew | 5.98 | 18.26 | 47.86 | 53.45 | 0.09 | 0.07 | 0.16 | 0.17 | 23.45 | 15.25 | 14.24 | 9.01 |
Right-skew | 3.42 | 20.00 | 41.88 | 51.72 | 0.04 | 0.11 | 0.10 | 0.22 | 24.16 | 17.57 | 15.15 | 10.28 |
Bimodal | 2.56 | 10.43 | 35.04 | 44.83 | 0.03 | 0.09 | 0.09 | 0.17 | 26.32 | 19.16 | 16.14 | 11.31 |
Normal - Log | 5.98 | 18.26 | 47.86 | 53.45 | 0.09 | 0.07 | 0.16 | 0.17 | 23.45 | 15.25 | 14.24 | 9.01 |
Normal - ilog | 7.69 | 27.83 | 50.43 | 57.76 | 0.17 | 0.21 | 0.18 | 0.37 | 21.91 | 15.87 | 13.51 | 9.55 |
Normal - boxcox | 5.13 | 18.26 | 44.44 | 50.86 | 0.04 | 0.10 | 0.12 | 0.20 | 23.73 | 16.87 | 14.81 | 10.02 |
Normal - rank | 14.53 | 36.52 | 57.27 | 65.52 | 0.08 | 0.17 | 0.24 | 0.44 | 18.97 | 12.50 | 11.65 | 6.65 |
Left-skew - log | 7.69 | 22.61 | 50.43 | 56.03 | 0.10 | 0.07 | 0.22 | 0.20 | 23.08 | 14.50 | 13.44 | 8.16 |
Left-skew - ilog | 5.13 | 19.13 | 45.3 | 54.31 | 0.05 | 0.09 | 0.15 | 0.19 | 23.46 | 16.08 | 14.43 | 9.58 |
Left-skew - boxcox | 5.13 | 18.26 | 43.59 | 50.00 | 0.05 | 0.08 | 0.11 | 0.17 | 23.97 | 16.87 | 14.71 | 10.06 |
Left-skew - rank | 14.53 | 36.52 | 57.27 | 65.52 | 0.08 | 0.17 | 0.24 | 0.44 | 18.97 | 12.50 | 11.65 | 6.65 |
Right-skew - log | 5.13 | 16.52 | 41.88 | 49.14 | 0.04 | 0.08 | 0.12 | 0.17 | 23.99 | 17.09 | 14.83 | 10.21 |
Right-skew - ilog | 3.42 | 22.61 | 43.59 | 51.72 | 0.05 | 0.11 | 0.10 | 0.23 | 23.98 | 17.63 | 15.17 | 10.41 |
Right-skew - boxcox | 4.27 | 16.52 | 41.88 | 50.86 | 0.03 | 0.09 | 0.10 | 0.21 | 24.2 | 17.23 | 15.11 | 10.13 |
Right-skew - rank | 14.53 | 36.52 | 57.27 | 65.52 | 0.08 | 0.17 | 0.24 | 0.44 | 18.97 | 12.50 | 11.65 | 6.65 |
Bimodal - log | 4.27 | 13.91 | 41.88 | 47.41 | 0.08 | 0.05 | 0.13 | 0.15 | 25.32 | 16.84 | 14.91 | 10.35 |
Bimodal - ilog | 2.56 | 11.30 | 35.90 | 45.69 | 0.04 | 0.10 | 0.08 | 0.19 | 26.25 | 19.35 | 16.26 | 11.35 |
Bimodal - boxcox | 2.56 | 12.17 | 36.75 | 44.83 | 0.04 | 0.08 | 0.08 | 0.17 | 25.71 | 18.07 | 15.48 | 10.8 |
Bimodal - rank | 14.53 | 36.52 | 57.27 | 65.52 | 0.08 | 0.17 | 0.24 | 0.44 | 18.97 | 12.50 | 11.65 | 6.65 |
Discussion
A GWA study is an expensive venture which requires careful design and quality control. One such consideration is normalization. Our simulation indicated that in studies where the effects and sample size were large; transformation had little effect. Performance issues arise when the genetic effect was less than moderate and sample size was not large. In this case, the type of normalization became a serious consideration with impacts on results.
The results showed that larger PV (more genetic effects) and samples size generally gave higher sensitivity and smaller displacement with a slight increase in false positive rate. When PV varied from 0.01 to 0.2, untransformed normal distribution showed sensitivity of 4.27% to 50.86% (PV = 0.01), 13.27% to 64.96% (PV = 0.02), and 71.79% to 97.44% (PV = 0.2) for 1000 to 8000 samples (see Table 1 and Additional file 1). When the phenotype was rank transformed, the sensitivity ranged from 14.53% to 65.52% (PV = 0.01), 27.43% to 76.07% (PV = 0.02) and 75.21% to 100% (PV = 0.2) respectively. This is in concordance with literature; with larger sample size and genetic effects, the causal SNP is more likely to be discovered. It also showed improved results with rank-based transformation for all phenotypes, though the amount of improvement depends on sample size and PV. The improvement factor for sensitivity (i.e. sensitivity_{rank-based}/sensitivity_{untransformed}) varied from 2.43 to 5.67 (1000 samples), 1.83 to 3.50 (2000 samples), 1.2 to 1.63 (4000 samples), 1.23 to 1.46 (8000 samples) for PV = 0.01. For PV = 0.2, the improvement factor ranged from 1.04 to 1.11 (1000 samples), 1.02 to 1.11 (2000 samples), 1.07 to 1.17 (4000 samples), and 1.03 to 1.06 (8000 samples). The improvement factor tended towards 1 for PV = 0.2, indicating that for larger genetic effects, transformation was not so critical (the sensitivity improved marginally but with a higher false positive). This trend was also observed in the case of larger sample size regardless of the distribution of original traits.
Displacement of causal SNP decreased with increasing sample size and PV. For PV = 0.01 and 1000 samples of the untransformed trait, the causal SNP was ranked on average 24.03 out of 100. This improved to 18.81 (PV = 0.02) and 5.03 (PV = 0.2). With rank-based transformation, the displacement improved: 18.97 (PV = 0.01), 16.38 (PV = 0.02), and 4.78 (PV = 0.2).
False positive rate is a concern in GWA studies. In our study, the false positive rate increased with PV and sample size. The simulation showed that rank-based transformation incurred a slightly higher false positive compared with the other methods. We recognize that the false positive rate computed here was subjective, depending on the 99 non-causal SNPs in simulated data. Nevertheless, it gave an indication of false positives amongst the different settings in simulations; i.e. traits distribution, sample size, and genetic effects. Does this mean that rank transformation has no benefits? For small sample size and genetic effects, the increase of sensitivity outweighs the slight increase in false positive rate. For large sample size and genetic effects, this is not true so caution is needed on transformation. We propose no transformation in this scenario.
It was noted in Figure 1 that the normally distributed trait did not follow a perfect normal distribution. In transformation such as log or beta, as long as the original trait followed a normal-like distribution, each trait would transform accordingly to left-skew, right-skew, or bimodal as intended. As for the effects of normality of the original trait on results, we observed that generally the original normal distribution did not perform as well as the rank transformation, suggesting that a 'perfect' normal distribution was desirable at least for small sample size and genetic effects.
In the simulations, Box-Cox sometimes achieved a normal distribution (Figure 2) though not perfectly normal like the rank-based transformation. However, its performance was still not comparable with the latter. In addition, it was observed that although some distribution appeared normal, rank-based transformation could still improve sensitivity. This is interesting as it suggests that it is not just sufficient to attain some form of normality for quantitative traits but to achieve a normality that increases the additive discriminating signals. Transformation should also be considered in the context of sample size and genetic effects. In large sample size and more than moderate effects, it may not be necessary to transform, thus maintaining a lower false positive with comparable sensitivity and displacement. For conditions other than this, rank-based transformation tends to improve the performance regardless of the distribution.
In our literature review, the traits were usually generated as non-normally distributed trait and not well defined traits such as those in our study (left-skew, right-skew, bimodal) where we could assess the effects of transformation on different distributions. This arises from the difficulty of generating quantitative traits to meet these distributions using genotype, especially using real genotype data. In Peng et al (2007), the normal trait was transformed to meet certain skewness and kurtosis for their evaluation. We adopted the same idea in our simulation by transforming the trait after genotype has been generated. This approach has the advantage of allowing us to use existing genotype data (simulated or actual) to study effects of different trait distributions.
Conclusions
The four quantitative traits investigated here are common distributions described by several statistical empirical distributions. Simulations were done on common factors affecting results of GWA study, such as normalization, sample size, and genetic effects. The simulation showed that rank-based transformation gave the best performance in terms of sensitivity and displacement regardless of the distribution of the trait. This is however accompanied by a slight increase in false positive rate. The positive effect of rank-based transformation decreased with increasing sample size and genetic effects. For large sample size and genetic effects, normalization is not recommended.
Methods
The normalization methods investigated were: logarithm, Box-Cox, inverse-logarithm (i.e. log [-[x_{ i }-min(x)]] where x_{ i }is the quantitative trait for sample i), and rank-based transformation [11]. Ranking of SNPs and its p-value from associative tests after multiple test corrections were used for performance assessment. Motivation for the inverse-logarithm transformation came from one of our quantitative traits where the data contained negative values and was highly skewed to the left, where neither logarithm nor Box-Cox would normalize it appropriately. All the transformations were provided or coded in Matlab.
Quantitative traits generated by HAPSIMU are normally distributed with mean and standard deviation determined by PV and f. To investigate various trait distributions such as left- and right- skew as well as bimodal, traits were log and beta transformed. Four traits were obtained after HAPSIMU (i.e. normal, left-skew, right-skew, bimodal), and each of these traits was transformed using logarithm, inverse-logarithm, Box-Cox, and rank-based, i.e. total of 20 traits. Quantitative traits were tested using the common GWAS software Plink [13] which implemented the likelihood ratio test and Wald test. It generated an output file with extension .qassoc that comprised of estimated regression coefficient, standard error, and asymptotic p-value. The p-value was used for assessment.
Criteria for performance assessment were based on (1) displacement ranking of causal SNP out of the 100 SNPs, where expected rank was 1 (i.e. displacement is 0), and (2) Bonferroni corrected p-value for significant association was <5 × 10^{-4}. Significant causal SNPs were considered true positives while significant non-causal SNPs were false positives. Sensitivity or True Positive Rate (TPR) was computed for the 120 datasets using TP/(TP+FN)*100 where TP, FN were true positive and false negative respectively from the confusion table tabulated from 120 datasets. False Positive Rate (FPR) or Type I error was computed as FP/(FP+TN)*100 where FP and TN were false positive and true negative from the confusion table. Since there was only one causal SNP, false negative was either 1 or 0 for each simulation, so sensitivity was synonymous with power.
Declarations
Acknowledgements
We are grateful to Ms Elian Chia for running a priori study on the idea. We also thank the Singapore Cohort Study of the Risk Factors for Myopia (SCORM) Genome Wide Association team whom LG works with for highlighting the issues of normalization. LG is supported by the Khoo Discovery Project Award Duke-NUS/KTP/2008/0002.
Authors’ Affiliations
References
- Amos CI, Wu X, Broderick P, Gorlov IP, Gu J, Eisen T, Dong Q, Zhang Q, Gu X, Vijayakrishnan J, Sullivan K, Matakidou A, Wang Y, Mills G, Doheny K, Tsai YY, Chen WV, Shete S, Spitz MR, Houlston RS: Genome-wide association scan of tag SNPs identifies a susceptibility locus for lung cancer at 15q25.1. Nat Genet 2008, 40(5):616–22. 10.1038/ng.109PubMed CentralView ArticlePubMed
- Barrett JC, Hansoul S, Nicolae DL, Cho JH, Duerr RH, Rioux JD, Brant SR, Silverberg MS, Taylor KD, Barmada MM, Bitton A, Dassopoulos T, Datta LW, Green T, Griffiths AM, Kistner EO, Murtha MT, Regueiro MD, Rotter JI, Schumm LP, Steinhart AH, Targan SR, Xavier RJ, NIDDK IBD Genetics Consortium, Libioulle C, Sandor C, Lathrop M, Belaiche J, Dewit O, Gut I, Heath S, Laukens D, Mni M, Rutgeerts P, Van Gossum A, Zelenika D, Franchimont D, Hugot JP, de Vos M, Vermeire S, Louis E, Belgian-French IBD, Consortium; Wellcome Trust Case Control Consortium, Cardon LR, Anderson CA, Drummond H, Nimmo E, Ahmad T, Prescott NJ, Onnie CM, Fisher SA, Marchini J, Ghori J, Bumpstead S, Gwilliam R, Tremelling M, Deloukas P, Mansfield J, Jewell D, Satsangi J, Mathew CG, Parkes M, Georges M, Daly MJ: Genome-wide association defines more than 30 distinct susceptibility loci for Crohn's disease. Nat Genet 2008, 40(8):955–62. 10.1038/ng.175PubMed CentralView ArticlePubMed
- Consortium, T.W.T.C.C.: Genome-wide association study of 14,000 cases of seven common diseases and 3,000 shared controls. Nature 2007, 447(7145):661–78. 10.1038/nature05911View Article
- Di Bernardo MC, Crowther-Swanepoel D, Broderick P, Webb E, Sellick G, Wild R, Sullivan K, Vijayakrishnan J, Wang Y, Pittman AM, Sunter NJ, Hall AG, Dyer MJ, Matutes E, Dearden C, Mainou-Fowler T, Jackson GH, Summerfield G, Harris RJ, Pettitt AR, Hillmen P, Allsup DJ, Bailey JR, Pratt G, Pepper C, Fegan C, Allan JM, Catovsky D, Houlston RS: A genome-wide association study identifies six susceptibility loci for chronic lymphocytic leukemia. Nat Genet 2008, 40(10):1204–10. 10.1038/ng.219View ArticlePubMed
- Frayling TM: Genome-wide association studies provide new insights into type 2 diabetes aetiology. Nat Rev Genet 2007, 8(9):657–62. 10.1038/nrg2178View ArticlePubMed
- Nair RP, Duffin KC, Helms C, Ding J, Stuart PE, Goldgar D, Gudjonsson JE, Li Y, Tejasvi T, Feng BJ, Ruether A, Schreiber S, Weichenthal M, Gladman D, Rahman P, Schrodi SJ, Prahalad S, Guthery SL, Fischer J, Liao W, Kwok PY, Menter A, Lathrop GM, Wise CA, Begovich AB, Voorhees JJ, Elder JT, Krueger GG, Bowcock AM, Abecasis GR, Collaborative Association Study of Psoriasis: Genome-wide scan reveals association of psoriasis with IL-23 and NF-kappaB pathways. Nat Genet 2009, 41(2):199–204. 10.1038/ng.311PubMed CentralView ArticlePubMed
- de Bakker PI, Ferreira MA, Jia X, Neale BM, Raychaudhuri S, Voight BF: Practical aspects of imputation-driven meta-analysis of genome-wide association studies. Hum Mol Genet 2008, 17(R2):R122–8. 10.1093/hmg/ddn288PubMed CentralView ArticlePubMed
- Feingold E: Regression-based quantitative-trait-locus mapping in the 21st century. Am J Hum Genet 2002, 71(2):217–22. 10.1086/341964PubMed CentralView ArticlePubMed
- Diao G, Lin DY: A powerful and robust method for mapping quantitative trait loci in general pedigrees. Am J Hum Genet 2005, 77(1):97–111. 10.1086/431683PubMed CentralView ArticlePubMed
- Labbe A, Wormald H: On normality, ethnicity, and missing values in quantitative trait locus mapping. BMC Genet 2005, 6(Suppl 1):S52. 10.1186/1471-2156-6-S1-S52PubMed CentralView ArticlePubMed
- Peng B, Yu RK, Dehoff KL, Amos CI: Normalizing a large number of quantitative traits using empirical normal quantile transformation. BMC Proc 2007, 1(Suppl 1):S156. 10.1186/1753-6561-1-s1-s156PubMed CentralView ArticlePubMed
- Zhang F, Liu J, Chen J, Deng HW: HAPSIMU: a genetic simulation platform for population-based association studies. BMC Bioinformatics 2008, 9: 331. 10.1186/1471-2105-9-331PubMed CentralView ArticlePubMed
- Purcell S, Neale B, Todd-Brown K, Thomas L, Ferreira MA, Bender D, Maller J, Sklar P, de Bakker PI, Daly MJ, Sham PC: PLINK: a tool set for whole-genome association and population-based linkage analyses. Am J Hum Genet 2007, 81(3):559–75. 10.1086/519795PubMed CentralView ArticlePubMed
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.