Age-adjusted nonparametric detection of differential DNA methylation with case–control designs
© Huang et al.; licensee BioMed Central Ltd. 2013
Received: 13 August 2012
Accepted: 20 February 2013
Published: 6 March 2013
Skip to main content
© Huang et al.; licensee BioMed Central Ltd. 2013
Received: 13 August 2012
Accepted: 20 February 2013
Published: 6 March 2013
DNA methylation profiles differ among disease types and, therefore, can be used in disease diagnosis. In addition, large-scale whole genome DNA methylation data offer tremendous potential in understanding the role of DNA methylation in normal development and function. However, due to the unique feature of the methylation data, powerful and robust statistical methods are very limited in this area.
In this paper, we proposed and examined a new statistical method to detect differentially methylated loci for case control designs that is fully nonparametric and does not depend on any assumption for the underlying distribution of the data. Moreover, the proposed method adjusts for the age effect that has been shown to be highly correlated with DNA methylation profiles. Using simulation studies and a real data application, we have demonstrated the advantages of our method over existing commonly used methods.
Compared to existing methods, our method improved the detection power for differentially methylated loci for case control designs and controlled the type I error well. Its applications are not limited to methylation data; it can be extended to many other case–control studies.
Essential for normal development and an influence on a variety of processes related to DNA integrity and function, DNA methylation plays an important role for epigenetic gene regulation in both development and disease . It is associated with processes including genomic imprinting, X-chromosome inactivation, suppression of repetitive elements, and carcinogenesis [2–4]. Aberrant DNA methylation, such as hypomethylation of oncogenes and hypermethylation of tumor suppressor genes, leads to genomic instability and tumorigenesis [5–10].
With more and more DNA methylation data generated from the high-throughput DNA methylation platforms, powerful and efficient statistical methods to handle these complex data are becoming highly demanded. One of the important research topics in this area is to detect differentially methylated loci in case and control studies. The commonly used methods for this purpose are the Student’s t-test and linear regression. Recently, a number of model-based approaches have been proposed in the literature. Siegmund  introduced a Bernoulli-lognormal mixture model to perform clustering analysis on methylation data generated using MethyLight. Houseman  proposed a β-mixture model to classify different tissue types using a recursive-partitioning algorithm for high-dimensional data from Illumina arrays. Wang  developed a likelihood based uniform-normal-mixture model to select differentially methylated loci between case and control groups using the Illumina array. The basic idea of Wang  is to describe the data using a three-component mixture model and treat completed methylated, unmethylated, and partially methylated loci differently. Wang  showed that, compared to the Student’s t-test under some situations, their method increases detection power . However, the aforementioned methods assume that the methylation profiles follow some special distributions that are known in terms of a finite number of parameters. Obviously if the underlying true distribution is far from the proposed ones, such assumptions will lead to biased results in practice.
Another complexity of the methylation study comes from the presence of other potential confounders such as age effects. As shown in [14–17], age is by far the strongest demographic risk factor for cancer, and there is substantial evidence that aging affects DNA methylation of specific loci, including cancer-related genes. Based on these observations, it is necessary to adjust age effects in the analysis of detecting differentially methylated loci. If the relationship between the methylation and age is more complex than a linear one, a traditional linear regression leads to inaccurate results. To solve this problem, Chen  proposed a method by first dividing the samples into several age groups and then combined the p-values obtained from each individual group together to form a new test. This method has been shown to increase the power in contrast to the traditional t-test without age adjustment or regression model with age adjusted linearly. However, within each group, a p-value is obtained from a simple t-test that is less robust and thus leaves room for improvement.
In this paper, we propose and examine a novel means to detecting differentially methylated loci and, that is, an age-adjusted nonparametric method that can account for age effects, given that substantial evidence exists that aging affects DNA methylation of specific loci, including cancer-related genes. Our method stems from the rank-based nonparametric methods that focus on a comparison of two entire empirical distribution functions rather than only two means. More specifically, we first divide the subjects into several age groups; then for each group, a nonparametric test is performed on each locus, and an individual p-value is reported. An overall p-value for each locus is estimated through combining all the individual p-values computed previously for that locus in different age groups. Our method does not depend on any distribution assumption but rather adjusts for age effects in an efficient way. We demonstrate the powerfulness of our method using both simulated and real datasets.
Where a j and b k are regression coefficients and εijk follows a i.i.d normal distribution. The normality assumption is clearly invalid for the β-values which have limited range between 0 and 1. Moreover, the relationship between the β-value and age is likely to be more complicated than a linear one. Therefore more powerful and robust nonparametric methods are desirable.
Here G i , i = 1,2,…, n 1k and H j ,j = 1,2,…,n 2k are the ranks of the samples from the k th case and control groups, respectively. Due to the intractable asymptotic distribution for the test statistics B, it is hard to find a close form for the relationship between p-value and B. We will use numerical fit to approximate this relationship. We first obtain the empirical distribution of B based on 107 permutations and then fit the distribution function piecewise exponentially to obtain the empirical relationship. The p-value for the k th age group can be calculated according to this empirical formula.
The node points we used here are 1.5 and 9. We find that the choice of node points has very little influence on the final analysis results for both simulated and real data. Note that the sample size we used for deriving this formula is 30. We have also tried some other choices and found that the results are quite similar. Thus, we recommend the above formula to be used in practice for problems with a sample size larger than 10.
Estimated Type I error rates at significant level 0.05 based on the four methods under different parameter settings of the three-component mixture distributions with τ 1 = 0.1, τ 2 = 0.9 and δ μ = 0.05
Estimated powers of the four methods at significant level 0.05 under different parameter settings for the three-component mixture distributions with τ 1 = 0.1, τ 2 = 0.9
δ μ = 0.03
δ μ = 0.05
δ τ = 0.03
δ τ = 0.06
The third settings assume that the β-values for both the case and control subjects follow the beta-distributions. Let s1 = s2 = 4. For the case group, the β-values are sampled from a beta-distribution Beta(s 1 + δ, s 2 − δ). For the control group, the β-values are sampled from a beta-distribution Beta(5s 1 + δ, 5s 2 − δ). Here δ takes six different values, -3λ, -2λ, -λ, 0.5λ, λ, and 1.5λ, one for each age group.
Change of the power with λ for four different methods when the distributions are Beta ( s 1 + δ , s 2 − δ ) and Beta (5 s 1 − δ , 5 s 2 + δ ) for the case and control groups; δ takes the values of -3λ, -2λ, -λ, 0.5λ, λ , and 1.5λ for the six age groups and s 1 = s 2 = 4
We also applied our proposed method to the United Kingdom Ovarian Cancer Population Study (UKOPS)  to select differentially methylated loci between ovarian cancer cases and healthy controls. The data were created using Illumina Infinium Human Methylation27 Beadchip and downloaded from the NCBI Gene Expression Omnibus ( http://www.ncbi.nlm.nih.gov/geo) under the accession number GSE19711. There were 274 control samples and 131 pre-treatment case samples, and the number of loci was 27578. For the data quality control, we removed 29 patients (15 controls and 14 treatments) with BS conversion efficiency value < 4000 or coverage rate < 95% . For each treatment group, the samples were divided into 6 age groups (50–55, 55–60, 60–65, 65–70, 70–75, and 75 and over). We further removed 12 patients in the pre-treatment group whose ages exceeded 78 since there were no such patients in the control group. The final sample size for each individual group is the same as the one listed in Table 2 of Chen  except that the “75 and over” group has 13 pre-treatment samples instead of 25. This dataset was analyzed by both Wang  and Chen  in their papers. Wang  did not consider the age effect, and only 96 cases and 136 controls were included in their analysis after further screening; while Chen  included the 12 patients with ages exceeding 78; thus their results are different from ours even though the same method was used.
Number of loci with p-values less than the given cutoff significance levels from different methods
Linear regression (I)
Combined t-test (II)
Combined Wilcoxon test (III)
Combined BWS test (IV)
From both I and IV
From both II and IV
From both III and IV
In this paper we chose different cutoff p-values to compare the performance of the proposed test with others. We did not consider the multiple testing issue, which is an important but difficult task for this area  and other areas where a large number of correlated variables are tested simultaneously [24–28]. The traditional correction methods for multiple comparisons, such as Bonferroni correction, are inappropriate here as they are too conservative due to the fact that many loci from the same gene are highly positively correlated. To account for the correlations among loci, methods based on the concept of “effective number” may be adopted .
There are many ways to combine p-values from independent tests [20, 30–32]. In this paper, we chose to use Fisher test due to its robustness. It is possible, however, that other methods may be more powerful under some certain conditions. The combined p-value method used in this paper is based on the assumption that the test for every individual age group is independent from each other. However, if this assumption is questionable, the current combined p-value method needs to be modified such that it can handle the correlations among the individual tests as well. This is another research topic we will pursue in a future paper.
In case–control methylation studies, the underlying distribution of the β-values is rarely known in advance, and clearly the normality assumption is not valid. Parametric models can be powerful if the assumptions for the models are valid, but they can also lead to biased results if the underlying true distribution is far deviated from the imposed ones. Thus, it is desirable to choose a powerful yet robust statistical test that does not depend on any underlying distribution assumption. In this article we proposed and examined a rank-based nonparametric method to detect differentially methylated loci. Through simulation, we showed that our proposed method is as powerful as the linear regression, t-test and Wilcoxon rank sum test methods if the mean differences between the two treatment groups are large. However, our method substantially outperformed the others in situations where the mean differences between the two groups were small while the variance differences were large.
Note that the age effects are strongly associated with methylation, and the ignoring age effect will cause a loss of power or a large number of false positives. Another advantage of the proposed method over many existed ones is that it combined the nonparametric test together with age adjustment. Our next goal was to generalize our method to adjust for more confounders other than the age such that it can have a much wider application in methylation research.
The authors would like to thank Ms. Kim Lawson for her professional editorial assistance, which highly improved the presentation of this paper. ZC also thanks the support from the faculty research funds awarded by the School of Public Health at the Indiana University Bloomington.
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License ( http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.