Comparison of Beta-value and M-value methods for quantifying methylation levels by microarray analysis
© Du et al; licensee BioMed Central Ltd. 2010
Received: 27 August 2010
Accepted: 30 November 2010
Published: 30 November 2010
High-throughput profiling of DNA methylation status of CpG islands is crucial to understand the epigenetic regulation of genes. The microarray-based Infinium methylation assay by Illumina is one platform for low-cost high-throughput methylation profiling. Both Beta-value and M-value statistics have been used as metrics to measure methylation levels. However, there are no detailed studies of their relations and their strengths and limitations.
We demonstrate that the relationship between the Beta-value and M-value methods is a Logit transformation, and show that the Beta-value method has severe heteroscedasticity for highly methylated or unmethylated CpG sites. In order to evaluate the performance of the Beta-value and M-value methods for identifying differentially methylated CpG sites, we designed a methylation titration experiment. The evaluation results show that the M-value method provides much better performance in terms of Detection Rate (DR) and True Positive Rate (TPR) for both highly methylated and unmethylated CpG sites. Imposing a minimum threshold of difference can improve the performance of the M-value method but not the Beta-value method. We also provide guidance for how to select the threshold of methylation differences.
The Beta-value has a more intuitive biological interpretation, but the M-value is more statistically valid for the differential analysis of methylation levels. Therefore, we recommend using the M-value method for conducting differential methylation analysis and including the Beta-value statistics when reporting the results to investigators.
Methylation of cytosine bases in DNA CpG islands is an important epigenetic regulation mechanism in the organ development, aging and different disease statuses . Hypermethylation of CpG islands located in the promoter regions of tumor suppressor genes has been firmly established as one of the most common mechanisms for gene regulation in cancer [2, 3]. Therefore, high-throughput profiling of DNA methylation status of CpG islands is crucial for forwarding our understanding of the influence of epigenomics [4–6]. Microarray-based Illumina Infinium methylation assay has been recently used in epigenomic studies [7–9] due to its high throughput, good accuracy, small sample requirement and relatively low cost .
To estimate the methylation status, the Illumina Infinium assay utilizes a pair of probes (a methylated probe and an unmethylated probe) to measure the intensities of the methylated and unmethylated alleles at the interrogated CpG site . The methylation level is then estimated based on the measured intensities of this pair of probes. To date, two methods have been proposed to measure the methylation level. The first one is called Beta-value, ranging from 0 to 1, which has been widely used to measure the percentage of methylation. This is the method currently recommended by Illumina [11, 12]. The second method is the log2 ratio of the intensities of methylated probe versus unmethylated probe . We have referred to it as the M-value method because it has been widely used in the mRNA expression microarray analysis. Since both methods have their own strengths and limitations, understanding the performance characteristics of both measures is very important in providing the best methylation analysis. We found some studies that optimized clustering methylation data using the Beta-value  method; but a rigorous comparison of the two methods has not been done. For this reason, we designed a titration experiment to compare and evaluate these two methods. In the following sections, we will first define these two methods and derive the relationship between them. Then we will evaluate the performance of these two methods in detecting differentially methylated CpG sites.
Definition of Beta-value and M-value
where y i,menty and y i,unmenty are the intensities measured by the ith methylated and unmethylated probes, respectively. To avoid negative values after background adjustment, any negative values will be reset to 0. Illumina recommends adding a constant offset α (by default, α = 100) to the denominator to regularize Beta value when both methylated and unmethylated probe intensities are low. The Beta-value statistic results in a number between 0 and 1, or 0 and 100%. Under ideal conditions, a value of zero indicates that all copies of the CpG site in the sample were completely unmethylated (no methylated molecules were measured) and a value of one indicates that every copy of the site was methylated. If we assume the probe intensities are Gamma distributed, then the Beta-value follows a Beta distribution. For this reason, it has been named the Beta-value.
Here we slightly modified the definition given in  by adding an offset α (by default, α = 1) to the intensity values to prevent unexpected big changes due to small intensity estimation errors, since for very small intensity values (especially between 0 and 1), small changes of the methylated and unmethylated probe intensities can result in large changes in the M-value. A M-value close to 0 indicates a similar intensity between the methylated and unmethylated probes, which means the CpG site is about half-methylated, assuming that the intensity data has been properly normalized by Illumina GenomeStudio or some other external normalization algorithm. Positive M-values mean that more molecules are methylated than unmethylated, while negative M-values mean the opposite. The M-value has been widely used in expression microarray analysis, especially two-color microarray analysis. Therefore, many existing microarray statistical frameworks using an M-value method can also be applied to methylation data analysis.
Relationship between Beta-value and M-value
Histograms of Beta-value and M-value
The distribution of standard deviation across different methylation levels
Performance comparison between Beta and M-values
Titration data has been widely used to evaluate the performance of new methods for analyzing mRNA expression microarrays [16, 17]. To apply this practice to methylation analysis, we designed a methylation titration experiment that enables the evaluation of the performance of the Beta-value and M-value methylation analysis methods. Similar to the titration design using Goldengate methylation chips by Bibikova and et al. , we selected two samples known to contain significant methylation differences. Sample A is a B-lymphocyte sample from a male donor. Sample B is a colon cancer sample from a female donor. The sources of the methylation differences between sample A and B include: (1) gender differences; (2) pathological differences; (3) tissue differences. Samples A and B were mixed at five different titration ratios: 100:0, 90:10, 75:25, 50:50 and 0:100. The mixed samples were measured by Illumina Infinium HumanMethylation27 BeadChip with technical replicates. Please see the Methods section for a more detailed description.
As shown in Figure 1, the middle range of logistic transformation is approximately linear while the low and high ranges have clear nonlinear relationships between the Beta-value and M-value statistics. We have grouped the results of the transformations into three analysis groups, labeled as low, middle and high, with the middle analysis group corresponding to the approximately linear range and the low and high groups in the nonlinear range. This simplifies the analysis of the performance of each statistic.
Beta-value: low (0, 0.2), middle [0.2, 0.8] and high (0.8, 1).
M-value: low (-Inf, -2), middle [-2, 2] and high (2, Inf).
Define differentially methylated CpG sites based on correlation
Design of the methylation titration experiment
% mix of A and B for each sample
N tech *
Performance comparison based on differential methylation analysis
One of the major statistical paradigms in expression microarray analysis has been the "Fold change-ranking with a non-stringent p-value cutoff" [18–20]. Under this framework, the CpG islands will be first subject to a low-stringency p-value threshold (p < 0.05 without the correction of multiple comparisons); and then ranked by fold changes. We hypothesized that M-value outperforms Beta-value under this statistical framework because M-value is more homoscedastic and therefore aligns better with the distribution assumptions of these statistical methods.
Refinement of the basic differential methylation analysis
Similar to other hybridization techniques, there is an inherent level of variability associated with sample preparation, sample loading, the microarrays and the detectors. To address this variability it is very common to add a "minimum difference threshold" to select out CpG sites with little difference between two biological conditions. Next we want to evaluate the performance of the Beta-value and M-value statistics if we include a minimum difference threshold in addition to the p-value requirement.
Figure 5 also provides some guidance for selecting the difference thresholds of Beta-value and M-value statistics. An ideal difference threshold would have both high TPR and high DR, but there is a tradeoff in selecting the threshold. From Figure 5, we can see that the TPR gradually increases with the difference threshold before stabilizing. Based on this, the difference threshold at the turning point of TPR can be set as the up-limit threshold because further increase of threshold will not improve TPR very much. On the other hand, the DR is almost constant at low thresholds and then gradually decreases with the increasing of difference threshold. So the difference threshold at the turning point of DR can be set as the down-limit threshold because it can increase the TPR without deteriorate the DR when DR is stabilized. Based on these guidelines, we suggest the range of threshold of M-value method should be about between 0.4 and 1.4 (or from 1.32 to 2.64 if we convert M-value to the non-log scale). For the Beta-value method, because of its severe heteroscedasticity in the low and high analysis groups, it is infeasible to provide a fixed threshold. We can only suggest the threshold of Beta-value for the middle analysis group, which is about between 0.05 and 0.15. It should be noted that these threshold ranges are dependent on the distribution of intensities in the dataset so ideally these thresholds should be determined for each dataset.
The Beta-value method has already been widely used to calculate methylation levels, and it is the manufacturer recommended method for analyzing Illumina Infinium HumanMethylation27 BeadChip microarrays. The M-value method has been widely used in the expression microarray analysis, and has been used to calculate methylation levels in some methylation microarray analyses . However, to date there has been no systematic evaluation of the relationship between the Beta-value and M-value methods. In this study, we demonstrate that the two methods are related by a Logit transformation. They have an approximately linear relationship in the middle methylation range (defined as 0.2 to 0.8 for the Beta-value method) with a significant compression above and below this range for the Beta-value method. The Beta-value range is from 0 and 1 and can be interpreted as an approximation of the percentage of methlyation. However, because the Beta-value has a bounded range, this statistic violates the Gaussian distribution assumption used by many statistical methods, including the very prevalent t-test. In comparison, M-value statistic can be appropriately analyzed with these methods.
To compare the performance of Beta and M-value methods in identifying the differentially methylated CpG sites, we designed a methylation titration experiment. As we do not know the 'true' methylated CpG sites, we have defined a set of True Positives (TPs) based on high levels of correlation between the methylation and titration profiles. It is important to note that some true differentially methylated CpG sites may not be included in this set of TPs; at the same time, some false positives may also be included in the TPs. Fortunately, athough a small number of false positives or false negatives will affect the estimation of TPRs and DRs, but does not affect the overall performance comparisons between two methods (We did simulations by randomly adding or removing 10% TPs, and found the performance difference between Beta and M-values are consistent with the curves shown in Figure 4. The results were not included in the paper.). Comparing the performance based on top ranked CpG sites (ranked based on the absolute difference between two comparing groups), the M-value method has better detection power and a higher True Positive Rate (TPR) in the low and high methylation ranges due to its reduced heteroscedasticity in these ranges. In the middle methylation range, the Beta-value method has slightly better detection power than the M-value method but a decreased TPR.
In microarray differential analysis, adding a difference (or fold-change) threshold is another common practice and effective way to improve the TPR. However, due to the severe heteroscedasticity of the Beta-value method outside the middle methylation ranges, it is impossible to impose a constant difference threshold across entire methylation range for the Beta-value method. If a constant difference threshold is used for the Beta-value method, then the detection rate outside the middle methylation range is severely deteriorated. To solve this problem, Illumina proposed a customized model to detect differentially methylated CpG sites . Basically, the model fits a parabola to the standard deviation as a function of Beta-value. However, this is inconvenient to implement, and the fitted parameters suggested by Illumina may change across different experiments under different conditions. Performing the same set of analyses using the M-value method demonstrates that using a constant difference threshold is appropriate and far easier to implement. Based on the comparison graphed in Figure 5 we suggest setting a threshold for the M-value method between 0.4 and 1.4 (or from 1.32 to 2.64 in the non-log scale).
The Beta-value method has a direct biological interpretation - it corresponds roughly to the percentage of a site that is methylated. This makes the Beta-value very attractive when modeling the underlying biological effect. However, this interpretation is an approximation , especially when the data has not been properly preprocessed and normalized. From an analytical and statistical standpoint, the Beta-value method has severe heteroscedasticity outside the middle methylation range, which imposes serious challenges in applying many statistic models. In comparison, the M-value method is more statistically valid in differential and other statistic analysis as it is approximately homoscedastic. Although the M-value statistic does not have an intuitive biological meaning, it is possible to provide an accurate estimation of methylation status by modeling the distribution of the M-value statistic. In differential methylation analysis, we recommend using M-value because we can directly apply most statistical analysis methods designed for expression microarrays and it is easy to implement a difference threshold adjustment to improve the TPR. And the difference of M-value can be interpreted as the fold-change in the non-log scale. Although both Beta-value and M-value methods have some limitations, the two statistics are inter-convertible using Equation 3, enabling the use of the most appropriate method. We recommend using the M-value method for differential methylation analysis and also including the Beta-value statistic in final reports due to its intuitive biological interpretation.
Similar to the titration design using Goldengate methylation chips by Bibikova and et al , we selected two samples with known methylation differences. Sample A is NA 10923 from Coriell Institute for Medical Research. It is a B-Lymphocyte sample from a male donor. Sample B is HTB-38 cell line from ATCC (http://www.atcc.org). It is a colon cancer sample from a female donor. Sample A and B were normalized into the same concentration, and then mixed in five different titration ratios. Table 1 shows the detailed information. The numbers in the row 2 and 3 in Table 1 are the percentage of sample A and B in the titration sample. Row 4 is the number of replicates of each sample.
DNA Methylation Profiling using Illumina Infinium BeadChip Microarrays
The DNA samples were prepared following the guidelines suggested by the manufacturer (Illumina, Inc.), and then measured by Illumina Infinium HumanMethylation27 BeadChip, which measures 27578 CpG sites. The HumanMethylation27 BeadChip contains a pair of methylated and unmethylated probes designed for each CpG site. All experiments were conducted following the manufacturer's protocols by the Genomics Core at Northwestern University. The Illumina BeadChips were scanned with an Illumina BeadArray Reader and then preprocessed by the Illumina GenomeStudio software. Raw data have been deposited in the NCBI GEO database under the accession number of GSE23789.
We used the Bioconductor methylumi package  to input the methylation files outputted by Illumina GenomeStudio software and processed the methylation data using Bioconductor lumi package . The methylation data was first passed QC and color balance check, and then background corrected and scaled based on the mean of all probes (using methylation simple scaling normalization (SSN) implemented in the lumi package). Beta-value and M-value statistics were calculated based on Equation 1 and 2. The related preprocessing functions are included in the Bioconductor lumi package (version > 2.0) . As a prefiltering step, 82 CpG sites with more than 50% of samples having detection p-values worse than 0.0001 were filtered before the analysis. The Pearson correlation method was used to calculate the correlation between the titration and methylation profiles. Welch's t-test was used to identify the differentially methylated CpG sites.
We appreciate the very constructive critique and insightful comments of the reviewers. This work was supported in part by the NIH award 1RC1ES018461-01 to LH. PD, SML and WAK acknowledge the support of P30CA060553 and UL1RR025741. We would like to thank Vivi Frangidakis for conducting the Illumina BeadChip experiments, Leming Shi for discussing the "FC-ranking" paradigm. We would also like to acknowledge other participants in the "DNA Methylation Alterations in Response to Pesticides Exposure" project meetings for their inputs and support: Hehuang Xie, Min Wang, Yue Yu and Marcelo Bento Soares.
- Laird PW: Principles and challenges of genome-wide DNA methylation analysis. Nat Rev Genet 2010, 11(3):191–203. 10.1038/nrg2732View ArticlePubMed
- Esteller M: CpG island hypermethylation and tumor suppressor genes: a booming present, a brighter future. Oncogene 2002, 21(35):5427–5440. 10.1038/sj.onc.1205600View ArticlePubMed
- Herman JG, Baylin SB: Gene silencing in cancer in association with promoter hypermethylation. N Engl J Med 2003, 349(21):2042–2054. 10.1056/NEJMra023075View ArticlePubMed
- Shen L, Kondo Y, Guo Y, Zhang J, Zhang L, Ahmed S, Shu J, Chen X, Waterland RA, Issa JP: Genome-wide profiling of DNA methylation reveals a class of normally methylated CpG island promoters. PLoS Genet 2007, 3(10):2023–2036. 10.1371/journal.pgen.0030181View ArticlePubMed
- O'Riain C, O'Shea DM, Yang Y, Le Dieu R, Gribben JG, Summers K, Yeboah-Afari J, Bhaw-Rosun L, Fleischmann C, Mein CA, et al.: Array-based DNA methylation profiling in follicular lymphoma. Leukemia 2009, 23(10):1858–1866. 10.1038/leu.2009.114View ArticlePubMedPubMed Central
- Breton CV, Byun HM, Wenten M, Pan F, Yang A, Gilliland FD: Prenatal tobacco smoke exposure affects global and gene-specific DNA methylation. Am J Respir Crit Care Med 2009, 180(5):462–467. 10.1164/rccm.200901-0135OCView ArticlePubMedPubMed Central
- Bell CG, Teschendorff AE, Rakyan VK, Maxwell AP, Beck S, Savage DA: Genome-wide DNA methylation analysis for diabetic nephropathy in type 1 diabetes mellitus. BMC Med Genomics 2010, 3: 33. 10.1186/1755-8794-3-33View ArticlePubMedPubMed Central
- Thirlwell C, Eymard M, Feber A, Teschendorff A, Pearce K, Lechner M, Widschwendter M, Beck S: Genome-wide DNA methylation analysis of archival formalin-fixed paraffin-embedded tissue using the Illumina Infinium HumanMethylation27 BeadChip. Methods 2010, 52(3):248–54. 10.1016/j.ymeth.2010.04.012View ArticlePubMed
- Grafodatskaya D, Choufani S, Ferreira JC, Butcher DT, Lou Y, Zhao C, Scherer SW, Weksberg R: EBV transformation and cell culturing destabilizes DNA methylation in human lymphoblastoid cell lines. Genomics 2010, 95(2):73–83. 10.1016/j.ygeno.2009.12.001View ArticlePubMed
- Weisenberger DJ, Berg DVD, Pan F, Berman BP, Laird PW: Comprehensive DNA Methylation Analysis on the Illumina Infinium Assay Platform. Illumina Application Note 2008. [http://www.illumina.com/support/literature.ilmn]
- Bibikova M, Fan JB: GoldenGate assay for DNA methylation profiling. Methods Mol Biol 2009, 507: 149–163. full_textView ArticlePubMed
- Bibikova M, Lin Z, Zhou L, Chudin E, Garcia EW, Wu B, Doucet D, Thomas NJ, Wang Y, Vollmer E, et al.: High-throughput DNA methylation profiling using universal bead arrays. Genome Res 2006, 16(3):383–393. 10.1101/gr.4410706View ArticlePubMedPubMed Central
- Irizarry RA, Ladd-Acosta C, Carvalho B, Wu H, Brandenburg SA, Jeddeloh JA, Wen B, Feinberg AP: Comprehensive high-throughput arrays for relative methylation (CHARM). Genome Res 2008, 18(5):780–790. 10.1101/gr.7301508View ArticlePubMedPubMed Central
- Houseman EA, Christensen BC, Yeh RF, Marsit CJ, Karagas MR, Wrensch M, Nelson HH, Wiemels J, Zheng S, Wiencke JK, et al.: Model-based clustering of DNA methylation array data: a recursive-partitioning algorithm for high-dimensional data arising as a mixture of beta distributions. BMC Bioinformatics 2008, 9: 365. 10.1186/1471-2105-9-365View ArticlePubMedPubMed Central
- Durbin BP, Hardin JS, Hawkins DM, Rocke DM: A variance-stabilizing transformation for gene-expression microarray data. Bioinformatics 2002, 18(Suppl 1):S105–110.View ArticlePubMed
- Lin SM, Du P, Huber W, Kibbe WA: Model-based variance-stabilizing transformation for Illumina microarray data. Nucleic Acids Res 2008, 36(2):e11. 10.1093/nar/gkm1075View ArticlePubMedPubMed Central
- Barnes M, Freudenberg J, Thompson S, Aronow B, Pavlidis P: Experimental comparison and cross-validation of the Affymetrix and Illumina gene expression analysis platforms. Nucleic Acids Res 2005, 33(18):5914–5923. 10.1093/nar/gki890View ArticlePubMedPubMed Central
- Shi L, Reid LH, Jones WD, Shippy R, Warrington JA, Baker SC, Collins PJ, de Longueville F, Kawasaki ES, Lee KY, et al.: The MicroArray Quality Control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements. Nat Biotechnol 2006, 24(9):1151–1161. 10.1038/nbt1239View ArticlePubMed
- Guo L, Lobenhofer EK, Wang C, Shippy R, Harris SC, Zhang L, Mei N, Chen T, Herman D, Goodsaid FM, et al.: Rat toxicogenomic study reveals analytical consistency across microarray platforms. Nat Biotechnol 2006, 24(9):1162–1169. 10.1038/nbt1238View ArticlePubMed
- Shi L, Jones WD, Jensen RV, Harris SC, Perkins RG, Goodsaid FM, Guo L, Croner LJ, Boysen C, Fang H, et al.: The balance of reproducibility, sensitivity, and specificity of lists of differentially expressed genes in microarray studies. BMC Bioinformatics 2008, 9(Suppl 9):S10. 10.1186/1471-2105-9-S9-S10View ArticlePubMedPubMed Central
- Illumina: GenomeStudio Methylation Module v1.0 User Guide. Illumina Technical Note 2008. [http://www.illumina.com/support/documentation.ilmn]
- Illumina: GoldenGate Assay for Methylation and BeadArray Technology. Illumina Technical Note 2007. [http://www.illumina.com/Documents/products/technotes/technote_goldengate_assay_methylation.pdf]
- Davis S, Bilke S: methylumi: Handle Illumina methylation data. Bioconductor R package version 132 2010.
- Du P, Kibbe WA, Lin SM: lumi: a pipeline for processing Illumina microarray. Bioinformatics 2008, 24(13):1547–1548. 10.1093/bioinformatics/btn224View ArticlePubMed
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (<url>http://creativecommons.org/licenses/by/2.0</url>), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.