- Open Access
MeInfoText 2.0: gene methylation and cancer relation extraction from biomedical literature
© Fang et al; licensee BioMed Central Ltd. 2011
- Received: 23 February 2011
- Accepted: 14 December 2011
- Published: 14 December 2011
DNA methylation is regarded as a potential biomarker in the diagnosis and treatment of cancer. The relations between aberrant gene methylation and cancer development have been identified by a number of recent scientific studies. In a previous work, we used co-occurrences to mine those associations and compiled the MeInfoText 1.0 database. To reduce the amount of manual curation and improve the accuracy of relation extraction, we have now developed MeInfoText 2.0, which uses a machine learning-based approach to extract gene methylation-cancer relations.
Two maximum entropy models are trained to predict if aberrant gene methylation is related to any type of cancer mentioned in the literature. After evaluation based on 10-fold cross-validation, the average precision/recall rates of the two models are 94.7/90.1 and 91.8/90% respectively. MeInfoText 2.0 provides the gene methylation profiles of different types of human cancer. The extracted relations with maximum probability, evidence sentences, and specific gene information are also retrievable. The database is available at http://bws.iis.sinica.edu.tw:8081/MeInfoText2/.
The previous version, MeInfoText, was developed by using association rules, whereas MeInfoText 2.0 is based on a new framework that combines machine learning, dictionary lookup and pattern matching for epigenetics information extraction. The results of experiments show that MeInfoText 2.0 outperforms existing tools in many respects. To the best of our knowledge, this is the first study that uses a hybrid approach to extract gene methylation-cancer relations. It is also the first attempt to develop a gene methylation and cancer relation corpus.
- Breast Cancer
- Association Rule
- Gene Methylation
- Relation Extraction
- Name Entity
Epigenetics involves the study of mitotically heritable changes in gene expression that are mediated by DNA and histone modifications without altering the DNA sequence . DNA methylation, one of the most critical epigenetic events in mammals, is primarily found on the carbon 5 position of the cytosine ring in the context of CpG dinucleotides . During the methylation reaction, DNA methyltransferases (DNMTs) catalyze the transfer of a methyl group from S-adenosyl-L-methionine (SAM). A number of studies have found that abnormal gene methylation, including hypermethylation and hypomethylation, are associated with the development and progression of cancer; however, the precise mechanisms are still unclear [3, 4]. Hence, if the methylation profile is unique to a certain type of cancer, DNA methylation could be an important diagnostic and prognostic biomarker .
Information extraction (IE), a field of text mining, selects specific facts about pre-defined types of entities and relationships of interest . As the publication rates in epigenetics have grown exponentially in recent years, several studies have tried to extract information about gene methylation-cancer associations from large collections of textual data. For example, MeInfoText 1.0 uses term co-occurrences in abstracts and sentences together with association rules to identify such relationships . The PubMeth database also uses co-occurrences and the data is reviewed manually to identify cancer-gene methylation associations . The major drawback with co-occurrence methods is that the results may contain a large number of false positive relations due to the lack of syntactic and semantic analysis. Moreover, manual curation may lead to low recall results. As mentioned above, DNA methylation plays an important role in abnormal gene expression and cancer development. However, little research has been done on automatically extraction DNA methylation information with the use of machine learning or other natural language processing techniques .
The field of biomedical research is highly versatile . Domain-specific text mining methods must be developed to help researchers and physicians in coping with information overload . In this paper, we present MeInfoText 2.0, which uses a hybrid approach to extract gene methylation-cancer relations. The updated database provides more accurate and large-scale gene methylation profiles as well as the distributions of different types of cancer without the need for a great deal of manual curation. This work would aid epigenetics researchers in making more efficient use of the existing knowledge for practical application.
Construction and content
Named entity recognition (NER)
Gene symbols/names were identified by NERBio, an ML-based Bio-NER system with an F-score of 85.76% [12–14]. We utilized the pattern "(hyper|hypo)?(-)?(methylat.+)" to identify methylation named entities, where '.' indicates a character and '+' indicates that the character immediately to the left of the symbol may appear more than once.
(TUMOR SITE) (CANCER-RELATED KEYWORD);
ABBREVIATION includes the acronyms for cancer types such as NPC (nasopharyngeal carcinoma) and CRC (Colorectal Cancer). CANCER-RELATED KEYWORD is a specialized lexicon comprised of the following surface names: cancer, tumor (tumour), neoplasm, carcinogenesis, tumorigenesis and metastasis. With the exception of pattern (1), the matching strategies are case-insensitive
Gene methylation-cancer relation extraction
We formulate the task of extracting gene methylation-cancer relations as a binary classification problem. The first model determines if each gene-methylation (G-M) pair in the annotated sentences is positive. Then, the derived positive sentences are input to the second model to identify positive gene-cancer (G-C) pairs.
Since there are no publicly available annotated corpora for training a gene methylation-cancer association extraction system, we collected epigenetics-related abstracts from MeInfoText 1.0 to compile G-M and G-C corpora. Then we manually annotated each G-M pair and G-C pair in the sentences. If a sentence contained more than one G-M or G-C pair, the sentence was duplicated several times according to the number of possible combinations of the terms in all the pairs so that each sentence only contained one pair. For example, the sentence, S1, "[SOCS1] gene , [SOCS2] gene , [RASSF1a] gene , [CDKN2a] gene , and [MGMT] gene were [methylated] methylation in 75, 43, 64, 75, and 64% of [melanoma] cancer samples, respectively", contains 5 G-M pairs. Therefore, it would be duplicated and rewritten as 5 sentences, each containing exactly one G-M pair for G-M model training. For the G-M corpus, if a gene entity in a sentence is described as methylated, then the relation is regarded as positive; otherwise, it is regarded as negative. In the above sentence, there are five positive instances. For the G-C corpus, if the methylated gene described in a sentence is involved in the development of cancer or the gene's methylation status is detectable in cancers, then the relation is labeled as positive; otherwise, it is labeled as negative. In the above example, five positive G-C pairs were generated. Both corpora contained 1,000 positive and 1,000 negative sentences.
We randomly selected a subset of 400 sentences from our corpus. Gene, methylation and cancer named entities (NE) and G-M relations and G-C relations were manually annotated by two annotators with biomedical background. The inter-annotator agreement is 95% determined as the intersection of annotated NE and relations divided by the total number of NE and relations.
For each G-C pair, there may be more than one evidence sentence with the relation probability calculated by the GC maximum entropy model. The sum of total probabilities for each gene and cancer relatedness is used to represent the ranking score of the G-C pair. Querying by cancer type returns genes methylated in the cancers ranked in the same way. Users can also find genes methylated in pre-specified cancer types by searching genes and cancers together. The relations extracted from the current literature are also available. In this study, the profiles of gene methylation across human tumor types provide the frequency patterns of gene methylation based on the number of evidence sentences and the maximum probability, as shown in Figure 3 (c).
For example, to access information about the BRCA1 (breast cancer 1, early onset), GSTP1 (glutathione S-transferase pi) and ESR1 (estrogen receptor 1) gene methylation profile across various types of cancer, a user could input BRCA1, GSTP1, ESR1 as search terms separated by line breaks. Gene orthographic variants, such as BRCA1 and BRCA-1, are generated based on a few simple rules . Next, the system checks if the searched genes are available in the database. After selecting gene symbols, the returned web page displays a table containing information about gene-cancer pairs, the average maximum probability, the number of evidence sentences and their frequency. The average maximum probability is the sum of the ranking scores divided by the number of sentences. The cancer set shown in the left-hand column lists the cancers associated with any one of the three genes. The user can then examine the extracted sentences ranked by their maximum probability scores. Keywords are highlighted and links to PubMed are also provided. In addition to the gene methylation profile, if only a single gene is queried, the gene summary, cross-references to other public databases, and statistics about hypermethylation and hypomethylation are shown.
Users can select one type of cancer, such as breast cancer, (or several types) to find a set of genes undergoing abnormal methylation related to the cancer(s) of interest. It is also possible to input multiple official gene symbols separated by line breaks and select multiple cancer types to retrieve the profiles of gene methylation across human cancer types. For instance, let us consider the following set of genes discussed by Esteller et al. : CDKN2A, CDKN2B, MGMT (O6-methylguanine-DNA methyltransferase), MLH1, BRCA1, GSTP1, DAPK1, CDH1 (cadherin 1), TIMP3 (TIMP metallopeptidase inhibitor 3), TP73, and APC (adenomatous polyposis coli). If the genes are input to the system and different types of cancer, such as colorectal, lung, breast, brain, gastric, liver, esophageal, bladder, blood, kidney, ovarian, head and neck, pancreatic, endometrial and lymphatic cancer, are selected, the methylation profile of each gene related to the different cancers will be shown. The profile may also reflect the specific involvement of the gene in the selected type of cancer or groups of cancers.
The pages retrieved by MeInfoText 2.0 for the above gene methylation profile are similar to the results reported by Esteller et al. . For example, CDKN2A is hypermethylated across colorectal, lung and breast cancer with an average maximum probability of 0.8 and a total of 306 evidence sentences. Meanwhile, hypermethylation of BRCA1 is found primarily in breast and ovarian cancer with an average maximum probability of 0.84 and approximately 41 evidence sentences.
In the next section, we consider the NER performance as well as the G-M and G-C relation extraction performance. The predictive performance measures for the trained models are defined as follows: and , where TP, FP and FN denote the number of true positives, false positives and false negatives respectively.
NER and relation extraction performance
The data used to evaluate the cancer named entity recognizer was downloaded from http://biotext.berkeley.edu/data/dis_treat_data/sentences_with_roles_and_relations. The disease named entities tagged <DIS></DIS> or <DISONLY></DISONLY> and the cancer names, except general terms like tumor, were used for evaluation. If an exact matching strategy is employed, the precision and recall rates for cancer name recognition are 85.2% and 79.5% respectively; while under the approximate matching strategy , the rates are 99.1% and 81.8% respectively.
To evaluate G-M and G-C relation extraction, we applied 10-fold cross validation on the G-M and G-C corpora. We randomly selected 900 sentences from the corpora to train the GM and GC models and used the remainder for testing. The average precision/recall rates were 94.7 ± 2.1/90.1 ± 2.8 and 91.8 ± 3.2/90.0 ± 1.6% for the GM and GC models respectively. Both models were trained with all the features shown in Figure 2. There was no obvious performance improvement (< 0.01) when the template features were used.
System evaluation and utility
Gene methylation and cancer relation extraction precision/recall rates
Co-occurrences in abstracts
Co-occurrences in sentences
Comparison of the information available in MeInfoText 2.0 and PubMeth
# hypermethylated genes available
# hypermethylated genes described in breast cancer
# hypomethylated genes available
# hypomethylated genes described in breast cancer
# genes searched for association with breast cancer
Comparison of the cancer-gene methylation association evidence sentences extracted by PubMeth and MeInfoText 2.0
# evidence sentences
# evidence sentences
Reference intersection (%)
The third experiment was designed to further evaluate the performance of MeInfoText 2.0 using data published by Kim et al, 2010 , which reports 58 genes methylated in colorectal cancer (CRC). All 58 genes are available in our database, and 72.4% are reported to be associated with gene methylation and CRC. The average maximum probability is 0.87 and there are 10 evidence sentences. The second and third experiments indicate that MeInfoText 2.0 performs well in epigenetics studies that focus on different types of cancer.
Veeck and Esteller  identified hypermethylation as an important mechanism in miRNA silencing; and they listed 3 miRNAs silenced by, or involved in, epigenetic mechanisms. Of the 3 genes, it has been reported that miR-9-1 with unknown target genes is hypermethylated in human breast cancer , an association also found by MeInfoText 2.0. Information about tumorgenesis and miRNA gene methylation, such as miR-34a  and miR-181c , is also available in the database. Moreover, the extracted information shows that aberrant expression of DNMT1 (DNA methyltransferase 1) breast cancer is associated with the loss of DNA methylation . To determine if DNMT1 or other DNA methyltransferases may be the potential target genes of miR-9-1, we used microRNA.org  for prediction. Our database does not contain any miR-9-1 information, but it can retrieve the prediction results for miR-9. Although DNMT1 is not predicted as the target gene of miR-9, microRNA.org shows that MeCP2 (methyl CpG binding protein 2) may contain two hsa-miR-9 target sites. A previous study  posited that the silence of the ER promoter in the breast cancer cell line is associated with DNA hypermethylation, histone modification and the recruitment of MeCP2, DNMT1 and other proteins. The hypothesis suggests that miR-9-1 hypermethylation abnormally increases the expression of MeCP2, which in turn represses the transcription of methylated DNA via the recruitment of a histone deacetylase activity associated with DNMT1 . Further investigation is needed to elucidate the relationships between miR-9-1, MeCP2 and DNMT1 in breast carcinogenesis.
MeInfoText 2.0 provides more accurate information about gene methylation-cancer associations discussed in a large number of studies. To the best of our knowledge, this is the first study that uses machine learning, a domain dictionary and pattern matching to extract genetic-epigenetic relations. Such relations are important for determining if unique profiles exist for specific types of cancer, and assessing how to improve cancer detection and treatment by using DNA methylation biomarkers. The study is also the first attempt to create a gene methylation-cancer corpus.
Project name: MeInfoText 2.0
Project home page: http://bws.iis.sinica.edu.tw:8081/MeInfoText2/
Operating system(s): platform independent
License: the database website is freely accessible
This research was supported in part by the National Science Council under grant NSC99-3112-B-001-005, the Academia Sinica Investigator Award 95-02 and the research center for Humanities and Social Sciences under grant IIS-50-23. The authors thank Chi-Yang Wu for annotating the subset of the corpus for the inter-annotator agreement analysis.
- Kristensen LS, Nielsen HM, Hansen LL: Epigenetics and cancer treatment. Eur J Pharmacol 2009, 625(13):131–142.View ArticlePubMedGoogle Scholar
- Bird A: DNA methylation patterns and epigenetic memory. Genes Dev 2002, 16(1):6–21. 10.1101/gad.947102View ArticlePubMedGoogle Scholar
- Esteller M: Epigenetics in cancer. N Engl J Med 2008, 358(11):1148–1159. 10.1056/NEJMra072067View ArticlePubMedGoogle Scholar
- Veeck J, Esteller M: Breast cancer epigenetics: from DNA methylation to microRNAs. J Mammary Gland Biol Neoplasia 2010, 15(1):5–17. 10.1007/s10911-010-9165-1PubMed CentralView ArticlePubMedGoogle Scholar
- Tost J: DNA methylation: an introduction to the biology and the disease-associated changes of a promising biomarker. Methods Mol Biol 2009, 507: 3–20. 10.1007/978-1-59745-522-0_1View ArticlePubMedGoogle Scholar
- Spasic I, Ananiadou S, McNaught J, Kumar A: Text mining and ontologies in biomedicine: making sense of raw text. Brief Bioinform 2005, 6(3):239–251. 10.1093/bib/6.3.239View ArticlePubMedGoogle Scholar
- Fang YC, Huang HC, Juan HF: MeInfoText: associated gene methylation and cancer information from text mining. BMC Bioinformatics 2008, 9: 22. 10.1186/1471-2105-9-22PubMed CentralView ArticlePubMedGoogle Scholar
- Ongenaert M, Van Neste L, De Meyer T, Menschaert G, Bekaert S, Van Criekinge W: PubMeth: a cancer methylation database combining text-mining and expert annotation. Nucleic Acids Res 2008, 36(Database):D842–846.PubMed CentralView ArticlePubMedGoogle Scholar
- Ohta T, Pyysalo S, Miwa M, Tsujii J: Event extraction for dna methylation. Journal of Biomedical Semantics 2011, 2(Suppl 5):S2. 10.1186/2041-1480-2-S5-S2PubMed CentralView ArticlePubMedGoogle Scholar
- Weeber M, Klein H, Aronson AR, Mork JG, de Jong-van den Berg LT, Vos R: Text-based discovery in biomedicine: the architecture of the DAD-system. Proc AMIA Symp 2000, 903–907.Google Scholar
- Cohen AM, Hersh WR: A survey of current work in biomedical text mining. Brief Bioinform 2005, 6(1):57–71. 10.1093/bib/6.1.57View ArticlePubMedGoogle Scholar
- Tsai RT, Sung CL, Dai HJ, Hung HC, Sung TY, Hsu WL: NERBio: using selected word conjunctions, term normalization, and global patterns to improve biomedical named entity recognition. BMC Bioinformatics 2006, 7(Suppl 5):S11. 10.1186/1471-2105-7-S5-S11PubMed CentralView ArticlePubMedGoogle Scholar
- Dai H-J, Hung H-C, Tsai RT-H, Hsu W-L: IASL Systems in the Gene Mention Tagging Task and Protein Interaction Article Sub-task. Proceedings of Second BioCreAtIvE Challenge Evaluation Workshop: 2007; Madrid, Spain 2007, 69–76.Google Scholar
- Dai HJ, Lai PT, Tsai RT: Multistage gene normalization and SVM-based ranking for protein interactor extraction in full-text articles. IEEE/ACM Trans Comput Biol Bioinform 2010, 7(3):412–420.View ArticlePubMedGoogle Scholar
- Berger AL, Della Pietra VJ, et al.: A maximum entropy approach to natural language processing. Computational linguistics 1996, 22(1):39–71.Google Scholar
- Tsai RT, Lai PT, Dai HJ, Huang CH, Bow YY, Chang YC, Pan WH, Hsu WL: HypertenGene: extracting key hypertension genes from biomedical literature with position and automatically-generated template features. BMC Bioinformatics 2009, 10(Suppl 15):S9. 10.1186/1471-2105-10-S15-S9PubMed CentralView ArticlePubMedGoogle Scholar
- Smith TF, Waterman MS: Identification of common molecular subsequences. J Mol Biol 1981, 147(1):195–197. 10.1016/0022-2836(81)90087-5View ArticlePubMedGoogle Scholar
- Sung CL, Lee CW, et al.: Alignment-based surface patterns for factoid question answering systems. Integrated Computer-Aided Engineering 2009, (16):259–269.Google Scholar
- MaxEnt toolkit[http://homepages.inf.ed.ac.uk/lzhang10/maxent_toolkit.html]
- Cohen AM: Unsupervised gene/protein named entity normalization using automatically extracted dictionaries. Proceedings of the ACL-ISMB Workshop on Linking Biological Literature, Ontologies and Databases: Mining Biological Semantics 2005, 17–24.View ArticleGoogle Scholar
- Esteller M, Corn PG, Baylin SB, Herman JG: A gene hypermethylation profile of human cancer. Cancer Res 2001, 61(8):3225–3229.PubMedGoogle Scholar
- Rosario B, Hearst M: Classifying semantic relations in bioscience texts. Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics, ACL Barcelona, Spain 2004.Google Scholar
- Tsai RT, Wu SH, Chou WC, Lin YC, He D, Hsiang J, Sung TY, Hsu WL: Various criteria in the evaluation of biomedical named entity recognition. BMC Bioinformatics 2006, 7: 92. 10.1186/1471-2105-7-92PubMed CentralView ArticlePubMedGoogle Scholar
- Kim MS, Lee J, Sidransky D: DNA methylation markers in colorectal cancer. Cancer Metastasis Rev 2010, 29(1):181–206. 10.1007/s10555-010-9207-6View ArticlePubMedGoogle Scholar
- Lehmann U, Hasemeier B, Christgen M, Muller M, Romermann D, Langer F, Kreipe H: Epigenetic inactivation of microRNA gene hsa-mir-9–1 in human breast cancer. J Pathol 2008, 214(1):17–24. 10.1002/path.2251View ArticlePubMedGoogle Scholar
- Chim CS, Wong KY, Qi Y, Loong F, Lam WL, Wong LG, Jin DY, Costello JF, Liang R: Epigenetic inactivation of the miR-34a in hematological malignancies. Carcinogenesis 2010, 31(4):745–750. 10.1093/carcin/bgq033View ArticlePubMedGoogle Scholar
- Hashimoto Y, Akiyama Y, Otsubo T, Shimada S, Yuasa Y: Involvement of epigenetically silenced microRNA-181c in gastric carcinogenesis. Carcinogenesis 2010, 31(5):777–784. 10.1093/carcin/bgq013View ArticlePubMedGoogle Scholar
- Tryndyak VP, Kovalchuk O, Pogribny IP: Loss of DNA methylation and histone H4 lysine 20 trimethylation in human breast cancer cells is associated with aberrant expression of DNA methyltransferase 1, Suv4–20h2 histone methyltransferase and methyl-binding proteins. Cancer Biol Ther 2006, 5(1):65–70. 10.4161/cbt.5.1.2288View ArticlePubMedGoogle Scholar
- Betel D, Wilson M, Gabow A, Marks DS, Sander C: The microRNA.org resource: targets and expression. Nucleic Acids Res 2008, 36(Database):D149–153.PubMed CentralView ArticlePubMedGoogle Scholar
- Sharma D, Blum J, Yang X, Beaulieu N, Macleod AR, Davidson NE: Release of methyl CpG binding proteins and histone deacetylase 1 from the Estrogen receptor alpha (ER) promoter upon reactivation in ER-negative human breast cancer cells. Mol Endocrinol 2005, 19(7):1740–1751. 10.1210/me.2004-0011View ArticlePubMedGoogle Scholar
- Fuks F, Burgers WA, Brehm A, Hughes-Davies L, Kouzarides T: DNA methyltransferase Dnmt1 associates with histone deacetylase activity. Nat Genet 2000, 24(1):88–91. 10.1038/71750View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.