- Open Access
A 2018 workshop: vaccine and drug ontology studies (VDOS 2018)
BMC Bioinformatics volume 20, Article number: 705 (2019)
This Editorial first introduces the background of the vaccine and drug relations and how biomedical terminologies and ontologies have been used to support their studies. The history of the seven workshops, initially named VDOSME, and then named VDOS, is also summarized and introduced. Then the 7th International Workshop on Vaccine and Drug Ontology Studies (VDOS 2018), held on August 10th, 2018, Corvallis, Oregon, USA, is introduced in detail. These VDOS workshops have greatly supported the development, applications, and discussion of vaccine- and drug-related terminology and drug studies.
Drugs and vaccines are critical to public health worldwide. When we discuss drugs, we often mean chemical drugs. Vaccines are typically classified as biological drugs. Both follow similar paths and rules in terms of preclinical research, manufacturing, clinical trials, government approval, and post-licensure usage surveillance and monitoring. However, drugs and vaccines have many differences . For example, vaccines are typically administered to healthy people, and drugs to patients with various diseases. As a result, it is more difficult to assess the safety of drugs compared to vaccines. The mechanisms are also different. Vaccines rely on the stimulation of protective immune responses, while drugs focus on pathway intervention. Drugs and vaccines are often regulated by different government agents. For example, in the USA, vaccines are regulated by the Center for Biologics (CBER) at the Food and Drug Administration (FDA), and drugs are regulated by the Center for Drug Evaluation and Research (CDER) at FDA. The safety surveillance of vaccines is mostly carried out by the Center for Disease Control (CDC), and the surveillance of drugs is managed by the FDA in the USA. Given these similarities and differences, it remains important for researchers and agents to collaborate and keep close communications for productive studies of both vaccines and drugs.
In the time of precision medicine and big data, there has been a huge challenge in organizing, integrating, and analyzing various vaccine and drug related data. The big data can be defined by the typical 4 V model: high volume, high variety, high velocity, and high veracity (data quality and data value) . Such big data cannot be easily analyzed without machine interpretation and automated understanding and analysis. Such work will need machine-understandable standardized controlled terminologies. Furthermore, we also need to have machines to fully understand the meanings and relations of the controlled terms. This is why we need ontology, which is an extension to the early generation of biomedical terminologies.
Over the last decades, we have learned a lot about biomedical ontologies and terminologies and how they can support public health and basic biomedical research. Before the report of the Gene Ontology (GO) , we know many biomedical terminologies, such as MeSH (Medical Subject Headings) used in PubMed literature indexing, MedDRA for adverse event reporting, and SNOMED for electronic exchange of clinical health information. Ontology is an update of terminology. The wide use of GO made researchers understand the importance of ontology and motivate the development and applications of various ontologies. Nowadays, hundreds of ontologies, such as the Drug Ontology (DrON)  and the Ontology of Adverse Events (OAE) , are available. The more recent review article in New England Journal of Medicine highlights the critical role of ontologies in standardization, classification, integration, and analysis of various types of knowledge and data associated with diseases, mechanisms, and precision medicine .
The VDOS workshop series have continuously provided a platform for sharing new development and applications of vaccine- and drug-related ontologies, discussing challenges and solutions in the fields, and promoting collaborations among researchers. These workshops usually cover two main areas of topics. One topic is the ontology representation of drugs and vaccines and their associated topics such as adverse event, prescriptions, and molecular mechanisms. The other topic covers various applications of the ontologies in real-world situations such as text mining, machine learning, and software development. Basic and translational research as well as clinical subjects have been widely covered.
The 7th International Workshop on Vaccine and Drug Ontology Studies (VDOS-2018; https://sites.google.com/site/vdosworkshop/VDOS-2018) was held at Corvallis, Oregon, USA, on August 10, 2018. This workshop was part of the ninth International Conference on Biomedical Ontology (ICBO-2018). Overall, VDOS-2018 was another successful VDOS meeting. In this Editorial, we would like to first summarize the results of the previous VDOS meetings and then focus on the introduction of the papers presented in the VDOS-2018 workshop.
Brief history of seven VDOSME/VDOS workshops
All the seven VDOS workshops so far were associated with the International Conference on Biomedical Ontology (ICBO) since 2012. The first workshop was named VDOSME-2012, standing for Vaccine and Drug Ontology in the Study of Mechanism and Effect 2012 . VDOSME had an emphasis on mechanisms and effects of vaccines and drugs. To broaden our scope, we later changed our name to Vaccine and Drug Ontology Studies (VDOS). To simplify our discussion, we will simply refer to all the previous seven workshops as VDOS. These workshops were held for three times in USA, two times in Europe (Portugal and UK), and one time each in Austria and Canada (Table 1). Drs. Yongqun “Oliver” He and Cui Tao were co-organizers for all the meetings. Dr. Junguk Hur has served as a co-organizer for the last two VDOS workshops. In addition, Drs. Luca Toldo, Gully Burns, Darrell R Abernethy, Sivaram Arabandi, and Sirarat Sarntivijai had also served as VDOS co-organizers. Dr. Abernethy (1949–2017) , a former Associate Director for Drug Safety in the Office of Clinical Pharmacology at the US FDA, kindly accepted the invitation to join as a co-organizer for the VDOSME-2012 workshop and provided significant help and advice in the workshop organization and Editorial preparation . Dr. Abernethy and all the co-organizers’ service and help are greatly appreciated.
In total, these workshops have accepted 37 full-length papers and 9 short papers (Table 1). We used EasyChair (http://easychair.org) to manage our paper submissions and reviewing. All of the papers were peer-reviewed by at least two experts before their acceptance. All of them were orally presented in the workshops and the authors were invited for submitting an extended research article for publication in peer-reviewed journals. Overall, all of these papers except two (Table 1) have been published in peer-reviewed journals, including Journal of Biomedical Semantics, Biomedical Informatics Insights, or BMC Bioinformatics.
We have had one keynote speaker, Dr. Khalid F. Almoosa, School of Biomedical Informatics, University of Texas Health Science Center at Houston, USA, to present in VDOS-2014 held at Houston. Dr. Almoosa was invited as an expert in the field of clinical bioinformatics research. The invitation of only one keynote presentation is largely due to the shortage of funding. It would be ideal to obtain additional funding to invite experts and governmental officials to present relevant topics.
VDOS-2018 workshop presentation report
In the VDOS 2018 workshop, various international attendees, including paper presenters, senior academic and government scientists, postdoctoral fellows, and graduate students, participated in this workshop. This year, four full-length papers and one short-length paper were accepted for oral presentations at the workshop after a peer-review process with each submission reviewed by at least three independent reviewers. After one additional round of independent peer reviewing on their extended version, with the reviewers’ comments taken care of, by the workshop co-organizers and the journal editors, four full-length papers [40,41,42,43] have been accepted for publication in the current thematic issue of the BMC Bioinformatics.
In the area of ontology mapping, Bona et al.  proposed to improve Drug Ontology (DrOn) , a modular extensible ontology of drug products, their ingredients, and their biological activity. DrOn was originally created to enable comparative effectiveness and health services researchers to query National Drug Codes (NDC), a 10-digit 3-segment numbering system to uniquely represent drug products, issued by the U.S. Food and Drug Administration (FDA). DrOn is constructed based on the RxNorm  drug terminology and Chemical Entities of Biological Interest (ChEBI) . This paper presented an enhancement of the DrOn with semantically rich representations of NDC, which resulted in a prototype that demonstrates the feasibility of this approach. A full accounting of NDC and RxNorm unique concept identifiers as information content entities and of the processes involved in managing their creation and changes has been implemented. The modeling efforts have considered not only assigning a NDC code but also deactivating a NDC, through using some best practice and tooling available from the OBO foundry community. Enabling the correct mappings between NDC codes and RxNorm codes in the context of the DrON ontology is a significantly meaningful effort. The enhanced DrOn will be especially useful in determining what packaged drug product an occurrence of an NDC in a database denotes in case the same code is assigned to different products at different points in time.
In the area of ontology development and representation, Ong et al.  developed a Vaccine Investigation Ontology (VIO) as an extension of the Vaccine Ontology (VO) and applied VIO to classify the different experimental variables and relations among them in the vaccine research. Different responses in the host to the same vaccine are frequently observed in vaccine studies; therefore, it systematically represents different experimental and analysis conditions. The development of VIO followed the eXtensible Ontology Development (XOD) principles  and is aligned with the Basic Formal Ontology (BFO) principles . As a use case, the authors reanalyzed two microarray datasets of live attenuated Yellow Fever vaccine YF-17D, by Gaucher et al. 2008  and Querec et al. , and reanalyzed differentially expressed genes (DEGs) affected by vaccination and their enriched biological functions in terms of Gene Ontology (GO) and Reactome pathways using the same approach as given in these publications. Surprisingly, the study showed a quite significant difference in terms of the number and constitution of differentially expressed genes compared to the published results, which were likely due to the software package differences. Significant differences in DEGs between two studies were also noted, while the GO enrichment results had more overlapping than the gene lists and the enriched pathway lists. This ontology-based analysis framework using VIO will be useful in representing heterogeneous data of host responses to vaccines, where differences in specific variables might explain different results drawn from similar studies.
Amith et al.  presented the development of Patient Health Information Dialogue Ontology (PHIDO) to model dialogue interaction related to health information. PHIDO is the result of an early simulation study involving a conversational agent discussing human papillomavirus (HPV) vaccine information to patients and fielding their questions over the course of the counseling session . From the collected dialogue exchanges between the user and the simulated agent, the researchers derived the conceptual level that describes four basic class abstractions - Discussion, Goal, Speech Task, and Utterance. From this, the ontology offers a foundational framework that could permit the construction of dialogue interaction for software agents. This article outlines several dialogue interaction patterns using the ontology’s features, and introduces a general algorithm for a software engine to harnesses the PHIDO. With PHIDO, there is the potential to formalize health dialogue interaction between software agents and users, align the dialogue ontology to health behavioral models, and provide machines the interaction intelligence to converse in a clinical environment. The overall outcome of this work is to advance the research in using conversational agents in counseling situations for healthcare, particularly in vaccine counseling, which has a dramatic effect on improving vaccination uptake. This is one of few attempts to use ontologically modeling for dialogue systems. The researchers’ future goals include the development of a software engine that utilizes PHIDO to counsel users on the HPV vaccine.
Lastly, Tiftikci et al.  presented a machine learning (ML)- and rule-based system for identifying adverse drug reaction (ADR) mentions in the text of drug labels and their normalization through the Medical Dictionary for Regulatory Activities (MedDRA) dictionary. ADRs, unwanted or unexpected events from using drugs, are a major safety concern, and drug labels describe established ADRs for the given drug. Systematically identifying ADRs from drug labels is critical in multiple aspects, allowing a comparison of ADRs from different manufacturers for the same active ingredient and enabling post-marketing safety analysis by identifying new ADRs not presented in the labels. This paper challenged the ADR identification task, as part of the Text Analysis Conference (TAC) Adverse Drug Reaction 2017 challenge (https://tac.nist.gov/2017/), using ML- and rule-based approaches. The ML approach employed a deep learning architecture, integrating bi-directional Long Short-Term Memory (Bi-LSTM), Convolutional Neural Network (CNN), and Conditional Random Fields (CRF) for entity recognition. Rule- and dictionary-based approach was implemented on their in-house text mining system, SciMiner [35, 52], which was also used for normalizing the identified ADR mentions to MedDRA terms. The ML-based approach outperformed the rule-based approach, achieving a 77.0% F1 score on the task of ADR mention recognition and 82.6% micro-averaged F1 score on the task of ADR normalization. This paper was the first study of utilizing ML approaches presented in VDOS workshops, and we expect to see more studies utilizing similar approaches in the future VDOS workshops.
Overall, the VDOS-2018 workshop covered six full-length paper representations and offered a platform for sharing the results of vaccine- and drug-related ontology development and applications. A lot of positive feedbacks were provided. We also expect to continue this workshop series in the future and make it an attractive event for more and more ontology and application developers and users.
Availability of data and materials
Adverse drug reaction
Basic Formal Ontology
Bi-directional Long Short-Term Memory
Chemical Entities of Biological Interest
Convolutional Neural Network
Differentially expressed genes
Medical Dictionary for Regulatory Activities
National Drug Codes
Patient Health Information Dialogue Ontology
Text Analysis Conference
Vaccine and drug ontology studies
Vaccine Investigation Ontology
eXtensible Ontology Development
He Y, Toldo L, Burns G, Tao C, Abernethy DR. A 2012 workshop: vaccine and drug ontology in the study of mechanism and effect (VDOSME 2012). J Biomed Semantics. 2012;3(1):12.
Onay C, Öztürk E. A review of credit scoring research in the age of big data. J Financial Regulation Compliance. 2018;26(3):382–405.
Ashburner M, Ball CA, Blake JA, Botstein D, Butler H, Cherry JM, Davis AP, Dolinski K, Dwight SS, Eppig JT, et al. Gene ontology: tool for the unification of biology. The gene ontology consortium. Nat Genet. 2000;25(1):25–9.
Hanna J, Joseph E, Brochhausen M, Hogan WR. Building a drug ontology based on RxNorm and other sources. J Biomed Semantics. 2013;4(1):44.
He Y, Sarntivijai S, Lin Y, Xiang Z, Guo A, Zhang S, Jagannathan D, Toldo L, Tao C, Smith B. OAE: the ontology of adverse events. J Biomed Semantics. 2014;5:29.
Haendel MA, Chute CG, Robinson PN. Classification, ontology, and precision medicine. N Engl J Med. 2018;379(15):1452–62.
Hur J, Ozgur A, Xiang Z, He Y. Identification of fever and vaccine-associated gene interaction networks using ontology-based literature mining. J Biomed Semantics. 2012;3(1):18.
Lin Y, He Y. Ontology representation and analysis of vaccine formulation and administration and their effects on vaccine immune responses. J Biomed Semantics. 2012;3(1):17.
Zhu Q, Jiang G, Chute CG. Profiling structured product labeling with NDF-RT and RxNorm. J Biomed Semantics. 2012;3(1):16.
Gurulingappa H, Mateen-Rajput A, Toldo L. Extraction of potential adverse drug events from medical case reports. J Biomed Semantics. 2012;3(1):15.
Doulaverakis C, Nikolaidis G, Kleontas A, Kompatsiaris I. GalenOWL: ontology-based drug recommendations discovery. J Biomed Semantics. 2012;3(1):14.
Tao C, He Y, Yang H, Poland GA, Chute CG. Ontology-based time information representation of vaccine adverse events in VAERS for temporal analysis. J Biomed Semantics. 2012;3(1):13.
Tao C, He Y, Arabandi S. A 2013 workshop: vaccine and drug ontology studies (VDOS 2013). J Biomed Semantics. 2014;5(1):16.
Lin Y, He Y. The ontology of genetic susceptibility factors (OGSF) and its application in modeling genetic susceptibility to vaccine adverse events. J Biomed Semantics. 2014;5:19.
Marcos E, Zhao B, He Y. The ontology of vaccine adverse events (OVAE) and its usage in representing and analyzing adverse events associated with US-licensed human vaccines. J Biomed Semantics. 2013;4(1):40.
Winnenburg R, Bodenreider O. A framework for assessing the consistency of drug classes across sources. J Biomed Semantics. 2014;5:30.
Doulaverakis C, Nikolaidis G, Kleontas A, Kompatsiaris I. Panacea, a semantic-enabled drug recommendations discovery framework. J Biomed Semantics. 2014;5(1):13.
Zhang Y, Tao C, He Y, Kanjamala P, Liu H. Network-based analysis of vaccine-related associations reveals consistent knowledge with the vaccine ontology. J Biomed Semantics. 2013;4(1):33.
Tao C, He Y, Arabandi S. Vaccine and drug ontology studies (VDOS 2014). J Biomed Semantics. 2016;7:6.
Winnenburg R, Sorbello A, Bodenreider O. Exploring adverse drug events at the class level. J Biomed Semantics. 2015;6:18.
Amith M, Gong Y, Cunningham R, Boom J, Tao C. Developing VISO: vaccine information statement ontology for patient education. J Biomed Semantics. 2015;6:23.
Peters LB, Bahr N, Bodenreider O. Evaluating drug-drug interaction information in NDF-RT and DrugBank. J Biomed Semantics. 2015;6:19.
Hur J, Ozgur A, Xiang Z, He Y. Development and application of an interaction network ontology for literature mining of vaccine-associated gene-gene interactions. J Biomed Semantics. 2015;6:2.
Zhang Y, Wu P, Luo Y, Tao C. Identification of sex-associated network patterns in vaccine-adverse event association network in VAERS. J Biomed Semantics. 2015;6:33.
Lin Y, Zheng J, He Y. VICO: ontology-based representation and integrative analysis of vaccination informed consent forms. J Biomed Semantics. 2016;7:20.
Hanna J, Bian J, Hogan WR. An accurate and precise representation of drug ingredients. J Biomed Semantics. 2016;7:7.
Guo A, Racz R, Hur J, Lin Y, Xiang Z, Zhao L, Rinder J, Jiang G, Zhu Q, He Y. Ontology-based collection, representation and analysis of drug-associated neuropathy adverse events. J Biomed Semantics. 2016;7:29.
Zhang Y, Wu HY, Du J, Xu J, Wang J, Tao C, Li L, Xu H. Extracting drug-enzyme relation from literature as evidence for drug drug interaction. J Biomed Semantics. 2016;7:11.
Du J, Cai Y, Chen Y, He Y, Tao C. Analysis of individual differences in vaccine Pharmacovigilance using VAERS data and MedDRA system organ classes: a use case study with trivalent influenza vaccine. Biomed Inform Insights. 2017;9:1178222617700627.
Hogan WR, Hanna J, Hicks A, Amirova S, Bramblett B, Diller M, Enderez R, Modzelewski T, Vasconcelos M, Delcher C. Therapeutic indications and other use-case-driven updates in the drug ontology: anti-malarials, anti-hypertensives, opioid analgesics, and a large term request. J Biomed Semantics. 2017;8(1):10.
Amith M, Tao C. Modulated evaluation metrics for drug-based ontologies. J Biomed Semantics. 2017;8(1):17.
Knowledge Base workgroup of the Observational Health Data S. Informatics c: Large-scale adverse effects related to treatment evidence standardization (LAERTES): an open scalable system for linking pharmacovigilance evidence sources with clinical data. J Biomed Semantics. 2017;8(1):11.
Du J, Xu J, Song H, Liu X, Tao C. Optimization on machine learning based approaches for sentiment analysis on HPV vaccines related tweets. J Biomed Semantics. 2017;8(1):9.
Hur J, Ozgur A, He Y. Ontology-based literature mining of E. coli vaccine-associated gene interaction networks. J Biomed Semantics. 2017;8(1):12.
Hur J, Ozgur A, He Y. Ontology-based literature mining and class effect analysis of adverse drug reactions associated with neuropathy-inducing drugs. J Biomed Semantics. 2018;9(1):17.
Judkins J, Tay-Sontheimer J, Boyce RD, Brochhausen M. Extending the DIDEO ontology to include entities from the natural product drug interaction domain of discourse. J Biomed Semantics. 2018;9(1):15.
Amith M, Tao C. Representing vaccine misinformation using ontologies. J Biomed Semantics. 2018;9(1):22.
Wang J, Zhao L, Ye Y, Zhang Y. Adverse event detection by integrating twitter data and VAERS. J Biomed Semantics. 2018;9(1):19.
Darrell R. Abernethy (1949-2017). Pharmacol Res Perspect 2018, 6(1).
Bona JP, Brochhausen M, Hogan WR: Enhancing the drug ontology with semantically-rich representations of national drug codes and rxnorm unique concept identifiers. BMC Bioinformatics (VDOS 2018).
Ong E, Zheng J, Wu G, He Y: VIO: ontology classification and study of vaccine responses given various experimental and analytical conditions BMC Bioinformatics (VDOS 2018).
Amith M, Roberts K, Tao C: Conceiving an application ontology to model patient human papillomavirus vaccine counseling for dialogue management. BMC Bioinformatics (VDOS 2018).
Tiftikci M, Özgür A, He Y, Hur J: Machine learning-based identification and rule-based normalization of adverse drug reactions in drug labels. BMC Bioinformatics (VDOS 2018).
Hogan WR, Hanna J, Joseph E, Brochhausen M. Towards a consistent and scientifically accurate drug ontology. CEUR Workshop Proc. 2013;1060:68–73.
Parrish F, Do N, Bouhaddou O, Warnekar P. Implementation of RxNorm as a terminology mediation standard for exchanging pharmacy medication between federal agencies. AMIA Annu Symp Proc. 2006;1057.
Degtyarenko K, de Matos P, Ennis M, Hastings J, Zbinden M, McNaught A, Alcantara R, Darsow M, Guedj M, Ashburner M. ChEBI: a database and ontology for chemical entities of biological interest. Nucleic Acids Res. 2008;36(Database issue):D344–50.
He Y, Xiang Z, Zheng J, Lin Y, Overton JA, Ong E. The eXtensible ontology development (XOD) principles and tool implementation to support ontology interoperability. J Biomed Semantics. 2018;9(1):3.
Smith B, Ashburner M, Rosse C, Bard J, Bug W, Ceusters W, Goldberg LJ, Eilbeck K, Ireland A, Mungall CJ, et al. The OBO foundry: coordinated evolution of ontologies to support biomedical data integration. Nat Biotechnol. 2007;25(11):1251–5.
Gaucher D, Therrien R, Kettaf N, Angermann BR, Boucher G, Filali-Mouhim A, Moser JM, Mehta RS, Drake DR 3rd, Castro E, et al. Yellow fever vaccine induces integrated multilineage and polyfunctional immune responses. J Exp Med. 2008;205(13):3119–31.
Querec TD, Akondy RS, Lee EK, Cao W, Nakaya HI, Teuwen D, Pirani A, Gernert K, Deng J, Marzolf B, et al. Systems biology approach predicts immunogenicity of the yellow fever vaccine in humans. Nat Immunol. 2009;10(1):116–25.
Amith M, Zhu A, Cunningham R, Lin R, Savas L, Shay L, Chen Y, Gong Y, Boom J, Roberts K, et al. Early usability assessment of a conversational agent for HPV vaccination. Stud Health Technol Inform. 2019;257:17–23.
Hur J, Schuyler AD, States DJ, Feldman EL. SciMiner: web-based literature mining tool for target identification and functional enrichment analysis. Bioinformatics. 2009;25(6):838–40.
As editors of this thematic issue, we thank all the authors who submitted their research papers, the Program Committee members and the reviewers for their excellent work. We appreciate the support and help from the International Conference on Biomedical Ontology (ICBO 2018) meeting organizers.
About this supplement
This article has been published as part of BMC Bioinformatics Volume 20 Supplement 21, 2019: Selected articles from the 7th International Workshop on Vaccine and Drug Ontology Studies (VDOS-2018). The full contents of the supplement are available online at https://bmcbioinformatics.biomedcentral.com/articles/supplements/volume-20-supplement-21.
The authors received no specific funding for this work.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Hur, J., Tao, C. & He, Y. A 2018 workshop: vaccine and drug ontology studies (VDOS 2018). BMC Bioinformatics 20 (Suppl 21), 705 (2019). https://doi.org/10.1186/s12859-019-3191-9
- VDOS workshop
- Knowledge standardization
- Data integration
- Adverse event
- Text mining