Skip to main content

Advertisement

CirGO: an alternative circular way of visualising gene ontology terms

Abstract

Background

Prioritisation of gene ontology terms from differential gene expression analyses in a two-dimensional format remains a challenge with exponentially growing data volumes. Typically, gene ontology terms are represented as tree-maps that enclose all data into defined space. However, large datasets make this type of visualisation appear cluttered and busy, and often not informative as some labels are omitted due space limits, especially when published in two-dimensional (2D) figures.

Results

Here we present an open source CirGO (Circular Gene Ontology) software that visualises non-redundant two-level hierarchically structured ontology terms from gene expression data in a 2D space. Gene ontology terms based on statistical significance were summarised with a semantic similarity algorithm and grouped by hierarchical clustering. This software visualises the most enriched gene ontology terms in an informative, comprehensive and intuitive format that is achieved by organising data from the most relevant to the least, as well as the appropriate use of colours and supporting information. Additionally, CirGO is an easy to use software that supports researchers with little computational background to present their gene ontology data in a publication ready format.

Conclusions

Our easy to use open source CirGO Python software package provides biologists with a succinct presentation of terms and functions that are most represented in a specific gene expression data set in a visually appealing 2D format (e.g. for reporting research results in scientific articles). CirGO is freely available at https://github.com/IrinaVKuznetsova/CirGO.git.

Background

Advances in next generation sequencing technologies have led to the generation of large volumes of digital data. Consequently, this has resulted in the development of bioinformatics tools that use knowledge from various computational and biological disciplines to display these large amounts of data in accessible ways. RNA sequencing (RNA-Seq) has become the gold standard for analysing gene expression changes in diverse biological organisms and systems [1,2,3,4,5]. RNA-Seq datasets are analysed and processed according to algorithms and statistical techniques that identify significantly altered transcripts from whole transcriptomes [3]. The identified changes in transcripts need to be organised and prioritised in categories according to their functional properties and relationships using Gene Ontology (GO) enrichment analyses.

The GO project initiative aims to organise current biological knowledge of genes and gene products in a structured and consistent way. The main purpose of the GO project is to: (1) provide a uniform vocabulary; (2) control and provide relationships of genes and gene products; and (3) provide accessible data structures that can be updated, accessed, or retrieved at any time due to the dynamic changing nature of the biological field [6,7,8,9]. The GO project comprises of two main concepts: the GO ontology and GO annotations [6,7,8, 10, 11]. The GO ontology entries are called GO terms that describe gene functions and show relationships between them. GO terms have a hierarchical directed acyclic graph structure that is similar to the structure of hierarchical trees [6,7,8,9,10]. A descendant (child) in the hierarchical directed acyclic graph can have multiple ancestors (parents), whereas in the case of the hierarchal layout the descendant can have only one ancestor. Importantly, the GO developers offer three GO editions such as GO-basic, GO, and GO-plus, where only the GO-basic version has an acyclic graph structure [6, 7]. More detailed description on the GO and GO-plus editions can be found in Chapter 11 of the Gene Ontology handbook  [6] or GO website [7]. The GO annotations on the other hand, signify an association of a gene to a specific GO term. In addition, GO terms are categorised as three distinct gene functions: molecular function, cellular component, and biological process [6,7,8,9]. The GO data is regularly curated by the GO consortium and can be found at the GO website [7].

GOs are commonly used to interpret results from high-throughput experiments by using a process called enrichment analysis. GO enrichment analyses generate GO terms based on statistically significant changes in gene expression or proteomic data [6, 8]. The identified GO terms that represent the statistically significant changes in datasets are then visualised. Frequently the number of GO terms in gene expression datasets are large, and it is currently a challenge to provide a non-redundant and biologically succinct list of GO terms. Therefore, visualisation methods aim to summarise and help to reveal identified patterns within the data in a comprehensive and biologically meaningful manner. A broad range of visualisation techniques have been developed to allow researchers to explore GO terms related to their data. These rely on two and three dimensional (2D/3D) graphic images, web-based presentations, or interactive visualisation to gain new insights. The traditional and intuitive way of visualising a hierarchical directed acyclic graph makes use of tree-based diagrams. GoMiner [12], RamiGO [13], Gorilla [14] and AmiGO [15] are GO enrichment tools, where GO enrichment analysis for the AmiGO software is provided by the PANTHER tool [16]. These tools utilise tree diagrams to represent GO terms, although some of these have not been updated for current use and produce images that are not practical for research publications.

To provide an example, GOrilla is web-based software used for GO enrichment analysis, that is capable of visualising partial hierarchy of GO terms as a tree diagram, where coloured boxes represent significantly enriched terms [6, 14]. However, it is often impractical to present a tree diagram in a 2D space with large datasets, particularly when it comes to publishing and presenting of the data in scientific journals and at meetings. This shortcoming also relates to other methods that utilise space-filling techniques, which omit important details such as labels when presented. For example, the method proposed by Supek and colleagues [17] aims to summarise a list of provided GO terms by removing redundant terms. Their tool called REVIGO, applies the semantic similarity method accompanied with the neighbor-joining clustering approach that results in two-level hierarchical structured data [6, 17,18,19,20]. One level represents an ancestor, and the secondary levels are related and similar in meaning descendants. In addition, REVIGO offers visualisation of results as a tree-map plot lacking important details that we discuss within this publication.

The organisation of data into two-level hierarchical modes leads to the use of space-filling visualising techniques. Space-filling techniques were developed to enable all provided data to fit into a defined space. Tree-maps belong to a space-filling technique that display hierarchical data as nested rectangles [21]. They provide a good overview of results, however large datasets make space-filling techniques less informative. Some information, such as labels, is often omitted if they cannot fit into a defined space. Additionally, the rectangular shapes in tree-maps are less intuitive when estimating their size within the dataset.

We used a two-level hierarchical format generated by REVIGO software to develop a 2D visualisation of GO terms. We considered, the most advantageous features of existing visualisation methods, to make images  more comprehensible [22]. Our CirGO method enables the visualisation of GO terms as: (1) a neat and simple image that was achieved by properly organising GO terms on a circular visualisation plot; (2) preservation of details as such as all labels with the same font size, representation of each cluster by its own colour, sorting of the resulting data from the most significant to the least significant in a clockwise way, a legend that provides supporting information for a slice size, and a colour based grouping to correlate a parent label to a group; (3) an intuitive, self-explanatory image of the most relevant findings, where the relevance is defined by statistical significance (such as p-values); (4) an informative, and detailed visualisation of multiple different parameters as “parent”, “child” labels, and slice proportion; (5) the use of colours and colour gradients as visual aids to guide viewers to the most represented GO terms.

Implementation

CirGO is a visualisation software that provides users with a static 2D visualisation (Fig. 1) of GO terms and can be used for publishing and presentations. The visualisation script was developed as a Python package and uses Python 2.7.14, Matplotlib 2.1.0 [23] and the GUI components with TkInter (Tcl/Tk) [24], and is freely available at [25].

Fig. 1
figure1

Example of CirGO image plot

The CirGO visualisation algorithm consists of the following three basic steps, which are also illustrated in Fig. 2.

  • Formatting step: converting and preparing a REVIGO file to a processing file;

  • Values calculation step: calculating, and organising values required for plotting;

  • Visualisation step: visualising the data and generating the final image.

Fig. 2
figure2

Schematic representation of the CirGO algorithm workflow. The algorithm workflow consists of three main steps: I. Formatting, II. Values calculation, and III. Visualisation. Main parameters are represented on the image as follows: n- represents number of input file rows; m- represents number of categories that will be visualised

The algorithm converts a regular REVIGO file into an intermediate file, which is used to create an image as shown in Fig. 2. The final plot represents a two-layer full hierarchical structure, and consists of an inner ring, and outer ring. The inner ring represents parent records, and the outer ring child records. Precise algorithm descriptions and a tutorial on how to use CirGO software are available in the Additional file 1 and GitHub page at [25].

GO categories can be determined from a provided gene list for any organism studied that is supported by functional annotation software, such as DAVID [26]. As an example, we present a list of two-level hierarchically structured GO terms that was obtained from the REVIGO Web server, which applies semantic similarity algorithm and a neighbor-joining approach to cluster data [17, 27]. The output file was formatted with fields designated as “representative”, “description”, and the absolute value of the “log10pval”, that define parent and child records as well as the slice size, respectively.

Initially, the input data is sorted based on the absolute value of the log10pval column from the largest to smallest value. Then, a number, m, of desired categories (or number of child categories) is selected for the visualisation, and the input data is subset to this number. Unique parent records that represent the inner circle categories are extracted. All log10 p-values that do not fall into the m desired categories (the largest p-values from the significant range dataset) are summed up, annotated as “additional categories”, and assigned to the related inner circle categories respectively. This process results in the addition of a number of slices to a number m of desired categories. All outer ring values are sorted from the largest to smallest for each represented slice. Although combining all the small values in this category increases each slice size, it is placed within the output in the position of the smallest value, so that it corresponds to their statistical significance.

Results and discussion

Comparison to tree-maps

The aim of the CirGO software was to generate visualisation that summarises GO terms from gene expression datasets in 2D space. We compared the CirGO visualisation performance (Fig. 1) to tree-maps (Fig. 3), where the input data is organised as a two-level hierarchy to demonstrate the advantages of the CirGO software. Visualisation of GO terms using CirGO provides several major advantages. First, it is an intuitive prioritisation of the most significantly changing parent GO terms as the largest slices of the chart in order of significance. Comparable to tree-maps visualisation we present all input data, but in our CirGO implementation we can intuitively order and consequently single out the most significantly affected GO terms. The second major advantage is the use of parent and child parameters, which enables us to deposit multiple child GO terms related to a parent category. Thereby we remove overcrowding through listing every GO term as in a tree-map presentation. As a final advantage, the use of parent and child categories in our CirGO environment eliminates the overlap between common terms and the redundancy found on tree-map presentations.

Fig. 3
figure3

Example of a tree-map visualisation plot. The circles indicate inconsistency in the font labels. The rectangles indicate absence of child labels. The triangles indicate overlap between parent and child labels

To make tree-map plots and our visualisation approach comparable we prepared the tree-map input data (which is the output from REVIGO) in the same format as for the CirGO environment. The chosen number of visualised child categories (m) was limited to 40. In addition to the 40 desired child categories, 8 additional slices were included and labelled as “additional categories” to retain the same structure of the input data. As a result of using a space-filling technique we were successful in making use of the whole data and fit it into a defined 2D space. The tree-map in Fig. 3 was generated with Treemap R package [28], which was created with the in-house script available at [25]. Although, the provided space was utilised, the order of significance and priority of each category is not intuitively clear as in our CirGO visualisation (Fig. 1). Below we discuss additional improvements, which are provided by our CirGO visualisation software in visualising GO terms.

Colour

Tree-maps apply various colours, where each colour indicates a parent term. Child terms have the same colour as the parent term. Our CirGO visualisation uses effective colour palettes generated by Colorgorical web-based tool that enables to distinguish parent terms from each other [29]. Moreover, child terms in CirGO employ gradient colours that are distributed from the darkest to lightest of the related parent colour to indicate the significance of the term from most to least significant, respectively. The gradient was created with Seaborn Python library [30]. Our CirGO visualisation also labels the parent slices with supporting labels “GO-number” that correlates the parent labels to the legend, and also as an indicator for colour vision impaired individuals.

Values and shapes

The size of the rectangular shapes on tree-maps can be misinterpreted by users. The layout of the rectangles depends on the algorithm used to display the data. However, there is the same concern in the visualisation community regarding the size of the pie chart slices. To overcome this problem, our CirGO software is supporting numerical information located at the legend that helps to evaluate the size of each slice on the pie chart. In addition, child values are sorted from the most significant to the least. This helps to intuitively understand that the subsequent slice size is smaller than the previous one. Moreover, CirGO visualisation has an intuitive distribution of labels in a clockwise way, which is not supported by tree-maps. The rectangular flow of tree-maps is not as intuitive and depends highly on the applied algorithm.

Font size

Tree-maps try to fit labels into the provided rectangular space that results in various labels and font size in one plot. There is an option that enables to retain the same font size, however this leads to the omission of some labels that do not fit into the provided space (Fig. 3). In contrast, CirGO displays all labels with the same font size providing consistency in publishing.

Pros and cons

Tree-maps fill out the provided space entirely and present all the terms, albeit in inconsistent font and order of priority which can frequently use common and redundant categories. Although CirGO is a circular visualisation, the advantage of this visualisation lays in its intuitive ordering of prioritised parent categories and use of non-redundant terms.

Conclusions

In summary, our CirGO visualisation has a two-layer hierarchy, where the inner circle represents a parent record or node. The outer circle is composed of one or more of the descendants of the parent, which are referred to as child records or nodes. Each category of the inner circle is reflected in the legend and supported with a related colour and text identifier “GO-number” catering to colour impaired individuals. Child nodes are organised as follows: each category of the child relates to one parent, that represents semantically similar term. These are sorted based on absolute log10 p-value from the smallest to largest, and a colour gradient is applied to highlight the largest to smallest value distribution. The GO analyses produce many final categories, which leads to cognitive overload if all of them are visualised. Therefore, we defined only a selected number of categories that are visualised. This number has to be pre-selected based on the underlying analysis data and can include up to 60 categories. To merge remaining categories under a certain value into one named “additional category”, we utilised thresholding. To demonstrate the strengths and advantage of our method, we have used a dataset of GO terms identified in a model of heart disease [31]. We visualised the most relevant and affected biological processes upon knockout of a gene, which is essential for survival and development (Fig. 1).

In conclusion, our Python-based open access CirGO software supports the visual analysis process through the representation of the most relevant GO terms in an appealing and intuitive way. A special feature of the tool is that it does not omit any related information. It creates an appealing visualisation, which easily fits within journal articles and other presentation formats. Succinctly it identifies the major findings from gene expression analyses. It is also very easy to use by scientists without any programming skills. Our CirGO software is a freely available Python package, eliminating the requirement for programming skills to visualise two-level hierarchical and redundant GO data in 2D format. It can be downloaded from [25]. Our CirGO software is licensed under the terms of the GNU general public license (version 3). This means it is a free software tool, which can be freely re-distributed and/or modified under the terms of the GNU General Public License v.3 as defined by the Free Software Foundation.

Availability and requirements

Project name: CirGO

Project home page: https://github.com/IrinaVKuznetsova/CirGO.git

Operating system(s): Windows, Unix, MacOS

Programming language: Python 2.7+

Other requirements: NumPy 1.13.1, Matplotlib 2.1.0, Seaborn 0.8.1

License: GNU General Public License (version 3)

Any restrictions to use by non-academics: none

Abbreviations

GO:

Gene ontology

RNA-Seq:

RNA sequencing

References

  1. 1.

    Chu Y, Corey DR. RNA sequencing: platform selection, experimental design, and data interpretation. Nucleic Acid Ther. 2012;22(4):271–4. https://doi.org/10.1089/nat.2012.0367 Mary Ann Liebert, Inc., publishers.

  2. 2.

    Mortazavi A, Williams BA, Mccue K, Schaeffer L, Wold B. Mapping and quantifying mammalian transcriptomes by RNA-Seq. Nat Methods. 2008;5(7):621–8. https://doi.org/10.1038/NMETH.1226.

  3. 3.

    Costa-Silva J, Domingues D, Lopes FM. RNA-Seq differential expression analysis: an extended review and a software tool. PLoS One. 2017;12(12):1–18. https://doi.org/10.1371/journal.pone.0190152 Public Library of Science.

  4. 4.

    Wilhelm BT, Marguerat S, Watt S, Schubert F, Wood V, Goodhead I, et al. Dynamic repertoire of a eukaryotic transcriptome surveyed at single-nucleotide resolution. Nature. 2008;453(7199):1239–43. https://doi.org/10.1038/nature07002 Nature Publishing Group.

  5. 5.

    Nagalakshmi U, Wang Z, Waern K, Shou C, Raha D, Gerstein M, et al. The transcriptional landscape of the yeast genome defined by RNA sequencing. Science (New York, N.Y.). 2008;320(5881):1344–9. https://doi.org/10.1126/science.1158441 American Association for the Advancement of Science.

  6. 6.

    Bauer S. Gene-category analysis. In: Dessimoz C, Škunca N, editors. The gene ontology handbook. New York: Springer New York; 2017. p. 175–88. https://doi.org/10.1007/978-1-4939-3743-1_13.

  7. 7.

    Gene Ontology Consortium. Available from: http://www.geneontology.org/. Accessed 25 Jan 2019.

  8. 8.

    Carbon S, Dietze H, Lewis SE, Mungall CJ, Munoz-Torres MC, Basu S, et al. Expansion of the gene ontology knowledgebase and resources: the gene ontology consortium. Nucleic Acids Res. 2017;45(D1):D331–8 Oxford University Press.

  9. 9.

    Kuśnierczyk W. Taxonomy-based partitioning of the gene ontology. J Biomed Inform. 2008;41(2):282–92 Available from: http://www.sciencedirect.com/science/article/pii/S1532046407000809.

  10. 10.

    Yon Rhee S, Wood V, Dolinski K, Draghici S. Use and misuse of the gene ontology annotations. Nat Rev Genet. 2008;9(7):509–15. https://doi.org/10.1038/nrg2363 Carnegie Institution for Science, Department of Plant Biology, 260 Panama Street, Stanford, California 94305, USA.: Nature Publishing Group.

  11. 11.

    Lovering RC, Camon EB, Blake JA, et al. Access to immunology through the Gene Ontology. Immunology. 2008;125(2):154–60. https://doi.org/10.1111/j.1365-2567.2008.02940.x Blackwell Publishing.

  12. 12.

    Zeeberg BR, Feng W, Wang G, Wang MD, Fojo AT, Sunshine M, et al. GoMiner: a resource for biological interpretation of genomic and proteomic data. Genome Biol. 2003;4(4):R28+. https://doi.org/10.1186/gb-2003-4-4-r28 Genomics and Bioinformatics Group, Laboratory of Molecular Pharmacology, National Cancer Institute, National Institutes of Health, Bethesda, MD 20892, USA.

  13. 13.

    Schröder MS, Gusenleitner D, Quackenbush J, Culhane AC, Haibe-Kains B. RamiGO: an R/Bioconductor package providing an AmiGO Visualize interface. Bioinformatics. 2013;29:666–8 Available from: http://bioinformatics.oxfordjournals.org/content/29/5/666.full.

  14. 14.

    Eden E, Navon R, Steinfeld I, Lipson D, Yakhini Z. GOrilla: a tool for discovery and visualization of enriched GO terms in ranked gene lists. BMC Bioinf. 2009;10(1):48+. https://doi.org/10.1186/1471-2105-10-48.

  15. 15.

    Carbon S, Ireland A, Mungall CJ, Shu S, Marshall B, Lewis S, et al. AmiGO: online access to ontology and annotation data. Bioinformatics. 2009;25(2):288–9. https://doi.org/10.1093/bioinformatics/btn615 Oxford University Press.

  16. 16.

    Thomas PD, Campbell MJ, Kejariwal A, Mi H, Karlak B, Daverman R, et al. PANTHER: A library of protein families and subfamilies indexed by function. Genome Res. 2003;13(9):2129–41. https://doi.org/10.1101/gr.772403 Protein Informatics, Celera Genomics, Foster City, California 94404, USA. paul.thomas@fc.celera.com.

  17. 17.

    Supek F, Bošnjak M, Škunca N, Šmuc T. REVIGO summarizes and visualizes long lists of gene ontology terms. PLoS One. 2011;6(7):1–9. https://doi.org/10.1371/journal.pone.0021800 Public Library of Science.

  18. 18.

    Pesquita C, Faria D, Falcão AO, Lord P, Couto FM. Semantic similarity in biomedical ontologies. PLoS Comput Biol. 2009;5(7):e1000443+. https://doi.org/10.1371/journal.pcbi.1000443 Public Library of Science.

  19. 19.

    Harispe S, Sánchez D, Ranwez S, Janaqi S, Montmain J. A framework for unifying ontology-based semantic similarity measures: A study in the biomedical domain. J Biomed Inform. 2013; Available from: http://www.sciencedirect.com/science/article/pii/S1532046413001834.

  20. 20.

    Saitou N, Nei M. The neighbor-joining method: a new method for reconstructing phylogenetic trees. Mol Biol Evol. 1987;4(4):406–25. https://doi.org/10.1093/oxfordjournals.molbev.a040454.

  21. 21.

    Shneiderman B. Tree visualization with tree-maps: 2-d space-filling approach. ACM Trans Graph. 1992;11(1):92–9. https://doi.org/10.1145/102377.115768 New York, NY, USA: ACM.

  22. 22.

    Lugmayr A, Stockleben B, Scheib C, A. Mailaparampil M. Cognitive big data - survey and review on big data research and it’s implications: what is really new in big data? J Knowl Manag. [Internet]. 2017;21(1):197–212. Available from: https://doi.org/10.1108/JKM-07-2016-0307.

  23. 23.

    Hunter JD. Matplotlib: A 2D graphics environment. IEEE Computer Soc. 2007;9(3):90–5 Computing in Science & Engineering.

  24. 24.

    Tkinter — Python interface to Tcl/Tk [Internet]. Available from: https://docs.python.org/2/library/tkinter.html. Accessed 25 Jan 2019.

  25. 25.

    Kuznetsova I. CirGO. 2018. Available from: https://github.com/IrinaVKuznetsova/CirGO.git

  26. 26.

    Huang DW, Sherman BT, Lempicki RA. Systematic and integrative analysis of large gene lists using DAVID bioinformatics resources. Nat Protoc. 2009;4(1):44–57. https://doi.org/10.1038/nprot.2008.211 Nature Publishing Group.

  27. 27.

    REViGO [Internet]. Available from: http://revigo.irb.hr/. Accessed 25-01-2019.

  28. 28.

    Tennekes M. Treemap: treemap visualization. 2017. Available from: https://CRAN.R-project.org/package=treemap

  29. 29.

    Gramazio CC, Laidlaw DH, Schloss KB. Colorgorical: Creating discriminable and preferable color palettes for information visualization. IEEE Transactions on Visualization and Computer Graphics. 2017;23(1):521–30.

  30. 30.

    Waskom M, Botvinnik O, O’Kane D, Hobson P, Lukauskas S, Gemperline DC, et al. mwaskom/seaborn: v0.8.1 (September 2017); 2017. https://doi.org/10.5281/zenodo.883859.

  31. 31.

    Rackham O, Busch JD, Matic S, Siira SJ, Kuznetsova I, Atanassov I, et al. Hierarchical RNA processing is required for mitochondrial ribosome assembly. Cell Rep. 2016;16(7):1874–90. Available from: https://www.sciencedirect.com/science/article/pii/S2211124716309494.

Download references

Acknowledgments

We thank Rui Hou for help with the colour gradient function. We also thank researchers from the Harry Perkins Institute of Medical Research for valuable comments and feedback on CirGO.

Funding

This project was supported by fellowships and project grants awarded to AF and OR from the National Health and Medical Research Council (NHMRC) and the Australian Research Council (ARC). The funding bodies had no role in the design, analysis and interpretation of the data for the work. OR was supported by the Cancer Council of Western Australia, and IK and SS are supported by the UWA Postgraduate Scholarships.

Availability of data and materials

The test data was obtained from GEO GSE83471. The Jan 2017 version of the GO ontology and annotations was used. All required test files can be found at https://github.com/IrinaVKuznetsova/CirGO.git.

Author information

IK contributed to all stages of the CirGO project such as the algorithm design, script implementation, software development, and manuscript writing. AL contributed to the supervision of the software design, software implementation, and manuscript writing. SJS contributed to the manuscript writing process. OR supervised the software design, and implementation, and manuscript writing. AF acted as a principal supervisor of the project and contributed to each stage of the project and manuscript writing. All authors read and approved the final manuscript.

Correspondence to Irina Kuznetsova or Aleksandra Filipovska.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

The file contains the manual, directions and tuturial for the installation and use of the software described in this manuscript. (DOCX 515 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Keywords

  • Gene ontology terms
  • Visualisation
  • Data organisation
  • Python
  • Bioinformatics