ANDDigest: a new web-based module of ANDSystem for the search of knowledge in the scientific literature
BMC Bioinformatics volume 21, Article number: 228 (2020)
The rapid growth of scientific literature has rendered the task of finding relevant information one of the critical problems in almost any research. Search engines, like Google Scholar, Web of Knowledge, PubMed, Scopus, and others, are highly effective in document search; however, they do not allow knowledge extraction. In contrast to the search engines, text-mining systems provide extraction of knowledge with representations in the form of semantic networks. Of particular interest are tools performing a full cycle of knowledge management and engineering, including automated retrieval, integration, and representation of knowledge in the form of semantic networks, their visualization, and analysis. STRING, Pathway Studio, MetaCore, and others are well-known examples of such products. Previously, we developed the Associative Network Discovery System (ANDSystem), which also implements such a cycle. However, the drawback of these systems is dependence on the employed ontologies describing the subject area, which limits their functionality in searching information based on user-specified queries.
The ANDDigest system is a new web-based module of the ANDSystem tool, permitting searching within PubMed by using dictionaries from the ANDSystem tool and sets of user-defined keywords. ANDDigest allows performing the search based on complex queries simultaneously, taking into account many types of objects from the ANDSystem’s ontology. The system has a user-friendly interface, providing sorting, visualization, and filtering of the found information, including mapping of mentioned objects in text, linking to external databases, sorting of data by publication date, citations number, journal H-indices, etc. The system provides data on trends for identified entities based on dynamics of interest according to the frequency of their mentions in PubMed by years.
The main feature of ANDDigest is its functionality, serving as a specialized search for information about multiple associative relationships of objects from the ANDSystem’s ontology vocabularies, taking into account user-specified keywords. The tool can be applied to the interpretation of experimental genetics data, the search for associations between molecular genetics objects, and the preparation of scientific and analytical reviews. It is presently available at https://anddigest.sysbio.ru/.
The vast amounts of published biomedical literature has made extremely urgent the problem of an effective automated finding of necessary information. The popular search engines, such as Google Scholar, PubMed, Scopus, and Web of Knowledge, are powerful universal tools for keyword-based document search without linking to any specific field of knowledge [1,2,3]. Text-mining of scientific publications is an alternative to such searching, providing automated extraction and formalized representation of specific information .
Text-mining-based systems are commonly dedicated to the solving of two types of tasks: the tasks of named-entity recognition (NER) and relationship extraction (RE). NER tasks consist of recognizing the names of all entities mentioned in text. Such objects are usually linked to the corresponding entries in external databases, featuring descriptions of their structural and functional properties. For example, proteins/genes are often associated with Uniprot/Entrez gene databases [5, 6] and chemical compounds with PubChem . The RE task is comprised of identification of all relationships between the recognized objects mentioned in a document.
Many methods have been proposed for dealing with a NER problem, based both on the use of manually specified rules and templates, and on traditional machine-learning approaches. For example, the POSBioTM-NER system  provides an automated recognition of biomedical terms by combining support vector machine (SVM) and conditional random field (CRF) approaches, while the information surrounding morphological features, parts of speech, and collocations of words are used as a set of features. Finkel and colleagues  used the features of the analysed texts and external resources to determine the biomedical named objects. ABNER  and Gimli  are examples of open-source CRF-based NER tools. With this, Tsuruoka et al.  developed a system for mapping of biomedical sequences, entitled GENIA Tagger, by employing the maximum entropy model and tagging algorithm. In the work of Chang et al. , the authors introduced biomedical word embeddings into the CRF model as additional input data, which allowed them to achieve significant improvement of the model. PowerBioNE is a hidden Markov model (HMM)-based NER system developed by Zhou et al. , which used various evidential features to deal with a naming conventions problem, while the K-nearest neighbour (KNN) approach was applied for solving of the data sparseness problem. NERBio  is an example of a rule-based system. The skip-chain CRF tool, proposed by Liao and Wu , implements the conventional machine-learning method, which is a representative of traditional machine-learning approaches. Wei et al.  proposed the combined use of a bidirectional long short-term memory network (BiLSTM) and CRF, which showed better results in comparison with rule-based and conventional-based systems. This approach provides a more complete contextual information and allows for more effective dealing with problems related to the inability to handle the strong dependence on tags in the sequence. Deep neural networks also are used in NER tasks. In particular, with the HUNER system , the LSTM-CRF approach was employed for dealing with these tasks.
Various methods are also being used to solve the RE problem, such as, for example, co-occurrence, template-based or rule-based approaches, along with machine learning, including feature-based, kernel-based, recurrent neural networks (RNN), and others. At the basis of co-occurrence-based approaches lies the assumption that keywords co-occurring together in the same text can be functionally related . Such methods allow performing just an analysis of frequencies of occurrence of keywords in text. At the same time, they do not provide any information regarding the type of relationship between the concepts corresponding to keywords. Also, such methods normally have lower precision in comparison to natural language processing (NLP)-based algorithms . However, despite the aforementioned shortcomings, they have earned great practical use because of simplicity .
The first generations of template-based systems utilized regular expressions to match words describing relationships between entities . Most of such templates consisted of names of objects and additional sets of keywords representing relationships between them, for example “trigger” and “stimulate.” Later generations of tools additionally began to use other approaches, such as part-of-speech (POS) tagging . At the same time, many rule-based systems also applied various constraints for dealing with challenging issues in terms of expression by templates, such as negative relationships . Some rule-based systems distance themselves from template-based approaches by replacing regular expressions with heuristic algorithms and sets of procedures . Unlike the co-occurrence-based methods, the use of manually defined rules and templates often allows authors to achieve high values of accuracy, but they tend to have low completeness . Several automated methods of rules and templates generation were proposed for dealing with this problem [27, 28]. RLIMS-P [29, 30] and MinePhos  are examples of template-based tools, both using rule-based templates for mining information on phosphorylation from the literature.
Most of the machine-learning (ML) methods, commonly employed in RE tasks, typically require a large set of annotated biomedical cases (supervised learning). These textual corpora usually pass pre-processing by NLP tools and then are applied as training sets for the construction of classification models. Among the Machine Learning methods, the most widely known are Naive Bayesian Classifier, HMM, SVM, Artificial Neural Networks (ANN), etc. [32,33,34]. These classifiers can use various functions intended to represent different characteristics of data (e.g., shortest path, bag-of-words (BOW), POS tagging) .
In recent years, deep-learning techniques, such as RNN, have proved to lead to outstanding results for various NLP tasks, including the RE. Considerable increases in performance were produced using the convolutional [36, 37] and recurrent neural networks  approaches. The success of deep learning in biomedical NLP is partly related to the development of vector models of words, such as Word2Vec  and, more recently, ELMo , BERT , GPT , Transformer-XL , and GPT-2 . These models learn word vector representations, capturing the syntactic and semantic relationships of words, and are known as word embeddings.
Among the computer programs that apply text-mining methods for the automated extraction of biomedical knowledge, special attention should be paid to information systems implementing a so-called full cycle of engineering and knowledge management. This includes retrieval, integration, and presentation of knowledge to the end-user, as well as allowing the performing of various types of additional analysis. The well-known examples of such systems are PathWay Studio , MetaCore [46, 47], STRING , and others. These tools consist of knowledge bases where the information, obtained from automated analysis of PubMed abstracts, full-text articles, along with various factographic databases, is accumulated. In addition, such systems have graphical user interfaces (GUIs) permitting access to the data stored in knowledge bases via the user-specified queries and performing the reconstruction and analysis of semantic networks on this basis.
The ANDSystem tool [49,50,51,52], previously developed by us, is another instance of systems that carry out a full cycle of engineering and management of knowledge. The ANDSystem tool is based on unique, specialized ontology , which, in many respects, outperforms the existing analogues by the description of a subject area.
In particular, using the ANDSystem tool, a number of studies were performed, including an analysis of data from high-performance proteomic experiments on the study of Helicobacter pylori and their relationship with the development of gastritis and tumours of the stomach ; an analysis of the proteomic urine profile of a healthy person under normal conditions and under the influence of space flight factors [54, 55]; analysis of the tissue-specific effects of gene knockout and the search for potential targets for drugs ; analysis of the molecular mechanisms of comorbidity of disease [57,58,59]; the search for novel tuberculosis susceptibility candidate genes ; analysis of the interactions of hepatitis C virus proteins with human proteins ; reconstruction and analysis of mosaic gene networks , etc. Moreover, with the prioritization methods of the ANDSystem tool, the key genes involved in the formation of a comorbid state of asthma and hypertension were identified , followed by experimental confirmation of their role in pathology . Based on ANDSystem’s knowledge base, we developed the web-based FunGeneNet tool. It facilitates estimating enrichment of functional interactions in experimental gene sets . The NACE program also uses the ANDSystem’s base of knowledge for the assessment of the effectiveness of potential signal transduction in gene networks .
However, like similar tools, the knowledge base of the ANDSystem is composed by a preliminary analysis of the literature within the used ontology. The search for information with a combined approach, which leverages methods of knowledge extraction in the frames of the specified ontology in combination with a list of user-defined keywords, can expand the amounts of extracted information or clarify the search.
Textpresso  and Polysearch  are examples of such systems. Textpresso Central offers a variety of options for the literature search, starting from a simple keyword-based search up to the performance of complex searches based on a wide range of categories or concepts using the dictionaries of names of objects as well as their synonyms within these categories. Furthermore, Textpresso Central utilizes several types of search filters, which allow the user to limit the main pool of the search through the literature. The system also permits sorting the obtained results by date. At the time of writing, PolySearch searches for interactions between many types of objects, including diseases, genes/proteins, drugs, metabolites, SNPs, pathways, and tissues. The search employs multiple information sources, including PubMed, OMIM , DrugBank , and Swiss-Prot . Among the other systems that provide similar functionality are XplorMed , MedlineR , LitMiner .
This paper describes a new web-based module of the ANDSystem tool, entitled ANDDigest, which enables performing searches of information in PubMed using dictionaries of the ANDSystem tool as well as user-defined keywords. ANDDigest facilitates conducting searches based on complex queries that simultaneously take into account the conditions for multiple interactions between different types of objects from the ANDSystem ontology. The GUI of ANDDigest supplied the found information both in text form with mapped objects as well as in the form of associative networks. The interface features a wide range of tools, providing various types of filtering of found scientific articles (by publication date, journal’s H-index, etc.). Moreover, ANDDigest permits computing the dynamics of the level of interest to the specific object in the scientific literature, as well as sorting of found documents by the average score of interest according to user-defined entities.
The text-mining module of the ANDSystem tool ensures all the necessary pre-processing of the textual data, including the conversion of text to the ANDSystem format, dividing it into separated sentences, normalization, morphological, and syntactic analysis, and mapping of the named entities (object names). In terms of the named entity recognition, a complex dictionary-based algorithm was implemented in the ANDSystem tool. All the prepared texts are then transferred for automated extraction of information about interactions between the found objects using the semantic-linguistic templates. In total, the ANDSystem tool contains more than 10,000 of such manually created templates, allowing the establishment of more than 25 form of relationships between 13 types of objects (proteins, genes, metabolites, microRNAs, biological processes, phenotypic traits, drugs, and their side effects, diseases, and others). The ANDSystem tool considers such interactions as physical interactions with the formation of molecular complexes (protein/protein, protein/DNA, metabolite/protein); catalytic reactions and proteolytic events involving the substrate/enzyme/product, as along with transformations of the substrate/product in the case of complex reactions with a lack of information surrounding the involved enzymes; gene co-expression; side effects of drugs; associative relationships of genes, proteins, metabolites, biological processes, phenotypic traits with diseases, etc. Regulatory interactions are divided into positive and negative regulation, including regulation of gene expression, regulation of protein translation, regulation of protein function/activity, regulation of stability and degradation of proteins, and regulation of transporting of substances. Such regulation can be carried out with the participation of proteins, metabolites, drugs, and miRNAs. Each interaction is characterized by the involved participants, their types, direction, and by cells and organisms along with where the event was described in the literature. The knowledge base of the ANDSystem tool was created based on a large-scale automatic analysis of more than 25 million texts of PubMed abstracts and dozens of factographic databases in the field of biology and biomedicine. It is a unique resource containing formalized information about more than 20 million interactions. It is worth noting that unlike other similar systems, in the ANDSystem tool, proteins and genes are considered separate entities, interconnected by a directed link (gene- > protein)-expression. All genes in the ANDSystem tool have a special attribute that characterizes tissue-specific expression, which permits the reconstruction of gene networks, including only those genes that are expressed in a given tissue, i.e., gene networks that are functioning in a given tissue.
Extraction and scoring of co-occurrence associations
The new version of the ANDSystem tool, extended by the ANDDigest module, allows performing a co-occurrence-based information search considering user-specified keywords. Such a type of search was not used in the ANDSystem tool previously. We score associations between objects from the ANDSystem ontology using the co-occurrence-based text-mining scoring scheme, implemented in STRING  and widely used by a number of other systems [75,76,77]. In our case, we consider the co-occurrence values between all pairs of objects from the ontology of the ANDSystem tool (O(i1,j1), O(i2,j2)), where i1 = (1, NT), j1 = (1, N(i1)), i2 = (1, NT), j2 = (1, N(i2)), NT – is a number of all types of objects from the ontology of the ANDSystem tool, N(i) – the number of all objects of ith type, stored in the ontology of the ANDSystem tool, and j1 ≠ j2 when i1 = i2. For each pair of objects, a weighted indicator of their co-occurrence was calculated based on the level of abstracts as well as individual sentences over the n abstracts in the text corpus:
where ωa =3 and ωs =0.2 are co-occurrence weights within the same abstract and same sentence, respectively, and δsk and δak are equal to 1 or 0 depending on whether or not O(i1,j1) and O(i2,j2) objects co-occur in abstract k or a sentence within it.
A co-occurrence score (s-score) was calculated as:
where C(O(i1,j1), O(i2)) is a sum over all O(i2) objects of the i2-th type paired with an O(i1,j1) object, C(O(i1), O(i2,j2)) is the sum over all O(i1) objects of the i1-th type paired with an O(i2,j2) object, the normalizing factor, C(O(i1), O(i2)), is the sum over all pairs of objects of the i1-th and i2-th type, and the weighting factor α = 0.6. The values for ωs, ωa, and α parameters were obtained from .
Assessment of accuracy
To assess the quality of the text-mining results, we constructed two reference sets, based on the gene-disease and protein-protein interactions. A positive sample, containing gene-disease associations, was created using a curated part of the DisGeNET database (version 6.0)  and included over 33,000 pairs. A negative sample contained over 2,000,000 pairs. It was formed from random genes and diseases from the ANDSystem’s ontology, excluding those interactions that were presented in the positive sample or the database of the ANDSystem tool.
It should be noted that the formed negative sample could contain real pairs of interacting genes and diseases that were not recognized by our templates and were not presented in the curated part of the DisGeNET database. Despite the fact that this circumstance could have a negative impact on the assessment results, we believe that this approach can be considered applicable for our purposes in case if acceptable accuracy indicators will be achieved. When analyzing these samples, the AUC appeared to be 73.9% (Fig. 1).
It should be noted that AUC calculations using a negative sample, containing an equal number of pairs as in a positive sample, showed that the AUC values remained almost unchanged, varying within only 0.1%.
To extract information, the ANDSystem tool uses semantic-linguistic templates with taking into account the grammatical structure of the sentence and the presence of keywords [50, 51]. At the same time these templates do not rely on the frequency of occurrence of protein-protein pairs in the text. In this regard, we suggested that the information on interactions between objects, extracted using the ANDSystem’s templates, can be used as a positive sample for the evaluation of the used co-occurrence-based approach.
The AUC value calculated using a positive sample (262,084 pairs) generated based on gene-disease interactions taken from the ANDSystem tool turned out to be 70.5%. The accuracy based on these data turned out to be even slightly lower than when using the curated gene-disease associations. This may be since gene-disease pairs rarely mentioned in the literature appeared to be among the positive interactions. Thus, such an approach to the formation of a positive sample can be used for a rough estimation of the method based on compatibility. The AUC value calculated using a positive sample based on the gene-disease interactions, extracted only from the ANDSystem database (262,084 gene-disease pairs), appeared to be 70.5%. I.e., obtained accuracy appeared to be even lower than compared to the gene-disease associations formed on the basis of the curated data. This may be probably related to the fact that gene-disease pairs rarely mentioned in the literature could be among the positive interactions. Thus, such an approach to the formation of a positive sample can be used for a rough estimation of our co-occurrence-based method.
The testing sample for protein-protein interactions was formed in the opposite way compared to the gene-disease described above. The negative sample contained pairs of non-interacting human proteins, obtained from the . Only those proteins that were found together in at least one PubMed abstract  were considered. Thus, 14,430 pairs of proteins were included in the negative sample. A positive sample was formed according to the protein-protein interactions presented in the ANDSystem knowledge base. Only such pairs of proteins were considered, the interactions between which were represented in the ANDSystem tool by the “interaction” type, characterized by physical interactions between proteins with the formation of complexes. In total, the positive sample contained 179,215 pairs of interactions of human proteins. The AUC value was 79.6%; an accuracy estimation on samples with the equal number of protein pairs in the negative and positive samples showed approximately the same AUC value, equal to 79.6% (Fig. 1).
We estimated the co-occurrence method for all types of the ANDSystem tool interactions by generating the positive samples based on the information from the ANDSystem’s templates, and negative samples, formed from random pairs of objects that were found together in the text at least once. A total of 47 pairwise interaction combinations were analyzed for 12 types of objects. AUC values ranged from 68.4% (cells-drug interactions) to 87.4% (drug-drug interactions). In Fig. 1 the ROC curves for interactions having different AUC values are shown. The values for the mean and standard deviations of negative sets were used to calculate the z-score and estimate the p-value for each interaction.
Calculation of trend strength
For each object from the ANDSystem ontology, an indicator of interest, based on the dynamics of its mentions in PubMed publications by years, was calculated. The dynamics were calculated in two ways: in the first case, only the absolute numbers of articles containing the object by each year were considered. In the second case, the number of publications concerning the object in each year was normalized to the total number of articles published in PubMed during that year. The trend strength estimations were performed based on the normalized dynamics using the non-parametric Mann-Kendall test [81, 82]. The analysis was performed with the mk.test function from the trend v1.1.1 package  of the R programming language and provided the values of trend strength (S) and statistical significance (z-score and p-value).
The user interface of ANDDigest
The web-based ANDDigest tool is designed for performing flexible searches of information in the mapped PubMed data based on the ANDSystem tool dictionaries and considering user-defined keywords. Its GUI enables performing searches, visualization, and various forms of sorting and filtering of the results, as well as saving them in different formats.
The search of information with taking into account the user-defined keywords
The search is performed using the pre-processed text corpus from PubMed  containing mapped objects from the ANDSystem ontology. A search query is defined as a list of concepts (types of objects), specific objects of a given type, keywords, which are related to the concept (located in the same sentence as the objects of the concept), as well as free-keywords that can be arbitrarily determined in the text (Fig. 2). At the same time, the query must contain at least one specified object of the chosen type. All objects included in the query can be connected via the logical AND (the “Include the Object” button) or NOT (the “Exclude the Object” button). In addition to objects and concepts, as was mentioned, the user can specify groups of free keywords. The keywords within the same group are interconnected with a logical OR and the logical AND applies to the first word of each group. It is also possible to set a group of keywords for abstracts that should be excluded from the search results. Such groups are considered according to the logical NOT rule with respect to other objects listed in the request. The search result is a list of PubMed abstracts satisfying the user-constructed query. Moreover, the window provides information regarding the approximate number of sources matching the user request. It should be noted that the current version of ANDDigest allows displaying no more than 5000 abstracts when a query is provided without specification of any keywords, and not more than 30,000 abstracts when keywords are specified.
Visualization of search results
ANDDigest features two options for displaying the search results - the textual and graphical, which includes a hierarchical tree structure and associative network.
The first type of representation is a table form (Fig. 3). Each line of the table corresponds to a short textual description of the abstract (digest) that satisfies the user’s request and contains mapped objects from the ANDSystem ontology. Clicking on the “read more ...” link displays the full text of the abstract. The table allows sorting digests by various criteria, such as publication date, H-index of the journal, citations number, as well as interest score. Information regarding the H-index was obtained from the SCImago portal . For all journals not presented in SCImago, the Scientific Journal Rankings (SJR) H-index value was set to zero. Information about the publication date and citations number was extracted from the XML version of the PubMed database . The score of interest for the digest (Digest Score) was estimated as the average z-value of all trends of mapped objects in the digest satisfying the user’s query.
The representation in the form of a hierarchical tree (Fig. 4) provides the user with information about the mapped objects, grouped by their types, and lists of synonyms for each object recognized in the text. It also permits conducting data sorting and filtering. The sorting can be accomplished by the number of abstracts concerning each object as well as by the trend strength values of the object. In turn, the following options are implemented for filtering: 1) filtering according to the quality of recognition of the object in the text (the values are based on data from the ANDSystem tool knowledge base); and 2) filtering according to the score of pairwise co-occurrences of mapped objects in the text corresponding to the user’s request. Another type of filtering, implemented in the tree form of representations, is a filter based on specifying queries. This filter allows forming subsets of all found digests, based on objects, or their synonyms, selected from the tree as well as manually entered keywords. The selection of objects or synonyms can be made from the context menu located on the left side of the corresponding tree branch (Fig. 4), while keywords can be directly typed into the corresponding text fields. The relationships between the provided entities are automatically determined with logicals AND, OR, and NOT.
Threshold values for filtering by the recognition quality of object names and their co-occurrence can be defined using the appropriate sliders. The range for the first slider is from 1 to 5, where “1” corresponds to the lowest recognition accuracy and “5” the highest. The threshold values for the second slider correspond to the s-score of object co-occurrences. These values range from the minimal to the maximal values among all found pairs of objects, which satisfy the initial user’s search.
A graphical representation of the found objects in the form of a network (Fig. 5) is implemented using the sigmajs library . This form illustrates such properties of objects as frequencies of their pairwise (edges) and separated (nodes) occurrences in texts. The filtering of a network by the edge and node sizes can be completed using the appropriate sliders. Right-clicking on the node brings up a context menu. This menu allows performing different layouts of the network, provides information about trend strength of the object, as well as its dynamics of interest, synonyms, and entries in external databases. Besides this, the context menu allows using visible objects on the network as a filter for digests. In this case, relations between visible nodes are set automatically through a logical OR.
Saving of results
ANDDigest allows the user to download the obtained data considering the applied filters in the JSON, CSV and PDF formats; the network can also be saved as an image in the SVG vector format.
Saving the information in the JSON format provides the user with the opportunity to perform further analysis of the obtained results using various third-party software tools. The JSON file contains a description of two objects: a digests table, entitled anddigest, which includes an id number of the relevant PubMed abstract, the date of publication, the score of interest for the digest, the number of citations, and the mapped text of the digest. The second JSON object is a network, consisting of two parts: nodes and edges. Each node is represented by its internal ANDDigest id, label, list of synonyms, type, colour, size, trend strength value, number of node’s mentions in the text, as well as the node’s coordinates. In turn, the network’s edges are represented by the internal id number, internal identifiers of the first (source) and second (target) nodes, the colour, and the size of the relationship. Further, each edge is presented by the s-score, z-score and p-value values reflecting the significance of the co-occurrence of the source and target nodes, as well as with an additional indicator that relationship was also established with the semantic templates of the ANDSystem tool.
The CSV format permits the user to perform a tabular analysis of the obtained data. Like in the case of the JSON format, the file contains mapped results of the query, as well as individual records about the nodes and edges of the network. At the same time, saving in this format does not provide the user with information about the colours of nodes or vertices, their sizes, or their spatial coordinates.
Examples of the application of the system
The use of the ANDDigest system was demonstrated by analysing diseases comorbid with preeclampsia, as well as by evaluating genes associated with the disease-resistance process with an example of three plants (Solanum tuberosum, Zea ramose, and Arabidopsis thaliana).
For the first example, the entered query was the following: find all articles that mention preeclampsia and any other disease and also contains one of the provided keywords (Comorbidity OR Comorbid OR Comorbidities) (Fig. 2). In the absence of a filtering threshold based on a co-occurrence s-score, the program found 186 diseases associated with preeclampsia mentioned in 57 abstracts.
After filtering, with a co-occurrence threshold value of s-score = 48 (z-score = 1.65, p-value < 0.05), the number of diseases decreased to 38, while the number of abstracts with their mention became 50. The distribution of the number of diseases after the filtration, according to the strength of their trends, is portrayed in Fig. 6.
Among the remaining diseases, the highest strength value of the trend had “obesity” (2164), while “gestational diabetis” (2059) was in second place and “premature labour” had the lowest value (− 262). It is noteworthy that the trend strength for “preeclampsia” was 1460, which corresponds to the 18th position in the list. Figure 7 depicts the dynamics of interest for “gestational diabetes,” “preeclampsia,” “obesity,” and “hypertensive disease,” in a normalized and non-normalized form.
According to obtained data, it was interesting to observe what genes are mentioned in the literature in the context of two diseases, preeclampsia and obesity, which are known to be comorbid . For this, the following query was used: find all articles containing preeclampsia and obesity, and at least one gene. After performing this query, 144 genes were determined (Filter by Nodes Score = 5) that could potentially be involved in the comorbid state of these two diseases.
At the same time, according to the frequency of mentions of these genes in found abstracts, the “placental growth factor” gene was in the first place (five documents). In second place were “hypoxia-inducible factor 1-alpha” and “C reactive protein,” each of which were linked with three documents.
Placental growth factor (PGF) plays an important role in angiogenesis and vasculogenesis, as well as in embryogenesis . Hypoxia-inducible factor-1 alpha belongs to transcription factors involved in the process of changes in available oxygen in the cellular environment, as well as in angiogenesis, metal transport, mitochondrial function, and cell growth [88, 89]. In turn, C reactive protein interacts with DNA and histones and bestows host defence-associated functions .
Among the described genes, “C reactive protein” had the greatest trend strength (1796, p-value = 1.96E-21), while the hypoxia-inducible factor 1-alpha had the lowest (1324, p-value = 6.6E-16). In turn, the value for PGF was 1681 (p-value = 7.06E-19). It is worthwhile noting that the strength of the trend for all three genes was statistically significant. The grouping of all the found genes by the distribution of trend strengths is shown in Fig. 8, while the dynamics of interest are presented in Fig. 9.
Another example of the application of ANDDigest was the identification of plant genes associated with the biological process of disease resistance (GO: 0009614). Researchers often face the problem of a lack of information about the functions of genes of the analysed organism and their relationships with biological processes or phenotypic traits. This problem is highly relevant to cultivated plants, such as, for example, Solanum tuberosum and Zea ramose. Model plants are of special interest because of an abundant amount of information on genes and their functions provided in the literature. Arabidopsis thaliana is a well-known representative of such modal plants. At the same time, disease resistance is a key characteristic for cultivated plants; this process also appears to have a robust dynamics of growth of interest in the scientific literature (Fig. 10).
Thus, we conducted an analysis of the occurrence of genes of different organisms in the context of the disease-resistance process in the abstracts of PubMed, in which one of the three plants was presented: Solanum tuberosum, Arabidopsis thaliana, or Zea ramose. In particular, for Solanum tuberosum, we used the following query: a fixed organism (Solanum tuberosum), a fixed process (disease resistance), and any other organism or any gene. The keywords were not specified.
As a result of this query, in which Solanum tuberosum was a fixed organism, 21 abstracts were returned containing 32 genes and 43 organisms. In turn, for Zea ramosa, 19 abstracts were obtained with the mention of 35 genes and 43 organisms. A query for Arabidopsis thaliana revealed 143 abstracts with 231 genes and 86 organisms in total. Across all three cases, the ‘Filter by Nodes Score’ slider value was set to 5.
It appeared that among all detected organisms - 13 were presented across all three lists. Among them were phytopathogenic bacterium (Pseudomonas syringae), fungus-like eukaryotic microorganism (Phytophthora infestans), plant pathogenic fungus (Rhizoctonia solani), and gram-negative soil bacterium (Agrobacterium tumefaciens). The remaining eight organisms (rice; cotton; Arabidopsis thaliana; tomato; Tobacco; potato; wheat; maize; Barley) were plants of agricultural importance.
It is known that Rhizoctonia solani is a soil-borne fungal pathogen that is pathogenic to different host species [91, 92]. Agrobacterium tumefaciens is a ubiquitous representative of the soil microflora and can cause crown gall disease . In turn, Pseudomonas syringae causes brown mucus, frostbite, fruit damage, and leaf spotting in plants . Phytophthora infestans are phytopathogens that are known for causing late bligh .
From Fig. 11, it can be seen that Pseudomonas syringae has the highest value for trend strength, which can indicate a growing interest in it from the research community. At the same time, the soil bacterium, Agrobacterium tumefaciens, has the highest number of references in the literature while the strength of this trend has the smallest value among all distributions presented. From the curve, it can be suggested that the highest number of mentions for this bacterium was manifested in the period from the 1990s to the beginning of the 2000s, after which it started to decrease. At the same time, during this period, there began an active growth of interest to three other represented organisms, which continues until now. Based on this graphical representation, we can conclude the importance of the tasks associated with fighting against diseases caused by the identified pathogens.
Among the found genes associated with resistance to diseases caused by the mentioned pathogens, snakin-1, Sgt1, and osmotin as examples can be distinguished. In particular, it is known that overexpression of the snakin-1 gene enhances the resistance of potato plants to Rhizoctonia solani . The Sgt1 gene is a representative of single dominant resistance genes; the study shows that this gene plays a significant role in potato resistance to late blight disease . Transgenic potato plants expressing wild osmotin proteins are known to become resistant to diseases caused by Phytophthora infestans .
In general, an analysis of the resulting list of genes showed that most of them are associated with the production of transgenic plants resistant to various diseases.
The present work describes a new web-based ANDDigest module integrated into the ANDSystem tool, designed to search for information in pre-processed texts of PubMed abstracts with mapped objects from the ontology of the ANDSystem tool. The ontology of the ANDSystem tool features dictionaries for 13 types of objects, including molecular-genetics entities (genes, proteins, metabolites, microRNAs), cells and organisms, biological processes, diseases, drugs and their side effects, etc. Along with the objects represented in the ANDSystem tool dictionaries, the system provides the user with the ability to use their own keywords for the specification of search queries. ANDDigest is intended to facilitate the solution of two types of information search tasks: problems related to synonymy as well as the formation of search queries for finding documents that contain any names of objects of the type indicated in the request (from the corresponding dictionary) without the manual specification of their names. Search results can be presented in different forms: in the form of a table containing a mapped text or a network of interacting objects corresponding to the user request. Besides this, the GUI of ANDDigest allows filtering of search results according to various criteria, as well as sorting for abstracts and identified objects. A feature of the developed tool is providing the user with the ability to build graphical representations that describe the dynamics of interest for the recognized objects calculated on the basis of the frequencies of mentioning of the names of objects in scientific publications per year. The system also assesses the strength and statistical significance of trends assessed on the basis of these frequencies.
Availability and requirements
Project name: The ANDDigest tool.
Project home page: https://anddigest.sysbio.ru/
Operating system(s): Platform independent.
Other requirements: Internet connection, web-browser with HTML5 and CSS3 support.
Any restrictions to use by non-academics: None.
Availability of data and materials
The data sets supporting the results of this article are included within the article.
Associative Network Discovery System
Support vector machine
Conditional random field
hidden Markov model
Bidirectional long short-term memory network
Recurrent neural networks
Natural language processing
Artificial Neural Networks
Graphical user interface
Receiver operating characteristic
Area under receiver operating characteristic curve
Scientific Journal Rankings
Extensible markup language
Scalable Vector Graphics
Portable Document Format
Placental growth factor
Beel J, Gipp B. Google Scholar’s Ranking Algorithm: An Introductory Overview. In: In Proceedings of the 12th International Conference on Scientometrics and Informetrics (ISSI’09), vol. 1; 2009. p. 230–41.
McEntyre J, Ostell J. The NCBI Handbook. Bethesda: National Center for Biotechnology Information (US); 2002.
Jacso P. As we may search - comparison of major features of the web of science, Scopus, and Google scholar citation-based and citation-enhanced databases. Curr Sci. 2005;89:1537–47.
McEntyre J, Ostell J. The NCBI Handbook. Bethesda: National Center for Biotechnology Information (US); 2013.
The UniProt Consortium. UniProt: the universal protein knowledgebase. Nucleic Acids Research. 2017. https://doi.org/10.1093/nar/gkw1099.
Maglott D, Ostell J, Pruitt KD, Tatusova T. Entrez gene: gene-centered information at NCBI. Nucleic Acids Res. 2010. https://doi.org/10.1093/nar/gkq1237.
Kim S, Thiessen PA, Bolton EE, Chen J, Fu G, Gindulyte A, Han L, He J, He S, Shoemaker BA, Wang J, Yu B, Zhang J, Bryant SH. PubChem Substance and Compound databases. Nucleic Acids Res. 2015. https://doi.org/10.1093/nar/gkv951.
Song Y, Kim E, Lee GG, Yi BK. POSBIOTM-NER in the shared task of BioNLP/NLPBA 2004. In: Proc Int Joint Workshop Natural Lang Process Biomed Appl; 2004. p. 100–3.
Finkel J, Dingare S, Nguyen H, Nissim M, Manning C, Sinclair G. Exploiting context for biomedical entity recognition: from syntax to the web. In: Proc Int Joint Workshop Natural Lang Process Biomed Appl; 2004. p. 88–91.
Settles B. ABNER: an open source tool for automatically tagging genes proteins and other entity names in text. Bioinformatics. 2005; https://doi.org/10.1093/bioinformatics/bti475.
Campos D, Matos S, Oliveira JL. Gimli: Open source and high-performance biomedical name recognition. BMC Bioinformatics. 2013. https://doi.org/10.1186/1471-2105-14-54.
Tsuruoka Y, Tateishi Y, Kim JD, Ohta T, McNaught J, Ananiadou S, Tsujii J. Developing a robust part-of-speech tagger for biomedical text. In: Proc. Panhellenic Conf Inform; 2005. p. 382–92.
Chang FX, Guo J, Xu WR, Chung SR. Application of word embeddings in biomedical named entity recognition tasks. J Digit Inf Manage. 2015;13(5):321–7.
Zhou G, Zhang J, Su J, Shen D, Tan C. Recognizing names in biomedical texts: a machine learning approach. Bioinformatics. 2004. https://doi.org/10.1093/bioinformatics/bth060.
Tsai R, Sung CL, Dai HJ, Hung HC, Sung TY, Hsu WL. NERBio: Using selected word conjunctions term normalization and global patterns to improve biomedical named entity recognition. BMC Bioinformatics. 2006. https://doi.org/10.1186/1471-2105-7-S5-S11.
Liao Z, Wu H. Biomedical named entity recognition based on skip-chain Crfs. In: Proc Int Conf Ind Control Electron Eng; 2012. p. 1495-1498.
Wei H, Gao M, Zhou A, Chen F, Qu W, Wang C, Lu M. Named Entity Recognition From Biomedical Texts Using a Fusion Attention-Based BiLSTM-CRF: IEEE Access; 2019. https://doi.org/10.1109/ACCESS.2019.2920734.
Weber L, Munchmeyer J, Rocktaschel T, Habibi M, Leser U. HUNER: improving biomedical NER with pretraining. Bioinformatics. 2019. https://doi.org/10.1093/bioinformatics/btz528.
Cohen KB, Hunter L. Getting started in text mining. PLoS Comput Biol. 2008. https://doi.org/10.1371/journal.pcbi.0040020.
Jensen LJ, Saric J, Bork P. Literature mining for the biologist: from information retrieval to biological discovery. Nat Rev Genet. 2006; https://doi.org/10.1038/nrg1768.
Fleuren WW, Alkema W. Application of text mining in the biomedical domain. Methods. 2015. https://doi.org/10.1016/j.ymeth.2015.01.015.
Zhou D, He Y, Kwoh CK. From Biomedical Literature to Knowledge: Mining Protein-Protein Interactions. In: Smolinski TG, Milanova MG, Hassanien AE, editors. Computational Intelligence in Biomedicine and Bioinformatics. Studies in Computational Intelligence. Berlin: Springer; 2008. p. 151.
Hao Y, Zhu X, Huang M, Li M. Discovering patterns to extract protein- protein interactions from the literature: part II. Bioinformatics. 2005. https://doi.org/10.1093/bioinformatics/bti493.
Koike A, Niwa Y, Takagi T. Automatic extraction of gene/protein biological functions from biomedical text. Bioinformatics. 2005. https://doi.org/10.1093/bioinformatics/bti084.
Rinaldi F, Schneider G, Kaljurand K, Hess M, Andronis C, Konstandi O, Persidis A. Mining of relations between proteins over biomedical scientific literature using a deep-linguistic approach. Artif Intell Med. 2007. https://doi.org/10.1016/j.artmed.2006.08.005.
Ananiadou S, McNaught J. Text Mining for Biology and Biomedicine. Norwood: Artech House, Inc.; 2005.
Nguyen QL, Tikk D, Leser U. Simple tricks for improving pattern-based information extraction from the biomedical literature. J Biomed Semantics. 2010. https://doi.org/10.1186/2041-1480-1-9.
Xu Y, Hong K, Tsujii J, Chang E. Feature engineering combined with machine learning and rule-based methods for structured information extraction from narrative clinical discharge summaries. J Am Med Inform Assoc. 2014. https://doi.org/10.1136/amiajnl-2011-000776.
Hu ZZ, Narayanaswamy M, Ravikumar KE, Vijay-Shanker K, Wu CH. Literature mining and database annotation of protein phosphorylation using a rule-based system. Bioinformatics. 2005. https://doi.org/10.1093/bioinformatics/bti390.
Torii M, Arighi CN, Li G, Wang Q, Wu CH, Vijay-Shanker K. RLIMS-P 2.0: a generalizable rule-based information extraction system for literature mining of protein phosphorylation information. IEEE/ACM Trans Comput Biol Bioinform. 2015. https://doi.org/10.1109/TCBB.2014.2372765.
Xu Y, Teng D, Lei Y. MinePhos: a literature mining system for protein phoshphorylation information extraction. IEEE/ACM Trans Comput Biol Bioinform. 2012. https://doi.org/10.1109/TCBB.2011.85.
Mooney RJ, Bunescu RC. Subsequence kernels for relation extraction. In: Advances in neural information processing systems; 2006. p. 171–8.
Giuliano C, Lavelli A, Romano L. Exploiting shallow linguistic information for relation extraction from biomedical literature. In: 11th Conference of the European Chapter of the Association for Computational Linguistics; 2006.
Airola A, Pyysalo S, Bjorne A, Pahikkala T, Ginter F, Salakoski T. All-paths graph kernel for protein-protein interaction extraction with evaluation of cross-corpus learning. BMC Bioinformatics. 2008. https://doi.org/10.1186/1471-2105-9-S11-S2.
Nalepa J, Kawulok M. Selecting training sets for support vector machines: a review. Artif Intell Rev. 2019. https://doi.org/10.1007/s10462-017-9611-1.
Zeng D, Liu K, Lai S, Zhou G, Zhao J. Relation classification via convolutional deep neural network. In: Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers; 2014. p. 2335–44.
Björne J, Salakoski T. Biomedical event extraction using convolutional neural networks and dependency parsing. In: Proceedings of the BioNLP 2018 workshop; 2018. p. 98–108.
Miwa M, Bansal M. End-to-end relation extraction using LSTMs on sequences and tree structures. arXiv. 2016. https://doi.org/10.18653/v1/P16-1105.
Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J. Distributed Representations of Words and Phrases and their Compositionality. In: 26th International Conference on Neural Information Processing Systems; 2013.
Peters M, Neumann M, Iyyer M, Gardner M, Clark C, Lee K, Zettlemoyer L. Deep contextualized word representations. arXiv. 2018. https://doi.org/10.18653/v1/N18-1202.
Devlin J, Chang M, Lee K, Toutanova K. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv. 2018; abs/1810.04805.
Radford A, Narasimhan K, Salimans T, Sutskever I. Improving language understanding by generative pre-training. https://cdn.openai.com/research-covers/language-unsupervised/language_understanding_paper.pdf. Accessed 5 Aug 2019.
Dai Z, Yang Z, Yang Y, Carbonell JG, Le QV, Salakhutdinov RR. Transformer-XL: attentive language models beyond a fixed-length context. arXiv. 2019. https://doi.org/10.18653/v1/p19-1285.
Radford A, Wu J, Child R, Luan D, Amodei D, Sutskever I. Language models are unsupervised multitask learners. OpenAI Blog. 2019;1(8):9.
Nikitin A, Egorov S, Daraselia N, Mazo I. Pathway studio -- the analysis and navigation of molecular networks. Bioinformatics. 2003. https://doi.org/10.1093/bioinformatics/btg290.
Nikolsky Y, Nikolskaya T, Bugrim A. Biological networks and analysis of experimental data in drug discovery. Drug Discov Today. 2005;10(9):653–62.
Ekins S, Bugrim A, Brovold L, Kirillov E, Nikolsky Y, Rakhmatulin E, Sorokina S, Ryabov A, Serebryiskaya T, Melnikov A, Metz J. Algorithms for network analysis in systems-ADME/Tox using the MetaCore and MetaDrug platforms. Xenobiotica. 2006. https://doi.org/10.1080/00498250600861660.
Szklarczyk D, Morris JH, Cook H, Kuhn M, Wyder S, Simonovic M, Santos A, Doncheva NT, Roth A, Bork P, Jensen LJ. The STRING database in 2017: quality-controlled protein–protein association networks, made broadly accessible. Nucleic Acids Res. 2016. https://doi.org/10.1093/nar/gkw937.
Demenkov PS, Ivanisenko TV, Kolchanov NA, Ivanisenko VA. ANDVisio: A new tool for graphic visualization and analysis of literature mined associative gene networks in the ANDSystem. In: Silico Biology; 2012. https://doi.org/10.3233/ISB-2012-0449.
Ivanisenko VA, Saik OV, Ivanisenko NV, Tiys ES, Ivanisenko TV, Demenkov PS, Kolchanov NA. ANDSystem: an associative network discovery system for automated literature mining in the field of biology. BMC Syst Biol. 2015. https://doi.org/10.1186/1752-0509-9-S2-S2.
Ivanisenko VA, Demenkov PS, Ivanisenko TV, Mishchenko EL, Saik OV. A new version of the ANDSystem tool for automatic extraction of knowledge from scientific publications with expanded functionality for reconstruction of associative gene networks by considering tissue-specific gene expression. BMC Bioinformatics. 2019. https://doi.org/10.1186/s12859-018-2567-6.
Saik OV, Nimaev VV, Usmonov DB, Demenkov PS, Ivanisenko TV, Lavrik IN, Ivanisenko VA. Prioritization of genes involved in endothelial cell apoptosis by their implication in lymphedema using an analysis of associative gene networks with ANDSystem. BMC Med Genomics. 2019. https://doi.org/10.1186/s12920-019-0492-9.
Momynaliev KT, Kashin SV, Chelysheva VV, Demina IA SOV, Serebryakova MV, Ivanisenko VA, Aman E, Akopian T, Govorun VM. Functional divergence of Helicobacter pylori related to early gastric cancer. J Proteome Res. 2010. https://doi.org/10.1021/pr900586w.
Pastushkova LK, Kononikhin AS, Tiys ES, Nosovsky AM, Dobrokhotov IV, Ivanisenko VA, Nikolaev EN, Novoselova NM, Custaud MA, Larina IM. Shifts in urine protein profile during dry immersion. Aviakosm Ekolog Med. 2015;49(4):15–9.
Larina IM, Pastushkova LK, Tiys ES, Kireev KS, Kononikhin AS, Starodubtseva NL, Popov IA, Custaud MA, Dobrokhotov IV, Nikolaev EN, Kolchanov NA. Permanent proteins in the urine of healthy humans during the Mars-500 experiment. J Bioinforma Comput Biol. 2015. https://doi.org/10.1142/S0219720015400016.
Petrovskiy ED, Saik OV, Tiys ES, Lavrik IN, Kolchanov NA, Ivanisenko VA. Prediction of tissue-specific effects of gene knockout on apoptosis in different anatomical structures of human brain. BMC genomics. 2015. https://doi.org/10.1186/1471-2164-16-S13-S3.
Bragina EY, Tiys ES, Freidin MB, Koneva LA, Demenkov PS, Ivanisenko VA, Kolchanov NA, Puzyrev VP. Insights into pathophysiology of dystropy through the analysis of gene networks: an example of bronchial asthma and tuberculosis. Immunogenetics. 2014. https://doi.org/10.1007/s00251-014-0786-1.
Glotov AS, Tiys ES, Vashukova ES, Pakin VS, Demenkov PS, Saik OV, Ivanisenko TV, Arzhanova ON, Mozgovaya EV, Zainulina MS, Kolchanov NA, Baranov VS, Ivanisenko VA. Molecular association of pathogenetic contributors to pre-eclampsia (pre-eclampsia associome). BMC Syst Biol. 2015. https://doi.org/10.1186/1752-0509-9-S2-S4.
Saik OV, Demenkov PS, Ivanisenko TV, Bragina EY, Freidin MB, Goncharova IA, Dosenko VE, Zolotareva OI, Hofestaedt R, Lavrik IN, Rogaev EI, Ivanisenko VA. Novel candidate genes important for asthma and hypertension comorbidity revealed from associative gene networks. BMC Med Genomics. 2018. https://doi.org/10.1186/s12920-018-0331-4.
Bragina EY, Tiys ES, Rudko AA, Ivanisenko VA, Freidin MB. Novel tuberculosis susceptibility candidate genes revealed by the reconstruction and analysis of associative networks. Infect Genet Evol. 2016. https://doi.org/10.1016/j.meegid.2016.10.030.
Saik OV, Ivanisenko TV, Demenkov PS, Ivanisenko VA. Interactome of the hepatitis C virus: literature mining with ANDSystem. Virus Res. 2016. https://doi.org/10.1016/j.virusres.2015.12.003.
Popik OV, Petrovskiy ED, Mishchenko EL, Lavrik IN, Ivanisenko VA. Mosaic gene network modelling identified new regulatory mechanisms in HCV infection. Virus Res. 2016. https://doi.org/10.1016/j.virusres.2015.10.004.
Drevytska T, Morhachov R, Tumanovska L, Portnichenko G, Nagibin V, Boldyriev O, Lapikova-Bryhinska T, Gurianova V, Dons'koi B, Freidin M, Ivanisenko V, Bragina EY, Hofestädt R, Dosenko V. shRNA-Induced Knockdown of a Bioinformatically Predicted Target IL10 Influences Functional Parameters in Spontaneously Hypertensive Rats with Asthma. J Integr Bioinform. 2018. https://doi.org/10.1515/jib-2018-0053.
Tiys ES, Ivanisenko TV, Demenkov PS, Ivanisenko VA. FunGeneNet: a web tool to estimate enrichment of functional interactions in experimental gene sets. BMC Genomics. 2018. https://doi.org/10.1186/s12864-018-4474-7.
Popik OV, Ivanisenko TV, Saik OV, Petrovskiy ED, Lavrik IN, Ivanisenko VA. NACE: a web-based tool for prediction of intercompartmental efficiency of human molecular genetic networks. Virus Res. 2016. https://doi.org/10.1016/j.virusres.2015.11.029.
Müller HM, Van Auken KM, Li Y, Sternberg PW. Textpresso central: a customizable platform for searching, text mining, viewing, and curating biomedical literature. BMC Bioinformatics. 2018. https://doi.org/10.1186/s12859-018-2103-8.
Liu Y, Liang Y, Wishart D. PolySearch2: a significantly improved text-mining system for discovering associations between human diseases, genes, drugs, metabolites, toxins and more. Nucleic Acids Res. 2015. https://doi.org/10.1093/nar/gkv383.
Hamosh A, Scot AF, Amberger JS, Bocchini CA, McKusick VA. Online Mendelian inheritance in man (OMIM), a knowledgebase of human genes and genetic disorders. Nucleic Acids Res. 2005. https://doi.org/10.1093/nar/gki033.
Wishart DS, Knox C, Guo AC, Shrivastava S, Hassanali M, Stothard P, Chang Z, Woolsey J. DrugBank: a comprehensive resource for in silico drug discovery and exploration //nucleic acids research; 2006. https://doi.org/10.1093/nar/gkj067.
Bairoch A, Apweiler R. The SWISS-PROT protein sequence database and its supplement TrEMBL in 2000. Nucleic Acids Res:2000. https://doi.org/10.1093/nar/28.1.45.
Perez-Iratxeta C, Perez AJ, Bork P, Andrade MA. Update on XplorMed: a web server for exploring scientific literature. Nucleic Acids Res. 2003. https://doi.org/10.1093/nar/gkg538.
Lin SM, McConnell P, Johnson KF, Shoemaker J. MedlineR: an open source library in R for Medline literature data mining. Bioinformatics. 2004. https://doi.org/10.1093/bioinformatics/bth404.
Maier H, Döhr S, Grote K, O'keeffe S, Werner T, de Angelis MH, Schneider R. LitMiner and WikiGene: identifying problem-related key players of gene regulation using publication abstracts. Nucleic Acids Res. 2005. https://doi.org/10.1093/nar/gki417.
Franceschini A, Szklarczyk D, Frankild S, Kuhn M, Simonovic M, Roth A, Lin J, Minguez P, Bork P, von Mering C, Jensen LJ. STRING v9.1: protein-protein interaction networks, with increased coverage and integration. Nucleic Acids Res. 2012. https://doi.org/10.1093/nar/gks1094.
Mørk S, Pletscher-Frankild S, Caro AP, Gorodkin J, Jensen LJ. Protein-driven inference of miRNA–disease associations. Bioinformatics. 2013. https://doi.org/10.1093/bioinformatics/btt677.
Binder JX, Pletscher-Frankild S, Tsafou K, Stolte C, O’Donoghue SI, Schneider R, Jensen LJ. COMPARTMENTS: unification and visualization of protein subcellular localization evidence. Database (Oxford). 2014. https://doi.org/10.1093/database/bau012.
Pletscher-Frankild S, Pallejà A, Tsafou K, Binder JX, Jensen LJ. DISEASES: Text mining and data integration of disease–gene associations. Methods. 2015. https://doi.org/10.1016/j.ymeth.2014.11.020.
Pinero J, Bravo A, Queralt-Rosinach N, Gutierrez-Sacristan A, Deu-Pons J, Centeno E, Garcia-Garcia J, Sanz F, Furlong LI. DisGeNET: a comprehensive platform integrating information on human disease-associated genes and variants. Nucleic Acids Res. 2016. https://doi.org/10.1093/nar/gkw943.
Trabuco LG, Betts MJ, Russell RB. Negative protein–protein interaction datasets derived from large-scale two-hybrid experiments. Methods. 2012. https://doi.org/10.1016/j.ymeth.2012.07.028.
The PubMed Database. ftp://ftp.ncbi.nlm.nih.gov/pubmed/. Accessed 15 Aug 2019.
Hipel KW, McLeod AI. Time series modelling of water resources and environmental systems: Elsevier; 1994. p. 45.
Libiseller C, Grimvall A. Performance of partial Mann-Kendall tests for trend detection in the presence of covariates. Environmetrics. 2002; https://doi.org/10.1002/env.507.
Pohlert T. Non-parametric trend tests and change-point detection. 2018. https://www.rdocumentation.org/packages/trend/versions/1.1.1. Accessed 05 Jul 2019.
SCImago, (nd). SJR - SCImago Journal & Country Rank [Portal]. Retrieved 2018 from http://www.scimagojr.com. Accessed 15 Aug 2019.
Jacomy A. sigma.js - v1.2.1. 2018. http://sigmajs.org/. Accessed 10 May 2019.
Ruijter H, Pasterkamp G, Rutten FH, Lam CSP, Chi C, Tan KH, Zonneveld AJ, Spaanderman M, Kleijn DPV. Heart failure with preserved ejection fraction in women: the Dutch queen of hearts program. Neth Hear J. 2015. https://doi.org/10.1007/s12471-014-0613-1.
Maglione D, Guerriero V, Viglietto G, Ferraro MG, Aprelikova O, Alitalo K, Del Vecchio S, Lei KJ, Chou JY, Persico MG. Two alternative mRNAs coding for the angiogenic factor, placenta growth factor (PlGF), are transcribed from a single gene of chromosome 14. Oncogene. 1993;8(4):925–31.
Smith TG, Robbins PA, Ratcliffe PJ. The human side of hypoxia-inducible factor. Br J Haematol. 2008. https://doi.org/10.1111/j.1365-2141.2008.07029.x.
Webb JD, Coleman ML, Pugh CW. Hypoxia, hypoxia-inducible factors (HIF), HIF hydroxylases and oxygen sensing. Cell Mol Life Sci. 2009. https://doi.org/10.1007/s00018-009-0147-7.
Zhang J, Yang L, Ang Z, Yoong SL, Tran TT, Anand GS, Tan NS, Ho B, Ding JL. Secreted M-ficolin anchors onto monocyte transmembrane G protein-coupled receptor 43 and cross talks with plasma C-reactive protein to mediate immune signaling and regulate host defense. J Immunol. 2010. https://doi.org/10.4049/jimmunol.1001225.
Adam GC. Thanatephorus cucumeris (Rhizoctonia solani): a species of wide host range. In: Sidhu GS, editor. Advances in Plant Pathology Vol 6. Genetics of Plant Pathogenic Fungi. New York: Academic Press. 1988. p. 535–52.
Ogoshi A. Ecology and pathogenicity of anastomosis and intraspecific groups of Rhizoctonia solani Kühn. Annu Rev Phytopathol. 1987;25:125–43.
Escobar MA, Dandekar AM. Agrobacterium tumefaciens as an agent of disease. Trends Plant Sci. 2003;8(8):380–6.
Hirano SS, Upper CD. Population biology and epidemiology of Pseudomonas syringae. Annu Rev Phytopathol. 1990;28(1):155–77.
Fry W. Phytophthora infestans: the plant (and R gene) destroyer. Mol Plant Pathol. 2008. https://doi.org/10.1111/j.1364-3703.2007.00465.x.
Almasia NI, Bazzini AA, Hopp HE, Vazquez-Rovere C. Overexpression of snakin-1 gene enhances resistance to Rhizoctonia solani and Erwinia carotovora in transgenic potato plants. Mol Plant Pathol. 2008. https://doi.org/10.1111/j.1364-3703.2008.00469.x.
Bhaskar PB, Raasch JA, Kramer LC, Neumann P, Wielgus SM, Austin-Phillips S, Jiang J. Sgt1, but not Rar1, is essential for the RB-mediated broad-spectrum resistance to potato late blight. BMC Plant Biol. 2008. https://doi.org/10.1186/1471-2229-8-8.
Li R, Wu N, Fan Y, Song B. Transgenic potato plants expressing osmotin gene inhibits fungal development in inoculated leaves. Chin J Biotechnol. 1999;15(2):71–5.
The authors are grateful to the Center of collective usage "Bioinformatics" to provide the server for our web service.
We acknowledge Cambridge Proofreading LLC for the careful proofreading of the manuscript.
About this supplement
This article has been published as part of BMC Bioinformatics Volume 21 Supplement 11, 2020: Selected Topics in “Systems Biology and Bioinformatics” - 2019: bioinformatics. The full contents of the supplement are available online at - https://bmcbioinformatics.biomedcentral.com/articles/supplements/volume-21-supplement-11.
The investigation was supported by a Kurchatov’s Genomics Center of the IC&G SB RAS (agreement with the Ministry of Science and Higher Education of the Russian Federation No 075-15-2019-1662; for T.V.I., P.S.D., N.V.I, V.A.I.), including the publication costs, design of the study,development of web-based ANDDigest system, writing the manuscript. In addition, the meta-analysis of trends in the field of science was supported by the project “Investigation, analysis and complex independent expertise of projects of the National technological initiatives, including the accompanying of projects of “road map” “NeuroNet””, which is executed in the framework of the state assignment No 28.12487.2018/12.1 of the Ministry of Science and Higher Education of the Russian Federation (for A.N.S. and V.A.I.). The analysis of genes associated with human diseases was supported by Budget Program АААА-А17-117092070032-4 (for T.V.I, O.V.S, P.S.D, N.V.I., V.A.I.).
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Ivanisenko, T.V., Saik, O.V., Demenkov, P.S. et al. ANDDigest: a new web-based module of ANDSystem for the search of knowledge in the scientific literature. BMC Bioinformatics 21 (Suppl 11), 228 (2020). https://doi.org/10.1186/s12859-020-03557-8