Skip to main content

Table 3 Turku Event Extraction System in the BioNLP Shared Tasks.

From: TEES 2.2: Biomedical Event Extraction for Diverse Corpora

Task

Name

devel / test

devel 2.2 / test 2.2

GE09 1

GENIA Event Extraction

- / 51.95

49.11 / -a

GE09 2

Protein Site Arguments

- / -

- / -a

GE09 3

Negation & Speculation

- / -

- / -a

GE11 1

GENIA Event Extraction

55.78 / 53.30

53.91 / 54.03

GE11 2

Protein Site Arguments

53.39 / 51.97

-b/-b

GE11 3

Negation & Speculation

38.34 / 26.86

37.92 / 31.85

EPI11

Epigenetics and PTM:s

56.41 / 53.33

60.03 / 56.22

ID11

Infectious Diseases

44.92 / 42.57

50.56 / 49.96

BB11

Bacteria Biotopes

27.01 / 26

30.87 / -a

BI11

Bacteria Gene Interactions

77.24 / 77

76.81 / -a

CO11

Protein/Gene Coreference

36.22 / 23.77

30.11 / -a

REL11

Entity Relations

65.99 / 57.7

-/-a

REN11

Bacteria Gene Renaming

84.62 / 87.0

85.04 / -a

GE13

GENIA Event Extraction

51.43* / 50.74

50.13* / 49.18

CG13

Cancer Genetics

61.82* / 55.41

63.50* / 54.99

PC13

Pathway Curation

57.63* / 51.10

59.74* / 49.90

GRO13

Gene Regulation Ontology

47.18* / 21.50

47.42* / -a

GRN13

Gene Regulation Network

-c / 0.86 SER

-c / 0.85 SER

BB13 1

NER and Categorization

-/-

-/-

BB13 2

Bacteria Localization

11.81* / 42

13.71* / 42.20

BB13 3

Bacteria Entities & Relations

64.67* / 14

63.34* / 14.24

  1. The first results column shows the official competition results from each BioNLP Shared Task in which TEES participated, reflective of the system's performance at that point in its development. The second column shows the performance of the current TEES 2.2 system. The development set results are evaluated using an official downloadable evaluator or the TEES internal evaluator (the latter shown with a star). The test set results are the results from the shared task (first column) or evaluated with the official online evaluation service (second column). The superscript (a) indicates that the online evaluation service is no longer available, (b) that that competition metric is not provided by the online evaluation service and (c) that the downloadable evaluator failed to process the predicted events.