Skip to main content

Table 15 Pathway Curation task primary evaluation results by event type.

From: Overview of the Cancer Genetics and Pathway Curation tasks of BioNLP Shared Task 2013

Event NaCTeM TEES-2.1
  recall prec. F-score recall prec. F-score
  CONVERSION 34.33 35.48 34.90 35.82 42.86 39.02
  PHOSPHORYLATION 62.46 55.94 59.02 53.40 66.00 59.03
  DEPHOSPHORYLATION 45.00 56.25 50.00 35.00 77.78 48.28
  ACETYLATION 69.57 72.73 71.11 82.61 76.00 79.17
  DEACETYLATION 33.33 33.33 33.33 0.00 0.00 0.00
  METHYLATION 42.86 60.00 50.00 57.14 80.00 66.67
  DEMETHYLATION 100.00 100.00 100.00 100.00 100.00 100.00
  UBIQUITINATION 52.94 64.29 58.06 58.82 76.92 66.67
  DEUBIQUITINATION 100.00 100.00 100.00 100.00 100.00 100.00
  LOCALIZATION 42.25 61.22 50.00 43.66 54.39 48.44
  TRANSPORT 65.52 61.29 63.33 56.55 59.85 58.16
  GENE EXPRESSION 90.65 83.15 86.74 84.55 79.39 81.89
  TRANSCRIPTION 71.15 82.22 76.29 57.69 73.17 64.52
  TRANSLATION 0.00 0.00 0.00 50.00 100.00 66.67
Simple-total 66.42 64.80 65.60 60.40 67.87 63.92
  DEGRADATION 78.57 89.19 83.54 78.57 78.57 78.57
  ACTIVATION 78.54 70.96 74.56 72.06 72.06 72.06
  INACTIVATION 44.62 55.77 49.57 38.46 45.45 41.67
  BINDING 64.96 47.30 54.74 53.96 53.96 53.96
  DISSOCIATION 38.46 46.88 42.25 35.90 45.16 40.00
  PATHWAY 84.91 75.50 79.93 70.94 75.50 73.15
General-total 69.07 62.69 65.72 61.16 65.74 63.37
  REGULATION 33.33 33.97 33.65 29.73 39.51 33.93
  POSITIVE REGULATION 35.49 42.81 38.81 34.51 45.45 39.23
  NEGATIVE REGULATION 45.75 50.64 48.07 41.02 47.37 43.97
  Regulation-total 37.73 42.79 40.10 35.17 44.76 39.39
Sub-total 53.47 53.96 53.72 48.23 56.22 51.92
  NEGATION 24.52 35.87 29.13 25.16 41.30 31.27
  SPECULATION 15.79 22.22 18.46 0.00 0.00 0.00
Modification-total 23.56 34.65 28.05 22.41 40.00 28.73
Total 52.23 53.48 52.84 47.15 55.78 51.10