Table 15 Pathway Curation task primary evaluation results by event type.
From: Overview of the Cancer Genetics and Pathway Curation tasks of BioNLP Shared Task 2013
Event | NaCTeM | TEES-2.1 | ||||
|---|---|---|---|---|---|---|
| Â | recall | prec. | F-score | recall | prec. | F-score |
  CONVERSION | 34.33 | 35.48 | 34.90 | 35.82 | 42.86 | 39.02 |
  PHOSPHORYLATION | 62.46 | 55.94 | 59.02 | 53.40 | 66.00 | 59.03 |
  DEPHOSPHORYLATION | 45.00 | 56.25 | 50.00 | 35.00 | 77.78 | 48.28 |
  ACETYLATION | 69.57 | 72.73 | 71.11 | 82.61 | 76.00 | 79.17 |
  DEACETYLATION | 33.33 | 33.33 | 33.33 | 0.00 | 0.00 | 0.00 |
  METHYLATION | 42.86 | 60.00 | 50.00 | 57.14 | 80.00 | 66.67 |
  DEMETHYLATION | 100.00 | 100.00 | 100.00 | 100.00 | 100.00 | 100.00 |
  UBIQUITINATION | 52.94 | 64.29 | 58.06 | 58.82 | 76.92 | 66.67 |
  DEUBIQUITINATION | 100.00 | 100.00 | 100.00 | 100.00 | 100.00 | 100.00 |
  LOCALIZATION | 42.25 | 61.22 | 50.00 | 43.66 | 54.39 | 48.44 |
  TRANSPORT | 65.52 | 61.29 | 63.33 | 56.55 | 59.85 | 58.16 |
  GENE EXPRESSION | 90.65 | 83.15 | 86.74 | 84.55 | 79.39 | 81.89 |
  TRANSCRIPTION | 71.15 | 82.22 | 76.29 | 57.69 | 73.17 | 64.52 |
  TRANSLATION | 0.00 | 0.00 | 0.00 | 50.00 | 100.00 | 66.67 |
Simple-total | 66.42 | 64.80 | 65.60 | 60.40 | 67.87 | 63.92 |
  DEGRADATION | 78.57 | 89.19 | 83.54 | 78.57 | 78.57 | 78.57 |
  ACTIVATION | 78.54 | 70.96 | 74.56 | 72.06 | 72.06 | 72.06 |
  INACTIVATION | 44.62 | 55.77 | 49.57 | 38.46 | 45.45 | 41.67 |
  BINDING | 64.96 | 47.30 | 54.74 | 53.96 | 53.96 | 53.96 |
  DISSOCIATION | 38.46 | 46.88 | 42.25 | 35.90 | 45.16 | 40.00 |
  PATHWAY | 84.91 | 75.50 | 79.93 | 70.94 | 75.50 | 73.15 |
General-total | 69.07 | 62.69 | 65.72 | 61.16 | 65.74 | 63.37 |
  REGULATION | 33.33 | 33.97 | 33.65 | 29.73 | 39.51 | 33.93 |
  POSITIVE REGULATION | 35.49 | 42.81 | 38.81 | 34.51 | 45.45 | 39.23 |
  NEGATIVE REGULATION | 45.75 | 50.64 | 48.07 | 41.02 | 47.37 | 43.97 |
  Regulation-total | 37.73 | 42.79 | 40.10 | 35.17 | 44.76 | 39.39 |
Sub-total | 53.47 | 53.96 | 53.72 | 48.23 | 56.22 | 51.92 |
  NEGATION | 24.52 | 35.87 | 29.13 | 25.16 | 41.30 | 31.27 |
  SPECULATION | 15.79 | 22.22 | 18.46 | 0.00 | 0.00 | 0.00 |
Modification-total | 23.56 | 34.65 | 28.05 | 22.41 | 40.00 | 28.73 |
Total | 52.23 | 53.48 | 52.84 | 47.15 | 55.78 | 51.10 |