Skip to main content

Table 6 Evaluation results of Task 1 on the (W)hole, (A)bstract, and (F)ull paper collections

From: The Genia Event and Protein Coreference tasks of the BioNLP Shared Task 2011

Team Part Simple Event Binding Regulation All
UTurku09 A 64.21/77.45/70.21 40.06/49.82/44.41 35.63/45.87/40.11 46.73/58.48/51.95
Miwa10 A 70.44 52.62 40.60 48.62/58.96/53.29
  W 68.47/80.25/73.90 44.20/53.71/48.49 38.02/54.94/44.94 49.41/64.75/56.04
FAUST A 66.16/81.04/72.85 45.53/58.09/51.05 39.38/58.18/46.97 50.00/67.53/57.46
  F 75.58/78.23/76.88 40.97/44.70/42.75 34.99/48.24/40.56 47.92/58.47/52.67
  F A 66.16/81.04/72.85 45.53/58.09/51.05 39.38/58.18/46.97 50.00/67.53/57.46
  F I 77.36/71.93/74.55 29.63/36.36/32.65 41.77/50.77/45.83 51.57/56.94/54.13
  F R 76.34/80.00/78.13 39.00/43.82/41.27 32.66/45.64/38.07 45.98/57.20/50.98
  F M 48.00/75.00/58.54 100.0/50.00/66.67 20.00/50.00/28.57 46.88/68.18/55.56
  W 67.01/81.40/73.50 42.97/56.42/48.79 37.52/52.67/43.82 48.49/64.08/55.20
UMass A 64.21/80.74/71.54 43.52/60.89/50.76 38.78/55.07/45.51 48.74/65.94/56.05
  F 75.58/83.14/79.18 41.67/47.62/44.44 34.72/47.51/40.12 47.84/59.76/53.14
  F A 64.21/80.74/71.54 43.52/60.89/50.76 38.78/55.07/45.51 48.74/65.94/56.05
  F I 79.25/82.35/80.77 44.44/48.00/46.15 35.44/56.00/43.41 51.57/65.08/57.54
  F R 75.95/83.97/79.76 34.00/40.96/37.16 32.29/42.89/36.85 45.09/56.04/49.98
  F M 48.00/85.71/61.54 100.0/100.0/100.0 20.00/33.33/25.00 46.88/78.95/58.82
  W 68.22/76.47/72.11 42.97/43.60/43.28 38.72/47.64/42.72 49.56/57.65/53.30
UTurku A 64.97/76.72/70.36 45.24/50.00/47.50 40.41/49.01/44.30 50.06/59.48/54.37
  F 78.18/75.82/76.98 37.50/31.76/34.39 34.99/44.46/39.16 48.31/53.38/50.72
  F A 64.97/76.72/70.36 45.24/50.00/47.50 40.41/49.01/44.30 50.06/59.48/54.37
  F I 84.91/67.16/75.00 25.93/30.43/28.00 30.38/30.77/30.57 47.80/45.24/46.48
  F R 77.48/78.99/78.23 36.00/30.51/33.03 34.68/45.54/39.38 47.19/54.18/50.44
  F M 60.00/75.00/66.67 100.0/20.00/33.33 40.00/25.00/30.77 59.38/50.00/54.29
  W 68.99/74.30/71.54 42.36/40.47/41.39 36.64/44.08/40.02 48.64/54.71/51.50
MSR-NLP A 65.99/74.71/70.08 43.23/44.51/43.86 37.14/45.38/40.85 48.52/56.47/52.20
  F 78.18/73.24/75.63 40.28/32.77/36.14 35.52/41.34/38.21 48.94/50.77/49.84
  F A 65.99/74.71/70.08 43.23/44.51/43.86 37.14/45.38/40.85 48.52/56.47/52.20
  F I 83.02/57.89/68.22 40.74/25.00/30.99 35.44/53.85/42.75 52.20/48.26/50.15
  F R 78.24/76.49/77.36 37.00/35.24/36.10 35.78/40.21/37.86 48.18/50.93/49.52
  F M 60.00/75.00/66.67 100.0/50.00/66.67 60.00/50.00/54.55 62.50/66.67/64.52
  W 59.99/85.53 /70.52 29.33/49.66/36.88 35.72/45.85/40.16 43.55/59.58/50.32
ConcordU A 56.51/84.56 /67.75 29.97/49.76/37.41 36.24/47.09/40.96 43.09/60.37/50.28
  F 70.65/88.03 /78.39 27.78/49.38/35.56 34.58/43.22/38.42 44.71/57.75/50.40
  F A 56.51/84.56 /67.75 29.97/49.76/37.41 36.24/47.09/40.96 43.09/60.37/50.28
  F I 58.49/86.11 /69.66 22.22/50.00/30.77 31.65/40.98/35.71 38.99/56.88/46.27
  F R 71.37/89.05 /79.24 28.00/53.85/36.84 33.76/44.12/38.25 43.99/58.76/50.32
  F M 72.00/94.74/81.82 50.00/20.00/28.57 40.00/11.76/18.18 65.62/51.22/57.53
  W 57.33/71.34/63.57 34.01/44.77/38.66 16.39/25.37/19.91 32.73/45.84/38.19
TM-SCS A 53.65/71.66/61.36 36.02/49.41/41.67 18.29/27.07/21.83 33.36/47.09/39.06
  F 68.57/70.59/69.57 29.17/35.00/31.82 12.20/21.02/15.44 31.14/42.83/36.06
  F A 53.65/71.66/61.36 36.02/49.41/41.67 18.29/27.07/21.83 33.36/47.09/39.06
  F I 71.70/67.86/69.72 18.52/31.25/23.26 12.66/27.78/17.39 33.33/49.07/39.70
  F R 66.03/69.76/67.84 32.00/37.65/34.59 11.38/19.68/14.42 29.44/41.20/34.34
  F M 72.00/72.00/72.00 50.00/50.00/50.00 20.00/12.50/15.38 62.50/57.14/59.70
  1. The full paper collection is further classified to titles/abstracts (F A ), introductions (F I ), results/dicussions/conclusions (F R ), and methods (F M ). Evaluated performance is reported in recall/precision/f-score. Some notable figures are underlined.