Table 6 Evaluation results of Task 1 on the (W)hole, (A)bstract, and (F)ull paper collections
From: The Genia Event and Protein Coreference tasks of the BioNLP Shared Task 2011
Team | Part | Simple Event | Binding | Regulation | All |
|---|---|---|---|---|---|
UTurku09 | A | 64.21/77.45/70.21 | 40.06/49.82/44.41 | 35.63/45.87/40.11 | 46.73/58.48/51.95 |
Miwa10 | A | 70.44 | 52.62 | 40.60 | 48.62/58.96/53.29 |
| Â | W | 68.47/80.25/73.90 | 44.20/53.71/48.49 | 38.02/54.94/44.94 | 49.41/64.75/56.04 |
FAUST | A | 66.16/81.04/72.85 | 45.53/58.09/51.05 | 39.38/58.18/46.97 | 50.00/67.53/57.46 |
| Â | F | 75.58/78.23/76.88 | 40.97/44.70/42.75 | 34.99/48.24/40.56 | 47.92/58.47/52.67 |
| Â | F A | 66.16/81.04/72.85 | 45.53/58.09/51.05 | 39.38/58.18/46.97 | 50.00/67.53/57.46 |
| Â | F I | 77.36/71.93/74.55 | 29.63/36.36/32.65 | 41.77/50.77/45.83 | 51.57/56.94/54.13 |
| Â | F R | 76.34/80.00/78.13 | 39.00/43.82/41.27 | 32.66/45.64/38.07 | 45.98/57.20/50.98 |
| Â | F M | 48.00/75.00/58.54 | 100.0/50.00/66.67 | 20.00/50.00/28.57 | 46.88/68.18/55.56 |
| Â | W | 67.01/81.40/73.50 | 42.97/56.42/48.79 | 37.52/52.67/43.82 | 48.49/64.08/55.20 |
UMass | A | 64.21/80.74/71.54 | 43.52/60.89/50.76 | 38.78/55.07/45.51 | 48.74/65.94/56.05 |
| Â | F | 75.58/83.14/79.18 | 41.67/47.62/44.44 | 34.72/47.51/40.12 | 47.84/59.76/53.14 |
| Â | F A | 64.21/80.74/71.54 | 43.52/60.89/50.76 | 38.78/55.07/45.51 | 48.74/65.94/56.05 |
| Â | F I | 79.25/82.35/80.77 | 44.44/48.00/46.15 | 35.44/56.00/43.41 | 51.57/65.08/57.54 |
| Â | F R | 75.95/83.97/79.76 | 34.00/40.96/37.16 | 32.29/42.89/36.85 | 45.09/56.04/49.98 |
| Â | F M | 48.00/85.71/61.54 | 100.0/100.0/100.0 | 20.00/33.33/25.00 | 46.88/78.95/58.82 |
| Â | W | 68.22/76.47/72.11 | 42.97/43.60/43.28 | 38.72/47.64/42.72 | 49.56/57.65/53.30 |
UTurku | A | 64.97/76.72/70.36 | 45.24/50.00/47.50 | 40.41/49.01/44.30 | 50.06/59.48/54.37 |
| Â | F | 78.18/75.82/76.98 | 37.50/31.76/34.39 | 34.99/44.46/39.16 | 48.31/53.38/50.72 |
| Â | F A | 64.97/76.72/70.36 | 45.24/50.00/47.50 | 40.41/49.01/44.30 | 50.06/59.48/54.37 |
| Â | F I | 84.91/67.16/75.00 | 25.93/30.43/28.00 | 30.38/30.77/30.57 | 47.80/45.24/46.48 |
| Â | F R | 77.48/78.99/78.23 | 36.00/30.51/33.03 | 34.68/45.54/39.38 | 47.19/54.18/50.44 |
| Â | F M | 60.00/75.00/66.67 | 100.0/20.00/33.33 | 40.00/25.00/30.77 | 59.38/50.00/54.29 |
| Â | W | 68.99/74.30/71.54 | 42.36/40.47/41.39 | 36.64/44.08/40.02 | 48.64/54.71/51.50 |
MSR-NLP | A | 65.99/74.71/70.08 | 43.23/44.51/43.86 | 37.14/45.38/40.85 | 48.52/56.47/52.20 |
| Â | F | 78.18/73.24/75.63 | 40.28/32.77/36.14 | 35.52/41.34/38.21 | 48.94/50.77/49.84 |
| Â | F A | 65.99/74.71/70.08 | 43.23/44.51/43.86 | 37.14/45.38/40.85 | 48.52/56.47/52.20 |
| Â | F I | 83.02/57.89/68.22 | 40.74/25.00/30.99 | 35.44/53.85/42.75 | 52.20/48.26/50.15 |
| Â | F R | 78.24/76.49/77.36 | 37.00/35.24/36.10 | 35.78/40.21/37.86 | 48.18/50.93/49.52 |
| Â | F M | 60.00/75.00/66.67 | 100.0/50.00/66.67 | 60.00/50.00/54.55 | 62.50/66.67/64.52 |
| Â | W | 59.99/85.53 /70.52 | 29.33/49.66/36.88 | 35.72/45.85/40.16 | 43.55/59.58/50.32 |
ConcordU | A | 56.51/84.56 /67.75 | 29.97/49.76/37.41 | 36.24/47.09/40.96 | 43.09/60.37/50.28 |
| Â | F | 70.65/88.03 /78.39 | 27.78/49.38/35.56 | 34.58/43.22/38.42 | 44.71/57.75/50.40 |
| Â | F A | 56.51/84.56 /67.75 | 29.97/49.76/37.41 | 36.24/47.09/40.96 | 43.09/60.37/50.28 |
| Â | F I | 58.49/86.11 /69.66 | 22.22/50.00/30.77 | 31.65/40.98/35.71 | 38.99/56.88/46.27 |
| Â | F R | 71.37/89.05 /79.24 | 28.00/53.85/36.84 | 33.76/44.12/38.25 | 43.99/58.76/50.32 |
| Â | F M | 72.00/94.74/81.82 | 50.00/20.00/28.57 | 40.00/11.76/18.18 | 65.62/51.22/57.53 |
| Â | W | 57.33/71.34/63.57 | 34.01/44.77/38.66 | 16.39/25.37/19.91 | 32.73/45.84/38.19 |
TM-SCS | A | 53.65/71.66/61.36 | 36.02/49.41/41.67 | 18.29/27.07/21.83 | 33.36/47.09/39.06 |
| Â | F | 68.57/70.59/69.57 | 29.17/35.00/31.82 | 12.20/21.02/15.44 | 31.14/42.83/36.06 |
| Â | F A | 53.65/71.66/61.36 | 36.02/49.41/41.67 | 18.29/27.07/21.83 | 33.36/47.09/39.06 |
| Â | F I | 71.70/67.86/69.72 | 18.52/31.25/23.26 | 12.66/27.78/17.39 | 33.33/49.07/39.70 |
| Â | F R | 66.03/69.76/67.84 | 32.00/37.65/34.59 | 11.38/19.68/14.42 | 29.44/41.20/34.34 |
| Â | F M | 72.00/72.00/72.00 | 50.00/50.00/50.00 | 20.00/12.50/15.38 | 62.50/57.14/59.70 |