Skip to main content

Table 10 Individual role agreement statistics

From: Construction of an annotated corpus to support biomedical information extraction

E. coli Human
Role N F-score Role N F-score
THEME 5560 92.41% SOURCE 10 100%
AGENT 3702 92.31% LOCATION 302 96.36%
MANNER 697 86.68% AGENT 2009 92.95%
DESTINATION 486 85.42% DESTINATION 403 92.12%
SOURCE 250 84.71% MANNER 344 90.84%
LOCATION 425 84.25% THEME 2485 89.67%
RATE 176 76.44% PURPOSE 53 89.47%
CONDITION 227 67.26% TEMPORAL 41 72.00%
PURPOSE 85 41.95% CONDITION 21 58.82%
DESCRIPTIVE-THEME 259 39.72% DESCRIPTIVE-THEME 234 57.46%
DESCRIPTIVE-AGENT 100 34.32% DESCRIPTIVE-AGENT 90 36.36%
TEMPORAL 33 25.00% INSTRUMENT 9 0.00%
INSTRUMENT 9 16.5% RATE 5 0.00%
  1. Separate statistics are shown for the E. coli and human parts of the corpus. Within each part, semantic roles are ordered according to their agreement rates. The columns headed N show the total number of assignments for each role. Assignments by each pair of annotators are counted separately and added to the total.