Skip to main content

Table 10 Individual role agreement statistics

From: Construction of an annotated corpus to support biomedical information extraction

E. coli

Human

Role

N

F-score

Role

N

F-score

THEME

5560

92.41%

SOURCE

10

100%

AGENT

3702

92.31%

LOCATION

302

96.36%

MANNER

697

86.68%

AGENT

2009

92.95%

DESTINATION

486

85.42%

DESTINATION

403

92.12%

SOURCE

250

84.71%

MANNER

344

90.84%

LOCATION

425

84.25%

THEME

2485

89.67%

RATE

176

76.44%

PURPOSE

53

89.47%

CONDITION

227

67.26%

TEMPORAL

41

72.00%

PURPOSE

85

41.95%

CONDITION

21

58.82%

DESCRIPTIVE-THEME

259

39.72%

DESCRIPTIVE-THEME

234

57.46%

DESCRIPTIVE-AGENT

100

34.32%

DESCRIPTIVE-AGENT

90

36.36%

TEMPORAL

33

25.00%

INSTRUMENT

9

0.00%

INSTRUMENT

9

16.5%

RATE

5

0.00%

  1. Separate statistics are shown for the E. coli and human parts of the corpus. Within each part, semantic roles are ordered according to their agreement rates. The columns headed N show the total number of assignments for each role. Assignments by each pair of annotators are counted separately and added to the total.