Skip to main content

Table 9 General agreement statistics in the GREC

From: Construction of an annotated corpus to support biomedical information extraction

Agreement Type

F-Score

 

E. coli

Human

Event identification

72.27%

76.37%

Argument identification(relaxed span match)

90.23%

91.27%

Argument identification (exact span match)

75.10%

77.48%

Semantic role assignment

88.96%

88.30%

Biological concept identification

82.55%

82.03%

Bio-concept category assignment(exact)

71.02%

66.03%

Bio-concept assignment(including parent)

75.38%

68.97%

Bio-concept supercategory assignment

95.52%

94.75%

  1. Average F-Score agreement figures are shown for several annotation substasks, with separate figures being shown for the E. coli and human parts of the corpus.