Skip to main content

Table 6 Interannotator agreement (A-B) in the main annotation phase, calculated as F-measure among the pair of annotators

From: Constructing a semantic predication gold standard from the biomedical literature

Equivalence Criteria

strict (relaxed)

strictCK

strictRK

strictCRK

base

0.500 (0.535)

0.624

0.536

0.655

base + PE

0.530 (0.567)

0.654

0.566

0.684

base + GP

0.505 (0.539)

0.628

0.542

0.659

base + PE + GP

0.536 (0.571)

0.659

0.573

0.688

  1. PE: predication equivalence, GP: gene/gene product correspondence, CK: conceptual knowledge, RK: relational knowledge, CRK: conceptual and relational knowledge