Skip to main content

Table 6 Interannotator agreement (A-B) in the main annotation phase, calculated as F-measure among the pair of annotators

From: Constructing a semantic predication gold standard from the biomedical literature

Equivalence Criteria strict (relaxed) strictCK strictRK strictCRK
base 0.500 (0.535) 0.624 0.536 0.655
base + PE 0.530 (0.567) 0.654 0.566 0.684
base + GP 0.505 (0.539) 0.628 0.542 0.659
base + PE + GP 0.536 (0.571) 0.659 0.573 0.688
  1. PE: predication equivalence, GP: gene/gene product correspondence, CK: conceptual knowledge, RK: relational knowledge, CRK: conceptual and relational knowledge