Table 4 Inter-annotator agreement (IAA) in the practice phase, calculated as F-measure among pairs of annotators
From: Constructing a semantic predication gold standard from the biomedical literature
Pair | A-B | A-C | B-C |
|---|---|---|---|
IAA (strict) | 0.415 | 0.475 | 0.378 |
IAA (relaxed) | 0.428 | 0.500 | 0.434 |