Skip to main content

Table 8 Inter-annotator agreement

From: Coreference annotation and resolution in the Colorado Richly Annotated Full Text (CRAFT) corpus of biomedical journal articles

Metric Average
MUC 0.684
Class-B3 0.858
Entity-B3 0.750
Mention-based CEAF 0.644
Entity-based CEAF 0.480
Krippendorff’s alpha 0.619