Skip to main content

Table 13 Annotation comparison strategies

From: A corpus of full-text journal articles is a robust evaluation tool for revealing differences in performance of biomedical natural language processing tools

Strict

Requiring matches at both the left and right edges of the name span

Overlap

Allowing any degree of overlap between the system-identified name span and the gold standard name span

Shared

Requiring a match only at one of the left or right edge of the name span

Subspan

Subsumption, where the boundaries of the system-identified name are within the span of the gold standard annotation, or vice versa