Skip to main content

Table 2 Pairwise agreement among the authors. The numbers presented in rows 3–7 were calculated for each pair of authors, as: (# of annotation agreements)/(# of fragments mutually annotated) but only included those sentences on which the pair of authors agreed on the number of fragments (such agreement on fragment number as a percentage is given in row 2).

From: New directions in biomedical text annotation: definitions, guidelines and corpus construction

Dimension Aut1–Aut2 Aut2–Aut3 Aut1–Aut3
# of fragments 0.851 0.881 0.891
Focus 0.803 0.731 0.733
Polarity 1.000 0.989 0.989
Certainty 0.861 0.787 0.800
Evidence 0.757 0.787 0.844
Trend 0.803 0.775 0.866