Skip to main content

Table 2 Pairwise agreement among the authors. The numbers presented in rows 3–7 were calculated for each pair of authors, as: (# of annotation agreements)/(# of fragments mutually annotated) but only included those sentences on which the pair of authors agreed on the number of fragments (such agreement on fragment number as a percentage is given in row 2).

From: New directions in biomedical text annotation: definitions, guidelines and corpus construction

Dimension

Aut1–Aut2

Aut2–Aut3

Aut1–Aut3

# of fragments

0.851

0.881

0.891

Focus

0.803

0.731

0.733

Polarity

1.000

0.989

0.989

Certainty

0.861

0.787

0.800

Evidence

0.757

0.787

0.844

Trend

0.803

0.775

0.866