Skip to main content

Table 1 Annotation characteristics. Each column represents an annotator: Aut1–3 are the authors of this paper and Oth1–9 are the other annotators. The first five rows show the number of fragments into which sentences were broken by each of the annotators. The counts appearing in subsequent rows are normalized by the number of fragments created by that annotator.

From: New directions in biomedical text annotation: definitions, guidelines and corpus construction

   Aut1 Aut2 Aut3 Oth1 Oth2 Oth3 Oth4 Oth5 Oth6 Oth7 Oth8 Oth9
Number of fragments 1 88 80 86 40 60 85 81 40 47 81 68 83
  2 10 18 12 42 31 16 17 44 44 19 30 16
  3 2 3 3 18 7 0 3 13 8 1 3 2
  4 1 0 0 1 2 0 0 4 2 0 0 0
  5 0 0 0 0 1 0 0 0 0 0 0 0
Focus G 0.09 0.15 0.13 0.27 0.29 0.16 0.22 0.15 0.2 0.08 0.13 0.07
  M 0.24 0.15 0.23 0.15 0.15 0.18 0.18 0.09 0.15 0.36 0.23 0.15
  S 0.71 0.8 0.82 0.63 0.63 0.8 0.63 0.75 0.65 0.58 0.71 0.79
Polarity P 0.94 0.94 0.93 0.81 0.92 0.92 0.92 0.88 0.81 0.94 0.92 0.83
  N 0.06 0.06 0.07 0.19 0.08 0.08 0.08 0.12 0.19 0.05 0.08 0.17
Certainty 0 0.02 0.02 0.04 0.01 0 0.02 0.03 0.04 0.01 0.03 0.01 0.08
  1 0.07 0.05 0.13 0.04 0.1 0.05 0.07 0.02 0.04 0.11 0.02 0.03
  2 0.11 0.10 0.13 0.04 0.22 0.05 0.10 0.01 0.05 0.18 0.12 0.03
  3 0.81 0.83 0.69 0.91 0.68 0.88 0.81 0.92 0.9 0.68 0.86 0.87
Evidence 0 0.31 0.34 0.26 0.75 0.38 0.27 0.27 0.7 0.83 0.07 0.31 0.42
  1 0.11 0.09 0.09 0.03 0.07 0.09 0.14 0.03 0 0.43 0.15 0.10
  2 0.19 0.21 0.24 0.14 0.11 0.23 0.23 0.2 0.13 0.16 0.3 0.31
  3 0.41 0.36 0.43 0.08 0.44 0.4 0.4 0.07 0.05 0.34 0.28 0.19
Trend + 0.13 0.03 0.13 0.12 0.12 0.03 0.07 0.03 0.10 0.05 0.11 0.03
  - 0.19 0.06 0.17 0.19 0.12 0.07 0.13 0.04 0.16 0.06 0.08 0.11
  0 0.68 0.91 0.70 0.69 0.76 0.90 0.80 0.93 0.74 0.89 0.81 0.86