Table 5 Individual scores for all annotators. Average sentence scores with 1 point awarded for each agreement with the majority annotation determined over the whole set of twelve annotators. The maximum possible score is 5, while 0 is the minimum.
From: New directions in biomedical text annotation: definitions, guidelines and corpus construction
Annotator | Aut1 | Aut2 | Aut3 | Oth1 | Oth2 | Oth3 | Oth4 | Oth5 | Oth6 | Oth7 | Oth8 | Oth9 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
Ave. Score | 3.96 | 4.25 | 4.08 | 2.06 | 2.95 | 4.00 | 4.00 | 2.07 | 2.50 | 3.59 | 3.59 | 3.57 |