Table 4 Overview of Fleiss’s kappa agreement at the end of each round. The agreement has been computed for concepts, relationships, and assertion annotations for each task’s entire set of documents
From: MetaTron: advancing biomedical annotation empowering relation annotation and collaboration
| Â | GCA | GDA | |
|---|---|---|---|
| Â | Concepts annotation | Relationships annotation | Assertions annotation |
Round 1 | 0.3312 | − 0.2179 | − 0.0364 |
Round 2 | 0.3312 | − 0.0872 | 0.2490 |