Skip to main content

Advertisement

Table 6 Confusion matrix for inter-annotator agreement on the CRA corpus: linguist (L) vs. domain expert (E) - S3

From: A comparison and user-based evaluation of models of textual information structure in the context of cancer risk assessment

HYP MOT BKG GOAL OBJT EXP MOD METH OBS RES CON L/E
16 0 12 1 0 0 0 0 0 0 5 HYP
5 48 13 0 2 0 0 4 0 1 0 MOT
11 6 316 0 3 0 0 4 1 1 2 BKG
2 4 4 87 80 7 0 10 0 0 0 GOAL
0 0 0 2 39 3 0 9 0 0 0 OBJT
0 0 1 1 7 190 0 66 5 8 0 EXP
0 0 3 1 4 7 5 13 0 2 1 MOD
0 0 8 7 25 63 5 92 3 10 1 METH
0 0 4 0 1 3 0 9 183 285 1 OBS
0 0 3 0 0 2 3 8 53 466 10 RES
0 1 5 1 1 0 1 3 9 105 337 CON