Table 6 Confusion matrix for inter-annotator agreement on the CRA corpus: linguist (L) vs. domain expert (E) - S3
HYP | MOT | BKG | GOAL | OBJT | EXP | MOD | METH | OBS | RES | CON | L/E |
|---|---|---|---|---|---|---|---|---|---|---|---|
16 | 0 | 12 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 5 | HYP |
5 | 48 | 13 | 0 | 2 | 0 | 0 | 4 | 0 | 1 | 0 | MOT |
11 | 6 | 316 | 0 | 3 | 0 | 0 | 4 | 1 | 1 | 2 | BKG |
2 | 4 | 4 | 87 | 80 | 7 | 0 | 10 | 0 | 0 | 0 | GOAL |
0 | 0 | 0 | 2 | 39 | 3 | 0 | 9 | 0 | 0 | 0 | OBJT |
0 | 0 | 1 | 1 | 7 | 190 | 0 | 66 | 5 | 8 | 0 | EXP |
0 | 0 | 3 | 1 | 4 | 7 | 5 | 13 | 0 | 2 | 1 | MOD |
0 | 0 | 8 | 7 | 25 | 63 | 5 | 92 | 3 | 10 | 1 | METH |
0 | 0 | 4 | 0 | 1 | 3 | 0 | 9 | 183 | 285 | 1 | OBS |
0 | 0 | 3 | 0 | 0 | 2 | 3 | 8 | 53 | 466 | 10 | RES |
0 | 1 | 5 | 1 | 1 | 0 | 1 | 3 | 9 | 105 | 337 | CON |