|  | P(A) | P(E) | Kappa score |
---|---|---|---|---|
Including ArgM | role identification | .97 | .52 | .94 |
 | role classification | .96 | .18 | .95 |
 | combined decision | .96 | .18 | .95 |
Excluding ArgM | role identification | .97 | .26 | .94 |
 | role classification | .99 | .28 | .98 |
 | combined decision | .99 | .28 | .98 |