Skip to main content

Table 4 Inter-annotator agreement

From: BIOSMILE: A semantic role labeling system for biomedical verbs using a maximum-entropy model with automatically generated template features

  

P(A)

P(E)

Kappa score

Including ArgM

role identification

.97

.52

.94

 

role classification

.96

.18

.95

 

combined decision

.96

.18

.95

Excluding ArgM

role identification

.97

.26

.94

 

role classification

.99

.28

.98

 

combined decision

.99

.28

.98