Skip to main content

Table 1 Kappa scores

From: Machine learning-based donor permission extraction from informed consent documents

Permissions

Round 1

Round 2

Round 3

Round 4

Round 5

Mean (SD)

Blank

0.58

0.68

0.62

0.66

0.76

0.66 (0.07)

Q1

0.41

0.29

 

0.78

0.89

0.59 (0.29)

Q2

0.50

0.59

 

0.52

0.75

0.59 (0.11)

Q3

0.42

0.71

0.40

0.40

0.59

0.50 (0.14)

Q4

0.07

0.50

0.00

0.00

0.26

0.17 (0.22)

Q5

0.59

0.65

0.79

0.47

0.72

0.64 (0.12)

Q6

0.38

0.66

0.54

0.72

0.73

0.61 (0.15)

Q7

0.59

0.56

0.00

 

0.88

0.50 (0.37)

Q8

0.75

0.73

1.00

0.67

0.89

0.81 (0.14)

Q9

0.59

0.77

0.80

0.75

0.71

0.72 (0.08)