Table 15 Inter-annotator agreement broken down by question types and corresponding triggers

General question types

comparison

0.28

0.43

0.66

0.77

information

0.37

0.51

0.65

0.75

time

-

-

0.47

0.65

other_question

0.23

0.39

0.00

0.00

Problem question types

cause

0.60

0.64

0.63

0.76

complication

0.17

0.21

0.58

0.64

diagnose_me

-

-

0.72

0.82

diagnosis

0.30

0.48

0.51

0.72

effect (association)

0.35

0.45

0.17

0.17

frequency

0.20

0.30

-

-

inheritance

0.30

0.46

-

-

lifestyle_diet

0.02

0.25

0.32

0.37

location

0.20

0.20

0.60

0.85

person_organization

0.43

0.63

0.18

0.63

prevention

0.44

0.51

0.50

0.50

prognosis

0.25

0.49

0.41

0.77

support_group

0.00

0.00

-

-

susceptibility

0.26

0.34

0.57

0.73

symptom

0.26

0.45

0.53

0.65

treatment

0.52

0.75

0.76

0.86

Intervention question types

action

0.03

0.19

0.57

0.60

alternative

0.18

0.22

-

-

contraindication

0.10

0.25

0.57

0.67

cost

0.40

0.40

1.00

1.00

dosage

0.23

0.37

-

-

indication

0.15

0.29

0.48

0.75

ingredient

0.36

0.83

0.50

0.50

interaction

0.20

0.73

0.57

0.78

long_term_effect

0.22

0.30

-

-

overdose

0.00

0.33

-

-

side_effect

0.31

0.39

-

-

storage_disposal

0.19

0.35

-

-

tapering

0.13

0.36

-

-

usage

0.08

0.40

0.62

0.72

drug_question

0.14

0.28

-

-