The first step in the development of text mining technology for cancer risk assessment: identifying and organizing scientific evidence in risk assessment literature

Table 7 The distribution of the annotations and the statistics of agreement

	A1	A2	Agreement	Disagreement
Carcinogenic activity	281 (0.55)	217 (0.50)	194 (0.78)	55 (0.22)
Mode of Action	158 (0.31)	172 (0.40)	129 (0.78)	36 (0.22)
Toxicokinetics	75 (0.15)	45 (0.10)	37 (0.62)	23 (0.38)
Irrelevant	0	2	0	2
Total	514	436	360 (0.76)	116 (0.24)

The columns A1 and A2 correspond to the annotators 1 and 2, respectively. The values shown are the number of annotations by the annotator. The last two columns show the statistics of agreement and disagreement. Rows 2-4 show the results for the three sub-taxonomies and the last row indicates the number of irrelevant abstracts among the relevant ones.

ISSN: 1471-2105