Skip to main content

Table 5 Statistics used in the inter-annotator agreement test

From: The first step in the development of text mining technology for cancer risk assessment: identifying and organizing scientific evidence in risk assessment literature

 

Annotator 2 rel

Annotator 2 irr

Annotator 1 total

Annotator 1 rel

145(p11= 0.697)

16(p12 = 0.077)

161(p1· = 0.774)

Annotator 1 irr

8 (p21= 0.038)

39(p22 = 0.186)

47 (p2· = 0.226)

Annotator 2 total

153(p·1 = 0.736)

55(p·2 = 0.264)

208(1)