Skip to main content

Table 5 Statistics used in the inter-annotator agreement test

From: The first step in the development of text mining technology for cancer risk assessment: identifying and organizing scientific evidence in risk assessment literature

  Annotator 2 rel Annotator 2 irr Annotator 1 total
Annotator 1 rel 145(p11= 0.697) 16(p12 = 0.077) 161(p = 0.774)
Annotator 1 irr 8 (p21= 0.038) 39(p22 = 0.186) 47 (p = 0.226)
Annotator 2 total 153(p·1 = 0.736) 55(p·2 = 0.264) 208(1)