Skip to main content

Table 3 Inter-annotator agreement on a sample of 10 radiology reports (F-measure)

From: Natural language processing of radiology reports for the detection of thromboembolic diseases and clinically relevant incidental findings

Category Exact match Inexact match
Entities (overall IAA) 77.3 87.8
  Anatomy 73.5 90.9
  ThromboPat* 95.7 99.1
  Exam 89.3 89.3
  K* 78.4 78.4
Relations (overall IAA) 62.4 71.8
  Anatomy Location_of K* 80 80
  Anatomy Location_of ThromboPat* 50 66.7
  1. IAA = inter-annotator agreement.
  2. *ThromboPat for thrombopathology concepts.
  3. *K for clinically relevant findings.