Skip to main content

Table 3 Inter-annotator agreement on a sample of 10 radiology reports (F-measure)

From: Natural language processing of radiology reports for the detection of thromboembolic diseases and clinically relevant incidental findings

Category

Exact match

Inexact match

Entities (overall IAA)

77.3

87.8

  Anatomy

73.5

90.9

  ThromboPat*

95.7

99.1

  Exam

89.3

89.3

  K*

78.4

78.4

Relations (overall IAA)

62.4

71.8

  Anatomy Location_of K*

80

80

  Anatomy Location_of ThromboPat*

50

66.7

  1. IAA = inter-annotator agreement.
  2. *ThromboPat for thrombopathology concepts.
  3. *K for clinically relevant findings.