Skip to main content

Table 4 Meta-knowledge assignment results on events in the GENIA-MK test set

From: Extracting semantically enriched events from biomedical literature

Dimension

Value

Count

R / P / F

Majority (R / P / F)

KT

Investigation

411

69.1 / 75.5 / 72.2

0.0 / 0.0 / 0.0

Analysis

1,340

70.4 / 78.4 / 74.2

0.0 / 0.0 / 0.0

Observation

2,593

72.1 / 72.3 / 72.2

100.0 / 34.0 / 50.7

Fact

673

63.7 / 68.0 / 65.8

0.0 / 0.0 / 0.0

Method

178

53.4 / 54.3 / 53.8

0.0 / 0.0 / 0.0

Other

2,440

77.0 / 70.6 / 73.6

0.0 / 0.0 / 0.0

 

Macro Average

7,635

67.6 / 70.0 / 68.6

16.7 / 5.7 / 8.5

 

Micro Average

7,635

72.0 / 72.0 / 72.0

34.0 / 34.0 / 34.0

CL

L3

7,057

97.6 / 97.5 / 97.6

100 / 92.4 / 96.1

L2

420

68.6 / 64.6 / 66.5

0.0 / 0.0 / 0.0

L1

158

67.1 / 84.8 / 74.9

0.0 / 0.0 / 0.0

 

Macro Average

7,635

77.8 / 82.3 / 79.7

33.3 / 30.8 / 32.0

 

Micro Average

7,635

95.4 / 95.4 / 95.4

92.4 / 92.4 / 92.4

Polarity

Positive

7,201

97.3 / 98.0 / 97.7

100 / 94.3 / 97.1

Negative

434

67.1 / 60.1 / 63.4

0.0 / 0.0 / 0.0

 

Macro Average

7,635

77.8 / 82.3 / 79.7

50.0 / 47.2 / 48.5

 

Micro Average

7,635

95.6 / 95.6 / 95.6

94.3 / 94.3 / 94.3

Manner

High

275

49.8 / 46.4 / 48.1

0.0 / 0.0 / 0.0

Low

59

23.7 / 48.3 / 31.8

0.0 / 0.0 / 0.0

Neutral

7,301

97.7 / 97.6 / 97.6

100 / 95.6 / 97.8

 

Macro Average

7,635

57.1 / 64.1 / 59.2

33.3 / 31.9 / 32.6

 

Micro Average

7,635

95.4 / 95.4 / 95.4

95.6 / 95.6 / 95.6

Source

Current

7,510

99.1 / 99.2 / 99.2

100 / 98.4 / 99.2

Other

125

53.6 / 50.0 / 51.7

0.0 / 0.0 / 0.0

 

Macro Average

7,635

76.4 / 74.6 / 75.5

50.0 / 49.2 / 49.6

 

Micro Average

7,635

98.4 / 98.4 / 98.4

98.4 / 98.4 / 98.4

  1. A majority class-based baseline is shown for reference. (R)ecall/(P)recision/(F)score are reported.