Skip to main content

Table 8 Results of KB evaluation for Q5 (Find the protein pairs of which one regulates the other) and Q6 (Find the protein pairs of which one regulates the other, transitive).

From: Extending the evaluation of Genia Event task toward knowledge base construction and comparison to Gene Regulation Ontology task

 

Q5 (Regulation)

Q6 (transitive Regulation)

 

P

TP

R / P / F

P

TP

R / P / F

GS

108

108

-

360

360

-

EVEX

61

18

16.67 / 29.51 / 21.30

197

126

35.00 / 63.96 / 45.24

TEES-2.1

65

18

16.67 / 27.69 / 20.81

218

133

36.94 / 61.01 / 46.02

BioSEM

45

14

12.96 / 31.11 / 18.30

155

90

25.00 / 58.06 / 34.95

NCBI

34

8

07.41 / 23.53 / 11.27

103

69

19.17 / 66.99 / 29.81

DlutNLP

69

20

18.52 / 28.99 / 22.60

174

106

29.44 / 60.92 / 39.70

HDS4NLP

31

13

12.04 / 41.94 / 18.71

31

17

04.72 / 54.84 / 08.70

NICTANLM

31

5

04.63 / 16.13 / 07.19

112

64

17.78 / 57.14 / 27.12

USheff

18

5

04.63 / 27.78 / 07.94

60

35

09.72 / 58.33 / 16.67

UZH

6

0

00.00 / 00.00 / 00.00

21

8

02.22 / 38.10 / 04.20

HCMUS

94

9

08.33 / 09.57 / 08.91

156

33

09.17 / 21.15 / 12.79

  1. Acronyms: GS=gold standard, P=positives, TP=true positives, R=recall, P=precision, F=f-score.