Skip to main content

Table 13 ID task primary evaluation results: F-scores by event type

From: Overview of the ID, EPI and REL tasks of BioNLP Shared Task 2011

 

FAUST

UMass

Stanford

ConcordU

UTurku

PNNL

PredX

Size

GENE EXPRESSION

70.68

66.43

54.00

56.57

64.88

53.33

0.00

512

TRANSCRIPTION

69.66

68.24

60.00

70.89

57.14

0.00

53.85

77

PROTEIN CATABOLISM

75.00

72.73

20.00

66.67

33.33

11.76

0.00

33

PHOSPHORYLATION

64.00

66.67

40.00

54.55

60.61

64.29

40.00

69

LOCALIZATION

33.33

14.29

31.58

20.00

66.67

20.69

0.00

49

Simple event total

68.47

63.55

52.72

56.78

62.67

43.87

18.18

740

BINDING

31.30

34.62

23.44

40.00

22.22

20.00

28.28

156

PROCESS

65.69

62.26

73.57

67.17

41.57

51.04

53.27

901

Non-regulation total

63.78

60.68

63.59

62.43

46.39

47.34

43.65

1797

REGULATION

35.44

30.49

17.67

19.43

22.96

0.00

2.16

267

POSITIVE REGULATION

47.50

49.49

34.78

23.41

41.28

24.60

21.02

455

NEGATIVE REGULATION

58.86

60.45

44.44

47.96

52.11

25.70

9.49

260

Regulation total

47.07

46.65

33.02

28.87

39.49

18.45

9.71

982

Subtotal

57.28

55.03

52.09

46.60

43.33

37.53

28.38

2779

NEGATION

0.00

0.00

0.00

22.92

32.91

0.00

0.00

96

SPECULATION

0.00

0.00

0.00

3.23

15.00

0.00

0.00

44

Modification total

0.00

0.00

0.00

11.82

26.89

0.00

0.00

140

Total

55.59

53.42

50.63

44.21

42.57

36.27

27.49

2919

  1. The Size column gives the number of annotations of each type in the given data (training+development). Best result for each type shown in bold.