Skip to main content

Table 5 Comparison with other BERT variants

From: B-LBConA: a medical entity disambiguation model based on Bio-LinkBERT and context-aware mechanism

Model

Parameters

NCBI

ADR

ShARe/CLEF

test

refined test

test

refined test

test

refined test

BlueBERT(Fine-Tuned) [24]

110 M

88.13

69.73

92.87

79.36

90.66

74.92

PubMedBERT(Fine-Tuned) [12]

110 M

90.28

72.79

93.01

81.96

92.45

78.26

BioDistilBERT(Fine-Tuned) [25]

80 M

91.15

72.13

92.79

80.45

92.67

83.29

BioTinyBERT(Fine-Tuned) [25]

18 M

87.48

67.34

89.68

75.31

89.48

78.64

BioMobileBERT(Fine-Tuned) [25]

30 M

89.86

68.21

90.14

75.93

90.28

76.83

SAPBERT(w/o Fine-Tuned) [26]

110 M

90.02

70.41

92.37

79.52

90.89

77.47

SAPBERT(Fine-Tuned) [26]

110 M

92.34

73.25

93.42

81.64

91.37

78.59

BioSyn [27]

110 M

90.58

72.48

95.02

81.19

92.16

77.34

BioSyn(init. w/SAPBERT) [27]

110 M

92.51

74.04

94.65

82.45

93.45

79.85

Bio-LinkBERT (ours)

108 M

93.57

74.38

94.72

79.89

94.23

80.68

  1. The bold font indicates the best performance on each dataset and the italics font indicates the second-best performance