Skip to main content

Table 4 The effectiveness of the integrated attention mechanisms according to mean F1 scores for 30 different random seeds

From: Relation extraction between bacteria and biotopes from biomedical texts with attention mechanisms and domain-specific contextual representations

ModelPEF1 score
FullsSDPs MeanSDMinMax
  1. All of the highest scores are highlighted in bold except for the SD. The first-row results derive from the best results of previous experiments (i.e., the last row in Table 3). Note: “PE” denotes positional encoding, “Attn” denotes the use of only Additive attention, “EAttn” denotes the use of both Additive and Entity-Oriented attentions, and “MAttn” denotes the use of Multi-Head attention