Skip to main content

Table 3 Ablation experiment results of our model

From: External features enriched model for biomedical question answering

Model 6b Factoid QA 7b Factoid QA 8b Factoid QA
Sacc Lacc MRR Sacc Lacc MRR Sacc Lacc MRR
Baseline (BioBERT) 0.3973 0.6217 0.4838 0.4318 0.6164 0.5007 0.3848 0.5585 0.4492
+FF (Feature Fusion) 0.4328 0.6296 0.5066 0.4467 0.5998 0.5085 0.3928 0.5813 0.4636
+POS+FF 0.4363 0.5957 0.5024 0.4353 0.6171 0.5051 0.3994 0.5786 0.4660
+NER+FF 0.4471 0.6114 0.5072 0.4471 0.6114 0.5072 0.4053 0.5795 0.4678
Full model (BioBERT+POS+NER+FF) 0.4517 0.6294 0.5197 0.4444 0.6419 0.5165 0.3937 0.6098 0.4688
  1. Bold values represent the highest results