From: External features enriched model for biomedical question answering
Model | 6b Factoid QA | 7b Factoid QA | 8b Factoid QA | ||||||
---|---|---|---|---|---|---|---|---|---|
Sacc | Lacc | MRR | Sacc | Lacc | MRR | Sacc | Lacc | MRR | |
Baseline (BioBERT) | 0.3973 | 0.6217 | 0.4838 | 0.4318 | 0.6164 | 0.5007 | 0.3848 | 0.5585 | 0.4492 |
+FF (Feature Fusion) | 0.4328 | 0.6296 | 0.5066 | 0.4467 | 0.5998 | 0.5085 | 0.3928 | 0.5813 | 0.4636 |
+POS+FF | 0.4363 | 0.5957 | 0.5024 | 0.4353 | 0.6171 | 0.5051 | 0.3994 | 0.5786 | 0.4660 |
+NER+FF | 0.4471 | 0.6114 | 0.5072 | 0.4471 | 0.6114 | 0.5072 | 0.4053 | 0.5795 | 0.4678 |
Full model (BioBERT+POS+NER+FF) | 0.4517 | 0.6294 | 0.5197 | 0.4444 | 0.6419 | 0.5165 | 0.3937 | 0.6098 | 0.4688 |