Table 5 F1-scores on fivefold cross-validated data set
| Â | Methods | Adv. (%) | Effect (%) | Int (%) | Mech. (%) |
|---|---|---|---|---|---|
Fold 1 | Only-BERT | 79.5 | 76.7 | 64.8 | 82.1 |
+ Interaction_attention | 83.9 | 77.0 | 70.3 | 84.6 | |
+ Int_attention + MOL | 82.0 | 78.2 | 69.1 | 83.9 | |
+ All | 84.7 | 79.2 | 79.2 | 86.4 | |
Fold 2 | Only-BERT | 75.5 | 61.0 | 67.5 | 70.1 |
+ Interaction_attention | 80.3 | 69.9 | 70.2 | 77.6 | |
+ Int_attention + MOL | 74.3 | 64.5 | 69.9 | 74.2 | |
+ All | 81.3 | 69.7 | 74.5 | 80.2 | |
Fold 3 | Only-BERT | 68.5 | 72.5 | 70.3 | 74.4 |
+ Interaction_attention | 70.2 | 79.9 | 69.3 | 82.1 | |
+ Int_attention + MOL | 69.1 | 74.4 | 65.5 | 79.6 | |
+ All | 70.1 | 80.6 | 72.3 | 83.6 | |
Fold 4 | Only-BERT | 73.3 | 76.6 | 71.4 | 74.3 |
+ Interaction_attention | 83.2 | 75.5 | 81.0 | 75.0 | |
+ Int_attention + MOL | 76.3 | 73.3 | 69.1 | 74.5 | |
+ All | 82.4 | 78.5 | 79.5 | 77.6 | |
Fold 5 | Only-BERT | 70.3 | 78.8 | 74.2 | 77.6 |
+Interaction_attention | 76.5 | 82.4 | 80.8 | 85.2 | |
+ Int_attention + MOL | 77.5 | 80.4 | 75.2 | 79.2 | |
+ All | 79.3 | 85.8 | 81.3 | 86.6 |