Metric | Rouge type | Bio-BERT | Bio-Word2Vec | Gensim | Graph-based | PyTeaser | PKUSUMSUM |
---|---|---|---|---|---|---|---|
\({\textbf {Pr}}\) | ROUGE-1 | 0.88 (0.12) | 0.81 (0.11) | 0.52 (0.11) | 0.75 (0.11) | 0.64 (0.11) | 0.65 (0.23) |
ROUGE-2 | 0.53 (0.08) | 0.46 (0.08) | 0.17 (0.08) | 0.41 (0.08) | 0.29 (0.08) | 0.35 (0.18) | |
ROUGE-L | 0.79 (0.07) | 0.71 (0.08) | 0.41 (0.08) | 0.64 (0.08) | 0.53 (0.08) | 0.68 (0.23) | |
\({\textbf {Rc}}\) | ROUGE-1 | 0.30 (0.14) | 0.31 (0.13) | 0.29 (0.13) | 0.32 (0.13) | 0.36 (0.13) | 0.28 (0.15) |
ROUGE-2 | 0.16 (0.08) | 0.17 (0.08) | 0.15 (0.05) | 0.17 (0.05) | 0.21 (0.05) | 0.17 (0.13) | |
ROUGE-L | 0.27 (0.08) | 0.28 (0.05) | 0.26 (0.05) | 0.28 (0.05) | 0.32 (0.05) | 0.18 (0.07) | |
\({\textbf {Fs}}\) | ROUGE-1 | 0.43 (0.10) | 0.43 (0.08) | 0.34 (0.06) | 0.41 (0.13) | 0.39 (0.10) | 0.28 (0.15) |
ROUGE-2 | 0.32 (0.10) | 0.32 (0.05) | 0.15 (0.07) | 0.24 (0.05) | 0.23 (0.04) | 0.19 (0.15) | |
ROUGE-L | 0.46 (0.08) | 0.42 (0.06) | 0.32 (0.05) | 0.35 (0.06) | 0.40 (0.04) | 0.26 (0.23) |