Metric | Dataset | LPI-BLS | LPI-CatBoost | PLIPCOM | LPI-SKF | LPI-HNM | LPI-deepGBDT |
---|---|---|---|---|---|---|---|
Precision | Dataset 1 | 0.5370 ± 0.0347 | 0.3405 ± 0.1562 | 0.3541 ± 0.1209 | 0.7009 ± 0.1208 | 0.6836 ± 0.1148 | 0.4413 ± 0.1452 |
Dataset 2 | 0.5769 ± 0.0287 | 0.3468 ± 0.1536 | 0.3879 ± 0.1793 | 0.6138 ± 0.1316 | 0.6227 ± 0.1840 | 0.6190 ± 0.0982 | |
Dataset 3 | 0.4479 ± 0.0234 | 0.5419 ± 0.0476 | 0.3772 ± 0.1050 | 0.6639 ± 0.1119 | 0.6842 ± 0.0844 | 0.5312 ± 0.0742 | |
Dataset 4 | 0.5319 ± 0.0042 | 0.6023 ± 0.0286 | 0.7413 ± 0.0151 | 0.7261 ± 0.0412 | 0.6635 ± 0.0230 | 0.7421 ± 0.0133 | |
Dataset 5 | 0.4164 ± 0.0122 | 0.7868 ± 0.0085 | 0.7459 ± 0.0037 | 0.7264 ± 0.1465 | 0.7700 ± 0.0505 | 0.7658 ± 0.0349 | |
Ave. | 0.5020 | 0.5237 | 0.5213 | 0.6862 | 0.6848 | 0.6199 | |
Recall | Dataset 1 | 0.5264 ± 0.0130 | 0.2567 ± 0.1423 | 0.2165 ± 0.0725 | 0.5415 ± 0.0702 | 0.7060 ± 0.0876 | 0.2298 ± 0.1220 |
Dataset 2 | 0.5486 ± 0.0204 | 0.2325 ± 0.1309 | 0.1744 ± 0.1197 | 0.4114 ± 0.0551 | 0.6568 ± 0.1041 | 0.2067 ± 0.0915 | |
Dataset 3 | 0.4819 ± 0.0104 | 0.3637 ± 0.0817 | 0.3023 ± 0.1209 | 0.4982 ± 0.0746 | 0.6651 ± 0.0211 | 0.3525 ± 0.1286 | |
Dataset 4 | 0.5479 ± 0.0042 | 0.5278 ± 0.0600 | 0.6730 ± 0.0125 | 0.5402 ± 0.0415 | 0.6411 ± 0.0329 | 0.6978 ± 0.0273 | |
Dataset 5 | 0.7993 ± 0.0470 | 0.8122 ± 0.0338 | 0.8473 ± 0.0155 | 0.5811 ± 0.0589 | 0.7394 ± 0.0156 | 0.8684 ± 0.0565 | |
Ave. | 0.5808 | 0.4386 | 0.4427 | 0.5145 | 0.6817 | 0.4710 | |
Accuracy | Dataset 1 | 0.5382 ± 0.0252 | 0.5204 ± 0.0694 | 0.5173 ± 0.0424 | 0.5867 ± 0.0757 | 0.6518 ± 0.0350 | 0.5386 ± 0.0615 |
Dataset 2 | 0.5672 ± 0.0181 | 0.5092 ± 0.0641 | 0.5298 ± 0.0562 | 0.5220 ± 0.0482 | 0.6474 ± 0.0736 | 0.5609 ± 0.0430 | |
Dataset 3 | 0.4708 ± 0.0139 | 0.5361 ± 0.0321 | 0.4899 ± 0.0349 | 0.5584 ± 0.0777 | 0.6347 ± 0.0312 | 0.5284 ± 0.0409 | |
Dataset 4 | 0.5135 ± 0.0038 | 0.5767 ± 0.0126 | 0.7172 ± 0.0109 | 0.6202 ± 0.0332 | 0.6150 ± 0.0286 | 0.7261 ± 0.0104 | |
Dataset 5 | 0.5089 ± 0.0004 | 0.7951 ± 0.0141 | 0.7785 ± 0.0051 | 0.6636 ± 0.0644 | 0.7117 ± 0.0144 | 0.7985 ± 0.0117 | |
Ave. | 0.5197 | 0.5875 | 0.6065 | 0.5902 | 0.6521 | 0.6305 | |
F1-score | Dataset 1 | 0.5285 ± 0.0228 | 0.2567 ± 0.1423 | 0.2494 ± 0.0853 | 0.5399 ± 0.0745 | 0.6818 ± 0.0428 | 0.2697 ± 0.1242 |
Dataset 2 | 0.5617 ± 0.0246 | 0.2622 ± 0.1347 | 0.2131 ± 0.1301 | 0.4092 ± 0.0634 | 0.6295 ± 0.1274 | 0.2629 ± 0.1012 | |
Dataset 3 | 0.4635 ± 0.0172 | 0.4175 ± 0.0750 | 0.3144 ± 0.1120 | 0.4929 ± 0.0804 | 0.6719 ± 0.0487 | 0.3791 ± 0.0995 | |
Dataset 4 | 0.5372 ± 0.0005 | 0.5389 ± 0.0305 | 0.7030 ± 0.0103 | 0.5468 ± 0.0408 | 0.6521 ± 0.0280 | 0.7160 ± 0.0142 | |
Dataset 5 | 0.5467 ± 0.0250 | 0.7970 ± 0.0184 | 0.7920 ± 0.0071 | 0.5908 ± 0.0734 | 0.7537 ± 0.0290 | 0.8115 ± 0.0084 | |
Ave. | 0.5275 | 0.4545 | 0.4544 | 0.5159 | 0.6778 | 0.4878 | |
AUC | Dataset 1 | 0.5701 ± 0.0508 | 0.5659 ± 0.0734 | 0.5397 ± 0.0855 | 0.6293 ± 0.1142 | 0.8013 ± 0.0902 | 0.5419 ± 0.0863 |
Dataset 2 | 0.6227 ± 0.0328 | 0.5173 ± 0.0987 | 0.5895 ± 0.0743 | 0.5235 ± 0.0899 | 0.7578 ± 0.1278 | 0.6347 ± 0.0798 | |
Dataset 3 | 0.4443 ± 0.0269 | 0.5373 ± 0.0421 | 0.5084 ± 0.0512 | 0.5848 ± 0.1577 | 0.7595 ± 0.0402 | 0.5625 ± 0.0508 | |
Dataset 4 | 0.5206 ± 0.0088 | 0.6004 ± 0.0148 | 0.7791 ± 0.0124 | 0.7202 ± 0.0571 | 0.7134 ± 0.0528 | 0.7883 ± 0.0115 | |
Dataset 5 | 0.5013 ± 0.0025 | 0.8717 ± 0.0133 | 0.8544 ± 0.0063 | 0.8000 ± 0.1136 | 0.8959 ± 0.0212 | 0.8802 ± 0.0172 | |
Ave. | 0.5318 | 0.6185 | 0.6542 | 0.6516 | 0.7856 | 0.6815 | |
AUPR | Dataset 1 | 0.5429 ± 0.0415 | 0.5303 ± 0.0744 | 0.5099 ± 0.0686 | 0.7347 ± 0.1155 | 0.8520 ± 0.0714 | 0.5539 ± 0.0754 |
Dataset 2 | 0.5672 ± 0.0181 | 0.4973 ± 0.0760 | 0.5299 ± 0.0719 | 0.5965 ± 0.1215 | 0.7137 ± 0.2185 | 0.6272 ± 0.0669 | |
Dataset 3 | 0.4600 ± 0.0243 | 0.5438 ± 0.0333 | 0.5197 ± 0.0420 | 0.6556 ± 0.1277 | 0.7782 ± 0.0554 | 0.5614 ± 0.0422 | |
Dataset 4 | 0.5525 ± 0.0034 | 0.6161 ± 0.0211 | 0.7778 ± 0.0168 | 0.7415 ± 0.0543 | 0.7491 ± 0.0348 | 0.7788 ± 0.0151 | |
Dataset 5 | 0.7308 ± 0.0046 | 0.8471 ± 0.0164 | 0.8187 ± 0.0119 | 0.7600 ± 0.1657 | 0.8836 ± 0.0563 | 0.8643 ± 0.0253 | |
Ave. | 0.5707 | 0.6069 | 0.6312 | 0.6977 | 0.7953 | 0.6771 |