Skip to main content

Table 2 Benchmark results of the thirteen prediction tools. Equations 1-4 are used to measure the predictive performance of these tools. (Abbreviations used: Sn = Sensitivity; Spc = Specificity; Acc = Accuracy; MCC = Matthews' Correlation Coefficient). 1 Used with HMMER 2.3.2 with cut-off score set at -5 [26] and the updated model [20]; 2 Version 3.0; 3 Authors updated system with UniProt 14.6 (Swiss-Prot Release 57.0) [3, 62]; 4 Version 1.0.1.

From: A comprehensive assessment of N-terminal signal peptides prediction methods

  Experiment 1 Experiment 2 Experiment 3
Methods Sn Spc Acc MCC Sn Spc Acc MCC Sn Spc Acc MCC
Philius 0.704 0.952 0.828 0.677 0.742 0.968 0.855 0.729 0.728 0.961 0.844 0.708
Phobius 0.637 0.978 0.807 0.654 0.749 0.982 0.865 0.752 0.711 0.987 0.849 0.726
PrediSi 0.726 0.974 0.850 0.723 0.768 0.986 0.877 0.773 0.750 0.974 0.862 0.742
RPSP 0.730 0.989 0.859 0.744 0.805 0.996 0.901 0.816 0.794 1.000 0.897 0.811
SigCleave 0.541 0.878 0.709 0.445 0.613 0.823 0.718 0.446 0.618 0.860 0.739 0.493
SigHMM1 0.707 0.937 0.822 0.662 0.561 0.963 0.762 0.572 0.596 0.952 0.774 0.587
SignalP2 ANN 0.785 0.959 0.872 0.756 0.856 0.965 0.910 0.826 0.842 0.987 0.914 0.838
SignalP2 HMM 0.759 0.952 0.856 0.725 0.832 0.974 0.903 0.814 0.833 0.969 0.901 0.810
Signal-BLAST3 0.978 0.815 0.896 0.803 0.881 0.809 0.845 0.692 0.825 0.794 0.809 0.619
Signal-CF 0.648 0.900 0.774 0.566 0.768 0.905 0.836 0.679 0.750 0.890 0.820 0.647
Signal-3L 0.737 0.889 0.813 0.633 0.786 0.920 0.853 0.712 0.715 0.934 0.825 0.665
SOSUIsignal 0.189 0.926 0.557 0.170 0.232 0.925 0.578 0.217 0.232 0.921 0.577 0.212
SPOCTOCUS4 0.393 0.907 0.650 0.350 0.502 0.902 0.702 0.441 0.408 0.899 0.654 0.352