Skip to main content

Table 4 Predictive performance on the TESTsmall dataset

From: fDETECT webserver: fast predictor of propensity for protein production, purification, and crystallization

  Predictors Material production (MF) Purification (PF) Crystallization (CF) Diffraction-quality crystallization (CR)
Average ±std p-value Average ±std p-value Average ±std p-value Average ±std p-value
AUC fDETECT 0.68 ±0.11   0.64 ±0.11   0.55 ±0.11   0.64 ±0.07  
PPCpred 0.64 ±0.11 0.004 0.67 ±0.12 <0.001 0.60 ±0.12 <0.001 0.66 ±0.08 0.054
Crysalis 0.67 ±0.11 0.392 0.59 ±0.11 <0.001 0.56 ±0.10 0.366 0.60 ±0.08 <0.001
PredPPCrys 0.62 ±0.11 <0.001 0.59 ±0.11 0.002 0.48 ±0.12 <0.001 0.62 ±0.08 0.001
XtalPRed NA    NA    NA    0.59 ±0.09 <0.001
XtalPred-RF NA    NA    NA    0.65 ±0.08 0.392
TragetCrys NA    NA    NA    0.64 ±0.07 0.734
CRYSTALP2 NA    NA    NA    0.63 ±0.08 0.419
MCC fDETECT 0.21 ±0.17   0.15 ±0.19   0.16 ±0.18   0.20 ±0.13  
PPCpred 0.19 ±0.20 0.039 0.26 ±0.21 <0.001 0.20 ±0.18 0.752 0.23 ±0.15 0.253
Crysalis 0.20 ±0.18 0.115 0.11 ±0.19 0.018 0.07 ±0.16 <0.001 0.15 ±0.15 0.005
PredPPCrys 0.12 ±0.17 <0.001 0.06 ±0.18 <0.001 0.00 ±0.19 <0.001 0.19 ±0.15 0.314
XtalPRed NA    NA    NA    0.18 ±0.18 0.580
XtalPred-RF NA    NA    NA    0.24 ±0.14 0.039
TragetCrys NA    NA    NA    0.21 ±0.12 0.889
CRYSTALP2 NA    NA    NA    0.23 ±0.14 0.297
Accuracy fDETECT 78.0 ±4.9   72.7 ±6.2   68.5 ±6.9   59.9 ±6.7  
PPCpred 77.4 ±5.4 0.040 76.2 ±6.7 <0.001 69.9 ±6.6 0.770 61.4 ±7.6 0.211
Crysalis 77.7 ±4.9 0.104 71.4 ±6.0 0.018 65.1 ±6.1 <0.001 57.5 ±7.3 0.004
PredPPCrys 75.6 ±4.8 <0.001 70.0 ±6.0 <0.001 61.9 ±7.5 <0.001 59.3 ±7.5 0.348
XtalPRed NA    NA    NA    58.7 ±8.8 0.315
XtalPred-RF NA    NA    NA    62.2 ±7.2 0.117
TragetCrys NA    NA    NA    60.3 ±6.2 1.000
CRYSTALP2 NA    NA    NA    61.4 ±6.7 0.256
  1. We report average AUC, MCC and accuracy and their corresponding standard deviations over 100 bootstrap tests (each test is based on 25% of randomly chosen proteins). Statistical significance of differences between fDETECT and each other method was measured with paired t-test; the measured values are normal, which we verified based on the Anderson-Darling test at 0.05 significance. The best results that are not significantly different with each other (p-value >0.05) for each outcome are given in bold font. NA means that a given method does not provide this type of prediction
\