Skip to main content

Table 1 Performance summary of all methods and predictions targets evaluated on the independent test dataset. Bold face indicates the best performing method. More detailed metrics, broken down to individual classes, can be found in the supplementary materials

From: AllesTM: predicting multiple structural features of transmembrane proteins

 

Z-coordinates

Topology

Continuous flexibility

Two-state flexibility

  
 

MAE

ACC

MAE

ACC

  

RF

9.1

0.83

0.67

0.68

  

GBM

7.82

0.86

0.65

0.69

  

conv

5.18

0.86

0.63

0.7

  

dconv

4.45

0.88

0.63

0.7

  

LSTM

3.71

0.89

0.63

0.7

  

AllesTM

3.72

0.9

0.63

0.7

  

MEMSAT-SVM

 

0.74

    

PolyPhobiusa

 

0.75/0.75

    

SCAMPIa

 

0.77/0.78

    

PROFbval

  

0.78

0.65

  

PredyFlexy

  

0.8

   
 

Phi angles

Psi angles

Secondary structure

RSA monomer

RSA complex

RSA change

 

MAE

MAE

ACC

MAE

MAE

MAE

RF

18.91

39.5

0.82

0.18

0.16

0.09

GBM

18.5

35.93

0.84

0.17

0.15

0.09

conv

16.93

28.75

0.85

0.16

0.14

0.07

dconv

17.43

29.47

0.85

0.16

0.14

0.07

LSTM

17.03

28.81

0.85

0.16

0.14

0.07

AllesTM

17.34

30.41

0.86

0.15

0.14

0.08

PROFphd

  

0.78

   

PSIPRED

  

0.87

   

ANGLOR

19.57

38.33

    

SPINE X

20.68

41.77

0.77

0.2

0.17

 

SPOT-1D

15.85

23.51

0.89

0.14

0.16

 
  1. aThe second value indicates the performance of PolyPhobius and SCAMPI without reentrant regions