Skip to main content

Table 6 Human evaluation on randomly sampled subset (30 interactions per PTM, unless there are fewer predictions) selected after thresholding on average confidence and standard deviation

From: Large-scale protein-protein post-translational modification extraction with distant supervision and confidence calibrated BioBERT

  Acety. Dephosph. Methy. Phosph. Ubiquit. Total
Correct 0 11 11 6 0 28
Incorrect—DNA methylation 0 0 2 0 0 2
Incorrect—NER 0 2 1 3 0 6
Incorrect—no trigger word 0 1 0 2 4 7
Incorrect—opposite type 0 1 0 0 0 1
Incorrect—relationship not described 0 14 4 19 0 37
Not—sure 1 0 1 0 0 2
Total 1 29 19 30 4 83