|
Dataa
|
Biocurator 1
|
Biocurator 2
|
Biocurator 3
|
Averagee
|
|---|
|
No. articles examined
|
53
|
68
|
65
|
62
|
|
Precision
b
|
0.90
|
0.97
|
0.86
|
0.91
|
|
Recall
c
|
0.62
|
0.79
|
0.71
|
0.71
|
|
F1-measure
d
|
0.70
|
0.85
|
0.75
|
0.77
|
- aOnly curated chemical-gene interactions were analyzed (disease interactions were not considered); consequently, these numbers differ slightly from those reported in Table 2.
- bPrecision = Correct interactions for individual biocurator/Total interactions for individual biocurator.
- cRecall = Correct interactions for individual biocurator/Total correct interactions from all biocurators.
- dF1-measure is the harmonic mean of precision and recall = (2 × Precision × Recall)/(Precision + Recall). Precision, Recall, and F1-measure were macro-averaged over the set of articles curated by that curator.
- eCalculated using data from three biocurators.
