Skip to main content

Table 3 Precision, recall, and f-measure of CTD manual curation

From: Text mining and manual curation of chemical-gene-disease networks for the Comparative Toxicogenomics Database (CTD)

Dataa

Biocurator 1

Biocurator 2

Biocurator 3

Averagee

No. articles examined

53

68

65

62

Precision b

0.90

0.97

0.86

0.91

Recall c

0.62

0.79

0.71

0.71

F1-measure d

0.70

0.85

0.75

0.77

  1. aOnly curated chemical-gene interactions were analyzed (disease interactions were not considered); consequently, these numbers differ slightly from those reported in Table 2.
  2. bPrecision = Correct interactions for individual biocurator/Total interactions for individual biocurator.
  3. cRecall = Correct interactions for individual biocurator/Total correct interactions from all biocurators.
  4. dF1-measure is the harmonic mean of precision and recall = (2 × Precision × Recall)/(Precision + Recall). Precision, Recall, and F1-measure were macro-averaged over the set of articles curated by that curator.
  5. eCalculated using data from three biocurators.