Text mining and manual curation of chemical-gene-disease networks for the Comparative Toxicogenomics Database (CTD)

Table 3 Precision, recall, and f-measure of CTD manual curation

Data^a	Biocurator 1	Biocurator 2	Biocurator 3	Average^e
No. articles examined	53	68	65	62
Precision ^b	0.90	0.97	0.86	0.91
Recall ^c	0.62	0.79	0.71	0.71
F1-measure ^d	0.70	0.85	0.75	0.77

^aOnly curated chemical-gene interactions were analyzed (disease interactions were not considered); consequently, these numbers differ slightly from those reported in Table 2.
^bPrecision = Correct interactions for individual biocurator/Total interactions for individual biocurator.
^cRecall = Correct interactions for individual biocurator/Total correct interactions from all biocurators.
^dF1-measure is the harmonic mean of precision and recall = (2 × Precision × Recall)/(Precision + Recall). Precision, Recall, and F1-measure were macro-averaged over the set of articles curated by that curator.
^eCalculated using data from three biocurators.