Skip to main content
Figure 3 | BMC Bioinformatics

Figure 3

From: Objective and automated protocols for the evaluation of biomedical search engines using No Title Evaluation protocols

Figure 3

Sensitivity of the evaluation to the search method S ref . Two different search methods were used in Step 1 of the high-recall evaluation (n = 29 search methods tested). The panels show MAP and bpref agreement between these two runs. A stronger agreement is observed for bpref than for MAP (MAP/MAP correlation coefficient: 0.9540, bpref/bpref: 0.9740). These results indicate that the high-recall evaluation protocol produces performance measures which are marginally dependent on the choice of the S ref method used to perform Step 1.

Back to article page