Skip to main content

Table 15 Criteria for the manual evaluation of the ā€œidealā€ answers in Phase B of Task 1b

From: An overview of the BIOASQ large-scale biomedical semantic indexing and question answering competition

Criterion

Explanation

Score

information recall

All the necessary information is reported.

1–5

information precision

No irrelevant information is reported.

1–5

information repetition

The answer does not repeat the same information multiple times.

1–5

readability

The answer is easily readable and fluent.

1–5