Skip to main content

Table 15 Criteria for the manual evaluation of the ā€œidealā€ answers in Phase B of Task 1b

From: An overview of the BIOASQ large-scale biomedical semantic indexing and question answering competition

Criterion

Explanation

Score

information recall

All the necessary information is reported.

1ā€“5

information precision

No irrelevant information is reported.

1ā€“5

information repetition

The answer does not repeat the same information multiple times.

1ā€“5

readability

The answer is easily readable and fluent.

1ā€“5