Skip to main content

Table 6 LiveQA Measures: Average Score (main score), Success@i+ and Precision@i+ on LiveQA’17 Test Data

From: A question-entailment approach to question answering

Measures

IR-based System

IR+RQE System

LiveQA’17 Best Results

LiveQA’17 Median Results

avgScore(0-3)

0.711

0.827

0.637

0.431

succ@2+

0.442

0.461

0.392

0.245

succ@3+

0.192

0.25

0.265

0.142

succ@4+

0.077

0.115

0.098

0.059

prec@2+

0.46

0.475

0.404

0.331

prec@3+

0.2

0.257

0.273

0.178

prec@4+

0.08

0.119

0.101

0.077

  1. Evaluation of the first retrieved answer for each question. N.B. Evaluating the RQE System alone is not relevant as explained previously (“RQE-based QA Approach” section). The best score are in bold