Model | Doc | Passage | Passage2 | Aspect |
---|---|---|---|---|
Top TREC* | 0.3105 | 0.0976 | 0.1097 | 0.2494 |
Median TREC | 0.1954 | 0.0565 | 0.0391 | 0.1272 |
TREC 2007 Submission | 0.2385 | 0.09742 | 0.1647 | 0.05164 |
Document model | 0.2363 | - | - | - |
Topic model No relevance | 0.2034 | - | - | - |
Topic-relevance model | 0.2605 | 0.0898 | 0.0452 | 0.1383 |
Concept model | 0.3381 | 0.1087 | 0.0579 | 0.1907 |
Term model | 0.3226 | 0.1053 | 0.0557 | 0.1856 |
Concept+Term models | 0.3443 | 0.1100 | 0.0588 | 0.2145 |
Doc+Concept +Term+Topic-relevance Min Spanning Passage 5 | 0.3554 (+14.46%) p = 0.0582 | 0.1214 (+24.39%) p = 0.0321 †| 0.0681 (-37.92%) | 0.2412 (-3.29%) |
Doc+Concept +Term+ Topic-relevance Max Spanning Passage 6 | 0.3576 (+15.17%) p = 0.0504 | 0.1093 (+11.99%) | 0.1280 (+16.68%) p = 0.0834 | 0.2596 (+4.08%) |