Table 1 Overview of tasks and corpora included in A2A

2004 PubMed snapshot

title, abstract, chemicals, MeSH terms

4.59M

Genomics 2004

50 topics, 8268 judgments, literature retrieval with biology topics

Genomics 2005

50 topics, 39958 judgments, literature retrieval with biology topics

2014 PMC snapshot

full-text, abstract, keywords, title, MeSH descriptors, MeSH qualifiers, MetaMap (title), MetaMap (abstract)

0.73M

CDS 2014 (Description)

30 topics, 37949 judgments, literature retrieval with clinical case descriptions

CDS 2014 (Summary)

30 topics, 37949 judgments, literature retrieval with clinical case summaries

CDS 2015 (Description)

30 topics, 37807 judgments, literature retrieval with clinical case descriptions

CDS 2015 (Summary)

30 topics, 37807 judgments, literature retrieval with clinical case summaries

2016 PMC snapshot

full-text, abstract, keywords, title, MeSH descriptors, MeSH qualifiers, MetaMap (title), MetaMap (abstract)

1.25M

CDS 2016 (Description)

30 topics, 37707 judgments, literature retrieval with clinical case descriptions

CDS 2016 (Summary)

30 topics, 37707 judgments, literature retrieval with clinical case summaries

CDS 2016 (Note)

30 topics, 37707 judgments, literature retrieval with clinical notes

2017 ClinicalTrials.gov

brief summary, brief title, clinical trial ID, detailed description, drug name, drug keywords, exclusion, gender, general keywords, inclusion, intervention type, maximum age, minimum age, official title, and primary outcome

0.24M

PM 2017 (clinical trials)

30 topics, 13019 judgments, clinical trial retrieval with patient profiles

PM 2018 (clinical trials)

50 topics, 14188 judgments, clinical trial retrieval with patient profiles

2019 ClinicalTrials.gov

brief summary, brief title, clinical trial ID, detailed description, drug name, drug keywords, exclusion, gender, general keywords, inclusion, intervention type, maximum age, minimum age, official title, and primary outcome

0.3M

PM 2019 (clinical trials)

40 topics, 12996 judgments, clinical trial retrieval with patient profiles

2017 abstracts

title, abstract, keywords, article type, MeSH descriptors, MeSH qualifiers

26.73M

PM 2017 (abstracts)

30 topics, 22642 judgments, literature retrieval with patient profiles

PM 2018 (abstracts)

50 topics, 22429 judgments, literature retrieval with patient profiles

2019 PubMed snapshot

title, abstract, keywords, article type, MeSH descriptors, MeSH qualifiers

29.13M

PM 2019 (abstracts)

40 topics, 18316 judgments, literature retrieval with patient profiles