Skip to main content

Table 3 AEFN based accuracy estimates on the text focus classification task without using ground truth.

From: Learning by aggregating experts and filtering novices: a solution to crowdsourcing problems in bioinformatics

 

First Component

Second Component

Third Component

Annotators

Estimated Sensitivity

Estimated Specificity

Estimated Sensitivity

Estimated Specificity

Estimated Sensitivity

Estimated Specificity

Annotator 1

0.7672

0.7749

0.8005

0.7969

0.7634

0.7907

Annotator 2

0.9373

0.8588

0.8753

0.8271

0.8958

0.8863

Annotator 3

0.7383

0.8258

Filtered

Filtered

Annotator 4

0.8059

0.8652

0.9010

0.8594

0.8318

0.8413

Annotator 5

Filtered

Filtered

Filtered

  1. The estimates by five annotators for three principal components on the text focus task are shown.
Back to article page

BMC Bioinformatics

ISSN: 1471-2105

Contact us