Skip to main content

Advertisement

Springer Nature is making Coronavirus research free. View research | View latest news | Sign up for updates

Table 3 AEFN based accuracy estimates on the text focus classification task without using ground truth.

From: Learning by aggregating experts and filtering novices: a solution to crowdsourcing problems in bioinformatics

  First Component Second Component Third Component
Annotators Estimated Sensitivity Estimated Specificity Estimated Sensitivity Estimated Specificity Estimated Sensitivity Estimated Specificity
Annotator 1 0.7672 0.7749 0.8005 0.7969 0.7634 0.7907
Annotator 2 0.9373 0.8588 0.8753 0.8271 0.8958 0.8863
Annotator 3 0.7383 0.8258 Filtered Filtered
Annotator 4 0.8059 0.8652 0.9010 0.8594 0.8318 0.8413
Annotator 5 Filtered Filtered Filtered
  1. The estimates by five annotators for three principal components on the text focus task are shown.