Skip to main content

Table 1 Properties of multi-annotator algorithms.

From: Learning by aggregating experts and filtering novices: a solution to crowdsourcing problems in bioinformatics

Algorithms

Unsupervised?

Integrate labels globally?

Data dependent?

Filter novice annotation?

MV

Y

N

N

N

MAP-ML

Y

Y

N

N

GMM-MAPML

Y

Y

Y

N

AEFN

Y

Y

Y

Y

  1. The comparisons of properties of multi-annotator algorithms are shown. 'Y' denotes that the algorithm has the property; 'N' denotes that the algorithm doesn't have the property.