The contribution of co-reference resolution to supervised relation detection between bacteria and biotopes entities

Table 4 Impact of co-reference strategy on co-reference resolution (all documents)

		With gold mentions						With predicted mentions
		Training			Development			Development
		R	P	F	R	P	F	R	P	F
sim	bcube	0.927	0.601	0.729	0.980	0.532	0.690	0.824	0.549	0.659
	ceafe	0.835	0.512	0.635	0.937	0.468	0.624	0.807	0.437	0.567
	ceafm	0.928	0.635	0.754	0.974	0.562	0.713	0.872	0.580	0.697
	muc	0.950	0.669	0.785	0.987	0.592	0.740	0.878	0.620	0.727
ana	bcube	0.006	0.059	0.011	0.012	0.100	0.021	0.009	0.075	0.016
	ceafe	0.038	0.057	0.045	0.070	0.109	0.085	0.057	0.092	0.070
	ceafm	0.029	0.101	0.045	0.046	0.180	0.073	0.041	0.157	0.065
	muc	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.000	0.000
all	bcube	0.927	0.508	0.656	0.970	0.466	0.629	0.825	0.476	0.604
	ceafe	0.823	0.448	0.580	0.910	0.433	0.587	0.791	0.396	0.527
	ceafm	0.928	0.554	0.694	0.969	0.515	0.673	0.872	0.521	0.653
	muc	0.950	0.581	0.721	0.981	0.537	0.694	0.878	0.552	0.678
		With self-predicted mentions
rec	bcube	0.187	0.068	0.099	0.206	0.075	0.110
	ceafe	0.230	0.040	0.068	0.379	0.056	0.098
	ceafm	0.326	0.094	0.146	0.374	0.091	0.147
	muc	0.319	0.109	0.163	0.308	0.089	0.139

Impact of co-reference strategy on co-reference resolution (all documents). sim = Similarity-based co-reference resolution, ana = anaphora-based co-reference resolution, all = sim ∪ ana. bcube = B³, ceafe = CEAF-entities, ceafm = CEAF-mentions, muc = MUC. Boldface highlights F-measure of best strategy. For reference, we also show the results obtained with the off-the-shelf version of Reconcile (rec)

ISSN: 1471-2105