Skip to main content

Table 4 Impact of co-reference strategy on co-reference resolution (all documents)

From: The contribution of co-reference resolution to supervised relation detection between bacteria and biotopes entities

  With gold mentions With predicted mentions
  Training Development Development
   R P F R P F R P F
sim bcube 0.927 0.601 0.729 0.980 0.532 0.690 0.824 0.549 0.659
  ceafe 0.835 0.512 0.635 0.937 0.468 0.624 0.807 0.437 0.567
  ceafm 0.928 0.635 0.754 0.974 0.562 0.713 0.872 0.580 0.697
  muc 0.950 0.669 0.785 0.987 0.592 0.740 0.878 0.620 0.727
ana bcube 0.006 0.059 0.011 0.012 0.100 0.021 0.009 0.075 0.016
  ceafe 0.038 0.057 0.045 0.070 0.109 0.085 0.057 0.092 0.070
  ceafm 0.029 0.101 0.045 0.046 0.180 0.073 0.041 0.157 0.065
  muc 0.000 0.000 0.000 0.000 0.000 0.000 0.000 0.000 0.000
all bcube 0.927 0.508 0.656 0.970 0.466 0.629 0.825 0.476 0.604
  ceafe 0.823 0.448 0.580 0.910 0.433 0.587 0.791 0.396 0.527
  ceafm 0.928 0.554 0.694 0.969 0.515 0.673 0.872 0.521 0.653
  muc 0.950 0.581 0.721 0.981 0.537 0.694 0.878 0.552 0.678
  With self-predicted mentions  
rec bcube 0.187 0.068 0.099 0.206 0.075 0.110  
  ceafe 0.230 0.040 0.068 0.379 0.056 0.098  
  ceafm 0.326 0.094 0.146 0.374 0.091 0.147  
  muc 0.319 0.109 0.163 0.308 0.089 0.139  
  1. Impact of co-reference strategy on co-reference resolution (all documents). sim = Similarity-based co-reference resolution, ana = anaphora-based co-reference resolution, all = sim ana. bcube = B3, ceafe = CEAF-entities, ceafm = CEAF-mentions, muc = MUC. Boldface highlights F-measure of best strategy. For reference, we also show the results obtained with the off-the-shelf version of Reconcile (rec)