Table 10 Results: Hierarchy Specific SVM Score Thresholding (atc weights) with Relaxed Correctness Criteria (Code Perspective). This shows that we do not get improvements in performance even when we relax the correctness criteria to consider ancestors that are 5 levels up the hierarchy from the code being analyzed.
From: GO for gene documents
Hierarchy | ANC_LEVEL | Recall | Precision | FScore |
|---|---|---|---|---|
MF | baseline | 0.6643 | 0.4128 | 0.4800 |
MF | 1 | 0.6643 | 0.419 | 0.4847 |
MF | 2 | 0.6650 | 0.4229 | 0.4880 |
MF | 3 | 0.6650 | 0.4243 | 0.4888 |
MF | 4 | 0.6650 | 0.4245 | 0.4890 |
MF | 5 | 0.6650 | 0.4245 | 0.4880 |
CC | baseline | 0.5781 | 0.3364 | 0.4009 |
CC | 1 | 0.5781 | 0.3471 | 0.4082 |
CC | 2 | 0.5784 | 0.3509 | 0.4113 |
CC | 3 | 0.5784 | 0.3536 | 0.4132 |
CC | 4 | 0.5784 | 0.3540 | 0.4136 |
BP | baseline | 0.4870 | 0.2674 | 0.3222 |
BP | 1 | 0.4887 | 0.2724 | 0.3265 |
BP | 2 | 0.4887 | 0.2746 | 0.3285 |
BP | 3 | 0.4890 | 0.2773 | 0.3301 |
BP | 4 | 0.4890 | 0.2776 | 0.3305 |
BP | 5 | 0.4890 | 0.2778 | 0.3306 |