Table 5 F1 scores of the first-order models and the pi-CRF for each corpora. The first value (‘whole instance’) is F1 score with whole test set and the second value (‘distanced instance’) is F1 score evaluated only with instances having transition dependency between NEs. (bold: best performance, shaded: pi-CRF)
Feature | Models | i2b2 2012 | SNUH | CoNLL 2003 | |||
|---|---|---|---|---|---|---|---|
| Â | Â | whole instance | distanced instance | whole instance | distanced instance | whole instance | distanced instance |
Set 1 | 1st-order CRF | 67.22 | 68.24 | 74.75 | 73.20 | 60.68 | 62.19 |
1st-order CRF with induced labels | 66.60 | 67.69 | 74.09 | 72.85 | 23.38 | 15.24 | |
pi-CRF | 67.29 | 68.43 | 75.50 | 74.43 | 45.54 | 43.41 | |
Set 2 | 1st-order CRF | 71.61 | 72.85 | 75.81 | 75.04 | 68.43 | 72.93 |
1st-order CRF with induced labels | 70.73 | 71.98 | 75.24 | 74.36 | 44.90 | 41.89 | |
pi-CRF | 71.99 | 73.35 | 76.04 | 75.29 | 69.61 | 72.31 | |
Set 3 | 1st-order CRF | 72.55 | 73.97 | 76.18 | 75.06 | 82.57 | 83.13 |
1st-order CRF with induced labels | 71.25 | 72.75 | 75.37 | 74.18 | 80.81 | 81.55 | |
pi-CRF | 72.58 | 74.04 | 76.24 | 75.33 | 82.08 | 82.76 | |