Data | Model | Whole instances | Distanced instances | ||||
---|---|---|---|---|---|---|---|
gold | expected | correct | gold | expected | correct | ||
i2b2 (clinical) | 1st-order CRF | 9,623 | 7,361 | 5,708 | 8,552 | 6,188 | 4,927 |
2nd-order CRF | 7,785 | 6,046 | 6,547 | 5,245 | |||
pi-CRF | 7,542 | 5,775 | 6,397 | 5,012 | |||
SNUH (clinical) | 1st-order CRF | 17,125 | 15,326 | 12,128 | 12,520 | 10,813 | 8,540 |
2nd-order CRF | 15,702 | 12,053 | 11,088 | 8,524 | |||
pi-CRF | 15,516 | 12,322 | 11,012 | 8,758 | |||
CoNLL (general) | 1st-order CRF | 5,629 | 3,785 | 2,856 | 4,331 | 2,693 | 2,184 |
2nd-order CRF | 2,778 | 2,529 | 1,986 | 1,799 | |||
pi-CRF | 1,855 | 1,704 | 1,280 | 1,218 |