Table 4 Performance comparison of all models
From: Extracting clinical named entity for pituitary adenomas from Chinese electronic medical records
Model | Overall | |||||
|---|---|---|---|---|---|---|
Strict | Relaxed | |||||
P (%) | R (%) | F1 (%) | P (%) | R (%) | F1 (%) | |
Dictionary | 42.74 | 43.44 | 43.08 | 64.08 | 65.13 | 64.60 |
CRF | 92.18 | 87.63 | 89.85 | 96.18 | 91.43 | 93.75 |
+ pos | 91.89 | 88.28 | 90.05 | 96.01 | 92.23 | 94.08 |
+ radical | 91.90 | 87.84 | 89.82 | 96.00 | 91.76 | 93.83 |
+ type | 92.31 | 87.82 | 90.01 | 96.52 | 91.82 | 94.11 |
+ index | 91.07 | 86.16 | 88.55 | 95.66 | 90.51 | 93.01 |
+ pos + radical | 91.90 | 87.95 | 89.88 | 96.13 | 92.01 | 94.03 |
+ pos + type | 92.32 | 88.60 | 90.42 | 96.39 | 92.50 | 94.40 |
+ pos + index | 91.08 | 87.43 | 89.22 | 95.62 | 91.79 | 93.66 |
+ radical + type | 91.98 | 87.99 | 89.94 | 96.22 | 92.04 | 94.09 |
+ radical + index | 91.12 | 87.18 | 89.10 | 95.59 | 91.45 | 93.47 |
+ type + index | 91.33 | 86.37 | 88.78 | 96.02 | 90.79 | 93.33 |
+ pos + radical + type | 92.43 | 88.49 | 90.42 | 96.51 | 92.40 | 94.41 |
+ pos + radical + index | 91.21 | 87.45 | 89.29 | 95.63 | 91.69 | 93.62 |
+ pos + type + index | 91.27 | 87.58 | 89.39 | 95.86 | 91.99 | 93.89 |
+ radical + type + index | 91.22 | 87.19 | 89.16 | 95.79 | 91.57 | 93.63 |
+ pos + radical + type + index | 91.46 | 87.75 | 89.57 | 95.86 | 91.97 | 93.88 |
BiLSTM-CRF | 90.24 | 89.64 | 89.94 | 94.98 | 94.36 | 94.67 |
BERT-BiLSTM-CRF | 92.00 | 90.54 | 91.27 | 96.34 | 94.81 | 95.57 |