Table 7 Results from the first ranked system (Sydney), customized MedEx system, CRF (all features), SVM (all features) systems, Simple Majority, Local CRF-based and SVM-based voting on the test set from the 2009 i2b2 challenge: “m” stands for medication, “do” for dosage, “mo” for mode, “f” for frequency, “du” for duration, “r” for reason
From: Recognition of medication information from discharge summaries using ensembles of classifiers
ALL | m | do | mo | f | du | r | ||
|---|---|---|---|---|---|---|---|---|
Sydney | Pre | 93.78 | 93.51 | 94.78 | 96.45 | 96.59 | 69.71 | 76.04 |
Re | 85.03 | 88.31 | 88.91 | 91.28 | 91.25 | 40.93 | 38.83 | |
F-score | 89.19 | 90.84 | 91.75 | 93.80 | 93.85 | 51.58 | 51.41 | |
Customized MedEx | Pre | 89.51 | 89.97 | 94.95 | 96.23 | 92.18 | 50.94 | 62.31 |
Re | 84.95 | 89.68 | 84.04 | 88.14 | 89.80 | 60.62 | 47.87 | |
F-score | 87.17 | 89.83 | 89.16 | 92.01 | 90.97 | 55.36 | 54.14 | |
CRF | Pre | 94.11 | 93.71 | 95.92 | 97.26 | 95.60 | 71.88 | 77.52 |
Re | 84.89 | 89.19 | 87.37 | 90.19 | 90.73 | 38.86 | 40.97 | |
F-score | 89.26 | 91.39 | 91.44 | 93.59 | 93.10 | 50.45 | 53.63 | |
SVM | Pre | 93.35 | 93.98 | 94.79 | 96.56 | 95.37 | 68.73 | 68.54 |
Re | 85.42 | 89.18 | 88.73 | 91.01 | 91.71 | 38.34 | 40.75 | |
F-score | 89.21 | 91.51 | 91.66 | 93.71 | 93.50 | 49.22 | 51.12 | |
Simple Majority Voting | Pre | 93.91 | 93.62 | 95.86 | 97.23 | 95.58 | 72.73 | 75.90 |
Re | 85.76 | 90.19 | 87.62 | 90.44 | 91.20 | 44.21 | 43.67 | |
F-score | 89.65 | 91.87 | 91.55 | 93.71 | 93.34 | 54.99 | 55.44 | |
Local CRF-Based Voting | Pre | 94.20 | 93.96 | 94.84 | 96.56 | 95.27 | 74.07 | 83.39 |
Re | 85.11 | 89.18 | 88.80 | 91.01 | 91.71 | 34.54 | 37.13 | |
F-score | 89.42 | 91.51 | 91.72 | 93.71 | 93.46 | 47.11 | 51.38 | |
Local SVM-Based Voting | Pre | 93.03 | 94.06 | 94.77 | 96.56 | 95.37 | 66.94 | 65.83 |
Re | 85.76 | 89.18 | 88.71 | 90.98 | 91.66 | 42.66 | 44.52 | |
F-score | 89.24 | 91.55 | 91.64 | 93.69 | 93.48 | 52.11 | 53.12 |