Skip to main content

Table 7 InterAnnotator agreement

From: A clinical trials corpus annotated with UMLS entities to enhance the access to evidence-based medicine

  Texts Mean (Standard deviation)
Strict Relaxed
Triple revision 12 (abstracts) 77.0% (±4.2) 86.10% (±3.2)
Double revision 42 (abstracts) 82.62% (±2.11) 93.06% (±0.97)
  70 (EudraCT) 88.48% (±3.05) 95.61% (±1.68)
  112 (abst. + EudraCT) 86.52% (±3.92) 94.76% (±1.91)
All (\(\sim\)10% of texts) 124 85.65% (±4.79) 93.94% (±3.31)