Skip to main content

Table 7 InterAnnotator agreement

From: A clinical trials corpus annotated with UMLS entities to enhance the access to evidence-based medicine

 

Texts

Mean (Standard deviation)

Strict

Relaxed

Triple revision

12 (abstracts)

77.0% (±4.2)

86.10% (±3.2)

Double revision

42 (abstracts)

82.62% (±2.11)

93.06% (±0.97)

 

70 (EudraCT)

88.48% (±3.05)

95.61% (±1.68)

 

112 (abst. + EudraCT)

86.52% (±3.92)

94.76% (±1.91)

All (\(\sim\)10% of texts)

124

85.65% (±4.79)

93.94% (±3.31)

Back to article page

BMC Medical Informatics and Decision Making

ISSN: 1472-6947

Contact us