Skip to main content

Table 6 Agreement between annotators

From: Automatic de-identification of French electronic health records: a cost-effective approach exploiting distant supervision and deep learning models

 

Annotator 1

Annotator 2

Annotator 3

Annotator 4

Annotator 5

Annotator 6

Annotator 1

1 (1,1)

NA

NA

0.909 (0.861,0.956)

0.880 (0.843,0.916)

0.97 (0.952,0.987)

Annotator 2

 

1 (1,1)

0.874 (0.784,0.965)

0.965 (0.942,0.988)

0.893 (0.868,0.917)

0.962 (0.945,0.978)

Annotator 3

  

1 (1,1)

0.986 (0.968,1)

0.928 (0.905,0.952)

0.943 (0.908,0.978)

Annotator 4

   

1 (1,1)

0.861 (0.817,0.904)

0.961 (0.937,0.985)

Annotator 5

    

1 (1,1)

0.91 (0.871,0.949)

Annotator 6

     

1 (1,1)