Skip to main content

Table 3 Agreement scores for all four categorizations; mutual F-score is reported by category

From: Monitoring stance towards vaccination in twitter messages

 

Relevance

Subject

Stance

Sentiment

Percent agreement

0.71

0.70

0.54

0.54

Krippendorff’s Alpha

0.27

0.29

0.35

0.34

Mutual F-score

Relevant

0.81

Vaccine

0.79

Negative

0.42

Worry, fear, doubts

0.21

 

Relevant abroad

0.40

Disease

0.06

Neutral

0.23

Anger, frustration

0.50

 

Irrelevant

0.42

Vaccine and disease

0.49

Positive

0.64

Informative

0.49

     

Not clear

0.31

Relieved

0.19

      

Other

0.20

Â