Table 10 F-measures of the retrained random forest models varying the crowdsourcing parameters
From: OC-2-KB: integrating crowdsourcing into an obesity and cancer knowledge base curation system
Workers’ time spent on HITs | |||
|---|---|---|---|
Number of times validated | ≥ 0 s | ≥ 300 s | ≥ 750 s |
Validated = 5 times | 98.5% | 98.8% | 99.8% |
Validated ≥ 4 times | 90.3% | 97.0% | 97.2% |
Validated ≥ 3 times | 79.1% | 85.1% | 91.4% |