An active learning-enabled annotation system for clinical named entity recognition

Table 2 Schedule of the user study

Time	Event	Task	Duration
Week 0	Guided Training	1. Annotation guideline review	30 min
	Guided Training	2. Sentence-by-sentence annotation and review using the interface	45 min
	Practice	1. Three quarter-hour sessions of annotation practice	45 min
	Practice	2. Four half-hour sections of annotation using Random, with 15-min break between sessions	3 h
Week 1	Annotation warm up training	1. Sentence-by-sentence annotation and review using the interface	15 - 30 min
	Annotation warm up training	2. Two 15 min sessions of annotation practice	30 min
	Main study for method Random	Four 30 min sessions of annotation using Method 2	3 h
	Main study for method Random	15-min break between sessions	3 h
Week 2	Annotation warm up training	1. Sentence-by-sentence annotation and review using the interface	15 - 30 min
	Annotation warm up training	2. Two 15 min sessions of annotation practice	30 min
	Main study for method CAUSE	Four 30 min sessions of annotation using Method 2	3 h
	Main study for method CAUSE	15-min break between sessions	3 h

ISSN: 1472-6947