Boolean versus ranked querying for biomedical systematic reviews

Table 2 Effectiveness of different ranked queries in each tier, searching from the full MEDLINE collection.

Index	Target	Query	RBP99	P@1,000	R@1,000	P@10,000	R@10,000
MEDLINE	Tier 0	T	0.043	0.038	0.042	0.021	0.202
		TR	0.092	0.079	0.088	0.040	0.380
		TRC	0.166	0.124	0.155	0.046	0.461
		B	0.150	0.118	0.143	0.044	0.408
MEDLINE	Tier 1	T	0.010	0.009	0.064	0.004	0.296
		TR	0.024	0.021	0.161	0.008	0.575
		TRC	0.067	0.044	0.327	0.011	0.709
		B	0.053	0.040	0.284	0.010	0.676
MEDLINE	Tier 2	T	0.003	0.003	0.082	0.001	0.283
		TR	0.008	0.008	0.195	0.003	0.601
		TRC	0.036	0.019	0.409	0.004	0.784
		B	0.019	0.014	0.341	0.004	0.718

Index indicates the source of documents, while Target indicates the relevant documents that the evaluation is based on. For example, Tier 1 in the Target column indicates that we judge our system based on the documents that are chosen for full-text screening.

ISSN: 1472-6947