Table 9 Comparison of effectiveness of different retrieval approaches: Boolean only systems (Original and Simplified), ranked only retrieval (TRC queries), ordered simplified Boolean queries (Lucene), combined approach (simplified Boolean queries on Ovid and ranked querying using Zettair).
From: Boolean versus ranked querying for biomedical systematic reviews
Method | Level | RBP99 | P@1,000 | R@1,000 | P@10,000 | R@10,000 |
|---|---|---|---|---|---|---|
Boolean | Tier 1 | 0.026 | 0.026 | 0.179 | 0.004 | 0.266 |
(Orig) | Tier 2 | 0.009 | 0.010 | 0.202 | 0.001 | 0.285 |
Boolean | Tier 1 | 0.015 | 0.014 | 0.103 | 0.007 | 0.426 |
(Simp) | Tier 2 | 0.008 | 0.006 | 0.115 | 0.003 | 0.414 |
Ranked | Tier 1 | 0.067 | 0.044 | 0.327 | 0.011 | 0.709 |
(TRC) | Tier 2 | 0.036 | 0.019 | 0.409 | 0.004 | 0.784 |
Boolean | Tier 1 | 0.023 | 0.023 | 0.172 | 0.013 | 0.528 |
(Lucene) | Tier 2 | 0.008 | 0.007 | 0.197 | 0.004 | 0.577 |
Combined | Tier 1 | 0.084 | 0.057 | 0.415 | 0.011 | 0.677 |
| Â | Tier 2 | 0.048 | 0.028 | 0.532 | 0.004 | 0.765 |