Table 3 Performance of the image type query in identifying specific image types in the 361-patient cohortζ
Image type | ||||
|---|---|---|---|---|
Bone scan | Gold standard manual abstraction | |||
Bone scan | Not bone scan | |||
Automated Lucene tool result | Bone scan | 23 | 0 | |
Not bone scan | 0 | 2988 | ||
Sensitivity (95% CI) | Specificity (95% CI) | PPV (95% CI) | F1 score | |
100% (85–100%) | 100% (100–100%) | 100% (85–100%) | 1.00 | |
Chest X-ray | Gold standard manual abstraction | |||
Chest X-ray | Not chest X-ray | |||
Automated Lucene tool result | Chest X-ray | 1039 | 0 | |
Not chest X-ray | 281 | 1691 | ||
Sensitivity (95% CI) | Specificity (95% CI) | PPV (95% CI) | F1 score | |
79% (76–81%) | 100% (100–100%) | 100% (100–100%) | 0.88 | |
CT chest | Gold standard manual abstraction | |||
CT chest | Not CT chest | |||
Automated Lucene tool result | CT chest | 841 | 0 | |
Not CT chest | 61 | 2109 | ||
Sensitivity (95% CI) | Specificity (95% CI) | PPV (95% CI) | F1 score | |
93% (91–95%) | 100% (100–100%) | 100% (100–100%) | 0.97 | |
CT abdomen/pelvis | Gold standard manual abstraction | |||
CT abdomen/pelvis | Not CT abdomen/pelvis | |||
Automated lucene tool result | CT abdomen/pelvis | 63 | 0 | |
Not CT abdomen/pelvis | 64 | 2884 | ||
Sensitivity (95% CI) | Specificity (95% CI) | PPV (95% CI) | F1 score | |
50% (41–59%) | 100% (100–100%) | 100% (94–100%) | 0.66 | |
CT chest/abdomen/pelvis | Gold standard manual abstraction | |||
CT Chest/abdomen/pelvis | Not CT Chest/abdomen/pelvis | |||
Automated Lucene tool result | CT Chest/abdomen/pelvis | 116 | 0 | |
Not CT Chest/abdomen/pelvis | 7 | 2888 | ||
Sensitivity (95% CI) | Specificity (95% CI) | PPV (95% CI) | F1 score | |
94% (89–98%) | 100% (100–100%) | 100% (97–100%) | 0.97 | |
CT head | Gold standard manual abstraction | |||
CT head | Not CT head | |||
Automated Lucene tool result | CT head | 131 | 0 | |
Not CT head | 18 | 2862 | ||
Sensitivity (95% CI) | Specificity (95% CI) | PPV (95% CI) | F1 score | |
88% (82–93%) | 100% (100–100%) | 100% (97–100%) | 0.94 | |
MR body | Gold standard manual abstraction | |||
MR body | Not MR body | |||
Automated Lucene tool result | MR body | 28 | 0 | |
Not MR body | 30 | 2953 | ||
Sensitivity (95% CI) | Specificity (95% CI) | PPV (95% CI) | F1 score | |
48% (35–62%) | 100% (100–100%) | 100% (88–100%) | 0.65 | |
MR brain | Gold standard manual abstraction | |||
MR brain | Not MR brain | |||
Automated Lucene tool result | MR brain | 41 | 0 | |
Not MR brain | 1 | 2969 | ||
Sensitivity (95% CI) | Specificity (95% CI) | PPV (95% CI) | F1 score | |
98% (87–100%) | 100% (100–100%) | 100% (91–100%) | 0.99 | |
PET | Gold standard manual abstraction | |||
PET | Not PET | |||
Automated Lucene tool result | PET | 266 | 0 | |
Not PET | 1 | 2744 | ||
Sensitivity (95% CI) | Specificity (95% CI) | PPV (95% CI) | F1 score | |
100% (98–100%) | 100% (100–100%) | 100% (99–100%) | 1.00 | |