Skip to main content

Advertisement

Table 3 EdIE-R performance on the NHS Tayside test set (n = 700 reports). Small numbers suppressed due to data governance requirements

From: A validated natural language processing algorithm for brain imaging phenotypes from radiology reports in UK electronic health records

Label True Positives (n) Sensitivity/Recall (95%CI) PPV/Precision (95%CI) Specificity (95%CI) F1 score
Atrophy 159 0.97 (0.93–0.99) 1.00 (0.98–1.00) 1.00 (0.99–1.00) 0.98
Small vessel disease 145 1.00 (0.97–1.00 1.00 (0.97–1.00) 1.00 (0.99–1.00) 1.00
Stroke
Underspecified < 5 1.00 (0.34–1.00 0.67 (0.21–0.94) 1.00 (0.99–1.00) 0.80
Haemorrhagic stroke
 Any haemorrhagic stroke 23 0.96 (0.80–0.99) 0.72 (0.55–0.84) 1.00 (0.99–1.00) 0.82
 Deep, old
 Deep, recent < 5 1.00 (0.21–1.00) 0.50 (0.10–0.91) 1.00 (0.99–1.00) 0.67
 Lobar, old < 5 1.00 (0.51–1.00) 1.00 (0.51–1.00) 1.00 (0.99–1.00) 1.00
 Lobar, recent < 5 0.75 (0.30–0.95) 1.00 (0.44–1.00) 1.00 (0.99–1.00) 0.86
 Underspecified 15 1.00 (0.80–1.00) 0.65 (0.45–0.81) 0.99 (0.98–0.99) 0.79
Ischaemic stroke
 Any ischaemic stroke 88 0.89 (0.81–0.94) 0.85 (0.76–0.90) 1.00 (0.99–1.00) 0.87
 Cortical, old 24 0.92 (0.76–0.98) 0.92 (0.76–0.98) 1.00 (0.99–1.00) 0.92
 Cortical, recent 9 0.75 (0.47–0.91) 1.00 (0.70–1.00) 1.00 (0.99–1.00) 0.86
 Deep, old 39 0.95 (0.84–0.99) 0.95 (0.84–0.99) 1.00 (0.99–1.00) 0.95
 Deep, recent < 5 0.50 (0.15–0.85) 0.50 (0.15–0.85) 1.00 (0.99–1.00) 0.50
 Underspecified 13 0.87 (0.62–0.96) 0.57 (0.37–0.74) 0.99 (0.97–0.99) 0.68
 Haemorrhagic transformation < 5 1.00 (0.21–1.00) 1.00 (0.21–1.00) 1.00 (0.99–1.00) 1.00
Other intracranial haemorrhage
 Subdural hematoma 6 0.75 (0.41–0.93) 0.86 (0.49–0.97) 1.00 (0.99–1.00) 0.80
 Subarachnoid haemorrhage < 5 0.57 (0.25–0.84) 0.57 (0.25–0.84) 1.00 (0.99–1.00) 0.53
 Microbleed < 5 1.00 (0.34–1.00) 1.00 (0.34–1.00) 1.00 (0.99–1.00) 1.00
Tumour
 Any tumour 52 0.96(0.87–0.99) 0.84 (0.73–0.91) 1.00 (0.99–1.00) 0.90
 Glioma < 5 1.00 (0.44–1.00) 0.60 (0.23–0.88) 1.00 (0.99–1.00) 0.75
 Meningioma < 5 1.00 (0.34–1.00) 1.00 (0.34–1.00) 1.00 (0.99–1.00) 1.00
 Metastasis 37 1.00 (0.91–1.00) 0.90 (0.78–0.96) 0.99 (0.99–1.00) 0.95
 Other 10 0.83 (0.55–0.95) 0.71 (0.45–0.88) 0.99 (0.99–1.00) 0.77