Skip to main content

Table 3 EdIE-R performance on the NHS Tayside test set (n = 700 reports). Small numbers suppressed due to data governance requirements

From: A validated natural language processing algorithm for brain imaging phenotypes from radiology reports in UK electronic health records

Label

True Positives (n)

Sensitivity/Recall (95%CI)

PPV/Precision

(95%CI)

Specificity (95%CI)

F1

score

Atrophy

159

0.97 (0.93–0.99)

1.00 (0.98–1.00)

1.00 (0.99–1.00)

0.98

Small vessel disease

145

1.00 (0.97–1.00

1.00 (0.97–1.00)

1.00 (0.99–1.00)

1.00

Stroke

Underspecified

< 5

1.00 (0.34–1.00

0.67 (0.21–0.94)

1.00 (0.99–1.00)

0.80

Haemorrhagic stroke

 Any haemorrhagic stroke

23

0.96 (0.80–0.99)

0.72 (0.55–0.84)

1.00 (0.99–1.00)

0.82

 Deep, old

 Deep, recent

< 5

1.00 (0.21–1.00)

0.50 (0.10–0.91)

1.00 (0.99–1.00)

0.67

 Lobar, old

< 5

1.00 (0.51–1.00)

1.00 (0.51–1.00)

1.00 (0.99–1.00)

1.00

 Lobar, recent

< 5

0.75 (0.30–0.95)

1.00 (0.44–1.00)

1.00 (0.99–1.00)

0.86

 Underspecified

15

1.00 (0.80–1.00)

0.65 (0.45–0.81)

0.99 (0.98–0.99)

0.79

Ischaemic stroke

 Any ischaemic stroke

88

0.89 (0.81–0.94)

0.85 (0.76–0.90)

1.00 (0.99–1.00)

0.87

 Cortical, old

24

0.92 (0.76–0.98)

0.92 (0.76–0.98)

1.00 (0.99–1.00)

0.92

 Cortical, recent

9

0.75 (0.47–0.91)

1.00 (0.70–1.00)

1.00 (0.99–1.00)

0.86

 Deep, old

39

0.95 (0.84–0.99)

0.95 (0.84–0.99)

1.00 (0.99–1.00)

0.95

 Deep, recent

< 5

0.50 (0.15–0.85)

0.50 (0.15–0.85)

1.00 (0.99–1.00)

0.50

 Underspecified

13

0.87 (0.62–0.96)

0.57 (0.37–0.74)

0.99 (0.97–0.99)

0.68

 Haemorrhagic transformation

< 5

1.00 (0.21–1.00)

1.00 (0.21–1.00)

1.00 (0.99–1.00)

1.00

Other intracranial haemorrhage

 Subdural hematoma

6

0.75 (0.41–0.93)

0.86 (0.49–0.97)

1.00 (0.99–1.00)

0.80

 Subarachnoid haemorrhage

< 5

0.57 (0.25–0.84)

0.57 (0.25–0.84)

1.00 (0.99–1.00)

0.53

 Microbleed

< 5

1.00 (0.34–1.00)

1.00 (0.34–1.00)

1.00 (0.99–1.00)

1.00

Tumour

 Any tumour

52

0.96(0.87–0.99)

0.84 (0.73–0.91)

1.00 (0.99–1.00)

0.90

 Glioma

< 5

1.00 (0.44–1.00)

0.60 (0.23–0.88)

1.00 (0.99–1.00)

0.75

 Meningioma

< 5

1.00 (0.34–1.00)

1.00 (0.34–1.00)

1.00 (0.99–1.00)

1.00

 Metastasis

37

1.00 (0.91–1.00)

0.90 (0.78–0.96)

0.99 (0.99–1.00)

0.95

 Other

10

0.83 (0.55–0.95)

0.71 (0.45–0.88)

0.99 (0.99–1.00)

0.77