Skip to main content

Table 3 Head MRI model error analysis

From: Development and web deployment of an automated neuroradiology MRI protocoling tool with natural language processing

Positiona

Correct protocol

Predicted protocol

(confidence score)

Raw clinical history

Radiologist assessment

1

IAC

Routine Brain

(0.8837)

MRI to rule out any CPA/retrocochlear masses that might be causing her vestibular symptoms and hearing loss. per EN: MRI to rule out any CPA/retrocochlear masses that might be causing her vestibular symptoms and hearing loss

True error

3

TMJ

Routine Brain

(0.8313)

Does this patient have TMJ arthritis and/oe anterior disc displacement w/o reduction. Consistent TMJ pain not resolved by massage, NSAIDS or muscle relaxants. Feels like something is blocking her mouth when she opens. Pain is extreme

True error

5

ContrastBrain

Routine Brain

(0.7986)

interval assessment for Multiple sclerosis. follow up MRI in next 1–2 months

Contrast preferred, Routine may be ok

7

Orbits

Routine Brain

(0.7464)

Optic nerve pallor. Likely longstanding optic nerve pallor with visual field defect. R/o tumor or compression

True error

9

ContrastBrain

Routine Brain

(0.6947)

f/u glioblastoma multiforme. GBM, s/p surgery, RT, on chemo; ?progression on last MRI—reviewed at FACILITY Neuro Onc—rec 2 month f/u as pt clinically stable

True error

11

Contrast Brain

Routine Brain

(0.6785)

CNS lymphoma. AGE M with HIV and relapsed primary CNS lymphoma receiving WBRT will complete on DATE. Needs post-radiation scan

True error

13

Face

Routine Brain

(0.5824)

r/o facial nerve abnl. this AGE woman has Turner's syndrome and has now had N recurrent episodes of "Bell's palsy" sequentially involving both sides of her face. query compression in facial canals vs other base of skull abnl involving her facial nerves bilaterally patient also experienced tongue and perioral numbness (not clearly just loss of taste) so evaluation of course of bilat V3 also appreciated

True Errorl

15

IAC

Routine Brain

(0.5485)

Request MRI IAC protocol to eval new unilateral tinnitus; patient has symmetric SNHL, though subjectively worse on left. New unilateral (left) tinnitus over last six months; also with symmetric SNHL on audio (including symmetric word recognition scores), however hearing is subjectively worse on left

True error

17

Routine Brain

Contrast Brain

(0.5247)

thinking changes and new headache

True error

19

f

Contrast Brain

(0.5131)

Evaluate for structural etiology of HA. AGE woman with severe migraines precipitated by aura of left arm numbness, then with pounding right-sided HA and nausea. Previously evaluated by Neuro, had normal brain CT and recommended advancing imaging if severe HA returns. Symptoms returned periodically since once month ago, requesting MRI for further evaluation of structural cause

True error

  1. aThe position refers to the ordered rank when all 23 incorrectly predicted head MRI protocols are ordered from most incorrect (high confidence) to least incorrect (low confidence)