Skip to main content

Table 2 Data labeling criteria

From: Automatic text classification of actionable radiology reports of tinnitus patients using bidirectional encoder representations from transformer (BERT) and in-domain pre-training (IDPT)

Classification

Potentially clinically important findings

Label instruction

Normal finding (labeled as 0)

NA

The scenarios when all organs are described as normal

Irrelevant finding (labeled as 1)

Bone:

If any lesion is observed and should be reported; meanwhile, the clinician is confident that the image finding provided limited information for diagnosis of tinnitus.

 

Any Degeneration

 
 

Brain:

 
 

-Brain degeneration

 
 

Nose and Sinus:

 
 

-Nasosinusitis (frontal sinus, sphenoid sinus, ethmoid sinus, maxillary sinus (except acute inflammation involving adjacent bone structures))

 
 

-Nasal turbinate hypertrophy

 
 

-Deviation of nasal septum

 
 

-Sinus cyst

 
 

External/middle ear: -

 
 

Chronic middle ear mastoiditis (except acute inflammation involving adjacent bone structures)

 
 

-Auditory canal cerumen

 
 

-Low middle cranial fossa

 

Relative finding (labeled as 2)

Bone: -

If one or more image findings should be reported in detail, and lead to a certain diagnosis for further examination or clinical evaluation. Or the image finding addressed a need for urgent communication with clinicians for timely treatment. Since there is variability in language expression, the labeler’s judgment is used as reference.

 

Sigmoid sinus bone wall deficiency

 
 

-Superior semicircular canal dehiscence

 
 

-Auditory ossicle abnormality

 
 

-Bone fracture

 
 

-High jugular fossa

 
 

Brain:

 
 

-Neoplasms

 
 

-Intracranial hemorrhage

 
 

-Cerebral infarction

 
 

-Cerebral herniation

 
 

Nose and sinus cavity:

 
 

-Neoplasms

 
 

-Nasosinusitis (morphologically altered bone or sinus tract obstruction)

 
 

External/Middle ear:

 
 

-Tympanic lesion (inflammation, neoplasm or perforation)

 
 

-Otosclerosis

 
 

-Cholesteatoma

 
 

-Other neoplasm observed within the imaging field

Â