Automatic detection of actionable radiology reports using bidirectional encoder representations from transformers

Table 9 Recall scores for truly actionable reports pointing out mass and non-mass abnormalities in the test set

Method	LR		GBDT		LSTM		BERT
Use of order information	( −)	( +)	( −)	( +)	( −)	( +)	( −)	( +)
Mass subset (n = 124)	0.935	0.895	0.839	0.855	0.895	0.927	0.927	0.903
Non-mass subset (n = 112) †	0.795	0.714	0.723	0.795	0.821	0.830	0.875	0.830

The maximum value for each subset is shown in bold
^†Vascular lesions (hemorrhage, thrombosis, infarction, and others) (n = 46), pneumonia (n = 17), pneumothorax (n = 11), hydronephrosis (n = 8), gastrointestinal perforation (n = 4), mediastinal emphysema (n = 3), hydrocephalus (n = 2), and other abnormalities (n = 21)

ISSN: 1472-6947