Automated extraction of information of lung cancer staging from unstructured reports of PET-CT interpretation: natural language processing with deep-learning

Park, Hyung Jun; Park, Namu; Lee, Jang Ho; Choi, Myeong Geun; Ryu, Jin-Sook; Song, Min; Choi, Chang-Min

doi:10.1186/s12911-022-01975-7

BMC Medical Informatics and Decision Making

Table 2 Prediction accuracy for primary cancer location and metastatic sites

From: Automated extraction of information of lung cancer staging from unstructured reports of PET-CT interpretation: natural language processing with deep-learning

	Validation set				Additional-test set
	Frequency	Precision	Sensitivity	F₁-Score	Frequency	Precision	Sensitivity	F₁-Score
Primary lung lesion
Left
Left (huge)	6	0.2000 (1/5)	0.1667 (1/6)	0.1818	143	0.6786 (19/28)	0.1329 (19/143)	0.2222
Left lower lobe	84	0.7143 (70/98)	0.8333 (70/84)	0.7692	553	0.7894 (521/660)	0.9421 (521/553)	0.8590
Left upper lobe	126	0.8684 (99/114)	0.7857 (99/126)	0.8250	765	0.9598 (717/747)	0.9373 (717/765)	0.9484
Any of left†	216	0.8940 (194/217)	0.8981 (194/216)	0.8961	1461	0.9666 (1387/1435)	0.9493 (1387/1461)	0.9579
Right
Right (huge)	8	0.0000 (0/0)	0.0000 (0/8)	0.0000	171	0.0000 (0/0)	0.0000 (0/171)	0.0000
Right lower lobe	90	0.8690 (73/84)	0.8111 (73/90)	0.8391	690	0.9361 (659/704)	0.9551 (659/690)	0.9455
Right middle lobe	27	0.3898 (23/59)	0.8519 (23/27)	0.5349	191	0.4360 (177/406)	0.9267 (177/191)	0.5930
Right upper lobe	132	0.8850 (100/113)	0.7576 (100/132)	0.8163	849	0.9376 (766/817)	0.9022 (766/849)	0.9196
Any of right†	257	0.9141 (234/256)	0.9105 (234/257)	0.9123	1901	0.9616 (1853/1927)	0.9748 (1853/1901)	0.9681
Overall	473	0.7953	0.7738	0.7767	3362	0.8308	0.8504	0.8265
Metastatic organ
Intra-thoracic
Malignant effusion	36	0.4096 (34/83)	0.9444 (34/36)	0.5714	342	0.57 (334/586)	0.9766 (334/342)	0.7198
Pleural nodule	55	0.6296 (51/81)	0.9273 (51/55)	0.7500	542	0.7674 (508/662)	0.9373 (508/542)	0.8439
Contralateral metastasis	61	0.3846 (40/104)	0.6557 (40/61)	0.4848	363	0.3441 (287/834)	0.7906 (287/363)	0.4795
Extra-thoracic
Bone	119	0.8298 (117/141)	0.9832 (117/119)	0.9000	697	0.7462 (682/914)	0.9785 (682/697)	0.8467
Extra-thoracic LN‡	82	0.4530 (82/181)	1.0000 (82/82)	0.6236	401	0.3347 (399/1192)	0.995 (399/401)	0.5009
Adrenal	22	0.4872 (19/39)	0.8636 (19/22)	0.6230	177	0.4958 (175/353)	0.9887 (175/177)	0.6604
Liver	42	0.8810 (37/42)	0.8810 (37/42)	0.8810	62	0.2609 (12/46)	0.1935 (12/62)	0.2222
Overall	473	0.6150	0.9113	0.7202	3362	0.5782	0.9276	0.6963

^†Predicting cancer site between right or left that do not consider subdivision of the lung lobes. ‡LN: lymph nodes

Back to article page

ISSN: 1472-6947

Contact us

General enquiries: journalsubmissions@springernature.com