Natural language processing for identification of hypertrophic cardiomyopathy patients from cardiac magnetic resonance reports

Dewaswala, Nakeya; Chen, David; Bhopalwala, Huzefa; Kaggal, Vinod C.; Murphy, Sean P.; Bos, J. Martijn; Geske, Jeffrey B.; Gersh, Bernard J.; Ommen, Steve R.; Araoz, Philip A.; Ackerman, Michael J.; Arruda-Olson, Adelaide M.

doi:10.1186/s12911-022-02017-y

BMC Medical Informatics and Decision Making

Table 4 Performance metrics for each NLP algorithm compared with gold standard

From: Natural language processing for identification of hypertrophic cardiomyopathy patients from cardiac magnetic resonance reports

Phenotypic characteristic	Sensitivity	Specificity	PPV	F-1 score	NPV	Accuracy
HCM diagnosis	0.98 (0.92, 1.00)	1.00 (0.97, 1.00)	1.00 (0.96, 1.00)	0.99 (0.97, 1.00)	0.98 (0.94, 1.00)	0.99 0.97, 1.00)
HCM morphologic subtype	0.98 (0.92, 1.00)	1.00 (0.84, 1.00)	1.00 (0.94, 1.00)	0.99 (0.97, 1.00)	0.95 (0.77, 1.00)	0.99 (0.94, 1.00)
Systolic anterior motion of mitral valve	0.97 (0.89, 1.00)	0.95 (0.76, 1.00)	0.98 (0.91, 1.00)	0.98 (0.94, 1.00)	0.91 (0.71, 0.99)	0.96 (0.90, 0.99)
Mitral regurgitation	0.95 (0.87, 0.99)	0.87 (0.66, 0.97)	0.95 (0.97, 0.99)	0.95 (0.91, 0.99)	0.87 (0.66, 0.97)	0.93 (0.85, 0.97)
Presence of LV obstruction	0.94 (0.85, 0.98)	0.95 (0.77, 1.00)	0.98 (0.91, 1.00)	0.96 (0.92, 0.99)	0.84 (0.64, 0.95)	0.94 (0.87, 0.98)
Location of obstruction (LVOT, mid-ventricular)	0.93 (0.85, 0.98)	0.91 0.71, 0.99)	0.96 (0.88, 0.99)	0.95 (0.91, 0.99)	0.84 (0.63, 0.95)	0.92 (0.85, 0.97)
Apical pouch	1.00 (0.59, 1.00)	0.97 (0.91, 1.00)	0.78 (0.40, 0.97)	0.88 (0.60, 1.00)	1.00 (0.95, 1.00)	0.98 (0.92, 1.00)
Left ventricular delayed enhancement	0.93 (0.84, 0.98)	0.92 (0.73, 0.99)	0.97 (0.88, 1.00)	0.95 (0.91, 0.98)	0.85 (0.65, 0.96)	0.93 (0.85, 0.97)
Left atrial enlargement	0.98 (0.91, 1.00)	1.00 (0.88, 1.00)	1.00 (0.94, 1.00)	0.99 (0.97, 1.00)	0.97 (0.82, 1.00)	0.99 (0.94, 1.00)
Right atrial enlargement	0.94 (0.73, 1.00)	0.99 (0.92, 1.00)	0.94 (0.73, 1.00)	0.94 (0.86, 1.00)	0.99 (0.92, 1.00)	0.98 (0.92, 1.00)
Maximal LV wall thickness	0.96 (0.90. 0.99)	1.00 (0.40, 1.00)	1.00 (0.95, 1.00)	0.98 (0.96, 1.00)	0.57 (0.18, 0.90)	0.96 (0.90, 0.99)
LV mass	0.99 (0.93, 1.00)	1.00 (0.59, 1.00)	1.00 (0.95, 1.00)	0.99 (0.98, 1.00)	0.88 (0.47, 1.00)	0.99 (0.94, 1.00)
LV mass index	0.97 (0.91, 1.00)	1.00 (0.69, 1.00)	1.00 (0.95, 1.00)	0.99 (0.96, 1.00)	0.83 (0.52, 0.98)	0.98 (0.92, 1.00)
LV ejection fraction	0.99 (0.93, 1.00)	0.83 (0.36, 1.00)	0.99 (0.93, 1.00)	0.99 (0.97, 1.00)	0.83 (0.36, 1.00)	0.98 (0.92, 1.00)
RV ejection fraction	1.00 (0.95, 1.00)	0.89 (0.52, 1.00)	0.99 (0.93, 1.00)	0.99 (0.98, 1.00)	1.00 (0.63, 1.00)	0.99 (0.94, 1.00)

HCM = hypertrophic cardiomyopathy, LV = left ventricular, LVOT = left ventricular outflow tract, NPV = negative predictive value, PPV = positive predictive value, RV = right ventricular

Back to article page

ISSN: 1472-6947

Contact us

General enquiries: journalsubmissions@springernature.com