BMC Medical Informatics and Decision Making

Table 9 Five Way Classification Including 'Outcome Measure' on Manually Annotated Abstracts

From: Sentence retrieval for abstracts of randomized controlled trials

	All Abstracts			Structured Subset			Unstructured Subset
	P	R	F	P	R	F	P	R	F
System 1	Accuracy = 90.29%			Accuracy = 90.95%			Accuracy = 00.00%
Aim	0.98	0.97	0.97	0.98	0.98	0.98	0.97	0.94	0.96
Method	0.87	0.83	0.85	0.88	0.83	0.85	0.85	0.82	0.84
Outcome Measure	0.79	0.69	0.74	0.80	0.69	0.74	0.76	0.69	0.72
Results	0.89	0.96	0.92	0.90	0.97	0.93	0.88	0.93	0.90
Conclusion	0.96	0.93	0.95	0.98	0.94	0.96	0.93	0.93	0.93
System 2	Accuracy = 94.22%			Accuracy = 94.89%			Accuracy = 92.70%
Aim	0.98	0.98	0.98	0.98	0.99	0.99	0.96	0.95	0.96
Method	0.88	0.88	0.88	0.89	0.88	0.89	0.87	0.88	0.88
Outcome Measure	0.81	0.77	0.79	0.82	0.77	0.79	0.80	0.75	0.77
Results	0.97	0.98	0.98	0.98	0.99	0.99	0.95	0.97	0.96
Conclusion	0.99	0.99	0.99	1.00	1.00	1.00	0.97	0.97	0.97
System 3	Accuracy = 94.77%			Accuracy = 94.89%			Accuracy = 94.07%
Aim	0.98	0.99	0.99	0.98	0.99	0.99	0.98	0.98	0.98
Method	0.89	0.89	0.89	0.89	0.88	0.89	0.90	0.88	0.89
Outcome Measure	0.81	0.77	0.79	0.82	0.77	0.79	0.78	0.77	0.78
Results	0.98	0.99	0.98	0.98	0.99	0.99	0.96	0.98	0.97
Conclusion	0.99	0.99	0.99	1.00	1.00	1.00	0.99	0.98	0.98
System 4	Accuracy = 95.60%			Accuracy = 96.71%			Accuracy = 93.09%
Aim	0.99	0.98	0.98	1.00	1.00	1.00	0.96	0.95	0.96
Method	0.91	0.89	0.90	0.92	0.91	0.92	0.91	0.85	0.88
Outcome Measure	0.82	0.85	0.84	0.85	0.86	0.85	0.76	0.83	0.79
Results	0.99	0.99	0.99	1.00	1.00	1.00	0.96	0.97	0.96
Conclusion	0.99	0.99	0.99	1.00	1.00	1.00	0.97	0.98	0.97

Sentence classification using CRFs into five classes including Outcome Measure. Results report on four systems as described in Table 8. System 4 describes a system identical to System 2 except the training data is augmented with those from Set O.

Back to article page

ISSN: 1472-6947

Contact us

General enquiries: journalsubmissions@springernature.com