BMC Medical Informatics and Decision Making

Table 10 Five Way Classification Including 'Participants' on Manually Annotated Abstracts

From: Sentence retrieval for abstracts of randomized controlled trials

	All Abstracts			Structured Subset			Unstructured Subset
	P	R	F	P	R	F	P	R	F
System 1	Accuracy = 90.59%			Accuracy = 90.82%			Accuracy = 90.08%
Aim	0.96	0.97	0.97	0.97	0.98	0.97	0.95	0.96	0.95
Method	0.86	0.91	0.88	0.87	0.92	0.89	0.83	0.89	0.86
Participants	0.68	0.37	0.48	0.67	0.36	0.47	0.71	0.40	0.52
Results	0.91	0.94	0.92	0.90	0.95	0.93	0.93	0.92	0.92
Conclusion	0.96	0.93	0.95	0.98	0.93	0.95	0.93	0.94	0.94
System 2	Accuracy = 94.64%			Accuracy = 94.98%			Accuracy = 93.68%
Aim	0.98	0.98	0.98	0.99	0.99	0.99	0.97	0.97	0.97
Method	0.90	0.96	0.93	0.91	0.97	0.94	0.88	0.93	0.90
Participants	0.76	0.40	0.52	0.76	0.37	0.50	0.77	0.46	0.58
Results	0.96	0.98	0.97	0.96	0.99	0.98	0.96	0.96	0.96
Conclusion	0.99	0.99	0.99	1.00	1.00	1.00	0.97	0.97	0.97
System 3	Accuracy = 94.91%			Accuracy = 94.98%			Accuracy = 94.75%
Aim	0.98	0.98	0.98	0.99	0.99	0.99	0.97	0.97	0.97
Method	0.90	0.96	0.93	0.90	0.97	0.93	0.88	0.94	0.91
Participants	0.77	0.38	0.51	0.76	0.37	0.49	0.80	0.43	0.56
Results	0.97	0.97	0.98	0.96	0.99	0.98	0.97	0.98	0.98
Conclusion	0.99	0.99	0.99	1.00	1.00	1.00	0.99	0.98	0.98
System 4	Accuracy = 94.25%			Accuracy = 94.98%			Accuracy = 94.75%
Aim	0.99	0.99	0.99	1.00	1.00	1.00	0.97	0.96	0.97
Method	0.92	0.94	0.93	0.93	0.94	0.94	0.89	0.92	0.90
Participants	0.56	0.38	0.45	0.54	0.34	0.42	0.59	0.51	0.55
Results	0.96	0.98	0.97	0.95	1.00	0.97	0.97	0.95	0.96
Conclusion	0.99	0.99	0.99	1.00	1.00	1.00	0.95	0.98	0.97

Sentence classification using CRFs into five classes including Participants. Results report on four systems as described in Table 8. System 4 describes a system identical to System 2 except the training data is augmented with those from Set P.

Back to article page

ISSN: 1472-6947

Contact us

General enquiries: journalsubmissions@springernature.com