Skip to main content

Table 10 Five Way Classification Including 'Participants' on Manually Annotated Abstracts

From: Sentence retrieval for abstracts of randomized controlled trials

  All Abstracts Structured Subset Unstructured Subset
  P R F P R F P R F
System 1 Accuracy = 90.59% Accuracy = 90.82% Accuracy = 90.08%
Aim 0.96 0.97 0.97 0.97 0.98 0.97 0.95 0.96 0.95
Method 0.86 0.91 0.88 0.87 0.92 0.89 0.83 0.89 0.86
Participants 0.68 0.37 0.48 0.67 0.36 0.47 0.71 0.40 0.52
Results 0.91 0.94 0.92 0.90 0.95 0.93 0.93 0.92 0.92
Conclusion 0.96 0.93 0.95 0.98 0.93 0.95 0.93 0.94 0.94
System 2 Accuracy = 94.64% Accuracy = 94.98% Accuracy = 93.68%
Aim 0.98 0.98 0.98 0.99 0.99 0.99 0.97 0.97 0.97
Method 0.90 0.96 0.93 0.91 0.97 0.94 0.88 0.93 0.90
Participants 0.76 0.40 0.52 0.76 0.37 0.50 0.77 0.46 0.58
Results 0.96 0.98 0.97 0.96 0.99 0.98 0.96 0.96 0.96
Conclusion 0.99 0.99 0.99 1.00 1.00 1.00 0.97 0.97 0.97
System 3 Accuracy = 94.91% Accuracy = 94.98% Accuracy = 94.75%
Aim 0.98 0.98 0.98 0.99 0.99 0.99 0.97 0.97 0.97
Method 0.90 0.96 0.93 0.90 0.97 0.93 0.88 0.94 0.91
Participants 0.77 0.38 0.51 0.76 0.37 0.49 0.80 0.43 0.56
Results 0.97 0.97 0.98 0.96 0.99 0.98 0.97 0.98 0.98
Conclusion 0.99 0.99 0.99 1.00 1.00 1.00 0.99 0.98 0.98
System 4 Accuracy = 94.25% Accuracy = 94.98% Accuracy = 94.75%
Aim 0.99 0.99 0.99 1.00 1.00 1.00 0.97 0.96 0.97
Method 0.92 0.94 0.93 0.93 0.94 0.94 0.89 0.92 0.90
Participants 0.56 0.38 0.45 0.54 0.34 0.42 0.59 0.51 0.55
Results 0.96 0.98 0.97 0.95 1.00 0.97 0.97 0.95 0.96
Conclusion 0.99 0.99 0.99 1.00 1.00 1.00 0.95 0.98 0.97
  1. Sentence classification using CRFs into five classes including Participants. Results report on four systems as described in Table 8. System 4 describes a system identical to System 2 except the training data is augmented with those from Set P.