Skip to main content

Table 9 Five Way Classification Including 'Outcome Measure' on Manually Annotated Abstracts

From: Sentence retrieval for abstracts of randomized controlled trials

  All Abstracts Structured Subset Unstructured Subset
  P R F P R F P R F
System 1 Accuracy = 90.29% Accuracy = 90.95% Accuracy = 00.00%
Aim 0.98 0.97 0.97 0.98 0.98 0.98 0.97 0.94 0.96
Method 0.87 0.83 0.85 0.88 0.83 0.85 0.85 0.82 0.84
Outcome Measure 0.79 0.69 0.74 0.80 0.69 0.74 0.76 0.69 0.72
Results 0.89 0.96 0.92 0.90 0.97 0.93 0.88 0.93 0.90
Conclusion 0.96 0.93 0.95 0.98 0.94 0.96 0.93 0.93 0.93
System 2 Accuracy = 94.22% Accuracy = 94.89% Accuracy = 92.70%
Aim 0.98 0.98 0.98 0.98 0.99 0.99 0.96 0.95 0.96
Method 0.88 0.88 0.88 0.89 0.88 0.89 0.87 0.88 0.88
Outcome Measure 0.81 0.77 0.79 0.82 0.77 0.79 0.80 0.75 0.77
Results 0.97 0.98 0.98 0.98 0.99 0.99 0.95 0.97 0.96
Conclusion 0.99 0.99 0.99 1.00 1.00 1.00 0.97 0.97 0.97
System 3 Accuracy = 94.77% Accuracy = 94.89% Accuracy = 94.07%
Aim 0.98 0.99 0.99 0.98 0.99 0.99 0.98 0.98 0.98
Method 0.89 0.89 0.89 0.89 0.88 0.89 0.90 0.88 0.89
Outcome Measure 0.81 0.77 0.79 0.82 0.77 0.79 0.78 0.77 0.78
Results 0.98 0.99 0.98 0.98 0.99 0.99 0.96 0.98 0.97
Conclusion 0.99 0.99 0.99 1.00 1.00 1.00 0.99 0.98 0.98
System 4 Accuracy = 95.60% Accuracy = 96.71% Accuracy = 93.09%
Aim 0.99 0.98 0.98 1.00 1.00 1.00 0.96 0.95 0.96
Method 0.91 0.89 0.90 0.92 0.91 0.92 0.91 0.85 0.88
Outcome Measure 0.82 0.85 0.84 0.85 0.86 0.85 0.76 0.83 0.79
Results 0.99 0.99 0.99 1.00 1.00 1.00 0.96 0.97 0.96
Conclusion 0.99 0.99 0.99 1.00 1.00 1.00 0.97 0.98 0.97
  1. Sentence classification using CRFs into five classes including Outcome Measure. Results report on four systems as described in Table 8. System 4 describes a system identical to System 2 except the training data is augmented with those from Set O.