Table 5 Results obtained with the FS ensemble with subset size defined by RPT using β = 0.1 (upper values), β = 1 (middle values) and β = 10 (bottom values) for different classifiers. Results are averaged over 10 × 5 stratified cross validation, for each time window, using CCC data
AUC | Sensitivity | Specificity | Stability | # Features | ||
|---|---|---|---|---|---|---|
2Y | NB | 0.803 ± 0.01 | 0.746 ± 0.01 | 0.681 ± 0.00 | 1.0 ± 0.0 | 9 |
0.829 ± 0.00 | 0.771 ± 0.01 | 0.733 ± 0.01 | 0.971 ± 0.03 | 18 | ||
0.829 ± 0.00 | 0.765 ± 0.01 | 0.744 ± 0.01 | 0.936 ± 0.01 | 20 | ||
SVM Poly | 0.815 ± 0.01 | 0.863 ± 0.01 | 0.767 ± 0.01 | 1.0 ± 0.0 | 9 | |
0.839 ± 0.00 | 0.789 ± 0.01 | 0.767 ± 0.01 | 0.965 ± 0.03 | 19 | ||
0.841 ± 0.00 | 0.788 ± 0.01 | 0.758 ± 0.01 | 0.936 ± 0.01 | 20 | ||
SVM RBF | 0.820 ± 0.00 | 0.803 ± 0.02 | 0.673 ± 0.01 | 1.0 ± 0.0 | 9 | |
0.841 ± 0.00 | 0.771 ± 0.01 | 0.765 ± 0.01 | 0.965 ± 0.03 | 19 | ||
0.841 ± 0.00 | 0.771 ± 0.01 | 0.765 ± 0.01 | 0.965 ± 0.03 | 19 | ||
DT | 0.616 ± 0.02 | 0.445 ± 0.03 | 0.786 ± 0.01 | 1.0 ± 0.0 | 9 | |
0.643 ± 0.02 | 0.578 ± 0.05 | 0.633 ± 0.03 | 0.918 ± 0.02 | 1 | ||
0.643 ± 0.02 | 0.578 ± 0.05 | 0.633 ± 0.03 | 0.918 ± 0.02 | 1 | ||
LR | 0.811 ± 0.01 | 0.752 ± 0.02 | 0.726 ± 0.01 | 1.0 ± 0.0 | 9 | |
0.811 ± 0.01 | 0.752 ± 0.02 | 0.726 ± 0.01 | 1.0 ± 0.0 | 9 | ||
0.821 ± 0.01 | 0.765 ± 0.01 | 0.765 ± 0.01 | 0.936 ± 0.01 | 20 | ||
3Y | NB | 0.833 ± 0.00 | 0.749 ± 0.01 | 0.735 ± 0.01 | 1.0 ± 0.0 | 9 |
0.857 ± 0.00 | 0.779 ± 0.01 | 0.772 ± 0.01 | 0.966 ± 0.01 | 19 | ||
0.859 ± 0.00 | 0.778 ± 0.01 | 0.781 ± 0.01 | 0.950 ± 0.01 | 20 | ||
SVM Poly | 0.844 ± 0.00 | 0.0 ± 0.0 | 1.0 ± 0.0 | 1.0 ± 0.0 | 9 | |
0.872 ± 0.00 | 0.633 ± 0.01 | 0.886 ± 0.00 | 0.966 ± 0.02 | 19 | ||
0.873 ± 0.01 | 0.643 ± 0.01 | 0.874 ± 0.00 | 0.909 ± 0.02 | 25 | ||
SVM RBF | 0.842 ± 0.00 | 0.582 ± 0.01 | 0.870 ± 0.01 | 1.0 ± 0.0 | 9 | |
0.873 ± 0.00 | 0.608 ± 0.01 | 0.891 ± 0.00 | 0.966 ± 0.02 | 19 | ||
0.874 ± 0.00 | 0.612 ± 0.01 | 0.895 ± 0.01 | 0.950 ± 0.02 | 20 | ||
DT | 0.664 ± 0.02 | 0.556 ± 0.03 | 0.773 ± 0.03 | 1.0 ± 0.0 | 9 | |
0.686 ± 0.02 | 0.587 ± 0.03 | 0.784 ± 0.02 | 0.986 ± 0.02 | 12 | ||
0.686 ± 0.02 | 0.587 ± 0.03 | 0.784 ± 0.02 | 0.986 ± 0.02 | 12 | ||
LR | 0.838 ± 0.01 | 0.619 ± 0.02 | 0.859 ± 0.00 | 1.0 ± 0.0 | 9 | |
0.838 ± 0.01 | 0.619 ± 0.02 | 0.859 ± 0.01 | 1.0 ± 0.0 | 9 | ||
0.853 ± 0.01 | 0.635 ± 0.01 | 0.859 ± 0.01 | 0.950 ± 0.02 | 20 | ||
4Y | NB | 0.852 ± 0.00 | 0.796 ± 0.01 | 0.768 ± 0.01 | 1.0 ± 0.0 | 9 |
0.852 ± 0.00 | 0.796 ± 0.01 | 0.768 ± 0.01 | 1.0 ± 0.0 | 9 | ||
0.868 ± 0.00 | 0.793 ± 0.01 | 0.788 ± 0.01 | 0.955 ± 0.02 | 19 | ||
SVM Poly | 0.853 ± 0.00 | 0.821 ± 0.01 | 0.720 ± 0.00 | 1.0 ± 0.0 | 9 | |
0.872 ± 0.00 | 0.775 ± 0.01 | 0.821 ± 0.01 | 0.959 ± 0.2 | 20 | ||
0.872 ± 0.00 | 0.775 ± 0.01 | 0.821 ± 0.01 | 0.959 ± 0.02 | 20 | ||
SVM RBF | 0.858 ± 0.00 | 0.754 ± 0.01 | 0.798 ± 0.00 | 1.0 ± 0.0 | 9 | |
0.858 ± 0.00 | 0.754 ± 0.01 | 0.798 ± 0.00 | 1.0 ± 0.0 | 9 | ||
0.871 ± 0.00 | 0.763 ± 0.01 | 0.820 ± 0.01 | 0.949 ± 0.03 | 16 | ||
DT | 0.675 ± 0.01 | 0.641 ± 0.02 | 0.713 ± 0.01 | 1.0 ± 0.0 | 2 | |
0.675 ± 0.01 | 0.641 ± 0.02 | 0.713 ± 0.01 | 1.0 ± 0.0 | 2 | ||
0.682 ± 0.02 | 0.655 ± 0.03 | 0.717 ± 0.01 | 0.937 ± 0.04 | 14 | ||
LR | 0.852 ± 0.00 | 0.737 ± 0.01 | 0.801 ± 0.01 | 1.0 ± 0.0 | 9 | |
0.852 ± 0.00 | 0.737 ± 0.01 | 0.801 ± 0.01 | 1.0 ± 0.0 | 9 | ||
0.742 ± 0.01 | 0.742 ± 0.01 | 0.803 ± 0.01 | 0.929 ± 0.01 | 15 |