Skip to main content

Table 5 Performance of the ensemble model that underwent probability calibration

From: Applying probability calibration to ensemble methods to predict 2-year mortality in patients with DLBCL

 

AUC

ECE

MCE

P

NB-RPR

0.794 (0.767–0.830)

9.514 (7.761–11.503)

23.800 (17.900–30.625)

0.257 (0.072–0.536)

Logit

0.803 (0.773–0.835)

9.517 (7.909–11.415)

24.400 (18.875–31.900)

0.226 (0.055–0.486)

RF-RPR

0.788 (0.753–0.816)

10.070 (7.989–11.932)

26.550 (20.200–33.275)

0.198 (0.042–0.464)

SVM-RPR

0.788 (0.751–0.816)

10.893 (8.880–13.453)

26.300 (20.300–34.320)

0.140 (0.025–0.418)

FNN

0.813 (0.780–0.845)

9.211 (7.075–10.391)

23.500 (17.675–28.925)

0.329 (0.113–0.585)

SA-EN-C

0.811 (0.777–0.842)

9.295 (7.634–11.199)

23.300 (17.800–29.650)

0.314 (0.131–0.536)

ECE-EN-C

0.811 (0.779–0.842)

9.027 (7.532–10.801)

22.350 (17.600–29.300)

0.351 (0.149–0.572)

MCE-EN-C

0.812 (0.777–0.842)

9.159 (7.456–10.862)

22.300 (17.100–28.700)

0.345 (0.161–0.566)

Stacking-EN-C

0.820 (0.791–0.857)

8.983 (6.698–10.533)

21.265 (14.880–27.800)

0.350 (0.145–0.672)

  1. SA-EN-C, ECE-EN-C, MCE-EN-C, and Stacking-EN-C represent the ensemble models obtained by combining NB-RPR, Logit, RF-RPR, SVM-RPR, and FNN using simple averaging, weighted averaging by the ECE, weighted averaging by the MCE, and stacking method respectively
  2. In each cell M (P25 - P75): M is the median, P25 is the 25th percentile and P75 is the 75th percentile of 300 performances. The best performance in each column is in bold. The secondary best performance in each column is underlined
  3. NB-RPR Naïve Bayes calibrated by shape-restricted polynomial regression, Logit Logistic regression, RF-RPR Random forest calibrated by shape-restricted polynomial regression, SVM-RPR Support vector machine calibrated by shape-restricted polynomial regression, FNN feedforward neural network
Back to article page

BMC Medical Informatics and Decision Making

ISSN: 1472-6947

Contact us