Skip to main content

Table 2 Changes in the CR interpretation performance by DLCR use

From: Effect of deep learning-based assistive technology use on chest radiograph interpretation by emergency department physicians: a prospective interventional simulation-based study

 

Without

DLCR

With

DLCR

P value

Without

DLCR

With

DLCR

P value

 

Sensitivity (95% CI)

Specificity (95% CI)

Physician 1

61.00

(55.06, 66.94)

66.80

(61.06, 72.53)

0.001

96.90

(93.91, 99.89)

94.57

(90.66, 98.48)

0.177

Physician 2

65.64

(59.85, 71.42)

72.97

(67.56, 78.38)

 < 0.001

87.60

(81.91,93.29)

87.60

(81.91, 93.29)

 > 0.999

Physician 3

56.76

(50.72, 62.79)

64.86

(59.05, 70.68)

 < 0.001

91.47

(86.65, 96.29)

96.12

(92.79, 99.46)

0.012

Physician 4

67.18

(61.46, 72.90)

76.06

(70.87, 81.26)

 < 0.001

82.95

(76.46, 89.44)

86.05

(80.07, 92.03)

0.344

Physician 5

71.43

(65.93, 76.93)

75.68

(70.45, 80.90)

0.004

81.40

(74.68, 88.11)

86.05

(80.07, 92.03)

0.054

Physician 6

62.93

(57.05, 68.82)

69.88

(64.30, 75.47)

0.005

86.05

(80.07, 92.03)

93.02

(88.63, 97.42)

0.026

Physician 7

49.03

(42.95, 55.12)

55.98

(49.94, 62.03)

0.002

91.47

(86.65, 96.29)

96.12

(92.79, 99.46)

0.031

Overall physicians

62.00

(55.64, 68.35)

68.89

(64.68, 73.10)

 < 0.001

88.26

(82.90, 93.62)

91.36

(88.49, 94.23)

0.015

 

Accuracy (95% CI)

AUROC (95% CI)

Physician 1

72.94

(68.52, 77.36)

76.03

(71.68, 80.28)

0.022

0.790

(0.756, 0.823)

0.807

(0.772, 0.842)

0.167

Physician 2

72.94

(68.52, 77.36)

77.84

(73.70, 81.97)

0.003

0.766

(0.726, 0.807)

0.803

(0.764, 0.842)

0.032

Physician 3

68.30

(63.67, 72.93)

75.26

(70.96, 79.55)

 < 0.001

0.741

(0.702, 0.780)

0.805

(0.771, 0.839)

 < 0.001

Physician 4

72.42

(67.98, 76.87)

79.38

(75.36, 83.41)

 < 0.001

0.751

(0.707, 0.794)

0.811

(0.771, 0.850)

0.004

Physician 5

74.74

(70.42, 79.07)

79.12

(75.08, 83.17)

 < 0.001

0.764

(0.721, 0.808)

0.809

(0.769, 0.848)

0.002

Physician 6

70.62

(66.09, 75.15)

77.58

(73.43, 81.73)

 < 0.001

0.745

(0.703, 0.787)

0.815

(0.779, 0.850)

 < 0.001

Physician 7

63.14

(58.34, 67.94)

69.33

(64.74, 73.92)

 < 0.001

0.703

(0.664, 0.742)

0.761

(0.726, 0.795)

 < 0.001

Overall physicians

70.73

(65.91, 75.54)

76.36

(73.21, 79.51)

 < 0.001

0.751

(0.719, 0.783)

0.801

(0.774, 0.828)

 < 0.001

  1. CR, chest radiograph; DLCR, deep learning-based assistive technology for chest radiograph; CI, confidence interval; AUROC, area under the receiver operating characteristic curve
Back to article page

BMC Medical Informatics and Decision Making

ISSN: 1472-6947

Contact us