Table 3 The score distribution for ChatGPT’ s performance
Accuracy | Completeness | Text Quality | ||||
|---|---|---|---|---|---|---|
N/CD | DD | N/CD | DD | N/CD | DD | |
Score 5 | 20 | 11 | 33 | 36 | 43 | 28 |
Score 4 | 13 | 17 | 11 | 7 | 5 | 17 |
Score 3 | 13 | 10 | 8 | 4 | 5 | 3 |
Score 2 | 4 | 8 | 2 | 1 | 1 | 0 |
Score 1 | 4 | 2 | 0 | 0 | 0 | 0 |
Mean | 3.8 | 3.6 | 4.4 | 4.6 | 4.7 | 4.5 |
Mean (102 cases) | 3.7 | 4.5 | 4.6 | |||
Inter- examiner agreement | 0.890 | 0.801 | 0.778 | |||