Scenario | • Describes a challenging situation, even for experts | yes | no |
• Describes an appropriate situation for examinees tested | yes | no | |
• The scenario is necessary in order to understand the question and to set the context | yes | no | |
• The clinical presentation is typical | yes | no | |
• The scenario is correctly written | yes | no | |
Questions | • Questions are developed following a key-feature approach | yes | no |
• In the experts' opinion, the options are relevant | yes | no | |
• The same option is not found in two consecutive questions | yes | no | |
• The new information (2nd column) makes it possible to test the link between the new information and the option (1st column) in the described context | yes | no | |
• Likert scale anchors are clearly defined and unambiguous | yes | no | |
• Questions are developed to spread the answers equally over all the values of the Likert scale | yes | no | |
• Questions are developed to provide balance between low and high variability | yes | no | |
Experts' panel | • Number between 10 and 20 | yes | no |
• The experts' panel includes experienced physicians whose presence in a jury is appropriate to the level of the examinees assessed | yes | no | |
• Experts take the test individually, in exactly the same conditions as the examinees | yes | no |