Skip to main content

Table 2 Script Concordance Test item quality grid, adapted from Caire

From: Script Concordance Tests: Guidelines for Construction

Scenario • Describes a challenging situation, even for experts yes no
  • Describes an appropriate situation for examinees tested yes no
  • The scenario is necessary in order to understand the question and to set the context yes no
  • The clinical presentation is typical yes no
  • The scenario is correctly written yes no
Questions • Questions are developed following a key-feature approach yes no
  • In the experts' opinion, the options are relevant yes no
  • The same option is not found in two consecutive questions yes no
  • The new information (2nd column) makes it possible to test the link between the new information and the option (1st column) in the described context yes no
  • Likert scale anchors are clearly defined and unambiguous yes no
  • Questions are developed to spread the answers equally over all the values of the Likert scale yes no
  • Questions are developed to provide balance between low and high variability yes no
Experts' panel • Number between 10 and 20 yes no
  • The experts' panel includes experienced physicians whose presence in a jury is appropriate to the level of the examinees assessed yes no
  • Experts take the test individually, in exactly the same conditions as the examinees yes no