Skip to main content

Table 7 Definitions of agreement and disagreement for different panel sizes

From: A conceptual framework and protocol for defining clinical decision support objectives applicable to medical specialties

  Agreement Disagreement
Panel size Number of panelists rating outside the 3-point region containing the median Number of panelists rating in each extreme third of the scale (1-3 and 7-9)
8-10 ≤2 ≥3
11-13 ≤3 ≥4
14-16 ≤4 ≥5
  1. Note. Definitions of disagreement and agreement reflect the default definitions according to the developers of the RAND/UCLA Appropriateness Method. These are also the most widely used definitions.