Skip to main content

Advertisement

Table 2 Inter-rater scoring and agreement by item on the goal-evaluation tool

From: Measuring the quality of Patients’ goals and action plans: development and validation of a novel tool

Goal evaluation tool-diabetes (GET-D) items Frequency of scores* Raw agreement (%) Kappa
0 1 2 3
Goal 1: Relation to Self-Management 24 146    91% 0.62
Goal 2a: Measurable Specificity 128    42 95% 0.87
Goal 2b: Presence of a Deadline 164    6 98% 0.65
Action Plan 3: Relation to the Goal 55 115    87% 0.71
Action Plan 4a: Specific Action 54    116 91% 0.78
Action Plan 4b: Frequency or Schedule 145    25 96% 0.86
Action Plan 4c: Location 168    2 98% −0.01
Action Plan 4d: Intensity or Duration 155    15 94% 0.63
Action Plan 4e: Activity Monitoring 167    3 99% 0.66
Action Plan 5: Feasibility 36 114 13 7 95% 0.77
Average across all 10 Criteria   94.4% 0.66
  1. Legend:
  2. * Criteria 1–4 were scored as either 0,1 or 0,3, to weight some criteria as more critical than others. Criteria 5 was scored as 0,1,2,3. The distribution of scores is based on scores provided by both raters (n=170 total, n=85 for each rater). There were no missing data for any criteria.