Skip to main content

Table 5 Calculate content validity ratio, modified Kappa and face validity

From: Design, development, and evaluation of a surveillance system for suicidal behaviors in Iran

content validity ratio, modified Kappa and face validity

Items of administrative class of suicide MDS

The number giving a rating of 3 or 4 to the relevancy of item

CVRa

Pcb

Kc

Face validityd

Interpretation

Record number

50

1

0/009 × \({10}^{-48}\)

1

3.5

Excellent

Gender

50

1

0/009 × \({10}^{-48}\)

1

3.5

Excellent

Age

50

1

0/009 × \({10}^{-48}\)

1

3.5

Excellent

Birth date

48

0.92

0/01 × \({10}^{-45}\)

0.96

2.86

Excellent

Marital status

48

0.96

0/01 × \({10}^{-45}\)

0.96

2.86

Excellent

Occupation/Job

50

1

0/048 × \({10}^{-45}\)

1

3.5

Excellent

Employment status

50

1

0/048 × \({10}^{-45}\)

1

3.5

Excellent

Admission date

45

0.8

0/02 × \({10}^{-45}\)

0.9

2.75

Excellent

Suicide method

50

1

4 × \({10}^{-45}\)

1

3.5

Excellent

Residence

48

0.92

0/009 × \({10}^{-48}\)

0.96

2.86

Excellent

Home address

50

1

0/01 × \({10}^{-45}\)

1

3.5

Excellent

Education level

49

0.96

0/01 × \({10}^{-45}\)

0.98

2.9

Excellent

Racial status

46

0.84

0/048 × \({10}^{-45}\)

0.92

2.63

Excellent

Healthcare setting name

50

1

0/02 × \({10}^{-45}\)

1

3.5

Excellent

Visit type

45

0.8

0/02 × \({10}^{-45}\)

0.9

2.36

Excellent

Visits followed by

48

0.92

0/01 × \({10}^{-45}\)

0.96

2.86

Excellent

  1. aThe formula of content validity ratio is CVR = (Ne–N/2)/ (N/2). In which the Ne is the number of panelists indicating "essential" and N is the total number of panelists. The numeric value of content validity ratio is determined by Lawshe Table. if CVR is bigger than 0.49, the item in the instrument with an acceptable level of significance will be accepted
  2. bPc (probability of a chance occurrence) was computed using the formula: pc = [N! /A! (N -A)!] *.5Nwhere N = number of experts and A = number of panelists who agree that the item is relevant
  3. cK (Modified Kappa) was computed using the formula: K = (I-CVI- PC)/ (1- PC). Interpretation criteria for Kappa, using guidelines described in Cicchetti and Sparrow (1981): Fair = K of 0.40 to 0.59; Good = K of 0.60 to 0.74; and Excellent = K > 0.7
  4. dFor calculation, the formula Impact Score = Frequency (ratio of raters who scored 3 & 4) * Importance (mean score for the importance on the basis of domains) was used. The Impact Score for each item must be above 1.5 or it will be removed