La Carlota City College

La Carlota City
Graduate School
Ph.D. 203 – Advanced Educational Statistics

Reporter: RAQUEL L. CHAVEZ

Professor: LUCIANO T. MAGALLANES, D.R Dev.

The Kendall’s Coefficient of Concordance W

A nonparametric test used to find out if there is an agreement or concordance among
raters or judges of N objects or individuals. The interpretation of the value of w is
high agreement when W=1, no agreement W=0.
FORMULA:

12 𝛴 𝐷 2
𝑊= 2
𝑚 (𝑁)(𝑁 2 − 1)
Where:
W = The coefficient of Concordance
D = The difference between the individual sum of ranks of the
raters or judges and the average of the sum of ranks of the
object or individuals.
2
 𝐷 = The sum of squares of the difference

m = Judges or raters
N = Objects or individuals being rated or ranked

Example: The data on the ranking of 10 projects by 4 judges.

Individual Judge’s Ranks

Project A B C D

1 1 2 3 4
2 3 1 2 2
3 4 4 1 3
4 5 5 5 1
5 2 6 7 6
6 8 3 4 7
7 6 8 6 5
8 7 7 8 9
9 10 10 9 8
10 9 9 10 10
 I. Problem: Is there an agreement or concordance of the 4 judges
regarding he 10 projects?
II. Hypothesis:
𝐻0 : There is no agreement or concordance of the 4 judges regarding the 10
projects.
𝐻𝐼 : There is an agreement or concordance of the 4 judges regarding the 10
projects.
III. Level of Significance:
a = .05
df = m = 4; N = 10
𝑊.05 = .44
IV. Statistics:
W Coefficient of Concordance

Individual Judge’s Sum of (𝑅̅ = 𝑆𝑢𝑚

Project Ranks Ranks 𝑜𝑓 𝑅𝑎𝑛𝑘𝑠) 𝐷2

A B C D

1 1 2 3 4 10 12 144
2 3 1 2 2 8 14 196
3 4 4 1 3 12 10 100
4 5 5 5 1 16 6 36
5 2 6 7 6 21 1 1
6 8 3 4 7 22 0 0
7 6 8 6 5 25 3 9
8 7 7 8 9 31 9 81
9 10 10 9 8 37 15 225
10 9 9 10 10 38 16 256

 𝑅̅= 220  𝐷2 = 1048

𝑅̅ = 220
10
𝑅̅ = 22
Solution:
Add the ranks of the 4 judges A, B, C, and D of the ten individual projects;
place them under column Sum of Ranks. Get the summation of the Sum of Ranks
with the notation of  𝑅 = 220. Get the average of the Sum of Ranks by dividing it
̅̅̅̅̅̅̅̅̅̅̅̅
by 10, the number of projects. The average is 22 and subtract it from the individual
Sum of Ranks of the ten projects and place them under column D. Square the
difference and place them under𝐷2 . Get the  𝐷2 = 1048.
 To compute use the formula:

12 𝛴 𝐷 2
𝑊= 2
𝑚 (𝑁)(𝑁 2 − 1)
12(1048)
=
42 (10)(102 −1)
12(1048)
=
16(10)(99)
12576
=
158404

W = .79
Decision Rule: If the computed W is greater than the tabular value reject 𝐻0 .
Conclusion: The computed W of .79 is greater than the tabular value of .44
at .05 level of significance with m=4 and N=10 degrees of freedom, the null
hypothesis is rejected in favour of the research hypothesis. This means that there is
an agreement or concordance of the 4 judges regarding the 10 projects. It implies
that project number 2 is rank 1 while project 10 is the last rank.

EXERCICES:
 The data on the ranking of 15 Plays (applying ICT skills in crafting an
adaptation of a literary text) a Culminating Activity of Grade 11 Senior High
School Students in their Oral Communication subject.
I. Problem: Is there an agreement or concordance of the 5 judges
regarding the 15 plays?
II. Hypothesis:
𝐻0 : There is no agreement or concordance of the 5 judges regarding the 15
plays.
𝐻𝐼 : There is an agreement or concordance of the 5 judges regarding the 15
plays.
III. Level of Significance:
a = .05
df = m = ___; N = 15
𝑊.05 = .____
IV. Statistics:
W Coefficient of Concordance

Play Judge’s Sum of (𝑅̅ = 𝑆𝑢𝑚

Project Ranks Ranks 𝑜𝑓 𝑅𝑎𝑛𝑘𝑠) 𝐷2
A B C D E

1 1 2 5 3 6
2 2 1 4 7 1
3 4 3 1 1 2
4 3 4 2 2 3
5 5 5 3 3 5
6 6 6 8 4 4
7 10 7 6 14 8
8 7 8 7 5 9
9 14 9 9 6 7
10 12 10 15 13 10
11 11 11 13 10 11
12 8 12 10 9 12
13 9 13 11 8 15
14 15 14 12 11 14
15 13 15 14 15 13