On the Equivalence of Multirater Kappas Based on 2-Agreement and 3-Agreement with Binary Scores

Table 2

Two hypothetical data sets with dichotomous judgments by 4 raters for 15 cases.

(a)  

Freq.	Raters
	1	2	3	4
6	1	1	1	1	𝜅(4,2)≈.645
5	1	0	0	0	𝜅(4,3)≈.645
4	0	0	0	0	𝜅(4,4)≈.599

(b)  

Freq.	Raters
	1	2	3	4
6	1	1	1	1	𝜅(4,2)≈.564
5	1	0	1	0	𝜅(4,3)≈.564
4	0	0	0	0	𝜅(4,4)≈.625