The Assessment of Critical Thinking Critically Assessed in Higher Education: A Validation Study of the CCTT and the HCTA
Table 4
Interrater reliabilities for the constructed-response items of the HCTA ().
Situation
Proportion equal scores
Weighted Cohen’s kappa
Situation 1
0.86
0.77
Situation 2
0.70
0.50
Situation 3
0.58 (0.72)*
(0.77)
Situation 4
0.88
0.85
Situation 5
0.72
0.62
Situation 6
0.56 (0.76)
(0.72)
Situation 7
0.84
0.78
Situation 8
0.86
0.77
Situation 9
0.86
0.76
Situation 10
0.94
0.83
Situation 11
0.90
0.89
Situation 12
0.86
0.90
Situation 13
0.70
0.58
Situation 14
0.92
0.90
Situation 15
0.66 (0.68)
(0.62)
Situation 16
0.78
0.72
Situation 17
0.88
/
Situation 18
0.74
0.74
Situation 19
0.72
0.75
Situation 20
0.88
0.75
Situation 21
0.74
0.73
Situation 22
0.80
0.71
Situation 23
0.70
0.68
Situation 24
0.98
0.94
Situation 25
0.66 (0.74)
(0.65)
Note: For question 17, it was impossible to calculate the weighted Cohen’s kappa, because not all values were present. *The results between brackets are the results of a second set of 50 responses.
