Comparability of Self-Ratings and Observer Ratings in Occupational Psychosocial Risk Assessments: Is There Agreement?

Table 1

Agreement and reliability estimates of the self-ratings.

Within-group agreement		Interrater reliability
Psychosocial risk items		ICC 1	ICC 2	F ratio
Work content
Task completeness	.43	.05	.55	2.22
Task variety	.52	.21	.88	8.11
Task significance	.63	.21	.88	8.13
Influence on task content	.29	.20	.87	7.46
Influence on task execution	.36	.27	.91	10.93
Influence on work pace	.36	.10	.74	3.80
Unambiguous work orders	.46	.07	.67	3.08
Clearly assigned responsibilities	.54	.05	.60	2.51
Authority for those responsible	.55	.02	.36	1.6
Skill utilization	.70	.13	.79	4.86
Qualification opportunities	.20	.14	.81	5.22
Advancement opportunities	.27	.13	.78	4.62
No suppression of emotion	.34	.09	.73	3.65
No critical life events	.44	.30	.92	12.39
No aggression/violence	.61	.31	.92	12.42
Fixed location	.46	.49	.96	26.13
Job security	.30	.05	.58	2.35
Work-life balance	.42	.15	.83	5.12
Work organisation
Compliance with working hours	.45	.19	.86	7.21
Regular recovery breaks	.37	.12	.78	4.483
No changes in working hours	.32	.11	.76	4.15
Timely changes to working hours	.28	.08	.66	2.96
Suitable ratio amount versus time	.37	.10	.74	3.915
Time for core tasks	.43	.08	.70	3.302
Uniform workload	.29	.09	.73	3.74
No multiple tasks	.32	.14	.81	5.19
No interruptions (from people)	.38	.12	.78	4.61
No interruptions (due to ICT)	.35	.22	.88	8.66
Comprehensive information	.54	.03	.50	1.99
Availability of work equipment	.61	.08	.69	3.242
Social relations
Respect among colleagues	.65	.08	.71	3.416
Support among colleagues	.63	.10	.75	3.977
Professional conflict solving	.57	.09	.71	3.467
Coordination of joint tasks	.59	.08	.69	3.244
Helpful feedback from supervisor	.31	.09	.73	3.724
Acknowledgement from supervisor	.24	.16	.84	6.08
Respect from supervisor	.49	.18	.85	6.671
Support from supervisor as needed	.37	.09	.73	3.729
Working environment
Sufficient Space	.36	.14	.81	5.234
Contact opportunities	.54	.07	.67	3.032
Retreat possibilities	.12	.12	.78	4.597
No unpleasant odours	.46	.29	.91	11.73
Quiet working environment	.27	.25	.90	9.849
Pleasant climate	.32	.28	.91	11.12
Appropriate lighting	.40	.20	.87	7.577
No hazardous/biological agents	.64	.33	.93	13.92
No heavy physical loads	.52	.35	.94	15.54
Varied postures	.14	.03	.43	1.75
PsyHealth	.42	.15	.77

Note. = 22; = 27; p < .001; p< .05; p< .01; ICC: intraclass correlation; within-group agreement measured at the item level with .