Research Article
Comparability of Self-Ratings and Observer Ratings in Occupational Psychosocial Risk Assessments: Is There Agreement?
Table 1
Agreement and reliability estimates of the self-ratings.
| Within-group agreement | Interrater reliability | | Psychosocial risk items | | ICC 1 | ICC 2 | F ratio |
| Work content | | | | | Task completeness | .43 | .05 | .55 | 2.22 | Task variety | .52 | .21 | .88 | 8.11 | Task significance | .63 | .21 | .88 | 8.13 | Influence on task content | .29 | .20 | .87 | 7.46 | Influence on task execution | .36 | .27 | .91 | 10.93 | Influence on work pace | .36 | .10 | .74 | 3.80 | Unambiguous work orders | .46 | .07 | .67 | 3.08 | Clearly assigned responsibilities | .54 | .05 | .60 | 2.51 | Authority for those responsible | .55 | .02 | .36 | 1.6 | Skill utilization | .70 | .13 | .79 | 4.86 | Qualification opportunities | .20 | .14 | .81 | 5.22 | Advancement opportunities | .27 | .13 | .78 | 4.62 | No suppression of emotion | .34 | .09 | .73 | 3.65 | No critical life events | .44 | .30 | .92 | 12.39 | No aggression/violence | .61 | .31 | .92 | 12.42 | Fixed location | .46 | .49 | .96 | 26.13 | Job security | .30 | .05 | .58 | 2.35 | Work-life balance | .42 | .15 | .83 | 5.12 | Work organisation | | | | | Compliance with working hours | .45 | .19 | .86 | 7.21 | Regular recovery breaks | .37 | .12 | .78 | 4.483 | No changes in working hours | .32 | .11 | .76 | 4.15 | Timely changes to working hours | .28 | .08 | .66 | 2.96 | Suitable ratio amount versus time | .37 | .10 | .74 | 3.915 | Time for core tasks | .43 | .08 | .70 | 3.302 | Uniform workload | .29 | .09 | .73 | 3.74 | No multiple tasks | .32 | .14 | .81 | 5.19 | No interruptions (from people) | .38 | .12 | .78 | 4.61 | No interruptions (due to ICT) | .35 | .22 | .88 | 8.66 | Comprehensive information | .54 | .03 | .50 | 1.99 | Availability of work equipment | .61 | .08 | .69 | 3.242 | Social relations | | | | | Respect among colleagues | .65 | .08 | .71 | 3.416 | Support among colleagues | .63 | .10 | .75 | 3.977 | Professional conflict solving | .57 | .09 | .71 | 3.467 | Coordination of joint tasks | .59 | .08 | .69 | 3.244 | Helpful feedback from supervisor | .31 | .09 | .73 | 3.724 | Acknowledgement from supervisor | .24 | .16 | .84 | 6.08 | Respect from supervisor | .49 | .18 | .85 | 6.671 | Support from supervisor as needed | .37 | .09 | .73 | 3.729 | Working environment | | | | | Sufficient Space | .36 | .14 | .81 | 5.234 | Contact opportunities | .54 | .07 | .67 | 3.032 | Retreat possibilities | .12 | .12 | .78 | 4.597 | No unpleasant odours | .46 | .29 | .91 | 11.73 | Quiet working environment | .27 | .25 | .90 | 9.849 | Pleasant climate | .32 | .28 | .91 | 11.12 | Appropriate lighting | .40 | .20 | .87 | 7.577 | No hazardous/biological agents | .64 | .33 | .93 | 13.92 | No heavy physical loads | .52 | .35 | .94 | 15.54 | Varied postures | .14 | .03 | .43 | 1.75 |
| PsyHealth | .42 | .15 | .77 | |
|
|
Note. = 22; = 27; p < .001; p< .05; p< .01; ICC: intraclass correlation; within-group agreement measured at the item level with . |