Research Article

The Context, Process, and Outcome Evaluation Model for Organisational Health Interventions

Table 2

Evaluation of an organisational health intervention (OHI) with special focus on lean processes at a hospital in Switzerland.

CPO category and corresponding research questionThemes/indicatorMethods/source

Omnibus context
In what kind of organisation (size, structure, etc.) is the intervention implemented?
How does the political, social, and economic environment look like?
(i) General information on the hospital: location, number of divisions and employees, hierarchical structure, financing, and so forth
(ii) Specific information on nursing departments: structure of nursing departments, types of nursing professions, number and characteristics of nursing personnel, and so forth
(iii) Current political and economic situation/changes that are relevant for the nursing divisions
(iv) Previous intervention projects in the nursing divisions
(i) Discussions with project leaders/head of nursing divisions
(ii) Documentary analysis (documents provided by the hospital)

Discrete context
Are IGLOs ready for the action cycle phase?
Do IGLOs facilitate/hinder the implementation process?
Are IGLOs capable of maintaining and further developing the triggered changes?
Leaders/individuals
(i) Project commitment and readiness for change 
Groups/organisation
(i) Planned projects/alterations during the intervention duration
(ii) Reasons for the intervention project
(iii) Provided resources (time and budget), stability of project personnel, and information politics
(iv) Openness for novelty, communication culture, and channels
(i) Discussions with project leaders/head of nursing divisions
(ii) Four focus group discussions

Implementation process
What is done to fit the intervention to the discrete context and prepare IGLOs for the action cycle phase?
Is the intervention implemented as planned and perceived as favourable by IGLOs?
Are capacities for appropriation built up? What are IGLOs doing to maintain and further develop the triggered changes?
Implementation of intervention elements
(i) Implementation of workshops
 (a) Number of workshops
 (b) Number of workshop participants
 (c) Composition of participants
 (d) Quality appraisals of workshop
 (e) Outcome expectancies
 (f) Satisfaction with measures (developed during the workshop)
 (g) Output of measures for improving the work situation
(ii) Implementation of employee surveys
 (a) Survey period
 (b) Reach
Implementation of intervention architecture
(i) Open questions
(i) Intervention planning chart
(ii) List of measures (developed during the workshop)
(iii) Short questionnaires applied at the second and fourth workshop days
(iv) Participation rate in the three-wave survey/information on the team sizes given by the team leaders
(v) Focus group discussions

Change process
Does the implementation trigger a process of change?
How do the triggered changes disseminate among IGLOs?
How do the triggered changes evolve over time?
(i) Transfer of workshop training and output to the team: communication, actions of workshop participants, and reactions of nonworkshop participants
(ii) Visibility of the implementation of measures to nonworkshop participants
(iii) Dynamics triggered with regard to interpersonal influences and social learning within the teams
(i) Focus group discussions

Proximate outcomes
Which effects arise immediately?
(i) Changes concerning waste of resources, efficient use of time, and collaboration(i) Focus group discussions

Intermediate outcomes
Which effects arise with regard to factual (job-related) and social (people-related) processes?
(i) Changes in the resource-demands-ratio
(ii) Changes in the interprofessional collaboration
(iii) Changes in team climate, work organisation, and supervisor behaviour
(i) Three-wave survey
(ii) Focus group discussions

Distal outcomes
Which higher-level effects evolve over time?
(i) Positive psychosocial health (engagement and satisfaction)
(ii) Negative psychosocial health (stress symptoms and negative feelings)
(i) Three-wave survey
(ii) Focus group discussions

Note. CPO: context, process, and outcome; IGLO: individual, group, leader, and organisation.