A Comparison of Field-Based and Lab-Based Experiments to Evaluate User Experience of Personalised Mobile Devices

Table 1

The overall user experience assessment for each task.

Task	Friedman (3 related samples)	Multiple paired comparisons [23, page 180], (𝛼=.05)
Checking match schedules	𝜒^2(2) = 31.3; 𝑃<.001	𝑁=18, 𝑅Personalized−𝑅Nonpersonalized = 21.5, >Z =14.36*; 𝑁=18, 𝑅Personalized−𝑅paper = 29.5, >Z =14.36*; 𝑁=18, 𝑅Nonpersonalized−𝑅paper = 8, <Z =14.36
Obtaining player information	𝜒^2(2) = 34; 𝑃<.001	𝑁=18, 𝑅Personalized−𝑅Nonpersonalized = 17, >Z = 14.36*; 𝑁=18, 𝑅Personalized−𝑅paper = 34, >Z =14.36*; 𝑁=18, 𝑅Nonpersonalized−𝑅paper = 17, >Z =14.36*
Reviewing match progress	𝜒^2(2) = 30.6; 𝑃<.001	𝑁=18, 𝑅Personalized−𝑅Nonpersonalized = 16.5, >Z = 14.36*; 𝑁=18, 𝑅Personalized−𝑅paper = 33, >Z =14.36*; 𝑁=18, 𝑅Nonpersonalized−𝑅paper = 16.5, >Z =14.36*
Building a community	𝜒^2(2) = 32.1; 𝑃<.001	𝑁=18, 𝑅Personalized−𝑅Nonpersonalized = 17, >Z = 14.36*; 𝑁=18, 𝑅Personalized−𝑅paper = 34, >Z =14.36*; 𝑁=18, 𝑅Nonpersonalized−𝑅paper = 17, >Z =14.36*

*Indicates a significant difference.