Review Article

Usability Evaluation of Dashboards: A Systematic Literature Review of Tools

Table 2

Characteristics of the questionnaires.

Questionnaire nameNumber of questions; scoringSubscalesGR

TAM [2529]15; 5-point Likert scale (“strongly disagree” to “strongly agree”)(i) Perceived ease of use
(ii) Perceived usefulness
(i) 0.98 (usefulness)
(ii) 0.94 for (ease of use)
UTAUT [26, 30]21; 7-point Likert scale (“strongly disagree” to “strongly agree”)(i) Mechanical ease of use
(ii) Cognitive ease of use
(iii) Emotional difficulty
(iv) Decision-aiding effectiveness
0.91
SUS [3140]10; 5-point Likert scale (“strongly disagree” to “strongly agree”)0.91
SART [34, 41, 42]10; 7-point Likert scale (“strongly disagree” to “strongly agree”)(i) Instability representation
(ii) Complexity representation
(iii) Variability representation
 (a) Arousal support
 (b) Concentration support
 (c) Spare mental capacity support
 (d) Division of attention
 (e) Information quantity
 (f) Information quality
 (g) Familiarity with dashboard
0.92
Health-ITUES [27, 34, 43]20; 5-point Likert scale (“strongly agree” to “strongly disagree”) and N/A(i) Quality of work life
(ii) Perceived usefulness
(iii) Perceived ease of use
(iv) User control
0.81 to 0.95
PSSUQ [32]19; 7-point Likert scale (“strongly agree” to “strongly disagree”) and N/A(i) System usefulness
(ii) Information quality
(iii) Interface quality
0.96
QUIS [35, 44]27; 10-point Likert scale (several adjectives positioned from negative to positive) and N/A(i) Overall reaction to the software
(ii) Screen
(iii) Terminology and system information
(iv) Learning
(v) System capabilities
0.94
CSUQ [45]19; 7-point Likert scale (“strongly agree” to “strongly disagree”) and N/A(i) System usefulness
(ii) Information quality
(iii) Interface quality
0.95
EUCS [46]12; 5-point Likert scale (“very strong” to “very dissatisfied”) and N/A(i) Accuracy
(ii) Content
(iii) Ease of use
(iv) Format
(v) Timeliness
0.95
DATUS [47]20; 7-point Likert scale (“strongly agree” to “strongly disagree”) and N/A(i) Effectiveness
(ii) Efficiency
(iii) Satisfaction
(iv) Learnability
(v) Accessibility
(vi) Appropriate recognizability
(vii) User interface aesthetics
(viii) Operability
NR
Batley et al. [48]8; 5-point Likert scale (“strongly agree” to “strongly disagree”) and N/ANR
Hertzum [49]21; 7-point Likert scale (“strongly agree” to “strongly disagree”) and N/ANR
Pickering et al. [50]10; 5-point Likert scale (“strongly agree” to “strongly disagree”) and N/A0.87 to 0.91
Tan et al. [51]12; 5-point Likert scale (“strongly agree” to “strongly disagree”) and N/A(i) Overall user satisfaction
(ii) Usage frequency
(iii) System quality (e.g., speed, ease of use, and stability)
(iv) System information quality (e.g., accuracy and relevancy of data)
(v) Impact on work efficiency
(vi) Impact on care quality (e.g., effectiveness and safety)
NR
Lai et al. [52]15; 5-point Likert scale (“strongly agree” to “strongly disagree”) and N/A0.87 to 0.91

TAM: Technology Acceptance Model; UTAUT: Unified Theory of Acceptance and Use of Technology; SUS: System Usability Scale; SART: Situation Awareness Rating Technique; Health-ITUES: Health Information Technology Usability Evaluation Scale; PSSUQ: Post-Study System Usability Questionnaire; QUIS: Questionnaire for User Interaction Satisfaction; CSUQ: Computer System Usability Questionnaire; EUCS: End-User Computing Satisfaction Model; DATUS: Dashboard Assessment Usability Model; GR: Global Reliability; NR: not reported.