Review Article

Usability Evaluation of Dashboards: A Systematic Literature Review of Tools

Table 3

Usability evaluation criteria for dashboards.

CriteriaSubcriteriaQuestionnaire

Usefulness(i) Perform tasks more effectively using dashboards
(ii) The effectiveness of the information displayed by the dashboard in completing the tasks of users
(iii) Better control of activities and improvement of job performance
(iv) Perform tasks faster using the dashboard
(v) Dashboard has been designed to maximize efficiency
Health-ITUES
PSSUQ
CSUQ
TAM
Operability(i) Displaying the level of details of data using a hierarchical structure
(ii) Report formats should include relevant data dimensions. Easy to identify, select, and view data dimensions
(iii) Data should be accessible at different levels of aggregation. Visibility and availability of filters applied to the data
(iv) The speed of system recovery when the user makes a mistake
(v) User control
DATUS
Learnability(i) Easy to learn
(ii) The speed of learning to use the dashboard
(iii) Clarity of information (such as online help and on-screen messages)
(iv) Comprehensibility of the information displayed by the dashboard
QUIS
Ease of use(i) Easy to use dashboard to perform tasks
(ii) Use the dashboard without needing help or guidance from others
(iii) It is easy to find the required information in the dashboard
EUCS
Health-ITUES
TAM
Suitability for tasks(i) Ability to support users’ daily activities
(ii) Fit and organize the information on the screen to the user’s tasks
(iii) Compatibility and organization of information on the screen with the user’s tasks
(iv) The possibility of setting the way of displaying software outputs (reports) with user tasks
DATUS
Improving situational awareness(i) Instability representation
(ii) Complexity representation
(iii) Variability representation
(iv) Arousal support
(v) Concentration support
(vi) Spare mental capacity support
(vii) Division of attention
SART
Satisfaction(i) Overall satisfaction in using the dashboard
(ii) Feel comfortable using the dashboard
(iii) Satisfaction with the dashboard user interface
(iv) Satisfaction with dashboard features and capabilities
QUIS
User interface(i) Visualization tools(i) Color coding
(ii) Data visualization: histogram plot, pie chart, bar graphs, gauges, data table, geographic maps
DATUS
PSSUQ
(ii) Interaction(i) Overview, zoom, filter, details-on-demand, control level of details, redo/undo, navigation and querying, data set reduction, customizable, drill up, and drill downDATUS
PSSUQ
CSUQ
Content(i) Information quantity provided(i) The quantity of information is appropriate for performing tasksSART
EUCS
(ii) Information quality provided(i) Quality of information: accuracy, up-to-date, comprehensive, relevantSART
PSSUQ
CSUQ
System capabilities(i) Having all the functions and features expected by users
(ii) Having the right speed
(iii) Integration of all expected functions in the system
QUIS