Research Article

Combinations of Methods for Collaborative Evaluation of the Usability of Interactive Software Systems

Table 4

Description of the metrics to consider in the analysis of the CUEM.

MetricDescriptionInterpretation

Characteristic: detection of usability issues
Total number of identified issues (TII)This metric is the total amount of usability issues identified in the evaluated system.The more usability issues are identified; the metric value is closer to 1.
Number of critical issues (NCI)This metric corresponds to the number of critical issues identified in the evaluated system.The more critical issues are identified; the metric value is closer to 1.
Number of frequent issues (NFI)This metric corresponds to the number of frequent issues identified in the evaluated system.The more frequent issues are detected; the metric value is closer to 1.

Characteristic: time
Time required to complete the planning phase (TPP)This metric corresponds to the time taken to perform the activities that constitute the planning phase.The less time used to perform the activities of the planning stage, the better.
It must be defined: TPPc = 1 – TPP, to define relation: less (time) – more (value).
Time required to complete the implementation phase (TIP)This metric corresponds to the time taken to perform the activities that constitute the implementation phase.The less time used to perform the activities of the implementation phase, the better.
It must be defined: TIPc = 1 – TIP, to define relation: less (time) – more (value).
Time required to complete the analysis of results phase (TAP)This metric is the time taken to complete the analysis of results phase.The less time used to analyze the results, the better.
It must be defined: TAPc = 1 – TAP, to define relation: less (time) – more (value).