Teaching Method for Software Measurement Process Based on Gamification or Serious Games: A Systematic Review of the Literature

Table 4

Likert scale for the quality criteria. Source: adapted from [44].

Criterion	Scale
1a.	4: clearly defines the objectives and justifies the study
	3: it clearly defines the study, but the justification is not clear or fails to justify the study.
	2: fails to define the objectives, but justifies the study
	1: the definition and justification of the study are not clear.
	0: fails to define the objectives or justify the study
1b.	4: defines the type of study by referencing the methodology in the literature
	3: defines the type of study, but without any reference to the methodology
	2: does not define the type of study but can be easily inferred
	1: does not define the type of study, but can be inferred with difficulty
	0: it is not possible to infer the type of study.
2a.	4: clearly defines a section with the context of the research
	3: the research context is included in a nonexclusive section.
	2: the context of the research is dispersed throughout the text.
	1: the context of the research is dispersed and is insubstantial.
	0: the context of the research is not addressed.
2b.	4: the text includes a section of related works.
	3: the text includes related works in a nonexclusive section.
	2: the text includes related works scattered throughout the text.
	1: the text does not include any related works, but is based on the literature.
	0: the text does not include any related works nor is it based on the literature.
3a.	4: results are clearly shown in the conclusion section.
	3: results are clearly referenced in the conclusion section.
	2: results that appear in the conclusion are not clear.
	1: results referenced in the conclusion are not clear.
	0: no results found.
3b.	4: the results are completely pertinent to the objectives of the study.
	3: the results are pertinent to the objectives of the study, although the author adds some subjective comments.
	2: the results have some bearing on the objectives of the study.
	1: the results are not pertinent to the objectives of the study.
	0: no results were found.
4a.	4: a tool or approach is described in detail and validated with users.
	3: a tool or approach is described in a detailed way, but not validated.
	2: there is a tool or approach, but it is not described in detail. However, it is validated with users.
	1: there is a tool or approach, but it is not described in detail or validated.
	0: there is only a reference to a tool or no tool or approach is described.
4b.	4: the experimental method is defined and clearly referenced.
	3: the experimental method is clearly defined.
	2: the experimental method is referenced.
	1: the experimental method is not referenced, but it can be inferred.
	0: it is not possible to infer an experimental method.
5a.	4: the text describes the criteria for choosing the studies.
	3: the text does not describe the criteria for choosing the studies, but includes material that contradicts the study being carried out.
	2: the text only describes studies pertinent to the study being carried out.
	1: the text does not describe a sufficient number of studies.
	0: the text does not describe studies in the database.
6a.	4: the review protocol is outlined, described, and followed.
	3: the review protocol is outlined and described, but there is evidence that it was not followed adequately.
	2: the review protocol has not been sufficiently described.
	1: the review protocol was only cited at different stages in the text.
	0: there is no review protocol.
7a.	4: there is information about the area of action, size, and origin of the organization.
	3: there is only information about two of the features.
	2: there is only information about one of the features.
	1: there is no information about any of the features.
	0: the study was not conducted in one or more organizations.
8a.	4: it clearly defines the objectives and justifies the study.
	3: it clearly defines the study, but the justification is not clear or the study is not justified.
	2: it fails to define the objectives, but justifies the study.
	1: the definition and justification of the study are not clear.
	0: it fails to define the objectives and does not justify the study.