Gamification Assisted Language Learning for Japanese Language Using Expert Point Cloud Recognizer
Starting from people limitations to understand Japanese, education and social life of those people in Japan can be hindered. Therefore, a game is needed that allows one to understand Japanese using Gamification Assisted Language Learning (GALL) method, involving the introduction of Japanese language implementation using expert point cloud ($EP) recognizer. This method is used to stimulate the sensory and motor nervous system and motivate students (players) to study harder. This can be evidenced by increase in players ability from 20% to 100%.
Gamification emerged in the late 1960 . Because researchers see the effectiveness of gamification use, it has become a major highlight since the early 2010 . Gamification is a method to implement by which a boring activity is converted into a fun activity, to attract interest and attention and motivate and improve performance in certain activities. It is widely used in the fields of education, economics, social studies, culture, politics, health, business ecology, and many more related fields [3–8].
In general, gamification changes person’s perception of nongame activity into games . In this case, the game can also serve to stimulate different sensory and motor systems for each person , so as to enhance person’s understanding and memory . Then it can activate the brain cells as one of its functions can improve the ability of person language [12, 13]. Human intuitive theories explain the development of brain cells in the game because one can explain the world of the game, analyze some examples, and generate counterfactual thinking and produce effective plans .
On the other hand, some countries use language as one of the main conditions for continuing education and obtaining citizenship and residence . In a study conducted by  on language education policy in China, Indonesia, Japan, the Philippines, and Vietnam, one of the countries that rejected internal linguistic diversity was Japan. It is governed by the myth of Japanese identity monoethnicity that is largely derived from the assimilation of Japanese norms that reinforce a monolingual as well as monoculture ideal of the Japanese state itself. Then at the Meiji restoration in 1868 began an educational revolution, where foreign language was the focus of education in Japan.
Currently, according to statistics from Japan Student Service Organization (JASSO) through articles written in Student Guide to Japan 2016/2017, the value of production per person (Gross Domestic Product) is the 3rd highest in the world, and Japan ranks the 7th in the world and number 1 in Asia because 24 Japanese nationals received Nobel prizes in 2016. These things make more and more people interested in continuing education in Japan, which can be seen from the data of 2011-2016: the number of international students is increasing (see Figure 1); then data as of May 1, 2016, explains that the number of international students continuing their education in Japan is 239287 people and that dominates from Asia, that is, 222627 people (see Figure 1) . If viewed statistically from a survey conducted by JASSO, by 2016 the number of Indonesian international students is ranked 6th after Taiwan (see Table 1) [18, 19].
Along with the increase of international students, Japan is also the 6th most popular country with many devotees to continue education. On the other hand, the increasing number of international students and the popularity of the country resulted in various problems and challenges that must be faced. According to , one of the factors which is a common problem often found against international students in Japan is the language skills. Of the 100 international students studying in Japan, 81% say that Japanese is hard to understand . Based on these results, preferably before continuing education to Japan, prospective students must learn Japanese first, so as to facilitate life in Japan, and students who are interested in continuing education in Japan are easier to be accepted in schools or universities in destination (schools or universities that have the main terms of Japanese as a language of daily learning).
In the process of learning, Japanese has several elements that must be considered: the letters (moji), vocabulary (goi), and grammar (bunpo). One of the first elements to be learned in Japanese is to memorize letters such as hiragana, katakana, and kanji, because Japanese letters model is different from the alphabetic language in general . In fact, it is quite difficult to memorize Japanese because of its form and complex writing. Therefore, many researchers are comparing several methods of learning Japanese language so that someone better understand the language.
One of the learning models is conventional or using textbooks. In general, conventional Japanese learning makes it difficult for a person to understand the material given . Ref.  said that Japanese language learning methods that use multimedia elements can attract motivation and encourage someone to continue learning Japanese to understand the use of the grammar. Meanwhile, the problem when using multimedia elements is that the learner focuses more on the effects raised of the multimedia elements provided instead of focusing on Japanese content, such as graphics, animation, or other multimedia elements. Therefore, gamification is made using Japanese as the most important part of the game.
In its implementation, this educational game uses point cloud ($P) recognizer algorithm developed by , because the $P recognizer has fast computing and high accuracy. On the other hand, the weakness of the algorithm is that it can only detect the result of the pattern that has been made, so it cannot detect the process of making it. Then the algorithm is developed again into expert point cloud ($EP) recognizer for the player who can learn to write Japanese well and truly.
2. Related Work
2.1. Game Development Live Cycle (GDLC)
The main stages in game development are design, prototype, production, and testing. Based on research conducted by [9, 24], GDLC has several processes, scilicet, initiation, preproduction, production, testing, beta, and release done iteratively to enable flexibility during the development process, resulting in good game quality. The quality can be measured from 5 criteria, namely, fun, functional, balanced, internally, and accessible.
2.2. Computer-Assisted Language Learning (CALL)
CALL was born in the 1960s. Fundamentals of CALL framework are always doing mutual relationship between development, implementation, and evaluation so that CALL can always evolve . Then in the evaluation several considerations are involved; that is,(i)Can users understand what the application is doing?(ii)What kind of content of the lesson that is created is compatible with current technological interactions? For example, in terms of reading, writing, or listening.(iii)How well are the design elements with understanding of user?
According to  in general CALL is used audiolingually, where the students listen to a recording and then learner is asked to retell the recorded tape by saying or typing an answer that has been programmed by computer. Then in 2016 CALL was developed using game. The game has a Role-Playing Game Simulators gameplay (RPG Sims), where the inference gained by the game can be used to facilitate learning Japanese language, as it produces fairly good learning outcomes, and RPG Sims has a high potential to motivate learners too .
Once reviewed, game still adopts the conventional way of learning and then converts to digital. Things that become attraction or how to motivate learners to learn can be developed again by making the learning content as the main game content. Then according to , computer studies need to analyze linguistic input from learners to detect errors and provide corrective feedback and have contextual instructional guidance.
2.3. $-Family Recognizer
Unistroke ($1) Recognizer is a 2D gesture recognizer algorithm designed to read patterns quickly. As the name implies, $1 algorithm can only be used to read a single pattern (stroke) or it can be said to have 2 permutations [23, 29]. Characteristics of the $1 algorithm are rotation invariant and size invariant. Rotation invariant is a pattern formed by slope of angle created by user; if it is in accordance with the order of formation of the same pattern, it will produce same reading. Subsequently size invariant is a pattern formed with a certain size created by the user, where reading is done by adjusting the size of the data created, resulting in same reading. Here is the complexity algorithm of $1:
Multistroke ($N) Recognizer is an algorithm that reads more than one pattern (stroke) but uses a lot of memory resulting in a slow process, because of the permutation of each stroke . Here is the complexity algorithm of $N:
Because this algorithm produces a slow process, the point cloud recognizer algorithm is developed.
Point Cloud ($P) Recognizer is to optimize the $N algorithm that reads a pattern based on a stroke made; then $P is based on the relationship between the points so it does not require permutation or the number of patterns does not affect the complexity level of the algorithm. This algorithm produces accuracy above 99% and the process is faster than $N .
Characteristics possessed by the $P algorithm are the size invariant and direction invariant. The size invariant of $P equals $1, while the direction invariant is a pattern formed in a different order that will produce the same reading, if pattern is formed according to existing datasets. Here is the complexity algorithm of $P:The explanation of the $-Family algorithm can be seen in Table 2.
2.4. Game Experience
Game experience is judged based on emotion, thought, reaction, and behavior from players because it is influenced by the functionality, content, service, player affinity, and value of the player, where there are some elements that become benchmarks, namely, user interface (UI), user experience (UX), gameplay experience (GX), and game balancing. That matter will be evaluated using game experience questionnaire.
The benchmark adopts research undertaken by. [30–38], specifically,(i)User Interface (UI)(1)Usability: UI can be said to be usable when all features work properly and have informative feedback.(2)Consistent: UI can be said to be consistent when an event used is also used elsewhere with the same model, thereby reducing short-term memory.(ii)User Experience (UX)(1)Useful: UX can be said to be useful if it can meet basic needs of player or game has benefits for player.(2)Usable: UX can be said to be usable if it can be used efficiently and easily learned.(3)Desirable: UX can be said to be desirable if it can contribute to user satisfaction by having a design with attractive aesthetic value.(iii)Gameplay Experience (GX)
Based on research , there are 2 main factors that can be formed through cognitive and affective person, namely, beliefs and feelings, which are derived from a combination that is expected by someone to an object where it becomes something fun for player. Then besides fun,  adds a review for gamification where the content contained therein is worthy of studying (see Figure 2).(iv)Game Balancing(1)Game is fair: every action taken has an appropriate impact on the game. Any success and failure experienced by player can be understood rationally.(2)Different skill levels: this is needed to determine the satisfaction of players, where there are challenges that have different levels of difficulty in every quest faced.
3. Propose Method
3.1. Gamification Assisted Language Learning (GALL)
In general, the process of CALL is to change the learning of language conventionally to digital. When collaborated with gamifications, these high potentials can be maximized, since gamification has the following elements:(i)Like games, the main requirement of gamification is to make a person feel happy and satisfied, and there are intrinsic elements of the contribution of knowledge in it.(ii)Have goals to achieve.(iii)Limiting game with the rules that apply to achieve the goal.(iv)Provide information about progress of achievements that have been made to achieve the objectives.(v)Have psychological elements to motivate players. Ref.  says there are 6 principal perspectives on motivation that closely relate to gamification, namely, trait perspective, behavioral learning perspective, cognitive perspective, perspective of self-determination, perspective of interest, and perspective of emotion.
Because Computer Assisted Language Learning (CALL) can be developed into Gamification Assisted Language Learning (GALL), GALL can maximize player interest to learn compared to CALL.
3.2. Datasets Japanese Language
Before recognizing Japanese writing required datasets are used as a measuring tool for the assessment standards of the games to be used as learning. These datasets are created by projecting the initial process of line formation to produce the final form of a point, where the datasets are stored in the xml format containing the position (x, y) of the writing. As seen in Figure 3, for example, this research has canvas of 5 × 5 and letter written is Ku. The letter is cut in accordance with the existing coordinates and then processed with the resample algorithm of $1 and $P where $1 each scratch generates 64 points with the same distance between points and $P each letter produces 32 points with the same distance between points. Visualization of datasets model made can be seen in Tables 3 and 4. The table describes the correct sequence of writing and the number of strokes contained in the Japanese language.
3.3. Expert Point Cloud ($EP)
Generally, the $-Family Recognizer has a deficiency of reading a pattern based on the results that have been formed, not based on the manufacturing process. To learn Japanese, the process of writing the letter is very important, because the pattern of writing symbolizes the balance and neatness of writing someone; therefore a method is required that can read the process of making Japanese from beginning to end.
To accomplish this, the $P algorithm was developed again into an expert point cloud ($EP) recognizer, where the algorithm used is a combination and modification of expert system methods, unistroke ($1) recognizer from  and point cloud ($P) recognizer from .
Expert systems are used to make Japanese recognition systems sequentially, so that writing procedure from beginning to end can be properly written (see Tables 3 and 4). Subsequently, to detect every stroke (striation), $1 algorithm is used by doing resample, rotation, scale, and translation. After all strokes formed into letter, the $P algorithm is used to detect writing as a whole, by doing greedy cloud match, resample, scale, and translation. Examples of model illustrations of $1 and $P modified to form $EP can be seen in Figures 4–7 and explanation of the algorithm can be seen in Tables 5–11. Subsequently, overall algorithm flow can be seen in Figure 8.
3.3.1. Unistroke ($1) Recognizer Algorithm Model
The following are stages of $1 algorithm:
(1) Resample. Based on the illustration of Figure 4, step (a) describes the player being asked to create a Japanese letter; then systematically input from the player is processed to find out whether language is true or not. Letter processing starts from step (b); step (b) explains that the input made by player will change to N point in accordance with the coordinates of writing. After that at step (c) the calculation of the distance is done between the points until all points passed all and the results can be seen in step (d). Step (e) describes N-th distance divided into 64 points. Here is the formula used in the resample stages:(a)Formula for calculating the average distance:(b)For each point, if then the following equation is used: Subsequently if then the following equation is used: If then the following equation is used:
(2) Rotation. In this step, Figure 5 describes step (a) where the midpoint of the writing is processed by resample. Then in step (b) withdrawal line is done from the midpoint to starting point of writing, after that the angle of is determined. In step (c) a rotation is performed on the x-axis until θ reaches angle of 00. This matter is done so that writing can still be detected even though writing canvas is upside down. Here is the formula used in the rotation stages:(a)Formula to determine the midpoint:(b)Formula for determining angular tilt:(c)Formula for rotation:
(3) Scale. In this step, scaling is performed to determine the equalization of the large or small size of inputs made to existing datasets. Initially, there is formation of a bounding box by drawing line perpendicularly from the coordinates of min (x, y) and max (x, y) so as to form a box that has coordinates (min x, max y), (max x, max y), (minx, min y), and (max x, min y) (see Figure 6). Then, bounding box of player posts compared to datasets. If bounding box player is not the same as bounding box dataset, then calculation is done using the following formula:
(4) Translation. At this step is the determination of center point of writing player and datasets, so that center point of both writing models is in position . It means writing of player coincides with writing of datasets. Then look for all difference distance between point of player and dataset (see Figure 7). Here is formula used in the translation stages:(a)Formula to determine center point of writing:(b)Formula to determine average distance between points:
(5) Score. Calculation accuracy of ratio is calculated from 0 to 1 with the following formula:
3.3.2. Point Cloud Recognizer ($P) Algorithm Model
In $P algorithm steps taken are not much different from $1; for the resample stage, the scale and translation remain the same as $1, which distinguishes it is the N-distance calculation which is divided into 32 points and calculated using greedy cloud match and $P algorithm does not have a rotation.
Greedy which is conducted by $P is looking for minimum distance that is compared between input player and datasets. In greedy usage there is distance calculation using cloud distance. Cloud distance uses variable weight to determine level of accuracy of a comparison. If a point in input player is paired to the nearest datasets point, then weight variable will decrease. Here is the formula used for calculation of variable weight:In addition, within cloud distance there is an Euclidean distance that is used for distance calculation at point cloud. Here is formula used for calculating distance of point cloud:
3.3.3. Score Final Expert Point Cloud ($EP) Recognizer
For assessment of overall accuracy, the following formula is used.
If stroke = 1 then the following equation is used:If stroke > 1 then the following equation is used:
$EP algorithm is used as the standardization of writing of language performed, since the input of the player will be compared with datasets that have been created, where it will affect accuracy of assessment.
4. Results and Discussion
In created RPG game, the battle system is lifted using turn based and has an active time battle (ATB), where, when the battle is done, the player and enemy alternately attack in accordance with the ATB that has been determined. Then to attack the player must write the Japanese language correctly, and damage is obtained by enemy in accordance with the accuracy of the writing.
In general, order of Japanese writing system can be seen in Figure 8. That figure explains the process of making datasets with algorithm process that runs up to get the accuracy of the writing player.
Then, after the game has been made, the game experience evaluation and pretest and posttest are given to 150 players to see players ability improvement, where there are 2 player categories: 46 players have learned Japanese and 104 player never learned Japanese. Test is done by asking player to make all the letters contained in Tables 3 and 4 along with the romaji.
On the other hand, to conduct game experience evaluation, a game experience questionnaire (GEQ) is made below:(1)Are the features in this game is running well?(a)Yes (100%)(b)No (0%)(2)Whether in-game display of buttons, portals, and all displays on each screen with the same model can make it easier to remember the function of interface used?(a)Yes (100%)(b)No (0%)(3)Do tutorial and help feature can help you in playing?(a)Yes (100%)(b)No (0%)(4)Is the system in the game easy to learn?(a)Yes (100%)(b)No (0%)(5)How do you think about aesthetics are displayed in this game?(a)Attractive (97%)(b)Not attractive (3%)(6)Does game you have played help you understand Japanese?(a)Yes (100%)(b)No (0%)(7)How do you think difficulty level of the game after played?(a)Appropriate (100%)(b)Not appropriate (0%)(8)Whether achievements and punishments provided matches the effort you are providing?(a)Appropriate (100%)(b)Not appropriate (0%)(9)Is overall learning content provided worthy to be learn?(a)Worth learning (100%)(b)Not worth learning (0%)(10)How do you think a game you have played?(a)Fun (100%)(b)Not fun (0%)
From GEQ it can be concluded that conditions found in the game experience have been met. For aesthetic problems, it is a matter of taste of player, because the developer cannot force someone to like aesthetics of the game made.
Before performing GEQ do pretest and posttest, where pretest is done before playing and posttest is done after playing, in which case player is asked to play for one week. Here are pretest results with 150 players: 10 players answered all questions correctly, 36 players answered with an average of 30%-50% wrong answers, and 104 players did not answer end answer but all wrong answers.
Subsequently, here are posttest results from the same person with pretest: there are 10 players who answered all the answers correctly (same player with pretest) and 134 people answered the correct average answer of 20%-100 %, while 6 players answered questions with all wrong answers.
Inference of this research is as follows:(i)Japanese datasets are based on expert knowledge.(ii)Currently $-Family has a new family of Expert Point Cloud Recognizer ($EP).(iii)RPG game battle system using turn-based and ATB plus attack system using $EP can attract players to learn to write Japanese.(iv)A game that is made already meets rules of game experience.(v)Increased ability of a person is based on the capability of the person, because everyone has different capabilities. It can be said that the more diligent a person is to learn, the more science is absorbed.(vi)A good game is a game that makes player feel happy to play it and unknowingly player can understand the science implicit in it.(vii)Overall GALL in a matter of a week can increase players ability from 20% to 100%.
The data I sent is the same as in the paper.
Conflicts of Interest
The author declares that there are no conflicts of interest.
C. J. Costa, M. Aparicio, and I. M. S. Nova, “Gamification: Software Usage Ecology,” Online Journal of Science and Technology, vol. 8, no. 1, 2018.View at: Google Scholar
Yanfi, Y. Udjaja, and A. C. Sari, “A Gamification Interactive Typing for Primary School Visually Impaired Children in Indonesia,” Procedia Computer Science, vol. 116, pp. 638–644, 2017.View at: Google Scholar
F. E. Gunawan, A. Maryanto, Y. Udjaja, S. Candra, and B. Soewito, “Improvement of E-learning quality by means of a recommendation system,” in Proceedings of the 11th International Conference on Knowledge, Information and Creativity Support Systems, KICSS 2016, Indonesia, November 2016.View at: Google Scholar
M. E. D. M. Pérez, A. P. Guzmán Duque, and L. C. F. García, “Game-based learning: Increasing the logical-mathematical, naturalistic, and linguistic learning levels of primary school students,” Journal of New Approaches in Educational Research, vol. 7, no. 1, pp. 31–39, 2018.View at: Publisher Site | Google Scholar
P. A. Tsividis, T. Pouncy, J. L. Xu, J. B. Tenenbaum, and S. J. Gershman, “Human learning in Atari,” in Proceedings of the 2017 AAAI Spring Symposium Series, Science of Intelligence: Computational Principles of Natural and Artificial Intelligence, 2017.View at: Google Scholar
E. Shohamy, Critical language testing, Language Testing and Assessment, 2017.
JASSO, “Student Guide to Japan 2017-2018,” 2017, http://www.jasso.go.jp/en/study_j/__icsFiles/afieldfile/2017/05/22/sgtj_2017_e.pdf.View at: Google Scholar
JASSO, “International Students in Japan 2016,” 2017, http://www.jasso.go.jp/en/about/statistics/intl_student/__icsFiles/afieldfile/2017/03/29/data16_brief_e.pdf.View at: Google Scholar
JASSO, “Student Guide to Japan 2016-2017,” 2017, http://www.jasso.go.jp/id/study_j/__icsFiles/afieldfile/2016/11/30/sgtj_2016_id_2.pdf.View at: Google Scholar
J. S. Lee, “Challenges of international students in a Japanese university: Ethnographic perspectives,” Journal of International Students , vol. 7, no. 1, pp. 73–93, 2017.View at: Google Scholar
M. C. Chan, Multimedia Courseware for Learning Japanese Language Level 1 [Ph.D. thesis], UTAR, 2016.
R.-D. Vatavu, L. Anthony, and J. O. Wobbrock, “Gestures as point clouds: A $p recognizer for user interface prototypes,” in Proceedings of the 14th ACM International Conference on Multimodal Interaction, ICMI 2012, pp. 273–280, USA, October 2012.View at: Google Scholar
R. Ramadan and Y. Widyani, “Game development life cycle guidelines,” in Proceedings of the 2013 5th International Conference on Advanced Computer Science and Information Systems, ICACSIS 2013, pp. 95–100, Indonesia, September 2013.View at: Google Scholar
P. Hubbard, “Foundaton of Computer-Assisted Language Learning,” 2017, https://web.stanford.edu/~efs/callcourse2/CALL1.htm.View at: Google Scholar
N. Gunduz, “Computer assisted language learning,” Journal of Language and Linguistic Studies, vol. 1, no. 2, 2005.View at: Google Scholar
J. O. Wobbrock, A. D. Wilson, and Y. Li, “Gestures without libraries, toolkits or training: A $1 recognizer for user interface prototypes,” in Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology, UIST 2007, pp. 159–168, USA, October 2007.View at: Google Scholar
S. Kim, K. Song, B. Lockee, and J. Burton, Gamification in Learning and Education, Springer International Publishing, Cham, 2018.View at: Publisher Site
E. Adams, Fundamentals of game design, Pearson Education, 2014.
E. C. Contreras and I. I. Contreras, “Development of Communication Skills through Auditory Training Software in Special Education,” in Encyclopedia of Information Science and Technology, pp. 2431–2441, IGI Global, 4th edition, 2018.View at: Google Scholar
D. Lightbown, Designing the user experience of game development tools, CRC Press, 2015.
M. Kors, E. D. Van der, Spek., and B. A. Schouten, “A Foundation for the Persuasive Gameplay Experience,” FDG, 2015.View at: Google Scholar
H. Joo, “A Study on Understanding of UI and UX, and Understanding of Design According to User Interface Change,” International Journal of Applied Engineering Research, vol. 12, no. 20, pp. 9931–9935, 2017.View at: Google Scholar
Y. Udjaja, V. S. Guizot, and N. Chandra, “Gamification for Elementary Mathematics Learning in Indonesia,” International Journal of Electrical and Computer Engineering (IJECE), vol. 8, no. 6, 2018.View at: Google Scholar
M. Sailer, J. Hense, H. Mandl, and M. Klevers, “Psychological Perspectives on Motivation through Gamification,” Psychological Perspectives on Motivation through Gamification, vol. 19, pp. 28–37, 2013.View at: Google Scholar