Abstract
Because of its high research value, action recognition has become a very popular research direction in recent years. However, the research on the combination of motion recognition technology and dance movements is still in its infancy. At the same time, due to the high complexity of dance movements and the problems of human body self-occlusion when performing dances, research on dance video action recognition has been caused. Progress is relatively slow. This article mainly introduces the research of sports dance action recognition system oriented to human motion monitoring and sensing, fully considers the abovementioned problems, and makes in-depth research and analysis on the current excellent action recognition research content in this field. This paper proposes a research method of sports dance movement recognition for human movement monitoring and sensing, including sports dance movement classification algorithm and sports dance movement preprocessing algorithm, which is used to conduct research experiments on sports dance movement recognition for human movement monitoring and sensing. The experimental results of this article show that the average recognition accuracy of the sports dance action recognition system for human motion monitoring and sensing is 92%, which can be used in daily sports dance training and competition.
1. Introduction
As a new sports project that has evolved and developed in recent centuries, sports dance combines a variety of artistic features, such as clothing, music, dance, and sports. In the existing sports dance training process, dancers usually watch videos repeatedly or seek corrective guidance from coaches to achieve the purpose of training. This not only consumes a lot of time and energy but also brings certain difficulties and challenges to learners.
Under the background of the continuous development of science and technology, human movement-oriented monitoring and sensing technology is gradually applied to sports dance and other fields, so that the majority of dance teaching workers, dancers, and dance learners who have strong needs in teaching and self-study can make accurate adjustments to the dance movements that are not standardized enough to ensure the accuracy of dance positions in training. Trainers can find their own rhythm and sense of rhythm through training and can also promote the further development of digital and basic dance training and other dance learning information.
Gorman et al. studied the relationship between the perception of human actions and the influence of social psychological resources. According to the resource and perception model, it tested and analyzed the common influence of subjective threats and buffer threats to social psychological resources. Two experiments tested whether social threats (i.e., rejection) and psychosocial resources affect the perception of human movement. The observer tries to recognize the movement of the person in the fuzzy point light display after being repelled or not repelled. In addition, the observer tries to measure trait resources (self-esteem plus social support) and manipulate self-affirmation. One of the studies shows that rejection will reduce the sensitivity of detecting human movement, but not for people with rich feature resources. Another study replicated this interaction between rejection phenomena and traits. These studies show that the basic visual skills for detecting human movements are affected by social threats and psychosocial resources. The correlation between the research elements is not strong, and the practicality is weak [1]. Geng et al.’s research found that in the real-time health monitoring, they believe that even a subset of available radio frequency functions can provide acceptable classification rates, which can be achieved by making the proposed scheme easier to reduce computational costs. This research is a research on human motion recognition technology for firefighters, and it is not targeted [2]. Chinnadurai and Sridharan found that in recent years, the concept of deep learning has been used to research image processing and machine learning applications. In order to monitor a specific person, Chinnadurai and Sridharan applied a set of image processing steps in the motion area containing the moving object, applied convolutional neural network classifiers with different levels in the selected area, and learned tools in Google TensorFlow used. In the experiment, shaking videos and low-resolution videos were considered and the video dataset was checked. This research process is cumbersome [3].
The innovations of this paper are as follows: (1) propose a classification algorithm using support vector machine model (SVM) as an action recognition method; (2) propose the hardware design of a sports dance action recognition system; and (3) design a sports dance action and identify the software of the system.
2. Method of Sports Dance Movement Recognition Oriented to Human Motion Monitoring and Sensing
2.1. Sports Dance Movement Classification Algorithm
This article will use the support vector machine model (SVM) as the classification algorithm of the action recognition method. Support vector machine is a new type of machine learning method based on statistical learning theory and structural risk minimization criteria, and it is also a major achievement of machine learning research in recent years [4]. It finds the global optimal solution from the limited sample information. It not only has the descriptive ability to accurately describe the training sample but also has the learning ability to identify any test sample without error [5]. In this case [6, 7], using the function that satisfies the Mercer condition as the inner product operation of the two sample features is equivalent to mapping the sample from the original feature space to a new feature space [8].
The following formula exists [9, 10]: with respect to and , and make them equal to zero [11]. where is under the constraint condition [12, 13]:
A dual problem has an optimal solution [14]. The solution of this optimization problem must satisfy the following condition:
The model is represented by the number of support vectors [15].
The function from the original feature space to a new feature space [16] was used.
2.2. Sports Dance Movement Preprocessing Algorithm
Sports dance moves contain a lot of noise when recognizing and transforming, and these noises will affect the edge features of dance video images [17]. Therefore, we need to perform preprocessing operations on the dance dataset first [18]. The preprocessing operations in this paper include background subtraction and median filtering operations. Background subtraction is used to extract the foreground to separate the human action area, and the median filtering operation is used to filter out the noise in the image to reduce the impact on edge features [19, 20].
2.2.1. Background Subtraction
Regarding background subtraction, the Gaussian mixture model method is adopted, and the video image sequence is regarded as a combination of multiple single Gaussian models. The model maintains a multidistributed density function for each pixel in the image. The video image sequence is usually described as the pixel probability distribution function [21].
Assuming that the value of a certain pixel at time is , the probability of occurrence of has the following formula:
Among them, is the weight of the th Gaussian distribution at time , and is the corresponding probability density function [22, 23]. The specific manifestation of is
And their weights are assigned the same value [24].
Assuming that the value of a pixel in a newly input image is , the following formula can be used to determine whether the pixel matches the established Gaussian distribution:
2.2.2. Median Filter
The specific process of median filtering is as follows: (1)First, move the template in the image, and move the center of the template to coincide with the center pixel of the image [25](2)Get the gray value of all pixels under the template(3)Sort the gray values of all pixels obtained from the template in an ascending order(4)Calculate the median of all gray values after the arrangement [26]
The specific process is shown in Figure 1.
3. Experiment of Sports Dance Action Recognition System Oriented to Human Motion Monitoring and Sensing
3.1. Hardware Design of Sports Dance Action Recognition System
3.1.1. System Hardware Architecture
The data acquisition module is used to collect information related to the human body state in real time and provides three-axis acceleration and three-axis angular velocity data for the sports dance action recognition system [27]. It is the data basis of the sports dance action recognition system, so the performance of the entire wearable human body motion state perception system is observed. The pros and cons all depend on the design part of the data acquisition module.
The main composition of the hardware of this system is composed of two parts: data acquisition of sensors and Bluetooth radio frequency. The sensor part is mainly composed of six-axis sensor MPU6050 and air pressure temperature sensor BMP180. The Bluetooth chip uses TI’s CC2541. MPU6050 and BMP180 are connected to CC2541 through I2C bus and transmit the collected data to the Bluetooth chip. The Bluetooth chip transmits the collected data through the ceramic antenna on the board.
3.1.2. Motion Sensor Chip MPU6050
The main function of the data acquisition module is to comprehensively collect the acceleration signal and angular velocity signal when the human body moves, so when choosing the sensor chip, give priority to the three-axis accelerometer and the three-axis gyroscope. Based on the above considerations, the sports dance action recognition system designed in this article chooses the MPU6050 motion sensor chip introduced by InvenSense. The MPU6050 motion sensor chip is the world’s first integrated 6-axis motion processing chip. It integrates a 3-axis gyroscope and a 3-axis accelerator into a chip with only a millimeter package. It reduces the size of the space that originally required two motion sensor chips to achieve and greatly reduces the space on the PCB circuit board.
3.1.3. Bluetooth 4.0 Wireless Module
The Bluetooth 4.0 wireless module is composed of the core chip TI’s CC2541 and its related circuits.
3.2. Software Design of Sports Dance Action Recognition System
3.2.1. C# Development Language and Its Development Environment
The main content of this paper is to realize the recognition of sports dancers’ human movements in a stable environment. Therefore, it is necessary to choose a stable and powerful development environment as the software platform. Due to the powerful functions of Microsoft Visual Studio 2010 and good human-computer interaction, we choose this development environment as the software development platform of this system.
3.2.2. Software Hierarchy and Functions
The human body motion recognition system software for sports dancers designed in this paper adopts a three-layer structure, namely, user layer, business logic layer, and device layer.
The user layer is responsible for displaying the results of the data to users in the form of charts, data, and graphs and accepting user settings and feedback information.
The business logic layer is designed to store, process, and analyze the three-axis acceleration and gyroscope data after receiving the data transmitted by the node.
The device layer is mainly responsible for wireless network interface and communication and works with the upper layer to maintain reasonable and effective network routing and to set the current network topology and protocol.
3.2.3. Using MATLAB’s Engine Technology
MATLAB’s engine function library is a collection of a series of programs provided by MATLAB, allowing users to call MATLAB in their own C language programs, using MATLAB as a calculation engine, and let it run in the background. Its task is to complete complex matrix operations and simplify the user programming task of the front desk. When the MATLAB engine is started, it is equivalent to starting another process in the background. The MATLAB engine function acts as a bridge between the user application and the MATLAB engine. It completes the exchange of data and the transmission of commands between the two. The three interface functions PutFullMatrixO, ExecuteO, and GetFullMatrix() are mainly used here. These three functions are the three member functions of MLAppClass, so we first need to add the COM application “MatlabApplication (version 7.7) Type Library” to instantiate the engine object, then use its interface for programming. Among the above three functions, PutFullMatrix and GetFullMatrix realize the functions of adding matrix to MATLAB Server and reading matrix from MATLAB Server, and Execute realizes the function of running script.
The specific function form is as follows: matlab. PutFullMatrix(“P”,“Base”,TrainIn,ImIn); matlab. GetFullMatrix(“R”, “Base”,TrainOut,ImOut); matlab.
Specific process is shown in Table 1.
4. Sports Dance Action Recognition for Human Motion Monitoring and Sensing
4.1. Preliminary Work Analysis of Action Recognition
(1)Before performing action recognition on sports dancers, first, classify and analyze the dance movements of sports dancers according to the relevant opinions of professionals. As shown in Table 2 and Figure 2, the average represents the evaluation of the importance of the indicator by professionals, and the coefficient of variation reflects the degree of dispersion of the evaluation of an indicator by professionals
It can be seen from the chart that among the secondary indicators, the coefficients of variation of “crossdance step,” “lock step,” “flicking,” and “inhibition” are all greater than 0.40. Experts have disputes over these indicators. It is believed that “lock step” steps are mostly locked rotation. It is recommended to adjust the name of the index to “lock turn” and move the item to the first-level index “rotation,” while doing “crossdance step” and “flick step.” The technical link of the index action is not based on mobile technology, but more includes reflexive action position and body rotation. In addition, the first-level index “linear movement” cannot accurately cover the above three second-level index types of actions, so consider adding a level. The indicator “connection category” and the “crossdance step category”, “flicking category,” and “inhibition category” are included under it, as the secondary indicators of the primary indicator “connection category.” (2)Ask the dancers about their willingness to apply the sports dance action recognition system to the training process, as shown in Table 3 and Figure 3
According to the data, 90.25% of the dancers are very willing to use the system, 7.75% do not care whether they use the system or not, and only 2.00% are reluctant to use the system. Among them, the difference between male and female dancers is small.
4.2. Performance Analysis of Sports Dance Action Recognition
(1)Experiment with the algorithm [28] and three features of this paper in the four groups of dance combinations on the FolkDance dance dataset, and count and organize the relevant results, as shown in Table 4 and Figure 4
From the experimental results shown in the chart, it can be seen that the recognition rate of dance movements for each single feature in each group is still relatively low. It can be seen from the table that the action feature extraction method in this paper has the highest recognition and extraction rate for modeling actions and other unique dance steps, which are 55.47% and 56.19%, respectively; the recognition rate for linear movement dance steps is 49.76%; for rotating dance steps. The recognition extraction rate is 52.32%; the average recognition rate is about 53.44%. (2)In the experiment process, the effect of action recognition in the above database is observed. At the same time, the recognition effect of the combination of 3D-SIFT and optical flow is better than the combination of RGB and optical flow. The different feature recognition effects are shown in Table 5 and Figure 5
The recognition rate is the highest when the combination of human body regions is used, and the whole body region is directly recognized. (3)Sports dance is a dance type with a larger opening and closing of movements, and dancers often fall down during training. A protective activation mechanism can be added to the recognition of sports dance movements. The system will automatically send a signal to the team doctor when the dancer falls or has a sports injury, so that the doctor can rush to treat the dancer in time. This article carried out related experiments, and the experimental results recorded the correct identification, underreporting, and false alarming of falls. Among them, correct recognition means correct recognition of the fall and its direction; false negative means that the experimenter did not recognize the fall behavior after the fall. We made a detailed record of the entire experiment process, and the experimental statistical results are shown in Table 6 and Figure 6
It can be seen from the chart that the accuracy of the algorithm proposed in this paper for the recognition of falling behaviors has reached more than 85%, and the average recognition accuracy is 92%. There was very little underreporting during the whole experiment. (4)This paper implements a GM-based recognition method on the segmented action pattern sets of CityU. For each set of experiments, we selected samples collected by 3 of the captured persons as the training set, and the other two samples are used as a test sample. The recognition accuracy rates of GM-based DTW and LCS on the segmented action pattern sets on the CityU and HDM05 datasets are shown in Table 7 and Figure 7
But it has the lowest recognition accuracy on the HDM05 dataset. This is because the HDM05 dataset has more significant time domains than the CityU dataset, through its own penalty mechanism, unlike DTW, which uses repeated E matching for longer samples in the middle frame, which is extremely easily brings overfitting problems.
5. Conclusions
Sports dance is a sport which includes standard dance and Latin dance. It has gone through three stages: folk dance, standard dance, and competitive dance. Less than a century ago, it has triggered a global upsurge of sports dance and competitive sports dance. In the 1930s, it was introduced into China in the form of social dance. At present, four international dance sports organizations, including the world sports dance federation, the World Dance Federation, the Royal Association of dance teachers, and the International Association of dance teachers, are committed to the development and popularization of dance sport in the world.
Motion capture technology is used to track the motion of some or all joints of the human body or animal through video devices, motion sensors, and other devices and measure the motion information of joints, so as to provide reference data for gait recognition and video production. This technology has been widely used in film and television production, interactive games, virtual reality, and personnel training. In order to better correct the movement of sports dancers and to have accurate training, the motion capture recognition technology is introduced into the design of sports dance action recognition system.
This paper designs the hardware part and software part of the system. The software part includes data acquisition, data processing, and auxiliary training. In the data acquisition part, the standard dance movements are input into the system, and the standard human dance posture database is established. The data processing part repairs the occluded joint points and restores the human skeleton structure. The auxiliary training part is divided into two parts, which are based on the joint point position and the joint angle. The system has the effect of assisting training. It mainly provides real suggestions for the trainer’s training through data analysis, and the suggester can make reasonable adjustments based on the suggestions. The experimental results show that the system can effectively improve the dance level of trainers.
Data Availability
No data were used to support the study.
Disclosure
We confirm that the content of the manuscript has not been published or submitted for publication elsewhere.
Conflicts of Interest
There are no potential competing interests in our paper.
Authors’ Contributions
All authors have seen the manuscript and approved its submission.
Acknowledgments
This work was supported by the Heilongjiang provincial basic scientific research business expenses in school undergraduate course colleges and universities cooperation projects (135409510) and Heilongjiang provincial undergraduate college basic scientific research business expenses project (Heilongjiang and brand cultivation of ice and snow sports cultural industry development stage results).