Abstract

Exoskeleton robot is a typical application to assist the motion of lower limbs. To make the lower extremity exoskeleton more flexible, it is necessary to identify various motion intentions of the lower limbs of the human body. Although more sEMG sensors can be used to identify more lower limb motion intention, with the increase in the number of sensors, more and more data need to be processed. In the process of human motion, the collected sEMG signal is easy to be interfered with noise. To improve the practicality of the lower extremity exoskeleton robot, this paper proposed a wavelet packet transform- (WPT-) based sliding window difference average filtering feature extract algorithm and the unscented Kalman neural network (UKFNN) recognition algorithm. We established an sEMG energy feature model, using a sliding window difference average filtering method to suppress noise interference and extracted stable feature values and using UKF filtering to optimize the neural network weights to improve the adaptability and accuracy of the recognition model. In this paper, we collected the sEMG signals of three muscles to identify six lower limb motion intentions. The average accuracy of 94.83% is proposed in this paper. Experiments show that the algorithm improves the accuracy and anti-interference of motion intention recognition of lower limb sEMG signals. The algorithm is superior to the backpropagation neural network (BPNN) recognition algorithm in the lower limb motion intention recognition and proves the effectiveness, novelty, and reliability of the method in this paper.

1. Introduction

Surface electromyography (sEMG) signals are bioelectrical signals recorded from the surface of the muscle through the electrode. It has the advantages of mature acquisition technology, high temporal resolution, and noninvasive recording [13]. In addition to some significant achievements in medical rehabilitation training, relevant research applications have gradually developed into a wider range of lower limb motion assist areas [4]. The most common lower extremity exoskeleton robots currently include HAL exoskeleton robot [5], MIT exoskeleton system [6], BLEEX lower limb exoskeleton [7], and NTULEE exoskeleton system [8]. The robot can walk horizontally, but it has few motion intention and low flexibility. Therefore, identifying more lower limb motion intention is beneficial to improve flexibility and practicability. It can also enhance the user’s athletic ability and improve people’s quality of life.

Most of the current research is based on sEMG signals to identify multiple motion intentions in the lower extremities. Coelho and Lima extracted eight channels of sEMG signals to identify seven motion intentions for the lower extremities [9]. Toledo-Pérez et al. collected sEMG signals from four muscles of the lower extremities and identified ankle dorsiflexion and flexion [10]. Al‐Quraishi et al. extracted the sEMG signal from the four muscles of the lower extremities and identified four motion intentions of the lower extremity ankle joint [7]. Tang et al. collected three channels of sEMG signals and identified three intentions of standing, flexing, and stretching [11]. Ma et al. collected sEMG signals of the rectus femoris (RF), semimembrane (SM), and the sphincter (SR) and identified two intentions of walking and obstacle crossing [12]. Li et al. recorded the sEMG signals of seven muscles of the lower extremities and recognized two motion intentions of the hip and knee joints of the lower extremities [13]. Ai et al. combined acceleration and sEMG signals to identify five motion intentions of the lower extremities [14]. To identify the lower extremity knee, ankle, and hip joint motions, Tapia et al. extracted sEMG signals from sixteen muscles of the lower extremities [15]. Zhang et al. extracted single channel sEMG signals for four motion intention recognition of lower limb knee joints [16]. These studies did not simultaneously consider accuracy, stability, and real-time. Therefore, we proposed a method of using three electromyographic sensors to recognize six kinds of lower limb motion intention.

The process of lower limb motion intention recognition mainly includes feature extraction and motion recognition. For example, some researchers used RMS [17, 18], mean absolute value (MAV) [19], autoregressive (AR) [20], variance, and Willison amplitude method to extract surface muscle electrical signal features [21, 22]. Some researchers used peak frequency and median frequency analysis [23, 24] to convert sEMG signals to the frequency domain and extracted sEMG features.

However, the sEMG signal is easily disturbed by static electricity, muscle fatigue, and friction factors. Traditional feature analysis methods cannot accurately describe the time-varying process and spectrum distribution of the sEMG signal, which leads to low reliability of feature extraction. WPT is a common time-frequency analysis method, which can reflect the energy distribution of the sEMG signal in each frequency band [25]. Gokgoz et al. used the WPT method to extract time-frequency information of myoelectric signals and diagnosed the lower limb neuromuscular diseases. Chen et al. proposed a wavelet packet of local energy (ELF) method to accurately describe the complexity in the local frequency band of myoelectric signals [26]. Ji et al. used discrete wavelet transform to construct a time-invariant multiscale matrix based on wavelet transform coefficients to identify eight motion intentions of lower limbs [27]. However, due to noise interference, the feature extracted by the wavelet packet cannot accurately describe the motion intention of lower limbs. Therefore, we proposed a sliding window differential average filtering method, analyzing the feature extracted by wavelet packet transform, suppressing noise interference, and extracting effective feature vector.

In the part of the lower extremity motion intent recognition, SEMG signal has complex nonlinear, strong coupling, and dynamic time-varying features [28]. In the aspect of motion intention recognition, researchers mainly studied the Bayesian network, neural network, multilayer perceptron, fuzzy approximation, support vector machine, and neural fuzzy system identification method [29, 30]. Neural network has strong nonlinear approximation ability and the ability to deal with unknown internal mechanism problems [3133]. However, the neural network model needs iterative learning in the training process [34], the convergence speed is slow, and the real-time performance needs to be improved [35, 36]. The sEMG signal is susceptible to external environmental influences during the acquisition process, such as sweating, muscle fatigue, electrode offset, and power frequency noise [37, 38]. The neural network model lacks stability when the environment changes. Therefore, we proposed an unscented Kalman neural network (UKFNN) method for lower extremity motion intention recognition. We used the UKF method [39, 40] to train the weight of the neural network to enhance the adaptive ability of the recognition model [41]. Our method improves the reliability, accuracy, and speed of the model.

We extracted sEMG signals from three channels and used the WPT method to extract features. We proposed a sliding window difference averaging filtering method to analyze the time-frequency domain feature, suppress noise interference, and extracted effective feature information. We constructed a UKFNN recognition model to recognize six lower limb motion intentions. Also, we compared the proposed recognition algorithm with the error backpropagation neural network (BPNN) recognition method [42] and evaluated the recognition accuracy of UKFNN.

This paper is structured as follows. The second part described the acquisition of myoelectric signals. The third part introduced the extraction method of sEMG signal features and explained the basic principle of the wavelet packet transform. Also, we proposed a feature analysis method for sliding window difference averaging filtering. The fourth part introduced the design of the UKFNN model. The fifth part gave the experimental results and compared them with the traditional BPNN method. The sixth part gives conclusions and future work.

2. sEMG Acquisition

Surface electromyography is recorded from the surface of human skeletal muscle through surface electromyography electrodes and contains many feature information related to limb motion. By analyzing these features, we can distinguish the different motion intentions of the limbs. Our goal is to use three sensors to identify six lower extremity motion intentions. We chose six common motion intentions of lower limbs, such as horizontal walking (HW), crossing obstacles (CO), standing up (SU), downstairs (DS), go-upstairs (GU), and stop-rest (SR). We analyzed the kinematics and biological features of lower limb muscles [43, 44]. The medial gastrocnemius (mg) is helpful for walking and running. The femoral muscle (VL) and the semitendinosus (ST) have the function of flexing the knee joint and stretching the hip joint [45]. Therefore, we selected three muscles as the source of sEMG signal acquisition initially, as shown in Figure 1.

We used three sEMG sensors to identify six lower limb motion intentions. The six motion intentions were HW, CO, SU, DS, GU, and SR, as shown in Figure 2.

We used the RMS method to calculate the changing trend of the sEMG signal of three muscles in six motion intentions, as shown in Figure 3.

It can be seen that the selected three muscles have obvious signal changes during the motion of the lower limbs. The changing trend of sEMG signals in three channels of a motion mode is the same. However, the trend of sEMG signal changes in six motion intentions is different. This is helpful to distinguish different motion intentions and further verifies the correctness of the selection of sEMG signal acquisition location.

We used the sEMG sensor developed by Biometrics, UK. The sampling frequency is 2000 Hz, and the input impedance of the amplifier is more than 10,000,000 m ohms. High-quality signals can be obtained without adding conductive adhesive to the skin. Simply attach the electrode strip to the three muscles using medical double-sided tape and record the surface myoelectric signal. The experimental computing platform processor is Intel(R) Core(TM) i7-9750H CPU@ 2.60 GHz, the memory is 16G, and the data analysis software is Matlab, 2015b.

We selected five healthy subjects to participate in the experiment, five men aged 23, 23, 25, 26, and 24 years, with a body fat rate of 17 ± 3% and a height of 170 ± 5 cm. Healthy subjects circulate in the form of “relaxation-motion-relaxation” for each motion, completing six motion intentions. Each motion is limited to two seconds. We collected sEMG signals from six intentions of lower extremity motions per subject.

3. sEMG Feature Extraction Method

The acquired sEMG signals have nonperiodic, nonstationary, and nonlinear chaotic features. We need to extract stable eigenvectors from myoelectric signals. Therefore, this paper used the wavelet packet transform analysis method, to describe the complex sEMG signal by an energy method. We proposed a sliding window difference average filtering method which can suppress the noise interference and extract the effective sEMG eigenvector.

(1)The research shows [26] that the sEMG signal should be decomposed into three layers. The decomposition structure is shown in Figure 4.(2)We used wavelet decomposition coefficients to reconstruct the signal and analyzed all nodes in the third layer. The raw signal can be restored to(3)Define wavelet packet energy as , the coefficients of wavelet packet decomposition as , and the constructed feature vector as :where represents the scale and represents the node.(4)Normalizing the energy of eight nodes:

3.1. Wavelet Packet Transform

The energy value of WPT can represent the changing trend of complex sEMG signals. The steps of the wavelet packet energy feature extraction algorithm are as follows.

3.2. Mother Wave Function Selection

Selecting different wavelet packet basis functions will get different eigenvalues, which will directly affect the recognition accuracy of lower limb motion intention. It is very important to select the appropriate basis function for extracting features. The energy feature values obtained by the wavelet packet transform should contain enough information on the raw signal to ensure the recognition accuracy. The larger the wavelet coefficient is, the similar the base function waveform is to the raw signal. Hence, selecting a basis function with high similarity to the raw signal contributes to the extraction of features. As shown in Figure 5, the raw signal is nonstationary and nonperiodic, with strong tightness.

We observed the wavelet packet basis function waveform in Figure 6. We can see the waveforms of sym3, sym5, cmor1-1.5, and the waveform of the myoelectric signal are different, and local performance is poor. The Harr wavelet is not continuous in the time domain and is not suitable for sEMG signal feature extraction. The attenuation rate of db8, db10, coif3, and fk22 is slow. It is easy to ignore the small change information in the raw sEMG signal [46]. The waveform of the dmey wavelet is similar to the raw sEMG signal, which has strong compactness and fast attenuation performance. Therefore, using the dmey wavelet to extract feature values is beneficial to improve the recognition accuracy of motion intention.

To extract the raw signal features of sEMG accurately, the wavelet packet basis function is with the maximum energy value in all motions. As shown in Figure 7, the average energy value of the dmey wavelet packet basis function is the highest, which further verifies the correctness of the wavelet packet basis function selection.

3.3. sEMG Feature Selection

At present, most studies choose the maximum absolute value of wavelet coefficients as the eigenvector of sEMG signals [25, 26]. However, in different motion intentions, the amplitude of the sEMG signal on the same muscle is different. Choosing wavelet coefficients as eigenvalues cannot accurately reflect the motion intention. We used the wavelet packet to decompose the sEMG signal, normalizing the complex sEMG signal to different frequency bands, and analyzed the energy values of the projection sequences in each band. We used a three-layer wavelet packet to decompose the sEMG signal of the gastrocnemius, as shown in Figure 8. Also, we calculated the sEMG signal energy eigenvalues of three muscles in six motions, as shown in Table 1.

Observing the wavelet packet energy values of each node in Table 1, we analyzed the energy distribution of six motion intentions of the same muscle and the energy distribution of three muscles in the same motion mode. It can be concluded that the energy values of , , , and are significantly different from those of other frequency bands, as shown in Figure 9. Therefore, we chose four subband energy values as eigenvectors. The eigenvector for each motion is twelve dimensions. We have extracted the 12-dimensional eigenvectors and built a feature model to analyze the eigenvectors, as shown in Figure 10.

Considering that sEMG signals are susceptible to noise interference during motion, such as sweating, friction, and electrode deflection, as shown in Figure 11, the sEMG signals of different muscles fluctuate aperiodically [37, 38].

We have built a feature model containing the interfering signals, as shown in Figure 12.

It can be seen from Figure 12 that the feature model of different motion intentions including interference signals is a periodic signal. But they have different peaks and troughs in the same period. We calculated the eigenvector to suppress the interference of noise. As shown in Figure 13, we set the width of the sliding window as M = 2 and the sliding step size as D = 4. Get three window feature values. We calculated the difference between the maximum value and the minimum value of the energy feature in each window and calculated the average values of the three differences.

We calculated and analyzed the difference average for each motion, as shown in Table 2.

Through the proposed sliding window difference average filtering algorithm, we calculated the eigenvalue in Figure 12 and analyzed the results of different noise interferences, as shown in Table 3. Therefore, we can set a threshold. If the difference average of eigenvalues is greater than 90, it can be judged that the sEMG is interfered with noise. We extracted feature vector by judging the threshold and removed the disturbing feature vector.

Our proposed sliding window difference average filtering method suppresses the interference of noise and extracts a stable feature vector. The 12-dimensional feature vector filtered by the sliding window difference average can be the input of the UKFNN to improve the reliability of the recognition model.

4. Recognition Using UKFNN

In the lower limb motion intent recognition algorithm, because the neural network has a strong nonlinear fitting ability, it is widely used in the modeling and optimization of the motion intention recognition process [33]. However, the lower limb sEMG signal has complex nonlinearity, strong coupling, and dynamic time-varying features during motion. The signal is susceptible to noise such as sweating, electrode offset, and power frequency interference [37, 38]. This leads to a lack of stability in the neural network model. Using UKF filtering for neural network learning can enhance the adaptive ability of the model and raise the accuracy of the model. Especially when the number of samples is increasing, it can speed up the convergence of the model [40]. Therefore, we used the UKFNN algorithm [41, 4749] to recognize the motion intention of lower limbs. We used the UKF algorithm to optimize the weight of the neural network, which can adapt to noise interference.

As shown in Figure 14, the UKFNN structure is a three-layer neural network.

The input of UKFNN is an N-dimensional eigenvector, and the input in Figure 14 is defined as :

The output of the UKFNN network in Figure 14 is defined as :

We calculated the number of intermediate layers in Figure 14 from the following equation:where represents the number of network input nodes. The extracted sEMG signal feature vector is , where represents the six motion intention output prediction results of the lower limbs and is a constant greater than 1 and less than 10.

We used the UKF filtering algorithm to correct the three-layer neural network connection weights. The input to the neural network is , constructing the state equation of the UKF filtering algorithm with the weight of the neural network. The output of the neural network is taken as its measurement equation. Therefore, the state equation and measurement equation of the UKF algorithm are as follows:where is the weight, is the input vector, is the output of the neural network, and is the transfer function of the neural network. And are the input noise and measurement noise of the neural network. All obey the mean value of 0, and the variance is the normal distribution of .

5. Experiment Results and Discussion

In the process of extracting the features of the sEMG signal on the lower limb surface, we used the WPT algorithm and selected the best mother wave to extract the sEMG signal features. We analyzed the obtained distribution of features and determined the eigenvectors as , , , and . We established a feature model for different motion intentions, as shown in Figure 10. Considering that during the motion of the lower limbs of the human body, the sEMG signal will be affected by noise. The extracted features containing noise interference are different from the features in the motion, as shown in Figure 12. Therefore, this paper proposed a sliding window difference averaging filtering method, verifying the feature model to extract stable eigenvectors, as shown in Figure 13.

In the recognition of lower limb motion intention, this paper designed the UKFNN algorithm, using the UKF filtering algorithm to establish a neural network state-space model and measurement model, optimizing the neural network weight vector, and solving the problem that the neural network has slow convergence speed and poor adaptability to noise interference in the model training process.

This paper constructed a 3-layer neural network, as shown in Figure 14. The input is a twelve-dimensional eigenvector, and the output is the predicted result of six motion intentions. The transfer function selected by the hidden layer is a nonlinear unipolar excitation function as . The output layer transfer function selected a linear function as , which can output an arbitrary value. The number of middle layer neurons is calculated by formula (7) to be 5 ≤  ≤ 14. Then, we verified through experiments that the number of middle-tier nodes is 14. The dimension of the UKFNN algorithm weight variable is 183.

We collected 600 sets of samples and divided that into training sets and testing sets, respectively, 480 sets and 120 sets. Both training sets and testing sets contain six motion data for five subjects. We trained the model with 480 sets of data. We selected each subject’s own 24 testing sets to verify the accuracy of six lower extremity motion intention. We verified a total of five subjects. The lower limb motion recognition accuracy was defined as the ratio of the number of correct recognition results of each move to the number of corresponding motion in the testing sets. The recognition accuracy is shown in Figure 15. The average accuracy of the UKFNN model is 94.83%. The average accuracy of the BPNN model is 90.8%. The minimum accuracy of the UKFNN model is 91.33%, and the accuracy of the BPNN model is 88.16%. It is concluded that the average accuracy of the UKFNN model is higher than the BPNN model.

Also, robustness is one of the important parameters to evaluate the performance of the algorithm, so we calculated the standard deviation based on the results of Figure 15 as an evaluation of robustness. As can be seen from Table 4, UKFNN is more robust than BPNN.

To graphically describe the distribution of the accuracy, a box plot is drawn, as shown in Figure 16. According to Figure 16, the accuracy rate of the UKFNN is higher than that of the BPNN, and the dispersion of the UKFNN is smaller than that of the BPNN.

Tables 5 and 6 show the results of motion intention recognition accuracy of the UKFNN model and the BPNN model for five subjects with six lower limb motion intentions.

In the UKFNN algorithm, the highest average accuracy is the go-upstairs (GU) motion, with 97.8%. The lowest average accuracy is stop-rest (SR) motion, with 88.8%. In the BPNN algorithm, the highest average accuracy is the go-upstairs (GU) motion, with 94.6%. The lowest average accuracy is horizontal walking (HW) motion, with 87%. Experiments show that the accuracy of the UKFNN model is more stable than the BPNN model.

Besides, the anti-interference of the model is an important factor affecting the control performance of the lower extremity exoskeleton. Considering that the sEMG signal is susceptible to noise interference, we tested the collected noise sEMG signals (interference 1, interference 2, and interference 3) and verified the ability of the UKFNN model to track sEMG signals. As shown in Figure 17, under different interference conditions, the UKFNN model can still track the change of features in real-time.

We calculated the root mean square error of the model as metrics to evaluate the reliability of the model, as shown in Table 7. It is proved that the UKFNN model has a stronger anti-interference ability than the BPNN model.

We found that different numbers of sEMG signal feature samples affect the motion intention recognition accuracy and real-time. We collected another 600 sets of data for testing and using different numbers of testing samples, namely, 100, 200, 400, and 600 samples, to test the UKFNN model and the BPNN model. The result is shown in Table 8.

It is proved that the samples increase and the accuracy of the BPNN and the UKFNN model will also increase. In the process of sample size change, the UKFNN model has higher accuracy, stability, and real-time performance than the BPNN model.

When the user is wearing the lower extremity exoskeleton, it is necessary to avoid the wrong recognition of human motion intention by the lower extremity exoskeleton robots. The confusion matrix is an important evaluation method of model accuracy and reliability. It can count the number of errors in the model recognition results and the correct number and also can analyze the correlation between different motion intentions of the lower limbs. In this paper, 400 sets of testing samples are selected to calculate the confusion matrix of six lower limb motion intentions and verified the accuracy of the method. Table 9 is the confusion matrix of the UKFNN model. The stop-rest (SR) motion intention has the lowest accuracy (88.8%). It is easy to misjudge the down-stairs (DS) motion intention, and the false-positive rate is 5.1%. Table 10 is the confusion matrix of the BPNN model. The horizontal walking (HW) motion intention has the lowest average accuracy (87%). It is easy to misjudge the motion intention of go-upstairs (GU), and the false-positive rate is 6.5%.

We selected 600 testing sets to verify the sensitivity of the model. Table 11 shows the sensitivity metrics of the UKFNN model and the BPNN model. The UKFNN model has a higher sensitivity. It is proved that the UKFNN model has a lower false-positive rate, and accuracy and reliability are better than the BPNN model.

We used three myoelectric sensors to identify the six motion intentions of the lower extremities. Also, we compared the results of previous studies to demonstrate the advancement of our recognition algorithm, as shown in Table 12. In these studies, most researchers used more sEMG sensors to identify more lower extremity motions. It can be seen from Table 12 that at least four muscle sEMG signals need to be acquired to identify five lower limb motion intentions. However, we only need three sensors to identify six lower limb motion intentions, and the accuracy reaches 94.83%.

6. Conclusion

We proposed a lower limb motion recognition method based on improved WPT and UKFNN. We analyzed the distribution of features and established a feature model. And we proposed a sliding window difference averaging filtering method to verify the eigenvalues and suppressed the interference of noise. Then, we used UKF filtering to optimize the neural network weights to improve the adaptability and accuracy of the recognition model, and we used the UKFNN model to identify the six motion intentions of the lower limbs. The results showed that the method has achieved good results and the average accuracy was 94.83%. Through the noise interference tests, it was verified that the model has the anti-interference ability. Also, under the fluctuation of the sample size, the UKFNN model has achieved better results in recognition accuracy and real-time performance. Also, the confusion matrix calculated that the UFKNN model has a low false-positive rate and the performance was better than the BPNN model. It showed that the method was advanced, reliable, and practical. Therefore, our proposed new method was suitable for the recognition of complex motion intentions of lower limbs. It is beneficial to realize the wide application of the exoskeleton robots to assist the lower limb motion. In the next step, the paper will increase the types of lower limb motion intention recognition, improving the recognition accuracy of lower limb motion intention.

Data Availability

The data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare that there are no conflicts of interest.

Authors’ Contributions

P.Q. did conceptualization and methodology. X.S. administered the project.

Acknowledgments

Special thanks are due to Jiaqing Zhu and Maqiang Zhai for the support provided in preparing the experiments. This work was supported by Projects U1613226 and U1813217 supported by NSFC, China, and Project 2019-INT009 from the Shenzhen Institute of Artificial Intelligence and Robotics for Society.