Identification of Visual Imagery by Electroencephalography Based on Empirical Mode Decomposition and an Autoregressive Model

Fu, Yunfa; Li, Zhaoyang; Gong, Anmin; Qian, Qian; Su, Lei; Zhao, Lei

doi:https://doi.org/10.1155/2022/1038901

Computational Intelligence and Neuroscience

On this page

Abstract Introduction Methods Results Discussion Conclusions Data Availability Conflicts of Interest Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2022 | Article ID 1038901 | https://doi.org/10.1155/2022/1038901

Identification of Visual Imagery by Electroencephalography Based on Empirical Mode Decomposition and an Autoregressive Model

Yunfa Fu,^1,2Zhaoyang Li,¹Anmin Gong,³Qian Qian,^1,2Lei Su,^1,2and Lei Zhao^2,4

Academic Editor: António Dourado

Received20 Oct 2021

Revised15 Dec 2021

Accepted12 Jan 2022

Published30 Jan 2022

Abstract

The traditional imagery task for brain–computer interfaces (BCIs) consists of motor imagery (MI) in which subjects are instructed to imagine moving certain parts of their body. This kind of imagery task is difficult for subjects. In this study, we used a less studied yet more easily performed type of mental imagery—visual imagery (VI)—in which subjects are instructed to visualize a picture in their brain to implement a BCI. In this study, 18 subjects were recruited and instructed to observe one of two visual-cued pictures (one was static, while the other was moving) and then imagine the cued picture in each trial. Simultaneously, electroencephalography (EEG) signals were collected. Hilbert–Huang Transform (HHT), autoregressive (AR) models, and a combination of empirical mode decomposition (EMD) and AR were used to extract features, respectively. A support vector machine (SVM) was used to classify the two kinds of VI tasks. The average, highest, and lowest classification accuracies of HHT were 68.14 3.06%, 78.33%, and 53.3%, respectively. The values of the AR model were 56.29 2.73%, 71.67%, and 30%, respectively. The values obtained by the combination of the EMD and the AR model were 78.40 2.07%, 87%, and 48.33%, respectively. The results indicate that multiple VI tasks were separable based on EEG and that the combination of EMD and an AR model used in VI feature extraction was better than an HHT or AR model alone. Our work may provide ideas for the construction of a new online VI-BCI.

1. Introduction

Brain–computer interfaces (BCIs) represent revolutionary human–computer interactions that aim to bypass peripheral nerves and muscles of the spinal cord and neuromusculature to realize direct communication and control between brains and the outside world. This technology is expected to provide an alternative new communication or control method for patients with severe movement disabilities or for healthy people with ad hoc needs for BCIs.

BCIs based on imagery represent an important type of BCI [1]. The traditional imagery task is motor imagery (MI) [2, 3], which requires subjects to imagine moving a certain part of their body from a first-person perspective [4, 5]. MI is difficult for subjects and requires a certain amount of training, and approximately 20% of individuals are incapable of MI [6]. Hence, MI may not be the best mental task for controlling BCIs [1]. Compared with the properties of MI, visual imagery (VI) is another mental-imagery task that is easier to complete, and it consists of instructing subjects to visualize a picture clearly in their brain from a third-person perspective [4]. Such mental-imagery activity usually does not require training or only requires a small amount of training. However, compared to the number of studies on MI-BCIs, much less research has been conducted on VI-BCIs. Therefore, there is a need for more research on VI-BCIs.

Currently, VI-BCI studies [1, 4, 7–9] exhibit continued issues with VI task design, as indicated by results revealing a lack of significant differences between different VI tasks, which may make it difficult to distinguish electroencephalography (EEG) characteristics induced by differentially designed VI tasks. Compared with the selection and execution of MI tasks, VI tasks are widely selected and consist of any picture or scene from daily life. For example, Kosmyna et al. [1] chose a flower and a hammer as VI tasks, with an average classification accuracy of 52%. This result may be because the VI tasks that were selected were all static, resulting in poor separability of evoked EEG signals. Azmy and Safri [7] analyzed the maximum power difference between EEGs during the resting state and a VI task (i.e., imagining a star rotating clockwise), which showed that there was no significant difference between the two states; unfortunately, the classification accuracy was not reported. Neuper et al. [4] measured EEGs during resting states and while subjects were instructed to imagine their hands in a VI task, which yielded an average classification accuracy of 56%. Koizumi et al. [8] used EEG to classify VI tasks of an unmanned aerial vehicle (UAV) moving in three planes (up/down, left/right, and front/back), with an average classification accuracy of 84.6% in prefrontal cortex. Sousa et al. [9] used EEG to classify three types of VI tasks: static points, dynamic points moving vertically in the up and down directions, and dynamic points moving vertically in the up, down, left, and right directions; this study yielded an average classification accuracy of 87.64%. Collectively, the above static VI task designs led to poor separability of evoked EEG signals, whereas use of a combination of moving VI tasks led to better separability of evoked EEG signals. Hence, the aim of this study was to combine static VI tasks (static pictures of visual imagery) and moving VI tasks (dynamic pictures of visual imagery), with the hypothesis that the EEG characteristics induced by these two different VI tasks would be separable.

In addition, the classification accuracies resulting from the feature-extraction methods used by previous VI-BCI studies could be improved [1, 4, 8, 9]. Kosmyna et al. [1] extracted power-spectrum features of EEG signals related to two VI tasks—flower and hammer—using a classifier based on spectrally weighted common spatial patterns, which yielded a low classification accuracy (52%). Neuper et al. [4] extracted frequency-band features of EEG signals related to two VI tasks, hand movement, and resting state, using a classifier based on distinction-sensitive learning vector quantization, which yielded a low-average classification accuracy (56%). Koizumi et al. [8] extracted power-spectral density features of the frequency bands of EEG signals related to three types of VI tasks and used a classifier based on a support vector machine (SVM), which yielded a moderate classification accuracy of 84.6%. Sousa et al. [9] extracted power-spectrum energy features of EEG signals related to three types of VI tasks and used an SVM classifier, which yielded a moderate classification accuracy of 87.64%. In contrast to these previous studies, our study used a combination of moving and static VI tasks to determine the resultant classification accuracies based on Hilbert–Huang Transform (HHT), autoregressive (AR) models, a combination method of empirical mode decomposition (EMD) and AR models for feature extraction, and an SVM for classification.

EMD has been used in HHT. HHT is an effective time–frequency analysis method for nonlinear and nonstationary signals [10]. Considering the nonlinear and nonstationary characteristics of EEG signals, some research has applied HHT to MI-BCIs, which has yielded promising results [11–14]. Some research also used the improved algorithm for empirical mode decomposition to classify motor imagery or other types of EEG signals such as epilepsy or depth of anesthesia [15–18]. However, this method has not yet been used in VI-BCIs. The AR model is a method for time-series analysis, and it has been used in MI-BCIs [19, 20]. AR model parameters gather important information, and studies have shown that the autoregressive parameters of AR model are most sensitive to state-dependent changes [21–23]. Therefore, autoregressive parameters of the AR model have been used as eigenvectors to represent EEG changes related to the state of subjects, which has yielded promising results [19, 20]. A combination of the EMD and the AR model is commonly used in mechanical fault diagnosis [24–26]. Zhang et al. investigate feature extraction of electroencephalogram (EEG) based emotional data by focusing on empirical mode decomposition (EMD) and autoregressive (AR) model to classify those emotional states. This combination has also yielded promising results [27]. It first uses EMD to decompose nonlinear nonstationary signals to obtain stable intrinsic mode function (IMF) components and then establishes the AR model for each IMF component. However, the combination of the EMD and the AR model has not been used for EEG feature extraction and classification verification of VI. Therefore, our study evaluated the HHT, the AR model, and a combination of the EMD and the AR model for their efficacies in classification accuracies of a novel VI-BCI paradigm.

2. Methods

2.1. Subjects, Visual Imagery Tasks, Time Sequences, Trials, and Experimental Settings

2.1.1. Subjects

Eighteen right-handed subjects (male, 24–28 years old) participated in this study. All subjects had no perceptual or cognitive impairments, and their vision was either normal or corrected to normal via corrective lenses. Each subject signed an informed consent before the experiment.

2.1.2. Visual Imagery Tasks

Previous VI-BCI studies that have used static pictures as mental tasks have resulted in poor separability of EEG characteristics [1]. In contrast, studies that have used MI as mental tasks have yielded separable characteristics of evoked EEGs. In this study, we used static-picture VI and moving-picture VI as mental task pairs. It is assumed that these two types of VI tasks can induce significantly different EEG characteristics. In our study, one VI task consisted of visually imagining a star with a static picture, while the other VI task involved visually imaging a star moving to the right, as shown in Figure 1.

(a)

(b)

2.1.3. The Time Sequence and Process of Each Trial

The time sequence of a trial is shown in Figure 2. The subjects were required to first conduct a visual observation and then imagine a cued picture. When t = 0 s, the screen showed the following text: “the experiment is about to start.” This required the subjects to remain awake and relax for 3 s. When t = 3 s, a static star or a star moving to the right was randomly displayed on the screen. The subjects were required to observe and memorize the picture for 4 s. When t = 7 s, the cued picture disappeared and the screen went black. The subjects were required to visualize the picture just cued for 4 s. When t = 11 s, “rest” appeared on the screen for 5 s. After the rest period, the next trial was started. Each subject executed 200 trials, and each task consisted of 100 trials.

2.1.4. Experimental Settings

The EEG equipment that was used is NT9200, and the sampling rate was 1,000 Hz. The electrode cap had 32 channels (according to the international 10–20 system), the grounding electrode was GND, the reference electrodes consisted of A1 and A2, and the electrode impedance was kept below 10 kΩ. A band-pass filter was set at 0.1 Hz and 100 Hz, and a 50 Hz notch filter was used to avoid power line noise. EEG data from eight channels—including FP2, F8, C3, CZ, C4, O1, Oz, and O2—were collected in this study.

2.2. Data Preprocessing

First, each EEG signal was linearly corrected to eliminate linear artifacts. Then, the original EEG signal was filtered with an elliptical filter with a digital band-pass filter at 8–13 Hz. The band-pass attenuation was 0.5 dB, and the stop-band attenuation was 50 dB. Finally, independent component analysis (ICA) was used to remove eye movement artifacts, ECG artifacts, and EMG artifacts.

2.3. Empirical Mode Decomposition and HHT

EMD is an adaptive signal time–frequency processing method that was creatively proposed by Huang et al. in 1998 [28]. Specifically, EMD is an adaptive data processing or excavation method that is suitable for the analysis of nonlinear and nonstationary time series. EMD assumes that any signal is composed of different IMFs, and each IMF can be linear or nonlinear. Each IMF component must satisfy two conditions [29]: (1) that the number of its extreme points and zero crossing points are the same or at most different by only one point and (2) that its upper and lower envelopes are locally symmetric with respect to the time axis. Any signal can be decomposed into a finite sum of IMFs, and the decomposition process should be based on the following assumptions [30]: (1) the signal has at least one maximum value and one minimum value; (2) the time-domain characteristics are determined by the extreme value interval; and (3) if the data sequence lacks the extreme value but contains the inflection point, the extreme point can be obtained by derivation.

The decomposition process of EMD is as follows [30]: Step 1: all the maximum points of the original data series x(t) are determined, and a cubic-spline interpolation function is used to fit the upper envelope of the original data; then, all the minimum points are determined, and a cubic-spline interpolation function is used to fit all the minimum points to form the lower envelope of the data. The mean values of the upper and lower envelope are recorded as , and the average envelope is then subtracted from the original data series x(t) to yield a new data series, : In an ideal case, if it is an IMF, then it is the first component of x(t). Step 2: if does not satisfy the conditions of an IMF, is used as the original data, Step 1 is repeated to obtain the average value of of the upper and lower envelope lines, and then it is determined whether satisfies the conditions of IMF. If not, the cycle is repeated k times to get , so that satisfies the conditions of IMF. Note that for , is the first IMF component of signal x(t). Then, is separated from x(t) to obtain the following:

Step 1 and Step 2 are then repeated with as the original data to obtain the second IMF component of x(t). This cycle is repeated n times to obtain n IMF components, as follows:

When becomes a monotone function from which an IMF component can no longer be extracted, the cycle ends. From (2) and (3), we obtain the following:

Therefore, any signal x(t) can be decomposed into the sum of n IMF components and a residual , where the IMF component contains the components of different frequency ranges from high to low, and they are all stable.

After EMD decomposition, Hilbert spectrum analysis was carried out, and Hilbert spectrum transformation was carried out for each IMF component according to the following formula:

The analytical signal is as follows:

Furthermore, the instantaneous amplitude and phase can be obtained as follows:

In this study, an HHT transform was used to extract the average instantaneous energy as the eigenvector. First, EMD was used to decompose each EEG signal under each task. Then, the spectrum of each IMF component was analyzed by the Hilbert transform. The average instantaneous energy of the HHT amplitude was calculated, and the eigenvector was constructed. Finally, SVM was used to classify the test set.

2.4. AR Model

For general random signals, the AR model can be described as follows:where is the ith sampling value of the signal, is the jth coefficient of the AR model, is the residual of white noise, and p is the order of the AR model.

In this study, the order of the AR model was first determined by the Akaike information criterion (AIC), and the optimal order of the AR model was with a of 6. Then, the Burg algorithm was used to extract the six-order AR model coefficient (AR1, …, AR6), which was composed of 12-dimensional feature vectors: . Finally, SVM was used to classify the test set.

2.5. Combination of EMD and AR Model

We first decomposed the VI-based EEG signals by EMD and obtained several stable IMF components. Then, we built the AR model for each IMF component and used the autoregressive parameters of the AR model and the variance of the residual as the eigenvector.

The EMD method was used to decompose the collected EEG signal x(t) to obtain n IMF components, . Each IMF component contained different feature-scale information. Thus, through EMD analysis, the features of signal x(t) were completely described by these n IMF components, . Therefore, through the feature extraction of , the features of the original signal x(t) were obtained.

For any IMF component , the following autoregressive (AR) model (m) was established:where is the AR (m) model parameter of component ; m is the model order; and is the residual of the model, which is the white noise sequence with a mean value of 0 and variance of . Therefore, and can be used as feature vectors to identify VI tasks.

The steps of feature extraction with EMD combined with the AR model are as follows: Under the VI tasks of static and moving pictures, n samples were taken and 2n EEG signals were obtained as samples. EMD decomposition was carried out for EEG signals under each task. The number of IMF components obtained by different EEG signals was , and the maximum value in was assumed to be n. If the number of IMF components in a sample was (k = 1, 2, 2n), the zero vector was supplemented to have n components , namely, .

Each IMF component was energy-normalized to yield a new component as follows:

The AR model was established for each energy-normalized component , and the order m of the model was determined by the final prediction error (FPE) criterion. The autoregressive parameter and the residual variance of the model were estimated by the least-square method, and represented the kth autoregressive parameter of the ith IMF component.

The average value , of , and of N samples in the same state were calculated, and and were taken as the template eigenvector of the ith component, where j = 1, 2 represent the VI static picture and VI moving picture, respectively.

2.6. Support Vector Machine

SVM is a classification algorithm that improves the generalizing ability of learning machines by seeking the minimum structural risk and also minimizes the empirical risk and confidence range, so as to achieve sufficient statistical power for small samples [31].

The cores of the SVM algorithm that we used are as follows [32]: (1) in the case of linear separability, the learning strategy of interval maximization was used to find a hyperplane with the largest interval; (2) in the case of online separability, the feature vector of a low dimension was mapped to a high dimension by a kernel function to determine linear separability. The EEG signals we collected were small and nonlinear, so this SVM classifier was suitable for our present study.

The EEG data of FP2 and F8 were analyzed. The VI data consisted of 100 training datasets and 100 test datasets, including the labels of training samples and test samples. First, the training samples and labels were used to train the model. Then, the model was used to predict the labels of the test samples. Finally, the prediction labels were compared with the real labels to determine the classification accuracies.

3. Results

Table 1 shows the t-test value and variance analysis value during the two VI tasks in each frequency band of the eight EEG channels. There were three variance analysis factors: (1) the VI tasks of imagining static and moving pictures; (2) the frequency-band range of the EEG signals (delta, theta, alpha, beta, and gamma); and (3) the EEG electrode channels (eight channels). The significance level was set as . The t-test results of the two VI tasks are shown in Table 1. The table also includes the value and df value of each electrode position obtained from the analysis of variance. As can be seen from the table, the most significant difference was in the bands of FP2 and F8 (). In addition, a t-test was carried out to determine which channel had a significant difference. The results showed that the values of positions F8 and FP2 were less than 0.01, which meant that there was a 99% significant difference between the data groups, which was the highest among all of the results.

The variance contribution rate and correlation coefficient of each IMF were calculated for IMF screening, as shown in Table 2. The sum-of-variance contribution rate of the first four stages of IMF was 96.13%, and the correlation coefficient was also high (Table 2). Therefore, the first four autoregressive parameters and the variance of model residuals were chosen as the eigenvectors.

Table 3 shows the average, maximum, and minimum classification rates obtained by the combination of EMD and AR model to extract features (within 4 s after the beginning of visual imagery) and the use of the SVM classifier.

Table 4 shows the average, maximum, and minimum classification rates obtained by using the HHT, the AR, and the combination of the EMD and the AR model to extract features (0–4 s after the beginning of VI tasks) via the SVM classifier.

Figure 3 shows the IMF obtained by EMD of EEG signals during VI tasks. It can be seen from Figure 3 that the EEG signal was decomposed into eight IMF components.

Figure 4 shows curves of classification accuracies as a function of time obtained by the HHT, the AR model, and the combination of the EMD and the AR model. The results of Figure 4(a) show that the classification curve of the test set at 0.0–4.0 s was generally stable and that the classification accuracy was the lowest at the beginning of the test. There was a maximum value between 0.3 and 0.8 s, a maximum value between 0.8 and 2.8 s, a maximum value between 2.8 and 3.5 s, and a maximum value between 3.5 and 4.0 s that tended to be stable. Figure 4(b) shows that the overall fluctuation of the classification curve of the test set was within 0.0–4.0 s and was relatively large, and the classification accuracy was the lowest at the beginning of the test and tended to decline within 0.0–1.0 s, with a maximum within 1.0–1.5 s, a minimum within 1.5–2.5 s, and a decline within 2.5–4.0 s. The results of Figure 4(c) show that the classification curve of the test set in 0–4 s tended to be stable as a whole, rising at 0.0–1.0 s, remaining stable at 1.0–3.0 s, and rising at 3.0–4.0 s.

(a)

(b)

(c)

4. Discussion

Many MI-BCI studies using EEG signals for analysis have been published. Although some elucidations have been made with this approach, MI tasks are not easy to acquire and control, as many subjects are incapable of performing MI tasks. Compared with the large volume of MI-BCI studies, fewer VI-BCI studies have been conducted. Importantly, VI tasks are easier to acquire and control compared to MI tasks.

In this study, visualizations of static and moving pictures were selected as VI task pairs. We hypothesized that the characteristic EEGs induced by these two different VI tasks would be separable. The most significant difference between the EEG signals induced by the two VI tasks appeared in the α band of FP2 and F8 (Table 1). The variance contribution rate of the first four IMF components reached 96.13%, and the correlation coefficient was high (Table 2). The features extracted between the two VI-task-based EEG signals by the combination of EMD and AR model could be distinguished to a certain extent (average classification accuracy: 78.40 2.07%; Table 3). Therefore, the two different VI tasks in this study were separable. Our future work will aim to further develop feature-extraction and classification methods to potentially improve this classification accuracy.

For the extraction of VI features in VI-BCIs, previous studies have mainly used EEG power-spectrum estimations or frequency bands [1, 4, 8, 9]. In [33], Llorella et al. created two different models of neural networks such as densely connected neural networks (NN) and convolutional neural networks (CNN) through genetic algorithms (GA) for classification. The result obtained is a 60.5% success rate for the five mental states using the CNN + GA technique. In this study, the HHT, the AR model, and a combination of the EMD and the AR model were used to extract features, while SVM was used to classify the EEG signals induced by VI task pairs. According to the results in Table 4, the average classification accuracy of HHT was 11.85% higher than that of the AR model, which showed that the former was better than the latter. The average classification accuracy of the combination of the EMD and the AR model was 10.26% and 22.11% higher than that of the HHT and AR model, respectively, which showed that this combination was better than the HHT or AR model alone. According to the results in Figure 4, the combination of EMD and the AR model yielded a better classification accuracy curve than did the HHT or AR model alone.

Table 5 shows the VI tasks (paradigm), feature-extraction method, classification method, and classification accuracy in VI-BCI studies. In the present study, the average classification accuracy of VIs of moving and static pictures was 26.4% higher than that of Kosmyna et al. and 22.4% higher than that of Neuper et al. We speculated that the VI tasks designed by Kosmyna et al. being all static led to poor separability of the VI-evoked EEG signals. The VI adopted by Neuper et al. induced certain difficulties in hand movements, which led to poor separability of the VI-evoked EEG signals. However, the methods of feature extraction and classification in these studies were different from one another.

The average classification accuracy of this study was 6.2% lower than that of Koizumi et al. which used three types of VI tasks of an UAV moving in three planes (up/down, left/right, front/back). Our present classification accuracy was also 9.24% lower than that of Sousa et al. that used three types of VI tasks of visual imagery: static points; dynamic points moving vertically up and down in two directions; and dynamic points moving up and down, as well as left and right (four directions). Compared with that of Koizumi and Sousa, the classification accuracy of our study was lower. We speculate that since the VI tasks designed by Koizumi and Sousa were dynamic, the VI-evoked EEG signals were more separable. However, the feature-extraction methods of their study and our study were different from one another.

The present study was an off-line VI-BCI study. There are more improved artificial neural networks used in motor task recognition based EEG signals which provided favorable results [34, 35]. To this end, our future work will include the following: (1) online verification and improvement of the proposed methods; (2) further improvement of the VI-BCI experimental paradigm (e.g., new VI tasks); and (3) for the VI-BCI experimental paradigm, further development of effective feature-extraction and classification methods based artificial neural networks.

5. Conclusions

This study was aimed at determining classification accuracies of different VI tasks reflected in EEG signals. In order to improve the separability between VI-evoked EEG characteristics, a new paradigm of VI tasks involving visualization of both moving and static pictures was used. We found that the most significant difference between the VI-evoked EEG signals appeared in the α band of FP2 and F8. The results showed that the combination of the EMD and the AR model yielded an average classification accuracy of 78.40% ± 2.07%, which was better than that of HHT or the AR model alone. Therefore, it is expected that the recognition of VI of moving and static pictures based on EEGs can be used as a BCI strategy. Additionally, our findings may provide ideas for the construction of a new online real-time VI-BCI with few channels (e.g., FP2 and F8).

Data Availability

The data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

Acknowledgments

This work was supported by the National Natural Science Foundation of China (nos. 82172058, 81771926, 61763022, and 62006246).

References

N. Kosmyna, J. T. Lindgren, and A. Lécuyer, “Attending to visual stimuli versus performing visual imagery as a control strategy for EEG-based brain-computer interfaces,” Scientific Reports, vol. 8, no. 1, Article ID 13222, 2018.
View at: Publisher Site | Google Scholar
G. Pfurtscheller and C. Neuper, “Motor imagery and direct brain-computer communication,” Proceedings of the IEEE, vol. 89, no. 7, pp. 1123–1134, 2001.
View at: Publisher Site | Google Scholar
J. R. Wolpaw, N. Birbaumer, and D. J. McFarland, “Brain–computer interfaces for communication and control,” Clinical Neurophysiology, vol. 113, pp. 767–791, 2002.
View at: Publisher Site | Google Scholar
C. Neuper, R. Scherer, M. Reiner, and G. Pfurtscheller, “Imagery of motor actions: differential effects of kinesthetic and visual-motor mode of imagery in single-trial EEG,” Brain Res Cogn Brain Res, vol. 25, pp. 668–677, 2005.
View at: Publisher Site | Google Scholar
C. R. Hall and K. A. Martin, “Measuring movement imagery abilities: a revision of the movement imagery questionnaire,” Journal of Mental Imagery, vol. 21, pp. 143–154, 1997.
View at: Google Scholar
B. Blankertz, C. Sannelli, S. Halder, E. M. Hammer, and A. Kübler, “Neurophysiological predictor of SMR-based BCI performance,” NeuroImage, vol. 51, pp. 1303–1309, 2001.
View at: Publisher Site | Google Scholar
H. Azmy and N. M. Safri, “EEG based BCI using visual imagery task for robot control,” Jurnal Teknologi, vol. 61, no. 2, 2013.
View at: Publisher Site | Google Scholar
K. Koizumi, U. Kazutaka, and N. Masayuki, “Development of a cognitive brain-machine interface based on a visual imagery method,” in Proceedings of the Conference proceedings: Annual International Conference of the IEEE Engineering in Medicine and Biology Society., vol. 2018, pp. 1062–1065, July, 2018.
View at: Publisher Site | Google Scholar
T. Sousa, C. Amaral, J. Andrade, G. Pires, and U. J. Nunes, “Pure visual imagery as a potential approach to achieve three classes of control for implementation of BCI in non-motor disorders,” Journal of Neural Engineering, vol. 14, no. 4, Article ID 046026, p. 11, 2017.
View at: Publisher Site | Google Scholar
N. E. Huang, Z. Shen, S. R. Long et al., “The empirical mode decomposition and the Hilbert spectrum for nonlinear and nonstationary time series analysis,” Proceedings of the Royal Society A: Mathematical, Physical & Engineering Sciences, vol. 454, pp. 903–995, 1971.
View at: Publisher Site | Google Scholar
H. Sun, Y. Fu, and X. Xiong, “Pattern recognition of MOTOR imagery based on HHT,” Acta Automatica Sinica, vol. 41, no. 9, p. 7, 2015.
View at: Google Scholar
R. Ghritlahare, M. Sahu, and R. Kumar, “Classification of Two-Class Motor Imagery EEG Signals Using Empirical Mode Decomposition and Hilbert–Huang Transformation,” Computing and Network Sustainability, Springer, New York, NJ, USA, 2019.
View at: Publisher Site | Google Scholar
J. Wang, G. Z. Xu, J. Wang, S. Yang, and W. L. Yan, “Application of Hilbert-Huang transform for the studyof motor imagery tasks,” in Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 3848–3851, IEEE, Vancouver, Canada, February, 2008.
View at: Publisher Site | Google Scholar
A. Gupta, D. Kumar, A. Chakraborti, and K. Sharma, “Performance Evaluation of Empirical Mode Decomposition Algorithms for Mental Task Classification,” 2017, Preprint.
View at: Publisher Site | Google Scholar
S. K. Bashar and M. Bhuiyan, “Classification of motor imagery movements using multivariate empirical mode decomposition and short time Fourier transform based hybrid method,” Engineering Science & Technology An International Journal, vol. 19, no. 3, pp. 1457–1464, 2016.
View at: Publisher Site | Google Scholar
W. Chen and Y. Yang, “Masking empirical mode decomposition-based hybrid features for recognition of motor imagery in EEG,” in Proceedings of the 2017 3rd IEEE International Conference On Control Science and Systems Engineering (ICCSSE), pp. 567–570, Beijing, China, August, 2017.
View at: Publisher Site | Google Scholar
A. Ullal and R. B. Pachori, “EEG signal classification using variational mode decomposition,” 2003, https://arxiv.org/abs/2003.12690.
View at: Google Scholar
R. Madanu, F. Rahman, and M. F. Abbod, “Depth of anesthesia prediction via EEG signals using convolutional neural network and ensemble empirical mode decomposition,” Mathematical Biosciences and Engineering, vol. 18, no. 5, pp. 5047–5068, 2021.
View at: Publisher Site | Google Scholar
M. Pal, S. Bhattacharyya, A. Konar, and D. N. Tibarewala, “Decoding of wrist and finger movement from electroencephalography signal,” in Proceedings of the IEEE International Conference on Electronics, IEEE, Bangalore, India, January, 2014.
View at: Publisher Site | Google Scholar
B. Xu, A. Song, and R. Yang, Journal of Huazhong University of Science and Technology: Natural Science Edition, vol. 39, no. 4, p. 5, 2011.
Y. Ding and L. Shi, Fault Diagnosis Technology of Mechanical Equipment, Shanghai Science and Technology Literature Press, Shanghai, 1994.
T. Liu, M. Zheng, and Z. Chen, “Application of AR model and fractal geometry in equipment condition monitoring,” Mechanical strength, vol. 23, no. 1, pp. 61–65, 2001.
View at: Google Scholar
S. N. Resalat and V. Saba, “A study of various feature extraction methods on a motor imagery based brain computer interface system,” Basic and Clinical Neuroscience, vol. 7, no. 1, pp. 13–19, 2016 Jan.
View at: Google Scholar
D. Yu, J. Cheng, and Yu Yang, “Rolling bearing fault diagnosis method based on EMD and AR model,” Journal of Vibration Engineering, vol. 17, no. 3, p. 4, 2004.
View at: Google Scholar
Y. Diao, H. Yue, and Z. Fu, “Structural Damage Warning Method Based on EMD Decomposition and AR Model Residual Error,” 2016, CN105631213A.
View at: Google Scholar
W. Yang and P. Wang, “Research on the application of method in fault diagnosis based on EMD-AR and SVM,” The 11th National Symposium on Rotor Dynamics (ROTDYN2014), vol. 2, 2014.
View at: Google Scholar
Y. Zhang, S. Zhang, and X. Ji, “EEG-based classification of emotions using empirical mode decomposition and autoregressive model,” Multimedia Tools and Applications, vol. 77, pp. 26697–26710, 2018.
View at: Publisher Site | Google Scholar
H. Huang, “Transform from wikipedia,” 2015, https://en.wikipedia.org/wiki/Hilbert-Huangtransform.
View at: Google Scholar
wikipedia, “Empirical mode decomposition from wikipedia,” 2018, https://en.wikipedia.org/wiki/EmpiricalModeDecomposition.
View at: Google Scholar
M. A. Li, Y. Cui, Y. Jin-Fu, and H. Dong-Mei, “An adaptive multi-domain fusion feature extraction with method HHT and CSSD,” Acta Electronica Sinica, vol. 41, no. 12, pp. 2479–2486, 2013.
View at: Google Scholar
Z. Zhou, Machine Learning, Tsinghua University Press, Beijing, China, 2016.
H. Li, Statistical Learning Methods, Tsinghua University Press, Beijing, China, 2012.
F. R. Llorella, G. Patow, and J. M. Azorín, “Convolutional neural networks and genetic algorithm for visual imagery classification,” Physical and Engineering Sciences in Medicine, vol. 43, no. 3, pp. 973–983, 2020.
View at: Publisher Site | Google Scholar
J. M. Antelis, B. Gudiño-Mendoza, and L. Falcón, “Dendrite morphological neural networks for motor task recognition from electroencephalographic signals,” Biomedical Signal Processing and Control, vol. 44, pp. 12–24, 2018.
View at: Publisher Site | Google Scholar
D. Carlos, H. Juan, and J. M. Antelis, “Spiking Neural Networks applied to the classification of motor tasks in EEG signals,” Neural Networks, vol. 122, pp. 130–143, 2020.
View at: Google Scholar

Copyright

Copyright © 2022 Yunfa Fu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

250

Downloads

674

Citations