Research Article  Open Access
Wei Wei, Qingxuan Jia, Yongli Feng, Gang Chen, "Emotion Recognition Based on Weighted Fusion Strategy of Multichannel Physiological Signals", Computational Intelligence and Neuroscience, vol. 2018, Article ID 5296523, 9 pages, 2018. https://doi.org/10.1155/2018/5296523
Emotion Recognition Based on Weighted Fusion Strategy of Multichannel Physiological Signals
Abstract
Emotion recognition is an important pattern recognition problem that has inspired researchers for several areas. Various data from humans for emotion recognition have been developed, including visual, audio, and physiological signals data. This paper proposes a decisionlevel weight fusion strategy for emotion recognition in multichannel physiological signals. Firstly, we selected four kinds of physiological signals, including Electroencephalography (EEG), Electrocardiogram (ECG), Respiration Amplitude (RA), and Galvanic Skin Response (GSR). And various analysis domains have been used in physiological emotion features extraction. Secondly, we adopt feedback strategy for weight definition, according to recognition rate of each emotion of each physiological signal based on Support Vector Machine (SVM) classifier independently. Finally, we introduce weight in decision level by linear fusing weight matrix with classification result of each SVM classifier. The experiments on the MAHNOBHCI database show the highest accuracy. The results also provide evidence and suggest a way for further developing a more specialized emotion recognition system based on multichannel data using weight fusion strategy.
1. Introduction
Emotion recognition is a quickly developing branch of affective computing, which is integration of psychology, physiology, computer science, and so on. And various studies have shown that emotion plays a vital role in artificial intelligent [1]. Emotion recognition enables computer to provide the appropriate feedback to emotion state of human, which can be applied to various applications, such as learning environment, leisure entertainment, medical assist, and mental health [2–5]. For example, if computers have ability to detect emotion of student and create an appropriate feedback according to the emotion state, the student can be more effective in online learning environment.
It is imperative to take into account physiological signals to recognize emotion because of the strong relationship between physiological reactions and human. Besides, physiological signals are the result of Central Nervous System (CNS) and Autonomic Nervous System (ANS) activities, which are the same among people with different cultures, languages, and gender and cannot be imitated easily [6]. And physiological activations are largely involuntary which cannot be triggered by any conscious or intentional control easily [7].
Since the complexity of body structure, various physiological activities are related to emotional state. The corresponding various physiological signals can be used for emotion recognition, such as EEG, ECG, GSR, RA, and Blood Volume Pressure (BVP). Single channel physiological signals presented do have some limitations; therefore the emotion recognition was proposed based on multichannel physiological signals. Relevant researches have achieved a certain level of development. However, the difference between various physiological signals has not been considered adequately. It is motivated by the fact that the strength of expression for physiological signal on various emotions is different. We propose a new principal of weight design based on feedback strategy, which uses signal emotional state recognition rate based on single physiological signal to calculate the weight matrix of each physiological signal.
For our proposed method, there are three main contributions. In the weight definition stage, a more advanced strategy based on feedback is used. In construction, physiological signal expounds the expressiveness of emotional state by the recognition rate of each emotional state based on each physiological signal. Then we calculate weight matrix of each classifier based on single physiological signal. In the fusion stage, a more advanced weight fusion strategy is used in decision level. We linearly fuse weight matrix with classification result of each classifier. And maxwin strategy is used for final emotion recognition result. The proposed method has been evaluated in a database which contains multichannel physiological signals. Moreover, comparison results have been carefully analyzed and studied on whether to use weight matrix based on strategy of feedback or not. The rest of the paper is organized as follows: Section 2 gives an overview of related works on emotion recognition based on multichannel physiological signals. Section 3 describes the materials and methods in use. Section 4 verifies the proposed method by experiment and analyzes experimental results. Section 5 concludes the paper.
2. Related Work
In the past long time, the issue of defining and describing emotion states has been a constant challenge in different subjects of the behavioral and social sciences. The discrete emotional model proposed by Ekman [8] and twodimensional continuous emotional model proposed by Lang [9] are generally used in emotion recognition research. In order to improve the use of emotion classification algorithm, discrete emotional model is the mostly adopted model in the current study. In the discrete emotional model, several basic emotions are considered separately since they do not have common attributes. The other emotions are considered a mix of these basic emotions. Ekman [8] proposed six discrete basic emotions, which contain happiness, sadness, surprise, anger, disgust, and fear which were considered in our study.
Most researchers divide human physiological signal sources into two categories: brain activities and peripheral physiological activities. Brain activities are measured by EEG, Magnetoencephalography (MEG), functional nearinfrared spectroscopy (fNIRS), functional magnetic resonance imaging (fMRI), etc. On the other hand, peripheral physiological activities are measured by ECG, heart rate, Electromyography (EMG), BVP, GSR, RA, finger temperature, etc. The commonly used EEG signals reflect emotion changes on the CNS, while the peripheral signals reflect the emotion influence on the ANS. From the clinical point of view EEG [10], ECG [11], GSR [12], and RA [13] are most widely used physiological signals for emotion recognition. Various physiological signals can be fused together to determine and classify various kinds of emotion [14]; therefore the focus of research turns to multimodal information fusion.
Previous works on fusion strategies can be broadly categorized into feature level fusion and decisionlevel fusion. Feature level fusion aims to directly combine feature vectors by concatenation [15] or kernel methods [16]. Decisionlevel fusion combines the prediction scores of each single classifier. The advantage of decisionlevel fusion is that it can combine different types of classifiers like logistic regression and SVM [17]. Previous works usually conducted it by a single layer averaging [18] or weighted voting [19]. For fusion strategy, we adopt weighted decisionlevel fusion strategy. Calculating weight is the key element that gives a weight to various features based on certain principles.
Previous various approaches on emotion have reported a correlation between basic emotions and physiological responses. Usually different classifiers such as hidden Markov models (HMMs [20]), k Nearest Neighbors (kNN) algorithm [21], SVM [22], support vector regression (SVR) [23], and linear discriminant analysis (LDA) [24] have been used for emotion recognition based on physiological signals. For classifier we chose a SVM, as they have previously been proven to be very effective and to maintain enough flexibility with regard to their main parameter optimization [25, 26]. And SVM have been reported in literature as obtaining the highest classification results when using multidimensional data [27].
3. Materials and Methods
3.1. Emotion Feature Extraction and Selection
Physiological signals are highly dimensional data which may contain a lot of useless features. Therefore, the most important thing of emotion recognition system is extracting appropriate and efficient features of physiological signals. Various analysis domains have been used in physiological emotion features extraction, including time, frequency, and statistical analysis. Time domain analysis is based on the geometric properties of physiological signals, such as amplitude, mean value, and variance. As the earliest method applied by researchers, the advantage is its simplicity and intuition. Frequency domain analysis is based on the character of every frequency. The most widely used method is power spectrum estimation, which obtains correspondence between power and the frequency by signal conversion. Timefrequency domain analysis is based on the comprehensive analysis of characters of both time and frequency domain features. In this study, we consider the combination of the time and frequency domain features for the physiological signals.
EEG is an electrophysiological monitoring method to record electrical activity of the brain. The MAHNOBHCI database provides EEG data recorded from 32 channels, 14 of which were from left hemisphere, 14 from right hemisphere, and 4 from midline. Researches have indicated that the emotion perception in human brain requires coordination between different brain regions. The main lobes involved in emotion perception include frontal lobes, temporal lobes, and parietal lobes [28]. Besides, the necessity of channel selection in EEGbased emotion recognition has been testified [29]. Therefore, the selected 12 channels are Fp1, FC5, T7, P7, and O1 from left hemisphere, Fp2, AF4, F8, T8, P4, and PO4 from right hemisphere, and Oz from midline which are shown in Figure 1. In general, bands of frequency for each EEG channel correspond to delta (04 Hz), theta (47 Hz), alpha (815 Hz), and beta (1631 Hz) [30]. Delta and theta are seen in babies and young children normally. Alpha emerges with closing of the eyes. Beta is seen on both sides in symmetrical distribution and most evident frontally. Therefore, the selected band of frequency is beta. Multiple types of EEG features have been used in emotion recognition, including both aspects of frequency domain and time domain features. Above all, we select mean, standard, and max of power spectral density of the beta to form 36dimensional EEG feature vector as follows:
Electrocardiography (ECG) signal is a measure of electrical activity associated with the heart. The MAHNOBHCI database provides ECG data recorded from 3 channels. ECG signals have been defined in medicine strictly which produces four entities: P wave, QRS complex wave, T wave, and U wave and each has a unique pattern [31] which are shown in Figure 2. The P wave represents atrial depolarization. The QRS complex wave represents ventricular depolarization. The T wave represents ventricular repolarization. The U wave represents papillary muscle repolarization. Additionally, heart rate variability (HRV) is the physiological phenomenon of variation in the time interval between heartbeats. It represents fluctuation between adjacent R where R is a point corresponding to the peak of the QRS complex wave. The amplitude peak of P, R, T wave, and HRV can describe the characteristics of signal with the changes of emotion states. And multiple types of ECG features have been used in emotion recognition, including both aspects of frequency domain and time domain features. Therefore, we select mean and standard of amplitude of P, R, T, and HRV in time domain. Besides, we select max, mean, and standard of power spectral density of HRV in frequency domain. Above all, we get 33dimensional ECG feature vector as follows:
Respiration amplitude (RA) is commonly acquired by measuring the physical change of the thoracic expansion with a rubber band around the chest or belly [13]. In general, relaxation and startling event causes rate decreases, tense situations may result in momentary cessation, and negative emotions generally cause pattern irregularity. Besides, RA is closely linked to heart function. The MAHNOBHCI database provides RA data recorded from one channel. The first difference and second difference of RA can also describe the characteristics of signal with the changes of emotion states. And multiple types of RA features have been used in emotion recognition, including both aspects of frequency domain and time domain features. Therefore, we select median, mean, variance, minimum, maximum, and maximum and minimum difference of RA in both time and frequency domains. Besides, we select median, mean, variance, minimum, maximum, and maximum and minimum difference of first and second difference of RA in time domains. Above all, we get 28dimensional ECG feature vector as follows:
Galvanic skin response (GSR) is physically the measure of change in the electrical properties of the skin [32] in response to changes in the ANS. Sympathetic activity causes increase in the sweat gland activity leading to a decrease in the level of skin resistance. Thus GSR is a manifestation of the sympathetic activity or emotional arousal. Specific emotions cannot be accurately identified because some emotions produce similar GSR responses, like anger and startle response [33]. However, GSR has high importance in emotion recognition clubbed with other physiological signal such as ECG. The MAHNOBHCI database provides GSR data recorded from one channel. The first difference and second difference of GSR can also describe the characteristics of signal with the changes of emotion states. And multiple types of GSR features have been used in emotion recognition, including both aspects of frequency domain and time domain features. Therefore, we select median, mean, variance, minimum, maximum, and maximum and minimum difference of GSR in both time and frequency domains. Besides, we select median, mean, variance, minimum, maximum, and maximum and minimum difference of first and second difference of GSR in time domains. Above all, we get 28dimensional GSR feature vector as follows:
3.2. SVM Classification
Following the extraction of features, a classifier is trained to recognize emotion states. Nonlinear SVM was evaluated in this study. SVM is a new supervised learning model with associated learning algorithm for classification problem of data whose ultimate aim is to find the optimal separating hyperplane. The mathematical model of SVM is shown as below.
Given a training set , where is input and is the corresponding output, if there is a hyperplane which can divide the all the points into two groups correctly, we aim to find the “maximummargin hyperplane” where the distance between the hyperplane and the nearest point from either group is maximized. By introducing the penalty parameter and the slack variable , the optimal hyperplane can be obtained by solving constraint optimization problem as follows:
Based on Lagrangian multiplier method, the problem is converted into a dual problem as follows:where are the Lagrange multipliers of samples . Only a few are solutions of the problem of removing the parts of , so that we can get the classification decision function as follows:
For the linearly nonseparable problem, we first map the data to some other highdimensional space , using a nonlinear mapping which we call . Then we use linear model to achieve classification in new space . Through defined “kernel function” , (6) is converted as follows:And the corresponding classification decision function is converted as follows:
The selection of kernel function aims to take the place of inner product of basis function. The ordinary kernel functions investigated for linearly nonseparable problems are as follows:
nthdegree polynomial kernel function is
(Gaussian) radial basis kernel function is
Sigmoid kernel function is
In this study, we used RBF kernel function. And grid search method was applied to optimize the parameters and .
3.3. Weighted Fusion Strategy
In this section, we propose a novel decisionlevel weight fusion network as shown in Figure 3 to combine the results of each independent classifier. Weighted fusion strategy is based on weight matrix, which is defined as Definition 1.
Definition 1. Let be a linear transformation square matrix of order , where is the number of categories. The different choices for lead to different weight situation.
is an identity matrix of order , which is no weight situation. is a diagonal matrix of order , where is the weight of category, and not all are equal to the others.We consider two situations of weight matrix in this paper.
Calculating weight is the key element that gives a weight to various features based on certain principles. As different features have different discriminative abilities on specific emotions [34], for weight definition, we adopt feedback strategy. Firstly, recognition results are obtained from the abovementioned methods that used separate classifier for each physiological signal. Each emotion recognition rate of each classifier is treated as a weight matrix as follows:
In particular, from each classifier we obtained a weight matrix for each sentiment classifier. Secondly, let as the classifier probabilities resulted from each physiological signal are an mdimensional vector, where and . And the classifier result is obtained according to linear data fusion principle as follows:
Finally, the recognition result is using a maxwin strategy as follows:And the most likely category label is .
4. Experiment Result
The experiments on the MAHNOBHCI database [35] show the effectiveness of the proposed method. In our experiments, we use EEGLAB, MATLAB, and python programs based on LIBSVM software packages, and the platform of data processing is a computer with Windows 7, Core™ i32120 CPU (3.30GHz,) 4.00GB RAM. The flow chart of the experiment is shown in Figure 4, and specific steps are described in the following sections.
4.1. Experiment Data
MAHNOBHCI is a multimodal database recorded in response to affective stimuli with the goal of emotion recognition. The recorded signals are shown in Table 1, we select the signals with italics in our experiments. The database records physiological signals of 30 participants with 9 different emotion labels. 30 volunteer participants have different cultural and education backgrounds.

Data recorded from 3 participants are not analyzed due to technical problems and unfinished data collection, so only 27 sets of data can be used in our research. The emotion labels are shown in Table 2, and we only use the data of labels with italics in our research. Concerning the imbalance of the emotion data set used in experiments, the size of training data sets is 80% of smallest emotion data. Besides, we use the remaining to test the classifiers, and the detailed number of data of each discrete emotion is shown in Table 3.


4.2. Results of Emotion Recognition
We extract each physiological signal emotion feature listed in Section 3 and apply the SVM classification independently. A comparison of results between each emotion has been shown in Table 4 for each physiological signal, respectively. Here, we observe that the emotional state of Neutral and Happiness are relatively easy to distinguish. And the highest average emotion recognition accuracy of 74.52% was obtained in EEG case. However, recognition accuracy of disgust is lower than ECG case. Besides, we can obtain emotion expression of each physiological signal which can be ranked according to the recognition rate and has been shown in Table 5. Obviously, various physiological signals have different abilities to classify specific emotion. Therefore, each result of physiological signal should be combined in a way that they benefit the interrelationships between the individual classifier.


We use the recognition rates in Table 4 and (15) to obtain the weight matrix of each classifier under the situation of diagonal matrix as follows:
Besides, we use (13) to obtain the weight matrix of each classifier under the situation of identity matrix as follows:
Our proposed fusion frame is performed to combine the classification results of these four physiological signals. Thus we verify the fusion frame on the same training set and test set with two situations of weight matrix, respectively. A comparison of results between each emotion has been shown in Table 6 for each situation.

4.3. Results Analysis
We could see that the average recognition correct rate by using proposed method is 84.6%. And the recognition rate of each emotion is more than the accuracy of each individual physiological signal and under the situation of identity weight matrix. These confirm the effectiveness of our method. Investigating its reason, it can be explained from robustness of weighted fusion strategy. This method reduces the influence of weak correlation feature and enhances the influence of strong correlation feature by weighted feature, thus improving the robustness of classification algorithm. In brief, the method improves the accuracy of emotion recognition by giving full play to the advantages of various physiological signals and decisionlevel weighted fusion strategy and makes the whole fusion process close to human emotion recognition.
5. Conclusion
In this paper, we propose an approach of emotion recognition based on weighted fusion strategy of multichannel emotion data. In our work, single channel emotion recognition systems that use signal physiological signal were analyzed separately and tested with the same emotion databases. Then, physiological signals were used together with a weighted decisionlevel fusion. Weighted strategy is based on the effect of each physiological signal on various emotion recognition result is different. Thus we calculate weight of physiological signals based on their respective recognition rate and design a recognition model based on multichannel physiological signals. And recognition rate of each emotion is more than the accuracy of each individual physiological signal. Thus the experimental results suggest that the approach based on weighted fusion strategy has good performance on the correct rate in emotion recognition. In future work improvement of feature extraction strategy is probably the best avenue to enhance classification performance. Moreover, additional feature selection technique will be implemented to reduce the number of features and ameliorate the classification accuracies. Thus emotion recognition based on multichannel emotion data is still full of challenges in the future.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
Acknowledgments
This work was supported by the National Natural Science Foundation of China (no. 61573066, no. 61327806).
References
 F. Cavallo, F. Semeraro, L. Fiorini, G. Magyar, P. Sinčák, and P. Dario, “Emotion Modelling for Social Robotics Applications: A Review,” Journal of Bionic Engineering, vol. 15, no. 2, pp. 185–203, 2018. View at: Publisher Site  Google Scholar
 T. Tojo, O. Ono, N. B. Noh, and R. Yusof, “Interactive Tutor Robot for Collaborative eLearning System,” Electrical Engineering in Japan, vol. 203, no. 3, pp. 22–29, 2018. View at: Publisher Site  Google Scholar
 M. Basiri, F. Schill, P. U.Lima, and D. Floreano, “Localization of emergency acoustic sources by micro aerial vehicles,” Journal of Field Robotics, vol. 35, no. 2, pp. 187–201, 2018. View at: Publisher Site  Google Scholar
 J. A. Díez, A. Blanco, J. M. Catalán, F. J. Badesa, L. D. Lledó, and N. GarcíaAracil, “Hand exoskeleton for rehabilitation therapies with integrated optical force sensor,” Advances in Mechanical Engineering, vol. 10, no. 2, p. 168781401775388, 2018. View at: Publisher Site  Google Scholar
 L. Z. You, S. D. Zhang, and L. D Zhu, “Bedchair integrationnew developing trend of helpage assistive robot,” in Proceedings of the 5th International Conference on Machinery, Materials Science and Engineering Applications, pp. 371–376, 2016. View at: Google Scholar
 S. Wioleta, “Using physiological signals for emotion recognition,” in Proceedings of the 2013 6th International Conference on Human System Interactions (HSI), pp. 556–561, Sopot, Poland, June 2013. View at: Publisher Site  Google Scholar
 S. Balters and M. Steinert, “Capturing emotion reactivity through physiology measurement as a foundation for affective engineering in engineering design science and engineering practices,” Journal of Intelligent Manufacturing, vol. 28, no. 7, pp. 1585–1607, 2017. View at: Publisher Site  Google Scholar
 P. Ekman, W. V. Friesen, M. O'Sullivan et al., “Universals and cultural differences in the judgments of facial expressions of emotion,” Journal of Personality and Social Psychology, vol. 53, no. 4, pp. 712–717, 1987. View at: Publisher Site  Google Scholar
 P. J. Lang, “The emotion probe. Studies of motivation and attention,” American Psychologist, vol. 50, no. 5, pp. 372–385, 1995. View at: Publisher Site  Google Scholar
 W.L. Zheng and B.L. Lu, “Investigating critical frequency bands and channels for eegbased emotion recognition with deep neural networks,” IEEE Transactions on Autonomous Mental Development, vol. 7, no. 3, pp. 162–175, 2015. View at: Publisher Site  Google Scholar
 H. W. Guo, Y. S. Huang, J. C. Chien, and J. S. Shieh, “Shortterm analysis of heart rate variability for emotion recognition via a wearable ECG device,” in Proceedings of the 2015 International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS), pp. 262–265, Okinawa, Japan, November 2015. View at: Publisher Site  Google Scholar
 Q. Zhang, X. Lai, and G. Liu, “Emotion Recognition of GSR Based on an Improved Quantum Neural Network,” in Proceedings of the 2016 8th International Conference on Intelligent HumanMachine Systems and Cybernetics (IHMSC), pp. 488–492, Hangzhou, China, August 2016. View at: Publisher Site  Google Scholar
 J. Kim and E. André, “Emotion recognition based on physiological changes in music listening,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 30, no. 12, pp. 2067–2083, 2008. View at: Publisher Site  Google Scholar
 C. Li, C. Xu, and Z. Feng, “Analysis of physiological for emotion recognition with the IRS model,” Neurocomputing, vol. 178, pp. 103–111, 2016. View at: Publisher Site  Google Scholar
 M. B. Wiem and Z. Lachiri, “Emotion assessing using valencearousal evaluation based on peripheral physiological signals and support vector machine,” in Proceedings of the 2016 4th International Conference on Control Engineering & Information Technology (CEIT), pp. 1–5, Hammamet, Tunisia, December 2016. View at: Publisher Site  Google Scholar
 J. Chen, Z. Chen, Z. Chi, and H. Fu, “Emotion recognition in the wild with feature fusion and multiple kernel learning,” in Proceedinds of the 16th Interntional Conference on multimodal interaction, pp. 508–513, 2014. View at: Google Scholar
 M. Liu, “Combining multiple kernel methods on iemannian manifold for emotion recognition in the wild,” in Proceedings of the 16th International Conference on multimodal interaction, pp. 494–501, 2014. View at: Google Scholar
 S. Meudt, D. Zharkov, M. Kächele, and F. Schwenker, “Multi classifier systems and forward backward feature selection algorithms to classify emotional coloured speech,” in Proceedings of the 2013 15th ACM International Conference on Multimodal Interaction, ICMI 2013, pp. 551–556, aus, December 2013. View at: Google Scholar
 M. Liu, R. Wang, Z. Huang, S. Shan, and X. Chen, “Partial least squares regression on grassmannian manifold for emotion recognition,” in Proceedings of the the 15th ACM, pp. 525–530, Sydney, Australia, December 2013. View at: Publisher Site  Google Scholar
 J. Chen, B. Hu, L. Xu, P. Moore, and Y. Su, “Featurelevel fusion of multimodal physiological signals for emotion recognition,” in Proceedings of the 2015 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pp. 395–399, Washington, wash, USA, November 2015. View at: Publisher Site  Google Scholar
 M. Khezri, M. Firoozabadi, and A. R. Sharafat, “Reliable emotion recognition system based on dynamic adaptive fusion of forehead biopotentials and physiological signals,” Computer Methods and Programs in Biomedicine, vol. 122, no. 2, pp. 149–164, 2015. View at: Publisher Site  Google Scholar
 Y.P. Lin, C.H. Wang, T.P. Jung et al., “EEGbased emotion recognition in music listening,” IEEE Transactions on Biomedical Engineering, vol. 57, no. 7, pp. 1798–1806, 2010. View at: Publisher Site  Google Scholar
 C.Y. Chang, C.W. Chang, J.Y. Zheng, and P.C. Chung, “Physiological emotion analysis using support vector regression,” Neurocomputing, vol. 122, pp. 79–87, 2013. View at: Publisher Site  Google Scholar
 M.S. Park, H.S. Oh, H. Jeong, and J.H. Sohn, “EEGbased emotion recogntion during emotionally evocative films,” in Proceedings of the 2013 International Winter Workshop on BrainComputer Interface, BCI 2013, pp. 5657, kor, February 2013. View at: Google Scholar
 A. Kapoor, W. Burleson, and R. W. Picard, “Automatic prediction of frustration,” International Journal of HumanComputer Studies, vol. 65, no. 8, pp. 724–736, 2007. View at: Publisher Site  Google Scholar
 S. B. Kotsiantis, I. D. Zaharakis, and P. E. Pintelas, “Machine learning: A review of classification and combining techniques,” Artificial Intelligence Review, vol. 26, no. 3, pp. 159–190, 2006. View at: Publisher Site  Google Scholar
 S. B. Kotsiantis, “Supervised machine learning: a review of classification techniques,” Informatica, vol. 31, no. 3, pp. 249–268, 2007. View at: Google Scholar  MathSciNet
 P. Sarkheil, R. Goebe, F. Schneider, and K. Mathiak, “Emotion unfolded by motion: A role for parietal lobe in decoding dynamic facial expressions,” Social Cognitive and Affective Neuroscience, vol. 8, no. 8, Article ID nss092, pp. 950–957, 2013. View at: Publisher Site  Google Scholar
 J. Zhang, M. Chen, S. Zhao, S. Hu, Z. Shi, and Y. Cao, “ReliefFBased EEG Sensor Selection Methods for Emotion Recognition,” Sensors, vol. 16, no. 10, p. 1558, 2016. View at: Publisher Site  Google Scholar
 W. O. Tatum and R. Ellen, “Grass Lecture: Extraordinary EEG,” The Neurodiagnostic Journal, vol. 54, no. 1, pp. 3–21, 2014. View at: Google Scholar
 S. Ktata, K. Ouni, and N. Ellouze, “ECG signal maxima detection using wavelet transform,” in Proceedings of the International Symposium on Industrial Electronics 2006, ISIE 2006, pp. 700–703, can, July 2006. View at: Google Scholar
 P. Das, A. Khasnobish, and D. N. Tibarewala, “Emotion recognition employing ECG and GSR signals as markers of ANS,” in Proceedings of the 2016 Conference on Advances in Signal Processing, CASP 2016, pp. 37–42, ind, June 2016. View at: Google Scholar
 N. D. Ahujaet et al., “GSR and HRA: its application in clinical diagnosis,” in Proceedings of the 16th IEEE Symposium ComputerBased Medical Systems, pp. 279–283, 2003. View at: Google Scholar
 B. Sun, L. Li, T. Zuo, Y. Chen, G. Zhou, and X. Wu, “Combining Multimodal Features with Hierarchical Classifier Fusion for Emotion Recognition in the Wild,” in Proceedings of the the 16th International Conference, pp. 481–486, Istanbul, Turkey, November 2014. View at: Publisher Site  Google Scholar
 M. Soleymani, J. Lichtenauer, T. Pun, and M. Pantic, “A multimodal database for affect recognition and implicit tagging,” IEEE Transactions on Affective Computing, vol. 3, no. 1, pp. 42–55, 2012. View at: Publisher Site  Google Scholar
Copyright
Copyright © 2018 Wei Wei et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.