About this Journal Submit a Manuscript Table of Contents
International Journal of Distributed Sensor Networks
Volume 2013 (2013), Article ID 937163, 11 pages
http://dx.doi.org/10.1155/2013/937163
Research Article

Divisibility and Compactness Analysis of Physiological Signals for Sentiment Classification in Body Sensor Network

School of Information & Electrical Engineering, Hebei University of Engineering, Hebei, Handan 056038, China

Received 6 May 2013; Accepted 27 August 2013

Academic Editor: Rajgopal Kannan

Copyright © 2013 Wei Wang and Xiaodan Huang. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Affective computing draws more and more attention to the human-computer interaction. Based on physiological signals acquired by body sensor network, within the affection recognition process, the problem that training samples have larger class distance and smaller intraclass distance must be considered. For the class divisibility and intraclass compactness problem, researching method of samples validity was proposed based on metric multidimensional scaling. With dissimilarity matrix, scalar product matrix was calculated. Subsequently, individual attribute reconstructing matrix could be got using principal components factor analysis to display samples difference in low dimension. By means of experiment results, training and testing samples for sentiment classifier will be selected instructionally.

1. Introduction

To realize natural human-computer interaction, more personalized services are required during the interactive process. Therefore, it is an effective way to bring in a user’s affection with body sensor network to the service. The artificial psychological and affective computing are becoming new research directions in the field of artificial intelligence [1]. Generally, researches focus on simulating affective recognition, modeling, and expression mainly. The affective recognition consists of two types. One is recognizing user’s affection which is user centered, and the other is recognizing affection in content, such as light effect, context, and characters in film, music, and art painting, which is content centered [2].

For the first type, researches can use multitypes of sensors to measure user’s affection. Kim et al. surveyed the amount of sweat, pulse, body temperature, and blood pressure. Based on this physiological information, they determined the user's affective state after data fusion and fuzzy inference [3]. Nguyen used fewer sensors, only with pulse and body temperature, to acquire affection [4]. Arapakis proposed a method with facial expression [5]. In addition, the measuring method also includes the questionnaire or its extended form. It is an indirect way. González et al. used emotion quotient (EQ) test table [6]. Ai Thanh Ho provided a group of different colors to select for user and determined the user's affection based on his selection. The features of these affection acquiring methods are compared in Table 1.

tab1
Table 1: Comparison among the methods of affection accessing.

The method based on the user’s physiological information to judge the affective state is better than others in portability, signal continuity, sensibility, and comfort as shown in Table 1. Therefore, researches on physiological divisibility of affection attract the interest of researchers in the field of human-computer interactionMany psychologists got different conclusions on autonomic nervous system (ANS). On the one hand, paper [7], regarded that the "detest" affection has specific ANS proposed. But on the other hand, the opposite researching view was also studied in [8]. However, the existence of specific affection ANS has got more and more support from recent studies [716]. In the research of affection recognition based on physiological signals, some affective physiological data sample libraries were established as shown in Table 2. However, these libraries provide a foundation for comparison and analysis of affective physiological feature selection and sentiment classification, whether they are valid, that is, whether or not having a larger class distance and a smaller intraclass distance, as training data is worthy of study. For the affective physiological database proposed in [17], this paper analyzes the divisibility and compactness of 20 groups of samples with 8 kinds of affections.

tab2
Table 2: Library of affective physiological samples.

2. Affective Physiological Samples

Affective database DataSet I, which is established by Picard, recorded physiological data of 20 days. The samples include 4 types: myoelectricity , pulse , skin conductance , and respiratory . And the affective states have 8 classes. They are calmness (N), anger (A), hate (H), grief (G), platonic love (P), romantic love (L), joy (J), and reverence (R). These signals were sampled in 100 seconds. The length of the time series is . So daily physiological data has 8 × 4 × 2001 = 64032 in total. The organization of affection database DataSet I is shown in Figure 1.

937163.fig.001
Figure 1: Data organization of affection database DataSet I.

3. Analysis of Divisibility and Compactness

In the affective state discriminating process with physiological signals, for feature-based classification methods, the training samples and selected feature impact on the classifier directly. Due to the different deployment of sensors in body sensor network and the participant’s daily life, training samples have more noise. So samples, which have a larger class distance and a smaller intraclass distance, should be selected to train the classifier. In addition, for different feature sets, dispersion between classes or within one class should be discussed. Therefore, after selecting a certain feature set, validity analysis for affective physiological sample is one of the key factors in training the affective state classifier. Based on the multidimensional scaling theory, this paper illustrates a general validity analysis method by using the dataset proposed in [17]. From the view of similarity or dissimilarity of affective physiological signals, we represent the samples in the low-dimensional space to reveal the underlying structure of the sample.

The literature in psychophysiology and related disciplines described features about affective state recognition based on facial muscle movement, heart rate changes, and so on [10]. Picard et al. proposed 6 static characteristics. They are mean value , standard deviation , mean value of the first-order differential absolute value , its normalized value , mean value of the second-order differential absolute value , and its normalized value [17]. Suppose that the th type of physiological signal acquiring devices gets the th measured value . And its normalized value is . So the 6 static features can be obtained by formulas (1) and (2) as follows: where , Based on the features above, time series acquired by the th type of physiological signal acquiring devices can be described with . So the feature vector of the th class of affective states is denoted as . This dataset contains 8 types of affective state data in 20 days. In order to discuss the difference in these data, that is, dispersion between classes or within one class, two affective state feature matrixes and are established with . is composed of 8 types of affective state feature vectors on day ; that is, . And is composed of the same types of affective state feature vectors in 20 days; that is, . According to multidimensional scaling theory [21], build a dissimilarity matrix with affective state feature matrix and especially in this paper. in can be calculated as Then, calculate the inner product matrix . Its element is where Designate reconstructed matrix in low-dimensional space as , which could be got through affective state feature matrix. And correspondingly, its affective state dissimilarity matrix is recorded as . Based on the theory of metric multidimensional scaling, is similar to in a sense. Then, Solving (6), affective state feature reconstructed matrix in low-dimensional space could be got. That is to say affective state feature could be presented in low-dimensional space.

At the same time, it is easy to obtain eigenvalues which the th dimension of is corresponding to: where are elements of .

4. Experiment

4.1. Class Divisibility

Take 8 classes of affective state feature vector on the day to form a matrix . And based on the theory of metric multidimensional scaling above, after reconstructing affective state feature matrix in low-dimensional space, analyze the class distance of samples measured by the body sensor network. According to Kruskal’s stress requirements, in this paper, each affection feature vector is reconstructed in two-dimensional space as shown in Figure 2.

fig2
Figure 2: Restructuring graph of affective eigenvectors on the th day.

In Figure 2, N, A, H, G, P, L, J, and R represent 8 classes of affective states, respectively. The axes of the left figures mean relative distance between reconstructive points. Take Figure 2(a) as an example; points L and J are closer, which demonstrates that the two types of affection, romantic love L and happiness J, only have few differences for the first day samples while affective physiological data are described with 6 static features above. Their class divisibility is too poor to train an effective classifier. Points R, P, H, and G have few differences in dimension II but some differences in dimension I. However, there are large differences for points A and N no matter in dimension I or II.

The right part of Figure 2(a) shows the linear fit scatter plot of reconstruction process. The -axis means the samples disparity, and the -axis reflects the fitting distance. Fitting coefficient is good enough. Young's S-stress and Kruskal’s stress reach 0.407% and 1.264%, respectively. And the determination coefficient RSQ is 0.99922, which means that the proportion of explaining by relative spatial distance is larger. The affection eigenvector reconstruction process data of the th day are summarized in Table 3.

tab3
Table 3: Summary of affective eigenvectors restructuring process on the th day.
4.2. Intraclass Compactness

Affective state feature matrix consists of the same type of affective state feature vector for 20 days. Based on metric multidimensional scaling theory stated above, reconstruct affective state feature in low-dimensional space to analyze the intraclass distance of samples. The reconstruction in two-dimensional space is as shown in Figure 3.

fig3
Figure 3: Restructuring graph of 8 types of affective eigenvectors.

In Figure 3, points Day 1–Day 20 denote the eigenvectors of 20 days for the same kind of affective state. From the left part of Figure 3, the axes also mean relative distance between reconstructive points. Points Day 1, Day 3, Day 4, and Day 5 are far away from the rest of the reconstructive points. That is to say intraclass distances of the same type of affective physiological data for the first day and the 3th–5th days are larger. Their intraclass compactness is poor. In addition, the 7th day samples also have a larger intraclass distance for anger affective state.

The right part of Figure 3 shows the linear fit scatter plot of reconstruction process. The -axis means the samples disparity, and the -axis reflects the fitting distance. Fitting coefficient is close to 1. Young's S-stress, Kruskal’s stress, and determination coefficient RSQ for the reconstructive process of 8 types of affective state feature vector are summarized in Table 4.

tab4
Table 4: Summary of 8 types of affective eigenvectors restructuring process.

5. Conclusions

As training samples of a classifier, the validness of affective physiological feature vectors is worthy of study. Larger classes distance and smaller intraclass distance are needed. An analysis method is proposed for body sensor network, which collects affective physiological data. Particularly, in this paper, we take the affective physiological database DataSet I as an example, and analyze divisibility and compactness of 20 groups of samples belonging to 8 types of affections.

Based on the 6 static features described by formulas (1)–(2), with the samples in DataSet I, class divisibility is poor for the 4 types of affection P, L, J, and R in one day. And for the same affective type, intraclass compactness is poor for the 1st, 3rd, 4th, and 5th days.

Acknowledgment

This work was supported by the Foundation for Young Scholars of Hebei Educational Committee (QN20131152, Q2012070).

References

  1. Z. Wang, “Artificial psychology—a most accessible science research to human brain,” Journal of University of Science and Technology Beijing, vol. 22, no. 5, pp. 478–481, 2000. View at Scopus
  2. E. Oliveira, N. M. Ribeiro, and T. Chambel, “Towards enhanced video access and recommendation through emotions,” in Proceedings of the ACM Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, 2010.
  3. S. J. Kim, J. S. Kim, S. H. Kim, et al., “Evolvable recommendation system in the portable device based on the emotion awareness Heidelberg,” in Proceedings of 9th International Conference on Knowledge-Based & Intelligent Information & Engineering Systems (KES), pp. 251–257, Springer, Berlin, Germany, 2005.
  4. T. L. Nguyen, EmuPlayer: Music Recommendation System Based on User Emotion Using Vital-Sensor, Keio University, Kanagawa, Japan, 2010.
  5. I. Arapakis, Y. Moshfeghi, H. Joho, R. Ren, D. Hannah, and J. M. Jose, “Integrating facial expressions into user profiling for the improvement of a multimodal recommender system,” in Proceedings of the IEEE International Conference on Multimedia and Expo (ICME '09), pp. 1440–1443, New York, NY , USA, July 2009. View at Publisher · View at Google Scholar · View at Scopus
  6. G. González, B. López, and J. L. De la Rosa, “Managing emotions in smart user models for recommender systems,” in Proceedings of the 6th International Conference on Enterprise Information Systems, pp. 187–194, AllBusiness, Atlanta, Ga, USA, 2004.
  7. J. P. Li, P. Zhang, L. F. Wang, et al., “Experiment study of autonomic nervous response patterns in five basic emotions,” Chinese Journal of Behavioral Medical Science, vol. 14, no. 2, pp. 257–259, 2005.
  8. I. C. Christie and B. H. Friedman, “Autonomic specificity of discrete emotion and dimensions of affective space: a multivariate approach,” International Journal of Psychophysiology, vol. 51, no. 2, pp. 143–153, 2004. View at Publisher · View at Google Scholar · View at Scopus
  9. M. M. Bradley and P. J. Lang, “Affective reactions to acoustic stimuli,” Psychophysiology, vol. 37, no. 2, pp. 204–215, 2000. View at Publisher · View at Google Scholar · View at Scopus
  10. J. T. Cacioppo, G. G. Berntson, J. T. Larsen, et al., “The psychophysiology of emotion,” in The Handbook of Emotion, M. Lewis and J. M. Haviland-Jones, Eds., pp. 173–191, Guilford Press, New York, NY, USA, 2000.
  11. P. Gomez, W. A. Stahel, and B. Danuser, “Respiratory responses during affective picture viewing,” Biological Psychology, vol. 67, no. 3, pp. 359–373, 2004. View at Publisher · View at Google Scholar · View at Scopus
  12. P. Gomez, P. Zimmermann, S. Guttormsen-Schär, and B. Danuser, “Respiratory responses associated with affective processing of film stimuli,” Biological Psychology, vol. 68, no. 3, pp. 223–235, 2005. View at Publisher · View at Google Scholar · View at Scopus
  13. I. Nyklíček, J. F. Thayer, and L. J. P. Van Doornen, “Cardiorespiratory differentiation of musically-induced emotions,” Journal of Psychophysiology, vol. 11, no. 4, pp. 304–321, 1997. View at Scopus
  14. D. Palomba, M. Sarlo, A. Angrilli, A. Mini, and L. Stegagno, “Cardiac responses associated with affective processing of unpleasant film stimuli,” International Journal of Psychophysiology, vol. 36, no. 1, pp. 45–57, 2000. View at Publisher · View at Google Scholar · View at Scopus
  15. P. Rainville, A. Bechara, N. Naqvi, and A. R. Damasio, “Basic emotions are associated with distinct patterns of cardiorespiratory activity,” International Journal of Psychophysiology, vol. 61, no. 1, pp. 5–18, 2006. View at Publisher · View at Google Scholar · View at Scopus
  16. W. H. Wen, Y. H. Qiu, G. Y. Liu, et al., “Construction and cross-correlation analysis of the affective physiological response database,” Scientia Sinica, vol. 41, no. 1, pp. 77–89, 2011.
  17. R. W. Picard, E. Vyzas, and J. Healey, “Toward machine emotional intelligence: analysis of affective physiological state,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 23, no. 10, pp. 1175–1191, 2001. View at Publisher · View at Google Scholar · View at Scopus
  18. K. H. Kim, S. W. Bang, and S. R. Kim, “Emotion recognition system using short-term monitoring of physiological signals,” Medical and Biological Engineering and Computing, vol. 42, no. 3, pp. 419–427, 2004. View at Publisher · View at Google Scholar · View at Scopus
  19. L. Li and J. H. Chen, “Emotion recognition using physiological signals,” in Lecture Notes in Computer Science, Z. G. Pan, A. Cheok, M. Haller, et al., Eds., pp. 437–446, Springer, Berlin, Germany, 2006.
  20. J. Kim and E. André, “Emotion recognition based on physiological changes in music listening,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 30, no. 12, pp. 2067–2083, 2008. View at Publisher · View at Google Scholar · View at Scopus
  21. M. L. Davison, Multidimensional Scalin, Wiley, New York, NY, USA, 1983.