Table of Contents Author Guidelines Submit a Manuscript
Computational and Mathematical Methods in Medicine
Volume 2015, Article ID 984353, 8 pages
http://dx.doi.org/10.1155/2015/984353
Review Article

Thermal Infrared Imaging-Based Computational Psychophysiology for Psychometrics

Infrared Imaging Lab, Institute for Advanced Biomedical Technology (ITAB), Department of Neuroscience, Imaging and Clinical Sciences, University of Chieti-Pescara, Via Luigi Polacchi 11, 66013 Chieti, Italy

Received 15 October 2014; Revised 5 January 2015; Accepted 27 January 2015

Academic Editor: Dimitris Giakoumis

Copyright © 2015 Daniela Cardone et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. R. Kirby, J. Forlizzi, and R. Simmons, “Affective social robots,” Robotics and Autonomous Systems, vol. 58, no. 3, pp. 322–332, 2010. View at Publisher · View at Google Scholar · View at Scopus
  2. A. Merla, “Thermal expression of intersubjectivity offers new possibilities to human-machine and technologically mediated interactions,” Frontiers in Psychology, vol. 5, article 802, 2014. View at Publisher · View at Google Scholar
  3. P. Ekman, R. W. Levenson, and W. V. Friesen, “Autonomic nervous system activity distinguishes among emotions,” Science, vol. 221, no. 4616, pp. 1208–1210, 1983. View at Publisher · View at Google Scholar · View at Scopus
  4. R. Vetrugno, R. Liguori, P. Cortelli, and P. Montagna, “Sympathetic skin response,” Clinical Autonomic Research, vol. 13, no. 4, pp. 256–270, 2003. View at Publisher · View at Google Scholar · View at Scopus
  5. S. D. Kreibig, “Autonomic nervous system activity in emotion: a review,” Biological Psychology, vol. 84, no. 3, pp. 394–421, 2010. View at Publisher · View at Google Scholar · View at Scopus
  6. A. Merla, L. Di Donato, P. M. Rossini, and G. L. Romani, “Emotion detection through functional infrared imaging: preliminary results,” Biomedizinische Technick, vol. 48, pp. 284–286, 2004. View at Google Scholar
  7. I. Fujimasa, “Pathophysiological expression and analysis of far infrared thermal images,” IEEE Engineering in Medicine and Biology Magazine, vol. 17, no. 4, pp. 34–42, 1998. View at Google Scholar
  8. R. Murthy and I. Pavlidis, “Noncontact measurement of breathing function,” IEEE Engineering in Medicine and Biology Magazine, vol. 25, no. 3, pp. 57–67, 2006. View at Publisher · View at Google Scholar · View at Scopus
  9. M. Garbey, N. Sun, A. Merla, and I. Pavlidis, “Contact-free measurement of cardiac pulse based on the analysis of thermal imagery,” IEEE Transactions on Biomedical Engineering, vol. 54, no. 8, pp. 1418–1426, 2007. View at Publisher · View at Google Scholar · View at Scopus
  10. A. Merla and G. L. Romani, “Thermal signatures of emotional arousal: a functional infrared imaging study,” in Proceedings of the 29th Annual International Conference of IEEE-EMBS, Engineering in Medicine and Biology Society (EMBC '07), pp. 247–249, Lyon, France, August 2007. View at Publisher · View at Google Scholar · View at Scopus
  11. I. T. Pavlidis, J. Dowdall, N. Sun, C. Puri, J. Fei, and M. Garbey, “Interacting with human physiology,” Computer Vision and Image Understanding, vol. 108, no. 1-2, pp. 150–170, 2007. View at Publisher · View at Google Scholar · View at Scopus
  12. D. Shastri, A. Merla, P. Tsiamyrtzis, and I. Pavlidis, “Imaging facial signs of neurophysiological responses,” IEEE Transactions on Biomedical Engineering, vol. 56, no. 2, pp. 477–484, 2009. View at Publisher · View at Google Scholar · View at Scopus
  13. I. Pavlidis, P. Tsiamyrtzis, D. Shastri et al., “Fast by nature—how stress patterns define human experience and performance in dexterous tasks,” Scientific Reports, vol. 2, article 305, 2012. View at Publisher · View at Google Scholar · View at Scopus
  14. A. Merla, “Method and system for the control of the residual efficiency of the interaction man-vehicle,” European Patent EP13425145, 2013.
  15. V. Engert, A. Merla, J. A. Grant, D. Cardone, A. Tusche, and T. Singer, “Exploring the use of thermal infrared imaging in human stress research,” PLoS ONE, vol. 9, no. 3, Article ID e90782, 2014. View at Publisher · View at Google Scholar · View at Scopus
  16. A. T. Krzywicki, G. G. Berntson, and B. L. O'Kane, “A non-contact technique for measuring eccrine sweat gland activity using passive thermal imaging,” Inernational Journal of Psychophysiology, vol. 94, no. 1, pp. 25–34, 2014. View at Publisher · View at Google Scholar
  17. C. B. Cross, J. A. Skipper, and D. Petkie, “Thermal imaging to detect physiological indicators of stress in humans,” in Thermosense: Thermal Infrared Applications XXXV, vol. 8705 of Proceedings of SPIE, Baltimore, Md, USA, 2013. View at Publisher · View at Google Scholar
  18. J. Dowdall, I. T. Pavlidis, and P. Tsiamyrtzis, “Coalitional tracking in facial infrared imaging and beyond,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, June 2006. View at Publisher · View at Google Scholar · View at Scopus
  19. Y. Zhou, P. Tsiamyrtzis, and I. Pavlidis, “Tissue tracking in thermo-physiological imagery through spatio-temporal smoothing,” Medical Imaging Computing and Computer Assisted Intervention, vol. 12, part 2, pp. 1092–1099, 2009. View at Google Scholar
  20. N. Sun, I. Pavlidis, M. Garbey, and J. Fei, “Harvesting the thermal cardiac pulse signal,” in Medical Image Computing and Computer-Assisted Intervention—MICCAI 2006, vol. 4191 of Lecture Notes in Computer Science, pp. 569–576, Springer, Berlin, Germany, 2006. View at Publisher · View at Google Scholar
  21. T. Bourlai, P. Buddharaju, I. Pavlidis, and B. Bass, “On enhancing cardiac pulse measurements through thermal imaging,” in Proceedings of the 9th International Conference on Information Technology and Applications in Biomedicine (ITAB '09), Larnaca, Cyprus, November 2009. View at Publisher · View at Google Scholar · View at Scopus
  22. A. A. Farag and S. Y. Chekmenev, “U.S. Patent Application 13/720,453,” 2012.
  23. S. Y. Chekmenev, A. A. Farag, and E. A. Essock, “Thermal imaging of the superficial temporal artery: an arterial pulse recovery model,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR '07), pp. 1–6, IEEE, June 2007. View at Publisher · View at Google Scholar · View at Scopus
  24. A. Merla, L. di Donato, G. L. Romani, M. Proietti, and F. Salsano, “Comparison of thermal infrared and laser doppler imaging in the assessment of cutaneous tissue perfusion in healthy controls and scleroderma patients,” International Journal of Immunopathology and Pharmacology, vol. 21, no. 3, pp. 679–686, 2008. View at Google Scholar · View at Scopus
  25. A. Kamal, “Assessment of autonomic function in patients with rheumatoid arthritis using spectral analysis and approximate entropy method,” Neurosciences, vol. 12, no. 2, pp. 136–139, 2007. View at Google Scholar · View at Scopus
  26. J. N. Murthy, J. van Jaarsveld, J. Fei et al., “Thermal infrared imaging: a novel method to monitor airflow during polysomnography,” Sleep, vol. 32, no. 11, pp. 1521–1527, 2009. View at Google Scholar · View at Scopus
  27. G. F. Lewis, R. G. Gatto, and S. W. Porges, “A novel method for extracting respiration rate and relative tidal volume from infrared thermography,” Psychophysiology, vol. 48, no. 7, pp. 877–887, 2011. View at Publisher · View at Google Scholar · View at Scopus
  28. R. Murthy, I. Pavlidis, and P. Tsiamyrtzis, “Touchless monitoring of breathing function,” in Proceedings of the 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC '04), vol. 1, pp. 1196–1199, IEEE, September 2004. View at Scopus
  29. S. Y. Chekmenev, H. Rara, and A. A. Farag, “Non-contact, wavelet-based measurement of vital signs using thermal imaging,” in Proceedings of the 1st International Conference on Graphics, Vision, and Image Processing (GVIP '05), pp. 107–112, Cairo, Egypt, 2005.
  30. J. Fei and I. Pavlidis, “Thermistor at a distance: unobtrusive measurement of breathing,” IEEE Transactions on Biomedical Engineering, vol. 57, no. 4, pp. 988–998, 2010. View at Publisher · View at Google Scholar · View at Scopus
  31. L. J. Goldman, “Nasal airflow and thoracoabdominal motion in children using infrared thermographic video processing,” Pediatric Pulmonology, vol. 47, no. 5, pp. 476–486, 2012. View at Publisher · View at Google Scholar · View at Scopus
  32. J. Fei, I. Pavlidis, and J. Murthy, “Thermal vision for sleep apnea monitoring,” Medical Imaging Computing and Computer Assisted Intervention, vol. 12, no. 2, pp. 1084–1091, 2009. View at Google Scholar · View at Scopus
  33. I. Pavlidis and J. A. Levine, “Thermal image analysis for polygraph testing,” IEEE Engineering in Medicine and Biology Magazine, vol. 21, no. 6, pp. 56–64, 2002. View at Publisher · View at Google Scholar · View at Scopus
  34. I. Fujimasa, T. Chinzei, and I. Saito, “Converting far infrared image information to other physiological data: the correlation of skin-surface temperature to physiological functions that control body temperature,” IEEE Engineering in Medicine and Biology, vol. 19, no. 3, pp. 71–76, 2000. View at Google Scholar · View at Scopus
  35. M. Coli, L. Fontanella, L. Ippoliti, and A. Merla, “Multiresolution KLE of psycho-physiological signals,” in Proceedings of S.Co. 2007, Book of Short Papers, pp. 116–121, 2007. View at Google Scholar
  36. A. Merla, “Computational physiology in a thermal image setting,” in Proceedings of 5th Conference on Complex Models and Computational Intensive Methods for Estimation and Prediction (S.Co. '07), Book of Short Papers, pp. 338–343, Venice, Italy, 2007.
  37. A. Di Giacinto, M. Brunetti, G. Sepede, A. Ferretti, and A. Merla, “Thermal signature of fear conditioning in mild post traumatic stress disorder,” Neuroscience, vol. 266, pp. 216–223, 2014. View at Publisher · View at Google Scholar
  38. K. I. Calvin and V. G. Duffy, “Development of a facial skin temperature-based methodology for non-intrusive mental workload measurement,” Occupational Ergonomics, vol. 7, pp. 83–94, 2007. View at Google Scholar · View at Scopus
  39. C. Puri, L. Olson, I. Pavlidis, J. Levine, and J. Starren, “Stresscam: non-contact measurement of users' emotional states through thermal imaging,” in Proceedings of the ACM Conference on Human Factors in Computing Systems, vol. 2, pp. 1725–1728, April 2005. View at Publisher · View at Google Scholar · View at Scopus
  40. Z. Zhu, P. Tsiamyrtzis, and I. Pavlidis, “Forehead thermal signature extraction in lie detection,” in Proceedings of the 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS '07), pp. 243–246, Lyon, France, August 2007. View at Publisher · View at Google Scholar
  41. J. Kang, J. A. McGinley, G. McFadyen, and K. Babski-Reeves, “Determining learning level and effective training times,” in Proceedings of the 25th Army Science Conference, Orlando, Fla, USA, Novmber 2006.
  42. J. Hines and G. E. Brown, “A standard stimulant for measuring vasomotor reactions: its application in the study of hypertension,” Proceedings of the Staff Meetings of the Mayo Clinic, vol. 7, pp. 332–335, 1932. View at Google Scholar
  43. C. Kirschbaum, K.-M. Pirke, and D. H. Hellhammer, “The “Trier social stress test”—a tool for investigating psychobiological stress responses in a laboratory setting,” Neuropsychobiology, vol. 28, no. 1-2, pp. 76–81, 1993. View at Publisher · View at Google Scholar · View at Scopus
  44. P. Buddharaju, I. T. Pavlidis, and P. Tsiamyrtzis, “Physiology-based face recognition,” in Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance (AVSS '05), pp. 354–359, September 2005. View at Publisher · View at Google Scholar · View at Scopus
  45. M. M. Khan, R. D. Ward, and M. Ingleby, “Classifying pretended and evoked facial expressions of positive and negative affective states using infrared measurement of skin temperature,” ACM Transactions on Applied Perception, vol. 6, no. 1, article 6, 2009. View at Publisher · View at Google Scholar · View at Scopus
  46. B. R. Nhan and T. Chau, “Classifying affective states using thermal infrared imaging of the human face,” IEEE Transactions on Biomedical Engineering, vol. 57, no. 4, pp. 979–987, 2010. View at Publisher · View at Google Scholar · View at Scopus
  47. S. Ioannou, V. Gallese, and A. Merla, “Thermal infrared imaging in psychophysiology: potentialities and limits,” Psychophysiology, vol. 51, no. 10, pp. 951–963, 2014. View at Publisher · View at Google Scholar
  48. S. J. Ebisch, T. Aureli, D. Bafunno, D. Cardone, G. L. Romani, and A. Merla, “Mother and child in synchrony: thermal facial imprints of autonomic contagion,” Biological Psychology, vol. 89, no. 1, pp. 123–129, 2012. View at Publisher · View at Google Scholar · View at Scopus
  49. B. Manini, D. Cardone, S. J. H. Ebisch, D. Bafunno, T. Aureli, and A. Merla, “Mom feels what her child feels:thermal signatures of vicarious autonomic response while watching children in a stressful situation,” Frontiers in Human Neuroscience, 2013. View at Publisher · View at Google Scholar · View at Scopus
  50. S. Ioannou, S. Ebisch, T. Aureli et al., “The autonomic signature of guilt in children: a thermal infrared imaging study,” PLoS ONE, vol. 8, no. 11, Article ID e79440, 2013. View at Publisher · View at Google Scholar · View at Scopus
  51. C. A. Hahn, R. D. Whitehead, M. Albrecht, C. E. Lefevre, and D. I. Perret, “Hot or not? Thermal reactions to social contact,” Biology Letters, vol. 8, no. 5, pp. 864–867, 2012. View at Publisher · View at Google Scholar
  52. I. Pavlidis and J. Levine, “Thermal image analysis for polygraph testing,” IEEE Engineering in Medicine and Biology Magazine, vol. 21, no. 6, pp. 56–64, 2002. View at Publisher · View at Google Scholar · View at Scopus
  53. D. A. Pollina, A. B. Dollins, S. M. Senter et al., “Facial skin surface temperature changes during a ‘concealed information’ test,” Annals of Biomedical Engineering, vol. 34, no. 7, pp. 1182–1189, 2006. View at Publisher · View at Google Scholar · View at Scopus
  54. K. Narita, T. Murata, T. Hamada et al., “Interactions among higher trait anxiety, sympathetic activity, and endothelial function in the elderly,” Journal of Psychiatric Research, vol. 41, no. 5, pp. 418–427, 2007. View at Publisher · View at Google Scholar · View at Scopus
  55. M. Mendolia, “An index of self-regulation of emotion and the study of repression in social contexts that threaten or do not threaten self-concept,” Emotion, vol. 2, no. 3, pp. 215–232, 2002. View at Publisher · View at Google Scholar · View at Scopus