Evaluating the User Physical Stresses Associated with Watching 3D and 2D Displays over Extended Time Using Heart Rate Variability, Galvanic Skin Resistance, and Performance Measure

Ramadan, Mohamed Z.; Alhaag, Mohammed H.

doi:https://doi.org/10.1155/2018/2632157

Journal of Sensors

On this page

Abstract Introduction Methods Results Discussion Conclusion Conflicts of Interest Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2018 | Article ID 2632157 | https://doi.org/10.1155/2018/2632157

Evaluating the User Physical Stresses Associated with Watching 3D and 2D Displays over Extended Time Using Heart Rate Variability, Galvanic Skin Resistance, and Performance Measure

Mohamed Z. Ramadan¹and Mohammed H. Alhaag¹

Academic Editor: Fanli Meng

Received11 Oct 2017

Revised11 Feb 2018

Accepted28 Feb 2018

Published25 Sept 2018

Abstract

This paper compares the effects of viewing videos with 2D and 3D displays with regard to the viewing distance (3 vs. 6, where is the height of the screen) and viewing time to determine the physical stresses in terms of heart rate variability, galvanic skin resistance (GSR), and performance of the viewer (percent of correct responses). Twenty healthy male university students with a mean age ± standard deviation of 27.7 ± 2.53 years participated in this study as volunteers. None had color blindness, and all had normal vision acuity. Display type by viewing distance interaction had a significant effect on most of the heart rate variability measures and associated with watching time for the GSR responses. The results concluded that viewing the 3D display from a short viewing distance produced significantly high physical stresses compared to viewing the 2D display from the same short viewing distance. However, the 3D display seemed to impart lower physical stress than the 2D display at long viewing distances. The findings of this study indicate that physical stresses appeared significant at close viewing distance after watching a 3D display for 50 min and increased with continued watching time. In addition, viewer performance was higher for the 3D compared to 2D display type.

1. Introduction

The use of stereoscopic 3D display has been associated with a myriad of visual fatigue symptoms such as nausea, fatigue, eyestrain, malaise, and headache [1]. These symptoms were observed to have a higher rate of incidence within existing populations. The American Optometric Association (1995) performed a survey that discussed the occurrence of these symptoms in at least a quarter of individuals who played 3D video games or watched 3D films [1, 2]. Such results were corroborated by informal online surveys conducted by http://HomeTheater.com that highlighted the presence of visual fatigue symptoms in 53% of individuals who extensively viewed 3D content [1, 3].

Additional independent research that revolved around the use of observational studies and public surveys reported that 25–50% of 3D viewers experienced eyestrain and other fatigue symptoms [2–5]. A current large-scale study with appropriate experimental controls discussed that the actual incidence rate of these symptoms was still relatively high even though it was less than previously believed [4, 6]. In particular, 3D viewing was seen to be a causal factor for eyestrain and headache occurrence in 14% of 3D viewers. Furthermore, the study noted that an additional 8% of the 3D viewers expressed discomfort that arose either as a result of the 3D glasses or due to the nocebo effect in the form of negative presumptions regarding 3D viewing [4, 6].

The visual fatigue linked with 3D displays has been affected by the viewing time and distance [7–9]. The guidelines for video displays [7] defined the watching distance as an essential environmental condition in which the discomfort due to negative and positive conflicts in the binocular disparity depends strongly on it [10]. In addition, the degree of visual fatigue might be increased due to the prolonged viewing of a 3D display [8, 11]. According to the American Optometric Association, using of visual systems for a long time causes inefficient visual processing functions and leads to visual fatigue [2].

Several studies have been conducted to evaluate visual fatigue by using subjective ratings and physiological evaluation methods. Kennedy et al. [12] developed a Simulator Sickness Questionnaire (SSQ), and Kuze and Ukai [13] established a questionnaire to evaluate subjectively the visual fatigue caused by watching movies, TV programs, and video games. Lambooij et al. [8] recommended that to evaluate stereoscopic visual fatigue subjectively, the questionnaire should include the items summarized in Sheedy et al.’s questionnaires [14]. In addition, numerous studies have been carried out to evaluate visual fatigue using electroencephalogram (EEG) features in 3D display environment [15–27]. Other objective methods include electrocardiography (ECG) and galvanic skin resistance (GSR) in a 3D display environment [28–41]. Wang et al. [42] used a questionnaire and optometric indicators comprising fusion range as well as accommodation convergence/accommodation (AC/A) ratio to investigate relationship between visual fatigue and viewers’ phoria for viewing autostereoscopic 3D displays. Wang et al. [43] investigated the binocular fusion range for a polarized 3D display. Recently, Alhaag and Ramadan [44] used electromyography (EMG) responses to investigate the effects of the display type on visual fatigue.

The ECG is a graphic recording of electrical activity of the heart during the cardiac cycle. General characteristics of the ECG signal are heart rate variability, heart rate, and interbeat interval (RR). The emotional state of the individual affects the heart rate, or pulse per minute, which easily differentiates between different emotions of individuals. Heart rate variability is assumed as a measure of autonomic nervous system activity based on the assumption that visual fatigue is associated with the increase of autonomic nervous system. Park et al. [35] assessed the effects of viewing 3DTV in young and elderly subjects using ECG. Results of Park et al. [34] showed that the average RR was decreased significantly for watching 3D visuals as opposed to 2D visuals, and the variation in the low-frequency/high-frequency (LF/HF) rhythm ratio was increased significantly when watching 3D visuals. The 3D visuals generate higher fatigue and stress in the elderly than the young subjects. Park et al. [37] used heart rhythm and autonomic balance to evaluate 3D visual fatigue. They found that viewing 3D rather than 2D video destabilizes the heart rhythm and increases heart rate, as well as induces a shift in autonomic balance, mainly due to increased activation of sympathetic nerves. Moreover, the autonomic balance was significantly different between the 2D and 3D groups.

Chen et al. [40] used a spectral analysis of heart rate variability (HRV) and subjective physiological measures to identify if individuals would be subject to fatigue, weakness, and any other discomfort factors after viewing a 3D video. They found a decrease in parasympathetic nervous activities of the participants after viewing a 3D video, which indicated that viewing a 3D video would render people uncomfortable and tired. In addition, there were insignificant differences in the sympathetic and parasympathetic nerve activities prior and following viewing a 2D video. Thus, they suggested that HRV measure could be an objective indicator for visual fatigue during viewing of 3D videos.

An alternative method that measures a sympathetic nervous system function is galvanic skin resistance (GSR) [45]. The GSR is a variation in the electrical properties of the human skin caused by an interaction between the individual’s psychological state and environmental actions [46]. When an individual is aroused or excited, the moisture levels in the skin change, causing changes in its electrical conductance. This phenomenon occurs because sweat glands are regulated by the sympathetic nervous system, and this variation in conductance can be an indirect measure of mental activity [46]. GSR is a nonintrusive quickly captured physiological signal mostly used for assessment of the actual state of the user, mainly for mental stress, arousal level, attention, emotional state, and anxiety [47–49]. As mental stress increases, variations in the electrical conductance of the skin are identified by GSR sensors. Kim et al. [33] recommended that GSR be utilized to evaluate visual fatigue in participants watching 3D and 2D displays.

Previous researchers that studied the physiological responses to watching display images compared measures recorded in pre- and postwatching periods to determine reliable measurement methods for visual fatigue. Hence, the physiological responses that occurred when the display was watched for an extended time were neglected. This study investigated the effects of the display type, viewing distance, and viewing time on the physical stress based on HRV and GSR. In addition, the performance of the viewer was measured by evaluating the number of correct answers to certain questions in a questionnaire related to the films that were watched.

2. Methods

2.1. Participants

The participants in the current study are the same as those used in the previous studies [27, 44]. Twenty healthy male university students with a mean ± SD age of 27.7 ± 2.53 years participated in this study as volunteers (more details on the participant’s characteristics are available in Alhaag and Ramadan [44]). A written informed consent form approved by the Human Participants Review Board of the university was completed by each participant prior to participation in the experiment. All participants had normal vision acuity, and none had any medical history. All participants were instructed to have a full night of rest and avoid cigarettes and caffeine in the preceding 6 h.

2.2. Instruments

The instruments used in this study are the same as those used in the previous studies [27, 44], which included a commercial 50-in LG 3D Smart TV (50LF650T) with passive 3D glasses. In addition, an 8-channel Biomonitor ME6000 (Mega Electronics Ltd., Kuopio, Finland), with one channel for ECG recording; sensor-CASSY (Leybolo Didactic GMBH, Germany); skin resistance box (Leybolo Didactic GMBH, Germany); a Snellen chart; GPM Vernier calipers; and measuring tape were used. The ECG signals were recorded using Mega Win 3.0.1 (Mega Electronics Ltd., Kuopio, Finland) at a sampling rate of 1000 Hz, and a CASSY Lab (Leybolo Didactic GMBH, Germany) was used to amplify and record the GSR sampling data at a sampling rate of 100 Hz. Additional materials used include 70% isopropyl alcohol swabs, cotton squares, bandages, and Ag/AgCl solid adhesive pregelled electrodes for ECG (Ambu A/S, Denmark). In addition, Kubios HRV software v2.2 (University of Western Finland, Finland) was employed to compute the HRV.

2.3. Experimental Setting

The experiment setup and specifications of the LG 3D smart TV adopted to conduct the current study are the same as those used in the previous studies (for more details, please see Ramadan et al. [27] and Alhaag and Ramadan [44]). Commercial movies in both 2D and 3D mode were displayed on a LG 3D Smart TV (50LF650T) using passive-row interlaced technology. The LG TV has the capability of changing from 2D to 3D mode and vice versa. The LG TV was positioned at a table height of 0.96 m with the center of the display height of 1.29 m from the lab floor. The viewing distances were 1.95 or 3.90 m (3 or 6). The reason for selecting three (3) or six (6) times the display height was recommended by the International Telecommunication Union (ITU) standards [50]. The back distance from the screen to the wall was set at 0.12 m. Black sheets were pasted on the wall surrounding the TV to eliminate any disturbance to the participant’s surrounding.

All experiments were conducted in the Human Factors Lab with an average dry-bulb temperature and relative humidity of 23.8°C and 30.6%, respectively. The experimental zone was ensured to have no vibrations or strong odors during the test. Lighting conditions were maintained constant for all sessions. The environmental luminance at the screen center was approximately 250 lux. The participants were asked to be seated in front of the display center and maintain their eyes’ position constant across all sessions at viewing distances of 1.95 or 3.90 meters.

2.4. Experimental Design

Four independent variables were considered: two involved repeated measures and the remaining two were binary variables. Thus, the mixed design (i.e., ) was used to represent the experiment. The two independent binary variables were () the display type (2D vs. 3D) and () viewing distance (3 vs. 6). The two independent variables based on repeated measures were () movies (Avengers, Jurassic World, San Andreas, and Godzilla) and () viewing time (pretest, T10, T20, T30, T40, T50, T60, and posttest). This experiment examined the influence of the viewing distance and display type in a repeated experiment based on the session time. Thus, it was a 2 × 2 × 4 × 8 design. Each of the () and () = 2 × 2 = 4 display-distance conditions contained participants, and each participant watched all four movies. All physiological measurements were measured continuously: pretest (3 min prior to executing the experiment), T10 (first 10 min period), T20 (second 10 min period), T30 (third 10 min period), T40 (fourth 10 min period), T50 (fifth 10 min period), T60 (sixth and last 10 min period), and posttest (3 min period after watching videos). In addition, pairwise comparisons were used to investigate the source of any significant effects regarding the time factor.

2.5. Task Performance

The performance of the viewer was measured by evaluating the number of correct answers to certain questions in a questionnaire related to the films that were watched. These questions were related to the actions in and views on what occurred in the movie and are represented in percent of correct responses.

2.6. Physiological Measures

2.6.1. Heart Rate Variability

HRV is assumed as a measure of autonomic nervous system activity based on the assumption that visual fatigue can increase autonomic nervous system activity. Therefore, it is likely possible to measure visual fatigue by measuring HRV. Chen et al. [40] showed that HRV could be an objective physiological indicator for visual fatigue during watching 3D movies. In this study, HRV is used as an indicator to measure physical stress, which was adopted from Markov et al. [51]. The time domain measures of HRV used in this study include the average of RR intervals (RR), the corresponding average heart rate (HR), the standard deviation of normal RR intervals (SDNN), the root mean square of successive differences in RR intervals (RMSSD), number of successive intervals differing more than 50 ms (NN50), and the percentage rate of times a successive RR interval was greater than the previous interval by >50 ms (pNN50). The SDNN reveals the overall HRV for both sympathetic and parasympathetic influences [51], while RMSSD can be used as a measure of short-term variability [52]. In addition, the pNN50 and RMSSD are indicators corresponding to parasympathetic neural regulation of the heart [51].

HRV frequency domain measures were further investigated, which were low frequency (–0.15 Hz), very low frequency (–0.04 Hz), high frequency (–0.4 Hz), and finally total power (–0.4 Hz). The sum power was deemed to be an indicator for the comprehensive autonomic activity [51]. Also, it was found that the vagal nerve activity influenced the HF band’s power spectrum, while the sympathetic nerve activity influenced the LF band’s power spectrum [51]. In addition, the sympathetic-parasympathetic balance was deemed to be indicated by the absolute power ratio in the LF and HF bands (LF/HF) [52]. The components of the frequency domain were computed in terms of relative values (%) and absolute units (ms²).

2.6.2. Galvanic Skin Resistance (GSR)

GSR is a method of capturing the autonomic nerve response as a feature of the sweat gland function to measure the electrical resistance of the skin. Higher GSR levels recorded during stressful tasks indicate higher levels of stress [53, 54]. Kim et al. [33] recommended that GSR can be utilized to evaluate physical stresses in participants watching 3D and 2D displays.

In this work, the electrical conductance of the skin was measured by attaching Velcro strip electrodes to the tips of the participants’ index and ring fingers. To reduce errors in the GSR measurement and compare within and between individuals during experiments, GSC was standardized as a percentage change from baseline (%ΔGSR) [55, 56]. This baseline value is defined as the difference between the maximum GSR value recorded during the most arousing period and the minimum GSR value recorded during the resting period in a room environment. All physiological data was measured and recorded continuously during the one-hour test with 10 min interval averages calculated, with the exception of the period prior to initiation of the experiment (pre-5 min period) and the last 3 min (post).

2.7. Statistical Analysis

A four-way mixed repeated ANOVA was implemented to examine the time, films, display type, and viewing distance effect on response variables (hear rate variability and GSR). In addition, univariate ANOVA was performed to study the effect of display type and viewing distance on ratings of correct answers. Finally, pairwise comparisons were used to investigate the source of any significant effects. Statistical analysis was achieved using SPSS Version 23. It is worth noting that ANOVA requires that certain assumptions be met, including homogeneity of variance in the data, normality, and continuous data (not dichotomous). In addition, not only the statistical significance is calculated but also the effect size based on the partial eta-squared value (). Partial eta-squared indicates the variance percentage in the dependent variables attributable to particular independent variables [57].

2.8. Experimental Protocol

The experimental protocol of this study is the same protocol used in the previous studies [27, 44]. Participants were introduced and welcomed to the experimental room. Each participant was required to come to the lab four times on different days for approximately 2 h each time. This allowed the physical stress associated with the four watched films to be evaluated on separate days without interference from the other movies. The interval time between visits was at least 48 h. During the preexperiment session (first visit), each participant was briefed regarding the objective of the study and experimental procedure as well as the time required for each visit. Then, the participants were given the opportunity to ask any questions regarding the study. They were informed of their right to cease participation in the experiment at any time. Then, each participant was given a consent form to read and sign and a demographic questionnaire to complete. Visual acuity and color blindness tests were conducted.

On execution of the experimental sessions, the participants were prepared to place electrodes on their skin for ECG and GSR sensors. For a comparative evaluation of the visual fatigue, the twenty participants were randomly allocated to one of the following four conditions: (i)Condition 1: view the four videos in 3D from a distance of 1.95 m (3D3)(ii)Condition 2: view the four videos in 3D from a distance of 3.90 m (3D6)(iii)Condition 3: view the four videos in 2D from a distance of 1.95 m (2D3)(iv)Condition 4: view the four videos in 2D from a distance of 3.90 m (2D6)

The four films were watched randomly by each participant. None of the participants was allowed to participate under more than one condition to avoid bias and the learning effect. In other words, if a subject watched the same film under more than one condition, he may become drowsy or bored, which could affect the HRV and GSR (i.e., response variables). Participants who watched the 3D movies wore passive 3D glasses with lenses containing circular-polarizing filters.

The ECG and GSR signals were recorded for 3 min (pretest). The participant then watched the assigned movie from the designated distance in the assigned mode (2D or 3D) for 1 h while the ECG and GSR signals were recorded for 60 min (this was later divided into six 10 min sessions). After the participant finished watching the movie, the ECG and GSR signals were recorded continuously for another 3 min (posttest). Finally, the participant answered the movie perception questionnaire to evaluate participant comprehension. The right wrist, upper right forearm (distal to the elbow), and the upper left forearm (distal to the elbow) were selected for ECG electrode placements. The selected skin positions were cleaned using 70% isopropyl alcohol swabs. The Ag/AgCl pregelled electrodes were placed in prepared positions. The red ECG clip was attached to the electrode tab on the upper left forearm (distal to elbow). The yellow and black clips were attached to electrode tabs on the upper right forearm (distal to the elbow) and the right wrist, respectively. The three ECG leads were connected to 1-ch ECG preamplifier for ME 6000. The 1-ch ECG preamplifier was connected to ch-3 and ch-4 of the ME 6000. The participant was asked to be seated in a relaxed position on a chair, resting his forearm on the arms of the chair or his legs, as shown in Figure 1.

3. Results

3.1. Performance Measure

The performance of the viewer was measured at the end of each video in terms of correct answers to the questions presented in a questionnaire related to the film. Results indicated that display type had a significant effect on the performance of the viewer, , , . For the 3D display, the participant’s performance (88.3% (15.7%)) was significantly higher than the performance with the 2D display (70% (20%)) regardless of the distance, as shown in Figure 2.

3.2. Heart Rate Variability Analysis

It was seen that there was a general pattern noted with regard to all the cardiovascular measures, through which the difference between the viewing distances and the displays was observed. Although there were individual differences between the study participants, it was noted that the results proved to be valid for every participant. Additionally, the results obtained for a few of the cardiovascular measures were seen to depend on the type of display and the distance. It was seen that the other cardiovascular measures depended strongly on interactions. These results have been illustrated in Table 1.

3.2.1. Time Domain Measures

A time domain comparison of the different cardiovascular measures was made between the viewing distance and the type of display. This comparison was inclusive of STDHR, RR, NN50, HR, RMSSD, pNN50, and SDRR parameters. Significant differences were noted between the 3D and 2D type of display within the HR measure. The HR was significantly higher (approximately 7 bpm) for the 3D than the 2D display experiments. This held true for films in excess of one hour. It can be concluded that watching films with 3D display, under highly monotonous conditions, is more demanding than the 2D display. In addition, significant differences between viewing displays at near and far distances can be detected only in the HR itself (). The HR was significantly higher (approximately 3 bpm) while watching films from a great distance (6) than from near distance (3).

Significant interactions between display type and viewing distance can be detected in the rest time domain measures. For 3D display, no significant changes in the STDHR, RR, SDRR, RMSSD, NN50, and pNN50 were observed regardless of distance. For 2D display, however, significant decreases in the STDHR, RR, SDRR, RMSSD, NN50, and pNN50 values approximately 21%, 6.6%, 37.7%, 50%, 238%, and 240%, respectively, were observed when the participates switch watching films from near (3) to far distance (6), for all measures.

3.2.2. Frequency Domain Measures

As shown in Table 1, a significant interaction effect between display type and viewing distance was found for the HF power band, . In addition, there was a significant display type effect on the HRV parameters (VLF and LF/HF absolute power). Neither the display type nor the viewing distance factor had an effect on the LF power. The measured VLF power showed a significant decrement when participants watched a 3D display compared to a 2D display, . The circadian effect was noted to be equal for both far and near viewing distances, which was revealed by the VLF parameter. Thus, there existed no variation in the band power of the VLF. Trutschel et al. [58] showed that VLF power was not appropriate with regard to workload discrimination; it nevertheless demonstrated the impact of the circadian effect on the performance and fatigue data. The LF/HF ratio band specifically demonstrated a significant decrease with regard to those participants that viewed the 3D display as compared to the participants that viewed the 2D display (). The HF parameter illustrated the effect of respiration on the heart that played a vital function in the strenuous near viewing of the 3D display.

3.3. Galvanic Skin Resistance

The results show that both the main variables had significant effect on GSR, display type (, , ), and viewing distance (, , ). In addition, the display type by session interaction and viewing distance by session interaction had significant effects on GSR, (, , ), (, , ), respectively. Finally, the display type by viewing distance by session interaction had a significant effect on GSR, (, , ).

The simple effect technique [59] was used to analyze the three-way interaction. As shown in Figure 3(a), it can be concluded that both display types (2D and 3D) follow the same trends with time. However, after 50 minutes of watching, there is a significant increase in the %ΔGSR for participants watching the 3D display compared to those watching the 2D display. In addition, as shown Figure 3(b), for the 3D display, the %ΔGSR increased steeply during the first 40 min and then decreased significantly until the end of experimental time. However, in the case of the 2D display, the %ΔGSR was increasing slightly steady to the end of the experiment. Based on a pairwise comparison, there were significant differences between the two display types in different sessions. Participants watching the 3D display exhibited less %ΔGSR after 50 min compared to those watching the 2D display.

(a)

(b)

4. Discussion

In this study, performance (percent of correct responses), HRV, and GSR were used to evaluate the effect of watching films on 2D and 3D displays from different viewing distances (3 vs. 6) over a viewing time of 60 min on the physical stress of the individual. Participants who watched videos on the 3D display exhibited a higher performance (percent of correct responses) than those who watched on the 2D display, regardless of the viewing distance (short or long). Based on this study, the heart rate (beats per minute) of the participants was investigated during the watching of different films on 2D and 3D displays over sixty minutes from a long and a short viewing distance. Hence, it has been found that the heart rate increased significantly when the participant was watching the 3D display. The heart rate increased slightly from the preview over the first twenty minutes (session 3) and remained stable to fifty minutes (session 5); then, it increased slightly again from session five until the end of the film. Furthermore, it has been found that watching the 3D display from a short viewing distance contributes to increasing the heart rate to 81.16 bpm, whereas it contributes to a decrease in heart rate to 74.110 bpm for the 2D display. For the long viewing distance (6), there is no statistically significant effect of display type on the heart rate; however, the 3D display contributes to increasing the heart rate. Moreover, when the viewing distance is changed from 3 to 6, the heart rate increased for the 2D display type, whereas it decreased for the 3D display type.

The reasons for the increasing heart rate associated with watching a 3D display from a short distance may be due to the excitement and appeal of as well as immersion in the 3D display. This result agrees with that of Åkerstedt et al. [60] wherein they state that visual fatigue could result from immersion in work. Furthermore, this result is consistent with Park et al. [37] who showed that viewing 3D rather than 2D video destabilizes the heart rhythm and increases the heart rate. They further showed that the visual fatigue caused by viewing 3D video is related to these changes in the heart rhythm. This is because the vagal nerve endings in the heart can transfer signal changes in the heart rhythm and blood pressure to the brain. This situation leads to emotional stress and reduced cognitive and reactive functions [37, 61–64]. The reasons for the increasing heart rate while watching a 2D display from a long distance may be due to alertness and difficulty in focusing, which in turn leads to decreased cognitive capacity of participants for processing visual information regarding increased cognitive load [37, 65].

The RR was significantly lower for watching 3D as opposed to 2D visuals, and the variation in LF/HF ratio decreased significantly for 3D visuals. Park et al. [37] found that viewing 3D rather than 2D video destabilizes the heart rhythm and increases the heart rate, and viewing 3D rather than 2D video induced a shift in autonomic balance, mainly due to increased activation of the sympathetic nerves. In addition, the autonomic balance was found to be significantly different between the 2D and 3D groups. Sakamoto et al. [39] studied the effect of watching a 3DTV video on physiological and subjective measurements of the TV viewer’s emotional state. They showed that heart rate and HRV (LF/HF) increased in almost all participants who gave high scores for “comfortable,” “like,” and “relaxed”; however, this was not the case for “sensation of involvement.” The reason for the increasing HR and LF/HF with a high score is because some participants may have fallen asleep. Park et al. [34] studied the effect of 3D visual fatigue on the autonomic nervous system using cardiac responses, namely, RMS-SD (root mean squared successive difference), SDNN (standard deviation of RR intervals), and HF/LF ratios extracted from the measured PPG (photoplethysmogram) after viewing the 3D display. The results indicated that after the subjects viewed the 3D display, responses in the sympathetic nervous system and parasympathetic nervous system were activated and deactivated, respectively, compared to those before viewing the 3D. They found that the HF/LF ratio, Ln (LF), and Ln (HF) after 3D viewing reduced significantly relative to those before the viewing. Park et al. [34] revealed that visual fatigue caused by watching 3D adversely affected the autonomic nervous system and accordingly increased activation of the sympathetic nerve resulting in decreased HRV; the results of this study are in agreement.

In terms of physical stress, the percentage change in the GSR increased significantly while watching videos on 3D displays and with increasing watching time when compared with the 2D displays when participants watched from a short viewing distance. This result is consistent with the study by Kim et al. [33], in which the authors showed that the patterns of GSR increased significantly while watching 3D compared to 2D videos. This result is concluded because the activation of the sympathetic nervous system was higher in the 3D than in the 2D case, which has a negative effect on cognitive function. However, the percentage change in GSR increased insignificantly while watching videos on 3D displays until a watching time of 40 min from a far viewing distance, when compared to watching the same videos on 2D displays. However, after 50 min of watching videos, the percentage change in GSR decreased significantly for the 3D display and with increasing watching time to the end of session when compared to watching the same videos on 2D displays.

The result of the current study is in agreement with the results of the previous studies reported by Ramadan et al. [27] and Alhaag and Ramadan [44]. In the previous studies [27, 44] and the present study, different measures were used to quantify different types of symptoms. Ramadan et al. [27] used electroencephalogram (EEG) relative beta power and alpha/beta power of EEG to assess human visual system and brain activity. While Alhaag and Ramadan [44] quantified visual fatigue associated with the display type, viewing time and distances using electromyography (EMG) in terms of the percentage of maximum voluntary contraction (%MVC) of the orbicularis oculi (OO) muscle activity and subjective visual discomfort score. Ramadan et al. [27] found that the decrease in relative beta power of the EEG and the increase in the alpha/beta ratio from the start until the end of the viewing session were significantly higher when watching the 3D display. They showed that viewing 3DTV has different influences on the brain as compared against watching 2DTV. Ramadan et al. [27] found that watching 2DTV from short viewing distances and watching 3DTV from longer viewing distances relaxed the brain, while watching 3D display from short viewing distances requires participants to utilize more cognitive loads for processing three-dimensional information leading to cause visual fatigue due to decrease in the cognitive capacity of the participants for processing visual information. Moreover, watching 2D displays from long distances increases the cognitive load because of low level of attentional focusing ability and regulates occipital lobe required by the brain to process the information.

In the other articles, Alhaag and Ramadan [44] showed that watching the 3D display from a short viewing distance produced significantly high muscle contraction compared to watching the 2D display from a short viewing distance. When the viewing distance was increased from 1.95 m to 3.90 m, the muscle fatigue of the orbicularis oculi (OO) muscle decreased in the 3D display case whereas it increased insignificantly in the 2D display case. In addition, there was approximately the same level of muscle fatigue when watching videos in 2D or 3D from a long viewing distance (3.90 m). The onset of visual fatigue appears in 30 minutes and 50 minutes of watching 3D display at short and long distances, respectively. They concluded that the OO muscle activity of the participants while watching the 3D display from a long distance (6) did not change over the viewing time, which means that viewing the 3D display from a long viewing distance is safer than viewing a 2D display.

The present study focused on quantified physical stress associated with watching display type from different distances over an extended period based on HRV, GSR, and performance (percent of correct responses). It was found that watching 3D display from a short viewing distance contributes to increase physical stress, as compared to 2D display. For the long viewing distance (6), there is no physical stress associated with display type (2D and 3D displays have same effect at long distance). Moreover, when the viewing distance is changed from 3 to 6, the physical stress increased for the 2D display type, whereas it decreased for the 3D display type. The results suggested that to reduce the physical stress, the 2D display must be watched from a short viewing distance or the 3D display from a long distance. It also noted that the onset of physical stress based on HRV and GSR measures appeared after 50 minutes of watching. From the comparison between the previous studies [27, 44] and the current study, it has been noted that watching a 2D display from a short distance and watching a 3D display from a long distance have less effect on physical stress, brain activity, visual fatigue, and eye muscle fatigue (orbicularis oculi (OO) muscle) which is turned to the safe condition for watching 2D and 3D displays. Despite the authors’ repeated attempts to recruit females by distributing flyers and pamphlets in the girls’ section, only male participants were recruited for the study.

5. Conclusion

The data analysis strongly suggests that HR variability and GSR are the best measures to distinguish between watching films on 2D and 3D displays from near and far viewing distances. Consistent variation in HR demonstrated that continual film viewing using 3D display is relatively more strenuous than watching films using 2D displays. Conversely, it was seen that HRV is relatively superior in measuring the physical stress condition.

Conflicts of Interest

The authors declare no conflict of interest.

Acknowledgments

The authors would like to acknowledge the support provided by the Deanship of Scientific Research at King Saud University, through the Research Center of the College of Engineering.

References

J. P. McIntire, P. R. Havig, and E. E. Geiselman, “Stereoscopic 3D displays and human performance: a comprehensive review,” Displays, vol. 35, no. 1, pp. 18–26, 2014.
View at: Publisher Site | Google Scholar
American Optometric Association and others, “Guide to the clinical aspects of computer vision syndrome,” St. Louis: American Optometric Association, vol. 1, 1995.
View at: Google Scholar
S. Wilkinson, “3D sickness explained?” Home Theater, vol. 25, 2011.
View at: Google Scholar
J. P. McIntire and K. K. Liggett, “The (possible) utility of stereoscopic 3D displays for information visualization: the good, the bad, and the ugly,” in 2014 IEEE VIS International Workshop on 3DVis (3DVis), pp. 1–9, Paris, France, November 2014.
View at: Publisher Site | Google Scholar
A. G. Solimini, “Are there side effects to watching 3D movies? A prospective crossover observational study on visually induced motion sickness,” PLoS One, vol. 8, no. 2, article e56160, 2013.
View at: Publisher Site | Google Scholar
J. C. A. Read and I. Bohr, “User experience while viewing stereoscopic 3D television,” Ergonomics, vol. 57, no. 8, pp. 1140–1153, 2014.
View at: Publisher Site | Google Scholar
R. Patterson, “Human factors of 3-D displays,” Journal of the Society for Information Display, vol. 15, no. 11, pp. 861–871, 2007.
View at: Publisher Site | Google Scholar
M. Lambooij, W. IJsselsteijn, M. Fortuin, and I. Heynderickx, “Visual discomfort and visual fatigue of stereoscopic displays: a review,” Journal of Imaging Science and Technology, vol. 53, no. 3, article 30201, 2009.
View at: Publisher Site | Google Scholar
T. Shibata, J. Kim, D. M. Hoffman, and M. S. Banks, “The zone of comfort: predicting visual discomfort with stereo displays,” Journal of Vision, vol. 11, no. 8, p. 11, 2011.
View at: Publisher Site | Google Scholar
M.-C. Park and S. Mun, “Overview of measurement methods for factors affecting the human visual system in 3D displays,” Journal of Display Technology, vol. 11, no. 11, pp. 877–888, 2015.
View at: Publisher Site | Google Scholar
M. L. Matthews, J. V. Lovasik, and K. Mertins, “Visual performance and subjective discomfort in prolonged viewing of chromatic displays,” Human Factors, vol. 31, no. 3, pp. 259–271, 1989.
View at: Publisher Site | Google Scholar
R. S. Kennedy, N. E. Lane, K. S. Berbaum, and M. G. Lilienthal, “Simulator sickness questionnaire: an enhanced method for quantifying simulator sickness,” The International Journal of Aviation Psychology, vol. 3, no. 3, pp. 203–220, 1993.
View at: Publisher Site | Google Scholar
J. Kuze and K. Ukai, “Subjective evaluation of visual fatigue caused by motion images,” Displays, vol. 29, no. 2, pp. 159–166, 2008.
View at: Publisher Site | Google Scholar
J. E. Sheedy, J. Hayes, and J. Engle, “Is all asthenopia the same?” Optometry and Vision Science, vol. 80, no. 11, pp. 732–739, 2003.
View at: Publisher Site | Google Scholar
Y.-J. Kim and E. C. Lee, “EEG based comparative measurement of visual fatigue caused by 2D and 3D displays,” in HCI International 2011 – Posters’ Extended Abstracts. HCI 2011. Communications in Computer and Information Science, C. Stephanidis, Ed., vol. 174, pp. 289–292, Springer, Berlin, Heidelberg, 2011.
View at: Google Scholar
S. Mun, M.-C. Park, S. Park, and M. Whang, “SSVEP and ERP measurement of cognitive fatigue caused by stereoscopic 3D,” Neuroscience Letters, vol. 525, no. 2, pp. 89–94, 2012.
View at: Publisher Site | Google Scholar
Y. J. Jung, D. Kim, H. Sohn, S. Lee, H. W. Park, and Y. M. Ro, “Subjective and objective measurements of visual fatigue induced by excessive disparities in stereoscopic images,” in Stereoscopic Displays and Applications XXIV, Burlingame, CA, USA, March 2013.
View at: Publisher Site | Google Scholar
H. Cho, M.-K. Kang, K.-J. Yoon, and S. C. Jun, “Feasibility study for visual discomfort assessment on stereo images using EEG,” in 2012 International Conference on 3D Imaging (IC3D), pp. 1–6, Liege, Belgium, December 2012.
View at: Publisher Site | Google Scholar
C. Chen, K. Li, Q. Wu, H. Wang, Z. Qian, and G. Sudlow, “EEG-based detection and evaluation of fatigue caused by watching 3DTV,” Displays, vol. 34, no. 2, pp. 81–88, 2013.
View at: Publisher Site | Google Scholar
C. Chen, J. Wang, K. Li et al., “Assessment visual fatigue of watching 3DTV using EEG power spectral parameters,” Displays, vol. 35, no. 5, pp. 266–272, 2014.
View at: Publisher Site | Google Scholar
C. Chen, J. Wang, K. Li, Y. Liu, and X. Chen, “Visual fatigue caused by watching 3DTV: an fMRI study,” Biomedical Engineering Online, vol. 14, Supplement 1, p. S12, 2015.
View at: Publisher Site | Google Scholar
B.-W. Hsu and M.-J. J. Wang, “Evaluating the effectiveness of using electroencephalogram power indices to measure visual fatigue,” Perceptual and Motor Skills, vol. 116, no. 1, pp. 235–252, 2013.
View at: Publisher Site | Google Scholar
Y. Wang, Y. Liu, B. Zou, and Y. Huang, “Study on issues of visual fatigue of display devices,” in Imaging and Applied Optics 2014, Seattle, Washington, USA, July 2014.
View at: Publisher Site | Google Scholar
J. Bang, H. Heo, J.-S. Choi, and K. Park, “Assessment of eye fatigue caused by 3D displays based on multimodal measurements,” Sensors, vol. 14, no. 9, pp. 16467–16485, 2014.
View at: Publisher Site | Google Scholar
S. H. Kweon, H. J. Kweon, S.-j. Kim, X. Li, X. Liu, and H. L. KweonI. Nunes, “A brain wave research on VR (virtual reality) usage: comparison between VR and 2D video in EEG measurement,” in Advances in Human Factors and Systems Interaction. AHFE 2017. Advances in Intelligent Systems and Computing, vol. 592, pp. 194–203, Springer, Cham, 2017.
View at: Publisher Site | Google Scholar
F. S. Avarvand, S. Bosse, G. Nolte, T. Wiegand, and W. Samek, “Measuring the quality of 3D visualizations using EEG: a time-frequency approach,” http://iphome.hhi.de/samek/pdf/AvaBCI17.pdf.
View at: Google Scholar
M. Ramadan, M. Alhaag, and M. Abidi, “Effects of viewing displays from different distances on human visual system,” Applied Sciences, vol. 7, no. 11, p. 1153, 2017.
View at: Publisher Site | Google Scholar
S. Yano, S. Ide, T. Mitsuhashi, and H. Thwaites, “A study of visual fatigue and visual comfort for 3D HDTV/HDTV images,” Displays, vol. 23, no. 4, pp. 191–201, 2002.
View at: Publisher Site | Google Scholar
M. Emoto, T. Niida, and F. Okano, “Repeated vergence adaptation causes the decline of visual functions in watching stereoscopic television,” Journal of Display Technology, vol. 1, no. 2, pp. 328–340, 2005.
View at: Publisher Site | Google Scholar
H.-C. O. Li, “Human factor research on the measurement of subjective three dimensional fatigue,” Journal of Broadcast Engineering, vol. 15, no. 5, pp. 607–616, 2010.
View at: Publisher Site | Google Scholar
E. Lee, H. Heo, and K. Park, “The comparative measurements of eyestrain caused by 2D and 3D displays,” IEEE Transactions on Consumer Electronics, vol. 56, no. 3, pp. 1677–1683, 2010.
View at: Publisher Site | Google Scholar
D. Kim, Y. J. Jung, E. Kim, Y. M. Ro, and H. Park, “Human brain response to visual fatigue caused by stereoscopic depth perception,” in 2011 17th International Conference on Digital Signal Processing (DSP), pp. 1–5, Corfu, Greece, July 2011.
View at: Publisher Site | Google Scholar
C. Kim, S. Park, M. Won, M. Whang, and E. Lee, “Autonomic nervous system responses can reveal visual fatigue induced by 3D displays,” Sensors, vol. 13, no. 10, pp. 13054–13062, 2013.
View at: Publisher Site | Google Scholar
S.-I. Park, M.-C. Whang, J.-W. Kim, S.-C. Mun, and S.-M. Ahn, “Autonomic nervous system response affected by 3D visual fatigue evoked during watching 3D TV,” Korean Journal of the Science of Emotion & Sensibility, vol. 14, no. 4, pp. 653–663, 2011.
View at: Google Scholar
S. J. Park, S. Bin Oh, M. Subramaniyam, and H. K. Lim, “Human impact assessment of watching 3D television by electrocardiogram and subjective evaluation,” in Proceedings of the XX IMEKO World Congress—Metrology for Green Growth, pp. 9–14, Busan, Korea, September 2012.
View at: Google Scholar
S. J. Park, M. Subramaniyam, M. K. Moon, and D. G. Kim, “Physiological responses to watching 3D on television with active and passive glasses,” in HCI International 2013 - Posters’ Extended Abstracts. HCI 2013. Communications in Computer and Information Science, C. Stephanidis, Ed., vol. 373, Springer, Berlin, Heidelberg.
View at: Publisher Site | Google Scholar
S. Park, M. J. Won, S. Mun, E. C. Lee, and M. Whang, “Does visual fatigue from 3D displays affect autonomic regulation and heart rhythm?” International Journal of Psychophysiology, vol. 92, no. 1, pp. 42–48, 2014.
View at: Publisher Site | Google Scholar
S. Park, M. J. Won, E. C. Lee, S. Mun, M.-C. Park, and M. Whang, “Evaluation of 3D cognitive fatigue using heart--brain synchronization,” International Journal of Psychophysiology, vol. 97, no. 2, pp. 120–130, 2015.
View at: Publisher Site | Google Scholar
K. Sakamoto, S. Asahara, S. Sakashita, K. Yamashita, and A. Okada, “Influence of 3DTV video contents on physiological and psychological measurements of emotional state,” in 2012 IEEE 16th International Symposium on Consumer Electronics, pp. 1–4, Harrisburg, PA, USA, June 2012.
View at: Publisher Site | Google Scholar
C.-Y. Chen, M.-D. Ke, P.-J. Wu, C.-D. Kuo, B.-J. Pong, and Y.-Y. Lai, “The influence of polarized 3D display on autonomic nervous activities,” Displays, vol. 35, no. 4, pp. 196–201, 2014.
View at: Publisher Site | Google Scholar
J. Li, C. Chen, Y. Liu, and X. Chen, “Small-world brain functional network altered by watching 2D/3DTV,” Journal of Visual Communication and Image Representation, vol. 38, pp. 433–439, 2016.
View at: Publisher Site | Google Scholar
Q. Wang, Q.-H. Wang, and C.-L. Liu, “Relationship between phoria and visual fatigue in autostereoscopic 3D displays,” Journal of the Society for Information Display, vol. 23, no. 6, pp. 277–283, 2015.
View at: Publisher Site | Google Scholar
Q. Wang, Q.-H. Wang, S.-X. Gu, and C.-L. Liu, “Human fusion range for polarized 3D display,” Journal of the Society for Information Display, vol. 24, no. 3, pp. 198–203, 2016.
View at: Publisher Site | Google Scholar
M. H. Alhaag and M. Z. Ramadan, “Using electromyography responses to investigate the effects of the display type, viewing distance, and viewing time on visual fatigue,” Displays, vol. 49, pp. 51–58, 2017.
View at: Publisher Site | Google Scholar
B. T. Shahani, J. J. Halperin, P. Boulu, and J. Cohen, “Sympathetic skin response--a method of assessing unmyelinated axon dysfunction in peripheral neuropathies,” Journal of Neurology, Neurosurgery, and Psychiatry, vol. 47, no. 5, pp. 536–542, 1984.
View at: Publisher Site | Google Scholar
P. A. Vijaya and G. Shivakumar, “Galvanic skin response: a physiological sensor system for affective computing,” International Journal of Machine Learning and Computing, vol. 3, no. 1, pp. 31–34, 2013.
View at: Publisher Site | Google Scholar
A. Nakasone, H. Prendinger, and M. Ishizuka, “Emotion recognition from electromyography and skin conductance,” in Proc. of the 5th International Workshop on Biosignal Interpretation, pp. 219–222, Tokyo, Japan, 2005.
View at: Google Scholar
C. Setz, B. Arnrich, J. Schumm, R. La Marca, G. Tröster, and U. Ehlert, “Discriminating stress from cognitive load using a wearable EDA device,” IEEE Transactions on Information Technology in Biomedicine, vol. 14, no. 2, pp. 410–417, 2010.
View at: Publisher Site | Google Scholar
W. Boucsein, Electrodermal Activity, Springer Science & Business Media, 2012.
View at: Publisher Site
International Telecommunication Union Radiocommunication Assembly, Methodology for the Subjective Assessment of the Quality of Television Pictures, International Telecommunication Union, 2003.
A. Markov, I. Solonin, and E. Bojko, “Heart rate variability in workers of various professions in contrasting seasons of the year,” International Journal of Occupational Medicine and Environmental Health, vol. 29, no. 5, pp. 793–800, 2016.
View at: Publisher Site | Google Scholar
M. P. Tarvainen, J.-P. Niskanen, J. A. Lipponen, P. O. Ranta-aho, and P. A. Karjalainen, “Kubios HRV–a software for advanced heart rate variability analysis,” in 4th European Conference of the International Federation for Medical and Biological Engineering, J. Vander Sloten, P. Verdonck, M. Nyssen, and J. Haueisen, Eds., vol. 22, pp. 1022–1025, Springer, Berlin, Heidelberg, 2009.
View at: Publisher Site | Google Scholar
C. H. Perala and B. S. Sterling, Galvanic Skin Response as a Measure of Soldier Stress, 2007, Final Report 7MB25R, U.S. Army Research Laboratory, Human Research & Engineering Directorate Aberdeen Proving Ground, MD 21005-5425.
M. E. Dawson, A. M. Schell, and D. L. Filion, “The electrodermal system,” in Handbook of Psychophysiology, vol. 2, pp. 200–223, Cambridge University Press, 2007.
View at: Publisher Site | Google Scholar
N. Gerrett, B. Redortier, T. Voelcker, and G. Havenith, “A comparison of galvanic skin conductance and skin wettedness as indicators of thermal discomfort during moderate and high metabolic rates,” Journal of Thermal Biology, vol. 38, no. 8, pp. 530–538, 2013.
View at: Publisher Site | Google Scholar
J. J. Braithwaite, D. G. Watson, R. Jones, and M. Rowe, “A guide for analysing electrodermal activity (EDA) & skin conductance responses (SCRs) for psychological experiments,” Psychophysiology, vol. 49, pp. 1017–1034, 2013.
View at: Google Scholar
J. D. Brown, T. Hilgers, and J. Marsella, “Essay prompts and topics: minimizing the effect of mean differences,” Written Communication, vol. 8, no. 4, pp. 533–556, 1991.
View at: Publisher Site | Google Scholar
U. Trutschel, C. Heinze, B. Sirois, M. Golz, D. Sommer, and D. Edwards, “Heart rate measures reflect the interaction of low mental workload and fatigue during driving simulation,” in Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications - AutomotiveUI '12, pp. 261–264, Portsmouth, New Hampshire, October 2012.
View at: Publisher Site | Google Scholar
G. Keppel and T. D. Wickens, Design and Analysis: A researcher’s Handbook, Pearson Prentice Hall, 2004.
T. Åkerstedt, A. Knutsson, P. Westerholm, T. Theorell, L. Alfredsson, and G. Kecklund, “Mental fatigue, work and sleep,” Journal of Psychosomatic Research, vol. 57, no. 5, pp. 427–433, 2004.
View at: Publisher Site | Google Scholar
A. L. Hansen, B. H. Johnsen, and J. F. Thayer, “Vagal influence on working memory and attention,” International Journal of Psychophysiology, vol. 48, no. 3, pp. 263–274, 2003.
View at: Publisher Site | Google Scholar
R. McCraty and A. Watkins, “Autonomic assessment report: a comprehensive heart rate variability analysis,” in Heart Math Research Center Reports. Boulder Creek, CA: Institute of Heart Math, 1996.
View at: Google Scholar
H. Rau, P. Pauli, S. Brody, T. Elbert, and N. Birbaumer, “Baroreceptor stimulation alters cortical activity,” Psychophysiology, vol. 30, no. 3, pp. 322–325, 1993.
View at: Publisher Site | Google Scholar
C. Wölk, M. Velden, U. Zimmermann, and S. Krug, “The interrelation between phasic blood pressure and heart rate changes in the context of the “baroreceptor hypothesis”,” Journal of Psychophysiology, vol. 3, no. 4, pp. 397–402, 1989.
View at: Google Scholar
P. Toffanin, R. de Jong, A. Johnson, and S. Martens, “Using frequency tagging to quantify attentional deployment in a visual divided attention task,” International Journal of Psychophysiology, vol. 72, no. 3, pp. 289–298, 2009.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2018 Mohamed Z. Ramadan and Mohammed H. Alhaag. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

2149

Downloads

1037

Citations