- About this Journal ·
- Abstracting and Indexing ·
- Aims and Scope ·
- Article Processing Charges ·
- Articles in Press ·
- Author Guidelines ·
- Bibliographic Information ·
- Citations to this Journal ·
- Contact Information ·
- Editorial Board ·
- Editorial Workflow ·
- Free eTOC Alerts ·
- Publication Ethics ·
- Reviewers Acknowledgment ·
- Submit a Manuscript ·
- Subscription Information ·
- Table of Contents
Computational Intelligence and Neuroscience
Volume 2009 (2009), Article ID 549419, 16 pages
A Framework Combining Delta Event-Related Oscillations (EROs) and Synchronisation Effects (ERD/ERS) to Study Emotional Processing
1Laboratory of Medical Informatics, School of Medicine, Aristotle University of Thessaloniki, P.O. Box 323, 54124 Thessaloniki, Greece
2Department of Psychology, City College, Affiliated Institution of the University of Sheffield, 54624 Thessaloniki, Greece
Received 21 March 2009; Revised 21 March 2009; Accepted 29 April 2009
Academic Editor: Laura Astolfi
Copyright © 2009 Manousos A. Klados et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Event-Related Potentials (ERPs) or Event-Related Oscillations (EROs) have been widely used to study emotional processing, mainly on the theta and gamma frequency bands. However, the role of the slow (delta) waves has been largely ignored. The aim of this study is to provide a framework that combines EROs with Event-Related Desynchronization (ERD)/Event-Related Synchronization (ERS), and peak amplitude analysis of delta activity, evoked by the passive viewing of emotionally evocative pictures. Results showed that this kind of approach is sensitive to the effects of gender, valence, and arousal, as well as, the study of interhemispherical disparity, as the two-brain hemispheres interplay roles in the detailed discrimination of gender. Valence effects are recovered in both the central electrodes as well as in the hemisphere interactions. These findings suggest that the temporal patterns of delta activity and the alterations of delta energy may contribute to the study of emotional processing. Finally the results depict the improved sensitivity of the proposed framework in comparison to the traditional ERP techniques, thereby delineating the need for further development of new methodologies to study slow brain frequencies.
During the past few years many studies have attempted to investigate the role of neuronal mechanisms involved in emotional processing . Most of those studies employed Event-Related Potentials (ERPs) and focused on the detection of time-locked changes in the activity of large pools of neurons . This approach has been mostly preferred because induced cerebral activity demonstrates an almost fixed time-delay to the stimulus onset, and it superimposes to the normal ongoing brain signals, which are regarded as additive noise. In these studies, typically a sufficiently large number of epochs with the same stimulus type are averaged in order to enhance the signal-to-noise (SNR) ratio. Consequently, this type of analysis aims at enhancing certain ERP components. However, this model can only roughly approximate reality, since it cannot deal with robust dynamical changes that occur in the human brain .
It is known that EEG activity is generated by sets of circuits . The neuronal cells involved in these circuits are synchronized upon the appearance of a novel stimulus. Therefore, their activity is coupled and overall EEG coherency is enhanced. Thus, the system’s complexity is reduced since it becomes more ordered. This results in the generation of rhythmic oscillations in various frequency bands which are superimposed on each other to form the compound event-related potential . So, the analysis of ERP waves and their oscillations may promote our biophysical understanding of the brain functional networks and the investigation of both the global and the local characteristics of human brain activity. For instance, it is known , that there are particular events, which are time-locked to the event, but not phase-locked, and have an inhibitory effect to the alpha rhythm . Consequently, the underlying cognitive processes cannot be thoroughly revealed using linear methods. Due to this limitation, frequency analyses are more appropriate, as long as, we assume that certain events affect specific bands of the ongoing EEG activity. This would result on the synchronization or desynchronization of underlying neurons exactly after the event (Event-Related Synchronization (ERS) or Desynchronization (ERD)) [7, 8]. The aforementioned reactions are time-locked to the event and concern specific brain waves. This type of spectral analysis is employed since selectively distributed oscillatory networks in the various frequency ranges control in an integrative way brain functions at every sensory and cognitive level. Cognitive processing of emotional visual stimuli involves several complex functions such as sensory processing, attention, decision making, and memory. Despite the potential interest of using such methodologies to emotionally evocative stimuli, research with these types of analyses employing the International Affective Picture System (IAPS)  is scarce.
A few such studies have indeed shown that brain rhythms are associated with several cognitive processes. For instance, an increase in theta activity has been associated with initial learning improvement, which is typically followed by a decrease that reflects habituation processes . A more relevant study, it has been shown that the amygdala produces theta activity in response to emotionally evocative stimuli ; whereas detection of unpleasant stimuli has been associated with theta synchronization in the hippocampus, which appears to be lateralized to the right hemisphere . Moreover, slow waves, contribute to the detection of salient-infrequent-stimuli, and consequently, they contribute to the P300 response [13, 14]. Taken all together, these findings suggest that slow cerebral oscillations are suitable to study the cognitive processes related to emotions.
Moreover, in the last few years, there is growing interest in investigating the neuronal mechanisms involved in the processing of emotionally evocative pictures [15, 16] using IAPS. IAPS pictures are rated in terms of valence and arousal. According to  emotional processing is mediated by two brain systems; the appetitive and the defensive. These two systems have evolved in order to assure the physical survival. The property “valence” refers to the direction of behavioral activation according to the motivational system induced by the stimulus. The property “arousal” represents the activation level elicited by the emotionally evocative stimulus . The defense system is mainly active in unpleasant situations ranging from threat to melancholy and it is associated with “fight-or-flight” responses. On the other hand, the presence of pleasant situations like sustenance, procreation and nurturance activates the appetitive system. Therefore, the valence dimension refers to the system that is activated, while the arousal dimension refers to the intensity of this activation .
A few studies have investigated oscillatory modulation with visual emotional stimuli from the IAPS. In one of these studies , they investigated spectral responses in the gamma range by means of wavelet transforms, and found early effects (80 ms after stimulus onset) of the activity around 30 Hz which discriminated unpleasant stimuli from pleasant ones. Moreover, there was a later increase (480–550 ms poststimulus) in higher frequencies which appeared to be a reliable indicator of arousal. Theta activity has also been related to emotional stimuli, as early synchronization of theta activity has been reported, together with an interaction between valence and hemisphere for the anterior temporal regions . In another study, it was found that theta ERS covaried with the stimulus intensity. Furthermore, the increase in theta activity was most pronounced over left anterior regions, and bilaterally over posterior regions . Finally, the same study also reported that desynchronization of the medium alpha range was associated with attentional resources. The synchronization of the upper alpha in anterior cortical areas was also attributed to a greater cognitive involvement during processing of emotionally arousing stimuli . To sum up, gamma, theta and alpha activities seem to be related with different aspects of the processing of emotional stimuli.
However, to our knowledge, there is limited literature about delta wave activity and whether it is modulated during the emotional processing of complex visual scenes, like IAPS pictures, or not. This is in fact surprising, since there is some evidence which suggests that this wave may also play a role in processing of emotional stimuli. For instance, a research has reported a relationship between the P300 component and the delta frequency component . Also, it is generally agreed, that the P300 is associated with unexpected or motivationally relevant stimuli . For instance, emotional stimuli elicit a more pronounced P300 response than neutral ones . Furthermore, studies have shown an increase of the activity in the delta frequency band during sexual arousal . Another study  has indicated higher coherence of slow waves in central and posterior regions of the right hemisphere during sexual arousal induced by imagery. A summary of the studies that have been conducted with delta wave activity to investigate cognitive and emotional processes in healthy adults, and brain abnormalities in neurological disorders is shown in Table 1. It is important to notice that most of these studies used the linked earlobes montage, and the number of electrodes varied from 7 to 62.
The aim of the present study is to investigate the feasibility of using event-related delta oscillations to study brain processing triggered by visually complex emotional stimuli. Based on previous research, we hypothesize that delta wave activity, particularly in posterior brain areas, is mainly associated with arousal, whereas valence effects on delta activity will be mostly observed in anterior brain areas. Furthermore, and since our ERP studies have reported gender differences with the same stimuli , we also aim to check the replication of such findings in delta wave activity. That is, we suspect increased delta activity for females as compared to males, particularly for unpleasant stimuli. Furthermore, this piece of work aims at the investigation of laterality differences by extending the delta oscillations framework with the inclusion of delta synchronization analysis in terms of ERS/ERD. In addition, as the studying of delta wave activity was found to be more sensitive to arousal modulations of emotional stimuli than classic ERP peak studies , and it is linked with decision-making and salience feature detection properties , it is important to examine whether we obtain stronger valence effects of delta wave activity than with the classic ERP approach. In other words, we aim to compare herein effect sizes for both ERP  and delta wave analyses (the present study). Finally, a side methodological aim is to compare the different montage methods for spatial filtering. Although, most of the studies summarized above (Table 1) have employed the linked earlobes montage, only a few studies have actually compared the effectiveness of this method in relation to other methods such as the Common Average Reference (CAR) and (large) Laplacian (LAP).
So, in the remaining of this paper, necessary background knowledge regarding the EROS extraction methodology, the artifact rejection approach and the ERD/ERS computation scheme are provided in Section 2. The results derived from the statistical analysis, which was performed on the average signals of each subject and for each emotional category are presented in Section 3. Finally, the contribution of the proposed framework to the estimation of the slow wave activity during emotional processing is discussed in Section 4.
2. Materials and Methods
Twenty eight healthy adults (14 males and 14 females) participated in the experiment (mean age of males , mean age of females). All subjects had normal or corrected to normal vision. Each participant signed an informed consent form prior to his/her participation and completed a short questionnaire. All participants were paid for their participation. An approval from the Ethical Committee of the Medical School of the Aristotle University of Thessaloniki, Greece, was granted for this study.
The participants passively viewed 160 emotional pictures, selected from the IAPS. The pictures were grouped in 4 conditions based on their valence and arousal ratings. The conditions were pleasant pictures with high arousal ratings (HVHA), pleasant pictures with low arousal ratings (HVLA), unpleasant pictures (Low Valence) with high arousal ratings (LVHA), and unpleasant pictures with low arousal ratings (LVLA). More details about valence and arousal ratings for each condition specific to gender are shown in Table 2. The experimental conditions were manipulated between blocks, thus there were four blocks of 40 photographs each.
2.3. Electrophysiological Recordings
During the presentation of each emotional block multichannel, Electroenchaphalogram (EEG) and Electrooculogram (EOG) were recorded with 500 Hz sampling frequency. Nineteen EEG electrodes were placed according to the 10–20 International System at sites Fp1, Fp2, F3, F4, F7, F8, Fz, C3, C4, Cz, T3, T4, T5, T6, P3, P4, Pz, O1, O2 with electrode resistance lower than 20 k. Two EOG electrodes were placed above and below the left eye and another two were placed at the outer canthi of each eye. Two bipolar signals were calculated from these four electrodes, namely vertical EOG (VEOG) and horizontal EOG (HEOG) and used for effective EOG artifact rejection.
Three different montages (Linked Mastoids, Common Average Reference and large Laplacian montage) (Figure 1) have been compared for optimal representation of cerebral responses. According to the linked mastoids montage, electrodes with odd indices were referenced to left mastoid and electrodes with even indices were referenced to right mastoid. Central electrodes (Fz, Cz, Pz) were referenced to the half of the sum of left and right mastoids. The Common Average Reference (CAR) which was computed according to the next formula:
where is the number of electrodes and is the potential of th electrode. As for the third montage, the large Laplacian reference (LAP) has been employed, since the number of electrodes is restrictive for the small Laplacian reference. The following formula has been used for the calculation of the LAP:
is the set of electrodes surrounding the th electrode, and is the distance between electrodes and (where is a member of ). The aforementioned distance is 3 cm for the small Laplacian montage, in contrast to large one, where the distance of two neighbor electrodes is 6 cm . Linked mastoids were more effective in normalizing the data (see Section 3.1) as compared to the other methods, so it was further used for the purposes of this study. More detailed results are mentioned in Section 3.
2.4. Experimental Procedure
Participants were asked to sit on a comfortable armchair in front of a computer screen placed at 80 cm distance from their eye horizontal level. The experiment started with a 30-second recording, during which, participants were asked to keep their eyes open and look at the blank screen. This recording was followed by another one where participants were asked to keep their eyes closed. These recordings were taken to serve as baseline values. The experimental protocol was comprised of stimuli in the form of IAPS pictures, forming blocks of forty randomly selected pictures according to their arousal and valence ratings (Table 2). The order of the blocks was counterbalanced across participants. Each single epoch had 0.5 seconds prestimulus showing a white cross in the center of the screen and 2 seconds poststimulus period (1 second picture duration followed by 1 second of the white cross). At the end of the procedure the initial 30-second recordings, with eyes open and then closed, were repeated.
2.5. Event-Related Desynchronizations (ERD)/Event-Related Synchronization (ERS)
Sensory, motor, cognitive and emotional processing can affect the ongoing EEG by decreasing (ERD) or increasing (ERS) the synchrony of underlying neurons, so cerebral activity can be quantified using the ERD/ERS method which is described in . ERD/ERS depict the percentage of band power changes during a test interval compared to a reference interval in a specific frequency band. There are a lot of different methods used today for quantification of ERD/ERS, which are summarized in . The band power method  has been selected for the purpose of this study. According to this method each EEG signal for each channel was band-pass filtered in the delta frequency band (0.5–4 Hz), squared in order to calculate the delta band power, epoched and averaged over trials for each subject and for each emotion block. Finally in order to obtain the percentage of event-related changes in delta band power the following formula was used:
where is the power of delta band in the reference interval (here 500 ms prestimulus) and is the delta band power for the test intervals after the event (here 0–500 ms, 500–1000 ms, 1000–1500 ms, 1500–2000 ms after picture onset). For a more detailed description of this method see . According to the aforementioned formula positive values () indicate that the test interval’s band power is lower compared to the reference, which means that delta oscillations decrease their synchrony (desynchronize), and, therefore, ERD is obtained for positive values. Negative values () indicate neuronal synchrony in a similar way and they are obtained for ERS.
2.6. Artifact Rejection
We have used the Least Mean Square (LMS) method, as it was proved to have better a performance among other widely used techniques for artifact rejection, based on Blind Source Separation (BSS) or regression methodology . According to the LMS adaptive filtering procedure, the goal is to adjust the filter coefficients and make them approach the optimal filter coefficients as close as possible (Figure 2). The underlying idea of the LMS algorithm is to use a steepest descent algorithm to find the coefficients which minimize the objective function,
where is the error from the block diagram (Figure 2) and denotes the expected value. After the application of the steepest descent algorithm we have
where denotes the gradient operator. For
where is the order of the adaptive filter, and we have
is a vector orientated to the steepest ascent of the objective function, so we have to take the opposite direction of for the minimization of . Thus we have the following equation:
where is the step size. Note that in most systems the expectation function has to be approximated, and this can be achieved with the following estimator:
where is the number of samples used for the estimation. For we have
so the update algorithm is
2.7. EEG Processing
A band pass filter (0.5–40 Hz) and a notch filter at 50 Hz were applied to raw EEG signals. EOG signals were also notch filtered at 50 Hz for main line noise extraction but were band pass filtered in a different frequency band at 0.5–13 Hz. The artifacts originated from ocular activity were rejected offline with the use of the LMS adaptive filter algorithm. To obtain delta oscillations the EEG data were band-pass filtered in delta band (0.5–4 Hz) using Kaiser filter. After that, each EEG signal was epoched into 40 trials with duration of 2.5 seconds each (fixed length of 500 ms prestimulus and 2 seconds after picture onset) and averaged over these epochs to perform Event-Related Oscillation (ERO) analysis. Finally for each average signal, the ERD/ERS was calculated.
2.8. ERD/ERS Data Reduction
ERD/ERS values were averaged into 2-electrode clusters according to their hemisphere (Left Hemisphere: Fp1, F3, F7, C3, T3, P3, T5, O1; Right Hemisphere Fp2, F4, F8, C4, T4, P4, T6, O2) thereby facilitating the investigation of possible brain asymmetries.
2.9. Statistical Analysis
In order to investigate the evoked differences of delta oscillations to emotional stimuli, ERD/ERS mean values were submitted to a mixed ANOVA with gender (male and female) as the between subject factor, and hemisphere (left and right), time intervals (0–500 ms, 500–1000 ms, 1000–1500 ms, and 1500–2000 ms), valence (pleasant and unpleasant) and arousal (high and low) as the within subject factors. Also ANOVAs with gender as the between subject factor and valence and arousal as the within subject factors were conducted on the delta activity EROs of the six characteristic peaks (200–300, 300–400, 400–500, 600–800, 1100–1250, 1200–1500 ms after picture onset).
As we mentioned above, the linked mastoids reference was more effective in normalizing the data as compared to the other two methods. In general, results showed that females had a stronger response to emotional stimuli as compared to males, in addition high arousal pictures provoke greater delta responses than the trials with low arousal pictures. Also delta responses provoked by unpleasant pictures were greater compared to the pleasant pictures. Finally, significant differences concerning the valence dimension were observed in the greater centro-frontal area, while the arousal was more discernible in the centro-parietal region.
As mentioned earlier, three different montages have been compared with regards to their effect in the ERD/ERS indices. Figure 3 illustrates delta waveform examples of the three montage methods. All reference techniques have similar overall features in terms of main peak responses. Otherwise the great scaling difference among the Large Laplacian montage and the rest methods is noticeable.
The results pointed out that the CAR and LAP approaches were not effective in normalizing the data; actually both montages increased greatly the mean square error (MSE) relative to the linked mastoids reference. For instance, the main effect of time interval was significant for all three methods, but the MSE was considerably increased for the CAR (, MSE = 2467660, ) and LAP (, MSE = 442632.50, ) methods in contrast to Linked Mastoids (, MSE = 1800.80, ). We also conducted the Kolmogorov-Smirnov test to check for normality, and found that data were not normalised with the CAR and LAP methods for many of the experimental conditions. This was not the case for the linked mastoid method, where all .
The averaged delta oscillatory activity from all the epoch segments was extracted for all the participants. The grand average waveform corresponding to the mean activity of all participants is visualized for each central electrode (Figure 4). The analysis presented herein is focused on the three central electrodes in order to study the differences among the four emotional categories and possible gender effects. Laterality issues are beyond the scope of the current EROs analysis.
The average delta activity contains six major peaks which are identified in the same temporal window for each block category. The selection of these windows was made in order to analyze early, late and very late cortical effects. The analysis is structured in a way to report only the significant results for each temporal window.
3.2.1. Positive Peak 200–300 ms
There was a significant arousal by gender interaction on the central electrode (Cz). Planned -test revealed significant differences between the low arousal (1.0766 V) and the high arousal (0.0938 V) conditions only for the female group . No other effect reached statistical significance, .
3.2.2. Negative Peak 300–400 ms
Results revealed significant main effects of valence and gender on the centro-frontal area. More specifically, unpleasant stimuli elicited greater responses than pleasant ones (7.588 and 8.177 V, resp.), and females produced greater responses relative to males (6.469 and 9.297 V, resp.). On the central electrode (Cz), there was a marginally significant main effect of gender , that is, females showed stronger responses (6.495 V) than males (4.212 V).
3.2.3. Positive Peak 400–500 ms
Results on the central electrode exhibited a highly significant main effect of arousal ; the delta activity was stronger for the high arousal condition (0.686 V) relative to the low arousal (0.455 V) condition during this temporal window. Similarly, for the parietal electrode only the main effect of arousal reached statistical significance , with high arousal condition eliciting much stronger responses than the low arousal condition (2.0043 and 0.8763 V, resp.).
3.2.4. Positive Peak 600–800 ms
Only the valence by gender interaction reached statistical significance on the frontal electrode. Planned -tests showed significant differences between males and females only for the unpleasant pictures, however there were no differences between male and female groups for the pleasant pictures, . In addition, there were significant differences between pleasant and unpleasant pictures (2.0742 and 1.5091 V, resp.) only for the male group.
Table 3 summarizes the statistical analysis for both ERP  and delta wave methodologies, which were performed on the same data. As it can be seen the proposed framework appears to be more sensitive to arousal effects of the emotional stimuli. The proposed framework revealed Gender and Arousal by Gender effects in Fz with higher -values, which means better sensitivity/specificity. Also the valence and the arousal effects in Cz and Pz respectively are superimposed by the use of the proposed framework analysis. At the current delta activity framework revealed more statistical significant effects in contrast to traditional ERP analysis (see Table 3).
All ERD/ERS mean values for delta oscillations are negative, so it can safely be deduced that delta oscillations are synchronized after emotional stimuli. It has to be noted that lower ERS values (from an algebraic point of view) denote higher increases of delta band powers.
Results showed a significant main effect of time . Scheffe posthoc comparisons showed significant differences between the first interval (40.083) and the three remaining intervals (mean ERS value equal to 19.9565, 18.98 and 10.4989, resp., all -values .0001). No other comparisons reached statistical significance, . That is, delta oscillations increased their band power after the stimulus onset (0–500 ms), dropped significantly in the second interval (500–1000 ms) and remained almost stable in the next two intervals (1000–1500, 1500–2000). Also, the main effect of arousal was significant . High arousal stimuli (25,474) produced greater synchronization of delta wave than low arousal pictures (19,285). In addition, the following 2-way interactions were significant: gender by time interaction , and valence by arousal . The gender by time interaction, evident only right after stimulus onset (0–500 ms interval), was due to a stronger response for female participants (50%) than for male participants (30%). Most importantly, these interactions were further modulated by a significant 5-way interaction, gender by hemisphere by time by valence by arousal interaction, .
For the male group, results showed a significant main effect of time intervals . Scheffe posthoc comparisons exhibited significant differences only between the first (30.3349) and the last interval (12.3907), . Also, the main effect of arousal was highly significant . That is, trials with high arousal pictures (25.1821) provoke greater synchronization of delta rhythm as compared to trials with low arousal (15.8206) pictures.
Also, the following interactions were significant in the male group: hemisphere by valence, (Figure 9), and hemisphere by time by valence by arousal, (marginal). The hemisphere by valence interaction was due to significant differences between the left (15.25) and right (23.31) hemisphere for the unpleasant pictures, ; whereas no differences were found between the two hemisphere conditions for the pleasant pictures, .
Finally, in order to analyze the 4-way interaction, we conducted four separate ANOVAs for each time interval with hemisphere, valence and arousal as the within subject factors.
3.4.1. Interval 1 (0–500 ms)
The analyses for the time interval of 0–500 ms revealed a significant main effect of hemisphere, . Mean ERS value for left hemisphere was 26.6563, whereas right hemisphere’s ERS was 34.0134. No other effect or interaction reached statistical significance, .
3.4.2. Interval 2 (500–1000 ms)
In the second interval, 500–1000 ms, there was a significant main effect of arousal, . That is, there was a greater synchronization of delta activity for the high arousal pictures (27.4742) than for the low arousal pictures (16.1314).
3.4.3. Interval 3 (1000–1500 ms)
In the third interval, 1000–1500 ms, there was a significant main effect of arousal as well, . As it was observed before, there was a greater synchronization of delta activity for the high arousal pictures (23.2588) than for low arousal pictures (11.6904). In this third interval there was also a significant hemisphere by valence interaction (Figure 10). That is, whereas synchronization of delta rhythm was greater for the pleasant picture (18.34) than for the unpleasant pictures (14.38) in the left hemisphere, the opposite pattern was observed for the right hemisphere (14.57 versus 22.61).
3.4.4. Interval 4 (1500–2000 ms)
Finally, in the analyses of the fourth interval, 1500–2000 ms, none of the main effects or their interaction reached statistical significance, .
The analyses for the female group revealed a significant main effect of time interval as well . Scheffe posthoc comparisons showed significant differences in the mean ERS value between the first interval (49.8315) and other three intervals (18.1076, 20.4854, 8.6071, resp.; ). Furthermore, the interaction time by valence reached statistical significance . To analyze this interaction we conducted two separate ANOVAs for each valence condition with time as the within subject factors. Results showed a significant main effect of time for both pleasant and unpleasant conditions (( and , resp.). Scheffe posthoc comparisons revealed significant differences between the first and the other three intervals for both the pleasant, (37.501, 19.094, 21.668, and 11.442; ), and the unpleasant condition, (42.665, 19.094, 21.668 and 9.555, resp.; ). However the interaction was due to a greater difference between the first and the second interval for the unpleasant pictures relative to the pleasant ones.
The major methodological aim of this paper was to investigate the feasibility of using a combination of event-related delta oscillations and delta synchronization analysis in terms of ERS/ERD in order to study emotional brain processing triggered by visually complex emotional stimuli. We have provided evidence herein that this kind of analysis is probably more sensitive to study not only arousal but also valence modulations of emotional stimuli than classic ERP peak studies. To provide such evidence, we compared effect sizes for both ERP and delta wave analyses. The resulted improved sensitivity of the proposed framework is given in both quantitative and qualitative terms, that is, on one hand, by the statistical analysis for both ERP and delta wave methodologies as depicted in Table 3; moreover, the differences between the two methodologies are qualitatively illustrated by Figures 5–7. According to Figure 6, the arousal modulation of the posterior areas is more intense when adopting delta oscillatory methodology in contrast to traditional ERP analysis. Similarly, the proposed framework is more sensitive in revealing the gender effect and valence modulation of the anterior areas as depicted in Figure 7. Finally, Figures 5 and 6 highlights the gender by valence and the gender by arousal interactions which also occur in the frontal lobe.
Delta oscillations are categorized among the brain’s natural oscillations, which generally provide basic links to cognitive functions by integrative control at all levels . According to , delta responses are evoked in the entire scalp of the human brain by sensory stimulation. The activity in this frequency band is related to signal matching, decision making and surprise . Our results concerning this type of analysis indicate the important role of the delta activity as a marker of emotional processing. As already commented above, this type of analysis is more sensitive than the classic ERP peak approach; this is also supported by the fact that interactions like the valence by arousal interaction according to the subject’s gender are revealed by the framework proposed here. Specifically, female participants exhibited stronger responses than males, particularly right after stimulus onset. Also, in general, high arousing and unpleasant pictures provoked stronger responses. In addition, the effects of valence and arousal in delta oscillations were modulated by gender. As expected, when an ERD/ERS analysis has been conducted, hemispheric differences have been found for the aforementioned effects in the male group. In a previous study  authors remark the contribution of delta waves in emotional modulation by visual inspection of emotional face expressions. The results presented in this paper demonstrate the participation of delta oscillations in emotional processing, in agreement with what has been shown in that study .
The main findings for the ERD/ERS analyses were the following: high arousal pictures provoked greater ERS responses of delta oscillations than low arousal pictures, which is in line with previous literature [10, 22], and this was mostly the case for the males participants. Moreover, females showed a greater ERS response as compared to males not only right after stimulus onset (0–500 ms interval), but also during the whole trial. Both males and females showed an effect of valence on ERD/ERS responses. Though, this effect interacted with hemisphere in males. On the other hand, in females, regardless of hemisphere, unpleasant pictures provoked a greater ERS values relative to pleasant pictures, whereas in males this was the case only for the right hemisphere. In the left hemisphere of the male group, ERS exhibited greater values for the pleasant pictures relative to the unpleasant. The prevalence of the right hemisphere in the emotional processing was also supported by a stronger initial (0–500 ms interval) synchronization in the right hemisphere relative to the left hemisphere.
Finally, results showed that the time course of these effects differed for males and females. Females showed a significant effect of the emotional valence of the stimulus only right after onset, whereas the effect of valence on ERS appeared much later (in the 1000–1500 ms interval) in males. The effect of arousal on ERS response was observed relatively soon (500–1000 ms after stimulus onset) in males. These findings suggest that there is a slower synchronization of delta oscillations in response to emotional stimuli for males as compared to females.
The initial stronger and faster response of females to emotional stimuli, as shown in the ERS analyses, replicate previous findings [38, 39], that have shown gender differences in cognitive tasks. Thus, it is generally agreed that male’s performance is better on spatial tasks, whereas females perform better on emotion-related tasks [40–42]. These results suggest that this difference may not only be due to cultural influences but may also reflect gender differences concerning information processing in the brain. There were also gender differences in arousal. While males showed greater ERS values for HA pictures relative to LA pictures, there was not a significant effect of arousal for females.
As it is expected, ERS analyses were sensitive to brain asymmetry in emotional processing as well. Clearly, the results summarized above, support the dominance of the right hemisphere in emotional processing but only for males. In females, the emotional response was not lateralized. It is known that specific cognitive processes are lateralized either to the left or right hemisphere in males . In contrast, cognitive processes are not so strongly lateralized in females, possibly because of the anatomical differences in the corpus callosum; it has been reported that women have a larger callosal size, which would enhance inter-hemispheric transfer, and would result in stronger bilateral processing as compared to males . This may explain why we found brain asymmetry effects on ERS responses in males but not in females. Our finding regarding right hemisphere prevalence in emotional processing, particularly for unpleasant-threatening stimuli, is also in line with already published literature (see  for a review). On the other hand, our results show that the left hemisphere appears to be dominant for the processing of pleasant-positive-stimuli. As Davidson has shown [45–47], the LH is associated with more positive emotions in contrast to the RH, which is more involved in negative stimuli .
The most consistent finding was that female participants exhibited in general greater responses than male participants, and this finding was true for early and late components. The literature about gender differences in emotional processing is limited and focuses mainly on brain asymmetries employing event-related potentials. For instance, a recent study  investigated memory processing of faces that were classified as neutral, friendly and unfriendly. The ERP analysis demonstrated larger amplitudes in female participants relative to male participants. These differences were present during both early processing, as indicated by N300 and N400 components and late processing which lasted until the P600. Thus, the present study generalizes this finding to complex emotional stimuli, using a different measure of brain activity. In the present study, gender differences were stronger at the early negative peaks (N300, N400). Also, in agreement with this study , we observed later gender effects by positive deflections approximately 600–800 ms and 1200–1500 after stimulus onset. A more recent study  used simple light stimulation in order to investigate gender differences during the various frequency bands of the human EEG. The results showed that the delta response amplitudes for women were significantly higher than for men over occipital, parietal, central and temporal electrode locations. Consequently, the specific frequency band has a key role in the investigation of gender differences in the processing of emotionally stimuli. At last, gender differences in emotional processing can be explained in terms of differences in phyletic memory . This memory has genetic origin and is based on the evolution theory.
The second main finding was that event-related delta oscillations were also modulated by the valence of the stimulus. In general, unpleasant pictures provoked greater responses than pleasant pictures did, although this effect was sometimes modulated by gender. Also, these effects were stronger and most consistent at the frontal electrodes (e.g., N300–400, P600–800, and N1100–1200 components). This finding agrees with previous work  that has shown that areas in the frontal cortex are activated by the valence dimension of the emotional stimuli. There is also converging evidence from neuropsychological studies, which supports a deficit in the processing of pleasant stimuli after damage to the left dorsolateral area , whereas bilateral lesions of the ventromedial prefrontal cortex are associated with inability to anticipate the rewarding consequences of an action . Neuroimaging studies with healthy adults have also reported  activation in the right frontal region during withdrawal-related negative affective states. However, despite the great amount of studies investigating the laterality of emotional processing in the frontal cortex, the function of the medial frontal cortical structure has not been studied so thoroughly. The present study suggests that the analysis of temporal changes occurring in this area reveals an effect of the emotional valence of the stimulus during the early processing (N300–400 component), since the activation of the defense system (unpleasant pictures) elicits greater delta activity in comparison to the activation of the appetitive system (pleasant pictures).
Finally, the results suggested that the positive peak that occurred almost 350 ms after stimulus onset mainly on parietal locations resulted in a strong arousal effect. Arousal effects on delta oscillations were also found for later positive (P400–500 and P1200–1500) and negative components (N1100–N1200). A substantial portion of P300 variation appears to be caused by fluctuations in the arousal state of the participants . A more recent study using IAPS pictures, demonstrated that the emotional stimuli elicit a more positive wave in the P300 area than neutral stimuli. Further evidence is provided by studies that showed enhanced P300 responses to alcohol and smoking-related cues in alcoholics and smokers respectively [57, 58]. On the other hand, time-frequency analysis of task-related and rare stimuli yielded a later delta coefficient with a parietal predominance . These findings are further supported by findings that suggest the contribution of delta activity to P3b expression . Furthermore, a more technical study  demonstrated that P3b components have a more centro-parietal distribution. Indeed the results reported above mention a main effect of arousal 450 ms after stimulus onset. However, the latency of this response is delayed in comparison to the ERP occurrence and it also follows the parietal delta response.
The results of this piece of work provide some evidence towards the confirmation of the authors’ hypothesis, that human emotional state and its associated brain processing related to and affects delta frequency activity. However, the relatively small number of electrodes used in the experimental recordings pertains to certain limitations [4, 37], since the spreading effect of the low conductivity skull cannot convey on detailed information of the scalp distributed potentials. So, there is a need for further research in this field with more accurate recordings, which will disclose effectively the scalp distributed phenomena occurred by emotional visual stimuli. It is also expected that the full intraband comparison will delineate the human brain emotional processing characteristics in a more comprehensive way. Nevertheless, the results presented here regarding the affection of delta oscillations by emotional stimuli cannot be overlooked.
In conclusion, to the best of our knowledge, this is the first study concerning the relation of delta oscillations (in terms of peak amplitude analysis and synchronization effects) and emotional processing triggered by visual stimuli from the IAPS collection. The results obtained here denote the important role of emotional processing in delta wave modulation. However, further research is needed in order to extend the interaction of two emotional dimensions (valence and arousal) with the subject’s gender and their effect on other bands and characteristic oscillations.
- P. Vuilleumier, “How brains beware: neural mechanisms of emotional attention,” Trends in Cognitive Sciences, vol. 9, no. 12, pp. 585–594, 2005.
- C. Neuper and G. Pfurtscheller, “Event-related dynamics of cortical rhythms: frequency-specific features and functional correlates,” International Journal of Psychophysiology, vol. 43, no. 1, pp. 41–58, 2001.
- S. Makeig, S. Debener, J. Onton, and A. Delorme, “Mining event-related brain dynamics,” Trends in Cognitive Sciences, vol. 8, no. 5, pp. 204–210, 2004.
- E. Başar, C. Başar-Eroglu, S. Karakaş, and M. Schürmann, “Gamma, alpha, delta, and theta oscillations govern cognitive processes,” International Journal of Psychophysiology, vol. 39, no. 2-3, pp. 241–248, 2001.
- J. Yordanova, V. Kolev, and E. Başar, “Oscillatory brain responses: changes with development and aging,” in Brain Function and Oscillations. I. Brain Oscillations: Principles and Approaches, E. Başar, Ed., pp. 239–251, Springer, Berlin, Germany, 1998.
- H. Berger, “UÈ ber das Elektrenkephalogramm des Menschen II,” Journal of Comparative Neurology and Psychology, vol. 40, pp. 160–179, 1930.
- G. Pfurtscheller and F. H. Lopes da Silva, “Event-related EEG/MEG synchronization and desynchronization: basic principles,” Clinical Neurophysiology, vol. 110, no. 11, pp. 1842–1857, 1999.
- G. Pfurtscheller and A. Aranibar, “Event related cortical desynchronization detected by power measurements of scalp EEG,” Electroencephalography and Clinical Neurophysiology, vol. 42, no. 6, pp. 817–826, 1977.
- P. J. Lang, M. M. Bradley, and B. N. Cuthbert, “International Affective Picture System (IAPS): Technical Manual and Affective Ratings,” NIMH Center for the Study of Emotion and Attention, 1997.
- G. G. Knyazev, “Motivation, emotion, and their inhibitory control mirrored in brain oscillations,” Neuroscience and Biobehavioral Reviews, vol. 31, no. 3, pp. 377–395, 2007.
- D. Paré, “Role of the basolateral amygdala in memory consolidation,” Progress in Neurobiology, vol. 70, no. 5, pp. 409–420, 2003.
- N. Nishitani, “Dynamics of cognitive processing in the human hippocampus by neuromagnetic and neurochemical assessments,” NeuroImage, vol. 20, no. 1, pp. 561–571, 2003.
- E. Başar, Brain Function and Oscillations. I. Brain Oscillations: Principles and Approaches, Springer, Berlin, Germany, 1998.
- E. Başar, Brain Function and Oscillations. II. Integrative Brain Function. Neurophysiology and Cognitive Processes, Springer, Berlin, Germany, 1999.
- C. Amrhein, A. Muhlberger, P. Pauli, and G. Wiedemann, “Modulation of event-related brain potentials during affective picture processing: a complement to startle reflex and skin conductance response?” International Journal of Psychophysiology, vol. 54, no. 3, pp. 231–240, 2004.
- B. N. Cuthbert, H. T. Schupp, M. M. Bradley, N. Birbaumer, and P. J. Lang, “Brain potentials in affective picture processing: covariation with autonomic arousal and affective report,” Biological Psychology, vol. 52, no. 2, pp. 95–111, 2000.
- C. Lithari, C. Frantzidis, C. Papadelis, et al., “Are females more sensitive to emotional stimuli? A neurophysiological study across arousal and valence dimensions,” Brain Topography, under review.
- R. D. Lane, P. M.-L. Chua, and R. J. Dolan, “Common effects of emotional valence, arousal and attention on neural activation during visual processing of pictures,” Neuropsychologia, vol. 37, no. 9, pp. 989–997, 1999.
- M. M. Bradley, M. Codispoti, B. N. Cuthbert, and P. J. Lang, “Emotion and motivation I: defensive and appetitive reactions in picture processing,” Emotion, vol. 1, no. 3, pp. 276–298, 2001.
- A. Keil, M. M. Müller, T. Gruber, C. Wienbruch, M. Stolarova, and T. Elbert, “Effects of emotional arousal in the cerebral hemispheres: a study of oscillatory brain activity and event-related potentials,” Clinical Neurophysiology, vol. 112, no. 11, pp. 2057–2068, 2001.
- L. I. Aftanas, A. A. Varlamov, S. V. Pavlov, V. P. Makhnev, and N. V. Reva, “Affective picture processing: event-related synchronization within individually defined human theta band is modulated by valence dimension,” Neuroscience Letters, vol. 303, no. 2, pp. 115–118, 2001.
- L. I. Aftanas, A. A. Varlamov, S. V. Pavlov, V. P. Makhnev, and N. V. Reva, “Time-dependent cortical asymmetries induced by emotional arousal: EEG analysis of event-related synchronization and desynchronization in individually defined frequency bands,” International Journal of Psychophysiology, vol. 44, no. 1, pp. 67–82, 2002.
- T. Demiralp and E. Başar, “Theta rhythmicities following expected visual and auditory targets,” International Journal of Psychophysiology, vol. 13, no. 2, pp. 147–160, 1992.
- R. G. Heath, “Pleasure and brain activity in man. Deep and surface electroencephalograms during orgasm,” Journal of Nervous and Mental Disease, vol. 154, no. 1, pp. 3–18, 1972.
- D. M. Tucker and S. L. Dawson, “Asymmetric EEG changes as method actors generated emotions,” Biological Psychology, vol. 19, no. 1, pp. 63–75, 1984.
- G. Yener, B. Güntekin, and E. Başar, “Event-related delta oscillatory responses of Alzheimer patients,” European Journal of Neurology, vol. 15, no. 6, pp. 540–547, 2008.
- E. Başar, C. Schmiedt-Fehr, A. Öniz, and C. Başar-Eroğlu, “Brain oscillations evoked by the face of a loved person,” Brain Research, vol. 1214, pp. 105–115, 2008.
- T. Harmony, T. Fernandez, J. Silva, et al., “EEG delta activity: an indicator of attention to internal processing during performance of mental tasks,” International Journal of Psychophysiology, vol. 24, no. 1-2, pp. 161–171, 1996.
- L. I. Aftanas, L. N. Savotina, V. P. Makhnev, and N. V. Reva, “Analysis of evoked EEG synchronization and desynchronization during perception of emotiogenic stimuli: association with autonomic activation processes,” Neuroscience and Behavioral Physiology, vol. 35, no. 9, pp. 951–957, 2005.
- M. Schürmann, C. Başar-Eroglu, V. Kolev, and E. Başar, “A new metric for analyzing single-trial event-related potentials (ERPs): application to human visual P300 delta response,” Neuroscience Letters, vol. 197, no. 3, pp. 167–170, 1995.
- D. V. Moretti, C. Babiloni, G. Binetti, et al., “Individual analysis of EEG frequency and band power in mild Alzheimer's disease,” Clinical Neurophysiology, vol. 115, no. 2, pp. 299–308, 2004.
- C. A. Frantzidis, C. Lithari, A. Vivas, et al., “Towards emotion aware computing: a study of arousal modulation with multichannel event-related potentials, delta oscillatory activity and skin conductivity responses,” in Proceedings of the 8th IEEE International Conference on BioInformatics and BioEngineering (BIBE '08), 2008.
- D. J. McFarland, L. M. McCane, S. V. David, and J. R. Wolpaw, “Spatial filter selection for EEG-based communication,” Electroencephalography and Clinical Neurophysiology, vol. 103, no. 3, pp. 386–394, 1997.
- M. A. Klados, C. Papadelis, C. Lythari, and P. D. Bamidis, “The removal of ocular artifacts from EEG signals: a comparison of performances for different methods,” in Proceedings of the 4th European Conference of the International Federation for Medical and Biological Engineering (ECIFMBE '08), IFMBE Proceedings 22, pp. 1259–1263, Antwerp, Belgium, November 2008.
- E. Başar, C. Başar-Eroglu, S. Karakas, and M. Schürmann, “Oscillatory brain theory: a new trend in neuroscience: the role of oscillatory processes in sensory and cognitive functions,” IEEE Engineering in Medicine and Biology Magazine, vol. 18, no. 3, pp. 56–66, 1999.
- C. Başar-Eroglu, E. Başar, T. Demiralp, and M. Schürmann, “P300-response: possible psychophysiological correlates in delta and theta frequency channels. A review,” International Journal of Psychophysiology, vol. 13, no. 2, pp. 161–179, 1992.
- M. Balconi and U. Pozzoli, “Event-related oscillations (ERO) and event-related potentials (ERP) in emotional face recognition,” International Journal of Neuroscience, vol. 118, no. 10, pp. 1412–1424, 2008.
- J. Wrase, S. Klein, S. M. Gruesser, et al., “Gender differences in the processing of standardized emotional visual stimuli in humans: a functional magnetic resonance imaging study,” Neuroscience Letters, vol. 348, no. 1–4, pp. 41–45, 2003.
- M. Lewis, J. M. Haviland-Jones, and L. Feldman Barrett, Handbook of Emotions, Guilford Press, New York, NY, USA, 2008.
- N. Jaušovec and K. Jaušovec, “Spatial rotation and recognizing emotions: gender related differences in brain activity,” Intelligence, vol. 36, no. 5, pp. 383–393, 2008.
- M. Grossman and W. Wood, “Sex differences in intensity of emotional experience: a social role interpretation,” Journal of Personality and Social Psychology, vol. 65, no. 5, pp. 1010–1022, 1993.
- A. M. Kring and A. H. Gordon, “Sex differences in emotion: expression, experience, and physiology,” Journal of Personality and Social Psychology, vol. 74, no. 3, pp. 686–703, 1998.
- C. Davatzikos and S. M. Resnick, “Sex differences in anatomic measures of interhemispheric connectivity: correlations with cognition in women but not men,” Cerebral Cortex, vol. 8, no. 7, pp. 635–640, 1998.
- H. A. Demaree, D. E. Everhart, E. A. Youngstrom, and D. W. Harrison, “Brain lateralization of emotional processing: historical roots and a future incorporating “dominance”,” Behavioral and Cognitive Neuroscience Reviews, vol. 4, no. 1, pp. 3–20, 2005.
- R. J. Davidson, “Emotion and affective style: hemispheric substrate,” Psychological Science, vol. 3, pp. 39–43, 1992.
- R. J. Davidson, “Cerebral asymmetry, emotion and affective style,” in Brain Asymmetry, R. J. Davidson and K. Hugdahl, Eds., pp. 361–387, MIT Press, Boston, Mass, USA, 1995.
- R. J. Davidson, “Anterior electrophysiological asymmetries, emotion, and depression: conceptual and methodological conundrums,” Psychophysiology, vol. 35, pp. 607–614, 1998.
- D. C. Hammond, “Neurofeedback treatment of depression and anxiety,” Journal of Adult Development, vol. 12, no. 2-3, pp. 131–137, 2005.
- F. Guillem and M. Mograss, “Gender differences in memory processing: evidence from event-related potentials to faces,” Brain and Cognition, vol. 57, no. 1, pp. 84–92, 2005.
- B. Güntekin and E. Başar, “Brain oscillations are highly influenced by gender differences,” International Journal of Psychophysiology, vol. 65, no. 3, pp. 294–299, 2007.
- J. M. Fuster, Memory in the Cerebral Cortex: An Empirical Approach to Neural Networks in the Human and Nonhuman Primate, MIT Press, Cambridge, Mass, USA, 1995.
- R. J. Davidson and W. Irwin, “The functional neuroanatomy of emotion and affective style,” Trends in Cognitive Sciences, vol. 3, no. 1, pp. 11–21, 1999.
- G. Gianotti, “Emotional behaviour and hemispheric side of lesion,” Cortex, pp. 41–55, 1972.
- A. Bechara, A. R. Damasio, H. Damasio, and S. W. Anderson, “Insensitivity to future consequences following damage to human prefrontal cortex,” Cognition, vol. 50, no. 1–3, pp. 7–15, 1994.
- R. J. Davidson, P. Ekman, C. D. Saron, J. A. Senulis, and W. V. Friesen, “Approach-withdrawal and cerebral asymmetry: emotional expression and brain physiology,” Journal of Personality and Social Psychology, vol. 58, no. 2, pp. 330–341, 1990.
- J. Polich and A. Kok, “Cognitive and biological determinants of P300: an integrative review,” Biological Psychology, vol. 41, no. 2, pp. 103–146, 1995.
- C. Hermann, S. Ziegler, N. Birbaumer, and H. Flor, “Pavlovian aversive and appetitive odor conditioning in humans: subjective, peripheral, and electrocortical changes,” Experimental Brain Research, vol. 132, no. 2, pp. 203–215, 2000.
- C. A. Warren and B. E. McDonough, “Event-related brain potentials as indicators of smoking cue-reactivity,” Clinical Neurophysiology, vol. 110, no. 9, pp. 1570–1584, 1999.
- V. Kolev, T. Demiralp, J. Yordanova, A. Ademoglu, and U. Isoglu-Alkac, “Time-frequency analysis reveals multiple functional components during oddball P300,” NeuroReport, vol. 8, no. 8, pp. 2061–2065, 1997.
- T. Demiralp, J. Yordanova, V. Kolev, A. Ademoglu, M. Devrim, and V. J. Samar, “Time-frequency analysis of single-sweep event-related potentials by means of fast wavelet transform,” Brain and Language, vol. 66, no. 1, pp. 129–145, 1999.
- M. Jing, S. Sanei, and A. Sumich, “An automatic detection and localization of P300 sub-components using ICA,” in Proceedings of the IEEE International Workshop on Biomedical Circuits and Systems (BioCAS '04), pp. S3.6-1–S3.6-4, Singapore, December 2004.