Abstract

Steady state visual evoked potential (SSVEP) is the brain's natural electrical potential response for visual stimuli at specific frequencies. Using a visual stimulus flashing at some given frequency will entrain the SSVEP at the same frequency, thereby allowing determination of the subject's visual focus. The faster an SSVEP is identified, the higher information transmission rate the system achieves. Thus, an effective stimulus, defined as one with high success rate of eliciting SSVEP and high signal-noise ratio, is desired. Also, researchers observed that harmonic frequencies often appear in the SSVEP at a reduced magnitude. Are the harmonics in the SSVEP elicited by the fundamental stimulating frequency or by the artifacts of the stimuli? In this paper, we compare the SSVEP responses of three periodic stimuli: square wave (with different duty cycles), triangle wave, and sine wave to find an effective stimulus. We also demonstrate the connection between the strength of the harmonics in SSVEP and the type of stimulus.

1. Introduction

A brain-computer interface (BCI) translates brain activities into commands that control external devices. BCI research was initially motivated by the need of a new type of communication tools for paralyzed or elderly people [1, 2]. In recent years, many researchers have investigated BCI for computer gaming and entertainment applications [36], which makes noninvasive electroencephalography (EEG) a popular choice [7]. Three types of neuronal signals are most commonly used in EEG-based BCI systems: event-related potentials (ERP) [6, 8, 9], motor-imagery-related brain activity [10, 11], and steady state visual evoked potentials (SSVEP) [1220].

Among these choices, SSVEP is viewed, by many researchers, as a promising electrophysiological source for BCI systems [21]. When looking at a light stimulus flickering at a given frequency, a user's SSVEP is entrained at the same frequency. Hence, by examining the EEG signal, a simple algorithm can identify the corresponding stimulus at which the subject is looking [22, 23]. It has been reported that SSVEPs can be elicited in the range of 4–100 Hz [2426]. Although the strongest responses were observed in the range of 5–20 Hz, high-frequency stimuli (greater than 30 Hz) present minimal safety hazards due to photo-induced epileptic seizures [27].

Because EEG is always mixed with background noises, the efficacy of an SSVEP-based BCI system relies heavily on the signal-noise ratio. Intuitively, SSVEP will be detected much faster and with greater easy if the signal-noise ratio is high. The faster an SSVEP is identified, the faster a BCI system can correctly respond, hence a higher information throughput [28]. As it is currently unknown whether the choice of a square wave, triangle wave, or sine wave light signal affects the strength of the elicited SSVEP, these three waveforms (square wave with different duty cycles) were compared in Section 3 for their success rate in eliciting an SSVEP response. In addition, researchers have observed that a stimulus at frequency 𝑓 can elicit SSVEP not only at 𝑓 , but also at harmonics 2 𝑓 , 3 𝑓 , or sometimes even higher orders [29, 30]. This seems to suggest that harmonics may be used to detect the stimulating frequency. In order to take advantage of the harmonics in the design of a BCI system, the following question needs to be addressed: are SSVEP harmonics elicited by the fundamental frequency, that is, 𝑓 , or by the artifacts of the stimulus?

From a signal perspective, the commonly used flickering stimulus is a periodic square wave with 50% duty cycle. Its spectrum contains nonzero Fourier components at ± ( 2 𝑘 1 ) 𝑓 , 𝑘 = 1 , 2 , . Therefore, under a square wave stimulus, the cause of a 3 𝑓 harmonic in SSVEP is unclear. In this paper, we explore the SSVEP responses of three periodic stimuli: square waves with different duty cycles, triangle waves, and sine waves. This group of waveforms provides us with the flexibility to adjust the strength of harmonics in a stimulus, hence allowing us to investigate the effects of artifact on SSVEPs.

The remainder of the paper is organized as follows. In Section 2, we describe the stimuli used in the experiments and the experimental setup. The results are given in Section 3. We conclude in Section 4.

2. Methodology

Three types of periodic stimuli were used in the experiments: square waves (with duty cycle 𝜏 ( 0 , 1 ) ), triangle waves, and sine waves. If we define the relative strength of the 𝑘 th harmonic frequency with respect to the fundamental frequency as 𝑟 ( 𝑘 ) = | 𝐺 𝑘 / 𝐺 1 | , where 𝐺 1 and 𝐺 𝑘 are the Fourier coefficients for the fundamental frequency and the 𝑘 th harmonic frequency, respectively, it is straightforward to show that 𝑟 s i n e ( 𝑘 ) = 1 for 𝑘 = ± 1 and 0 otherwise; 𝑟 t r i a n g l e ( 𝑘 ) = [ ( 𝜋 / 2 ) s i n e ( 𝑘 𝜋 / 2 ) ] 2 ; 𝑟 s q u a r e ( 𝑘 ) = | s i n e ( 𝑘 𝜏 ) / s i n e ( 𝜏 ) | . Clearly, in theory, there are no harmonic frequencies in a sine wave. In a triangle wave, the harmonic frequencies only exist for odd 𝑘 . Its magnitude is proportional to 1 / 𝑘 2 . For a square wave with duty cycle 𝜏 = 0 . 5 , there are also no harmonics for even 𝑘 . The magnitude of odd harmonics is, however, proportional to 1 / 𝑘 , that is, stronger than that of a triangle wave. Note that the magnitude of harmonics of a square wave depends on its duty cycle, for example, 𝑟 s i n e ( 2 ) > 0 for 𝜏 0 . 5 .

The above wave forms were rendered using an LED. In order to generate sine and triangle luminance signal, the LED needs to work in a linear (or close to linear) operating region. For the LED used in our experiments, a 3.25 V DC bias was applied. The resulting linear operating region is [3 V, 3.5 V]. The luminance of the LED was converted to an electrical signal using a Lutron LX-102 light meter. The output of the light meter was visualized using a Agilent 54621D oscilloscope and recorded using an integrated sound card. Figure 1 shows the luminance signal and its spectrum of the three waves. Note that the light signals were not perfectly sine, triangle, or square waves due to the nonlinearity of the LED. The artifacts in the sine and triangle waves were more significant than in the square wave. For example, 2 𝑓 , which should not exist theoretically in sine or triangle waves, appeared in the measured luminance signal. Nevertheless, the amplitude of 2 𝑓 in the measured sine or triangle luminance is roughly one order of magnitude smaller.

Five subjects participated in this experiment. EEG was recorded with one channel over the occipital cortex at a sampling rate of 1 kHz, filtered by a 0.15 Hz high-pass filter and a 150 Hz low-pass filter. The distance between the LED and a subject was 50 cm. We examined stimuli of 11 Hz, 13 Hz, 15 Hz, 18 Hz, and 22 Hz and recorded the SSVEPs of square, triangle, and sine waves. Square waves were generated with 10%, 25%, and 50% duty cycles. In each recording session, the subject was told to look at the stimulus for 8 seconds and close their eyes for a rest period of a random duration from 10 to 20 seconds. The recorded data were discarded when muscle movements artifacts were significant.

3. Results

The primary research goals of these experiments are to find out what kind of waveforms is preferred for future SSVEP based systems. Table 1 reports the SSVEP results from all subjects. 𝑓 is the fundamental frequency of the stimulus. “Valid trials” is the number of trials where the magnitude of FFT coefficients of SSVEP at 𝑓 , 2 𝑓 , or 3 𝑓 are 50% greater than the baseline. “Total trials" is the number experiments in which a stimulus is presented to a user regardless of whether the SSVEP peaks were detected. “1 𝑓 occurs, 2 𝑓 occurs, and 3 𝑓 occurs” are the number of observed SSVEP peaks at 1 𝑓 , 2 𝑓 and 3 𝑓 , respectively.

Theoretically, SSVEP peaks appear at the stimulus frequency 1 𝑓 and its harmonics 2 𝑓 , 3 𝑓 , and so forth. An SSVEP system has to use an recognizable 1 𝑓 component to identify which frequency the subject is looking at, while it sometimes uses its harmonics to improve the accuracy. Thus, a valid trial without a 1 𝑓 peak may not be acceptable in a real SSVEP system. So, we define a trial in which 1 𝑓 occurs as an accurate trial, and the accuracy of a certain type of waveform of a certain frequency is A c c u r a c y w a v e , f r e q u e n c y = 1 𝑓 o c c u r s / T o t a l t r i a l s . Figure 2 shows the accuracies of SSVEP trials driven by the three waves above.

We have the following observations. (i)A square waves with 50% duty cycle have a significantly higher accuracy than other stimuli in our experiment. As shown in Figure 2, the average accuracies ( a l l f r e q u e n c i e s n u m b e r o f a c c u r a t e t r i a l s / a l l f r e q u e n c i e s t o t a l n u m b e r o f t r i a l s ) of sine, triangle, and square waves with duty cycle 50%, 25%, and 10% were 7 0 . 4 % , 8 1 . 0 % , 9 4 . 7 % , 7 9 . 8 % , and 6 9 . 1 % , respectively. Using statistic analysis techniques, we check if the performance of 50% square wave is better than that of triangle wave, which is intuitively the second best waveform as seen in Figure 2, with a significant level less than 0.05. ( 9 0 / 9 5 ) 50% square waves and ( 8 1 / 1 0 0 ) triangle waves evoked 1 𝑓 SSVEP, thus 𝑍 = ( 𝑝 1 𝑝 2 ) ( 𝜋 1 𝜋 2 ) / 𝑝 1 ( 1 𝑝 1 ) / 𝑛 1 + 𝑝 2 ( 1 𝑝 2 ) / 𝑛 2 = 1 . 7 2 8 . Since 𝑍 𝛼 = ( 𝑥 𝜇 0 ) / ( 𝜎 / 𝑛 ) = 1 . 6 4 5 < 𝑍 , we conclude that square waves with 5 0 % duty cycle have a significantly higher accuracy than other stimuli in our experiment. (ii)A square wave has a higher success rate than sine or triangle waves in eliciting SSVEPs. In our experiments, the success rates (number of valid trials divided by the total number of trials) for sine, triangle, and square waves were 7 5 . 0 % , 8 3 . 0 % , and 9 0 . 8 % , respectively. (iii)All three wave forms elicited 2 𝑓 component in SSVEPs. In our experiments, the success rates for 2 𝑓 component in SSVEP were 4 2 . 9 % for sine waves, 4 8 . 2 % for triangle waves, and 5 6 . 2 % for square waves (averaged over all three duty cycles). Among the three duty cycles, 1 0 % , 2 5 % , and 5 0 % , of the square wave, the 2 𝑓 success rates were 4 3 . 0 % , 7 0 . 7 % , and 5 9 . 0 % , respectively.(iv)A square wave has a significantly higher success rate than sine or triangle wave in eliciting 3 𝑓 component in SSVEPs. In our experiments, the success rates for 3 𝑓 component in SSVEP were 18.4% for sine waves, 14.0% for triangle waves, and 48.0% for square waves (averaged over all three duty cycles). Among the three duty cycles, 10%, 25%, and 50%, of the square wave, the 3 𝑓 success rates were 44.6%, 50.7%, and 55.0%, respectively.

Although sine, triangle, and square waves with 5 0 % duty cycle do not contain 2 𝑓 component, they all elicited 2 𝑓 in SSVEP with similar success rates. Square wave with 2 5 % duty cycle contains a strong 2 𝑓 component. Its 2 𝑓 success rate is significantly higher ( 7 0 . 7 % ). This suggests that (1) the 2 𝑓 component is primarily elicited by the fundamental frequency and (2) the artifacts in the stimuli increase the success rate of 2 𝑓 in SSVEP. A similar observation is obtained for 3 𝑓 . This seems to suggest that although the fundamental frequency can elicit harmonics (2 𝑓 and 3 𝑓 in our experiments) in SSVEP, the success rate of getting harmonics in SSVEPs is positively correlated with the strength of the artifacts in a stimulus.

4. Conclusion

Our results showed that the harmonics associated with SSVEP are elicited both by the fundamental frequency and the artifacts of the stimuli, with the 2 𝑓 component mainly produced by the fundamental frequency and the 3 𝑓 mainly by the artifacts of square waves. At the same time, SSVEP elicited with square waves do not always contain all the artifactual frequency components, for example, 3 𝑓 , and SSVEP with sine waves may have 3 𝑓 harmonics, which is not a part of the stimuli artifacts.

We also observed that square waves with 5 0 % duty cycle have a significantly higher accuracy than other stimuli in our experiment. As a result, the use of square waves with 5 0 % duty cycle is preferred if high 1 𝑓 SSVEP eliciting rate is the goal, while sine waves for SSVEP simulation should be chosen if few harmonic artifacts are wanted.

Acknowledgments

This work was supported by the Department of Computer and Information Science and the School of Engineering, University of Mississippi. We would like to thank James Church, Joseph Smith, Xiaofei Nan, and Jing Ma for the help in data collection.