Brain Computer Interface Systems for Neurorobotics: Methods and ApplicationsView this Special Issue
A MISO-ARX-Based Method for Single-Trial Evoked Potential Extraction
In this paper, we propose a novel method for solving the single-trial evoked potential (EP) estimation problem. In this method, the single-trial EP is considered as a complex containing many components, which may originate from different functional brain sites; these components can be distinguished according to their respective latencies and amplitudes and are extracted simultaneously by multiple-input single-output autoregressive modeling with exogenous input (MISO-ARX). The extraction process is performed in three stages: first, we use a reference EP as a template and decompose it into a set of components, which serve as subtemplates for the remaining steps. Then, a dictionary is constructed with these subtemplates, and EPs are preliminarily extracted by sparse coding in order to roughly estimate the latency of each component. Finally, the single-trial measurement is parametrically modeled by MISO-ARX while characterizing spontaneous electroencephalographic activity as an autoregression model driven by white noise and with each component of the EP modeled by autoregressive-moving-average filtering of the subtemplates. Once optimized, all components of the EP can be extracted. Compared with ARX, our method has greater tracking capabilities of specific components of the EP complex as each component is modeled individually in MISO-ARX. We provide exhaustive experimental results to show the effectiveness and feasibility of our method.
Evoked potentials (EPs) are localized potential changes generated by the central nervous system when stimulated by well-defined external stimuli (such as electrical, light, sound, and other stimuli) . Thus, EPs can be categorized as auditory evoked potentials (AEPs), visual evoked potentials (VEPs), somatosensory evoked potentials (SEPs), and motor evoked potentials (MEPs) according to the modality of stimulation. Depending on the experimental paradigm, EPs may include a complex of partially overlapping components , reflecting different processing stages along the neural pathways. The latency variations of specific components can objectively reflect changes in the underlying state of the neural pathways, which is very meaningful in cognitive science research and clinical applications . Many single-trial EP extracting methods have been proposed in order to enhance the ability to track latency variations.
Parametric modeling using autoregression with exogenous inputs (ARX) is a commonly used method for extracting single-trial EPs over the conventional moving time average . ARX modeling for single-trial EP estimation was first proposed by Cerutti et al. . In ARX, the electroencephalogram (EEG) can be viewed as an autoregression (AR) model driven by white noise, and the EP can be accurately modeled by an autoregressive-moving-average (ARMA) filter with a known signal . The known signal is typically the average of the reference EPs (AREP). The order and parameters of the AR and ARMA models can be estimated by utilizing various optimization techniques, such as the final prediction error (FPE)  and the least-squares (LS) method . The EPs can then be reconstructed by ARMA filtering with the AREP. ARX modeling has been widely adopted by researchers to rapidly extract middle latency AEPs, VEPs, and SEPs. For example, Mainardi et al.  used the ARX model to quantify changes in auditory N100 for the monitoring of sedation in cardiac surgery patients. Rossi et al.  extracted single-trial SEPs with ARX filtering for monitoring the functional integrity of the spinal cord during surgery. Lange and Inbar  further extended the ARX estimator to make the single-trial estimation process resistant to noise present in the system using a robust evoked potential estimator (REPE). However, Cerutti et al.  recently found, by systemic experimentation, that EP extraction using ARX modeling is completely invalid when latency varies greatly compared with the AREP. We carried out a further study on the single-trial extracting experiments made by De Silva et al. . We found that they always assumed temporal lag between the input and the output of the ARX model equaled zero, which causes significant error when latency varies greatly. In addition, they limited the ARX method to yield a waveform similar to the average response, differing only in global latency. Thus, their procedure cannot demonstrate the method’s tracking capabilities of specific components of the EPs. An EP complex may contain components that originated from different functional brain sites . The summation of these components results in component overlap, which may cause partial occlusion of the desired component’s features. Because of this, the tracking of latency variations of specific components is very difficult.
In this paper, we present a novel single-trial evoked potential estimation method based on multiple-input single-output ARX (MISO-ARX). In MISO-ARX, each component of the EP is individually modeled by an ARMA filter with a reference signal to avoid different components interfering with each other as in ARX. In addition, all parameters are calculated synchronously to guarantee that the estimated EP is optimal overall. Moreover, as EPs have been proven (in our previous paper) to have strong sparsity over an appropriate dictionary, we first roughly estimate the temporal lag of specific components with sparse coding before calculating the parameters of MISO-ARX in order to improve robustness against great latency variations. A series of experiments carried out on simulated and human test responses confirmed the superior performance of our MISO-ARX method for tracking latency variations even in situations of extremely low SNR. The rest of this paper is organized as follows. Section 2 gives a detailed description of our single-trial estimation algorithm. Section 3 contains our experimental results obtained by using the MISO-ARX method and a comparison with ARX and REPE methods. Section 4 presents our conclusions.
2. Single-Trial Evoked Potential Extraction with MISO-ARX
EPs are always embedded in the ongoing spontaneous EEG background, and the SNR is extremely low (below 0 dB). The main parts of our method consist of removing the EEG from the measurement and then reconstructing the single-trial EP . The measurement is
2.1. The EP Signal
The single-trial EP is considered as a complex containing many components; these components may originate from different functional brain sites and can be distinguished according to their respective latencies and amplitudes. The EP waveform is assumed to be a superposition of components:where is the basic shape of the component, is the component’s latency, and indicates the component’s amplitude.
In MISO-ARX, each component is derived by filtering the reference using the ARMA model parameters, as shown in where and . Thus, (2) can be rewritten as In (4), can be parameterized asThen, we assume and , which yields Thus, , and we obtain
2.2. Reference Signal for Each Component
The selection of reference signals, which directly affects the accuracy of EP extraction, is a very important process. In MISO-ARX, we extract the reference signal for each component from the AREP using a specific filtering window function, such as the Hamming window or the Blackman window. The central location and width of the window are determined by the location and width of the peak, respectively. An example of a simulated decomposition is provided in Figure 1. It can be seen that the simulated waveform consists of three underlying components, which were extracted using a Hamming window.
2.3. The EEG Signal
In this paper, the EEG signal is viewed as an AR model driven by white noise , defined as where .
2.4. Estimation of Temporal Lag
In ARX, most researchers assume that temporal lag between the input and output of the model is equal to zero before estimating the model orders and . This assumption is not in accordance with practice. In this study, we used sparse coding to roughly estimate the value of . Sparse coding has had significant success in signal denoising and separation. In addition, in our previous paper, EPs were proven to have strong sparsity over an appropriate dictionary . Assuming and are the dictionary and the sparse coefficients, respectively, can be expressed as . Thus, is The estimator for is calculated by solvingwhere is determined by the variance of the EEG. Equation (10) can be solved by using optimization methods, such as basis pursuit , orthonormal matching pursuit , and Lasso . Since the atoms of are constructed by left or right translation of the basic components of EPs, we use the location of nonzero values in to estimate the temporal lag .
2.5. Single-Trial Extraction
In order to simplify this model, we assume . This implies a partial loss of generality with respect to the AR model for the noise and the ARMA model for the signal, completely independent of each other. Nevertheless, the MISO-ARX model requires more complex algorithms to be characterized. In this paper, this MISO system is characterized with the global separable nonlinear multi-innovation recursive least-squares-identification method . Then, parameters and are estimated. The EP can be reconstructed as
3. Experimental Results
3.1. Simulation Experiment
A computer simulation was conducted to verify the performance of our MISO-ARX method for EP signal estimation. Three single-trial-estimation methods for EP signals, namely, ARX, REPE, and SP, were compared in the following simulations. In order to measure the performance of each of the methods, we measured the SNR of the estimated EPs and the accuracy of the latencies for different SNRs to evaluate the quality of these methods. All experiments were implemented in Matlab R2006b on a Pentium 2.7 GHz PC with 4 GB RAM.
The reference signals were simulated by the superimposition of three basic components, which can be represent by the Gaussian distribution function ; thusThe synthetic reference signals ( and ) are shown in Figure 2.
From Figure 2, it can be seen that all three components have changed and the latency of the third wave varies significantly. In this study, we used an EP with as the reference signal. The background EEG superimposed on the EP signal was simulated by an autoregressive process , as shown in the following equation:where is Gaussian white noise. During the process of estimation, the SNR of the observations may change over time due to the nonstationary characteristics of the EEG. Therefore, in this experiment, the performance of the four different methods was examined under various SNR conditions. The SNRs of the observations were changed from 0 dB to −10 dB, and was changed from −5 to 5. For each SNR value, 100 pairs of observations were generated. The average results for different SNR and values in 100 independent runs are shown in Figure 3.
It is clear that, with the decrease of the value of the SNR, estimation performance declines. However, in MISO-ARX, the changes in had hardly any impact on the estimation results. This illustrates that our method is apt for tracking latency variation of EPs. Since the SNR is defined by the complete signal and not by a specific feature of it, we measured the MISO-ARX method’s ability of tracking latency variations. We compared ARX and MISO-ARX in the case of three different SNR values (0 dB, −5 dB, and −10 dB) and four different latencies (4.17 ms (), 5.29 ms (), 6.26 ms (), and 7.24 ms ()). Results are shown in Figure 4. We can see from Figures 4(a) and 4(b) that, for high SNR values (0 dB and −5 dB), our method had strong tracking capability for all latencies. Figure 4(c) indicates a deterioration of latency tracking performance when the SNR decreased, but the MISO-ARX method’s accuracy rate still exceeded 70%. With ARX, even for high SNR values, for and the estimations were totally wrong, suggesting that tracking such variations is not possible.
3.2. Real Data
For further evaluation of the performance of our method, VEPs were collected from six eyes belonging to three human subjects during pattern reversal VEP experiments. This study was conducted with the approval of the local ethics committee, and all experiments with human participants were performed according to the National Institutes of Health Guidelines. VEP signals were recorded via a surface electrode placed on the occipital region of the scalp (Oz), using the right earlobe as a reference, with the forehead grounded. Subjects were required to gaze at a cross on the stimulus screen. The stimulus pattern was a conventional black-and-white checkerboard, which was reversed every half a second. Recordings were made using a digital EEG recording system (NuAmps EEG Amplifier, NeuroScan, USA) with a sampling rate of 1000 Hz and stored on a computer. Signals were bandpass filtered in the range of 0.05–450 Hz.
In the VEP signal, critical responses were located at approximately 100 ms after stimulation, where the positive peak (P100) occurred. With the stimulus being delivered at 0 ms, we processed each VEP trial from 0 ms to 200 ms. We used data from the first 50 pairs of trials to perform the experiment, from six eyes belonging to three subjects, as shown in Figure 5. As shown in the figure, it is clear that most estimated VEPs have a peak at around 100 ms.
For each eye, we used data from the first 50 pairs of trials to calculate the average of the estimated VEPs. The results are shown in Figure 6. The estimates using MISO-ARX are indicated by solid line, and the averages of the measurements are indicated by dashed-dotted line. Clearly, as shown in Figure 6, the average of the estimated results for each eye is very similar to the average of the measurements.
Then, we estimated the latency of the P100 for each trial, as shown in Figure 7. The estimates are indicated by dots, the averages of the estimates are indicated by solid line, and the P100 latencies of the average of the measurements are indicated by dashed-dotted line. We can see that the trial-to-trial variation in the latencies of P100 is large. However, the averages of the estimates are close to the results of the average of the measurements.
In this paper, we presented a novel single-trial EP extraction method based on MISO-ARX. This method considers the single-trial EP as a complex containing many components, and each component can be modeled by ARMA. In addition, in order to improve the accuracy of the model parameters estimation, we used sparse coding to roughly estimate temporal lag. Since each component is modeled individually, our method has greater tracking capabilities of specific components of the EP complex. We conducted a series of experiments on synthetic and real data, and the results were evaluated using waveform observations and several metrics. From point of view of the experimental results, our method achieved a better and more favorable estimation performance than other currently used state-of-the-art methods in single-trial EP estimations.
The authors declare that they have no financial and personal relationships with other people or organizations that can inappropriately influence their work; there are no professional or other personal interests of any nature or kind in any product, service, and/or company that could be construed as influencing the position presented in, or the review of, this manuscript. And the funding in “Acknowledgments” would not lead to any conflict of interests regarding the publication of this manuscript.
This work was supported by the Nature Science Foundation of China (Grant no. 61401181) and Nature Science Foundation of China (Grant no. 61403174).
L. Rossi, A. M. Bianchi, A. Merzagora, A. Gaggiani, S. Cerutti, and F. Bracchi, “Single trial somatosensory evoked potential extraction with ARX filtering for a combined spinal cord intraoperative neuromonitoring technique,” BioMedical Engineering Online, vol. 6, article no. 2, 2007.View at: Publisher Site | Google Scholar
O. Shental, “Sparse representation of white Gaussian noise with application to L0-norm decoding in noisy compressed sensing,” in Proceedings of the Qualcomm Technology Forum (QTECH '11), San Diego, Calif, USA, June 2011.View at: Google Scholar
Y. C. Pati, R. Rezaiifar, and P. S. Krishnaprasad, “Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition,” in Proceedings of the 27th Asilomar Conference on Signals, Systems and Computers, vol. 1, pp. 40–44, Pacific Grove, Calif, USA, November 1993.View at: Google Scholar