Enhancing P300 Wave of BCI Systems Via Negentropy in Adaptive Wavelet Denoising.

Brian Computer Interface (BCI) is a direct communication pathway between the brain and an external device. BCIs are often aimed at assisting, augmenting or repairing human cognitive or sensory-motor functions. EEG separation into target and non-target ones based on presence of P300 signal is of difficult task mainly due to their natural low signal to noise ratio. In this paper a new algorithm is introduced to enhance EEG signals and improve their SNR. Our denoising method is based on multi-resolution analysis via Independent Component Analysis (ICA) Fundamentals. We have suggested combination of negentropy as a feature of signal and subband information from wavelet transform. The proposed method is finally tested with dataset from BCI Competition 2003 and gives results that compare favorably.

Introduction

The Brian Computer interface (BCI) system is set of signal processing components and sensors that allows acquiring and analyzing brain activities with the goal of establishing a communication channel directly between the brain and an external device such as a computer, neuroprosthesis, and etc , by analyzing electroencephalographic activities that reflect the functions of the brain[1619].

There are many BCI systems based on EEG rhythms, as Alpha, Beta, Mu, Slow Cortical Potentials (SCPs), Event Related Synchronization/ Desynchronization (ERS/ERD) phenomena, Steady-State Visual Evoked Potential (SSVEPs), P300 component of the Evoked-Related potentials (ERP's) and so on[22].

P300 Based BCI was first introduced by Farwell and Donchin in 1988 for controlling an external device[581112].

The P300 (P3) wave is an event related potential elicited by task-relevant, infrequent stimuli. This wave is considered to be an endogenous potential as its occurrence links to a person's reaction to the stimulus, not to the physical attributes of a stimulus. This is a positive ERP, which its occurrence is over the parietal cortex with a latency of about 300 ms after rare or task relevant stimuli. Mainly, the P300 is thought to reflect tasks involved in stimulus evaluation or categorization[6].

Within BCI, P300 potentials can provide a means of detecting a person's intention concerning on the choice of object.

Detecting the p300 peaks in the EEG accurately and accurately, is the main goal In a P300 speller, therefore variety of feature extraction and classification procedures have been implemented, improving the performance. a good preprocessing step could enhance the SNR and help to have simple, more accurate algorithm for feature extraction and classification. More reliable and ever fast signal processing methods for preprocessing the recorded data are crucial in the improvement of practical BCI systems.

Single-trial ERP detection is understood to be challenging, as P300 waves and other task related signal components have a large amount of noise (artifacts-ongoing task and unrelated neural activities)[624]. A preprocessing step for P300 detection is applied to enhance the Signal to Noise Ratio (SNR) and to remove both interfering physiological signals as those related to ocular, muscular and cardiac activities , and non-physiological artifacts, such as electrode movements, broken wire contacts and power line noise. To detect the specific patterns the feature extraction step is conducted in brain activity that encode the patient's motor intentions or reflect the user commands. Translating feature into control signals is aimed at last step to sent to an external device[1016].

Several methods, based on Independent Component Analysis (ICA), Fourier Transform and Wavelet Transform (WT) were thus proposed to enhance the SNR and to remove the artifacts from EEG signals[1324].

The major drawback of ICA-based method is that they are supervised and they are not specifically designed to separate brain waves. For instance ICA is a popular method to EEG denoising but after the decomposition in independent components (IC) it is necessary to select (by spatio-temporal prior or manually) the ICs which contained the evoked potentials.

Wavelet denoising techniques have been adopted for signal enhancement applications. EEG signal is first mapped to discrete wavelet domain by means of multiresolution analysis. Details coefficients related to additive noise could be eliminated using a contrast or adaptive threshold level. Finally signal is reconstructed back to time domain using remaining wavelet coefficients.

Donoho[7] suggested a denoising technique in the wavelet domain in order to enhance the domain. It is by thresholding the wavelet coefficients in the orthogonal wavelet domain. Two thresholding algorithms were proposed, namely the soft thresholding and hard thresholding.

So to denoising the signal, choosing a good threshold and algorithm would help having more clear signals.

In this paper, we propose a new unsupervised algorithm to automatically estimate noise subspace from raw EEG signal. The aim is to provide a new method to increasing the spelling debit.

In particular our algorithms is a adaptive wavelet denoising which is one of the best method for signal denoising. The threshold on each WT levels are different and dependence of negentropy. Negentropy is the mainly parameter that ICA work based on. Negentropy of each level in WT is calculated and the lowest level negentropy introduced for certifiable parameter. Other levels negentropy compare with this one and independency of such levels and the main (the lowest level) acquired. This independency, determine the threshold. More independency describe more different signals that noise (of any source except) have been added to it. So the threshold must be increased to eliminate the noise.

This paper organized as follows: Section 2 describe the P300 subspace and the BCI Enhancement. Section 3 describe Independent Component Analysis and Wavelet Transform whereas Section 4 present our proposed algorithm. In the last parts, Section 5 and 6 have simulated result and conclusion.

Methodology

On the P300 based BCI, the user was presented with a screen that is a 6*6 character matrix with 36 symbols. The user then, one by one, focuses a on letters of an expected word. The columns and rows of the matrix are randomly flashed. For concerning the letter of the word there are 12 illuminations (6 columns and 6 rows) which provide the visual stimulus. Two flashes (one column and one row) out of the twelve intensifications decide a character which the user wants to say. It is expected that the evoked waveforms are different from others[1016]. Each row and column in the matrix was randomly illuminated for 100ms. After illumination of a row/column, for 75ms the matrix was blank. For each character sets of 12 illuminations were repeated 15 times. So there were 180 illuminations for each character. After all illuminations the matrix is blank for 2.5s[10].

To improve and validate signal processing and classification methods for BCIs, some BCI groups organized an online BCI data bank, known as the BCI competition datasets. These datasets consist of continuous single-trials of EEG activity, one part is training data and another part is test data which is unlabeled. Initially the labels for test data were not available for the purpose of the competition. The labels for testing sets are released and the data sets became available for developing new methods towards improving BCI studies. This paper uses EEG signals of the BCI competitions 2003 dataset-IIb which are recorded from a P300/ERP based BCI word speller[16].

Reducing noise of signals will help P300 detection. We proposed method to enhance EEG with adaptive WT via ICA concepts. It is demonstrated that channel Cz has mainly data and more accurate to detect P300, so most of the studies rely on this record[6].

Independent Component Analysis

To alleviate the influence of noise, in this research, an independent component analysis ICA-based denoising scheme is proposed and integrated with adaptive wavelet denoising .

The methodology of Independent Component Analysis (ICA) was first introduced in the context of neural networks[3]. Delorme et al[1] utilized ICA as an important algorithm for EEG analysis. The goal of ICA is to separate instantaneously mixed signals into their independent sources without knowledge of mixing process. One practical application of ICA decomposition is the Evoked Related Potential and electroencephalogram analysis. The recorded signal can be considered as different sources in the brain and various artifacts that generate electrical signals. ICA is presented of interesting sources[25] or automated classification of epileptiform activity[20] and artifact removal[21].

Hidden information is called the independent components (ICs) of the data. The noise information usually cannot be directly obtained from the observed data. Thus, ICA can be used to detect and remove the noise via the identification of the ICs of the time series data, and improve the performance of the specific patterns in brain activity.

Let X = [x1,x2,x3,...,x] be a multivariate data matrix of size m*n, m≤n consisting of observed mixture signals x (size 1*n , i=1,2,.., n).

In the ICA model, the matrix X can be introduced as[2021]:

Where s is the i-th row of the m*n source matrix S and a is the i-th column of the m*m unknown mixing matrix. Vectors s are the latent source signals that cannot be observed from the mixture signals x. The ICA algorithm aims at finding an m*m de-mixing matrix W such as:

Y = [y] = wx      (2)

Where y is the i-th row of the matrix Y (i=1,2, … m) . The vectors y must be as statistically independent as possible, and are called as independent components. When de-mixing matrix W completely is the inverse of mixing matrix A, ICs (y) can be used to estimate the latent source signal s.

The ICA algorithm is formulated as an optimization problem by setting up the measure statistical independence of ICs as an objective function. To do this, using some optimization techniques for solving the de-mixing matrix W is suggested. In general, the ICs are obtained by using the de-mixing matrix W to multiply the original matrix. This matrix can be determined by using an algorithm which maximized the statistical independence of ICs. The statistical independence obtained by ICs with non-gaussian distribution[20]. The negentropy can measure the non-Gaussianity of the ICs such as :

J(y) = H(ygauss) – H(y)      (3)

Where y is a Gaussian random vector having the same covariance matrix like y. H is the entropy of random vector y defined by H with density p(y):

H(y) = –∫ p(y) log p(y)dy      (4)

The negentropy is zero if and only if the vector has a Gaussian distribution and it is always non-negative parameter.Since the problem in using negentropy is computationally very difficult, an approximation of this parameter is proposed as follows[1624]:

J(y) ≈ [E{G(y)} – E{G(v)}]2      (5)

Where E stand for entropy, v is a Gaussian variable of zero mean and unit variance, and y is a random variable with same mean and variance. G is a nonquadratic function, and is given by G(y)=exp(–y2/2) in this study[22].

We can find the de-mixing matrix with optimization. This maximization in described method, FASTICA, is achieved using an approximate Newton iteration. After every iteration, to prevent all vectors from converging to the same maximum, (that would yield several times the same source), the p-th output has to be decorrelated from the previously estimated sources. A deflation scheme based on a Gram-Schmidt orthogonalization is a simple way to do this[6924].

Wavelet Transform

It has been shown that EEG is a classical non stationary signal. Short time fourier transform (STFT), which was a time-frequency analysis method, was applied to analyze brain signals but it has been noted that the transform depends critically on the window. Wavelet Transform (WT), that is a multi-resolution analysis method , brings solution to this task and give a more accurate temporal localization[14]. In the research of brain signal enhancement, a more accurate local band denoising required Wavelet Transform could help to eliminate noise, which we interested in, That can generate spectral resolution[1415].

In particular the Wavelet Transform forms a signal representation which is local in time and frequency domains. The WT relies on smoothing the time domain signal at various scales thus if ψ(x) represents as wavelet at scale s, the WT of such a function like f(x)∈L2(R) is defined as a convolution[17]:

Wf(s,x) = f*ψ(x)      (6)

The scaled wavelet are constructed from a ‘Mother’ wavelet, ψ(x):

ψ(x)= (1/s)ψ(x/s)     (7)

With a Gaussian function, G(x), the ‘Mother’ wavelet will be defined as[11]:

From knowledge of the modulus maxima of WT, the signal f(x) may be reconstructed to a good approximation. These maxima propose a compact representation idea for noise removal.

The existing research uses a lipschits exponent method based on least square. Lipschitz exponent-α (L.E.α) is a criteria to quantize locally regulation of function in mathematics[726]. L.E. αat one point can reflect the signal singularity in that area of function. This means that its smoothness increases and signal singularity diminish with α.

Order 0 ≤α < 1, and assuming that a constant (C) exists that makes:

The lipschitz exponent at x0 point is called α. If the function is nth differentiable, but nth derivative of f(x) is uncontinuously, the lipschitz exponent of ∫ f (x) dx is up to α+1 when n ≤ α < n+1 (n being the nearest integer to α)[1516].

So it is possible to characterize isolated singularities when they occur in a smooth signal. Furthermore for such point like x in the neighbor of x0, where f(x) is α-Lipschitz at x0, the modulus maxima of the WT evolve with scale s, according to:

|Wf(s,x)|≤ Asα      (10)

Where A is a constant[16].

To determine α, WT of one typical EEG segment calculated and by formula (10) it's Lipschitz have to be zero (figures 1–3).

Fig 1

Wavelet transform of EEG

Fig 3

A+.5 line with m=.1.4566 and a=0.9566 so we have a=0 for determining the wavelet function.

xy plane to know point of Singularites.

Noise Removal

Adaptive Wavelet Denoising has many good results in biomedical signals, and ICA has many advantages in EEG denoising. Therefore it is possible to combine them to reach the better Signal to Noise Ratios (SNR). The SNR was defined as the ratio of standard deviations of the clean ERP signal and one of the surrogate EEGs. Note that for lower SNR, the ERP are hardly recognizable in the single-trial. ICA approach helps us to use adaptive thresholding via wavelet to choose thresholds of denoising (figure 4).

Fig 4

Adaptive Wavelet Thresholdings.

As shown in fig.4 adaptive wavelet denoising is a method to noise removal. Wavelet Transform computed. Then the level C−3, the lowest frequency is kept, which is more noiseless and similar to original signal. Other levels (d−) must denoised with sufficient thresholds (such as T). With adaptive wavelet thresholding user can denoised each level with interested threshold and function[7].

To have WT coefficients only for singularities and no other points, a proper wavelet need to detect singularities in a signal (sufficient number of moments must be zero). EEG signal has peaks at some points, like discontinuous regions so we choose α (lipschitz Regularity) to be zero.

Now the signal has to be input of WT. because SNR of EEG is low we propose to have 3 analysis levels by soft thresholding. Usually the levels of transform can be changed (most 3 to 5) but in more practical denoising, 3 levels work well. Our experiment certify this suggestion[715].

Soft thresholding is a useful tool to denoising signals with low SNRs, but hard thresholding could generate more noise. It can be simply defined by[7] (figure 5):

Fig 5

Function of δ (dJ, λ).

δ (d, λ) = (d – signλ) II(|d|> λ)

where II (.) is heavyside function.      (12)

d 's are the elements in each level of WT and λ is the threshold for denoising each element.

We change above function fewness, to have a better signal power.

where ∏(.) is heavyside function, k = 2.

By WT we have subspaces of Cz channel complex with noise. ICA separate ICs by maximizing negentropy of sources. We want to use this idea to finds proper threshold in each branch.

EEG Signal Via Cz Channel in ERP

Applying some preprocessing steps before using an ICA algorithm is very useful to separate ICs. Therefore we discuss some techniques that make the ICA estimation so simpler and in better condition.

The most basic preprocessing step is to center x, i.e. to make x a zero-mean variable, subtract its mean vector m = E{x}. This process does not mean that the mean couldn’t be estimated.

We can complete the estimation of mixing matrix A with centered data, by adding the mean vector of s, back to the centered estimates of it. A−1m gives the mean vector of s (in the preprocessing m was subtracted as the mean)[13].

Whitening the observed variables is another useful preprocessing strategy in ICA. This means that after centering and before the application of the ICA algorithm, we linearly transform the observed vector X to obtain a new white vector X, i.e. its components are uncorrelated and their variances equal one. In other words, the covariance matrix of X is the identity matrix:

E{XXT}= I      (14)

Using the eigen-value decomposition (EVD) of the covariance matrix E{xx}= EDE is one of the popular method for whitening , where E is the orthogonal matrix of eigenvectors of E{xx} and D is the diagonal matrix of its eigenvalues, D= diag(d1, …,dn)[1322]. Note that E{xx} can be estimated from the available sample x(1), ..,x(T). we can see that whitening can now be done by:

Where the matrix D−½ is computed by a simple component-wise operation as D−½ = diag(d1−½,…,d−½. The mixing matrix transforms into a new one, Ã, where it is orthogonal[1322]:

Centering and whitening prepare subspace signals to denoising. In universal denoising, the parameter has to be introduced by[715]:

Where in this function, δ stand for variance of noise, d−1 's are the first subspace elements (1≤K≤N), N imply length of trail and λ is the threshold. In universal thresholding, the same threshold (above formula), used for all subbands.

But we compute negentropy for each branch. One of the subbands that has lower frequency is like to signal so its negentropy is important. Other subspace negentropies have compared to this one and their differences change the threshold of denoising. To adaptive wavelet thresholding, SURE has introduced to fine the best threshold in each band. In this approach threshold from zero to universal value changed and SURE like follow formula computed then threshold that associated minimum SURE determined and used for that band. We have improved SURE by negentropy feature. So the SURE can change like this:

If signals to noise ratio is less so we can increase the Wavelet Transform and denoising each level accurately. But in practice the WT levels for denoising are 3 to 5[715]. In this application we found that 3 levels could be sufficient. So Negentropy of 3 levels wavelet decomposition from EEG were computed then each one has denoised by adaptive soft thresholding obtaind by their negentropy. These subspaces, reconstructed in time/domain transform. This approach suggests very good denoising method and SNR results.

Simulation and Results

EEG signals in each iteration were averaged and 12 averaged parts let to determine ERP Eliminating artifacts caused to develope clear EEG signals. This algorithm applied on BCI Competition 2003 database (IIb) and interesting results appears. In the EEG data with average SNR of 4.4667 dB we have test ICA, Wavelet Thresholding (Soft Thresholding with Universal criteria) and Adaptive Wavelet Thresholding via ICA concepts algorithm to compare them for enhancement ERP detection. Sequentially averaged SNR=4.5933 dB, SNR=4.6700 dB and SNR=4.7442 dB obtained. therefore the proposed method could be more accurate to EEG enhancement. Some simulation results can be seen as follows.

Noisy EEG of Cz Channel(Top) and it's 12 segments (Down).

Denoised EEG of Cz Channel by ICA(Top) and it's 12 segments (Down).

Denoised EEG of Cz Channel by Adaptive Wavelet Thesholdings (Top) and it's 12 segments(Down).

Denoised EEG of Cz Channel by Proposed Algorithm(Top) and it's 12 segments (Down).

Conclusion

This paper has introduced a new algorithm to enhance ERP signals. SNR of EEG is very low. We aim to eliminate artifacts. We proposed a method based on adaptive wavelet thresholding via ICA concepts. Negentropy is a most important feature to diagnose noises. This method was compared with two usual algorithms such as ICA and WT. Algorithms was tested on signals from dataset BCI competition 2003. The proposed method could be more accurate to EEG enhancement.

Denoising Algorithm of EEG signals via Adaptive Wavelet Thresholding by ICA Concepts

Table 1

Comparing different methods on achieved Signals to Noise ratios of some signals