Wheelchair Control Based on Multimodal Brain-Computer Interfaces

Steady state visual evoked potential (SSVEP)-based brain-computer interface (BCI) has gained a lot of attention due to its robustness and high information transfer rate (ITR). However, transitioning well-controlled laboratory-oriented BCI demonstrations to real-world applications poses severe challenges for this exciting field. For instance, conducting BCI experiments usually requires skilled technicians to abrade the area of skin underneath each electrode and apply an electrolytic gel or paste to acquire high-quality SSVEPs from hair-covered areas. Our previous proof-of-concept study has proposed an alternative approach that employed electroencephalographic signals collected from easily accessible non-hair-bearing areas including neck, behind the ears, and face to realize an SSVEP-based BCI. The study results showed that, with proper electrode placements and advanced signal-processing algorithms, the SSVEPs measured from non-hair-bearing areas in off-line SSVEP experiments could achieve comparable SNR to that obtained from the hair-bearing occipital areas. This study extended the previous work to systematically investigate the costs and benefits of non-hair SSVEPs. Furthermore, this study developed and evaluated an online BCI system based solely on non-hair EEG signals. A 12-target identification task was employed to quantitatively assess the performance of the online SSVEP-based BCI system. All subjects successfully completed the tasks using non-hair SSVEPs with 84.08 ± 15.60% averaged accuracy and 30.21 ± 10.61 bits/min averaged ITR. The empirical results of this study demonstrated the practicality of implementing an SSVEP-based BCI based on signals from non-hair-bearing areas, significantly improving the feasibility and practicality of real-world BCIs.

The electroencephalogram (EEG) based Brain-Computer Interfaces (BCIs) has been considerably extended to the multidisciplinary and challenging nature of BCI study. The algorithms of Digital signal processing and pattern recognition certainly constitute necessary components of a BCI system which are applied to the EEG signals to decode mental states those are relevant for BCI operation. The basic BCI concepts such as: brain activity monitoring, BCI operation, and the relevant mental states for BCI are applied to WSN. The major types of relevant mental states for BCI, namely motor imagery (ERD/ERS), steady state visual evoked potentials (SSVEP) are also mapped to MANET’s behaviour. The multivariate nature of the EEG combined with the neuroscience familiarity on hemispheric brain specialization is favourably taken into account to derive optimal combinations of the individual signals composing the EEG. BCI provides a non-muscular channel for sending commands to the external world using the electroencephalographic activity or other electrophysiological process of the brain function. A necessary factor in the successful operation of BCI systems is the methods used to process the brain signals. The processed data has been applied on to nodes of MANET where each set of sensor nodes are used for particular application. Based on the output of BCI commands, the MANET is operated and controlled with using only activities of neurons of brain, hence this approach could be more helpful to physically differently abled people or medically injured people.

F190. Mindfulness based stress reduction’s influence on brain-computer interface control

This paper presents the major challenges and solutions for the Brain Computer Interfaces (BCIs), which are based on Steady State Visual Evoked Potentials (SSVEPs). A BCI utilizes the information transmitted by the brain; there are several methods available for analyzing these brain activities. One of the major challenges in BCI is to remove the noise successfully. Averaging along with Wavelets has been proposed in this paper for de-noising the brain activities. Moreover, three different approaches have been investigated to estimate the frequency spectrum of the brain signals. In addition to the well known Fourier Transform (FT) technique, for spectral estimation, there are many parametric and non parametric techniques for computing the frequency content of a signal. This paper presents a comparison between Fast Fourier Transform (FFT), MUltiple SIgnal Classification (MUSIC) and Linear Predictive Coding (LPC). The effectiveness of different techniques has been studied and the simulation results have shown that MUSIC outperforms the other approaches.

This paper presents an electroencephalogram (EEG) based brain computer interface (BCI) design as a control mechanism for the Open Vibe Space shooter game. BCI using Steady State Visual Evoked Potential (SSVEP) is designed. The SSVEP is generated in response to a flickering visual stimulus. The setup uses different flickering frequencies which are displayed on a Liquid Crystal Display (LCD) monitor to elicit SSVEP responses. The EEG signals are recorded over the visual cortex of the brain. These signals are pre-processed to remove undesired information. To extract features, the power information contained in the corresponding frequency bands are calculated. The feature set is fed as an input to the classifier to identify the target class. This study tried to compare the performance of different classification algorithms in terms of accuracy, information transfer rate and the response time. Based on the outcome, support vector machine classifier with radial basis function recorded the best average accuracy of 90%.

The performance of steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) has been drastically improved in the past few years. In conventional SSVEP-based BCIs, the speed of a selection is fixed towards high performance based on preliminary offline analysis. However, due to inter-trial variability, the optimal selection time to achieve sufficient accuracy is different for each trial. To optimize the performance of SSVEP-based BCIs, this study proposed a dynamic stopping method that can adaptively determine a selection time in each trial by applying a threshold to the probability of detecting a target. A 12-class SSVEP dataset recorded from 10 subjects was used to evaluate the performance of the proposed method. Compared to the conventional method with a fixed selection time towards the highest accuracy, the proposed method could significantly reduce the averaged selection time (0.84±0.39 s vs. 1.44±0.63 s, p<;0.05) with comparable accuracy (99.44±1.57 % vs. 99.55±1.22 %). As a result, the simulated online information transfer rate (ITR) with the dynamic stopping method achieved a significant improvement compared to the conventional method (125.30±21.55 bits/min vs. 92.75±23.77 bits/min). These results suggest that the proposed dynamic stopping method is effective for improving the performance of SSVEP-based BCI systems.

Objective. Steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) can provide relatively easy, reliable and high speed communication. However, the performance is still not satisfactory, especially in some users who are not able to generate strong enough SSVEP signals. This work aims to strengthen a user’s SSVEP by alpha down-regulating neurofeedback training (NFT) and consequently improve the performance of the user in using SSVEP-based BCIs. Approach. An experiment with two steps was designed and conducted. The first step was to investigate the relationship between the resting alpha activity and the SSVEP-based BCI performance, in order to determine the training parameter for the NFT. Then in the second step, half of the subjects with ‘low’ performance (i.e. BCI classification accuracy <80%) were randomly assigned to a NFT group to perform a real-time NFT, and the rest half to a non-NFT control group for comparison. Main results. The first step revealed a significant negative correlation between the BCI performance and the individual alpha band (IAB) amplitudes in the eyes-open resting condition in a total of 33 subjects. In the second step, it was found that during the IAB down-regulating NFT, on average the subjects were able to successfully decrease their IAB amplitude over training sessions. More importantly, the NFT group showed an average increase of 16.5% in the SSVEP signal SNR (signal-to-noise ratio) and an average increase of 20.3% in the BCI classification accuracy, which was significant compared to the non-NFT control group. Significance. These findings indicate that the alpha down-regulating NFT can be used to improve the SSVEP signal quality and the subjects’ performance in using SSVEP-based BCIs. It could be helpful to the SSVEP related studies and would contribute to more effective SSVEP-based BCI applications.

A steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) system relies on the photic driving response to effectively elicit characteristic electroencephalogram (EEG) signals. However, traditional visual stimuli mainly adopt high-contrast black-and-white flickering stimulations, which are easy to cause visual fatigue. This paper presents an SSVEP dataset acquired at a wide frequency range from 1 to 60 Hz with an interval of 1 Hz using flickering stimuli under two different modulation depths. This dataset contains 64-channel EEG data from 30 healthy subjects when they fixated on a single flickering stimulus. The stimulus was rendered on an LCD display with a refresh rate of 240 Hz. Initially, the dataset was rigorously validated through comprehensive data analysis to investigate SSVEP responses and user experiences. Subsequently, BCI performance was evaluated through offline simulations of frequency-coded and phase-coded BCI paradigms. This dataset provides comprehensive and high-quality data for studying and developing SSVEP-based BCI systems.

Objective.With the recent development of visual evoked potential (VEP) based brain-computer interfaces (BCIs), the stimulus paradigm has been continuously innovated, in which the pursuit of higher BCI performance and better user experience has become indispensable.Approach.To optimize the stimulus paradigm, a 12-target online BCI system was designed in this study by adopting flicker for steady-state VEPs, Newton's ring for steady-state motion VEP, and frame rate based video stimulus, respectively. The signal characteristics of VEP, classification accuracy, and user experience of the three stimulus paradigms were quantitatively evaluated and compared.Main results.The online information transfer rates for the three stimulus paradigms were 53.77 bits min-1, 51.41 ± 3.55 bits min-1, and 52.07 ± 3.09 bits min-1, respectively. The video stimulus had a significantly better user experience, while the flicker stimulus showed the worst.Significance.These results demonstrate the advantage of the proposed video stimulus paradigm and have significant theoretical and applied implications for developing VEP-based BCI systems.

Steady-state visual evoked potential (SSVEP)-based brain– computer interfaces (BCIs) have been widely studied. Considerable progress has been made in the aspects of stimulus coding, electroencephalogram processing, and recognition algorithms to enhance system performance. The properties of SSVEP have been demonstrated to be highly sensitive to stimulus luminance. However, thus far, there have been very few reports on the impact of background luminance on the system performance of SSVEP-based BCIs. This study investigated the impact of stimulus background luminance on SSVEPs. Specifically, this study compared two types of background luminance, i.e., (1) black luminance [red, green, blue (rgb): (0, 0, 0)] and (2) gray luminance [rgb: (128, 128, 128)], and determined their effect on the classification performance of SSVEPs at the stimulus frequencies of 9, 11, 13, and 15 Hz. The offline results from nine healthy subjects showed that compared with the gray background luminance, the black background luminance induced larger SSVEP amplitude and larger signal-to-noise ratio, resulting in a better classification accuracy. These results suggest that the background luminance of visual stimulus has a considerable effect on the SSVEP and therefore has a potential to improve the BCI performance.

Online coadaptive training has been successfully employed to enable people to control motor imagery (MI)-based brain-computer interfaces (BCIs), allowing to completely skip the lengthy and demotivating open-loop calibration stage traditionally applied before closed-loop control. However, practical reasons may often dictate to eventually switch off decoder adaptation and proceed with BCI control under a fixed BCI model, a situation that remains rather unexplored. This work studies the existence and magnitude of potential post-adaptation effects on system performance, subject learning and brain signal modulation stability in a state-of-the-art, coadaptive training regime inspired by a game-like design. The results extracted in a cohort of 20 able-bodied individuals reveal that ceasing classifier adaptation after three runs (approx. 30 min) of a single-session training protocol had no significant impact on any of the examined BCI control and learning aspects in the remaining two runs (about 20 min) with a fixed classifier. Fifteen individuals achieved accuracies that are better than chance level and allowed them to successfully execute the given task. These findings alleviate a major concern regarding the applicability of coadaptive MI BCI training, thus helping to further establish this training approach and allow full exploitation of its benefits.

In this paper, to develop a hybrid brain-computer interface based on Steady State Visual Evoked Potential(SSVEP) and P300, we validate a SSVEP brain-computer interface (BCI) with the hybrid stimuli of SSVEP and P300, and analyze the effect of P300 visual stimuli on the classification accuracy of the SSVEP BCI. The hybrid stimuli include the SSVEP stimuli, which consist of twochessboardimagespresented on a LCD screen and flashing at particular frequencies, respectively, and the P300 stimuli, which include nine characters and locate between the SSVEP stimuli. We extract the fundamental frequencies and second harmonics of the frequencies of the SSVEP stimulifrom EEG data as features, andapply a Fisher's linear discriminant analysis to build the classifier. The experimental results from three subjects show that the SSVEP potentials can be elicited well under the hybrid stimuli of SSVEP and P300, and the P300 stimuli under the hybrid condition have no significant effect on the SSVEP BCI. This work laysa foundationfor developing a hybrid BCIbased on SSVEP and P300.

This work presents the development of a Brain Computer Interface (BCI) based on Steady State Visual Evoked Potentials (SSVEP), that enables a user to control a remote control car. The visual stimulus conditions of area, frequency, and shape were evaluated with the purpose of obtaining the SSVEP signal with the highest amplitude in order to obtain the best performance of the developed BCI. A remote control car was built and was controlled by a healthy subject using the developed SSVEP BCI, proving its proper functionality. This BCI has the purpose of helping people with motor disabilities; one of its possible applications could be the control of wheelchairs.

Motor Imagery (MI)-based Brain Computer Interface (BCI) system is a potential technology for active neurorehabilitation of stroke patients by complementing the conventional passive rehabilitation methods. Research to date mainly focused on classifying left vs. right hand/foot MI of stroke patients. Though a very few studies have reported decoding imagined hand movement directions using electroencephalogram (EEG)-based BCI, the experiments were conducted on healthy subjects. Our work analyzes MI-based brain cortical activity from EEG signals and decodes the imagined hand movement directions in stroke patients. The decoded direction (left vs. right) of hand movement imagination is used to provide control commands to a motorized arm support on which patient's affected (paralyzed) arm is placed. This enables the patient to move his/her stroke-affected hand towards the intended (imagined) direction that aids neuroplasticity in the brain. The synchronization measure called Phase Locking Value (PLV), extracted from EEG, is the neuronal signature used to decode the directional movement of the MI task. Event-related desynchronization/synchronization (ERD/ERS) analysis on Mu and Beta frequency bands of EEG is done to select the time bin corresponding to the MI task. The dissimilarities between the two directions of MI tasks are identified by selecting the most significant channel pairs that provided maximum difference in PLV features. The training protocol has an initial calibration session followed by a feedback session with 50 trials of MI task in each session. The feedback session extracts PLV features corresponding to most significant channel pairs which are identified in the calibration session and is used to predict the direction of MI task in left/right direction. An average MI direction classification accuracy of 74.44% is obtained in performing the training protocol and 68.63% from the prediction protocol during feedback session on 16 stroke patients.

Currently, the operational electroencephalography (EEG)-based brain–computer interfaces (BCIs) suffer from problems of BCI latency/lag issues, which restricts the use of interfaces impractical scenarios. One of the reasons behind the present challenges is the application of a purely data-driven approach to the BCI pipeline. Although BCI applications have improved significantly with the research in the fields of artificial intelligence (AI) and machine learning (ML), fundamental issues of data-driven training restrict the latency that can be achieved under current BCI paradigms. This work explores the possibility of future BCI using a combination of data-driven and theory-driven methods. In this study, an EEG-BCI dataset from steady-state visually evoked potentials (SSVEPs) is applied, where the SSVEP signals contain, source components from the occipital, parietal and frontal regions of the brain. Source reconstruction is done with the combination of independent component analysis (ICA) and low-resolution electromagnetic tomography analysis (LORETA). This method was able to predict BCI classification labels 5[Formula: see text]s earlier, based on pre-recorded signals from the scalp. The novelty of the current contribution lies in utilizing the source reconstructed EEG time-series for BCI classification, which allows for retention of classification accuracy up to 70% while working with the reduced data dimensionality. Implementation of this algorithm will allow a significant reduction in lag in online BCIs.