A Modified Hybrid Brain-Computer Interface Speller Based on Steady-State Visual Evoked Potentials and Electromyogram.

Brain–computer interface (BCI) systems rely on the direct measurement of brain signals, such as event-related desynchronization (ERD), steady state visual evoked potentials (SSVEPs), P300s, or slow cortical potentials. Unfortunately, none of these BCI approaches work for all users. This study compares two conventional BCI approaches (ERD and SSVEP) within subjects, and also evaluates a novel hybrid BCI based on a combination of these signals. We recorded EEG data from 12 subjects across three conditions. In the first condition, subjects imagined moving both hands or both feet (ERD). In the second condition, subjects focused on one of the two oscillating visual stimuli (SSVEP). In the third condition, subjects simultaneously performed both tasks. We used logarithmic band power features at sites and frequencies consistent with ERD and SSVEP activity, and subjects received real-time feedback based on their performance. Subjects also completed brief questionnaires. All subjects could simultaneously perform the movement and visual task in the hybrid condition even though most subjects had little or no training. All subjects showed both SSVEP and ERD activity during the hybrid task, consistent with the activity in both single tasks. Subjects generally considered the hybrid condition moderately more difficult, but all of them were able to complete the hybrid task. Results support the hypothesis that subjects who do not have strong ERD activity might be more effective with an SSVEP BCI, and suggest that SSVEP BCIs work for more subjects. A simultaneous hybrid BCI is feasible, although the current hybrid approach, which involves combining ERD and SSVEP in a two-choice task to improve accuracy, is not significantly better than a comparable SSVEP BCI. Switching to an SSVEP BCI could increase reliability in subjects who have trouble producing the EEG activity necessary to use an ERD BCI. Subjects who are proficient in both BCI approaches might be able to combine these approaches in different ways and for different goals.

Objective. Brain–computer interface (BCI) technologies have been intensely studied to provide alternative communication tools entirely independent of neuromuscular activities. Current BCI technologies use electroencephalogram (EEG) acquisition methods that require unpleasant gel injections, impractical preparations and clean-up procedures. The next generation of BCI technologies requires practical, user-friendly, nonintrusive EEG platforms in order to facilitate the application of laboratory work in real-world settings. Approach. A capacitive electrode that does not require an electrolytic gel or direct electrode–scalp contact is a potential alternative to the conventional wet electrode in future BCI systems. We have proposed a new capacitive EEG electrode that contains a conductive polymer-sensing surface, which enhances electrode performance. This paper presents results from five subjects who exhibited visual or auditory steady-state responses according to BCI using these new capacitive electrodes. The steady-state visual evoked potential (SSVEP) spelling system and the auditory steady-state response (ASSR) binary decision system were employed. Main results. Offline tests demonstrated BCI performance high enough to be used in a BCI system (accuracy: 95.2%, ITR: 19.91 bpm for SSVEP BCI (6 s), accuracy: 82.6%, ITR: 1.48 bpm for ASSR BCI (14 s)) with the analysis time being slightly longer than that when wet electrodes were employed with the same BCI system (accuracy: 91.2%, ITR: 25.79 bpm for SSVEP BCI (4 s), accuracy: 81.3%, ITR: 1.57 bpm for ASSR BCI (12 s)). Subjects performed online BCI under the SSVEP paradigm in copy spelling mode and under the ASSR paradigm in selective attention mode with a mean information transfer rate (ITR) of 17.78 ± 2.08 and 0.7 ± 0.24 bpm, respectively. Significance. The results of these experiments demonstrate the feasibility of using our capacitive EEG electrode in BCI systems. This capacitive electrode may become a flexible and non-intrusive tool fit for various applications in the next generation of BCI technologies.

In this paper, to develop a hybrid brain-computer interface based on Steady State Visual Evoked Potential(SSVEP) and P300, we validate a SSVEP brain-computer interface (BCI) with the hybrid stimuli of SSVEP and P300, and analyze the effect of P300 visual stimuli on the classification accuracy of the SSVEP BCI. The hybrid stimuli include the SSVEP stimuli, which consist of twochessboardimagespresented on a LCD screen and flashing at particular frequencies, respectively, and the P300 stimuli, which include nine characters and locate between the SSVEP stimuli. We extract the fundamental frequencies and second harmonics of the frequencies of the SSVEP stimulifrom EEG data as features, andapply a Fisher's linear discriminant analysis to build the classifier. The experimental results from three subjects show that the SSVEP potentials can be elicited well under the hybrid stimuli of SSVEP and P300, and the P300 stimuli under the hybrid condition have no significant effect on the SSVEP BCI. This work laysa foundationfor developing a hybrid BCIbased on SSVEP and P300.

Brain machine interfaces (BMIs) provide one of the important means to interact with external world for a patient who lost motor function by using brain electrical signals such as scalp electroencephalogram (EEG). The main function of BMIs is to detect, analyze and classify the modulation of EEG according to a user's intent and to decode it to demonstrate to others. Most of conventional BMIs with relatively high speed and high classification accuracy have a requisite that a user can open and move his/her eyes toward a target corresponding to user's intent and gaze at it. Locked-in patients, who have lost almost all motor function including facial muscle, cannot control the eye-movement as well as gaze. The present study aimed at developing a BMI which was independent of the eye-movement and eye-gaze as a final goal. In this paper, we discuss the feasibility of binary class of BMI available with eyes-closed condition using a recent our newly observation that the steady-state visual evoked potential (SSVEP) could be modulated by performing the mental tasks even in the eyes-close state. Temporal evolution of the modulation of SSVEP was investigated using the amplitude of SSVEP and Kullback-Leibler (KL) divergence. The amplitudes of fundamental SSVEP (10 Hz) averaged across 11 participants showed significant difference between the mental focusing task and relaxed runs from the onset of the flicker stimuli with the frequency of 10 Hz and the intensity of 5 lx, whereas those of the second harmonic SSVEP (20 Hz) gave only small difference without statistical significance. For the image recalling task, the amplitude differences between the fundamental SSVEPs in the task and relaxed conditions did not show significant difference, whereas the amplitude differences of the second harmonic SSVEP showed the main effect of the image recall task. The KL divergences for the fundamental SSVEP amplitude showed large differences at the onset of flicker stimuli and gradual decrease with time at P4 and O2 for the mental focus task, yet no such characteristic evolution was not seen in KL divergence for the second harmonic SSVEP. On the other hand, the KL divergences during the image recalling were increased with time for both the fundamental and second harmonic SSVEPs at most of the electrode sites. The classification accuracies of the proposed BMI exceeded 75 % in average across the subjects for both tasks using Fisher's linear discriminant analysis.

The steady-state visual evoked potential (SSVEP) has been widely applied in brain-computer interfaces (BCIs), such as letter or icon selection and device control. Most of these BCIs used different flickering frequencies to evoke SSVEP with different frequency components that were used as control commands. In this paper, a novel method combining the time phase and EEG frequency components is presented and validated with nine healthy subjects. In this method, four different frequency components of EEG were classified out from four time phases. When the SSVEP is evoked and what is the frequency of the SSVEP is determined by the linear discriminant analysis (LDA) classifier in the same time to locate the target image. The results from offline analysis show that this method yields good performance both in classification accuracy and information transfer rate (ITR).KeywordsBrain-computer interfaces (BCIs)Electroencephalogram (EEG)Steady-state visual evoked potential (SSVEP)Time phase

Brain-computer interface (BCI) for robotic arm control has been studied to improve the life quality of people with severe motor disabilities. There are still challenges for robotic arm control in accomplishing a complex task with a series of actions. An efficient switch and a timely cancel command are helpful in the application of robotic arm. Based on the above, we proposed an asynchronous hybrid BCI in this study. The basic control of a robotic arm with six degrees of freedom was a steady-state visual evoked potential (SSVEP) based BCI with fifteen target classes. We designed an EOG-based switch which used a triple blink to either activate or deactivate the flash of SSVEP-based BCI. Stopping flash in the idle state can help to reduce visual fatigue and false activation rate (FAR). Additionally, users were allowed to cancel the current command simply by a wink in the feedback phase to avoid executing the incorrect command. Fifteen subjects participated and completed the experiments. The cue-based experiment obtained an average accuracy of 92.09%, and the information transfer rates (ITR) resulted in 35.98 bits/min. The mean FAR of the switch was 0.01/min. Furthermore, all subjects succeeded in asynchronously operating the robotic arm to grasp, lift, and move a target object from the initial position to a specific location. The results indicated the feasibility of the combination of EOG and SSVEP signals and the flexibility of EOG signal in BCI to complete a complicated task of robotic arm control.

Brain-computer interface (BCI) systems translate the human neurophysiological activities into commands through EEG analysis. Improving the BCI performances leads to faster and easier use and less fatigue. In this study, we proposed a new prepossessing approach to increase the robustness of a steady-state visual evoked potential (SSVEP) based BCI. Inspiring from the known properties of the SSVEP frequency components, the goal was to enhance the signal quality by making it more convenient to be interpreted by the decision-making step. We first investigated the potential to detect the deteriorating periods based on the physiological properties of the SSVEP. The proposed system localizes the intervals which can obscure the SSVEP frequencies by a new algorithm founded on the processing and the analysis of the instantaneous phase. The piecewise linear regression allows a sampler comprehension of the phase signal. Then, these intervals are filtered by the moving average filter to enhance the SSVEP quality. Finally, the decision making is made by the canonical correlation analysis (CCA) algorithm. The results of experiments, using real EEG signals from five subjects, show that the proposed approach significantly increases the performances in terms of accuracy and information transfer rate by about 7.3% and 3.85 bits/min, respectively, in case of 2 s segment length. On the other hand, the spatial filtering methods of the literature weaken the system performances.

Steady state visual evoked potential (SSVEP)-based brain-computer interface (BCI) has gained a lot of attention due to its robustness and high information transfer rate (ITR). However, transitioning well-controlled laboratory-oriented BCI demonstrations to real-world applications poses severe challenges for this exciting field. For instance, conducting BCI experiments usually requires skilled technicians to abrade the area of skin underneath each electrode and apply an electrolytic gel or paste to acquire high-quality SSVEPs from hair-covered areas. Our previous proof-of-concept study has proposed an alternative approach that employed electroencephalographic signals collected from easily accessible non-hair-bearing areas including neck, behind the ears, and face to realize an SSVEP-based BCI. The study results showed that, with proper electrode placements and advanced signal-processing algorithms, the SSVEPs measured from non-hair-bearing areas in off-line SSVEP experiments could achieve comparable SNR to that obtained from the hair-bearing occipital areas. This study extended the previous work to systematically investigate the costs and benefits of non-hair SSVEPs. Furthermore, this study developed and evaluated an online BCI system based solely on non-hair EEG signals. A 12-target identification task was employed to quantitatively assess the performance of the online SSVEP-based BCI system. All subjects successfully completed the tasks using non-hair SSVEPs with 84.08 ± 15.60% averaged accuracy and 30.21 ± 10.61 bits/min averaged ITR. The empirical results of this study demonstrated the practicality of implementing an SSVEP-based BCI based on signals from non-hair-bearing areas, significantly improving the feasibility and practicality of real-world BCIs.

A classification algorithm of an SSVEP brain-Computer interface based on CCA fusion wavelet coefficients

The application of the brain-computer interface (BCI) is massively helpful and advantageous for disabled people. Moreover, BCI is an arrangement of software and hardware interface that provides a direct interaction between the human brain and computer devices. Therefore, in this article, A steady state visual evoked potential (SSVEP)-based BCI system is presented to identify SSVEP components from multi-channel electroencephalogram (EEG) data by minimizing background noise using an adaptive spatial filtering method. Here, the proposed adaptive spatial filtering-based SSVEP component extraction (ASFSCE) model improves reproducibility among multiple trails and identifies targets efficiently by optimizing the Eigenvalue problem. Along with that, the proposed ASFSCE model minimizes computational complexity from O(G<sup>2</sup>) to to get high target identification accuracy with faster execution. Performance results are measured using the SSVEP dataset. In this dataset, 11 subjects are used to perform experiments and 256-channel EEG data is taken. The efficiency of the proposed ASFSCE model is measured in terms of mean target detection accuracy and mean information transfer rate (ITR) in bits per minute. The average detection accuracy and ITR are evaluated by considering 23 trials for each subject. The obtained detection accuracy is 93.47% and ITR is 308.23 bpm.

Steady-state visual evoked potential (SSVEP) serves as one of the extensively utilized paradigms for brain–computer interface (BCI). SSVEP-based BCI has advantages of good classification accuracy, high information transfer rate (ITR), and little user training. However, there exist few studies investigating SSVEP-based BCI in the mobile situation, where electroencephalography (EEG) data are inevitably contaminated by muscle activities, and meanwhile, a limited number of channels are preferred. In this study, two major muscle artifact removal schemes are investigated in the dynamic scenario. One scheme adopts state-of-the-art blind source separation (BSS) methods without electromyogram (EMG) reference, while the other utilizes auxiliary EMG channels as a reference in the denoising process. To evaluate the performance of two schemes, we have tested them on real EEG data collected from ten subjects. The results demonstrate that, in the few-channel condition of SSVEP data, there are classification accuracy improvements of 9.93% for the canonical correlation analysis (CCA) indicator and 15.72% for the task-related component analysis (TRCA) indicator after processed by recursive least-squares (RLS) filtering with auxiliary EMG, and in the single-channel condition, there are classification accuracy improvements of 22.00% for the CCA indicator and 24.42% for the TRCA indicator after RLS filtering, averaged across all the subjects and data lengths. However, the BSS-based methods fail to improve the classification accuracies of SSVEP. Thus, it is of necessity to mount additional EMG channels for effective muscle activity suppression. This study provides an insightful suggestion for future real-life BCI applications.

Brain-computer interface (BCI) systems have emerged as an augmentative technology that can provide a promising solution for individuals with motor dysfunctions and for the elderly who are experiencing muscle weakness. Steady-state visually evoked potentials (SSVEPs) are widely adopted in BCI systems due to their high speed and accuracy when compared to other BCI paradigms. In this paper, we apply combined magnitude and phase features for class discrimination in a real-time SSVEP-based BCI platform. In the proposed real-time system users gain control of a motorised bed system with seven motion commands and an idle state. Experimental results amongst eight participants demonstrate that the proposed real-time BCI system can successfully discriminate between different SSVEP signals achieving high information transfer rates (ITR) of 82.73 bits/min. The attractive features of the proposed system include noninvasive recording, simple electrode configuration, excellent BCI response and minimal training requirements.

Steady-state visual evoked potential (SSVEP) based brain-computer interfaces (BCIs) have achieved an information transfer rate (ITR) of over 300 bits/min, but abundant training data is required. The performance of SSVEP algorithms deteriorates greatly under limited data, and the existing time-shift data augmentation method fails to improve it because the phase-locked requirement between training samples is violated. To address this issue, this study proposes a novel augmentation method, namely phase-locked time-shift (PLTS), for SSVEP-BCI. The similarity between epochs at different time moments was evaluated, and a unique time-shift step was calculated for each class to augment additional data epochs in each trial. The results showed that the PLTS significantly improved the classification performance of SSVEP algorithms on the BETA SSVEP datasets. Moreover, under the condition of one calibration block, by slightly prolonging the calibration duration (from 48 s to 51.5 s), the ITR increased from 40.88 ±4.54 bits/min to 122.61 ± 7.05 bits/min with the PLTS. This study provides a new perspective on augmenting data epochs for training-based SSVEP-BCI, promotes the classification accuracy and ITR under limited training data, and thus facilitates the real-life applications of SSVEP-based brain spellers.

Purpose: Brain-Computer Interface (BCI) Speller systems help people with mobility impairments improve their cognitive and physical abilities. Steady-State Visual Evoked Potential (SSVEP) signals have been used to build high-speed BCI speller systems. SSVEP signals are a subtype of Visual Evoked Potential (VEP), a form of co-frequency, and the harmonics response elicited by a specific frequency stimulus. Noise and artifacts are critical issues for target detection in SSVEP-based BCI systems.
 Materials and Methods: Thus, it is essential to provide target detection techniques that operate well in the presence of noises. One solution for overcoming the noise impact is to employ approaches that automatically extract the appropriate features for target detection from the training data. Deep Convolutional Neural Network (DCNN) was utilized in this study to automatically extract features from SSVEP data in noisy conditions. Moreover, the BETA database, which contains SSVEP data from 70 individuals collected outside of the electromagnetic shielding room, was used. In this regard, a suitable DCNN structure for target stimulus frequency identification was first designed. The network was pre-trained with part of the data from the BETA database. Finally, at the single-subject level, this pre-trained network was retrained and evaluated.
 Results: The results showed that after retraining, the accuracy and Information Transfer Rate (ITR) increased (p-value < 0.01) for all participants.
 Conclusion:.The enhancement in accuracy and ITR are 25.72% and 43.10 bpm, respectively.

Enhancing multi-class SSVEP classification performance using regularized covariance estimators, spatiotemporal beamforming, and short-time EEG trials