A High Performance Spelling System based on EEG-EOG Signals With Visual Feedback.

Objective. Brain–computer interface (BCI) technologies have been intensely studied to provide alternative communication tools entirely independent of neuromuscular activities. Current BCI technologies use electroencephalogram (EEG) acquisition methods that require unpleasant gel injections, impractical preparations and clean-up procedures. The next generation of BCI technologies requires practical, user-friendly, nonintrusive EEG platforms in order to facilitate the application of laboratory work in real-world settings. Approach. A capacitive electrode that does not require an electrolytic gel or direct electrode–scalp contact is a potential alternative to the conventional wet electrode in future BCI systems. We have proposed a new capacitive EEG electrode that contains a conductive polymer-sensing surface, which enhances electrode performance. This paper presents results from five subjects who exhibited visual or auditory steady-state responses according to BCI using these new capacitive electrodes. The steady-state visual evoked potential (SSVEP) spelling system and the auditory steady-state response (ASSR) binary decision system were employed. Main results. Offline tests demonstrated BCI performance high enough to be used in a BCI system (accuracy: 95.2%, ITR: 19.91 bpm for SSVEP BCI (6 s), accuracy: 82.6%, ITR: 1.48 bpm for ASSR BCI (14 s)) with the analysis time being slightly longer than that when wet electrodes were employed with the same BCI system (accuracy: 91.2%, ITR: 25.79 bpm for SSVEP BCI (4 s), accuracy: 81.3%, ITR: 1.57 bpm for ASSR BCI (12 s)). Subjects performed online BCI under the SSVEP paradigm in copy spelling mode and under the ASSR paradigm in selective attention mode with a mean information transfer rate (ITR) of 17.78 ± 2.08 and 0.7 ± 0.24 bpm, respectively. Significance. The results of these experiments demonstrate the feasibility of using our capacitive EEG electrode in BCI systems. This capacitive electrode may become a flexible and non-intrusive tool fit for various applications in the next generation of BCI technologies.

Purpose: Brain-Computer Interface (BCI) Speller systems help people with mobility impairments improve their cognitive and physical abilities. Steady-State Visual Evoked Potential (SSVEP) signals have been used to build high-speed BCI speller systems. SSVEP signals are a subtype of Visual Evoked Potential (VEP), a form of co-frequency, and the harmonics response elicited by a specific frequency stimulus. Noise and artifacts are critical issues for target detection in SSVEP-based BCI systems.
 Materials and Methods: Thus, it is essential to provide target detection techniques that operate well in the presence of noises. One solution for overcoming the noise impact is to employ approaches that automatically extract the appropriate features for target detection from the training data. Deep Convolutional Neural Network (DCNN) was utilized in this study to automatically extract features from SSVEP data in noisy conditions. Moreover, the BETA database, which contains SSVEP data from 70 individuals collected outside of the electromagnetic shielding room, was used. In this regard, a suitable DCNN structure for target stimulus frequency identification was first designed. The network was pre-trained with part of the data from the BETA database. Finally, at the single-subject level, this pre-trained network was retrained and evaluated.
 Results: The results showed that after retraining, the accuracy and Information Transfer Rate (ITR) increased (p-value < 0.01) for all participants.
 Conclusion:.The enhancement in accuracy and ITR are 25.72% and 43.10 bpm, respectively.

The paper presents a framework for offline analysis of P300 speller system using seeded k-means based ensemble SVM. Due to the use of small-datasets for the training of classifier, the performance deteriorates. The Proposed framework emphases on semi-supervised clustering approach for training the SVM classifier with large amount of data. The normalized mutual information (NMI) has used for cluster validation that gives maximum 88 clusters on 10 fold cross-validation dataset with NMI approx equals to 1. The proposed framework has applied to the EEG data acquired from two subjects and provided by the Wadsworth center for brain-computer interface (BCI) competition III. The experimental results show the increase in SNR value and obtain better accuracy results than linear, polynomial or rbf kernel SVM.

In this study we compared tactile and visual feedbacks for the motor imagery-based brain–computer interface (BCI) in five healthy subjects. A vertical green bar from the center of the fixing cross to the edge of the screen was used as visual feedback. Vibration motors that were placed on the forearms of the right and the left hands and on the back of the subject’s neck were used as tactile feedback. A vibration signal was used to confirm the correct classification of the EEG patterns of the motor imagery of right and left hand movements and the rest task. The accuracy of recognition in the classification of the three states (right hand movement, left hand movement, and rest) in the BCI without feedback exceeded the random level (33% for the three states) for all the subjects and was rather high (67.8% ± 13.4% (mean ± standard deviation)). Including the visual and tactile feedback in the BCI did not significantly change the mean accuracy of recognition of mental states for all the subjects (70.5% ± 14.8% for the visual feedback and 65.9% ± 12.4% for the tactile feedback). The analysis of the dynamics of the movement imagery skill in BCI users with the tactile and visual feedback showed no significant differences between these types of feedback. Thus, it has been found that the tactile feedback can be used in the motor imagery-based BCI instead of the commonly used visual feedback, which greatly expands the possibilities of the practical application of the BCI.

This study provides critical insights into next-generation BCI systems, specifically addressing the challenges of visual and physical fatigue, as well as performance limitations, in VR and MR environments. Conventional Event-Related Potential (ERP)-based spellers typically rely on two-dimensional visual stimuli presented on desktop LED screens. With the emergence of immersive head-mounted displays (HMDs), there is growing interest in integrating ( VR ) and ( MR ) into brain-computer interface (BCI) systems. In this study, we implemented ERP speller systems across Desktop, VR , and MR environments, evaluating (1) P300/N200 mean amplitudes, (2) spelling performance, and (3) physiological and physical fatigue. Using Linear Discriminant Analysis (LDA) alongside Random Forest (RF), k-Nearest Neighbors (kNN), and XGBoost classifiers, we found that the Desktop environment shows higher P300 and N200 amplitudes, achieving a spelling accuracy of 75% and an Information Transfer Rate (ITR) of 26.1 bits/min, compared to MR (63.4% accuracy, 20.5 bits/min) and VR (60.8% accuracy, 19.8 bits/min). Cross-session experiments, analyzed via two-sided paired t -tests, revealed stable P300 signals in Desktop settings but significant performance declines in VR and MR during prolonged use. Symptom questionnaires indicated that MR induced the highest visual fatigue, while VR caused the most physical fatigue. These findings highlight critical challenges in VR / MR BCI systems, including visual and physical stress and performance degradation, while demonstrating the potential of MR -P300 spellers for applications in neurorehabilitation and assistive communication for motor-impaired individuals. Our results underscore the need for optimized 3D rendering, adaptive user-system mechanisms, and advanced machine learning to enhance next-generation BCI performance in immersive environments.

Brain-computer interface (BCI) for robotic arm control has been studied to improve the life quality of people with severe motor disabilities. There are still challenges for robotic arm control in accomplishing a complex task with a series of actions. An efficient switch and a timely cancel command are helpful in the application of robotic arm. Based on the above, we proposed an asynchronous hybrid BCI in this study. The basic control of a robotic arm with six degrees of freedom was a steady-state visual evoked potential (SSVEP) based BCI with fifteen target classes. We designed an EOG-based switch which used a triple blink to either activate or deactivate the flash of SSVEP-based BCI. Stopping flash in the idle state can help to reduce visual fatigue and false activation rate (FAR). Additionally, users were allowed to cancel the current command simply by a wink in the feedback phase to avoid executing the incorrect command. Fifteen subjects participated and completed the experiments. The cue-based experiment obtained an average accuracy of 92.09%, and the information transfer rates (ITR) resulted in 35.98 bits/min. The mean FAR of the switch was 0.01/min. Furthermore, all subjects succeeded in asynchronously operating the robotic arm to grasp, lift, and move a target object from the initial position to a specific location. The results indicated the feasibility of the combination of EOG and SSVEP signals and the flexibility of EOG signal in BCI to complete a complicated task of robotic arm control.

A new benchmark dataset for P300 ERP-based BCI applications

A Brain Computer Interface (BCI) character speller allows human-beings to directly spell characters using eye-gazes, thereby building communication between the human brain and a computer. Convolutional Neural Networks (CNNs) have achieved state-of-the-art results on the BCI character spelling accuracy. Unfortunately, to the best of our knowledge, it has not been studied whether the CNN should be designed differently to increase the spelling accuracy when the number of sensors used to acquire EEG signals is different. This paper performs an empirical study to investigate this issue. First, we show a motivational example which motivates us for this investigation. Then, we propose a method to design CNNs according to the number of sensors used in the BCI character speller. This method automatically configures a parametric CNN we have devised according to the given number of sensors. Experimental results on six datasets show that we need to design different CNNs when different number of sensors are used for the acquisition of EEG signals. Experimental results also show that our designed sensor-aware CNNs outperform other CNNs in terms of spelling accuracy in most cases. Our CNNs can increase the spelling accuracy achieved by other CNNs with up to 34%.

Spelling Paradigm first introduced by Farwell and Donchin, is one of the Brain Computer Interface (BCI) applications that enables paralyzed people to communicate with their environment. In such a problem, user needs to focus on the characters which are randomly flashed row or column-wise on the computer screen in a small period of time. The accuracy in spelling words is the main problem in this scheme and the duration of the correct prediction is quite important. The purpose of this work is twofold: to analyze a user specific response to a spelling paradigm system considering the optimal frequency bands for P300 detection, and secondly to investigate the classification performance for the perception of row and columnwise flashings in the spelling system. The preprocessing is performed with Wiener Deconvolution Model (WDM) and optimal filters for user specific system is constructed. The proposed algorithm is applied to dataset IIb of BCI competition 2003 and the words for training and testing sets are predicted with 100% accuracy after first 4 trials, as compared to other winning algorithms (100% accuracy in 5 repetitions) of the competition. Furthermore, our classification results show that perception to row and column flashings may differ considerably.

Brain–computer interface controlled gaming: Evaluation of usability by severely motor restricted end-users

Brain-Computer Interfaces (BCI) facilitate interaction with devices, enhancing the quality of life for individuals with disabilities and offering a more direct method for controlling smart devices. Auditory BCIs commonly utilize event-related potentials (ERPs) necessitating a sequential presentation of choices through auditory stimuli. However, such methods impose constraints on the achievable Information Transfer Rate (ITR) compared to visual BCIs due to extended stimulus presentation times. Here, we introduce an auditory BCI approach in which the selective representation of attended speech in a listener's brain enables the decoding of one target sound source from the background. The simultaneous delivery of options in our proposed method reduces presentation durations by 2.5x compared to previous auditory BCI paradigms. This approach yields an average ITR exceeding 17 bits/min, with the best subject surpassing 33 bits/min. By outdoing current state-of-the-art auditory BCI paradigms, our research represents a significant advancement in the development of practical auditory BCI technologies.

Goal: P300 spellers are among the most popular types of brain-computer interfaces (BCIs) and are extremely useful assistive devices that enable severely disabled patients to communicate. However, P300 speller performances should be further improved to translate laboratory designs into practical applications. We aimed to design a new speller paradigm that could evoke higher event-related potentials (ERPs) than traditional P300 spellers, thus improving the performance of BCI systems. Methods: We proposed a new P300 speller paradigm based on three-dimensional (3-D) stereo visual stimuli. In this paradigm, flashing buttons are presented in 3-D stereo form. We designed two experiments, one that tested a traditional two-dimensional (2-D) speller and another that tested the proposed 3-D speller. Twelve healthy volunteers participated in our experiments. We compared the ERPs elicited by the 2-D speller and the 3-D speller, and we also compared the classification accuracy, information transfer rate (ITR), and user workload between the two paradigms. Results: The 3-D P300 speller elicited higher amplitudes of P300 waveforms than the traditional 2-D P300 speller. The online experimental results showed that the classification accuracy and the ITR were significantly improved with the 3-D P300 speller. We also found that the user workload of the 3-D P300 speller was significantly lower than that of the 2-D P300 speller. Conclusion : The proposed 3-D P300 speller based on stereo visual stimuli outperformed a traditional 2-D P300 speller. This finding indicates that our 3-D paradigm offers a new method that will improve the performance of P300 BCI systems.

Estimating and approaching the maximum information rate of noninvasive visual brain-computer interface

Brain-computer interface (BCI) technology based on event-related potentials (ERP) of electroencephalography (EEG) is widely used in daily life and medical treatment. However, the research of identifying the miniature and more informative asymmetric visual evoked potentials (aVEPs), which belongs to ERP, needs further exploration. Herein, a task-related component analysis combining paired character decoding (TRCA-PCD) method, which can enhance reproducibility of aVEPs in multiple trials and strengthen the features of different samples, was designed to realize fast decoding of aVEPs. The BCI performance and the influence of repetition times between the TRCA-PCD method, the discriminative canonical pattern matching (DCPM) method and traditional task-related component analysis (TRCA) method were compared using a 32-class aVEPs dataset recorded from 32 subjects. The highest average recognition accuracy and information transfer rate (ITR) of TRCA-PCD after parameter selection were 70.37 ± 2.49 % (DCPM: 64.91 ± 2.81 %, TRCA: 44.01 ± 3.25 %) with the peak value of 97.92% and 28.90 ± 3.83 bits/min (DCPM: 21.29 ± 3.35 bits/min, TRCA: 11.54 ± 2.81 bits/min) with the peak value of 94.55 bits/min respectively. Statistical analysis indicated that the highest average recognition rate could be obtained when the repetition time was six, and the highest ITR could be obtained when the repetition time was one. Overall, the results verified the effectiveness and superiority of TRCA-PCD in recognition of aVEPs and provided a reference for parameter selection. Therefore, the TRCA-PCD method can promote the further application of aVEPs in the BCI speller field.

To enhance the information transfer rate (ITR) of a steady-state visual evoked potential (SSVEP)-based speller, more characters with flickering symbols should be used. Increasing the number of symbols might reduce the classification accuracy. A hybrid brain-computer interface (BCI) improves the overall performance of a BCI system by taking advantage of two or more control signals. In a simultaneous hybrid BCI, various modalities work with each other simultaneously, which enhances the ITR. In our proposed speller, simultaneous combination of electromyogram (EMG) and SSVEP was applied to increase the ITR. To achieve 36 characters, only nine stimulus symbols were used. Each symbol allowed the selection of four characters based on four states of muscle activity. The SSVEP detected which symbol the subject was focusing on and the EMG determined the target character out of the four characters dedicated to that symbol. The frequency rate for character encoding was applied in the EMG modality and latency was considered in the SSVEP modality. Online experiments were carried out on 10 healthy subjects. The average ITR of this hybrid system was 96.1 bit/min with an accuracy of 91.2%. The speller speed was 20.9 char/min. Different subjects had various latency values. We used an average latency of 0.2 s across all subjects. Evaluation of each modality showed that the SSVEP classification accuracy varied for different subjects, ranging from 80% to 100%, while the EMG classification accuracy was approximately 100% for all subjects. Our proposed hybrid BCI speller showed improved system speed compared with state-of-the-art systems based on SSVEP or SSVEP-EMG, and can provide a user-friendly, practical system for speller applications.