Brain–computer interface controlled gaming: Evaluation of usability by severely motor restricted end-users

F190. Mindfulness based stress reduction’s influence on brain-computer interface control

Steady state visual evoked potential (SSVEP)-based brain-computer interface (BCI) has gained a lot of attention due to its robustness and high information transfer rate (ITR). However, transitioning well-controlled laboratory-oriented BCI demonstrations to real-world applications poses severe challenges for this exciting field. For instance, conducting BCI experiments usually requires skilled technicians to abrade the area of skin underneath each electrode and apply an electrolytic gel or paste to acquire high-quality SSVEPs from hair-covered areas. Our previous proof-of-concept study has proposed an alternative approach that employed electroencephalographic signals collected from easily accessible non-hair-bearing areas including neck, behind the ears, and face to realize an SSVEP-based BCI. The study results showed that, with proper electrode placements and advanced signal-processing algorithms, the SSVEPs measured from non-hair-bearing areas in off-line SSVEP experiments could achieve comparable SNR to that obtained from the hair-bearing occipital areas. This study extended the previous work to systematically investigate the costs and benefits of non-hair SSVEPs. Furthermore, this study developed and evaluated an online BCI system based solely on non-hair EEG signals. A 12-target identification task was employed to quantitatively assess the performance of the online SSVEP-based BCI system. All subjects successfully completed the tasks using non-hair SSVEPs with 84.08 ± 15.60% averaged accuracy and 30.21 ± 10.61 bits/min averaged ITR. The empirical results of this study demonstrated the practicality of implementing an SSVEP-based BCI based on signals from non-hair-bearing areas, significantly improving the feasibility and practicality of real-world BCIs.

Currently, the operational electroencephalography (EEG)-based brain–computer interfaces (BCIs) suffer from problems of BCI latency/lag issues, which restricts the use of interfaces impractical scenarios. One of the reasons behind the present challenges is the application of a purely data-driven approach to the BCI pipeline. Although BCI applications have improved significantly with the research in the fields of artificial intelligence (AI) and machine learning (ML), fundamental issues of data-driven training restrict the latency that can be achieved under current BCI paradigms. This work explores the possibility of future BCI using a combination of data-driven and theory-driven methods. In this study, an EEG-BCI dataset from steady-state visually evoked potentials (SSVEPs) is applied, where the SSVEP signals contain, source components from the occipital, parietal and frontal regions of the brain. Source reconstruction is done with the combination of independent component analysis (ICA) and low-resolution electromagnetic tomography analysis (LORETA). This method was able to predict BCI classification labels 5[Formula: see text]s earlier, based on pre-recorded signals from the scalp. The novelty of the current contribution lies in utilizing the source reconstructed EEG time-series for BCI classification, which allows for retention of classification accuracy up to 70% while working with the reduced data dimensionality. Implementation of this algorithm will allow a significant reduction in lag in online BCIs.

Objective.A motor imagery (MI)-based brain-computer interface (BCI) enables users to engage with external environments by capturing and decoding electroencephalography (EEG) signals associated with the imagined movement of specific limbs. Despite significant advancements in BCI technologies over the past 40 years, a notable challenge remains: many users lack BCI proficiency, unable to produce sufficiently distinct and reliable MI brain patterns, hence leading to low classification rates in their BCIs. The objective of this study is to enhance the online performance of MI-BCIs in a personalized, biomarker-driven approach using transcranial alternating current stimulation (tACS).Approach.Previous studies have identified that the peak power spectral density value in sensorimotor idling rhythms is a neural correlate of participants' upper limb MI-BCI performances. In this active-controlled, single-blind study, we applied 20 min of tACS at the participant-specific, peakµfrequency in resting-state sensorimotor rhythms (SMRs), with the goal of enhancing resting-stateµSMRs.Main results.After tACS, we observed significant improvements in event-related desynchronizations (ERDs) ofµSMRs, and in the performance of an online MI-BCI that decodes left versus right hand commands in healthy participants (N= 10)-but not in an active control-stimulation control group (N= 10). Lastly, we showed a significant correlation between the resting-stateµSMRs andµERD, offering a mechanistic interpretation behind the observed changes in online BCI performances.Significance.Our research lays the groundwork for future non-invasive interventions designed to enhance BCI performances, thereby improving the independence and interactions of individuals who rely on these systems.

Steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) have potential to realize high-speed communication between the human brain and the external environment. Recently, multiple access (MA) methods in telecommunications have been introduced into the system design of BCIs and showed their potential in improving BCI performance. This study investigated the feasibility of hybrid frequency and phase coding methods in multi-target SSVEP-based BCIs. Specifically, this study compared two hybrid target-coding strategies: (1) mixed frequency and phase coding, and (2) joint frequency and phase coding. In a simulated online BCI experiment using a 40-target BCI speller, BCI performance for both coding approaches were tested with a group of six subjects. At a spelling speed of 40 characters per minute (1.5 seconds per character), both approaches obtained high information transfer rates (ITR) (mixed coding: 172.37±28.67 bits/min, joint coding: 170.94±28.32 bits/min) across subjects. There was no statistically significant difference between the two approaches (p>0.05). These results suggest that the hybrid frequency and phase coding methods are highly efficient for multi-target coding in SSVEP BCIs with a large number of classes, providing a practical solution to implement a high-speed BCI speller.

Introduction: This current study is part of a larger, on-going clinical trial (NCT02098265), which evaluates non-invasive electroencephalographic (EEG) based brain-computer interface(BCI) therapy for restoration of distal upper extremity motor function in stroke survivors. We acquired data for 8 participants (mean age= 64 years) presenting with varying levels of upper-extremity motor deficits and chronicity since stroke. EEG based BCI task-related performance outcomes were compared with distal extremity behavioral testing on the 9-Hole Peg Test - 9HPT) to illustrate the relationship of BCI training performance on behavioral performance. Methods: EEG data is acquired with BCI2000, a 16 channel recording system (g.LADYbird-g. GAMMAsys-g. USBamp, Guger Technologies, Graz, Austria) with electrodes positioned according to the standard 10-20 system over the sensorimotor cortex at C3 & C4. Participants performed a hand movement task; randomly cued to move either their affected or unaffected hand depending on the appearance of virtual target and cursor on the screen. 9HPT Data was selected from two BCI conditions: 1) BCI with visual stimulus only, and 2) BCI with visual stimulation plus functional electrical stimulation (FES) of the impaired arm, and tongue stimulation (TS) at four time-points: baseline (prior to BCI therapy), mid-point of BCI therapy, post-therapy, and one month post-therapy. Results: BCI visual plus stimulus for the unaffected side was found to best relate to 9HPT scores (p= 0.0928) with a trend to significance. BCI visual plus stimulus for the affected side was not shown to correlate with 9HPT scores (p= 0.2655). The results suggest that 9HPT scores better relate with average task accuracy when the TS and FES adjuvants are incorporated (BCI stimulus vs 9H PT unaffected p= 0.09284, BCI stimulus vs 9H PT affected p= 0.26553) compared to the BCI visual only task (BCI visual vs 9HPT unaffected p=0.2702, BCI visual vs 9HPT affected (p= 0.89276). Conclusion: Non-invasive EEG-based BCI therapy may be suitable for the restoration of distal upper extremity motor function but average task accuracy does not appear to be a valid indicator of motor improvement. This finding suggests that visual only BCI systems are inadequate for motor rehabilitation.

BCI is a strong tool that improves human-system communication. It improves the brain's ability to interact with its surroundings. Recent decades have seen substantial advances in neuroscience and computer science. This has made BCI a leader in computational neuroscience and intelligence research. Recent technological advances including wearable sensing devices, real-time data streaming, machine learning, and deep learning have raised the need for electroencephalographic (EEG)-based brain-computer interface (BCI) in clinical and translational applications. EEG-based Brain-Computer Interfaces (BCIs) detect cognitive state variations throughout laborious tasks, making them advantageous for individuals. To fill in the gaps in the wide overview of the past five years (2019-2024), we surveyed the newest research on EEG signal detection and computational intelligence in brain-computer interfaces. To provide a more accurate account, we will begin by reviewing Brain-Computer Interface (BCI) technology and its main challenges. Modern signal detection and enhancement techniques for EEG signal collection and refinement follow. We also provide advanced computational intelligence methods for tracking, maintaining, and monitoring human cognitive and operational performance in everyday applications. Combinations, interpretable fuzzy models, transfer learning, and deep learning are used. We conclude with a sample of cutting-edge BCI-driven healthcare applications and explore future EEG-based BCI research.

Objective. Code-modulated visual evoked potential (c-VEP) based brain–computer interfaces (BCIs) exhibit high encoding efficiency. Nevertheless, the majority of c-VEP based BCIs necessitate an initial training or calibration session, particularly when the number of targets expands, which impedes the practicality. To address this predicament, this study introduces a calibration-free c-VEP based BCI employing narrow-band random sequences. Approach. For the encoding method, a series of random sequences were generated within a specific frequency band. The c-VEP signals were subsequently elicited through the application of on-type grid flashes that were modulated by these sequences. For the calibration-free decoding algorithm, filter-bank canonical correlation analysis (FBCCA) was utilized with the reference templates generated from the original sequences. Thirty-five subjects participated into an online BCI experiment. The performances of c-VEP based BCIs utilizing narrow-band random sequences with frequency bands of 15–25 Hz (NBRS-15) and 8–16 Hz (NBRS-8) were compared with that of a steady-state visual evoked potential (SSVEP) based BCI within a frequency range of 8–15.8 Hz. Main results. The offline analysis results demonstrated a substantial correlation between the c-VEPs and the original narrow-band random sequences. After parameter optimization, the calibration-free system employing the NBRS-15 frequency band achieved an average information transfer rate (ITR) of 78.56 ± 37.03 bits/min, which exhibited no significant difference compared to the performance of the SSVEP based system when utilizing FBCCA. The proposed system achieved an average ITR of 102.1 ± 57.59 bits/min in a simulation of a 1000-target BCI system. Significance. This study introduces a novel calibration-free c-VEP based BCI system employing narrow-band random sequences and shows great potential of the proposed system in achieving a large number of targets and high ITR.

Eliciting dual-frequency SSVEP using a hybrid SSVEP-P300 BCI

Objective. Brain–computer interface (BCI) technologies have been intensely studied to provide alternative communication tools entirely independent of neuromuscular activities. Current BCI technologies use electroencephalogram (EEG) acquisition methods that require unpleasant gel injections, impractical preparations and clean-up procedures. The next generation of BCI technologies requires practical, user-friendly, nonintrusive EEG platforms in order to facilitate the application of laboratory work in real-world settings. Approach. A capacitive electrode that does not require an electrolytic gel or direct electrode–scalp contact is a potential alternative to the conventional wet electrode in future BCI systems. We have proposed a new capacitive EEG electrode that contains a conductive polymer-sensing surface, which enhances electrode performance. This paper presents results from five subjects who exhibited visual or auditory steady-state responses according to BCI using these new capacitive electrodes. The steady-state visual evoked potential (SSVEP) spelling system and the auditory steady-state response (ASSR) binary decision system were employed. Main results. Offline tests demonstrated BCI performance high enough to be used in a BCI system (accuracy: 95.2%, ITR: 19.91 bpm for SSVEP BCI (6 s), accuracy: 82.6%, ITR: 1.48 bpm for ASSR BCI (14 s)) with the analysis time being slightly longer than that when wet electrodes were employed with the same BCI system (accuracy: 91.2%, ITR: 25.79 bpm for SSVEP BCI (4 s), accuracy: 81.3%, ITR: 1.57 bpm for ASSR BCI (12 s)). Subjects performed online BCI under the SSVEP paradigm in copy spelling mode and under the ASSR paradigm in selective attention mode with a mean information transfer rate (ITR) of 17.78 ± 2.08 and 0.7 ± 0.24 bpm, respectively. Significance. The results of these experiments demonstrate the feasibility of using our capacitive EEG electrode in BCI systems. This capacitive electrode may become a flexible and non-intrusive tool fit for various applications in the next generation of BCI technologies.

The study aimed to compare the effects of combined action observation and motor imagery (AOMI) and motor imagery (MI)-based brain-computer interface (BCI) training on upper limb recovery, cortical excitation, and cognitive task performance in chronic stroke patients. 17 chronic stroke patients were recruited and randomly assigned to AOMI-based BCI (n = 9) and MI-based BCI groups (n = 8). The AOMI-based BCI group received AOMI-based BCI training via functional electrical stimulation (FES) feedback, whereas the MI-based BCI group obtained MI-based BCI training via FES feedback. Both groups participated in training for 12 sessions (3 days/week, consecutive four weeks). To evaluate upper limb function recovery, the Fugl–Meyer Assessment for upper extremity (FMA-UE) was employed. Event-related desynchronization (ERD) and online classification accuracy were utilized to measure cortical excitation of the affected sensorimotor hand region and cognitive task performance, respectively. Both AOMI and MI-based BCI training improved upper limb function in chronic stroke patients. However, the AOMI-based BCI group showed significantly greater motor gain than the MI-based BCI group. In addition, the AOMI-based BCI group demonstrated significantly greater cortical excitation of the affected sensorimotor hand region and cognitive task performance. The correlation analysis revealed that higher cognitive task performance during AOMI-based BCI training may promote greater cortical excitation of the affected sensorimotor hand region, which contributes to greater upper limb function improvement compared to MI-based BCI training.

The performance of steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) has been drastically improved in the past few years. In conventional SSVEP-based BCIs, the speed of a selection is fixed towards high performance based on preliminary offline analysis. However, due to inter-trial variability, the optimal selection time to achieve sufficient accuracy is different for each trial. To optimize the performance of SSVEP-based BCIs, this study proposed a dynamic stopping method that can adaptively determine a selection time in each trial by applying a threshold to the probability of detecting a target. A 12-class SSVEP dataset recorded from 10 subjects was used to evaluate the performance of the proposed method. Compared to the conventional method with a fixed selection time towards the highest accuracy, the proposed method could significantly reduce the averaged selection time (0.84±0.39 s vs. 1.44±0.63 s, p<;0.05) with comparable accuracy (99.44±1.57 % vs. 99.55±1.22 %). As a result, the simulated online information transfer rate (ITR) with the dynamic stopping method achieved a significant improvement compared to the conventional method (125.30±21.55 bits/min vs. 92.75±23.77 bits/min). These results suggest that the proposed dynamic stopping method is effective for improving the performance of SSVEP-based BCI systems.

Steady-state visual evoked potential (SSVEP) based brain-computer interfaces (BCIs) have achieved an information transfer rate (ITR) of over 300 bits/min, but abundant training data is required. The performance of SSVEP algorithms deteriorates greatly under limited data, and the existing time-shift data augmentation method fails to improve it because the phase-locked requirement between training samples is violated. To address this issue, this study proposes a novel augmentation method, namely phase-locked time-shift (PLTS), for SSVEP-BCI. The similarity between epochs at different time moments was evaluated, and a unique time-shift step was calculated for each class to augment additional data epochs in each trial. The results showed that the PLTS significantly improved the classification performance of SSVEP algorithms on the BETA SSVEP datasets. Moreover, under the condition of one calibration block, by slightly prolonging the calibration duration (from 48 s to 51.5 s), the ITR increased from 40.88 ±4.54 bits/min to 122.61 ± 7.05 bits/min with the PLTS. This study provides a new perspective on augmenting data epochs for training-based SSVEP-BCI, promotes the classification accuracy and ITR under limited training data, and thus facilitates the real-life applications of SSVEP-based brain spellers.

This study proposes a steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) independent of amplitude-frequency and phase calibrations. Six stepping delay flickering sequences (SDFSs) at 32-Hz flickering frequency were used to implement a six-command BCI system. EEG signals recorded from Oz position were first filtered within 29-35 Hz, segmented based on trigger events of SDFSs to obtain SDFS epochs, and then stored separately in epoch registers. An epoch-average process suppressed the inter-SDFS interference. For each detection point, the latest six SDFS epochs in each epoch register were averaged and the normalized power of averaged responses was calculated. The visual target that induced the maximum normalized power was identified as the visual target. Eight subjects were recruited in this study. All subjects were requested to produce the "563241" command sequence four times. The averaged accuracy, command transfer interval, and information transfer rate (mean ± std.) values for all eight subjects were 97.38 ± 5.97%, 3.56 ± 0.68 s, and 42.46 ± 11.17 bits/min, respectively. The proposed system requires no calibration in either the amplitude-frequency characteristic or the reference phase of SSVEP which may provide an efficient and reliable channel for the neuromuscular disabled to communicate with external environments.

This paper presents the major challenges and solutions for the Brain Computer Interfaces (BCIs), which are based on Steady State Visual Evoked Potentials (SSVEPs). A BCI utilizes the information transmitted by the brain; there are several methods available for analyzing these brain activities. One of the major challenges in BCI is to remove the noise successfully. Averaging along with Wavelets has been proposed in this paper for de-noising the brain activities. Moreover, three different approaches have been investigated to estimate the frequency spectrum of the brain signals. In addition to the well known Fourier Transform (FT) technique, for spectral estimation, there are many parametric and non parametric techniques for computing the frequency content of a signal. This paper presents a comparison between Fast Fourier Transform (FFT), MUltiple SIgnal Classification (MUSIC) and Linear Predictive Coding (LPC). The effectiveness of different techniques has been studied and the simulation results have shown that MUSIC outperforms the other approaches.