Relevance-based channel selection in motor imagery brain–computer interface

The Common Spatial Patterns (CSP) method is a widely used spatial filtering technique that can extract discriminative features for Electroencephalogram (EEG)-based brain computer interface (BCI) classification tasks. Since the EEG signal acquired on the scalp is a nonlinear composition of multiple signal and noise sources, in order to characterize the nonlinear data structure, nonlinear CSP methods have been proposed by using the kernel technique. Most kernel CSP methods calculate temporal covariance structure in a kernel feature space that leads to a large kernel matrix with each dimension equal to the number of time points multiplied by the number of classes. In this work, a kernel CSP method exploiting spatial covariance structure in the feature space is developed where the size of kernel matrix is the number of EEG channels, which is usually much less than that of time points. The proposed method was evaluated using motor imagery EEG data. Results indicate that the kernel CSP using spatial analysis can provide comparable performance to the existing methods using temporal analysis with less computational load.

A motor imagery (MI) brain-computer interface (BCI) plays an important role in the neurological rehabilitation training for stroke patients. Electroencephalogram (EEG)-based MI BCI has high temporal resolution, which is convenient for real-time BCI control. Therefore, we focus on EEG-based MI BCI in this paper. The identification of MI EEG signals is always quite challenging. Due to high inter-session/subject variability, each subject should spend long and tedious calibration time in collecting amounts of labeled samples for a subject-specific model. To cope with this problem, we present a supervised selective cross-subject transfer learning (sSCSTL) approach which simultaneously makes use of the labeled samples from target and source subjects based on Riemannian tangent space. Since the covariance matrices representing the multi-channel EEG signals belong to the smooth Riemannian manifold, we perform the Riemannian alignment to make the covariance matrices from different subjects close to each other. Then, all aligned covariance matrices are converted into the Riemannian tangent space features to train a classifier in the Euclidean space. To investigate the role of unlabeled samples, we further propose semi-supervised and unsupervised versions which utilize the total samples and unlabeled samples from target subject, respectively. Sequential forward floating search (SFFS) method is executed for source selection. All our proposed algorithms transfer the labeled samples from most suitable source subjects into the feature space of target subject. Experimental results on two publicly available MI datasets demonstrated that our algorithms outperformed several state-of-the-art algorithms using small number of the labeled samples from target subject, especially for good target subjects.

The study aimed to compare the effects of combined action observation and motor imagery (AOMI) and motor imagery (MI)-based brain-computer interface (BCI) training on upper limb recovery, cortical excitation, and cognitive task performance in chronic stroke patients. 17 chronic stroke patients were recruited and randomly assigned to AOMI-based BCI (n = 9) and MI-based BCI groups (n = 8). The AOMI-based BCI group received AOMI-based BCI training via functional electrical stimulation (FES) feedback, whereas the MI-based BCI group obtained MI-based BCI training via FES feedback. Both groups participated in training for 12 sessions (3 days/week, consecutive four weeks). To evaluate upper limb function recovery, the Fugl–Meyer Assessment for upper extremity (FMA-UE) was employed. Event-related desynchronization (ERD) and online classification accuracy were utilized to measure cortical excitation of the affected sensorimotor hand region and cognitive task performance, respectively. Both AOMI and MI-based BCI training improved upper limb function in chronic stroke patients. However, the AOMI-based BCI group showed significantly greater motor gain than the MI-based BCI group. In addition, the AOMI-based BCI group demonstrated significantly greater cortical excitation of the affected sensorimotor hand region and cognitive task performance. The correlation analysis revealed that higher cognitive task performance during AOMI-based BCI training may promote greater cortical excitation of the affected sensorimotor hand region, which contributes to greater upper limb function improvement compared to MI-based BCI training.

F190. Mindfulness based stress reduction’s influence on brain-computer interface control

Brain-Computer Interfaces (BCI) based on Electroencephalography (EEG) signals, in particular motor imagery (MI) data have received a lot of attention and show the potential towards the design of key technologies both in healthcare and other industries. MI data is generated when a subject imagines movement of limbs and can be used to aid rehabilitation as well as in autonomous driving scenarios. Thus, classification of MI signals is vital for EEG-based BCI systems. Recently, MI EEG classification techniques using deep learning have shown improved performance over conventional techniques. However, due to inter-subject variability, the scarcity of unseen subject data, and low signal-to-noise ratio, extracting robust features and improving accuracy is still challenging. In this context, we propose a novel two-way few shot network that is able to efficiently learn how to learn representative features of unseen subject categories and how to classify them with limited MI EEG data. The pipeline includes an embedding module that learns feature representations from a set of samples, an attention mechanism for key signal feature discovery, and a relation module for final classification based on relation scores between a support set and a query signal. In addition to the unified learning of feature similarity and a few shot classifier, our method leads to emphasize informative features in support data relevant to the query data, which generalizes better on unseen subjects. For evaluation, we used the BCI competition IV 2b dataset and achieved an 9.3% accuracy improvement in the 20-shot classification task with state-of-the-art performance. Experimental results demonstrate the effectiveness of employing attention and the overall generality of our method.

Objective.A motor imagery (MI)-based brain-computer interface (BCI) enables users to engage with external environments by capturing and decoding electroencephalography (EEG) signals associated with the imagined movement of specific limbs. Despite significant advancements in BCI technologies over the past 40 years, a notable challenge remains: many users lack BCI proficiency, unable to produce sufficiently distinct and reliable MI brain patterns, hence leading to low classification rates in their BCIs. The objective of this study is to enhance the online performance of MI-BCIs in a personalized, biomarker-driven approach using transcranial alternating current stimulation (tACS).Approach.Previous studies have identified that the peak power spectral density value in sensorimotor idling rhythms is a neural correlate of participants' upper limb MI-BCI performances. In this active-controlled, single-blind study, we applied 20 min of tACS at the participant-specific, peakµfrequency in resting-state sensorimotor rhythms (SMRs), with the goal of enhancing resting-stateµSMRs.Main results.After tACS, we observed significant improvements in event-related desynchronizations (ERDs) ofµSMRs, and in the performance of an online MI-BCI that decodes left versus right hand commands in healthy participants (N= 10)-but not in an active control-stimulation control group (N= 10). Lastly, we showed a significant correlation between the resting-stateµSMRs andµERD, offering a mechanistic interpretation behind the observed changes in online BCI performances.Significance.Our research lays the groundwork for future non-invasive interventions designed to enhance BCI performances, thereby improving the independence and interactions of individuals who rely on these systems.

BCI is a strong tool that improves human-system communication. It improves the brain's ability to interact with its surroundings. Recent decades have seen substantial advances in neuroscience and computer science. This has made BCI a leader in computational neuroscience and intelligence research. Recent technological advances including wearable sensing devices, real-time data streaming, machine learning, and deep learning have raised the need for electroencephalographic (EEG)-based brain-computer interface (BCI) in clinical and translational applications. EEG-based Brain-Computer Interfaces (BCIs) detect cognitive state variations throughout laborious tasks, making them advantageous for individuals. To fill in the gaps in the wide overview of the past five years (2019-2024), we surveyed the newest research on EEG signal detection and computational intelligence in brain-computer interfaces. To provide a more accurate account, we will begin by reviewing Brain-Computer Interface (BCI) technology and its main challenges. Modern signal detection and enhancement techniques for EEG signal collection and refinement follow. We also provide advanced computational intelligence methods for tracking, maintaining, and monitoring human cognitive and operational performance in everyday applications. Combinations, interpretable fuzzy models, transfer learning, and deep learning are used. We conclude with a sample of cutting-edge BCI-driven healthcare applications and explore future EEG-based BCI research.

Online coadaptive training has been successfully employed to enable people to control motor imagery (MI)-based brain-computer interfaces (BCIs), allowing to completely skip the lengthy and demotivating open-loop calibration stage traditionally applied before closed-loop control. However, practical reasons may often dictate to eventually switch off decoder adaptation and proceed with BCI control under a fixed BCI model, a situation that remains rather unexplored. This work studies the existence and magnitude of potential post-adaptation effects on system performance, subject learning and brain signal modulation stability in a state-of-the-art, coadaptive training regime inspired by a game-like design. The results extracted in a cohort of 20 able-bodied individuals reveal that ceasing classifier adaptation after three runs (approx. 30 min) of a single-session training protocol had no significant impact on any of the examined BCI control and learning aspects in the remaining two runs (about 20 min) with a fixed classifier. Fifteen individuals achieved accuracies that are better than chance level and allowed them to successfully execute the given task. These findings alleviate a major concern regarding the applicability of coadaptive MI BCI training, thus helping to further establish this training approach and allow full exploitation of its benefits.

The accuracy of the classification of user intentions is essential for motor imagery (MI)-based brain-computer interface (BCI). Effective and appropriate training for users could help us produce the high reliability of mind decision making related with MI tasks. In this study, we aimed to investigate the effects of visual guidance on the classification performance of MI-based BCI. In this study, leveraging both the single-subject and the multi-subject BCI paradigms, we train and classify MI tasks with three different scenarios in a 3D virtual environment, including non-object-directed scenario, static-object-directed scenario, and dynamic object-directed scenario. Subjects are required to imagine left-hand or right-hand movement with the visual guidance. We demonstrate that the classification performances of left-hand and right-hand MI task have differences on these three scenarios, and confirm that both static-object-directed and dynamic object-directed scenarios could provide better classification accuracy than the non-object-directed case. We further indicate that both static-object-directed and dynamic object-directed scenarios could shorten the response time as well as be suitable applied in the case of small training data. In addition, experiment results demonstrate that the multi-subject BCI paradigm could improve the classification performance comparing with the single-subject paradigm. These results suggest that it is possible to improve the classification performance with the appropriate visual guidance and better BCI paradigm. We believe that our findings would have the potential for improving classification performance of MI-based BCI and being applied in the practical applications.

In recent years, deep learning-based feature representation methods have shown a promising impact on electroencephalography (EEG)-based brain-computer interface (BCI). Nonetheless, owing to high intra- and inter-subject variabilities, many studies on decoding EEG were designed in a subject-specific manner by using calibration samples, with no concern of its practical use, hampered by time-consuming steps and a large data requirement. To this end, recent studies adopted a transfer learning strategy, especially domain adaptation techniques. Among those, we have witnessed the potential of adversarial learning-based transfer learning in BCIs. In the meantime, it is known that adversarial learning-based domain adaptation methods are prone to negative transfer that disrupts learning generalized feature representations, applicable to diverse domains, for example, subjects or sessions in BCIs. In this article, we propose a novel framework that learns class-relevant and subject-invariant feature representations in an information-theoretic manner, without using adversarial learning. To be specific, we devise two operational components in a deep network that explicitly estimate mutual information between feature representations: 1) to decompose features in an intermediate layer into class-relevant and class-irrelevant ones and 2) to enrich class-discriminative feature representation. On two large EEG datasets, we validated the effectiveness of our proposed framework by comparing with several comparative methods in performance. Furthermore, we conducted rigorous analyses by performing an ablation study in regard to the components in our network, explaining our model's decision on input EEG signals via layer-wise relevance propagation, and visualizing the distribution of learned features via t-SNE.

Correlation-based channel selection and regularized feature optimization for MI-based BCI

The development of brain computer interfaces (BCIs) for patient rehabilitation is a growing field of research. The BCI experimental paradigms consist mainly of selective attention BCI models and motor imagery (MI) BCIs. Selective attention models require an external stimulus (screen) but achieve high rates of classification accuracy fairly quickly. MI systems do not require external stimuli but require extensive training. The goal of our study was to gauge how much a short training paradigm requiring seven six-minute sessions of video attention would change fMRI BOLD activity between two sessions of MI ± one acquired before and another after the training protocol took place. The study used four MIs: 1) right hand 2) left hand 3) feet 4) tongue; and it was carried out on ten subjects. We found an increase of the BOLD response after training, both in amplitude and spatial extent, for the majority (6 out of 10) of subjects and MIs (all except left hand). Our results corroborate other literature results regarding the effect of training in MI based BCIs.

Electroencephalogram (EEG) based brain-computer interfaces (BCIs) for wheelchair control have great value for those with devastating neuromuscular disorders. Although there have been many attempts to implement EEG-based wheelchair control systems by P300, steady state visual evoked potential (SSVEP), and motor imagery (MI) related event-related desynchronization/synchronization (ERD/ERS), the number of simultaneous control commands in those BCI systems is strictly limited, and those BCI control do not work for a non-negligible portion of users due to the problem of BCI Illiteracy.In this paper, we develop a multimodal BCI based wheelchair control system, the user could employ subject-optimized mental strategies to produce multiple commands to control the wheelchair, which include ERD/ERS, SSVEP, and simultaneous ERD/ERS and SSVEP. It could not only help address ”BCI illiteracy”, but also provide simultaneous control commands for complex control. Experiment results demonstrate the proposed system is effective and flexible in practical application.KeywordsBCIwheelchair controlmultimodalBCI Illiteracy

Brain-computer interface (BCI) technology is an innovative human-computer interaction technology that does not rely on the peripheral nerve transmission pathway and muscle tissues, and establishes the connection between the human brain and the external machine. BCI system includes three categories: active, reactive and passive, with the motor imagery brain-computer interface (MI-BCI) is the most common active BCI system. MI-BCI controls external devices by imagining movements in the brain, without actually having to perform the movement. In order to bring more immersion to patients, the introduction of augmented reality (AR) technology can increase the interest of patients and improve the concentration on rehabilitation training. This study reviews the overview of BCI technology, the application of MI-BCI technology in the rehabilitation of nervous system diseases, and the limitations and prospects applications of MI-BCI technology in the rehabilitation of nervous system diseases, so as to provide reference for the application of MI-BCI technology in the diagnosis and rehabilitation of nervous system diseases. Specifically, the overview of BCI technology mainly introduces BCI technology, MI-BCI technology and AR-MI-BCI rehabilitation training system (the process and overall structure of the AR-MI-BCI rehabilitation training system). MI-BCI system has many applications in neurological diseases such as stroke, drug addiction and depression, which can not only effectively assist the diagnosis of neurological diseases, but also activate specific brain regions to promote brain function rehabilitation. MI-BCI system can identify the motor imagery intention of stroke patients and guide them to actively imagine body movements, which is helpful for active rehabilitation of patients. To address the poor generalization issues in traditional machine learning algorithms at the individual level of stroke patients, MI-BCI rehabilitation training system is built on the transfer learning technology. The rehabilitation training system based on AR-MI-BCI can assist drug users to reduce drug addiction and the difficult withdrawal of mental dependence and physical dependence caused by drug abuse, and make drug users have a connection between drugs and resistance emotion. EEG recognition scheme based on MI-BCI multi-frequency brain network can assist in the diagnosis of depression, but MI-BCI technology has some shortcomings in terms of technical development, device cost, patient privacy and clinical application.

The objective of this study was to investigate the efficacy of an Electroencephalography (EEG)-based Motor Imagery (MI) Brain-Computer Interface (BCI) coupled with a Haptic Knob (HK) robot for arm rehabilitation in stroke patients. In this three-arm, single-blind, randomized controlled trial; 21 chronic hemiplegic stroke patients (Fugl-Meyer Motor Assessment (FMMA) score 10–50), recruited after pre-screening for MI BCI ability, were randomly allocated to BCI-HK, HK or Standard Arm Therapy (SAT) groups. All groups received 18 sessions of intervention over 6 weeks, 3 sessions per week, 90 min per session. The BCI-HK group received 1 h of BCI coupled with HK intervention, and the HK group received 1 h of HK intervention per session. Both BCI-HK and HK groups received 120 trials of robot-assisted hand grasping and knob manipulation followed by 30 min of therapist-assisted arm mobilization. The SAT group received 1.5 h of therapist-assisted arm mobilization and forearm pronation-supination movements incorporating wrist control and grasp-release functions. In all, 14 males, 7 females, mean age 54.2 years, mean stroke duration 385.1 days, with baseline FMMA score 27.0 were recruited. The primary outcome measure was upper extremity FMMA scores measured mid-intervention at week 3, end-intervention at week 6, and follow-up at weeks 12 and 24. Seven, 8 and 7 subjects underwent BCI-HK, HK and SAT interventions respectively. FMMA score improved in all groups, but no intergroup differences were found at any time points. Significantly larger motor gains were observed in the BCI-HK group compared to the SAT group at weeks 3, 12, and 24, but motor gains in the HK group did not differ from the SAT group at any time point. In conclusion, BCI-HK is effective, safe, and may have the potential for enhancing motor recovery in chronic stroke when combined with therapist-assisted arm mobilization.