Asynchronous Brain Computer Interfaces Using Echo State Networks

EEG-based brain-computer interfaces (BCI) are non-invasive approaches for replacing or restoring motor functions in impaired patients, and direct brain-to-device communication in the general population. Motor imagery (MI) is one of the most used BCI paradigms, but its performance varies across individuals and certain users require substantial training to develop control. In this study, we propose to integrate a MI paradigm simultaneously with a recently proposed Overt Spatial Attention (OSA) paradigm, to accomplish BCI control. We evaluated a cohort of 25 human subjects' ability to control a virtual cursor in one- and two-dimensions over 5 BCI sessions. The subjects used 5 different BCI paradigms: MI alone, OSA alone, MI, and OSA simultaneously towards the same target (MI+OSA), and MI for one axis while OSA controls the other (MI/OSA and OSA/MI). Our results show that MI+OSA reached the highest average online performance in 2D tasks at 49% Percent Valid Correct (PVC), and statistically outperforms both MI alone (42%) and OSA alone (45%). MI+OSA had a similar performance to each subject's best individual method between MI alone and OSA alone (50%) and 9 subjects reached their highest average BCI performance using MI+OSA. Integrating MI and OSA leads to improved performance over both individual methods at the group level and is the best BCI paradigm option for some subjects. This work proposes a new BCI control paradigm that integrates two existing paradigms and demonstrates its value by showing that it can improve users' BCI performance.

A motor imagery (MI) brain-computer interface (BCI) plays an important role in the neurological rehabilitation training for stroke patients. Electroencephalogram (EEG)-based MI BCI has high temporal resolution, which is convenient for real-time BCI control. Therefore, we focus on EEG-based MI BCI in this paper. The identification of MI EEG signals is always quite challenging. Due to high inter-session/subject variability, each subject should spend long and tedious calibration time in collecting amounts of labeled samples for a subject-specific model. To cope with this problem, we present a supervised selective cross-subject transfer learning (sSCSTL) approach which simultaneously makes use of the labeled samples from target and source subjects based on Riemannian tangent space. Since the covariance matrices representing the multi-channel EEG signals belong to the smooth Riemannian manifold, we perform the Riemannian alignment to make the covariance matrices from different subjects close to each other. Then, all aligned covariance matrices are converted into the Riemannian tangent space features to train a classifier in the Euclidean space. To investigate the role of unlabeled samples, we further propose semi-supervised and unsupervised versions which utilize the total samples and unlabeled samples from target subject, respectively. Sequential forward floating search (SFFS) method is executed for source selection. All our proposed algorithms transfer the labeled samples from most suitable source subjects into the feature space of target subject. Experimental results on two publicly available MI datasets demonstrated that our algorithms outperformed several state-of-the-art algorithms using small number of the labeled samples from target subject, especially for good target subjects.

Dealing with subjects who are unable to attain a proper level of performance, that is, those with brain–computer interface (BCI) illiteracy or BCI inefficients, is still a major issue in human electroencephalography (EEG) BCI systems. The most suitable approach to address this issue is to analyze the EEG signals of individual subjects independently recorded before the main BCI tasks, to evaluate their performance on these tasks. This study mainly focused on non-linear analyses and deep learning techniques to investigate the significant relationship between the intrinsic characteristics of a prior idle resting state and the subsequent BCI performance. To achieve this main objective, a public EEG motor/movement imagery dataset that constituted two individual EEG signals recorded from an idle resting state and a motor imagery BCI task was used in this study. For the EEG processing in the prior resting state, spectral analysis but also non-linear analyses, such as sample entropy, permutation entropy, and recurrent quantification analyses (RQA), were performed to obtain individual groups of EEG features to represent intrinsic EEG characteristics in the subject. For the EEG signals in the BCI tasks, four individual decoding methods, as a filter-bank common spatial pattern-based classifier and three types of convolution neural network-based classifiers, quantified the subsequent BCI performance in the subject. Statistical linear regression and ANOVA with post hoc analyses verified the significant relationship between non-linear EEG features in the prior resting state and three types of BCI performance as low-, intermediate-, and high-performance groups that were statistically discriminated by the subsequent BCI performance. As a result, we found that the frontal theta rhythm ranging from 4 to 8 Hz during the eyes open condition was highly associated with the subsequent BCI performance. The RQA findings that higher determinism and lower mean recurrent time were mainly observed in higher-performance groups indicate that more regular and stable properties in the EEG signals over the frontal regions during the prior resting state would provide a critical clue to assess an individual BCI ability in the following motor imagery task.

Objective: Brain-computer interface (BCI) spelling is a promising communication solution for people in paralysis. Currently, BCIs suffer from imperfect decoding accuracy which calls for methods to handle spelling mistakes. Detecting error-related potentials (ErrPs) has been early identified as a potential remedy. Nevertheless, few works have studied the elicitation of ErrPs during engagement with other BCI tasks, especially when BCI feedback is provided continuously. Methods: Here, we test the possibility of correcting errors during pseudo-online Motor Imagery (MI) BCI spelling through ErrPs, and investigate whether BCI feedback hinders their generation. Ten subjects performed a series of MI spelling tasks with and without observing BCI feedback. Results: The average pseudo-online ErrP detection accuracy was found to be significantly above the chance level in both conditions and did not significantly differ between the two (74% with, and 78% without feedback). Conclusions: Our results support the possibility to detect ErrPs during MI-BCI spelling and suggest the absence of any BCI feedback-related interference.

The development of brain computer interfaces (BCIs) for patient rehabilitation is a growing field of research. The BCI experimental paradigms consist mainly of selective attention BCI models and motor imagery (MI) BCIs. Selective attention models require an external stimulus (screen) but achieve high rates of classification accuracy fairly quickly. MI systems do not require external stimuli but require extensive training. The goal of our study was to gauge how much a short training paradigm requiring seven six-minute sessions of video attention would change fMRI BOLD activity between two sessions of MI ± one acquired before and another after the training protocol took place. The study used four MIs: 1) right hand 2) left hand 3) feet 4) tongue; and it was carried out on ten subjects. We found an increase of the BOLD response after training, both in amplitude and spatial extent, for the majority (6 out of 10) of subjects and MIs (all except left hand). Our results corroborate other literature results regarding the effect of training in MI based BCIs.

A novel Morse code-inspired method for multiclass motor imagery brain–computer interface (BCI) design

For individuals with high degrees of motor disability or locked-in syndrome, it is impractical or impossible to use mechanical switches to interact with electronic devices. Brain computer interfaces (BCIs) can use motor imagery to detect interaction intention from users but lack the accuracy of mechanical switches. Hence, there exists a strong need to improve the accuracy of EEG-based motor imagery BCIs attempting to implement an on/off switch. Here, we investigate how monitoring the pupil diameter of a person as a psycho-physiological parameter in addition to traditional EEG channels can improve the classification accuracy of a switch-like BCI. We have recently noticed in our lab (work not yet published) how motor imagery is associated with increases in pupil diameter when compared to a control rest condition. The pupil diameter parameter is easily accessible through video oculography since most gaze tracking systems report pupil diameter invariant to head position. We performed a user study with 30 participants using a typical EEG based motor imagery BCI. We used common spatial patterns to separate motor imagery, signaling movement intention, from a rest control condition. By monitoring the pupil diameter of the user and using this parameter as an additional feature, we show that the performance of the classifier trying to discriminate motor imagery from a control condition improves over the traditional approach using just EEG derived features. Given the limitations of EEG to construct highly robust and reliable BCIs, we postulate that multi-modal approaches, such as the one presented here that monitor several psycho-physiological parameters, can be a successful strategy in making BCIs more accurate and less vulnerable to constraints such as requirements for long training sessions or high signal to noise ratio of electrode channels.

Using neural correlates of intentionally induced human emotions may offer alternative imagery strategies to control brain-computer interface (BCI) applications. In this paper, self-induced emotions i.e., emotions induced by participants performing sad or happy related emotional imagery, are compared to motor imagery (MI) in a two-class electroencephalogram (EEG)-based BCI. The BCI setup included a multistage signal-processing framework allowing online continuous feedback presentation in a game involving one-dimensional control of game character. With seven participants, the highest online accuracies were 90% for emotion-inducing imagery (EII) and 80% for MI. Offline and online results analysis showed no significant differences in MI and EII performance. The results suggest that EII may be suitable for intentional control in BCI paradigms and offer a viable alternative for some BCI users.

Brain-Computer Interface (BCI) systems allow user to operate devices without muscular activation and experimental results indicate that they can induce activity-dependent plasticity. A BCI system has two key features: exploitation of brain signal changes induced by the cognitive task assigned to the user and mutual learning. With respect to the first feature, BCI users can learn to control and hence change their cortical activity, for example by performing a motor imagery task. Mutual learning, on the other hand, is set up between users, which have to learn how to control their brain activity, and the classifier used for learning and categorize brain signal changes. This mutual learning can be mediated by the use of feedback, which in turn can be discrete or continuous, abstract or realistic and so on. Motor imagery represents a promising approach for stroke rehabilitation, thus a BCI based on a motor imagery paradigm could be a useful tool. Nevertheless, in stroke rehabilitation settings two issues are emerging which are also crucial for motor imagery BCIs. The first one relates to the importance of recognize the imagery ability of the subject, the second one to the importance of feedback in re-learning of motor skills. The present study relates to this second issue and it is aimed at investigating attitudes of BCI users towards feedback. We considered a sample of six healthy males, using an EEG-based BCI and executing a Motor Imagery task without feedback (training phase) and with feedback (performance phase). A horizontal bar of varying length depicted on a computer screen was used as feedback medium and overall accuracy data were matched with neurophysiological data acquired from P z and O z . Results could be of importance for BCI use as neurorehabilitation tool in stroke rehabilitation protocols since they suggest that some subjects could need an increased cortical activation in order to deal with a stimulus like visual feedback. Moreover, they reveal a possible association between worsening in performance and increased cortical activation needed in order to cope with feedback.

Brain-computer interface (BCI) technology is an innovative human-computer interaction technology that does not rely on the peripheral nerve transmission pathway and muscle tissues, and establishes the connection between the human brain and the external machine. BCI system includes three categories: active, reactive and passive, with the motor imagery brain-computer interface (MI-BCI) is the most common active BCI system. MI-BCI controls external devices by imagining movements in the brain, without actually having to perform the movement. In order to bring more immersion to patients, the introduction of augmented reality (AR) technology can increase the interest of patients and improve the concentration on rehabilitation training. This study reviews the overview of BCI technology, the application of MI-BCI technology in the rehabilitation of nervous system diseases, and the limitations and prospects applications of MI-BCI technology in the rehabilitation of nervous system diseases, so as to provide reference for the application of MI-BCI technology in the diagnosis and rehabilitation of nervous system diseases. Specifically, the overview of BCI technology mainly introduces BCI technology, MI-BCI technology and AR-MI-BCI rehabilitation training system (the process and overall structure of the AR-MI-BCI rehabilitation training system). MI-BCI system has many applications in neurological diseases such as stroke, drug addiction and depression, which can not only effectively assist the diagnosis of neurological diseases, but also activate specific brain regions to promote brain function rehabilitation. MI-BCI system can identify the motor imagery intention of stroke patients and guide them to actively imagine body movements, which is helpful for active rehabilitation of patients. To address the poor generalization issues in traditional machine learning algorithms at the individual level of stroke patients, MI-BCI rehabilitation training system is built on the transfer learning technology. The rehabilitation training system based on AR-MI-BCI can assist drug users to reduce drug addiction and the difficult withdrawal of mental dependence and physical dependence caused by drug abuse, and make drug users have a connection between drugs and resistance emotion. EEG recognition scheme based on MI-BCI multi-frequency brain network can assist in the diagnosis of depression, but MI-BCI technology has some shortcomings in terms of technical development, device cost, patient privacy and clinical application.

Brain-computer interfaces (BCI) are an interesting emerging technology providing an efficient communication system between human brain and external devices like computers or neuroprosthesis. Among assorts of neuroimaging techniques, electroencephalogram (EEG) is among one of the non-invasive methods exploited mostly in BCI studies. Recent studies have shown that Motor Imagery (MI) based BCI can be used as a rehabilitation tool for patients with severe neuromuscular disabilities. The spatial and spectral information related to brain activities associated with BCI paradigms are usually pre-determined as default in EEG analysis without speculation, which can lead to loses effects in practical applications due to individual variability across different subjects. Recent studies have shown that feature combination of each specifically tailored for different physiological phenomena such as Readiness Potential (RP) and Event Related Desynchronization (ERD) might benefit BCI making it robust against artifacts. Hence, the objective is to design a CSSBP with combined feature vectors, where the signal is divided into several sub bands using a band pass filter, and this channel and frequency configurations are then modeled as preconditions before learning base learners and introducing a new heuristic of stochastic gradient boost for training the base learners under these preconditions. The effectiveness and robustness of this algorithm along with feature combination is evaluated on two different data sets recorded from distinct populations. Results showed that Boosting approach with feature combination clearly outperformed the state-of-the-art algorithms, and improved the classification performance and resulted in increased robustness. This method can also be used to explore the neurophysiological mechanism of underlying brain activities.

The objective of this study was to investigate the efficacy of an Electroencephalography (EEG)-based Motor Imagery (MI) Brain-Computer Interface (BCI) coupled with a Haptic Knob (HK) robot for arm rehabilitation in stroke patients. In this three-arm, single-blind, randomized controlled trial; 21 chronic hemiplegic stroke patients (Fugl-Meyer Motor Assessment (FMMA) score 10–50), recruited after pre-screening for MI BCI ability, were randomly allocated to BCI-HK, HK or Standard Arm Therapy (SAT) groups. All groups received 18 sessions of intervention over 6 weeks, 3 sessions per week, 90 min per session. The BCI-HK group received 1 h of BCI coupled with HK intervention, and the HK group received 1 h of HK intervention per session. Both BCI-HK and HK groups received 120 trials of robot-assisted hand grasping and knob manipulation followed by 30 min of therapist-assisted arm mobilization. The SAT group received 1.5 h of therapist-assisted arm mobilization and forearm pronation-supination movements incorporating wrist control and grasp-release functions. In all, 14 males, 7 females, mean age 54.2 years, mean stroke duration 385.1 days, with baseline FMMA score 27.0 were recruited. The primary outcome measure was upper extremity FMMA scores measured mid-intervention at week 3, end-intervention at week 6, and follow-up at weeks 12 and 24. Seven, 8 and 7 subjects underwent BCI-HK, HK and SAT interventions respectively. FMMA score improved in all groups, but no intergroup differences were found at any time points. Significantly larger motor gains were observed in the BCI-HK group compared to the SAT group at weeks 3, 12, and 24, but motor gains in the HK group did not differ from the SAT group at any time point. In conclusion, BCI-HK is effective, safe, and may have the potential for enhancing motor recovery in chronic stroke when combined with therapist-assisted arm mobilization.

One of the main problems in Brain Computer Interface (BCI) systems is the non-stationary behavior of the electroencephalography (EEG) signals causing problems in real time applications. Another common problem in BCI systems is the situation where the labeled data are scarce. In this study, we take a semi-supervised learning perspective and propose solving both types of problems by updating the BCI system with labels obtained from the outputs of the classifier. To test the approach, data from motor imagery BCI system are used. Attributes extracted from EEG signals are classified with Linear Discriminant Analysis (LDA) and Support Vector Machines (SVM). With respect to the static classifiers, accuracy was improved approximately 4% using the proposed adaptation approach in the case of a training dataset. Even though the difference between the performance of static and adaptive classifiers decreases as the size of training data increases, the accuracy of our proposed adaptive classifier remains higher. The proposed approach has also improved the performance of a BCI system around 4% in the case of non-stationary signals as well.

There is the need for enhanced processing techniques that aid the development of Brain-Computer Interfaces (BCIs), considering their wide use for communication and control. Several paradigms exist for developing BCIs. One of such is motor imagery (MI). MI-based BCIs have been implemented in a variety of ways. Key factors such as the device type, task paradigm, preprocessing, feature extraction and selection and classification techniques, must be properly considered in building BCIs. Also, factors such as the task at hand, target population, processing rate and usability of the online system must be considered. Considering this need, this review presents a summary of the existing techniques for motor imagery classification, stating common trends and challenges facing MI studies, with potential improvements that might be seen. Specifically, the review focuses on electroencephalography (EEG)-based MI BCIs, with works sampled over a wide range of time.

BackgroundThe motor imagery brain computer interface (MI-BCI) is now available in a commercial product for clinical rehabilitation. However, MI-BCI is still a relatively new technology for commercial rehabilitation application and there is limited prior work on the frequency effect. The MI-BCI has become a commercial product for clinical neurological rehabilitation, such as rehabilitation for upper limb motor dysfunction after stroke. However, the formulation of clinical rehabilitation programs for MI-BCI is lack of scientific and standardized guidance, especially limited prior work on the frequency effect. Therefore, this study aims at clarifying how frequency effects on MI-BCI training for the plasticity of the central nervous system.MethodsSixteen young healthy subjects (aged 22.94 ± 3.86 years) were enrolled in this randomized clinical trial study. Subjects were randomly assigned to a high frequency group (HF group) and low frequency group (LF group). The HF group performed MI-BCI training once per day while the LF group performed once every other day. All subjects performed 10 sessions of MI-BCI training. functional near-infrared spectroscopy (fNIRS) measurement, Wolf Motor Function Test (WMFT) and brain computer interface (BCI) performance were assessed at baseline, mid-assessment (after completion of five BCI training sessions), and post-assessment (after completion of 10 BCI training sessions).ResultsThe results from the two-way ANOVA of beta values indicated that GROUP, TIME, and GROUP × TIME interaction of the right primary sensorimotor cortex had significant main effects [GROUP: F(1,14) = 7.251, P = 0.010; TIME: F(2,13) = 3.317, P = 0.046; GROUP × TIME: F(2,13) = 5.676, P = 0.007]. The degree of activation was affected by training frequency, evaluation time point and interaction. The activation of left primary sensory motor cortex was also affected by group (frequency) (P = 0.003). Moreover, the TIME variable was only significantly different in the HF group, in which the beta value of the mid-assessment was higher than that of both the baseline assessment (P = 0.027) and post-assessment (P = 0.001), respectively. Nevertheless, there was no significant difference in the results of WMFT between HF group and LF group.ConclusionThe major results showed that more cortical activation and better BCI performance were found in the HF group relative to the LF group. Moreover, the within-group results also showed more cortical activation after five sessions of BCI training and better BCI performance after 10 sessions in the HF group, but no similar effects were found in the LF group. This pilot study provided an essential reference for the formulation of clinical programs for MI-BCI training in improvement for upper limb dysfunction.