Combining detrended cross-correlation analysis with Riemannian geometry-based classification for improved brain-computer interface performance.

The right and left-hand motor imagery (MI) analysis based on the electroencephalogram (EEG) signal can directly link the central nervous system to a computer or a device. This study aims to identify a set of robust and nonlinear effective brain connectivity features quantified by transfer entropy (TE) to characterize the relationship between brain regions from EEG signals and create a hierarchical feature selection and classification for discrimination of right and lefthand MI tasks. TE is calculated among EEG channels as the distinctive, effective connectivity features. TE is a model-free method that can measure nonlinear effective connectivity and analyze multivariate dependent directed information flow among neural EEG channels. Then four feature subset selection methods namely relief-F, Fisher, Laplacian, and local learningbased clustering (LLCFS) algorithms are used to choose the most significant effective connectivity features and reduce redundant information. Finally, support vector machine (SVM) and linear discriminant analysis (LDA) methods are used for classification. Results show that the best performance in 29 healthy subjects and 60 trials is achieved using the TE method via the Relief-F algorithm as feature selection and support vector machine (SVM) classification with 91.02% accuracy. The TE index and a hierarchical feature selection and classification can be useful for the discrimination of right- and left-hand MI tasks from multichannel EEG signals. Effective connectivity features were extracted from electroencephalogram (EEG) to analyze relationships between regions.Four feature selection methods used to select most significant effective features.Support vector machine (SVM) used for discrimination of right and left hand motor imagery (MI) task. In this study, we investigated brain activity using effective connectivity during MI task based on EEG signals. The motor imagery task can accomplish the same goal as motor execution, since they are both activated by the same brain area. Transfer entropy, coherence, and Granger casualty were employed to extract the features. Differential patterns of activity between the left vs. right MI task showed activity around the motor area rather than other areas. In order to reduce redundant information and select the most significant effective connectivity features, four feature subset selection algorithms are used: Relief-F, Fisher, Laplacian, and learning-based clustering feature selection (LLCFS). Then, support vector machine (SVM) and linear discriminant analysis (LDA) are used to classify left and right hand MI task. Comparison of three different connectivity methods showed that TE index had the highest classification accuracy, and could be useful for the discrimination of right and left hand MI tasks from multichannel EEG signals.

Brain computer interfaces (BCIs) based on motor imagery (MI) play an important role in helping to improve and restore the loss of physical function. However, traditional MI-BCIs are limited to the motion intention of gross limb, which places many restrictions on their applications. This study proposes a hybrid paradigm based on MI and the steady-state somatosensory evoked potential, with the aim of improving the spatial resolution of MI recognition. Twelve subjects participated in this study. They performed MI tasks under MI and hybrid conditions. In the MI condition, subjects only performed MI tasks, whereas, in the hybrid condition, they received an electrical stimulus while performing the same tasks. Under the hybrid condition, subjects were required not to pay extra attention to the electrical stimulation. The MI task included imagining clenching the right hand and lifting the right forearm. The classifier was built using the filter bank common spatial pattern algorithm and a support vector machine, and online experiments were used to verify the recognition of two MI tasks. During the online experiments, all subjects were able to output different commands at a recognition accuracy far higher than the random level. The average classification accuracy of the hybrid condition reached 76.39%, with a maximum value of 88.34%, which was about 11% higher than that of the MI condition. Moreover, based on offline data, the classification performance using the event-related desynchronization (ERD) feature under the hybrid condition did not differ significantly from that under the MI condition, indicating that the introduction of electrical stimulation did not interfere in the separability of ERD. The proposed paradigm improved the efficiency of decoding multiple MI locations within a single limb. Despite the introduction of external stimuli, users could still drive the new system in the same way as MI in traditional MI-BCI.

The aim of this paper is to classify both (left and right) hand motor imagery (MI) tasks using event-related (de) synchronization (ERD/ERS) patterns based on the inter trial variance (IV). In this work, publicly available online BCI-2003 competition data set was used which contains MI based Electroencephalography (EEG) data of a single subject. The raw MI based EEG signals were extracted from C3 and C4 channels and band pass filtered to mu (8–12 Hz) frequency band. The mean, inter trial variance and ERD/ERS patterns were calculated in both the channels for both MI tasks of the subject. The patterns were used as feature vector and input to the different machine learning classifiers. The logistic regression and Naive Bayesian classifiers were used for the classification of both MI tasks of the subject. For logistic regression classifier, the accuracy, precision and sensitivity were found to be 92.40%, 92.00% and 92.00%, respectively. Meanwhile, 92.19% accuracy, 92.00% precision and 92.00% sensitivity were obtained for the Naive Bayesian classifier. The logistic regression classifier provides maximum classification accuracy (92.40%) in comparison with the existing methods (87.90–90.20%). Result shows that, the proposed method can quantify ERD/ERS patterns effectively in both the channels and also classifies both MI tasks of the subject successfully.

Objective. We proposed a novel simultaneous hybrid brain–computer interface (BCI) by incorporating electrical stimulation into a motor imagery (MI) based BCI system. The goal of this study was to enhance the overall performance of an MI-based BCI. In addition, the brain oscillatory pattern in the hybrid task was also investigated. Approach. 64-channel electroencephalographic (EEG) data were recorded during MI, selective attention (SA) and hybrid tasks in fourteen healthy subjects. In the hybrid task, subjects performed MI with electrical stimulation which was applied to bilateral median nerve on wrists simultaneously. Main results. The hybrid task clearly presented additional steady-state somatosensory evoked potential (SSSEP) induced by electrical stimulation with MI-induced event-related desynchronization (ERD). By combining ERD and SSSEP features, the performance in the hybrid task was significantly better than in both MI and SA tasks, achieving a ~14% improvement in total relative to the MI task alone and reaching ~89% in mean classification accuracy. On the contrary, there was no significant enhancement obtained in performance while separate ERD feature was utilized in the hybrid task. In terms of the hybrid task, the performance using combined feature was significantly better than using separate ERD or SSSEP feature. Significance. The results in this work validate the feasibility of our proposed approach to form a novel MI-SSSEP hybrid BCI outperforming a conventional MI-based BCI through combing MI with electrical stimulation.

Motor imagery-based brain–computer interface (MI-BCI) inefficiency phenomenon is one of the biggest challenges in MI-BCI research. BCI inefficiency subject is defined as the subject who cannot achieve classification accuracy higher than 70% since 70% is considered to be the minimum accuracy for communication by BCI. About 15–30% of the people are MI-BCI inefficiency according to the investigation. Most of the existing studies used common spatial patterns (CSP) to extract motor imagery feature and identify MI-BCI inefficiency subject based on the obtained classification accuracy. We think the MI-BCI performance maybe suppressed because CSP mainly extracts event-related desynchronization (ERD) feature, while the features generated by motor imagery are more than that. In this current work, we screened a total of 12 MI-BCI inefficiency subjects by CSP feature firstly, and recorded the motor imagery EEG data of them. Furthermore, we constructed a task-related brain network by calculating the coherence between EEG channels, the graph-based analysis showed that the node degree and clustering coefficient have intensity differences between left and right hand motor imagery. Finally, the two kinds of features were used to discriminate the two tasks. The results showed that both node degree and clustering coefficient features perform better than CSP, and the feature combination of brain network and CSP achieved higher accuracy than a single feature. In particular, a total of four subjects achieved accuracy higher than 70% by node degree and CSP features fusion. This work demonstrates that the accuracy of the MI-BCI inefficiency subject can be increased by using the brain network feature, but the accuracy gains are not high enough; it is worth to try other types of feature extraction algorithms for the MI-BCI inefficiency subject.

Motor imagery (MI) has been widely used to operate brain-computer interface (BCI) systems for rehabilitation and some life assistive devices. However, the current performance of an MI-based BCI cannot fully meet the needs of its in-field applications. Most of the BCIs utilizing a generalized feature for all participants have been found to greatly hamper the efficacy of the BCI system. Hence, some attempts have made on the exploration of subject-dependent parameters, but it remains challenging to enhance BCI performance as expected. To this end, in this study, we used the independent component analysis (ICA), which has been proved capable of isolating the pure motor-related component from non-motor-related brain processes and artifacts and extracting the common motor-related component across MI, motor execution (ME), and motor observation (MO) conditions. Then, a sliding window approach was used to detect significant mu-suppression from the baseline using the electroencephalographic (EEG) alpha power time course and, thus, the success rate of the mu-suppression detection could be assessed on a single-trial basis. By comparing the success rates using different parameters, we further quantified the extent of the improvement in each motor condition to evaluate the effectiveness of both generalized and individualized parameters. The results showed that in ME condition, the success rate under individualized latency and that under generalized latency was 90.0% and 77.75%, respectively; in MI condition, the success rate was 74.14% for individual latency and 58.47% for generalized latency, and in MO condition, the success rate was 67.89% and 61.26% for individual and generalized latency, respectively. As can be seen, the success rate in each motor condition was significantly improved by utilizing an individualized latency compared to that using the generalized latency. Moreover, the comparison of the individualized window latencies for the mu-suppression detection across different runs of the same participant as well as across different participants showed that the window latency was significantly more consistent in the intra-subject than in the inter-subject settings. As a result, we proposed that individualizing the latency for detecting the mu-suppression feature for each participant might be a promising attempt to improve the MI-based BCI performance.

A novel Morse code-inspired method for multiclass motor imagery brain–computer interface (BCI) design

Motor imagery (MI) is a cognitive process wherein an individual mentally rehearses a specific movement without physically executing it. Recently, MI-based brain-computer interface (BCI) has attracted widespread attention. However, accurate decoding of MI and understanding of neural mechanisms still face huge challenges. These seriously hinder the clinical application and development of BCI systems based on MI. Thus, it is very necessary to develop new methods to decode MI tasks. In this work, we propose a multi-branch convolutional neural network (MBCNN) with a temporal convolutional network (TCN), an end-to-end deep learning framework to decode multi-class MI tasks. We first used MBCNN to capture the MI electroencephalography signals information on temporal and spectral domains through different convolutional kernels. Then, we introduce TCN to extract more discriminative features. The within-subject cross-session strategy is used to validate the classification performance on the dataset of BCI Competition IV-2a. The results showed that we achieved 75.08% average accuracy for 4-class MI task classification, outperforming several state-of-the-art approaches. The proposed MBCNN-TCN-Net framework successfully captures discriminative features and decodes MI tasks effectively, improving the performance of MI-BCIs. Our findings could provide significant potential for improving the clinical application and development of MI-based BCI systems.

In motor imagery (MI) based brain-computer interface (BCI), common spatial pattern (CSP) is most popularly used for discriminant feature extraction. However, the performance of CSP depends on the operational frequency bands, which are selected manually or set to a broad frequency range in most of the previously developed applications. Due to subject to subject or even trial to trial variability of frequency band affected by MI task, these methods suffer from poor performance. We have proposed a novel approach, using combination of multivariate iterative filtering (MIF) and CSP (MIFCSP), to automatically select optimal frequency bands based on MIF which can be further used for discriminant feature extraction. MIF decomposes the signal into several multivariate intrinsic mode functions, from which features are extracted using CSP. We select the minimum number of most significant features for which highest classification accuracy is achieved. Subsequently, linear discriminant analysis (LDA) classifier is used to classify different MI tasks. Experimental results for BCI competition IV dataset 2a and BCI competition III-IIIa are presented. For left hand versus right hand MI classification, proposed MIFCSP method provides 83.18% and 84.44% average accuracy, respectively. Superior classification performance confirms that MIFCSP is a promising candidate for MI BCI application.

In the aging society, the number of people suffering from vascular disorders is rapidly increasing and has become a social problem. The death rate due to stroke, which is the second leading cause of global mortality, has increased by 40% in the last two decades. Stroke can also cause paralysis. Of late, brain‐computer interfaces (BCIs) have been garnering attention in the rehabilitation field as assistive technology. A BCI for the motor rehabilitation of patients with paralysis promotes neural plasticity, when subjects perform motor imagery (MI). Feedback, such as visual and proprioceptive, influences brain rhythm modulation to contribute to MI learning and motor function restoration. Also, virtual reality (VR) can provide powerful graphical options to enhance feedback visualization. This work aimed to improve immersive VR‐BCI based on hand MI, using visual‐electrotactile stimulation feedback instead of visual feedback. The MI tasks include grasping, flexion/extension, and their random combination. Moreover, the subjects answered a system perception questionnaire after the experiments. The proposed system was evaluated with twenty able‐bodied subjects. Visual‐electrotactile feedback improved the mean classification accuracy for the grasping (93.00% ± 3.50%) and flexion/extension (95.00% ± 5.27%) MI tasks. Additionally, the subjects achieved an acceptable mean classification accuracy (maximum of 86.5% ± 5.80%) for the random MI task, which required more concentration. The proprioceptive feedback maintained lower mean power spectral density in all channels and higher attention levels than those of visual feedback during the test trials for the grasping and flexion/extension MI tasks. Also, this feedback generated greater relative power in the μ‐band for the premotor cortex, which indicated better MI preparation. Thus, electrotactile stimulation along with visual feedback enhanced the immersive VR‐BCI classification accuracy by 5.5% and 4.5% for the grasping and flexion/extension MI tasks, respectively, retained the subject’s attention, and eased MI better than visual feedback alone.

Performance of motor imagery (MI)-based brain computer interfaces (BCIs) highly depends on the extraction of features from different brain neural processes. Commonly designed BCIs use band power changes in single channel electroencephalograms (EEGs) to discriminate different MI tasks. In this paper, we studied the information about interactions of spatially separated brain areas by considering the relationships between brain source signals through functional connectivity. We investigated dynamic time-frequency connectivity patterns during four motor imagery movements including left hand, right hand, both feet and tongue by means of Coherence measure estimated from multivariate adaptive autoregressive model coefficients. To tackle the volume conduction problem, sensor space signals were transformed into source space using independent component analysis technique. We showed distinct time-varying Coherence for different motor imageries. For tongue MI movement, bilateral connectivity was observed in hand areas of both hemispheres. The similar connectivity was detected for feet MI task, but with more focus on right hemisphere. During right and left hand MI, bilateral and contralateral brain connectivities were observed respectively. Results provided valuable information for possible classification of MI tasks by considering brain source functional connectivity patterns for BCIs.

Motor imagery (MI) from human brain signals can diagnose or aid specific physical activities for rehabilitation, recreation, device control, and technology assistance. It is a dynamic state in learning and practicing movement tracking when a person mentally imitates physical activity. Recently, it has been determined that a brain–computer interface (BCI) can support this kind of neurological rehabilitation or mental practice of action. In this context, MI data have been captured via non-invasive electroencephalogram (EEGs), and EEG-based BCIs are expected to become clinically and recreationally ground-breaking technology. However, determining a set of efficient and relevant features for the classification step was a challenge. In this paper, we specifically focus on feature extraction, feature selection, and classification strategies based on MI-EEG data. In an MI-based BCI domain, covariance metrics can play important roles in extracting discriminatory features from EEG datasets. To explore efficient and discriminatory features for the enhancement of MI classification, we introduced a median absolute deviation (MAD) strategy that calculates the average sample covariance matrices (SCMs) to select optimal accurate reference metrics in a tangent space mapping (TSM)-based MI-EEG. Furthermore, all data from SCM were projected using TSM according to the reference matrix that represents the featured vector. To increase performance, we reduced the dimensions and selected an optimum number of features using principal component analysis (PCA) along with an analysis of variance (ANOVA) that could classify MI tasks. Then, the selected features were used to develop linear discriminant analysis (LDA) training for classification. The benchmark datasets were considered for the evaluation and the results show that it provides better accuracy than more sophisticated methods.

Motor imagery-based brain-computer interface (MI-BCI) currently represents a new trend in rehabilitation. However, individual differences in the responsive frequency bands and a poor understanding of the communication between the ipsilesional motor areas and other regions limit the use of MI-BCI therapy. Objective: Bimanual training has recently attracted attention as it achieves better outcomes as compared to repetitive one-handed training. This study compared the effects of three MI tasks with different visual feedback. Methods: Fourteen healthy subjects performed single hand motor imagery tasks while watching single static hand (traditional MI), single hand with rotation movement (rmMI), and bimanual coordination with a hand pedal exerciser (bcMI). Functional connectivity is estimated by Transfer Entropy (TE) analysis for brain information flow. Results: Brain connectivity of conducting three MI tasks showed that the bcMI demonstrated increased communications from the parietal to the bilateral prefrontal areas and increased contralateral connections between motor-related zones and spatial processing regions. Discussion/Conclusion: The results revealed bimanual coordination operation events increased spatial information and motor planning under the motor imagery task. And the proposed bimanual coordination MI-BCI (bcMI-BCI) can also achieve the effect of traditional motor imagery tasks and promotes more effective connections with different brain regions to better integrate motor-cortex functions for aiding the development of more effective MI-BCI therapy. Clinical and Translational Impact Statement The proposed bcMI-BCI provides more effective connections with different brain areas and integrates motor-cortex functions to promote motor imagery rehabilitation for patients’ impairment.

This study underscores the reactivity of sensorimotor rhythms (SMR) in EEG such as mu rhythm in connection with the imagination and voluntary movement of left and right knee extension with able-bodied subjects using the standard Graz brain-computer interface (BCI) paradigm. As the knee motor execution (ME) and motor imagery (MI) reflect the user's voluntary physical and imagination state of knee extension respectively, they have been analyzed in order to be used as control signals to restore motor function with neuro-plasticity for BCI applications. This reactivity has been evaluated using the quantification of event-related desynchronization (ERD) and event-related synchronization (ERS) patterns. Investigations on the cortical lateralization of ERD/ERS during the left and right knee MI and ME for the extension task was done. During left and right knee MI, the foot area mu rhythm was desynchronized in all subjects, whereas no enhancement of the hand area mu rhythm was observed during any task. The frequency of the most reactive components for mu rhythm was 8.8±0.5 Hz. Interestingly a contralateral dominance was visible at a central electrode position, during left knee extension MI task. This lead to the establishment of an understanding of the left-right knee MI and its associated cognitive behavior.

BackgroundOne of the most promising applications for electroencephalogram (EEG)-based brain computer interface is for stroke rehabilitation. Implemented as a standalone motor imagery (MI) training system or as part of a rehabilitation robotic system, many studies have shown benefits of using them to restore motor control in stroke patients. Hand movements have widely been chosen as MI tasks. Although potentially more challenging to analyze, wrist and forearm movement such as wrist flexion/extension and forearm pronation/supination should also be considered for MI tasks, because these movements are part of the main exercises given to patients in conventional stroke rehabilitation. This paper will evaluate the effectiveness of such movements for MI tasks.MethodsThree hand and wrist movement tasks which were hand opening/closing, wrist flexion/extension and forearm pronation/supination were chosen as motor imagery tasks for both hands. Eleven subjects participated in the experiment. All of them completed hand opening/closing task session. Ten subjects completed two MI task sessions which were hand opening/closing and wrist flexion/extension. Five subjects completed all three MI tasks sessions. Each MI task comprised 8 sessions spanning a 4 weeks period. For classification, feature extraction based on common spatial pattern (CSP) algorithm was used. Two types were implemented, one with conventional CSP (termed WB) and one with an increase number of features achieved by filtering EEG data into five bands (termed FB). Classification was done by linear discriminant analysis (LDA) and support vector machine (SVM).ResultsEight-fold cross validation was applied on EEG data. LDA and SVM gave comparable classification accuracy. FB achieved significantly higher classification accuracy compared to WB. The accuracy of classifying wrist flexion/extension task were higher than that of classifying hand opening/closing task in all subjects. Classifying forearm pronation/supination task achieved higher accuracy than classifying hand opening/closing task in most subjects but achieved lower accuracy than classifying wrist flexion/extension task in all subjects. Significant improvements of classification accuracy were found in nine subjects when considering individual sessions of experiments of all MI tasks. The results of classifying hand opening/closing task and wrist flexion/extension task were comparable to the results of classifying hand opening/closing task and forearm pronation/supination task. Classification accuracy of wrist flexion/extension task and forearm pronation/supination task was lower than those of hand movement tasks and wrist movement tasks.ConclusionHigh classification accuracy of the three MI tasks support the possibility of using EEG-based stroke rehabilitation system with these movements. Either LDA or SVM can equally be chosen as a classifier since the difference of their accuracies is not statistically significant. Significantly higher classification accuracy made FB more suitable for classifying MI task compared to WB. More training sessions could potentially lead to better accuracy as evident in most subjects in this experiment.