An EEG-based Imagined Speech Database for comparing Paradigm Designs.

Speech impairments, resulting from brain injuries, mental disorders, or vocal abuse, substantially affect an individual’s quality of life and can lead to social isolation. Brain–Computer Interfaces (BCIs), particularly those based on EEG, offer a promising support mechanism by harnessing brain signals. Owing to their clinical efficacy, cost-effective EEG devices, and expanding applications in the medical and social spheres, their usage has surged. This study introduces an ensemble-based feature engineering mechanism to pinpoint the optimal brain rhythm, channel subset, and feature set for accurately predicting imagined words from EEG signals via machine learning models. Leveraging the 2020 International BCI competition dataset, we employed bandpass filtering, channel wrapping, and ranking methods were applied to discern suitable brain rhythms and features associated with imagined speech. Subsequent application of kernel-based principal component analysis enabled us to compress the feature space dimensionality. We then trained various machine learning models, among which the kNN model excelled, achieving an average accuracy of 73% in a 10-fold cross-validation scheme ,surpassing 18% higher than the existing literature. The Gamma rhythm was identified as the most predictive of imagined speech from EEG brain signals. These advancements herald a new era of more precise and effective BCIs, poised to significantly improve the lives of those with speech impairments.

Developing effective Brain-Computer Interfaces (BCIs) based on Imagined Speech (IS) is a significant challenge, largely due to high inter-subject variability in neural patterns. This study introduces a novel analytical framework to address this issue by integrating functional, effective, and complex network analyses with a more naturalistic sentence-level experimental protocol. Our findings confirm that while IS connectivity networks are characterized by considerable variability across individuals, our methodology successfully identifies a core set of stable pathways that persist across subjects. Specifically, we identified three principal pathways: a motor-language network in the left hemisphere driven by delta-band activity (CL→FR,CR consistent in 60% of subjects), a right-hemisphere network relayed to motor planning areas via gamma-band activity (TR→CL in 40% of subjects), and a top-down visual-spatial network involving parietal regions (POL→CR in 60% of subjects). In parallel, complex network analysis reveals the gamma frequency band to be the most functionally integrated and robust spectral signature, exhibiting significantly higher mean connectivity strength compared to all other bands (e.g., p=0.0015 vs. beta) and appearing consistently in 6/10 subjects. By distinguishing these stable neural markers from subject-specific activity, this work provides more reliable EEG-based signatures for the future development of advanced speech BCIs.

Imagined speech is a process in which a person imagines words without saying them. Electroencephalogram (EEG)-based brain–computer interface (BCI) systems help in automatically identifying imagined speech to facilitate persons with severe brain disorders. Extracting meaningful information from the raw EEG signal is a challenging task due to the nonstationary nature of EEG signals. Decomposing a signal into several sub-bands (SBs) using rational dilation wavelet transform (RADWT) requires selecting predefined factual parameters, which is an arduous task. The main objective of this study is to propose an adaptive RADWT method capable of decomposing EEG signals by adaptively selecting the tuning parameters and classifying the EEG signals into distinct categories. The optimum tuning parameters of RADWT are obtained using particle swarm optimization (PSO) and used to decompose the EEG signals into several SBs. Several statistical features are elicited from each SB and used to input six different machine learning (ML) algorithms. This work uses a 64-channel EEG dataset recorded from 15 healthy people for three categories: long words, short words, and vowels. The performance of the proposed AISR system is evaluated using seven performance evaluation metrics: accuracy, recall, precision, Cohen’s kappa, F1-score, and area under the curve. The proposed system achieved the average classification accuracies of 87.26% ± 1.12%, 89.23% ± 0.95%, 95.5% ± 0.68%, and 92.16% ± 0.83% for long words, short–long words, short words, and vowels, respectively. When compared with the existing state-of-the-art, the proposed non-parametric decomposition approach and the Bagging algorithm achieved a 3%–5% improvement. The performance of the proposed method is validated using an open-access dataset.

Brain-computer interfaces (BCIs) are well-known instances of how technology can convert a user's brain activity taken from non-invasive electroencephalography (EEG) into computer commands for the purpose of computer-assisted communication and interaction. However, not all users are attaining the accuracy required to use a BCI consistently, despite advancements in technology. Accordingly, previous research suggests that human factors could be responsible for the variance in BCI performance among users. Therefore, the user's internal mental states and traits including motivation, affect or cognition, personality traits, or the user's satisfaction, beliefs or trust in the technology have been investigated. Going a step further, this manuscript aims to discuss which human factors could be potential superordinate factors that influence BCI performance, implicitly, explicitly as well as inter- and intraindividually. Based on the results of previous studies that used comparable protocols to examine the motivational, affective, cognitive state or personality traits of healthy and vulnerable EEG-BCI users within and across well-investigated BCIs (P300-BCIs or SMR-BCIs, respectively), it is proposed that the self-relevance of tasks and stimuli and the user's self-concept provide a huge potential for BCI applications. As potential key human factors self-relevance and the user's self-concept (self-referential knowledge and beliefs about one's self) guide information processing and modulate the user's motivation, attention, or feelings of ownership, agency, and autonomy. Changes in the self-relevance of tasks and stimuli as well as self-referential processing related to one's self (self-concept) trigger changes in neurophysiological activity in specific brain networks relevant to BCI. Accordingly, concrete examples will be provided to discuss how past and future research could incorporate self-relevance and the user's self-concept in the BCI setting - including paradigms, user instructions, and training sessions.

Brain Machine Interfaces (BMIs) enable direct communication between the brain or nervous system and a machine without involving the sensory-motor system. BMIs are an embryonic technology and remarkable accomplishments have recently been reported. BMIs have a high potential and possibly an enormous impact on society, and may evoke a revolution in the way we interact with computers. If we look at the Human Factors and Ergonomics community's position in the BMI field, we do not have a meaningful track record yet. However, the thesis of this paper is that we as a community are in a good position to (1) facilitate a broadening of the focus of BMIs from therapeutic applications to general use and (2) to realise a spin-in of BMI technology to domains such as Human Computer Interaction, supporting people with special needs, and training and simulation.

Enhancing the Social Impact of Contemporary Music with Neurotechnology

A brain-computer interface technology that can decode the neural signals associated with attempted but unarticulated speech could offer a future efficient means of communication for people with severe motor impairments. Recent demonstrations have validated this approach. Here we assume that it will be possible in future to decode imagined (i.e., attempted but unarticulated) speech in people with severe motor impairments, and we consider the characteristics that could maximize the social utility of a BCI for communication. As a social interaction, communication involves the needs and goals of both speaker and listener, particularly in contexts that have significant potential consequences. We explore three high-consequence legal situations in which neurally-decoded speech could have implications: Testimony, where decoded speech is used as evidence; Consent and Capacity, where it may be used as a means of agency and participation such as consent to medical treatment; and Harm, where such communications may be networked or may cause harm to others. We then illustrate how design choices might impact the social and legal acceptability of these technologies.

Amyotrophic Lateral Sclerosis (ALS) is a neurodegenerative disease that causes progressive loss of voluntary movement, including the ability to speak. As the disease rapidly progresses, there is a need for augmented and alternative communication that removes physical barriers required for engagement. Brain-Computer Interfaces (BCI) are a technology that allow for communication using only brain signals in response to visual stimuli. This project aimed to design an accessible and practical BCI for continuous, at-home use, and to increase BCI usability by using familiar facial stimuli to elicit a stronger brain response. The overall goal for enhancement of BCI usability is to maximize ease of use for individuals with ALS and their caregivers so that BCI technologies can make a useful impact and improve the everyday lives of people with ALS. In this project, a new miniaturized and low-cost P300 BCI system was designed using wireless and battery-operated EEG neuroimaging, modular software, and the use of an individualized BCI presentation stimuli. A 3-dimensional virtual environment platform was integrated as a navigational control output mechanism that executes commands received from the BCI to move a user's avatar in a virtual maze. Together, these form the virtual environment BCI (veBCI). The BCI stimuli presentation consisted of a custom approach of integrating different human face images with the aim of increasing user engagement and elicited brain activity, and therefore improving BCI online accuracy. The impact and effectiveness of the approach was tested via a verification BCI study in which 6 different stimuli conditions were utilized: male celebrity face, female celebrity face, male stranger face, female stranger face, a family member/close friend of the participant, and blank/no face as a control. A total of 16 volunteers (average age 56.5 and eight diagnosed with ALS) used the BCI system with all 6 face conditions in ecologically valid settings. Results indicate that this new miniaturized BCI is usable for both people with ALS and healthy controls. Significant differences existed in the amplitude of the P300 response in ALS and healthy controls. Additionally, differences between male and female participants demonstrated the potential role of personalization to optimize the visually evoked potential response and further increase BCI online accuracy. In conclusion, a home-use P300 BCI system was developed with a new generation of miniaturized, low-cost, and mobile neuroimaging running on an embedded computational platform. BCI stimuli with human face inclusion could help personalization of the BCI. Furthermore, virtual environments provide unique new ways to implement BCI output beyond typical spelling tasks and communication. Future work could focus on developing dedicated online signal processing to eliminate noise and improve online accuracy during home use.

A brain–computer interface (BCI) provides a method of generating interaction between the human brain and a computational system, that is, a computer. In short, communicating with a computer directly using brain signals, without any muscles, is what concerns the field of BCI. Initially, BCI was developed for communication with patient diagnosis with neuromuscular disorder. Due to the recent development of BCI devices – such as artificial electrodes, wireless headsets, flexible software – it is being used to improve interaction between computational system and the general community. Recording of brain responses is performed by BCI device using different non-invasive and invasive techniques such as magnetic resonance imaging, electrocorticography, magnetoencephalography, and electroencephalography. Focusing on the recent developments of BCI, the paper contains a rigorous review of recent BCI systems mentioning its issues and challenges. The review work is performed focusing on five key points: objective of the development, methodology used, dataset used for experiment, BCI setup and software used, and finally the outcome of the development. The comprehensive survey of BCI gives a future direction of research focusing on eliminating the drawbacks and developing advanced BCI technologies.

Several attempts for speech brain–computer interfacing (BCI) have been made to decode phonemes, sub-words, words, or sentences using invasive measurements, such as the electrocorticogram (ECoG), during auditory speech perception, overt speech, or imagined (covert) speech. Decoding sentences from covert speech is a challenging task. Sixteen epilepsy patients with intracranially implanted electrodes participated in this study, and ECoGs were recorded during overt speech and covert speech of eight Japanese sentences, each consisting of three tokens. In particular, Transformer neural network model was applied to decode text sentences from covert speech, which was trained using ECoGs obtained during overt speech. We first examined the proposed Transformer model using the same task for training and testing, and then evaluated the model’s performance when trained with overt task for decoding covert speech. The Transformer model trained on covert speech achieved an average token error rate (TER) of 46.6% for decoding covert speech, whereas the model trained on overt speech achieved a TER of 46.3% (p>0.05;d=0.07)\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$( p > 0.05; d=0.07)$$\\end{document}. Therefore, the challenge of collecting training data for covert speech can be addressed using overt speech. The performance of covert speech can improve by employing several overt speeches.

Brain–computer interfaces (BCIs), also known as brain–machine interfaces (BMIs), translate brain activity into new outputs that replace, restore, enhance, supplement or improve natural brain outputs. BCI research and development has grown rapidly for the past two decades. It is beginning to provide useful communication and control capacities to people with severe neuromuscular disabilities; and it is expanding into new areas such as neurorehabilitation that may greatly increase its clinical impact. At the same time, significant challenges remain, particularly in regard to translating laboratory advances into clinical use.

Implantable brain-computer interfaces (BCIs) are being developed to restore speech capacity for those who are unable to speak. Patients with locked-in syndrome or amyotrophic lateral sclerosis could be able to use covert speech – vividly imagining saying something without actual vocalisation – to trigger neural controlled systems capable of synthesising speech. User control has been identified as particularly pressing for this type of BCI. The incorporation of machine learning and statistical language models into the decoding process introduces a contribution to (or ‘shaping of’) the output that is beyond the user’s control. Whilst this type of ‘shared control’ of BCI action is not unique to speech BCIs, the automated shaping of what a user ‘says’ has a particularly acute ethical dimension, which may differ from parallel concerns surrounding automation in movement BCIs. This paper provides an analysis of the control afforded to the user of a speech BCI of the sort under development, as well as the relationships between accuracy, control, and the user’s ownership of the speech produced. Through comparing speech BCIs with BCIs for movement, we argue that, whilst goal selection is the more significant locus of control for the user of a movement BCI, control over process will be more significant for the user of the speech BCI. The design of the speech BCI may therefore have to trade off some possible efficiency gains afforded by automation in order to preserve sufficient guidance control necessary for users to express themselves in ways they prefer. We consider the implications for the speech BCI user’s responsibility for produced outputs and their ownership of token outputs. We argue that these are distinct assessments. Ownership of synthetic speech concerns whether the content of the output sufficiently represents the user, rather than their morally relevant, causal role in producing that output.

Active Brain Computer Interfaces (BCIs) allow people to exert voluntary control over a computer system: brain signals are captured and imagined actions (movements, concepts) are recognized after a training phase (from 10 min to 2 months). BCIs are confined in labs, with only a few dozen people using them outside regularly (e.g. assistance for impairments). We propose a “Co-learning BCI” (CLBCI) that reduces the amount of training and makes BCIs more suitable for recreational applications. We replicate an existing experiment where the BCI controls a drone and compare CLBCI to their Operant Conditioning (OC) protocol over three durations of practice (1 day, 1 week, 1 month). We find that OC works at 80 % after a month practice, but the performance is between 60 and 70 % any earlier. In a week of practice, CLBCI reaches a performance of around 75 %. We conclude that CLBCI is better suited for recreational use. OC should be reserved for users for whom performance is the main concern.

A brain-computer interface (BCI) is a system that enables control of devices or communication with other persons, only through cerebral activity, without using muscles. The main application for BCIs is assistive technology for disabled persons. Examples for devices that can be controlled by BCIs are artificial limbs, spelling devices, or environment control systems. BCI research has seen renewed interest in recent years, and it has been convincingly shown that communication via a BCI is in principle feasible. However, present day systems still have shortcomings that prevent their widespread application. In part, these shortcomings are caused by limitations in the functionality of the pattern recognition algorithms used for discriminating brain signals in BCIs. Moreover, BCIs are often tested exclusively with able-bodied persons instead of conducting tests with the target user group, namely disabled persons. The goal of this thesis is to extend the functionality of pattern recognition algorithms for BCI systems and to move towards systems that are helpful for disabled users. We discuss extensions of linear discriminant analysis (LDA), which is a simple but efficient method for pattern recognition. In particular, a framework from Bayesian machine learning, the so-called evidence framework, is applied to LDA. An algorithm is obtained that learns classifiers quickly, robustly, and fully automatically. An extension of this algorithm allows to automatically reduce the number of sensors needed for acquisition of brain signals. More specifically, the algorithm allows to perform electrode selection. The algorithm for electrode selection is based on a concept known as automatic relevance determination (ARD) in Bayesian machine learning. The last part of the algorithmic development in this thesis concerns methods for computing accurate estimates of class probabilities in LDA-like classifiers. These probabilities are used to build a BCI that dynamically adapts the amount of acquired data, so that a preset, approximate bound on the probability of misclassifications is not exceeded. To test the algorithms described in this thesis, a BCI specifically tailored for disabled persons is introduced. The system uses electroencephalogram (EEG) signals and is based on the P300 evoked potential. Datasets recorded from five disabled and four able-bodied subjects are used to show that the Bayesian version of LDA outperforms plain LDA in terms of classification accuracy. Also, the impact of different static electrode configurations on classification accuracy is tested. In addition, experiments with the same datasets demonstrate that the algorithm for electrode selection is computationally efficient, yields physiologically plausible results, and improves classification accuracy over static electrode configurations. The classification accuracy is further improved by dynamically adapting the amount of acquired data. Besides the datasets recorded from disabled and able-bodied subjects, benchmark datasets from BCI competitions are used to show that the algorithms discussed in this thesis are competitive with state-of-the-art electroencephalogram (EEG) classification algorithms. While the experiments in this thesis are uniquely performed with P300 datasets, the presented algorithms might also be useful for other types of BCI systems based on the EEG. This is the case because functionalities such as robust and automatic computation of classifiers, electrode selection, and estimation of class probabilities are useful in many BCI systems. Seen from a more general point of view, many applications that rely on the classification of cerebral activity could possibly benefit from the methods developed in this thesis. Among the potential applications are interrogative polygraphy ("lie detection") and clinical applications, for example coma outcome prognosis and depth of anesthesia monitoring.

We present a novel integration of a brain-computer interface (BCI) with a multi-touch surface. BCIs based on the P300 paradigm often use a visual stimulus of a flashing character to elicit an event related potential in the brain's EEG signal. Traditionally, P300-based BCI paradigms use a grid layout of visual targets, commonly an alphabet, and allow users to select targets using their thoughts. In our new system a multi-touch table senses objects placed upon its surface and the system can highlight the objects on the table by flashing an area of light around them. This allows us to construct a P300-based BCI that uses a user-assembled collection of objects as targets, rather than a pre-determined grid layout. An experiment shows that our new paradigm works just as well as the traditional paradigms, thus highlighting the potential for BCIs to be integrated in a broader range of situations.