Brain Machine Interfaces: Technology Status, Applications and the Way to the Future

Brain-Computer Interface (BCI) enables users to interact with a computer only through their brain biological signals, without the need to use muscles. BCI is an emerging research area but it is still relatively immature. However, it is important to reflect on the different aspects of the Human-Computer Interaction (HCI) area related to BCIs, considering that BCIs will be part of interactive systems in the near future. BCIs most attend not only to handicapped users, but also healthy ones, improving interaction for end-users. Virtual Reality (VR) is also an important part of interactive systems, and combined with BCI could greatly enhance user interactions, improving the user experience by using brain signals as input with immersive environments as output. This paper addresses only noninvasive BCIs, since this kind of capture is the only one to not present risk to human health. As contributions of this work we highlight the survey of interactive systems based on BCIs focusing on HCI and VR applications, and a discussion on challenges and future of this subject matter.

A new research methodology named Brain Computer Interface (BCI) studies novel human-computer interactions; by means of BCI electronics devices, paralyzed patients are able to interact with the environment using no muscular contractions. This technique provides an external electronics support to all persons with severe motor disabilities, by acquiring in continuous mode the electroencephalogram (EEG) signals and operating some processing to control a computer or other domotics devices. Patients are so allowed to control external devices or to communicate simple messages through the computer, just concentrating their attention either on codified movements or on a letter or icon on a digital keyboard. The use of a customized and optimized spatial filtering technique embedded in the BCI system, based on the detection of the Electroencephalographic activity, improves the accuracy of BCI system itself, thanks to the explicit separation of the signal activity of interest from artefact signals. In this chapter, after an overview of the state-of-the-art research on BCI systems, the spatial filtering problem in EEG signals acquisition will be illustrated. In particular, a spatial filtering algorithm, known as ICA (Independent Component Analysis) and its application will be discussed. Finally, the design and implementation of an embedded system for EEG signals acquisition and real-time processing for BCI applications will be presented. The system is based onto a very performing and reconfigurable hardware platform. Moreover ICA algorithm has been implemented for noise reduction and artifacts removal.

Brain–computer interfaces (BCIs), also known as brain–machine interfaces (BMIs), translate brain activity into new outputs that replace, restore, enhance, supplement or improve natural brain outputs. BCI research and development has grown rapidly for the past two decades. It is beginning to provide useful communication and control capacities to people with severe neuromuscular disabilities; and it is expanding into new areas such as neurorehabilitation that may greatly increase its clinical impact. At the same time, significant challenges remain, particularly in regard to translating laboratory advances into clinical use.

We present a novel approach for providing people with severe impairment the possibility of collecting feedbacks and communication prompts using a Brain Computer Interface (BCI). In particular we implemented an experimental apparatus, based on MindWave; the latter is a low cost and well known BCI device released by NeuroSky®, based on a dry single electrode and designed for enhancing Human-Computer Interaction (HCI), especially for videogames [8]. Even if BCI is an emerging research area and appears to be still relatively immature, the expected future impact on HCI is really considerable. The experimental apparatus allows users to interact with the computer only through their brain biological signals, without the need for using muscles. The BCI system is based on the Steady—State Visual Evoked Potential (SSVEP). The SSVEP is generated in presence of a repetitive visual stimuli; in our experiment two different visual stimuli are available: when the patient looks at one of the stimuli the SVVEP signal is generated and she/he can express a decision or respond to a question. Even if the experiment has been tested only on a very limited patient set, the results are extremely promising.

The possibility of an effective connection between neural tissue and computers has inspired scientists and engineers to develop new ways of controlling and obtaining information from the nervous system. These applications range from `brain hacking' to neural control of artificial limbs with brain signals. Notwithstanding the significant advances in neural prosthetics in the last few decades and the success of some stimulation devices such as cochlear prosthesis, neurotechnology remains below its potential for restoring neural function in patients with nervous system disorders. One of the reasons for this limited impact can be found at the neural interface and close attention to the integration between electrodes and tissue should improve the possibility of successful outcomes.The neural interfaces research community consists of investigators working in areas such as deep brain stimulation, functional neuromuscular/electrical stimulation, auditory prostheses, cortical prostheses, neuromodulation, microelectrode array technology, brain–computer/machine interfaces. Following the success of previous neuroprostheses and neural interfaces workshops, funding (from NIH) was obtained to establish a biennial conference in the area of neural interfaces. The first Neural Interfaces Conference took place in Cleveland, OH in 2008 and several topics from this conference have been selected for publication in this special section of the Journal of Neural Engineering. Three `perspectives' review the areas of neural regeneration (Corredor and Goldberg), cochlear implants (O'Leary et al) and neural prostheses (Anderson). Seven articles focus on various aspects of neural interfacing. One of the most popular of these areas is the field of brain–computer interfaces. Fraser et al, report on a method to generate robust control with simple signal processing algorithms of signals obtained with electrodes implanted in the brain. One problem with implanted electrode arrays, however, is that they can fail to record reliably neural signals for long periods of time. McConnell et al show that by measuring the impedance of the tissue, one can evaluate the extent of the tissue response to the presence of the electrode. Another problem with the neural interface is the mismatch of the mechanical properties between electrode and tissue. Basinger et al use finite element modeling to analyze this mismatch in retinal prostheses and guide the design of new implantable devices. Electrical stimulation has been the method of choice to activate externally the nervous system. However, Zhang et al show that a novel dual hybrid device integrating electrical and optical stimulation can provide an effective interface for simultaneous recording and stimulation. By interfacing an EMG recording system and a movement detection system, Johnson and Fuglevand develop a model capable of predicting muscle activity during movement that could be important for the development of motor prostheses. Sensory restoration is another unsolved problem in neural prostheses. By developing a novel interface between the dorsal root ganglia and electrodes arrays, Gaunt et al show that it is possible to recruit afferent fibers for sensory substitution. Finally, by interfacing directly with muscles, Jung and colleagues show that stimulation of muscles involved in locomotion following spinal cord damage in rats can provide an effective treatment modality for incomplete spinal cord injury.This series of articles clearly shows that the interface is indeed one of the keys to successful therapeutic neural devices. The next Neural Interfaces Conference will take place in Los Angeles, CA in June 2010 and one can expect to see new developments in neural engineering obtained by focusing on the neural interface.

Brain-computer interfaces (BCIs) are well-known instances of how technology can convert a user's brain activity taken from non-invasive electroencephalography (EEG) into computer commands for the purpose of computer-assisted communication and interaction. However, not all users are attaining the accuracy required to use a BCI consistently, despite advancements in technology. Accordingly, previous research suggests that human factors could be responsible for the variance in BCI performance among users. Therefore, the user's internal mental states and traits including motivation, affect or cognition, personality traits, or the user's satisfaction, beliefs or trust in the technology have been investigated. Going a step further, this manuscript aims to discuss which human factors could be potential superordinate factors that influence BCI performance, implicitly, explicitly as well as inter- and intraindividually. Based on the results of previous studies that used comparable protocols to examine the motivational, affective, cognitive state or personality traits of healthy and vulnerable EEG-BCI users within and across well-investigated BCIs (P300-BCIs or SMR-BCIs, respectively), it is proposed that the self-relevance of tasks and stimuli and the user's self-concept provide a huge potential for BCI applications. As potential key human factors self-relevance and the user's self-concept (self-referential knowledge and beliefs about one's self) guide information processing and modulate the user's motivation, attention, or feelings of ownership, agency, and autonomy. Changes in the self-relevance of tasks and stimuli as well as self-referential processing related to one's self (self-concept) trigger changes in neurophysiological activity in specific brain networks relevant to BCI. Accordingly, concrete examples will be provided to discuss how past and future research could incorporate self-relevance and the user's self-concept in the BCI setting - including paradigms, user instructions, and training sessions.

Recently research into Brain-Computer Interfacing (BCI) applications for healthy users, such as games, has been initiated. But why would a healthy person use a still-unproven technology such as BCI for game interaction? BCI provides a combination of information and features that no other input modality can offer. But for general acceptance of this technology, usability and user experience will need to be taken into account when designing such systems. Therefore, this chapter gives an overview of the state of the art of BCI in games and discusses the consequences of applying knowledge from Human-Computer Interaction (HCI) to the design of BCI for games. The integration of HCI with BCI is illustrated by research examples and showcases, intended to take this promising technology out of the lab. Future research needs to move beyond feasibility tests, to prove that BCI is also applicable in realistic, real-world settings.

The dynamic clamp technology to implement artificial membrane or synaptic conductances is one of the most successful examples of closed-loop interactions with the nervous system for observation and control purposes (for a review see [1]). We recently proposed a generalization of the dynamic clamp concept to design goal-driven closed-loop interactions with biological systems beyond electrical stimulation and recording in the context of in vitro electrophysiology and animal ethology [2]. Following the same activity-dependent stimulation approach, we designed an assisted closed-loop (ACL) to optimize the efficiency of brain-computer interfaces (BCI) based on steady state visually evoked potentials (SSVEP) [3]. SSVEP based BCIs use multiple visual stimuli such as LEDs or regions on a screen flickering at different frequencies. A subject's brain generates electrical activity at the same fundamental frequency as the visual stimulus on which the subject has focused his/her attention. The ACL consists in the delivery of online information with regard to the control over the given BCI goal both to the human subject and to the system, resulting in an online adaptation of BCI stimuli properties, in this first proof of concept study the combination of the employed flicker frequencies (Figure ​(Figure1).1). The optimization process is realized by first performing a real-time closed-loop search for the best set of stimulation frequencies to achieve the given BCI goal, which informs the system about the most effective flicker frequencies to produce SSVEPs in a given subject. Secondly, a continuous auditory feedback informs the subject about the actual distance to a predefined detection threshold. Figure 1 The assisted closed-loop (ACL) provides online information to the system about the most effective flicker frequencies and to the human subject about the actual distance to the pre-defined SSVEP detection threshold by a continuous auditory feedback (speaker ... Our results show that this shared online information leads to an enhanced BCI efficiency, as compared to classic BCI protocols, by helping them to reach the BCI goal in their interaction. The analysis also shows that the ACL protocol takes into account interindividual variabilities. In particular, baseline resting state EEG measures seem to predict subjects' BCI performances, which indicates that the ACL based BCIs might be expanded to innovative new diagnostic/therapeutic tools for clinical contexts and as new paradigms for basic research. Taking all together, these results illustrate that assisted closed-loop protocols can reveal dynamics otherwise hidden under traditional stimulation techniques, provide control of regular and pathological states, induce learning processes, bridge between distinct levels of analysis and lead to automation of experiments. The proposed approach might have a large impact for applied uses, such as computer control and biomedical or prosthetic uses, but also in novel paradigms for neuroscientific and biomedical research.

The aim of this project is to control a robot using a Brain Machine Interface (BMI). The electrophysiological signals generated from the brain are used to command different devices. The signals generated can be processed and conditioned by the BMI to perform the specific work for which they are generated. The research in BMI can naturally improve the quality of life of the disabled persons. BMI gives neural response which helps controlling a robot with one's mind. The BMI used here is NeuroSky Mindwave which is a three electrode system as compared to the previous BMI's which has a complex twenty four electrodes and is very clumsy to handle. The main advantage of the BMI used in this paper is that it uses dry electrodes over the traditional wet electrodes which makes the user very uncomfortable which decreases the accuracy of the neural response recorded.

Objective. Brain–machine interfaces (BMIs) re-establish communication channels between the nervous system and an external device. The use of BMI technology has generated significant developments in rehabilitative medicine, promising new ways to restore lost sensory-motor functions. However and despite high-caliber basic research, only a few prototypes have successfully left the laboratory and are currently home-deployed. Approach. The failure of this laboratory-to-user transfer likely relates to the absence of BMI solutions for providing naturalistic feedback about the consequences of the BMI’s actions. To overcome this limitation, nowadays cutting-edge BMI advances are guided by the principle of biomimicry; i.e. the artificial reproduction of normal neural mechanisms. Main results. Here, we focus on the importance of somatosensory feedback in BMIs devoted to reproducing movements with the goal of serving as a reference framework for future research on innovative rehabilitation procedures. First, we address the correspondence between users’ needs and BMI solutions. Then, we describe the main features of invasive and non-invasive BMIs, including their degree of biomimicry and respective advantages and drawbacks. Furthermore, we explore the prevalent approaches for providing quasi-natural sensory feedback in BMI settings. Finally, we cover special situations that can promote biomimicry and we present the future directions in basic research and clinical applications. Significance. The continued incorporation of biomimetic features into the design of BMIs will surely serve to further ameliorate the realism of BMIs, as well as tremendously improve their actuation, acceptance, and use.

In the recent years, the field of Human-Computer Interaction (HCI) has greatly evolved to involve new and exciting interaction paradigms that allow users to interact with their environment and with technology in a more intuitive and ergonomic way. These interaction paradigms include voice, touch, virtual reality, and more recently, the brain. A brain-computer interface (BCI) is a an interface system allowing users to control devices without using the normal output pathways of peripherals, instead, by using neural activity generated in the brain. BCIs have a huge potential in a multitude of fields, all the way from providing users with severe motor disabilities with means for interaction with the external world, to entertainment, gaming, user state monitoring, and self-tracking systems. The potentials of BCI have sparked the interest of researchers, gaming markets and healthcare providers more and more in the recent years. The is due to the emergence of new commercial lightweight, low cost Electroencephalograph (EEG) equipment that made it possible to create more portable and usable BCI systems and expanded their fields of application. This Master thesis aims to explore the state of the art commercial BCI as well as the uses and challenges related to them. Commercially available EEG equipment, namely the Neurosky Brainband and Neurosky Mindset, will be investigated. User tests will be carried out to investigate whether such equipment with low accuracy and low cost can be used to recognize various mental activities. This would be performed by first collecting a dataset of brain signals during performing a set of mental tasks, which is one of the contributions of this project, followed by applying a set of signal processing algorithms, then exploring various classification techniques to classify the collected signals.

Brain machine interfaces (BMIs) provide one of the important means to interact with external world for a patient who lost motor function by using brain electrical signals such as scalp electroencephalogram (EEG). The main function of BMIs is to detect, analyze and classify the modulation of EEG according to a user's intent and to decode it to demonstrate to others. Most of conventional BMIs with relatively high speed and high classification accuracy have a requisite that a user can open and move his/her eyes toward a target corresponding to user's intent and gaze at it. Locked-in patients, who have lost almost all motor function including facial muscle, cannot control the eye-movement as well as gaze. The present study aimed at developing a BMI which was independent of the eye-movement and eye-gaze as a final goal. In this paper, we discuss the feasibility of binary class of BMI available with eyes-closed condition using a recent our newly observation that the steady-state visual evoked potential (SSVEP) could be modulated by performing the mental tasks even in the eyes-close state. Temporal evolution of the modulation of SSVEP was investigated using the amplitude of SSVEP and Kullback-Leibler (KL) divergence. The amplitudes of fundamental SSVEP (10 Hz) averaged across 11 participants showed significant difference between the mental focusing task and relaxed runs from the onset of the flicker stimuli with the frequency of 10 Hz and the intensity of 5 lx, whereas those of the second harmonic SSVEP (20 Hz) gave only small difference without statistical significance. For the image recalling task, the amplitude differences between the fundamental SSVEPs in the task and relaxed conditions did not show significant difference, whereas the amplitude differences of the second harmonic SSVEP showed the main effect of the image recall task. The KL divergences for the fundamental SSVEP amplitude showed large differences at the onset of flicker stimuli and gradual decrease with time at P4 and O2 for the mental focus task, yet no such characteristic evolution was not seen in KL divergence for the second harmonic SSVEP. On the other hand, the KL divergences during the image recalling were increased with time for both the fundamental and second harmonic SSVEPs at most of the electrode sites. The classification accuracies of the proposed BMI exceeded 75 % in average across the subjects for both tasks using Fisher's linear discriminant analysis.

Research on brain–computer interfaces (BCIs) advances the way scientists understand how the human brain functions. The BCI system, which is based on the use of electroencephalography (EEG) signals to detect motor imagery (MI) tasks, enables opportunities for various applications in stroke rehabilitation, neuroprosthetic devices, and communication tools. BCIs can also be used in emotion recognition (ER) research to depict the sophistication of human emotions by improving mental health monitoring, human–computer interactions, and neuromarketing. To address the low accuracy of MI-BCI, which is a key issue faced by researchers, this study employs a new approach that has been proven to have the potential to enhance motor imagery classification accuracy. The basic idea behind the approach is to apply feature extraction methods from the field of emotion recognition to the field of motor imagery. Six feature sets and four classifiers were explored using four MI classes (left and right hands, both feet, and tongue) from the BCI Competition IV 2a dataset. Statistical, wavelet analysis, Hjorth parameters, higher-order spectra, fractal dimensions (Katz, Higuchi, and Petrosian), and a five-dimensional combination of all five feature sets were implemented. GSVM, CART, LinearSVM, and SVM with polynomial kernel classifiers were considered. Our findings show that 3D fractal dimensions predominantly outperform all other feature sets, specifically during LinearSVM classification, accomplishing nearly 79.1% mean accuracy, superior to the state-of-the-art results obtained from the referenced MI paper, where CSP reached 73.7% and Riemannian methods reached 75.5%. It even performs as well as the latest TWSB method, which also reached approximately 79.1%. These outcomes emphasize that the new hybrid approach in the motor imagery/emotion recognition field improves classification accuracy when applied to motor imagery EEG signals, thus enhancing MI-BCI performance.

Brain–computer interfaces: a powerful tool for scientific inquiry

Globally, a wide range of mental disorders continues to significantly impact people’s lives, with traditional treatment methods often falling short of providing effective and systematic solutions. Brain-computer interface (BCI) technology, one of the most rapidly advancing fields, offers promising applications across various sectors of human society, including production, healthcare, and media. By combining different BCI technologies, such as EEG monitoring and Deep Brain Stimulation, medical institutions can now offer patients a broader spectrum of effective or potential treatment options. This paper provides a comprehensive review of the current application status of various representative BCI technologies in mental health treatment. It also explores the prospect of constructing an integrated treatment system for mental disorders based on BCI technology, aiming to enhance this paper understanding of BCI applications in mental health care. The study examines how different BCI technologies can be utilized at various stages of disease progression, from early diagnosis to long-term management. Additionally, it discusses the potential of BCI in improving patient outcomes, quality of life, and social integration, while addressing ethical considerations and future research directions in this rapidly evolving field.