Towards Brain Computer Interfaces for Recreational Activities: Piloting a Drone

Brain-Computer Interface (BCI) systems allow user to operate devices without muscular activation and experimental results indicate that they can induce activity-dependent plasticity. A BCI system has two key features: exploitation of brain signal changes induced by the cognitive task assigned to the user and mutual learning. With respect to the first feature, BCI users can learn to control and hence change their cortical activity, for example by performing a motor imagery task. Mutual learning, on the other hand, is set up between users, which have to learn how to control their brain activity, and the classifier used for learning and categorize brain signal changes. This mutual learning can be mediated by the use of feedback, which in turn can be discrete or continuous, abstract or realistic and so on. Motor imagery represents a promising approach for stroke rehabilitation, thus a BCI based on a motor imagery paradigm could be a useful tool. Nevertheless, in stroke rehabilitation settings two issues are emerging which are also crucial for motor imagery BCIs. The first one relates to the importance of recognize the imagery ability of the subject, the second one to the importance of feedback in re-learning of motor skills. The present study relates to this second issue and it is aimed at investigating attitudes of BCI users towards feedback. We considered a sample of six healthy males, using an EEG-based BCI and executing a Motor Imagery task without feedback (training phase) and with feedback (performance phase). A horizontal bar of varying length depicted on a computer screen was used as feedback medium and overall accuracy data were matched with neurophysiological data acquired from P z and O z . Results could be of importance for BCI use as neurorehabilitation tool in stroke rehabilitation protocols since they suggest that some subjects could need an increased cortical activation in order to deal with a stimulus like visual feedback. Moreover, they reveal a possible association between worsening in performance and increased cortical activation needed in order to cope with feedback.

Enhancing the Social Impact of Contemporary Music with Neurotechnology

Amyotrophic Lateral Sclerosis (ALS) is a neurodegenerative disease that causes progressive loss of voluntary movement, including the ability to speak. As the disease rapidly progresses, there is a need for augmented and alternative communication that removes physical barriers required for engagement. Brain-Computer Interfaces (BCI) are a technology that allow for communication using only brain signals in response to visual stimuli. This project aimed to design an accessible and practical BCI for continuous, at-home use, and to increase BCI usability by using familiar facial stimuli to elicit a stronger brain response. The overall goal for enhancement of BCI usability is to maximize ease of use for individuals with ALS and their caregivers so that BCI technologies can make a useful impact and improve the everyday lives of people with ALS. In this project, a new miniaturized and low-cost P300 BCI system was designed using wireless and battery-operated EEG neuroimaging, modular software, and the use of an individualized BCI presentation stimuli. A 3-dimensional virtual environment platform was integrated as a navigational control output mechanism that executes commands received from the BCI to move a user's avatar in a virtual maze. Together, these form the virtual environment BCI (veBCI). The BCI stimuli presentation consisted of a custom approach of integrating different human face images with the aim of increasing user engagement and elicited brain activity, and therefore improving BCI online accuracy. The impact and effectiveness of the approach was tested via a verification BCI study in which 6 different stimuli conditions were utilized: male celebrity face, female celebrity face, male stranger face, female stranger face, a family member/close friend of the participant, and blank/no face as a control. A total of 16 volunteers (average age 56.5 and eight diagnosed with ALS) used the BCI system with all 6 face conditions in ecologically valid settings. Results indicate that this new miniaturized BCI is usable for both people with ALS and healthy controls. Significant differences existed in the amplitude of the P300 response in ALS and healthy controls. Additionally, differences between male and female participants demonstrated the potential role of personalization to optimize the visually evoked potential response and further increase BCI online accuracy. In conclusion, a home-use P300 BCI system was developed with a new generation of miniaturized, low-cost, and mobile neuroimaging running on an embedded computational platform. BCI stimuli with human face inclusion could help personalization of the BCI. Furthermore, virtual environments provide unique new ways to implement BCI output beyond typical spelling tasks and communication. Future work could focus on developing dedicated online signal processing to eliminate noise and improve online accuracy during home use.

A brain–computer interface (BCI) provides a method of generating interaction between the human brain and a computational system, that is, a computer. In short, communicating with a computer directly using brain signals, without any muscles, is what concerns the field of BCI. Initially, BCI was developed for communication with patient diagnosis with neuromuscular disorder. Due to the recent development of BCI devices – such as artificial electrodes, wireless headsets, flexible software – it is being used to improve interaction between computational system and the general community. Recording of brain responses is performed by BCI device using different non-invasive and invasive techniques such as magnetic resonance imaging, electrocorticography, magnetoencephalography, and electroencephalography. Focusing on the recent developments of BCI, the paper contains a rigorous review of recent BCI systems mentioning its issues and challenges. The review work is performed focusing on five key points: objective of the development, methodology used, dataset used for experiment, BCI setup and software used, and finally the outcome of the development. The comprehensive survey of BCI gives a future direction of research focusing on eliminating the drawbacks and developing advanced BCI technologies.

Brain–computer interfaces (BCIs), also known as brain–machine interfaces (BMIs), translate brain activity into new outputs that replace, restore, enhance, supplement or improve natural brain outputs. BCI research and development has grown rapidly for the past two decades. It is beginning to provide useful communication and control capacities to people with severe neuromuscular disabilities; and it is expanding into new areas such as neurorehabilitation that may greatly increase its clinical impact. At the same time, significant challenges remain, particularly in regard to translating laboratory advances into clinical use.

Brain-computer interfaces (BCIs) enable control of computers and other assistive devices, such as neuro-prostheses, which are used for communication, movement restoration, neuro-modulation, and muscle stimulation, by using only signals measured directly from the brain. A BCI creates a new output channel for the brain to a computer or a device. This requires retrieval of signals of interest from the brain, and its use for neuro-rehabilitation by means of interfacing the signals to a computerized device. Brain signals such as action potentials from single neurons or nerve fibers, extracellular local field potentials (LFPs), electrocorticograms, electroencephalogram and its components such as the event-related brain potentials, real-time functional magnetic resonance imaging, near-infrared spectroscopy, and magneto-encephalogram have been used. BCIs are envisaged to be useful for communication, control and self-regulation of brain function. BCIs employ neurofeedback to enable operant conditioning to allow the user to learn using it. Paralytic conditions arising from stroke or other diseases are being targeted for BCI application. Neurofeedback strategies ranging from sensory feedback to direct brain stimulation are being employed. Existing BCIs are limited in their throughput in terms of letters per minute or commands per minute, and need extensive training to use the BCI. Further, they can cause rapid fatigue due to use and have limited adaptability to changes in the patient's brain state. The challenge before BCI technology for neuro-rehabilitation today is to enable effective clinical use of BCIs with minimal effort to set up and operate.

A brain-computer interface (BCI) is a system that enables control of devices or communication with other persons, only through cerebral activity, without using muscles. The main application for BCIs is assistive technology for disabled persons. Examples for devices that can be controlled by BCIs are artificial limbs, spelling devices, or environment control systems. BCI research has seen renewed interest in recent years, and it has been convincingly shown that communication via a BCI is in principle feasible. However, present day systems still have shortcomings that prevent their widespread application. In part, these shortcomings are caused by limitations in the functionality of the pattern recognition algorithms used for discriminating brain signals in BCIs. Moreover, BCIs are often tested exclusively with able-bodied persons instead of conducting tests with the target user group, namely disabled persons. The goal of this thesis is to extend the functionality of pattern recognition algorithms for BCI systems and to move towards systems that are helpful for disabled users. We discuss extensions of linear discriminant analysis (LDA), which is a simple but efficient method for pattern recognition. In particular, a framework from Bayesian machine learning, the so-called evidence framework, is applied to LDA. An algorithm is obtained that learns classifiers quickly, robustly, and fully automatically. An extension of this algorithm allows to automatically reduce the number of sensors needed for acquisition of brain signals. More specifically, the algorithm allows to perform electrode selection. The algorithm for electrode selection is based on a concept known as automatic relevance determination (ARD) in Bayesian machine learning. The last part of the algorithmic development in this thesis concerns methods for computing accurate estimates of class probabilities in LDA-like classifiers. These probabilities are used to build a BCI that dynamically adapts the amount of acquired data, so that a preset, approximate bound on the probability of misclassifications is not exceeded. To test the algorithms described in this thesis, a BCI specifically tailored for disabled persons is introduced. The system uses electroencephalogram (EEG) signals and is based on the P300 evoked potential. Datasets recorded from five disabled and four able-bodied subjects are used to show that the Bayesian version of LDA outperforms plain LDA in terms of classification accuracy. Also, the impact of different static electrode configurations on classification accuracy is tested. In addition, experiments with the same datasets demonstrate that the algorithm for electrode selection is computationally efficient, yields physiologically plausible results, and improves classification accuracy over static electrode configurations. The classification accuracy is further improved by dynamically adapting the amount of acquired data. Besides the datasets recorded from disabled and able-bodied subjects, benchmark datasets from BCI competitions are used to show that the algorithms discussed in this thesis are competitive with state-of-the-art electroencephalogram (EEG) classification algorithms. While the experiments in this thesis are uniquely performed with P300 datasets, the presented algorithms might also be useful for other types of BCI systems based on the EEG. This is the case because functionalities such as robust and automatic computation of classifiers, electrode selection, and estimation of class probabilities are useful in many BCI systems. Seen from a more general point of view, many applications that rely on the classification of cerebral activity could possibly benefit from the methods developed in this thesis. Among the potential applications are interrogative polygraphy ("lie detection") and clinical applications, for example coma outcome prognosis and depth of anesthesia monitoring.

Brain Computer Interfacing (BCI) allows user to control certain devices or objects using human brain. With the availability of various sensors, it is possible to obtain the data from the human brain which controls the physical activities in the brain itself. BCI users can access a system capable of communicating efficiently in a special manner that works based on the brain signals. BCI gives a better platform for physically challenged people to do certain significant functions in their daily routine. The use of brain imaging technologies in BCI helps to enhance the signal quality during the communication among the machines and the human beings. The paper describes some of the research works carried on BCI and its advancements to perform a better communication between the computers and the human brain, by using emerging technologies. This paper also covers the applications, challenges, and future directions of BCI.

Decoding brain activity for brain computer interfaces (BCI) is a challenging machine learning task. Many BCIs are designed in a synchronous setting, which allows to output a command from the brain to the computer at pre-determined, specific time points. The task becomes substantially more demanding when designing asynchronous BCIs, which allow control over the interface at any given time. Most BCIs use static classifiers, in which the readout is driven only by the current input. However, due to the complex nature of ongoing brain activity, dynamic classifiers, which capture the temporal dynamics of the input signal, are likely to be more suitable for the task. To examine this notion, we designed a classification framework based on Echo State Networks (ESNs), which have demonstrated strong performance in similar tasks in other domains. We evaluated the performance of this approach on pre-recorded EEG data of an asynchronous motor imagery (MI) BCI task, and compared our approach to a conventional method. ESN-based architectures exhibited superior performance in comparison. Our findings suggest that ESNs may prove useful in other BCI paradigms in virtue of their ability to reduce the detrimental effect of non-stationarity in brain signals.

The possibility of an effective connection between neural tissue and computers has inspired scientists and engineers to develop new ways of controlling and obtaining information from the nervous system. These applications range from `brain hacking' to neural control of artificial limbs with brain signals. Notwithstanding the significant advances in neural prosthetics in the last few decades and the success of some stimulation devices such as cochlear prosthesis, neurotechnology remains below its potential for restoring neural function in patients with nervous system disorders. One of the reasons for this limited impact can be found at the neural interface and close attention to the integration between electrodes and tissue should improve the possibility of successful outcomes.The neural interfaces research community consists of investigators working in areas such as deep brain stimulation, functional neuromuscular/electrical stimulation, auditory prostheses, cortical prostheses, neuromodulation, microelectrode array technology, brain–computer/machine interfaces. Following the success of previous neuroprostheses and neural interfaces workshops, funding (from NIH) was obtained to establish a biennial conference in the area of neural interfaces. The first Neural Interfaces Conference took place in Cleveland, OH in 2008 and several topics from this conference have been selected for publication in this special section of the Journal of Neural Engineering. Three `perspectives' review the areas of neural regeneration (Corredor and Goldberg), cochlear implants (O'Leary et al) and neural prostheses (Anderson). Seven articles focus on various aspects of neural interfacing. One of the most popular of these areas is the field of brain–computer interfaces. Fraser et al, report on a method to generate robust control with simple signal processing algorithms of signals obtained with electrodes implanted in the brain. One problem with implanted electrode arrays, however, is that they can fail to record reliably neural signals for long periods of time. McConnell et al show that by measuring the impedance of the tissue, one can evaluate the extent of the tissue response to the presence of the electrode. Another problem with the neural interface is the mismatch of the mechanical properties between electrode and tissue. Basinger et al use finite element modeling to analyze this mismatch in retinal prostheses and guide the design of new implantable devices. Electrical stimulation has been the method of choice to activate externally the nervous system. However, Zhang et al show that a novel dual hybrid device integrating electrical and optical stimulation can provide an effective interface for simultaneous recording and stimulation. By interfacing an EMG recording system and a movement detection system, Johnson and Fuglevand develop a model capable of predicting muscle activity during movement that could be important for the development of motor prostheses. Sensory restoration is another unsolved problem in neural prostheses. By developing a novel interface between the dorsal root ganglia and electrodes arrays, Gaunt et al show that it is possible to recruit afferent fibers for sensory substitution. Finally, by interfacing directly with muscles, Jung and colleagues show that stimulation of muscles involved in locomotion following spinal cord damage in rats can provide an effective treatment modality for incomplete spinal cord injury.This series of articles clearly shows that the interface is indeed one of the keys to successful therapeutic neural devices. The next Neural Interfaces Conference will take place in Los Angeles, CA in June 2010 and one can expect to see new developments in neural engineering obtained by focusing on the neural interface.

EMG and EOG artifacts in brain computer interface systems: A survey

The modern commercial industry is increasingly dependent on the analysis of vast data records. Analysing big electroencephalogram (EEG) signal data (called brain signal data) plays an important role in a wide variety of applications such as healthcare practices, brain computer interface (BCI) systems, innovative education, privacy and security, and biometrics. The key objective of this paper is to establish a methodological framework for identifying communicative intentions of motor disabled people from EEG data for application in BCI systems. The proposed framework is designed based on common spatial pattern (CSP) data method and optimized ensemble (OE) machine learning method for the application of BCI technologies. The CSP method is used for discovering important features from EEG data and finally the extracted features are fed as an input to optimized ensemble (OE) method. The proposed method was tested on BCI Competition III dataset IVa, which contains motor imagery-based EEG signal data. The experimental results show that our proposed method can handle brain signal big data for identifying communicative intentions for an advanced BCI system. We compared the performance of our proposed method with several other existing methods. In comparison with other established methods, our method achieves higher classification accuracy performance. This research assists the experts in processing and analysing EEG signals for BCI applications. It also supports technologists to create a new EEG data analyser for BCI systems.KeywordsElectroencephalographyBrain computer interfaceCommon spatial patternMachine learning

Brain-Computer Interface: Current and Emerging Rehabilitation Applications

Brain-Computer Interface (BCI) enables users to interact with a computer only through their brain biological signals, without the need to use muscles. BCI is an emerging research area but it is still relatively immature. However, it is important to reflect on the different aspects of the Human-Computer Interaction (HCI) area related to BCIs, considering that BCIs will be part of interactive systems in the near future. BCIs most attend not only to handicapped users, but also healthy ones, improving interaction for end-users. Virtual Reality (VR) is also an important part of interactive systems, and combined with BCI could greatly enhance user interactions, improving the user experience by using brain signals as input with immersive environments as output. This paper addresses only noninvasive BCIs, since this kind of capture is the only one to not present risk to human health. As contributions of this work we highlight the survey of interactive systems based on BCIs focusing on HCI and VR applications, and a discussion on challenges and future of this subject matter.

Event Abstract Back to Event Analysis and classification of EEG signals for brain computer interfaces Ugur Halici1*, E. Agi1, C. Özgen1 and I. Ulusoy1 1 Computer Vision and Intelligent Systems Research Laboratory, Middle East Technical University, Turkey Brain Computer Interfaces (BCIs) are systems developed in order to control devices by using only brain signals. Depending on the application, the device to be controlled might be a neuroprothesis, a wheel-chair or a computer. In BCI systems, different mental activities to be performed by the users are associated with different actions on the device to be controlled. The neurophysiologic brain signals produced as results of these mental activities are collected by a data acquisition device and converted to digital form. Electroencephalogram (EEG) is the most common technique employed for data acquisition in BCI systems today, due to its time-space resolution, its price and its easiness in use when compared to the other acquisition techniques. The digital brain signals collected are processed for feature extraction and then classified in order to decide on the associated action. A control signal produced according to the decision is used to change the state of the device to be controlled. Providing a feedback signal informing the user about the new state of the controlled device completes the BCI cycle. The early BCI systems were designed to work on pre-defined neurophysiologic features, where a feedback produced by a fixed set-up was provided to the system users. In these early BCI systems, the users should learn by themselves how to produce neurophysiologic signals in order to control the system. In several studies, it is reported that weeks, even months may be needed in order the user to learn how to produce these signals by adaptation of their brain. Recently, BCI systems in which machine learning algorithms employed for adapting the BCI system by using user specific signals are started to emerge. In several studies, it is shown that the adaptation of the BCI systems in this way reduces drastically the time required the user to able to produce appropriate signals and adaptation time in terms of days, even minutes are reported [1-4] The aim of this study is to analyze EEG signals collected for BCI purposes by using techniques Principal Component Analysis, Fisher Linear Discriminant Analysis, and Independent Component Analysis in order to reduce the dimension of the feature vectors obtained by sampling EEG signals in an representative manner and then classify the low dimension feature vectors obtained in this way by using Neural Networks and Support Vector Machines, which are able to learn through samples. The experimental studies are still going on for feature extraction and classification. The experimental results obtained will be presented in the final paper for comparison purposes.