Android based EEG speller for the disabled

Brain–computer interfaces (BCIs) based on steady-state visually evoked potentials (SSVEPs) have been well researched due to their easy system configuration, little or no user training and high information transfer rates. To elicit an SSVEP, a repetitive visual stimulus (RVS) is presented to the user. The properties of this RVS (e.g., frequency, luminance) have a significant influence on the BCI performance and user comfort. Several studies in this area in the last one-and-half decades have focused on evaluating different stimulus parameters (i.e., properties). However, there is little research on the synthesis of the existing studies, as the last review on the subject was published in 2010. Consequently, we conducted a scoping review of related studies on the influence of stimulus parameters on SSVEP response and user comfort, analyzed them and summarized the findings considering the physiological and neurological processes associated with BCI performance. In the review, we found that stimulus type, frequency, color contrast, luminance contrast and size/shape of the retinal image are the most important stimulus properties that influence SSVEP response. Regarding stimulus type, frequency and luminance, there is a trade-off between the best SSVEP response quality and visual comfort. Finally, since there is no unified measuring method for visual comfort and a lack of differentiation in the high-frequency band, we proposed a measuring method and a division of the band. In summary, the review highlights which stimulus properties are important to consider when designing SSVEP BCIs. It can be used as a reference point for future research in BCI, as it will help researchers to optimize the design of their SSVEP stimuli.

Brain Computer Interface (BCI) is useful as an interface to operate a computer and external equipment using brain activities. A Steady-State Visual Evoked Potential (SSVEP) is known as the powerful tool to achieve BCI systems. A user of BCI focuses on the visual stimulus which produces brain activities used as an input of BCI. On the other hand, the user needs to pay own attention to surrounding situation for avoiding accidents. This means that the user should turn own attention to both the environment and the visual stimulus. The practical SSVEP based BCI often places visual stimuli around a fixation point which displays the surrounding situation captured by a camera. In addition, the visual stimulus equipped with moving vehicles has a slight movement due to our body movement and vehicle movement. This fact shows that the visual stimulus is moving at the side of user's vision. However, the relation of a SSVEP and a place and moving of visual stimulus has not been discussed. In this paper, we measure and analyze SSVEP for visual stimulus located on the surrounding area of fixation point, and a moving visual stimulus.

Previous studies have shown that the brain network topology correlates with the cognitive function. However, few studies have investigated the relationship between functional brain networks that process sensory inputs and outputs. In this study, we focus on steady-state paradigms using a periodic visual stimulus, which are increasingly being used in both brain-computer interface (BCI) and cognitive neuroscience researches. Using the graph theoretical analysis, we investigated the relationship between the topology of functional networks entrained by periodic stimuli and steady state visually evoked potentials (SSVEP) using two frequencies and eleven subjects. First, the entire functional network (Network 0) of each frequency for each subject was constructed according to the coherence between electrode pairs. Next, Network 0 was divided into three sub-networks, in which the connection strengths were either significantly (positively for Network 1, negatively for Network 3) or non-significantly (Network 2) correlated with the SSVEP responses. Our results revealed that the SSVEP responses were positively correlated to the mean functional connectivity, clustering coefficient, and global and local efficiencies, while these responses were negatively correlated with the characteristic path length of Networks 0, 1 and 2. Furthermore, the strengths of these connections that significantly correlated with the SSVEP (both positively and negatively) were mainly found to be long-range connections between the parietal-occipital and frontal regions. These results indicate that larger SSVEP responses correspond with better functional network topology structures. This study may provide new insights for understanding brain mechanisms when using SSVEPs as frequency tags.

Steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) systems suffer from low SSVEP response intensity and visual fatigue, resulting in lower accuracy when operating the system for continuous commands, such as an electric wheelchair control. This study proposes two SSVEP improvements to create a practical BCI for communication and control in disabled people. The first is flicker pattern modification for increasing SSVEP response through mixing (1) fundamental and first harmonic frequencies, and (2) two fundamental frequencies for an additional number of commands. The second method utilizes a quick response (QR) code for visual stimulus patterns to increase the SSVEP response and reduce visual fatigue. Eight different stimulus patterns from three flickering frequencies (7, 13, and 17 Hz) were presented to twelve participants for the test and score levels of visual fatigue. Two popular SSVEP methods, i.e., power spectral density (PSD) with Welch periodogram and canonical correlation analysis (CCA) with overlapping sliding window, are used to detect SSVEP intensity and response, compared to the checkerboard pattern. The results suggest that the QR code patterns can yield higher accuracy than checkerboard patterns for both PSD and CCA methods. Moreover, a QR code pattern with low frequency can reduce visual fatigue; however, visual fatigue can be easily affected by high flickering frequency. The findings can be used in the future to implement a real-time, SSVEP-based BCI for verifying user and system performance in actual environments.

Over the years, the driver-vehicle interface has been improved, but interacting with in-vehicle features can still increase distraction and affect road safety. This study aims to introduce brain-machine interface (BMI)- based solution to potentially enhance road safety. To achieve this goal, we evaluated visual stimuli properties (SPs) for a steady state visually evoked potentials (SSVEP)-based BMI system. We used a heads-up display (HUD) as the primary screen to present icons for controlling in-vehicle functions such as music, temperature, settings, and navigation. We investigated the effect of various SPs on SSVEP detection performance including the duty cycle and signal-to-noise ratio of visual stimuli, the size, color, and frequency of the icons, and array configuration and location. The experiments were conducted with 10 volunteers and the signals were analyzed using the canonical correlation analysis (CCA), filter bank CCA (FBCCA), and power spectral density analysis (PSDA). Our experimental results suggest that stimuli with a green color, a duty cycle of 50%, presented at a central location, with a size of 36 cm2 elicit a significantly stronger SSVEP response and enhanced SSVEP detection time. We also observed that lower SNR stimuli significantly affect SSVEP detection performance. There was no statistically significant difference observed in SSVEP response between the use of an LCD monitor and a HUD.

Efforts to construct an effective brain-computer interface (BCI) system based on Steady State Visual Evoked Potentials (SSVEP) commonly focus on sophisticated mathematical methods for data analysis. The role of different stimulus features in evoking strong SSVEP is less often considered and the knowledge on the optimal stimulus properties is still fragmentary. The goal of this study was to provide insight into the influence of stimulus characteristics on the magnitude of SSVEP response. Five stimuli parameters were tested: size, distance, colour, shape, and presence of a fixation point in the middle of each flickering field. The stimuli were presented on four squares on LCD screen, with each square highlighted by LEDs flickering with different frequencies. Brighter colours and larger dimensions of flickering fields resulted in a significantly stronger SSVEP response. The distance between stimulation fields and the presence or absence of the fixation point had no significant effect on the response. Contrary to a popular belief, these results suggest that absence of the fixation point does not reduce the magnitude of SSVEP response. However, some parameters of the stimuli such as colour and the size of the flickering field play an important role in evoking SSVEP response, which indicates that stimuli rendering is an important factor in building effective SSVEP based BCI systems.

In this paper, to develop a hybrid brain-computer interface based on Steady State Visual Evoked Potential(SSVEP) and P300, we validate a SSVEP brain-computer interface (BCI) with the hybrid stimuli of SSVEP and P300, and analyze the effect of P300 visual stimuli on the classification accuracy of the SSVEP BCI. The hybrid stimuli include the SSVEP stimuli, which consist of twochessboardimagespresented on a LCD screen and flashing at particular frequencies, respectively, and the P300 stimuli, which include nine characters and locate between the SSVEP stimuli. We extract the fundamental frequencies and second harmonics of the frequencies of the SSVEP stimulifrom EEG data as features, andapply a Fisher's linear discriminant analysis to build the classifier. The experimental results from three subjects show that the SSVEP potentials can be elicited well under the hybrid stimuli of SSVEP and P300, and the P300 stimuli under the hybrid condition have no significant effect on the SSVEP BCI. This work laysa foundationfor developing a hybrid BCIbased on SSVEP and P300.

Data mining based approach to study the effect of consumption of caffeinated coffee on the generation of the steady-state visual evoked potential signals

Decision letter: Neural markers of predictive coding under perceptual uncertainty revealed with Hierarchical Frequency Tagging

A variety of assessment tools are currently available to help clinicians assess Sports Related Concussion (SRC). Currently, the most widely available tools are neither objective nor portable, and are therefore not ideal for assessment at the site and time of a suspected injury. A portable system was developed to deliver a measurement of the steady-state visual-evoked potential (SSVEP). This system involved a smartphone housed in a Google Cardboard frame, which delivered a 15-Hz flicker visual stimulus while an electroencephalography (EEG) headset recorded EEG signals. Sixty-five rugby union players were tested during their regular season and were stratified into healthy, concussed, and recovered groups based on clinical examination. Their SSVEP response was quantified into a signal-to-noise ratio (SNR). The SNRs of players in each study group were summarized. Additionally, the SNRs of individual players who had baseline, post-injury, and post-recovery readings were analyzed. Sixty-five participants completed a baseline evaluation to measure their SSVEP. Twelve of these participants sustained a medically diagnosed concussion and completed SSVEP re-testing within 72 h. Eight concussed players received follow-up SSVEP testing after recovery. Concussed participants had a lower SNR [2.20 (2.04–2.38)] when compared to their baseline [4.54 (3.79–5.10)]. When clinically recovered, participant SNR was not significantly different to their baseline [4.82 (4.13–5.18)]. The baseline SNRs of the players who experienced a concussion during the season were not different to those of players who did not experience a concussion [4.80 (4.07–5.68)]. This is the first study to identify differences in SSVEP responses in male amateur rugby union players with and without concussion. It is also the first SSVEP demonstration for concussion evaluation at point-of-care. SSVEPs are significantly attenuated in the presence of concussion in these male athletes. Individuals returned to their baseline SSVEP following clinical recovery from the concussive injury. The use of SSVEPs has the potential to be a supplemental aid for the assessment and management of concussion.

The dynamic clamp technology to implement artificial membrane or synaptic conductances is one of the most successful examples of closed-loop interactions with the nervous system for observation and control purposes (for a review see [1]). We recently proposed a generalization of the dynamic clamp concept to design goal-driven closed-loop interactions with biological systems beyond electrical stimulation and recording in the context of in vitro electrophysiology and animal ethology [2]. Following the same activity-dependent stimulation approach, we designed an assisted closed-loop (ACL) to optimize the efficiency of brain-computer interfaces (BCI) based on steady state visually evoked potentials (SSVEP) [3]. SSVEP based BCIs use multiple visual stimuli such as LEDs or regions on a screen flickering at different frequencies. A subject's brain generates electrical activity at the same fundamental frequency as the visual stimulus on which the subject has focused his/her attention. The ACL consists in the delivery of online information with regard to the control over the given BCI goal both to the human subject and to the system, resulting in an online adaptation of BCI stimuli properties, in this first proof of concept study the combination of the employed flicker frequencies (Figure ​(Figure1).1). The optimization process is realized by first performing a real-time closed-loop search for the best set of stimulation frequencies to achieve the given BCI goal, which informs the system about the most effective flicker frequencies to produce SSVEPs in a given subject. Secondly, a continuous auditory feedback informs the subject about the actual distance to a predefined detection threshold. Figure 1 The assisted closed-loop (ACL) provides online information to the system about the most effective flicker frequencies and to the human subject about the actual distance to the pre-defined SSVEP detection threshold by a continuous auditory feedback (speaker ... Our results show that this shared online information leads to an enhanced BCI efficiency, as compared to classic BCI protocols, by helping them to reach the BCI goal in their interaction. The analysis also shows that the ACL protocol takes into account interindividual variabilities. In particular, baseline resting state EEG measures seem to predict subjects' BCI performances, which indicates that the ACL based BCIs might be expanded to innovative new diagnostic/therapeutic tools for clinical contexts and as new paradigms for basic research. Taking all together, these results illustrate that assisted closed-loop protocols can reveal dynamics otherwise hidden under traditional stimulation techniques, provide control of regular and pathological states, induce learning processes, bridge between distinct levels of analysis and lead to automation of experiments. The proposed approach might have a large impact for applied uses, such as computer control and biomedical or prosthetic uses, but also in novel paradigms for neuroscientific and biomedical research.

Brain machine interfaces (BMIs) provide one of the important means to interact with external world for a patient who lost motor function by using brain electrical signals such as scalp electroencephalogram (EEG). The main function of BMIs is to detect, analyze and classify the modulation of EEG according to a user's intent and to decode it to demonstrate to others. Most of conventional BMIs with relatively high speed and high classification accuracy have a requisite that a user can open and move his/her eyes toward a target corresponding to user's intent and gaze at it. Locked-in patients, who have lost almost all motor function including facial muscle, cannot control the eye-movement as well as gaze. The present study aimed at developing a BMI which was independent of the eye-movement and eye-gaze as a final goal. In this paper, we discuss the feasibility of binary class of BMI available with eyes-closed condition using a recent our newly observation that the steady-state visual evoked potential (SSVEP) could be modulated by performing the mental tasks even in the eyes-close state. Temporal evolution of the modulation of SSVEP was investigated using the amplitude of SSVEP and Kullback-Leibler (KL) divergence. The amplitudes of fundamental SSVEP (10 Hz) averaged across 11 participants showed significant difference between the mental focusing task and relaxed runs from the onset of the flicker stimuli with the frequency of 10 Hz and the intensity of 5 lx, whereas those of the second harmonic SSVEP (20 Hz) gave only small difference without statistical significance. For the image recalling task, the amplitude differences between the fundamental SSVEPs in the task and relaxed conditions did not show significant difference, whereas the amplitude differences of the second harmonic SSVEP showed the main effect of the image recall task. The KL divergences for the fundamental SSVEP amplitude showed large differences at the onset of flicker stimuli and gradual decrease with time at P4 and O2 for the mental focus task, yet no such characteristic evolution was not seen in KL divergence for the second harmonic SSVEP. On the other hand, the KL divergences during the image recalling were increased with time for both the fundamental and second harmonic SSVEPs at most of the electrode sites. The classification accuracies of the proposed BMI exceeded 75 % in average across the subjects for both tasks using Fisher's linear discriminant analysis.

Brain–computer interface (BCI) systems rely on the direct measurement of brain signals, such as event-related desynchronization (ERD), steady state visual evoked potentials (SSVEPs), P300s, or slow cortical potentials. Unfortunately, none of these BCI approaches work for all users. This study compares two conventional BCI approaches (ERD and SSVEP) within subjects, and also evaluates a novel hybrid BCI based on a combination of these signals. We recorded EEG data from 12 subjects across three conditions. In the first condition, subjects imagined moving both hands or both feet (ERD). In the second condition, subjects focused on one of the two oscillating visual stimuli (SSVEP). In the third condition, subjects simultaneously performed both tasks. We used logarithmic band power features at sites and frequencies consistent with ERD and SSVEP activity, and subjects received real-time feedback based on their performance. Subjects also completed brief questionnaires. All subjects could simultaneously perform the movement and visual task in the hybrid condition even though most subjects had little or no training. All subjects showed both SSVEP and ERD activity during the hybrid task, consistent with the activity in both single tasks. Subjects generally considered the hybrid condition moderately more difficult, but all of them were able to complete the hybrid task. Results support the hypothesis that subjects who do not have strong ERD activity might be more effective with an SSVEP BCI, and suggest that SSVEP BCIs work for more subjects. A simultaneous hybrid BCI is feasible, although the current hybrid approach, which involves combining ERD and SSVEP in a two-choice task to improve accuracy, is not significantly better than a comparable SSVEP BCI. Switching to an SSVEP BCI could increase reliability in subjects who have trouble producing the EEG activity necessary to use an ERD BCI. Subjects who are proficient in both BCI approaches might be able to combine these approaches in different ways and for different goals.

Objective. Steady-state visual evoked potential (SSVEP) is an important control method of the brain–computer interface (BCI) system. The development of an efficient SSVEP feature decoding algorithm is the core issue in SSVEP-BCI. It has been proposed to use user training data to reduce the spontaneous electroencephalogram activity interference on SSVEP response, thereby improving the feature recognition accuracy of the SSVEP signal. Nevertheless, the tedious data collection process increases the mental fatigue of the user and severely affects the applicability of the BCI system. Approach. A cross-subject spatial filter transfer (CSSFT) method that transfer the existing user model with good SSVEP response to the new user test data without collecting any training data from the new user is proposed. Main results. Experimental results demonstrate that the transfer model increases the distinction of the feature discriminant coefficient between the gaze following target and the non-gaze following target and accurately identifies the wrong target in the fundamental algorithm model. The public datasets show that the CSSFT method significantly increases the recognition performance of canonical correlation analysis (CCA) and filter bank CCA. Additionally, when the data used to calculate the transfer model contains one data block only, the CSSFT method retains its effective feature recognition capabilities. Significance. The proposed method requires no tedious data calibration process for new users, provides an effective technical solution for the transfer of the cross-subject model, and has potential application value for promoting the application of the BCI system.

A new dual-frequency stimulation method to increase the number of visual stimuli for multi-class SSVEP-based brain–computer interface (BCI)