An SSVEP-Based BCI with Adaptive Time-Window Length

Steady state visual evoked potential (SSVEP)-based brain-computer interface (BCI) has gained a lot of attention due to its robustness and high information transfer rate (ITR). However, transitioning well-controlled laboratory-oriented BCI demonstrations to real-world applications poses severe challenges for this exciting field. For instance, conducting BCI experiments usually requires skilled technicians to abrade the area of skin underneath each electrode and apply an electrolytic gel or paste to acquire high-quality SSVEPs from hair-covered areas. Our previous proof-of-concept study has proposed an alternative approach that employed electroencephalographic signals collected from easily accessible non-hair-bearing areas including neck, behind the ears, and face to realize an SSVEP-based BCI. The study results showed that, with proper electrode placements and advanced signal-processing algorithms, the SSVEPs measured from non-hair-bearing areas in off-line SSVEP experiments could achieve comparable SNR to that obtained from the hair-bearing occipital areas. This study extended the previous work to systematically investigate the costs and benefits of non-hair SSVEPs. Furthermore, this study developed and evaluated an online BCI system based solely on non-hair EEG signals. A 12-target identification task was employed to quantitatively assess the performance of the online SSVEP-based BCI system. All subjects successfully completed the tasks using non-hair SSVEPs with 84.08 ± 15.60% averaged accuracy and 30.21 ± 10.61 bits/min averaged ITR. The empirical results of this study demonstrated the practicality of implementing an SSVEP-based BCI based on signals from non-hair-bearing areas, significantly improving the feasibility and practicality of real-world BCIs.

The performance of steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) has been drastically improved in the past few years. In conventional SSVEP-based BCIs, the speed of a selection is fixed towards high performance based on preliminary offline analysis. However, due to inter-trial variability, the optimal selection time to achieve sufficient accuracy is different for each trial. To optimize the performance of SSVEP-based BCIs, this study proposed a dynamic stopping method that can adaptively determine a selection time in each trial by applying a threshold to the probability of detecting a target. A 12-class SSVEP dataset recorded from 10 subjects was used to evaluate the performance of the proposed method. Compared to the conventional method with a fixed selection time towards the highest accuracy, the proposed method could significantly reduce the averaged selection time (0.84±0.39 s vs. 1.44±0.63 s, p<;0.05) with comparable accuracy (99.44±1.57 % vs. 99.55±1.22 %). As a result, the simulated online information transfer rate (ITR) with the dynamic stopping method achieved a significant improvement compared to the conventional method (125.30±21.55 bits/min vs. 92.75±23.77 bits/min). These results suggest that the proposed dynamic stopping method is effective for improving the performance of SSVEP-based BCI systems.

Objective. Steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) can provide relatively easy, reliable and high speed communication. However, the performance is still not satisfactory, especially in some users who are not able to generate strong enough SSVEP signals. This work aims to strengthen a user’s SSVEP by alpha down-regulating neurofeedback training (NFT) and consequently improve the performance of the user in using SSVEP-based BCIs. Approach. An experiment with two steps was designed and conducted. The first step was to investigate the relationship between the resting alpha activity and the SSVEP-based BCI performance, in order to determine the training parameter for the NFT. Then in the second step, half of the subjects with ‘low’ performance (i.e. BCI classification accuracy <80%) were randomly assigned to a NFT group to perform a real-time NFT, and the rest half to a non-NFT control group for comparison. Main results. The first step revealed a significant negative correlation between the BCI performance and the individual alpha band (IAB) amplitudes in the eyes-open resting condition in a total of 33 subjects. In the second step, it was found that during the IAB down-regulating NFT, on average the subjects were able to successfully decrease their IAB amplitude over training sessions. More importantly, the NFT group showed an average increase of 16.5% in the SSVEP signal SNR (signal-to-noise ratio) and an average increase of 20.3% in the BCI classification accuracy, which was significant compared to the non-NFT control group. Significance. These findings indicate that the alpha down-regulating NFT can be used to improve the SSVEP signal quality and the subjects’ performance in using SSVEP-based BCIs. It could be helpful to the SSVEP related studies and would contribute to more effective SSVEP-based BCI applications.

Steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) have potential to realize high-speed communication between the human brain and the external environment. Recently, multiple access (MA) methods in telecommunications have been introduced into the system design of BCIs and showed their potential in improving BCI performance. This study investigated the feasibility of hybrid frequency and phase coding methods in multi-target SSVEP-based BCIs. Specifically, this study compared two hybrid target-coding strategies: (1) mixed frequency and phase coding, and (2) joint frequency and phase coding. In a simulated online BCI experiment using a 40-target BCI speller, BCI performance for both coding approaches were tested with a group of six subjects. At a spelling speed of 40 characters per minute (1.5 seconds per character), both approaches obtained high information transfer rates (ITR) (mixed coding: 172.37±28.67 bits/min, joint coding: 170.94±28.32 bits/min) across subjects. There was no statistically significant difference between the two approaches (p>0.05). These results suggest that the hybrid frequency and phase coding methods are highly efficient for multi-target coding in SSVEP BCIs with a large number of classes, providing a practical solution to implement a high-speed BCI speller.

This study proposes a steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) independent of amplitude-frequency and phase calibrations. Six stepping delay flickering sequences (SDFSs) at 32-Hz flickering frequency were used to implement a six-command BCI system. EEG signals recorded from Oz position were first filtered within 29-35 Hz, segmented based on trigger events of SDFSs to obtain SDFS epochs, and then stored separately in epoch registers. An epoch-average process suppressed the inter-SDFS interference. For each detection point, the latest six SDFS epochs in each epoch register were averaged and the normalized power of averaged responses was calculated. The visual target that induced the maximum normalized power was identified as the visual target. Eight subjects were recruited in this study. All subjects were requested to produce the "563241" command sequence four times. The averaged accuracy, command transfer interval, and information transfer rate (mean ± std.) values for all eight subjects were 97.38 ± 5.97%, 3.56 ± 0.68 s, and 42.46 ± 11.17 bits/min, respectively. The proposed system requires no calibration in either the amplitude-frequency characteristic or the reference phase of SSVEP which may provide an efficient and reliable channel for the neuromuscular disabled to communicate with external environments.

Multi-frequency-modulated visual stimulation scheme has been shown effective for the steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) recently, especially in increasing the visual target number with less stimulus frequencies and mitigating the visual fatigue. However, the existing calibration-free recognition algorithms based on the traditional canonical correlation analysis (CCA) cannot provide the merited performance. To improve the recognition performance, this study proposes a phase difference constrained CCA (pdCCA), which assumes that the multi-frequency-modulated SSVEPs share a common spatial filter over different frequencies and have a specified phase difference. Specifically, during the CCA computation, the phase differences of the spatially filtered SSVEPs are constrained using the temporal concatenation of the sine-cosine reference signals with the pre-defined initial phases. We evaluate the performance of the proposed pdCCA-based method on three representative multi-frequency-modulated visual stimulation paradigms (i.e., based on the multi-frequency sequential coding, the dual-frequency, and the amplitude modulation). The evaluation results on four SSVEP datasets (Dataset Ia, Ib, II, and III) show that the pdCCA-based method can significantly outperform the current CCA method in terms of recognition accuracy. It improves the accuracy by 22.09% in Dataset Ia, 20.86% in Dataset Ib, 8.61% in Dataset II, and 25.85% in Dataset III. The pdCCA-based method, which actively controls the phase difference of the multi-frequency-modulated SSVEPs after spatial filtering, is a new calibration-free method for multi-frequency-modulated SSVEP-based BCIs.

This paper presents an electroencephalogram (EEG) based brain computer interface (BCI) design as a control mechanism for the Open Vibe Space shooter game. BCI using Steady State Visual Evoked Potential (SSVEP) is designed. The SSVEP is generated in response to a flickering visual stimulus. The setup uses different flickering frequencies which are displayed on a Liquid Crystal Display (LCD) monitor to elicit SSVEP responses. The EEG signals are recorded over the visual cortex of the brain. These signals are pre-processed to remove undesired information. To extract features, the power information contained in the corresponding frequency bands are calculated. The feature set is fed as an input to the classifier to identify the target class. This study tried to compare the performance of different classification algorithms in terms of accuracy, information transfer rate and the response time. Based on the outcome, support vector machine classifier with radial basis function recorded the best average accuracy of 90%.

Steady-state visual evoked potentials (SSVEP)-based brain-computer interfaces (BCIs) have the potential to be utilized in various fields due to their high accuracies and information transfer rates (ITR). High-frequency (HF) visual stimuli have shown promise in reducing visual fatigue and enhancing user comfort. However, these HF-SSVEP-BCIs often face limitations in the number of commands and typically require extensive individual training data to achieve high performance. In this study, we proposed a row-column dual-frequency encoding and decoding method using HF stimulation to develop a comfortable BCI system that supports multiple commands and reduces training costs. We arranged 20 targets in a matrix of five rows and four columns, with each target modulated by left-and-right field stimulation using two frequency-phase combinations. Targets in each row or column share a unique frequency-phase combination, allowing EEG data from the same row or column to be used collectively to train a row/column index decoding model for target identification. To evaluate the performance of our method, we constructed a 20-target asynchronous robotic arm control system with the adaptive window method. With only four training trials per target, the online system achieved an ITR of 105.14 ± 14.15 bits/min, a true positive rate of 98.18 ± 2.87%, a false positive rate of 7.39 ± 6.73%, and a classification accuracy of 91.88 ± 5.75%, with an average data length of 925.70 ± 45.44 ms. These results indicate that the proposed protocol can deliver accurate and rapid command outputs for a comfortable SSVEP-based BCI with minimal training data and fewer frequencies.

In this study, we proposed a new type of hybrid visual stimuli for steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs), which incorporate various periodic motions into conventional flickering stimuli (FS) or pattern reversal stimuli (PRS). Furthermore, we investigated optimal periodic motions for each FS and PRS to enhance the performance of SSVEP-based BCIs. Periodic motions were implemented by changing the size of the stimulus according to four different temporal functions denoted by none, square, triangular, and sine, yielding a total of eight hybrid visual stimuli. Additionally, we developed the extended version of filter bank canonical correlation analysis (FBCCA), which is a state-of-the-art training-free classification algorithm for SSVEP-based BCIs, to enhance the classification accuracy for PRS-based hybrid visual stimuli. Twenty healthy individuals participated in the SSVEP-based BCI experiment to discriminate four visual stimuli with different frequencies. An average classification accuracy and information transfer rate (ITR) were evaluated to compare the performances of SSVEP-based BCIs for different hybrid visual stimuli. Additionally, the user's visual fatigue for each of the hybrid visual stimuli was also evaluated. As the result, for FS, the highest performances were reported when the periodic motion of the sine waveform was incorporated for all window sizes except for 3 s. For PRS, the periodic motion of the square waveform showed the highest classification accuracies for all tested window sizes. A significant statistical difference in the performance between the two best stimuli was not observed. The averaged fatigue scores were reported to be 5.3 ± 2.05 and 4.05 ± 1.28 for FS with sine-wave periodic motion and PRS with square-wave periodic motion, respectively. Consequently, our results demonstrated that FS with sine-wave periodic motion and PRS with square-wave periodic motion could effectively improve the BCI performances compared to conventional FS and PRS. In addition, thanks to its low visual fatigue, PRS with square-wave periodic motion can be regarded as the most appropriate visual stimulus for the long-term use of SSVEP-based BCIs, particularly for window sizes equal to or larger than 2 s.

Cognitive assessment is of growing importance, with the general population getting older and a rapidly growing incidence of dementia, which is a major public health issue. Treatment of dementia must, to be most effective, start early in the disease process. Thus, early detection of cognitive decline is important. Cognitive decline may be detected using fully-automated computerized assessment. Such systems will provide inexpensive and widely available screenings of cognitive ability. The aim of this pilot study is to develop a real time steady state visual evoked potential (SSVEP) based brain-computer interface (BCI) for neurological cognitive assessment. It is intended for use by patients who suffer from diseases impairing their motor skills, but are still able to control their gaze. Results are based on 11 healthy test subjects. The system performance have an average accuracy of 100% - 0%. The test subjects achieved an information transfer rate (ITR) of 14.64 bits/min - 7.63 bits/min and a subject test performance of 47.22% - 34.10%. This study suggests that BCI may be applicable in practice as a computerized cognitive assessment tool. However, many improvements are required for the system to be fully valid and of clinical use.

Steady-state visual evoked potential (SSVEP)-based brain– computer interfaces (BCIs) have been widely studied. Considerable progress has been made in the aspects of stimulus coding, electroencephalogram processing, and recognition algorithms to enhance system performance. The properties of SSVEP have been demonstrated to be highly sensitive to stimulus luminance. However, thus far, there have been very few reports on the impact of background luminance on the system performance of SSVEP-based BCIs. This study investigated the impact of stimulus background luminance on SSVEPs. Specifically, this study compared two types of background luminance, i.e., (1) black luminance [red, green, blue (rgb): (0, 0, 0)] and (2) gray luminance [rgb: (128, 128, 128)], and determined their effect on the classification performance of SSVEPs at the stimulus frequencies of 9, 11, 13, and 15 Hz. The offline results from nine healthy subjects showed that compared with the gray background luminance, the black background luminance induced larger SSVEP amplitude and larger signal-to-noise ratio, resulting in a better classification accuracy. These results suggest that the background luminance of visual stimulus has a considerable effect on the SSVEP and therefore has a potential to improve the BCI performance.

Electroencephalogram (EEG) based brain-computer interfaces (BCIs) for wheelchair control have great value for those with devastating neuromuscular disorders. Although there have been many attempts to implement EEG-based wheelchair control systems by P300, steady state visual evoked potential (SSVEP), and motor imagery (MI) related event-related desynchronization/synchronization (ERD/ERS), the number of simultaneous control commands in those BCI systems is strictly limited, and those BCI control do not work for a non-negligible portion of users due to the problem of BCI Illiteracy.In this paper, we develop a multimodal BCI based wheelchair control system, the user could employ subject-optimized mental strategies to produce multiple commands to control the wheelchair, which include ERD/ERS, SSVEP, and simultaneous ERD/ERS and SSVEP. It could not only help address ”BCI illiteracy”, but also provide simultaneous control commands for complex control. Experiment results demonstrate the proposed system is effective and flexible in practical application.KeywordsBCIwheelchair controlmultimodalBCI Illiteracy

Objective. This study aims to establish a generalized transfer-learning framework for boosting the performance of steady-state visual evoked potential (SSVEP)-based brain–computer interfaces (BCIs) by leveraging cross-domain data transferring. Approach. We enhanced the state-of-the-art template-based SSVEP decoding through incorporating a least-squares transformation (LST)-based transfer learning to leverage calibration data across multiple domains (sessions, subjects, and electroencephalogram montages). Main results. Study results verified the efficacy of LST in obviating the variability of SSVEPs when transferring existing data across domains. Furthermore, the LST-based method achieved significantly higher SSVEP-decoding accuracy than the standard task-related component analysis (TRCA)-based method and the non-LST naive transfer-learning method. Significance. This study demonstrated the capability of the LST-based transfer learning to leverage existing data across subjects and/or devices with an in-depth investigation of its rationale and behavior in various circumstances. The proposed framework significantly improved the SSVEP decoding accuracy over the standard TRCA approach when calibration data are limited. Its performance in calibration reduction could facilitate plug-and-play SSVEP-based BCIs and further practical applications.

Steady-state visual evoked potential (SSVEP) based brain-computer interfaces (BCIs) have achieved an information transfer rate (ITR) of over 300 bits/min, but abundant training data is required. The performance of SSVEP algorithms deteriorates greatly under limited data, and the existing time-shift data augmentation method fails to improve it because the phase-locked requirement between training samples is violated. To address this issue, this study proposes a novel augmentation method, namely phase-locked time-shift (PLTS), for SSVEP-BCI. The similarity between epochs at different time moments was evaluated, and a unique time-shift step was calculated for each class to augment additional data epochs in each trial. The results showed that the PLTS significantly improved the classification performance of SSVEP algorithms on the BETA SSVEP datasets. Moreover, under the condition of one calibration block, by slightly prolonging the calibration duration (from 48 s to 51.5 s), the ITR increased from 40.88 ±4.54 bits/min to 122.61 ± 7.05 bits/min with the PLTS. This study provides a new perspective on augmenting data epochs for training-based SSVEP-BCI, promotes the classification accuracy and ITR under limited training data, and thus facilitates the real-life applications of SSVEP-based brain spellers.

A steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) system relies on the photic driving response to effectively elicit characteristic electroencephalogram (EEG) signals. However, traditional visual stimuli mainly adopt high-contrast black-and-white flickering stimulations, which are easy to cause visual fatigue. This paper presents an SSVEP dataset acquired at a wide frequency range from 1 to 60 Hz with an interval of 1 Hz using flickering stimuli under two different modulation depths. This dataset contains 64-channel EEG data from 30 healthy subjects when they fixated on a single flickering stimulus. The stimulus was rendered on an LCD display with a refresh rate of 240 Hz. Initially, the dataset was rigorously validated through comprehensive data analysis to investigate SSVEP responses and user experiences. Subsequently, BCI performance was evaluated through offline simulations of frequency-coded and phase-coded BCI paradigms. This dataset provides comprehensive and high-quality data for studying and developing SSVEP-based BCI systems.