Discriminative Canonical Pattern Matching for Single-Trial Classification of ERP Components.

Brain-Computer Interfaces (BCI) is a one kind of communication system that enables control of devices or communication with others only through brain signal activities without using motor activities. The main application for BCI is to provide an alternative channel for helping disabled persons, hereafter mentioned as subjects, to communicate with the external world. This paper tries to demonstrate the performance of different machine learning algorithms based on classification accuracy. Performance has been evaluated on dataset II from BCI Competition III for the year 2004 for two subjects 'A' & 'B' and dataset IIb from BCI Competition II for the year 2003 for one subject 'C'. As a primary stage, a preprocessing was applied on the samples in order to extract the most significant features before introducing them to machine learning algorithms. The algorithms applied are Bayesian Linear Discriminant Analysis (BLDA), linear Support Vector Machine (SVM), Fisher Linear Discriminant Analysis (FLDA), Generalized Anderson's Task linear classifier (GAT), Linear Discriminant Analysis (LDA). BLDA and SVM yielded the highest accuracy for all 3 subjects. BLDA algorithm achieved classification accuracy 98%, 98% and 100%, SVM algorithm achieved 98%, 96% and 100% for subjects 'A', 'B' and 'C' respectively.

Research was conducted to investigate the use of optical, air-born acoustic and plasma charge signals for detecting defects in laser welds. Full penetration, partial penetration and gapped-full penetration butt-joint welds were made in 1.4mm cold-rolled steel sheet. A 3 kW CO2 laser was used to produce these three classes of welds while laser power, travel speed and joint fitup were varied to produce the various conditions. Visible light, audible sound and electrical charge near the plume were measured simultaneously in real-time using a silicon photodiode, a condensor microphone and a plasma charge sensing gas nozzle, respectively. The spectra of the sensor signals were analyzed by a statistical technique known as Linear Discriminant Analysis (LDA). Stepwise LDA was used to identify the most important frequency bands and canonical discriminant analysis was employed to develop discriminant functions. Reliability analysis of the training samples revealed that this LDA method classified laser welds with reliability ranging from 85% to 96%, depending on the welds selected for inclusion in the training set. When the linear discriminant function was validated using new (untrained) samples, it distinguished the three different classes of laser welds with approximately 87% accuracy. Among the three signals, sound produced better separation between the classes of welds, although a discriminator based on all three signals combined and one that used only plasma charge and acoustic signals were of almost equal reliability.Research was conducted to investigate the use of optical, air-born acoustic and plasma charge signals for detecting defects in laser welds. Full penetration, partial penetration and gapped-full penetration butt-joint welds were made in 1.4mm cold-rolled steel sheet. A 3 kW CO2 laser was used to produce these three classes of welds while laser power, travel speed and joint fitup were varied to produce the various conditions. Visible light, audible sound and electrical charge near the plume were measured simultaneously in real-time using a silicon photodiode, a condensor microphone and a plasma charge sensing gas nozzle, respectively. The spectra of the sensor signals were analyzed by a statistical technique known as Linear Discriminant Analysis (LDA). Stepwise LDA was used to identify the most important frequency bands and canonical discriminant analysis was employed to develop discriminant functions. Reliability analysis of the training samples revealed that this LDA method classified laser welds with rel...

Brain-computer interface (BCI) provides the brain with a new communication and control channel for conveying messages and commands to the outside world. BCIs require effective on-line processing of EEG or P300 which appeared just 300ms after the event happened. In this paper, we use a method of Bayesian linear discriminant analysis (BLDA) to classify P300 signals from the data set of BCI Competition III. P300 are obtained when subjects were facing a screen on which flashed objects were displayed. Before training a classification parameter for the BLDA, several preprocessing operations were applied to the data including filtering, trial extraction et al. With the BLDA algorithm, the classification accuracy in our experiment could be up to above 80%, depends on the averaged times of trials and SNR of the data. In summary, it is suitable to use LDA in the P300-based BCI system, and LDA will be a promising method to extract feature for BCI designs.

The demand for public datasets has increased as data-driven methodologies have been introduced in the field of brain-computer interfaces (BCIs). Indeed, many BCI datasets are available in various platforms or repositories on the web, and the studies that have employed these datasets appear to be increasing. Motor imagery is one of the significant control paradigms in the BCI field, and many datasets related to motor tasks are open to the public already. However, to the best of our knowledge, these studies have yet to investigate and evaluate the datasets, although data quality is essential for reliable results and the design of subject− or system-independent BCIs. In this study, we conducted a thorough investigation of motor imagery/execution EEG datasets recorded from healthy participants published over the past 13 years. The 25 datasets were collected from six repositories and subjected to a meta-analysis. In particular, we reviewed the specifications of the recording settings and experimental design, and evaluated the data quality measured by classification accuracy from standard algorithms such as Common Spatial Pattern (CSP) and Linear Discriminant Analysis (LDA) for comparison and compatibility across the datasets. As a result, we found that various stimulation types, such as text, figure, or arrow, were used to instruct subjects what to imagine and the length of each trial also differed, ranging from 2.5 to 29 s with a mean of 9.8 s. Typically, each trial consisted of multiple sections: pre-rest (2.38 s), imagination ready (1.64 s), imagination (4.26 s, ranging from 1 to 10 s), the post-rest (3.38 s). In a meta-analysis of the total of 861 sessions from all datasets, the mean classification accuracy of the two-class (left-hand vs. right-hand motor imagery) problem was 66.53%, and the population of the BCI poor performers, those who are unable to reach proficiency in using a BCI system, was 36.27% according to the estimated accuracy distribution. Further, we analyzed the CSP features and found that each dataset forms a cluster, and some datasets overlap in the feature space, indicating a greater similarity among them. Finally, we checked the minimal essential information (continuous signals, event type/latency, and channel information) that should be included in the datasets for convenient use, and found that only 71% of the datasets met those criteria. Our attempts to evaluate and compare the public datasets are timely, and these results will contribute to understanding the dataset’s quality and recording settings as well as the use of using public datasets for future work on BCIs.

Background. Usually the training set of online brain-computer interface (BCI) experiment is small. For the small training set, it lacks enough information to deeply train the classifier, resulting in the poor classification performance during online testing. Methods. In this paper, on the basis of Z-LDA, we further calculate the classification probability of Z-LDA and then use it to select the reliable samples from the testing set to enlarge the training set, aiming to mine the additional information from testing set to adjust the biased classification boundary obtained from the small training set. The proposed approach is an extension of previous Z-LDA and is named enhanced Z-LDA (EZ-LDA). Results. We evaluated the classification performance of LDA, Z-LDA, and EZ-LDA on simulation and real BCI datasets with different sizes of training samples, and classification results showed EZ-LDA achieved the best classification performance. Conclusions. EZ-LDA is promising to deal with the small sample size training problem usually existing in online BCI system.

The linear discriminant analysis (LDA) method is a classical and commonly utilized technique for dimensionality reduction and classification in brain-computer interface (BCI) systems. Being a first-order discriminator, LDA is usually preceded by the feature extraction of electroencephalogram (EEG) signals, as multi-density EEG data are of second order. In this study, an analytic bilinear classification method which inherits and extends LDA is proposed. This method considers 2-dimentional EEG signals as the feature input and performs classification using the optimized complex-valued bilinear projections. Without being transformed into frequency domain, the complex-valued bilinear projections essentially spatially and temporally modulate the phases and magnitudes of slow event-related potentials (ERPs) elicited by distinct brain states in the sense that they become more separable. The results show that the proposed method has demonstrated its discriminating capability in the development of a rapid image triage (RIT) system, which is a challenging variant of BCIs due to the fast presentation speed and consequently overlapping of ERPs.

Recent advances in deep learning have had a methodological and practical impact on brain-computer interface (BCI) research. Among the various deep network architectures, convolutional neural networks (CNNs) have been well suited for spatio-spectral-temporal electroencephalogram (EEG) signal representation learning. Most of the existing CNN-based methods described in the literature extract features at a sequential level of abstraction with repetitive nonlinear operations and involve densely connected layers for classification. However, studies in neurophysiology have revealed that EEG signals carry information in different ranges of frequency components. To better reflect these multi-frequency properties in EEGs, we propose a novel deep multi-scale neural network that discovers feature representations in multiple frequency/time ranges and extracts relationships among electrodes, i.e., spatial representations, for subject intention/condition identification. Furthermore, by completely representing EEG signals with spatio-spectral-temporal information, the proposed method can be utilized for diverse paradigms in both active and passive BCIs, contrary to existing methods that are primarily focused on single-paradigm BCIs. To demonstrate the validity of our proposed method, we conducted experiments on various paradigms of active/passive BCI datasets. Our experimental results demonstrated that the proposed method achieved performance improvements when judged against comparable state-of-the-art methods. Additionally, we analyzed the proposed method using different techniques, such as PSD curves and relevance score inspection to validate the multi-scale EEG signal information capturing ability, activation pattern maps for investigating the learned spatial filters, and t-SNE plotting for visualizing represented features. Finally, we also demonstrated our method's application to real-world problems. Based on our experimental results and analyses, we believe that the proposed multi-scale neural network can be useful for various BCI paradigms, as a starting model or as a backbone network in any new BCI experiments.

Generalized sparse discriminant analysis for event-related potential classification

A brain-computer interface (BCI) is a system that enables control of devices or communication with other persons, only through cerebral activity, without using muscles. The main application for BCIs is assistive technology for disabled persons. Examples for devices that can be controlled by BCIs are artificial limbs, spelling devices, or environment control systems. BCI research has seen renewed interest in recent years, and it has been convincingly shown that communication via a BCI is in principle feasible. However, present day systems still have shortcomings that prevent their widespread application. In part, these shortcomings are caused by limitations in the functionality of the pattern recognition algorithms used for discriminating brain signals in BCIs. Moreover, BCIs are often tested exclusively with able-bodied persons instead of conducting tests with the target user group, namely disabled persons. The goal of this thesis is to extend the functionality of pattern recognition algorithms for BCI systems and to move towards systems that are helpful for disabled users. We discuss extensions of linear discriminant analysis (LDA), which is a simple but efficient method for pattern recognition. In particular, a framework from Bayesian machine learning, the so-called evidence framework, is applied to LDA. An algorithm is obtained that learns classifiers quickly, robustly, and fully automatically. An extension of this algorithm allows to automatically reduce the number of sensors needed for acquisition of brain signals. More specifically, the algorithm allows to perform electrode selection. The algorithm for electrode selection is based on a concept known as automatic relevance determination (ARD) in Bayesian machine learning. The last part of the algorithmic development in this thesis concerns methods for computing accurate estimates of class probabilities in LDA-like classifiers. These probabilities are used to build a BCI that dynamically adapts the amount of acquired data, so that a preset, approximate bound on the probability of misclassifications is not exceeded. To test the algorithms described in this thesis, a BCI specifically tailored for disabled persons is introduced. The system uses electroencephalogram (EEG) signals and is based on the P300 evoked potential. Datasets recorded from five disabled and four able-bodied subjects are used to show that the Bayesian version of LDA outperforms plain LDA in terms of classification accuracy. Also, the impact of different static electrode configurations on classification accuracy is tested. In addition, experiments with the same datasets demonstrate that the algorithm for electrode selection is computationally efficient, yields physiologically plausible results, and improves classification accuracy over static electrode configurations. The classification accuracy is further improved by dynamically adapting the amount of acquired data. Besides the datasets recorded from disabled and able-bodied subjects, benchmark datasets from BCI competitions are used to show that the algorithms discussed in this thesis are competitive with state-of-the-art electroencephalogram (EEG) classification algorithms. While the experiments in this thesis are uniquely performed with P300 datasets, the presented algorithms might also be useful for other types of BCI systems based on the EEG. This is the case because functionalities such as robust and automatic computation of classifiers, electrode selection, and estimation of class probabilities are useful in many BCI systems. Seen from a more general point of view, many applications that rely on the classification of cerebral activity could possibly benefit from the methods developed in this thesis. Among the potential applications are interrogative polygraphy ("lie detection") and clinical applications, for example coma outcome prognosis and depth of anesthesia monitoring.

This study provides critical insights into next-generation BCI systems, specifically addressing the challenges of visual and physical fatigue, as well as performance limitations, in VR and MR environments. Conventional Event-Related Potential (ERP)-based spellers typically rely on two-dimensional visual stimuli presented on desktop LED screens. With the emergence of immersive head-mounted displays (HMDs), there is growing interest in integrating ( VR ) and ( MR ) into brain-computer interface (BCI) systems. In this study, we implemented ERP speller systems across Desktop, VR , and MR environments, evaluating (1) P300/N200 mean amplitudes, (2) spelling performance, and (3) physiological and physical fatigue. Using Linear Discriminant Analysis (LDA) alongside Random Forest (RF), k-Nearest Neighbors (kNN), and XGBoost classifiers, we found that the Desktop environment shows higher P300 and N200 amplitudes, achieving a spelling accuracy of 75% and an Information Transfer Rate (ITR) of 26.1 bits/min, compared to MR (63.4% accuracy, 20.5 bits/min) and VR (60.8% accuracy, 19.8 bits/min). Cross-session experiments, analyzed via two-sided paired t -tests, revealed stable P300 signals in Desktop settings but significant performance declines in VR and MR during prolonged use. Symptom questionnaires indicated that MR induced the highest visual fatigue, while VR caused the most physical fatigue. These findings highlight critical challenges in VR / MR BCI systems, including visual and physical stress and performance degradation, while demonstrating the potential of MR -P300 spellers for applications in neurorehabilitation and assistive communication for motor-impaired individuals. Our results underscore the need for optimized 3D rendering, adaptive user-system mechanisms, and advanced machine learning to enhance next-generation BCI performance in immersive environments.

Objective. Recent trends in brain–computer interface (BCI) research concern the passive monitoring of brain activity, which aim to monitor a wide variety of cognitive states. Engagement is such a cognitive state, which is of interest in contexts such as learning, entertainment or rehabilitation. This study proposes a novel approach for real-time estimation of engagement during different tasks using electroencephalography (EEG). Approach. Twenty-three healthy subjects participated in the BCI experiment. A modified version of the d2 test was used to elicit engagement. Within-subject classification models which discriminate between engaging and resting states were trained based on EEG recorded during a d2 test based paradigm. The EEG was recorded using eight electrodes and the classification model was based on filter-bank common spatial patterns and a linear discriminant analysis. The classification models were evaluated in cross-task applications, namely when playing Tetris at different speeds (i.e. slow, medium, fast) and when watching two videos (i.e. advertisement and landscape video). Additionally, subjects’ perceived engagement was quantified using a questionnaire. Main results. The models achieved a classification accuracy of 90% on average when tested on an independent d2 test paradigm recording. Subjects’ perceived and estimated engagement were found to be greater during the advertisement compared to the landscape video (p = 0.025 and p < 0.001, respectively); greater during medium and fast compared to slow Tetris speed (p < 0.001, respectively); not different between medium and fast Tetris speeds. Additionally, a common linear relationship was observed for perceived and estimated engagement (r rm = 0.44, p < 0.001). Finally, theta and alpha band powers were investigated, which respectively increased and decreased during more engaging states. Significance. This study proposes a task-specific EEG engagement estimation model with cross-task capabilities, offering a framework for real-world applications.

Objective. A brain–computer interface (BCI) equips humans with the ability to control computers and technical devices mentally. However, the enormous data and the existing irrelevant features of the electrocorticogram signal limit the performance of the classifier. To address these problems, a novel signal processing framework for a binary motor imagery-based BCI system (MI–BCI) is proposed in this paper. Approach. Stockwell transform and Bayesian linear discriminant analysis were applied to feature extraction and classification, respectively, and a genetic algorithm (GA) was used in the process of feature selection to extract the most relevant features for classification. The superiority of the algorithm is demonstrated through test results based on the BCI Competition III dataset I. Main results. By comparing the processes with or without feature selection, the performance of the classification was proven to improve using the GA. By adjusting the parameters of the GA, the best feature set (selected 48.6% features) was selected to achieve classification sensitivity, specificity, precision, and accuracy of 94%, 98%, 97.9%, and 96%, respectively, exceeding the results of the existing state-of-the art algorithms. Significance. As the proposed method can reduce the number of features and select the best feature set, its classification performance was improved and the classification time was shortened; thus, it can be applied to various BCI systems.

Single-trial analysis and classification of ERP components — A tutorial

Crop disease detection with remote sensing is a challenging area that can have significant economic and environmental impact on crop disease management. Spectroscopic remote sensing in the visible and near-infrared (NIR) region has the potential to detect crop changes due to diseases. Soybean cyst nematode (SCN) and sudden death syndrome (SDS) are two common soybean diseases that are extremely difficult to detect in the early stages under mild to moderate infestation levels. The objective of this research study was to relate leaf reflectance to disease conditions and to identify wavebands that best discriminated these crop diseases. A microplot experiment was conducted. Data collected included 800 leaf spectra, corresponding leaf chlorophyll content and disease rating of four soybean cultivars grown under different disease conditions. Disease conditions were created by introducing four disease treatments of control (no disease), SCN, SDS, and SCN+SDS. Crop data were collected on a weekly basis over a 10-week period, starting from 71 days after planting (DAP). The correlation between disease rating and selected vegetation indices (VI) were evaluated. Wavebands with the most disease discrimination capability were identified with stepwise linear discriminant analysis (LDA), logistic discriminant analysis (LgDA) and linear correlation analysis of pooled data. The identified band combinations were used to develop a classification function to identify plant disease condition. The best correlation (&gt;0.8) between disease rating and VI occurred during 112 DAP. Both LDA and LgDA identified several bands in the NIR, red, green and blue regions as critical for disease discrimination. The discriminant models were able to detect over 80% of the healthy plants accurately under cross-validation but showed poor accuracy in discriminating individual diseases. A two-class discriminant model was able to identify 97% of the healthy plants and 58% of the infested plants as having some disease from the plant spectra.

A Brain-Computer interface (BCI) is a communication system that enables the generation of a control signal from brain signals such as sensorymotor rhythms and evoked potentials; therefore, it constitutes a novel communication option for people with severe motor disabilities (such as Amyotrophic Lateral Sclerosis patients). This paper presents the development of a P300-based BCI. This prototype uses a homemade six-channel electroencephalograph for the acquisition of the signals, and a visual stimulation matrix; since this matrix contains letters of the alphabet as well as images associated to them, it permits word-writing and the elaboration of messages with the images. To process the signals the software BCI2000 and MATLAB 7.0 were used. The latter was used to program three linear translation algorithms (Stepwise Linear Discriminant Analysis, Lineal Discriminant Analysis and Least Squares) to convert the brain signals into communication signals. These algorithms had a classification accuracy of 90.73 %, 95.75 % and 89.45 % respectively, when using raw data; and of 90.78%, 49.48 % and 53.9 %, when data was previously common-average filtered. The experimental setup was tested in ten healthy volunteers; 5 of them got a 100% success, 1 a 90% success, 2 an around 70% success and 2 a 50% success, in the online free-spelling tests.