Electrophysiological Indices of Target and Distractor Processing in Visual Search

Categorization of images containing visual objects can be successfully recognized using single-trial electroencephalograph (EEG) measured when subjects view images. Previous studies have shown that task-related information contained in event-related potential (ERP) components could discriminate two or three categories of object images. In this study, we investigated whether four categories of objects (human faces, buildings, cats and cars) could be mutually discriminated using single-trial EEG data. Here, the EEG waveforms acquired while subjects were viewing four categories of object images were segmented into several ERP components (P1, N1, P2a and P2b), and then Fisher linear discriminant analysis (Fisher-LDA) was used to classify EEG features extracted from ERP components. Firstly, we compared the classification results using features from single ERP components, and identified that the N1 component achieved the highest classification accuracies. Secondly, we discriminated four categories of objects using combining features from multiple ERP components, and showed that combination of ERP components improved four-category classification accuracies by utilizing the complementarity of discriminative information in ERP components. These findings confirmed that four categories of object images could be discriminated with single-trial EEG and could direct us to select effective EEG features for classifying visual objects.

Object categorization using single-trial electroencephalography (EEG) data measured while participants view images has been studied intensively. In previous studies, multiple event-related potential (ERP) components (e.g., P1, N1, P2, and P3) were used to improve the performance of object categorization of visual stimuli. In this study, we introduce a novel method that uses multiple-kernel support vector machine to fuse multiple ERP component features. We investigate whether fusing the potential complementary information of different ERP components (e.g., P1, N1, P2a, and P2b) can improve the performance of four-category visual object classification in single-trial EEGs. We also compare the classification accuracy of different ERP component fusion methods. Our experimental results indicate that the classification accuracy increases through multiple ERP fusion. Additional comparative analyses indicate that the multiple-kernel fusion method can achieve a mean classification accuracy higher than 72%, which is substantially better than that achieved with any single ERP component feature (55.07% for the best single ERP component, N1). We compare the classification results with those of other fusion methods and determine that the accuracy of the multiple-kernel fusion method is 5.47, 4.06, and 16.90% higher than those of feature concatenation, feature extraction, and decision fusion, respectively. Our study shows that our multiple-kernel fusion method outperforms other fusion methods and thus provides a means to improve the classification performance of single-trial ERPs in brain-computer interface research.

To clarify the functional significance of Go event-related potential (ERP) components, this study aimed to explore stimulus- and response-locked ERP averaging effects on the series of ERP components elicited during an auditory Go/NoGo task. Go stimulus- and response-locked ERP data from 126 healthy young adults (Mage =20.3, SD=2.8years, 83 female) were decomposed using temporal principal components analysis (PCA). The extracted components were then identified as stimulus-specific, response-specific, or common to both stimulus- and response-locked data. MANOVAs were then used to test for stimulus- versus response-locked averaging effects on common component amplitudes to determine their primary functional significance (i.e., stimulus- or response-related). Go stimulus- and response-related component amplitudes were then entered into stepwise linear regressions predicting the reaction time (RT), RT variability, and omission errors. Nine ERP components were extracted from the stimulus- and response-locked data, including N1-1, processing negativity (PN), P2, response-related N2 (RN2), motor potential (MP), P3b, P420, and two slow wave components; SW1 and SW2. N1-1, PN, and P2 were stimulus-specific, whereas, RN2, MP, and P420 were response-specific; P3b, SW1, and SW2 were common to both data sets. P3b, SW1, and SW2 were significantly larger in the response-locked data, indicating that they were primarily response-related. RT, RT variability, and omission errors were predicted by various stimulus- and response-related components, providing further insight into ERP markers of auditory information processing and cognitive control. Further, the results of this study indicate the utility of quantifying some common components (i.e., Go P3b, SW1, and SW2) using the response-locked ERP.

Sedative-hypnotic drugs not only increase sedation, but also impair memory as serum concentration increases. These drugs also produce profound changes in the auditory event-related potential (ERP). The ability of various ERP components to predict changes in sedation and memory produced by various drugs was tested. Sixty-five healthy volunteers randomly received intravenous placebo, midazolam, propofol, thiopental, fentanyl with ondansetron, or ondansetron alone at five different stable target concentrations (three increasing, two decreasing) using a computer-controlled infusion pump to produce varying degrees of sedation without loss of consciousness. ERPs were recorded while volunteer participants detected a deviant auditory stimulus and made a button-press response to a target tone (standard oddball paradigm, 80:20 ratio, to elicit a P3 response). At each target concentration, volunteers learned a list of 16 words. The predictive probabilities (Pk) of various ERP components were determined for word recognition at the end of the day (memory) and log reaction time to the deviant stimulus (sedation). The N2 latency of the ERP consistently predicted log reaction time in all groups (Pk +/- SE from 0.58 +/- 0.04 to 0.71 +/- 0.04). The N2P3 amplitude of the ERP was the best predictor of memory performance for midazolam (Pk, 0.63 +/- 0.04), propofol (Pk, 0.62 +/- 0.05), and thiopental (Pk, 0.66 +/- 0.04). There was a differential ability to predict memory performance from sedation for midazolam and propofol. Midazolam and propofol affect memory differentially from their sedative effects, and these are indexed by specific components of the auditory ERP. These components of the ERP are associated with specific, but not necessarily unique, neuroanatomic structures. Thus, these drugs act by additional mechanisms beyond general central nervous system depression to produce the effects of sedation and memory impairment.

Crowding occurs when an easily identified isolated stimulus is surrounded by stimuli with similar properties, making it very difficult to identify. Crowding is suggested as a mechanism that creates a bottleneck in object recognition and awareness. Recently, we showed that brief presentation times at the fovea resulted in a significant crowding effect on target identification, impaired the target's color awareness, and resulted in a slower reaction time. However, when tagging the target with a red letter, the crowding effect is abolished. Crowding is widely considered a grouping; hence, it is pre-attentive. An event-related potential (ERP) study that investigated the spatial-temporal properties of crowding suggested the involvement of higher-level visual processing. Here, we investigated whether ERP's components may be affected by crowding and tagging, and whether the temporal advantage of ERP can be utilized to gain further information about the crowding mechanism. The participants reported target identification using our standard foveal crowing paradigm. It is assumed that crowding occurs due to a suppressive effect; thus, it can be probed by changes in perceptual (N1, ~160 ms) and attentive (P3 ~300-400 ms) components. We found a suppression effect (less negative ERP magnitude) in N1 under foveal crowding, which was recovered under tagging conditions. ERP's amplitude components (N1 and P3) and the behavioral proportion correct are highly correlated. These findings suggest that crowding is an early grouping mechanism that may be combined with later processing involving the segmentation mechanism.

Event-related potentials (ERPs) evoked by key stimuli informing a subject about the forthcoming recognition of the global or local level of a hierarchical test figure were analyzed in 7-year-old children with different levels of maturity of the regulatory brain systems. Differences in both the initial ERP components P1, N1, and P2 (which reflect the analysis of the sensory characteristics and significance of a key stimulus) and the late components N3, Pc, and Nc (which reflect the preparation for the recognition of a subsequent test figure) were found. It was shown that, in children with frontal-thalamic regulatory system immaturity (FTRSI), the amplitude of the ERP component N1 is decreased in the caudal areas. In children with an immature bottom-up activation system, a decrease in the amplitude of initial ERP components in the caudal areas was observed in a broader time interval in components P1, N1, and P2. As compared to the control groups of children, in children with immature frontal-thalamic structures, components N3, Pc, and Nc were different in both the caudal and precentral areas. In children with immature lower brainstem activation structures, the late ERP components were different, predominantly, in the parietal and temporo-parieto-occipital areas. Comparison of ERPs in response to global and local key stimuli in children of the control group demonstrated a clear-cut temporal and topographical organization in the period of preparation for subsequent recognition of a prescribed level of the test stimulus: the earlier preparation stages were associated with component N3 in the parietal and temporo-parieto-occipital areas, whereas later stages were associated with Pc changes in the frontal areas. In children with FTRSI, changes in the late components in the caudal areas were poorly expressed and their topographical organization (characteristic of the control group) was absent; the involvement of the frontal areas in the late stages of the key stimulus analysis was restricted. These findings may give grounds to suggest the significance of the frontal-thalamic system in the organization of the response to an expected stimulus. In children with immature lower brainstem activation structures, the type of the key stimulus was reflected in the late ERP components in a diffuse way.

Time effects on event-related brain potentials and vigilance performance

Although areas of frontal cortex are thought to be critical for maintaining information in visuospatial working memory, the event-related potential (ERP) index of maintenance is found over posterior cortex in humans. In the present study, we reconcile these seemingly contradictory findings. Here, we show that macaque monkeys and humans exhibit the same posterior ERP signature of working memory maintenance that predicts the precision of the memory-based behavioral responses. In addition, we show that the specific pattern of rhythmic oscillations in the alpha band, recently demonstrated to underlie the human visual working memory ERP component, is also present in monkeys. Next, we concurrently recorded intracranial local field potentials from two prefrontal and another frontal cortical area to determine their contribution to the surface potential indexing maintenance. The local fields in the two prefrontal areas, but not the cortex immediately posterior, exhibited amplitude modulations, timing, and relationships to behavior indicating that they contribute to the generation of the surface ERP component measured from the distal posterior electrodes. Rhythmic neural activity in the theta and gamma bands during maintenance provided converging support for the engagement of the same brain regions. These findings demonstrate that nonhuman primates have homologous electrophysiological signatures of visuospatial working memory to those of humans and that a distributed neural network, including frontal areas, underlies the posterior ERP index of visuospatial working memory maintenance.

The present study investigated the role of proficiency in late second-language (L2) processing using comparable stimuli in German and Italian. Both sets of stimuli consisted of simple active sentences including a word category violation, a morphosyntactic agreement violation, or a combination of the two. Four experiments were conducted to study high- and low-proficiency L2 learners of German as well as high- and low-proficiency L2 learners of Italian. High-proficiency L2 learners in both languages showed the same event-related potential (ERP) components as native speakers for all syntactic violations. For the word category violation, they displayed an early anterior negativity (ELAN), an additional negativity reflecting reference-related processes, and a late P600 evidencing processes of reanalysis. For the processing of the morphosyntactic error, an anterior negativity (LAN) and a P600 were observed, whereas for the combined violation, the same ERP components were found as in the pure category violation. In high-proficiency L2 learners, the timing of the processing steps was equivalent to that of native speakers, although some amplitude differences were present. Low-proficiency L2 learners, however, showed qualitative differences in the agreement violation characterized by the absence of the LAN and quantitative differences reflected in a delayed P600 in every violation condition. These findings emphasize that with a high proficiency, late L2 learners can indeed show native-like neural responses with the timing approximating that of native speakers. This challenges the idea that there are fundamental differences in language processing in the brain between natives and late L2 learners.

Baddeley's influential model of working memory postulates a unitary central executive that allocates mental resources to several distinct short-term buffers. Subjects viewed individually presented single numerals and were required to maintain memory sets comprised of the most recently represented three stimuli. A clearly discernible visual event-related potentials (ERP) component emerged once the lengths of series of individual numbers exceeded memory set size and revision of working memory contents was required. An ERP correlate of working memory revision also emerged upon updating of auditory stimuli. This component was absent when subjects were exposed to the same series of stimuli in a standard “oddball” target detection situation. ERPs elicited when subjects were given the opportunity to rehearse without the need to update working memory contents clearly differed in latency from ERPs seen during updating. These findings provide support for previous studies suggesting a specific ERP correlate of central executive processes in working memory and are consistent with Baddeley's model.

The complex multidimensional visual patterns of facial expression is particularly well suited for studying perception and the processes underlying perceptual integration of component parts into a meaningful whole. With the high resolution in milliseconds, event-related potential (ERP) may be an excellent technique to track the time course of cognitive processing for facial emotions. Facial affective stimuli elicit particular ERP components involved in early processing of facial expressions, including: early sensory processing of visual stimuli: the P100; early structural encoding of facial features: the N170; second-order sustained activities necessary for consequent deeper processing: the posterior P2 and decoding of facial features to identify emotional content: the N250. We reviewed above mentioned ERP components respectively, in order to add the knowledge about ERP components as indicators of neural dynamics of facial emotion processing, and to provide a point of reference for further exploration on facial emotion processing that may be useful for understanding human cognition development and pathology. Key words: Face; Emotion; ERP; P100; N170; P2; N250

Event-related potential correlates of color selection and lexical decision: hierarchical processing or late selection?

A wavelet based algorithm for the identification of oscillatory event-related potential components.

Lack of repetition priming effect on visual event-related potentials in schizophrenia

To study visual event-related potentials (ERPs) associated with presentation of erotic pictures in backward masking condition in order to investigate perception, attention and information processing underlying the initiation and maintenance of abnormal sexual behavior in pedophilia. Participants (58 males committed sexual offenses against children) were divided into the pedophilia group (n=38) and the control group without disorders of sexual preference (n=20). Three types of stimuli were used: neutral pictures of nature (S1), adult heterosexual erotic pictures (S2) and erotic pictures with children (S3). Posterior N1 (N140) and anterior N1 (N120) and P3 (P320) ERP components were included in analysis. In both groups, the perception of erotic stimuli was accompanied by a significant increase in the amplitude and prolongation of the latency of the N140 and P320 components (p<0.001). N140 changes were characterized by right-hemispheric bias in both groups, however, asymmetry was observed for amplitude in the control group, and for latency - in the pedophilia group; besides, reactivity to S3 stimuli was weaker than to S2 ones in the pedophilia group. N120 amplitude was elevated significantly in response to S2 stimuli in the control group, and no changes were found in the pedophilia group. Between-group differences were revealed for early negative components N140 and N120, which parameters were entered as predictors into classification model based on discriminant analysis. The obtained accuracy of model was 87.23%. The specificity of neurophysiological reactions to erotic pictures in pedophilic patients corroborates the concept of disease as general neurodevelopmental disorder.