Attentional Modulation of Change Detection ERP Components by Peripheral Retro-Cueing

Numerous studies have demonstrated that observers often fail to notice large changes in visual scenes, a phenomenon known as change blindness. Some experiments have suggested that phenomenological experience in change blindness experiments is more diverse than the common distinction between change detection and change blindness allows to resolve. Recently, it has been debated whether changes in visual scenes can be detected ("sensed") without a corresponding perception of the changing object ("seeing") and whether these phenomena build on fundamentally different perceptual processes. The present study investigated whether phenomenologically different perceptual processes such as sensing and seeing rely on different or similar neural processes. We studied ERP effects of visual change processing (as compared to change blindness) when observers merely detected the presence of a change ("sensing") and when they identified the changing object in addition to detection ("seeing"). Although the visual awareness negativity (VAN)/selection negativity was similar for detection with and without identification, a change-related positivity and the N2pc contralateral to changes were found exclusively when the change was fully identified. This finding indicates that change identification requires perceptual and neural processes that are not involved in mere detection. In a second experiment, we demonstrated that the VAN and N2pc effects are similar to effects of selective attention in a visual search task. By contrast, the change-related positivity was specific for conscious processing of visual changes. The results suggest that changes can be detected ("sensed") without perception of the changing object. Furthermore, sensing and seeing seem to rely on different neural processes and seem to constitute different types of visual perception. These findings bear implications for how different categories of visual awareness are related to different stages in visual processing.

Neural correlates of conscious processing of emotional faces: Evidence from event-related potentials

The presence of a change in a visual scene can influence brain activity and behavior, even in the absence of full conscious report. It may be possible for us to sense that such a change has occurred, even if we cannot specify exactly where or what it was. Despite existing evidence from electroencephalogram (EEG) and eye-tracking data, it is still unclear how this partial level of awareness relates to functional magnetic resonance imaging (fMRI) blood oxygen level dependent (BOLD) activation. Using EEG, fMRI, and a change blindness paradigm, we found multi-modal evidence to suggest that sensing a change is distinguishable from being blind to it. Specifically, trials during which participants could detect the presence of a colour change but not identify the location of the change (sense trials), were compared to those where participants could both detect and localise the change (localise or see trials), as well as change blind trials. In EEG, late parietal positivity and N2 amplitudes were larger for localised changes only, when compared to change blindness. However, ERP-informed fMRI analysis found no voxels with activation that significantly co-varied with fluctuations in single-trial late positivity amplitudes. In fMRI, a range of visual (BA17,18), parietal (BA7,40), and mid-brain (anterior cingulate, BA24) areas showed increased fMRI BOLD activation when a change was sensed, compared to change blindness. These visual and parietal areas are commonly implicated as the storage sites of visual working memory, and we therefore argue that sensing may not be explained by a lack of stored representation of the visual display. Both seeing and sensing a change were associated with an overlapping occipitoparietal network of activation when compared to blind trials, suggesting that the quality of the visual representation, rather than the lack of one, may result in partial awareness during the change blindness paradigm.

Change blindness refers to the inability to detect visual changes if introduced together with an eye-movement, blink, flash of light, or with distracting stimuli. Evidence of implicit detection of changed visual features during change blindness has been reported in a number of studies using both behavioral and neurophysiological measurements. However, it is not known whether implicit detection occurs only at the level of single features or whether complex organizations of features can be implicitly detected as well. We tested this in adult humans using intact and scrambled versions of schematic faces as stimuli in a change blindness paradigm while recording event-related potentials (ERPs). An enlargement of the face-sensitive N170 ERP component was observed at the right temporal electrode site to changes from scrambled to intact faces, even if the participants were not consciously able to report such changes (change blindness). Similarly, the disintegration of an intact face to scrambled features resulted in attenuated N170 responses during change blindness. Other ERP deflections were modulated by changes, but unlike the N170 component, they were indifferent to the direction of the change. The bidirectional modulation of the N170 component during change blindness suggests that implicit change detection can also occur at the level of complex features in the case of facial stimuli.

The level of processing hypothesis (LoP) proposes that the transition from unaware to aware visual perception is graded for low-level (i.e., energy, features) stimulus whereas dichotomous for high-level (i.e., letters, words, meaning) stimulus. In this study, we explore the behavioral patterns and neural correlates associated with different depths (i.e., low vs. high) of stimulus processing. The low-level stimulus condition consisted of identifying the color (i.e., blue/blueish vs. red/reddish) of the target, and the high-level stimulus condition consisted of identifying stimulus category (animal vs. object). Behavioral results showed that the levels of processing manipulation produced significant differences in both the awareness rating distributions and accuracy performances between tasks, the low-level task producing more intermediate subjective ratings and linearly increasing accuracy performances and the high-level task producing less intermediate ratings and a more nonlinear pattern for accuracies. The electrophysiological recordings revealed two correlates of visual awareness, an enhanced posterior negativity in the N200 time window (visual awareness negativity [VAN]), and an enhanced positivity in the P3 time window (late positivity [LP]). The analyses showed a double dissociation between awareness and the level of processing hypothesis manipulation: Awareness modulated VAN amplitudes only in the low-level color task, whereas LP amplitude modulations were observed only in the higher level category task. These findings are compatible with a two-stage microgenesis model of conscious perception, where an early elementary phenomenal sensation of the stimulus (i.e., the subjective perception of color) would be indexed by VAN, whereas stimulus' higher level properties (i.e., the category of the target) would be reflected in the LP in a later latency range.

Late Positivity Correlates with Subjective Reports: Evidence from the Low-frequency and High-frequency Reporting Tasks

One theory of visual awareness proposes that electrophysiological activity related to awareness occurs in primary visual areas approximately 200 ms after stimulus onset (visual awareness negativity: VAN) and in fronto-parietal areas about 300 ms after stimulus onset (late positivity: LP). Although similar processes might be involved in auditory awareness, only sparse evidence exists for this idea. In the present study, we recorded electrophysiological activity while subjects listened to tones that were presented at their own awareness threshold. The difference in electrophysiological activity elicited by tones that subjects reported being aware of versus unaware of showed an early negativity about 200 ms and a late positivity about 300 ms after stimulus onset. These results closely match those found in vision and provide convincing evidence for an early negativity (auditory awareness negativity: AAN), as well as an LP. These findings suggest that theories of visual awareness are also applicable to auditory awareness.

Using a machine-learning classification algorithm applied to near-infrared spectroscopy (NIRS) signals, we classify a success (change detection) or a failure (change blindness) in detecting visual changes for a change-detection task. Five subjects perform a change-detection task, and their brain activities are continuously monitored. A support-vector-machine algorithm is applied to classify the change-detection and change-blindness trials, and correct classification probability of 70-90% is obtained for four subjects. Two types of temporal shapes in classification probabilities are found: one exhibiting a maximum value after the task is completed (postdictive type), and another exhibiting a maximum value during the task (predictive type). As for the postdictive type, the classification probability begins to increase immediately after the task completion and reaches its maximum in about the time scale of neuronal hemodynamic response, reflecting a subjective report of change detection. As for the predictive type, the classification probability shows an increase at the task initiation and is maximal while subjects are performing the task, predicting the task performance in detecting a change. We conclude that decoding change detection and change blindness from NIRS signal is possible and argue some future applications toward brain-machine interfaces.

Electrophysiological recordings are commonly used to study the neural correlates of consciousness in humans. Previous research is inconsistent as to whether awareness can be indexed with visual awareness negativity (VAN) at about 200 ms or if it occurs later. The present study was preregistered with two main aims: First, to provide independent evidence for or against the presence of VAN, and second, to study whether stimulus size may account for the inconsistent findings. Subjects were shown low-contrast Gaussian filtered gratings (Gabor patches) in the four visual quadrants. Gabor size (large and small) was varied in different sessions and calibrated to each subject’s threshold of visual awareness. Event-related potentials were derived from trials in which subjects localized the Gabors correctly to capture the difference between trials in which they reported awareness versus no awareness. Bayesian analyses revealed very strong evidence for the presence of VAN for both Gabor sizes. However, there was no evidence for or against an effect of stimulus size. The present findings provide evidence for VAN as an early neural correlate of awareness.

Observers often miss visual changes in the environment when they co-occur with other visual disruptions. This phenomenon is called change blindness. Previous research has shown that change blindness increases with age. The aim of the current study was to explore the role of post-perceptual stimulus processing in age differences. Therefore, the P3 component of the event-related potential was measured while younger, middle-aged, and older participants performed a change detection task under different task demands. Older adults detected fewer changes than younger adults, even when the task was very easy. Detected changes elicited greater P3 amplitudes than undetected changes in younger adults. This effect was reduced or even absent for middle-aged and older participants, irrespective of task demands. Because this P3 effect is supposed to reflect participants' confidence in change detection, less confidence in own responses may explain the decline of change detection performance in normal aging.

Visual awareness was studied in 11 subjects by using coherent and scrambled objects as stimuli. The stimuli were presented near the subjective perceptual threshold. Explicitly recognized stimuli elicited a specific negative ERP deflection peaking at 460 ms. Our reaction time experiment suggests that this visual awareness negativity (VAN) is similar to that found previously at a shorter latency. We propose that VAN might reflect the exact moment of becoming aware of the task-relevant stimulus properties and provide an online marker of the temporal dynamics of visual awareness.

People often fail to detect large changes to visual scenes following a brief interruption, an effect known as ‘change blindness’. People with autism spectrum conditions (ASC) have superior attention to detail and better discrimination of targets, and often notice small details that are missed by others. Together these predict people with autism should show enhanced perception of changes in simple change detection paradigms, including reduced change blindness. However, change blindness studies to date have reported mixed results in ASC, which have sometimes included no differences to controls or even enhanced change blindness. Attenuated change blindness has only been reported to date in ASC in children and adolescents, with no study reporting reduced change blindness in adults with ASC. The present study used a change blindness flicker task to investigate the detection of changes in images of everyday life in adults with ASC (n = 22) and controls (n = 22) using a simple change detection task design and full range of original scenes as stimuli. Results showed the adults with ASC had reduced change blindness compared to adult controls for changes to items of marginal interest in scenes, with no group difference for changes to items of central interest. There were no group differences in overall response latencies to correctly detect changes nor in the overall number of missed detections in the experiment. However, the ASC group showed greater missed changes for marginal interest changes of location, showing some evidence of greater change blindness as well. These findings show both reduced change blindness to marginal interest changes in ASC, based on response latencies, as well as greater change blindness to changes of location of marginal interest items, based on detection rates. The findings of reduced change blindness are consistent with clinical reports that people with ASC often notice small changes to less salient items within their environment, and are in-line with theories of enhanced local processing and greater attention to detail in ASC. The findings of lower detection rates for one of the marginal interest conditions may be related to problems in shifting attention or an overly focused attention spotlight.

Change detection is required in monitoring and managing complex situations such as air traffic control. Considering that change blindness—the incapacity to detect changes in a visual scene—is a considerable source of human errors and that most studies on change detection have involved static visual scenes, it is crucial to evaluate existing tools designed to help this cognitive function in complex dynamic situations. The goal of the present study was to determine the efficacy of the Change History Explicit (CHEX)—a tool already proven effective when explicit change detection is the only task to execute—when change detection is implicit and intrinsic to a more complex task. Results revealed that the CHEX failed to improve implicit change detection when this task was embedded in a threat-evaluation and weapon-assignment (TEWA) task. Moreover, TEWA performance was hindered and mental workload was perceived as higher when the CHEX was available. Even when the information load imposed by the CHEX was reduced, the tool remained ineffective. This suggests that the nature of the change detection task should be taken into account when designing a decision support system.

Change blindness is a phenomenon of visual attention, whereby changes to a visual display go unnoticed under certain specific circumstances. While many laboratory procedures have been developed that produce change blindness in humans, the flicker paradigm has emerged as a particularly effective method. In the flicker paradigm, two visual displays are presented in alternation with one another. If successive displays are separated by a short inter-stimulus interval (ISI), change detection is impaired. The simplicity of the procedure and the clear, performance-based operational definition of change blindness make the flicker paradigm well-suited to comparative research using nonhuman animals. Indeed, a variant has been developed that can be implemented in operant chambers to study change blindness in pigeons. Results indicate that pigeons, like humans, are worse at detecting the location of a change if two consecutive displays are separated in time by a blank ISI. Furthermore, pigeons' change detection is consistent with an active, location-by-location search process that requires selective attention. The flicker task thus has the potential to contribute to investigations of the dynamics of pigeons' selective spatial attention in comparison to humans. It also illustrates that the phenomenon of change blindness is not exclusive to humans' visual perception, but may instead be a general consequence of selective attention. Finally, while the useful aspects of attention are widely appreciated and understood, it is also important to acknowledge that they may be accompanied by specific imperfections such as change blindness, and that these imperfections have consequences across a wide range of contexts.

Change blindness is often taken as evidence that visual representations are impoverished, while successful recognition of specific objects is taken as evidence that they are richly detailed. In the current experiments, participants performed cover tasks that required each object in a display to be attended. Change detection trials were unexpectedly introduced and surprise recognition tests were given for nonchanging displays. For both change detection and recognition, participants had to distinguish objects from the same basic-level category, making it likely that specific visual information had to be used for successful performance. Although recognition was above chance, incidental change detection usually remained at floor. These results help reconcile demonstrations of poor change detection with demonstrations of good memory because they suggest that the capability to store visual information in memory is not reflected by the visual system's tendency to utilize these representations for purposes of detecting unexpected changes.