Supporting Change Detection in Complex Dynamic Situations: Does the CHEX Serve its Purpose?

Numerous studies have demonstrated that observers often fail to notice large changes in visual scenes, a phenomenon known as change blindness. Some experiments have suggested that phenomenological experience in change blindness experiments is more diverse than the common distinction between change detection and change blindness allows to resolve. Recently, it has been debated whether changes in visual scenes can be detected ("sensed") without a corresponding perception of the changing object ("seeing") and whether these phenomena build on fundamentally different perceptual processes. The present study investigated whether phenomenologically different perceptual processes such as sensing and seeing rely on different or similar neural processes. We studied ERP effects of visual change processing (as compared to change blindness) when observers merely detected the presence of a change ("sensing") and when they identified the changing object in addition to detection ("seeing"). Although the visual awareness negativity (VAN)/selection negativity was similar for detection with and without identification, a change-related positivity and the N2pc contralateral to changes were found exclusively when the change was fully identified. This finding indicates that change identification requires perceptual and neural processes that are not involved in mere detection. In a second experiment, we demonstrated that the VAN and N2pc effects are similar to effects of selective attention in a visual search task. By contrast, the change-related positivity was specific for conscious processing of visual changes. The results suggest that changes can be detected ("sensed") without perception of the changing object. Furthermore, sensing and seeing seem to rely on different neural processes and seem to constitute different types of visual perception. These findings bear implications for how different categories of visual awareness are related to different stages in visual processing.

People often fail to detect large changes to visual scenes following a brief interruption, an effect known as ‘change blindness’. People with autism spectrum conditions (ASC) have superior attention to detail and better discrimination of targets, and often notice small details that are missed by others. Together these predict people with autism should show enhanced perception of changes in simple change detection paradigms, including reduced change blindness. However, change blindness studies to date have reported mixed results in ASC, which have sometimes included no differences to controls or even enhanced change blindness. Attenuated change blindness has only been reported to date in ASC in children and adolescents, with no study reporting reduced change blindness in adults with ASC. The present study used a change blindness flicker task to investigate the detection of changes in images of everyday life in adults with ASC (n = 22) and controls (n = 22) using a simple change detection task design and full range of original scenes as stimuli. Results showed the adults with ASC had reduced change blindness compared to adult controls for changes to items of marginal interest in scenes, with no group difference for changes to items of central interest. There were no group differences in overall response latencies to correctly detect changes nor in the overall number of missed detections in the experiment. However, the ASC group showed greater missed changes for marginal interest changes of location, showing some evidence of greater change blindness as well. These findings show both reduced change blindness to marginal interest changes in ASC, based on response latencies, as well as greater change blindness to changes of location of marginal interest items, based on detection rates. The findings of reduced change blindness are consistent with clinical reports that people with ASC often notice small changes to less salient items within their environment, and are in-line with theories of enhanced local processing and greater attention to detail in ASC. The findings of lower detection rates for one of the marginal interest conditions may be related to problems in shifting attention or an overly focused attention spotlight.

Change blindness is a phenomenon of visual attention, whereby changes to a visual display go unnoticed under certain specific circumstances. While many laboratory procedures have been developed that produce change blindness in humans, the flicker paradigm has emerged as a particularly effective method. In the flicker paradigm, two visual displays are presented in alternation with one another. If successive displays are separated by a short inter-stimulus interval (ISI), change detection is impaired. The simplicity of the procedure and the clear, performance-based operational definition of change blindness make the flicker paradigm well-suited to comparative research using nonhuman animals. Indeed, a variant has been developed that can be implemented in operant chambers to study change blindness in pigeons. Results indicate that pigeons, like humans, are worse at detecting the location of a change if two consecutive displays are separated in time by a blank ISI. Furthermore, pigeons' change detection is consistent with an active, location-by-location search process that requires selective attention. The flicker task thus has the potential to contribute to investigations of the dynamics of pigeons' selective spatial attention in comparison to humans. It also illustrates that the phenomenon of change blindness is not exclusive to humans' visual perception, but may instead be a general consequence of selective attention. Finally, while the useful aspects of attention are widely appreciated and understood, it is also important to acknowledge that they may be accompanied by specific imperfections such as change blindness, and that these imperfections have consequences across a wide range of contexts.

Using a machine-learning classification algorithm applied to near-infrared spectroscopy (NIRS) signals, we classify a success (change detection) or a failure (change blindness) in detecting visual changes for a change-detection task. Five subjects perform a change-detection task, and their brain activities are continuously monitored. A support-vector-machine algorithm is applied to classify the change-detection and change-blindness trials, and correct classification probability of 70-90% is obtained for four subjects. Two types of temporal shapes in classification probabilities are found: one exhibiting a maximum value after the task is completed (postdictive type), and another exhibiting a maximum value during the task (predictive type). As for the postdictive type, the classification probability begins to increase immediately after the task completion and reaches its maximum in about the time scale of neuronal hemodynamic response, reflecting a subjective report of change detection. As for the predictive type, the classification probability shows an increase at the task initiation and is maximal while subjects are performing the task, predicting the task performance in detecting a change. We conclude that decoding change detection and change blindness from NIRS signal is possible and argue some future applications toward brain-machine interfaces.

Change detection evokes a Simon-like effect

Change blindness is often taken as evidence that visual representations are impoverished, while successful recognition of specific objects is taken as evidence that they are richly detailed. In the current experiments, participants performed cover tasks that required each object in a display to be attended. Change detection trials were unexpectedly introduced and surprise recognition tests were given for nonchanging displays. For both change detection and recognition, participants had to distinguish objects from the same basic-level category, making it likely that specific visual information had to be used for successful performance. Although recognition was above chance, incidental change detection usually remained at floor. These results help reconcile demonstrations of poor change detection with demonstrations of good memory because they suggest that the capability to store visual information in memory is not reflected by the visual system's tendency to utilize these representations for purposes of detecting unexpected changes.

Despite the importance of change detection (CD) for visual perception and for performance in our environment, observers often miss changes that should be easily noticed. In the present study, we employed time-frequency analysis to investigate the neural activity associated with CD and change blindness (CB). Observers were presented with two successive visual displays and had to look for a change in orientation in any one of four sinusoid gratings between both displays. Theta power increased widely over the scalp after the second display when a change was consciously detected. Relative to no-change and CD, CB was associated with a pronounced theta power enhancement at parietal-occipital and occipital sites and broadly distributed alpha power suppression during the processing of the prechange display. Finally, power suppressions in the beta band following the second display show that, even when a change is not consciously detected, it might be represented to a certain degree. These results show the potential of time-frequency analysis to deepen our knowledge of the temporal curse of the neural events underlying CD. The results further reveal that the process resulting in CB begins even before the occurrence of the change itself.

Is the n-back task a measure of unstructured working memory capacity? Towards understanding its connection to other working memory tasks

One promising means of overcoming data overload in complex domains is through the introduction of tactile displays, which can offload the overburdened visual channel. However, the effectiveness of tactile displays depends on taking into consideration attentional systems and the limitations of the human perception. One important question is the extent to which the tactile modality is susceptible to change blindness, i.e. the failure to detect even large and expected changes when these changes coincide with a “transient” stimulus. Recent research has demonstrated an analog of change blindness in the tactile modality for pattern change recognition. The present study examined whether tactile change blindness, as well as crossmodal visual-tactile change blindness, occurs in the context of search and monitoring tasks, and whether it is affected by the addition of a secondary task. The application domain for this experiment was simulated Unmanned Aerial Vehicle control. The findings confirmed the occurrence of tactile change blindness; however, no crossmodal change blindness was observed and change detection was unaffected by the addition of a secondary search task. Overall, this research add to the knowledge base in multimodal and redundant information processing and can inform the design of multimodal displays for complex, data-rich domains.

The presence of a change in a visual scene can influence brain activity and behavior, even in the absence of full conscious report. It may be possible for us to sense that such a change has occurred, even if we cannot specify exactly where or what it was. Despite existing evidence from electroencephalogram (EEG) and eye-tracking data, it is still unclear how this partial level of awareness relates to functional magnetic resonance imaging (fMRI) blood oxygen level dependent (BOLD) activation. Using EEG, fMRI, and a change blindness paradigm, we found multi-modal evidence to suggest that sensing a change is distinguishable from being blind to it. Specifically, trials during which participants could detect the presence of a colour change but not identify the location of the change (sense trials), were compared to those where participants could both detect and localise the change (localise or see trials), as well as change blind trials. In EEG, late parietal positivity and N2 amplitudes were larger for localised changes only, when compared to change blindness. However, ERP-informed fMRI analysis found no voxels with activation that significantly co-varied with fluctuations in single-trial late positivity amplitudes. In fMRI, a range of visual (BA17,18), parietal (BA7,40), and mid-brain (anterior cingulate, BA24) areas showed increased fMRI BOLD activation when a change was sensed, compared to change blindness. These visual and parietal areas are commonly implicated as the storage sites of visual working memory, and we therefore argue that sensing may not be explained by a lack of stored representation of the visual display. Both seeing and sensing a change were associated with an overlapping occipitoparietal network of activation when compared to blind trials, suggesting that the quality of the visual representation, rather than the lack of one, may result in partial awareness during the change blindness paradigm.

Our visual system receives an enormous amount of information, but not all information is retained. This is exemplified by the fact that subjects fail to detect large changes in a visual scene, i.e., change-blindness. Current theories propose that our ability to detect these changes is influenced by the gist or interpretation of an image. On the other hand, stimulus-driven image features such as contrast energy dominate the representation in early visual cortex (De Valois and De Valois, 1988; Boynton et al., 1999; Olman et al., 2004; Mante and Carandini, 2005; Dumoulin et al., 2008). Here we investigated whether contrast energy contributes to our ability to detect changes within a visual scene. We compared the ability to detect changes in contrast energy together with changes to a measure of the interpretation of an image. We used subjective important aspects of the image as a measure of the interpretation of an image. We measured reaction times while manipulating the contrast energy and subjective important properties using the change blindness paradigm. Our results suggest that our ability to detect changes in a visual scene is not only influenced by the subjective importance, but also by contrast energy. Also, we find that contrast energy and subjective importance interact. We speculate that contrast energy and subjective important properties are not independently represented in the visual system. Thus, our results suggest that the information that is retained of a visual scene is both influenced by stimulus-driven information as well as the interpretation of a scene.

Observers often miss visual changes in the environment when they co-occur with other visual disruptions. This phenomenon is called change blindness. Previous research has shown that change blindness increases with age. The aim of the current study was to explore the role of post-perceptual stimulus processing in age differences. Therefore, the P3 component of the event-related potential was measured while younger, middle-aged, and older participants performed a change detection task under different task demands. Older adults detected fewer changes than younger adults, even when the task was very easy. Detected changes elicited greater P3 amplitudes than undetected changes in younger adults. This effect was reduced or even absent for middle-aged and older participants, irrespective of task demands. Because this P3 effect is supposed to reflect participants' confidence in change detection, less confidence in own responses may explain the decline of change detection performance in normal aging.

Change detection is essential for visual perception and performance in our environment. However, observers often miss changes that should be easily noticed. A failure in any of the processes involved in conscious detection (encoding the pre-change display, maintenance of that information within working memory, and comparison of the pre and post change displays) can lead to change blindness. Given that unnoticed visual changes in a scene can be easily detected once attention is drawn to them, it has been suggested that attention plays an important role on visual awareness. In the present study, we used behavioral and electrophysiological (ERPs) measures to study whether the manipulation of retrospective spatial attention affects performance and modulates brain activity related to the awareness of a change. To that end, exogenous peripheral cues were presented during the delay period (retro-cues) between the first and the second array using a one-shot change detection task. Awareness of a change was associated with a posterior negative amplitude shift around 228–292 ms (“Visual Awareness Negativity”), which was independent of retrospective spatial attention, as it was elicited to both validly and invalidly cued change trials. Change detection was also associated with a larger positive deflection around 420–580 ms (“Late Positivity”), but only when the peripheral retro-cues correctly predicted the change. Present results confirm that the early and late ERP components related to change detection can be functionally dissociated through manipulations of exogenous retro-cueing using a change blindness paradigm.

The effect of healthy aging on change detection and sensitivity to predictable structure in crowded acoustic scenes

Change blindness refers to the inability to detect visual changes if introduced together with an eye-movement, blink, flash of light, or with distracting stimuli. Evidence of implicit detection of changed visual features during change blindness has been reported in a number of studies using both behavioral and neurophysiological measurements. However, it is not known whether implicit detection occurs only at the level of single features or whether complex organizations of features can be implicitly detected as well. We tested this in adult humans using intact and scrambled versions of schematic faces as stimuli in a change blindness paradigm while recording event-related potentials (ERPs). An enlargement of the face-sensitive N170 ERP component was observed at the right temporal electrode site to changes from scrambled to intact faces, even if the participants were not consciously able to report such changes (change blindness). Similarly, the disintegration of an intact face to scrambled features resulted in attenuated N170 responses during change blindness. Other ERP deflections were modulated by changes, but unlike the N170 component, they were indifferent to the direction of the change. The bidirectional modulation of the N170 component during change blindness suggests that implicit change detection can also occur at the level of complex features in the case of facial stimuli.