Task-Irrelevant Features in Visual Working Memory Influence Covert Attention: Evidence from a Partial Report Task.

Two hypotheses have been proposed to explain the formation manner for visual working memory (VWM) representations during the consolidation process: an all-or-none process hypothesis and a coarse-to-fine process hypothesis. However, neither the all-or-none process hypothesis nor the coarse-to-fine process hypothesis can stipulate clearly how VWM representations are formed during the consolidation process. In the current study, we propose a two-stage process hypothesis to reconcile these hypotheses. The two-stage process hypothesis suggests that the consolidation of coarse information is an all-or-none process in the early consolidation stage, while the consolidation of detailed information is a coarse-to-fine process in the late consolidation stage. By systematically manipulating the encoding time of memory stimuli, we asked participants to memorize one (Experiment 1) or two (Experiment 2) orientations in different encoding time intervals. We found that the memory rate increased linearly as the encoding time increased. More importantly, VWM precision remained constant when the encoding time was short, while the precision increased linearly as the encoding time increased when the encoding time was sufficient. These results supported the two-stage process hypothesis, which reconciles previous conflicting findings in the literature.

Although it is well accepted that the formation of visual working memory (VWM) representations from simple static features is a rapid and effortless process that completes within several hundred milliseconds, the storage of motion information in VWM within that time scale can be challenging due to the limited processing capacity of the visual system. Memory formation can also be demanding especially when motion stimuli are visually complex. Here, we investigated whether the formation of VWM representations of motion direction is more gradual than that of static orientation and examined the effects of stimulus complexity on that process. To address these issues, we examined how the number and the precision of stored items in VWM develop over time by using a continuous report procedure. Results showed that while a viewing duration of several seconds was required for the successful storage of multiple motion directions in VWM regardless of motion complexity, the accumulation of memory precision was much slower when the motion stimulus was visually complex (Experiments 1 & 2). Additional experiments showed that the difference in memory performance for simple and complex motion stimuli cannot be explained by differences in signal-to-noise levels of the stimulus (Experiment 3). These results demonstrate remarkable temporal limitations in the formation of VWM representations for dynamic objects, and further show how this process is affected by stimulus properties such as visual complexity and signal-to-noise levels.

Multiple representations in visual working memory simultaneously guide attention: The type of memory-matching representation matters

Working memory (WM) is limited in capacity, but it is controversial whether these capacity limitations are domain-general or are generated independently within separate modality-specific memory systems. These alternative accounts were tested in bimodal visual/tactile WM tasks. In Experiment 1, participants memorized the locations of simultaneously presented task-relevant visual and tactile stimuli. Visual and tactile WM load was manipulated independently (one, two, or three items per modality), and one modality was unpredictably tested after each trial. To track the activation of visual and tactile WM representations during the retention interval, the visual contralateral delay activity (CDA) and tactile CDA (tCDA) were measured over visual and somatosensory cortex, respectively. CDA and tCDA amplitudes were selectively affected by WM load in the corresponding (tactile or visual) modality. The CDA parametrically increased when visual load increased from one to two and to three items. The tCDA was enhanced when tactile load increased from one to two items and showed no further enhancement for three tactile items. Critically, these load effects were strictly modality-specific, as substantiated by Bayesian statistics. Increasing tactile load did not affect the visual CDA, and increasing visual load did not modulate the tCDA. Task performance at memory test was also unaffected by WM load in the other (untested) modality. This was confirmed in a second behavioral experiment where tactile and visual loads were either two or four items, unimodal baseline conditions were included, and participants performed a color change detection task in the visual modality. These results show that WM capacity is not limited by a domain-general mechanism that operates across sensory modalities. They suggest instead that WM storage is mediated by distributed modality-specific control mechanisms that are activated independently and in parallel during multisensory WM.

In daily life, people frequently need to observe dynamic objects and temporarily maintain their representations in visual working memory (VWM). The present study explored the mechanism underlying the binding between perceptual features and locations of dynamic objects in VWM. In three experiments, we measured and compared the memory performance for feature-location binding of multiple dynamic and static objects. The results showed that the feature-location binding was impaired for the dynamic objects compared with the static objects. The impairment persisted when the global spatial configuration of the objects remained intact during the motion, as well as when the binding task was relatively easy, such as binding between single-feature objects and coarse locations. The results indicate that object features and locations are not maintained in VWM as well-integrated object files; rather, the formation of feature-location binding may require additional processes, which are disrupted by the constant change of locations in dynamic circumstances. We propose a consolidation process as possible underlying mechanism, and discuss factors that may influence the strength of feature-location binding in dynamic circumstances.

Visual working memory (VWM) is typically considered to represent complete objects—that is, separate parts of an object are maintained as bound objects. Yet it remains unclear whether and how the features of disparate parts are integrated into a whole-object memory representation. Using a change detection paradigm, the present study investigated whether VWM performance varies as a function of grouping strength for features that either determine the grouped object (orientation) or that are not directly grouping relevant (color). Our results showed a large grouping benefit for grouping-relevant orientation features and, additionally, a much smaller, albeit reliable, benefit for grouping-irrelevant color features when both were potentially task relevant. By contrast, when color was the only task-relevant feature, no grouping benefit from the orientation feature was revealed both under lower or relatively high demands for precision. Together, these results indicate that different features of an object are stored independently in VWM; and an emerging, higher-order grouping structure does not automatically lead to an integrated representation of all available features of an object. Instead, an object benefit depends on the specific task demands, which may generate a linked, task-dependent representation of independent features.

Attention has frequently been regarded as an emergent property of linking sensory representations to action plans. It has recently been proposed that similar mechanisms may operate within visual working memory (VWM), such that linking an object in VWM to an action plan strengthens its sensory memory representation, which then expresses as an attentional bias. Here we directly tested this hypothesis by comparing attentional biases induced by VWM representations which were the target of a future action, to those induced by VWM representations that were equally task-relevant, but not the direct target of action. We predicted that the first condition would result in a more prioritized memory state and hence stronger attentional biases. Specifically, participants memorized a geometric shape for a subsequent memory test. At test, in case of a match, participants either had to perform a grip movement on the matching object (action condition), or perform the same movement, but on an unrelated object (control condition). To assess any attentional biases, during the delay period between memorandum and test, participants performed a visual selection task in which either the target was surrounded by the memorized shape (congruent trials) or a distractor (incongruent trials). Eye movements were measured as a proxy for attentional priority. We found a significant interaction for saccade latencies between action condition and shape congruency, reflecting more pronounced VWM-based attentional biases in the action condition. Our results are consistent with the idea that action plans prioritize sensory representations in VWM.

Maintaining visual working memory (VWM) representations recruits a network of brain regions, including the frontal, posterior parietal, and occipital cortices; however, it is unclear to what extent the occipital cortex is engaged in VWM after sensory encoding is completed. Noninvasive brain stimulation data show that stimulation of this region can affect working memory (WM) during the early consolidation time period, but it remains unclear whether it does so by influencing the number of items that are stored or their precision. In this study, we investigated whether single-pulse transcranial magnetic stimulation (spTMS) to the occipital cortex during VWM consolidation affects the quantity or quality of VWM representations. In three experiments, we disrupted VWM consolidation with either a visual mask or spTMS to retinotopic early visual cortex. We found robust masking effects on the quantity of VWM representations up to 200 msec poststimulus offset and smaller, more variable effects on WM quality. Similarly, spTMS decreased the quantity of VWM representations, but only when it was applied immediately following stimulus offset. Like visual masks, spTMS also produced small and variable effects on WM precision. The disruptive effects of both masks and TMS were greatly reduced or entirely absent within 200 msec of stimulus offset. However, there was a reduction in swap rate across all time intervals, which may indicate a sustained role of the early visual cortex in maintaining spatial information.

How are images that have been assembled from their constituting elements maintained as a coherent representation in visual working memory (vWM)? Here, we compared two conditions of vWM maintenance that only differed in how vWM contents had been created. Participants maintained images that they either had to assemble from single features or that they had perceived as complete objects. Object complexity varied between two and four features. We analyzed electroencephalogram phase coupling as a measure of cortical connectivity in a time interval immediately before a probe stimulus appeared. We assumed that during this time both groups maintained essentially the same images, but that images constructed from their elements would require more neural coupling than images based on a complete percept. Increased coupling between frontal and parietal-to-occipital cortical sources was found for the maintenance of constructed in comparison to nonconstructed objects in the theta, alpha, beta, and gamma frequency bands. A similar pattern was found for an increase in vWM load (2 vs. 4 features) for nonconstructed objects. Under increased construction load (2 vs. 4 features for constructed images), the pattern was restricted to fronto-parietal couplings, suggesting that the fronto-parietal attention network is coping with the higher attentional demands involved in maintaining constructed images, but without increasing the communication with the occipital visual buffer in which the visual representations are assumed to be stored. We conclude from these findings that the maintenance of constructed images in vWM requires additional attentional processes to keep object elements together as a coherent representation. Hum Brain Mapp 37:4349-4362, 2016. © 2016 Wiley Periodicals, Inc.

Visual working memory (WM) can hold a limited amount of information for a short interval. The current study investigated whether the features of the objects maintained in WM are represented in a dependent or independent manner. Across five experiments, we presented multifeature objects (color and shape) and investigated whether remembering one feature is correlated with remembering the other feature. To answer this question, we divided the continuous response distribution into five quintiles according to the accuracy performance, then computed the area under the curve of the continuous response of the other feature, thus calculating the area under the curve for a given feature for each quintile of the other feature. A dependent object representation predicts a correlation between these measures, indicating that remembering one feature is correlated with remembering the other feature. In all five experiments, in which we used different stimuli (triangles or polygons), different memory exposure intervals (1,200 or 300 ms), and different response procedures (sequential or simultaneous responses), we found strong evidence for a dependency between the object's features. We conclude that this current analysis was able to reveal strong feature dependency in WM. These findings support the conclusion that visual WM relies on object-based representations and that all the objects' features are represented in a dependent manner. (PsycInfo Database Record (c) 2025 APA, all rights reserved).

Previous research has shown that retrospective gaze cues direct attention to internally maintained representations in visual working memory (vWM). Here, we aimed to differentiate the dual nature of gaze and accordingly proposed two hypotheses regarding the gaze-induced prioritization in vWM. The directional cueing hypothesis claims a constant attentional shifting to the gazed-at direction. By contrast, the referential cueing hypothesis proposes that gaze cues selectively orient attention toward their referents. To test these hypotheses, we employed an adapted change-detection task wherein gaze cues were presented during the retention interval. Critically, the cue character was positioned between two barriers, which could be either opaque (the blocked condition) or transparent (the unblocked condition). Polygons previously presented at the gazed-at (vs. gazed-away) location were better memorized, but not when the visual perspective of the character was obstructed (i.e., the blocked condition, Experiment 1). Subsequent experiments demonstrated that physical motion cues (Experiment 2) and inverted face cues (Experiment 3), which disrupted the extraction of referential signals, were immune to barrier settings. In Experiment 4, we generalize this selective cueing effect to faces with fearful expressions. These consistent findings support the referential cueing hypothesis and emphasize the distinctiveness of social attention. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Visual working memory (VWM) is an active representation enabling the manipulation of item information even in the absence of visual input. A common way to investigate VWM is to analyze the performance at later recall. This approach, however, leaves uncertainties about whether the variation of recall performance is attributable to item encoding and maintenance or to the testing of memorized information. Here, we record the contralateral delay activity (CDA), an established electrophysiological measure of item storage and maintenance, in human subjects performing a delayed orientation precision estimation task. This allows us to link the fluctuation of recall precision directly to the process of item encoding and maintenance. We show that for two sequentially encoded orientation items, the CDA amplitude reflects the precision of orientation recall of both items, with higher precision being associated with a larger amplitude. Furthermore, we show that the CDA amplitudes for the items vary independently from each other, suggesting that the precision of memory representations fluctuates independently.NEW & NOTEWORTHY The present work demonstrates for the first time that the contralateral delay activity (CDA), an online electrophysiological measure of the number of representations maintained in memory, is also a reliable measure of the precision of memory representations. Furthermore, we show that the CDA fluctuates independently for individual items held in memory, thereby providing unambiguous direct neurophysiological support for independently fluctuating memory representations.

Binding of non-spatial features in visual working memory (VWM), and the role of location in binding, remain unknown. Empirical evidence for and against feature binding in VWM has been based on null results. Object file theory postulates that spatiotemporal location is critical in maintenance of feature binding in VWM, but no evidence has been provided for the binding of feature conjunction to location. The current study combined the redundancy gain paradigm and the object reviewing paradigm to investigate the relationship between color-shape binding and location. A set of features was presented in a two-object memory display, followed by a single object probe. Participants judged if the probe contained any features of the memory display, regardless of location. The probe contained two, one, or zero features in the memory display (redundant trials, single-feature trials, or new trials, respectively). Within the redundant trials, the features were either grouped or separated. To investigate the role of location, single-feature and redundant-grouped trials were further classified into location-shared and location-unshared trials The race model analysis examined whether RT advantage of redundant over single-feature trials is due to probability summation, and revealed object-based feature co-activation regardless of location sharing between probe and memory objects, suggesting location-unbound binding of color and shape. Location-sharing benefits were obtained for both redundant and single-feature conditions, indicating maintenance of object files independent of non-spatial feature binding. Amplitude modulations in N350 ERP component reflecting the feature co-activation had the peak in a frontal region, whereas those reflecting the location-sharing benefit had the peak in a posterior region, suggesting different neural mechanisms for the maintenance of color-shape binding and object files. In a location-irrelevant task, color-shape binding is maintained without binding to location, inconsistent with object file theory. These novel findings suggest a parallel maintenance of type and token VWM representations. Meeting abstract presented at VSS 2015

As of yet, visual working memory (WM) training has failed to yield consistent cognitive benefits to performance in untrained tasks, despite large improvements in trained tasks. Investigating the mechanisms underlying training effects can help explain these inconsistencies. In this pre-registered, pre-test/post-test online training study, we examined how training affects the quantity and quality of representations in visual WM using continuous-reproduction tasks. N = 64 young healthy adults were randomly assigned to an experimental group or an active control group to complete four training sessions of practce in an orientation-reproduction or a visual search task, respectively. We observed that, in the trained task, only the quality, but not the quantity, of visual WM representations significantly increased in the experimental group relative to the control group. These improvements did not generalise to untrained stimuli or paradigms. Therefore, our findings suggest that training gains are not driven by enhanced capacity. Instead, gains in the quality of visual WM representations that are tied to specific stimuli and paradigms may reflect enhanced efficiency in using the existing visual WM capacity.

The content of visual working memory (VWM) guides attention, but whether this interaction is limited to a single VWM representation or functional for multiple VWM representations is under debate. To test this issue, we developed a gaze-contingent search paradigm to directly manipulate selection history and examine the competition between multiple cue-matching saccade target objects. Participants first saw a dual-color cue followed by two pairs of colored objects presented sequentially. For each pair, participants selectively fixated an object that matched one of the cued colors. Critically, for the second pair, the cued color from the first pair was presented either with a new distractor color or with the second cued color. In the latter case, if two cued colors in VWM interact with selection simultaneously, we expected the second cued color object to generate substantial competition for selection, even though the first cued color was used to guide attention in the immediately previous pair. Indeed, in the second pair, selection probability of the first cued color was substantially reduced in the presence of the second cued color. This competition between cue-matching objects provides strong evidence that both VWM representations interacted simultaneously with selection. (PsycINFO Database Record