FMRI reveals processing streams in action

Recent behavioral and neuroimaging studies using continuous flash suppression (CFS) have suggested that action-related processing in the dorsal visual stream might be independent of perceptual awareness, in line with the "vision-for-perception" versus "vision-for-action" distinction of the influential dual-stream theory. It remains controversial if evidence suggesting exclusive dorsal stream processing of tool stimuli under CFS can be explained by their elongated shape alone or by action-relevant category representations in dorsal visual cortex. To approach this question, we investigated category- and shape-selective functional magnetic resonance imaging-blood-oxygen level-dependent responses in both visual streams using images of faces and tools. Multivariate pattern analysis showed enhanced decoding of elongated relative to non-elongated tools, both in the ventral and dorsal visual stream. The second aim of our study was to investigate whether the depth of interocular suppression might differentially affect processing in dorsal and ventral areas. However, parametric modulation of suppression depth by varying the CFS mask contrast did not yield any evidence for differential modulation of category-selective activity. Together, our data provide evidence for shape-selective processing under CFS in both dorsal and ventral stream areas and, therefore, do not support the notion that dorsal "vision-for-action" processing is exclusively preserved under interocular suppression.

The degree of interaction between the ventral and dorsal visual streams has been discussed in multiple scientific domains for decades. Recently, several white matter tracts that directly connect cortical regions associated with the dorsal and ventral streams have become possible to study due to advancements in automated and reproducible methods. The developmental trajectory of this set of tracts, here referred to as the posterior vertical pathway (PVP), has yet to be described. We propose an input-driven model of white matter development and provide evidence for the model by focusing on the development of the PVP. We used reproducible, cloud-computing methods and diffusion imaging from adults and children (ages 5-8years) to compare PVP development to that of tracts within the ventral and dorsal pathways. PVP microstructure was more adult-like than dorsal stream microstructure, but less adult-like than ventral stream microstructure. Additionally, PVP microstructure was more similar to the microstructure of the ventral than the dorsal stream and was predicted by performance on a perceptual task in children. Overall, results suggest a potential role for the PVP in the development of the dorsal visual stream that may be related to its ability to facilitate interactions between ventral and dorsal streams during learning. Our results are consistent with the proposed model, suggesting that the microstructural development of major white matter pathways is related, at least in part, to the propagation of sensory information within the visual system.

Event Abstract Back to Event Dissociating the role of dorsal and ventral visual streams in object lifting and weight perception Vonne Van Polanen1*, Guy Rens1 and Marco Davare1 1 KU Leuven, Belgium When sequentially lifting a series of differently weighted objects, our fingertip forces are typically scaled according to the weight of the previously lifted object, an effect often referred to as sensorimotor memory [2]. For instance, force rates are higher after the lift of a heavy compared to a light object. Recently, we showed that this effect on force parameters also changes perceptual estimates, where objects are judged lighter after the lift of a heavy compared to a light weight [3]. Here, we aimed to investigate the causal role of the dorsal vs. ventral visual streams in these processes, given they are classically involved in computing motor vs. perceptual parameters, respectively. We used transcranial magnetic stimulation (TMS) to investigate the contribution of the left anterior intraparietal sulcus (aIPS) and lateral occipital (LO) areas, which are important nodes for processing hand-object interactions in the dorsal and ventral streams. Subjects received TMS to either aIPS or LO. Neuronavigation (Brainsight) was used to localize our TMS targets on individual structural brain imaging scans. The left aIPS was defined anatomically as the intersection between the intraparietal and postcentral sulci and LO was located using previously published functional coordinates [1]. Subjects were asked to grip and lift equally sized but differently weighted (light, 2N, or heavy, 6N) objects in a pseudo-randomized order and provide a weight estimate on a self-chosen scale. During object lifting, TMS was applied in a burst of 3 pulses (10Hz) at 120% of the active motor threshold. Three stimulation conditions were compared for each brain area, with stimulation at object contact (dynamic phase), 500 ms after object lift-off (static phase) or no stimulation. We quantified the effect of TMS on perceptual weight estimates, peak grip and load force rates, loading phase duration and mean grip force during stable hold. For each parameter, a mixed ANOVA was performed with TMS target (aIPS or LO) as between-subject factor and TMS condition (dynamic, static, or no stimulation) and object order (light-light, heavy-light, light-heavy, or heavy-heavy) as within-subject factors. When previously lifting a heavy object, peak grip and load force rates were higher and loading phase durations were shorter compared to previously lifting a light object, in line with classical sensorimotor memory effects. It is noteworthy that TMS did not alter this order effect. We only found a general effect of TMS when applied during the dynamic phase, with increased force rate peaks compared to the other TMS conditions. Furthermore, stable grip forces were higher after lifting a heavy object compared to a light one. Interestingly, this effect was cancelled in the aIPS group. No general effect of TMS condition on stable grip force was found. Finally, weight estimations were lower when a light object was preceded by a heavy object compared to a light one, replicating our earlier findings [3]. TMS led to overall lighter weight ratings, independently of the targeted area or timing. Remarkably, the order effect on weight estimations was cancelled when TMS was applied during the static phase over either aIPS or LO. These findings suggest that both aIPS and LO are involved in late phases of object weight perception. Moreover, the role of dorsal and ventral stream areas in mediating sensorimotor memory effects seems limited to aIPS for controlling grip forces in later phases of lifting. Overall, this sheds new light on the interactions between brain networks mediating action and perception during object manipulation.

The visual guidance of goal-directed movements requires transformations of incoming visual information that are different from those required for visual perception. For us to grasp an object successfully, our brain must use just-in-time computations of the object’s real-world size and shape, and its orientation and disposition with respect to our hand. These requirements have led to the emergence of dedicated visuomotor modules in the posterior parietal cortex of the human brain (the dorsal visual stream) that are functionally distinct from networks in the occipito-temporal cortex (the ventral visual stream) that mediate our conscious perception of the world. Although the identification and selection of goal objects and an appropriate course of action depends on the perceptual machinery of the ventral stream and associated cognitive modules, the execution of the subsequent goal-directed action is mediated by dedicated online control systems in the dorsal stream and associated motor areas. The dorsal stream allows an observer to reach out and grasp objects with exquisite ease, but by itself, deals only with objects that are visible at the moment the action is being programmed. The ventral stream, however, allows an observer to escape the present and bring to bear information from the past – including information about the function of objects, their intrinsic properties, and their location with reference to other objects in the world. Ultimately then, both streams contribute to the production of goal-directed actions. The principles underlying this division of labour between the dorsal and ventral streams are relevant to the design and implementation of autonomous robotic systems.

Visual information is processed in the brain primarily through two distinct pathways, the dorsal and the ventral visual streams. The present functional magnetic resonance imaging study investigated the specialization and integration of dorsal and ventral streams using tasks of object recognition and location detection. The study included 22 healthy adult volunteers who viewed stimuli consisting of grayscale photographs of common household objects presented in blocked design. Participants were asked to either recognize an object or to locate its position. While the location detection task elicited greater activation in the dorsal visual stream, recognizing objects showed greater activation in the middle occipital gyri, left inferior temporal gyrus, and in the left inferior frontal gyrus. The integration between dorsal and ventral brain areas was stronger during location detection than during object recognition. In addition, a principal components analysis found preliminary evidence for a group of regions, such as frontal and parietal cortex, working together in this task. Overall, the results of this study indicate the existence of specialized modules for object recognition and location detection, and possible interactions between areas beyond the visual cortex that may play a role in such tasks.

Action video games foster competitive environments that demand rapid spatial navigation and decision-making. Action video gamers often exhibit faster response times and slightly improved accuracy in vision-based sensorimotor tasks. Background/Objectives: However, the underlying functional and structural changes in the two visual streams of the brain that may be contributing to these cognitive improvements have been unclear. Methods: Using functional and diffusion MRI data, this study investigated the differences in connectivity between gamers who play action video games and nongamers in the dorsal and ventral visual streams. Results: We found that action video gamers have enhanced functional and structural connectivity, especially in the dorsal visual stream. Specifically, there is heightened functional connectivity—both undirected and directed—between the left superior occipital gyrus and the left superior parietal lobule during a moving-dot discrimination decision-making task. This increased connectivity correlates with response time in gamers. The structural connectivity in the dorsal stream, as quantified by diffusion fractional anisotropy and quantitative anisotropy measures of the axonal fiber pathways, was also enhanced for gamers compared to nongamers. Conclusions: These findings provide valuable insights into how action video gaming can induce targeted improvements in structural and functional connectivity between specific brain regions in the visual processing pathways. These connectivity changes in the dorsal visual stream underpin the superior performance of action video gamers compared to nongamers in tasks requiring rapid and accurate vision-based decision-making.

Dissociation and convergence of the dorsal and ventral visual working memory streams in the human prefrontal cortex

Reading the prevailing emotion of groups of people ("crowd emotion") is critical to understanding their overall intention and disposition. It alerts us to potential dangers, such as angry mobs or panicked crowds, giving us time to escape. A critical aspect of processing crowd emotion is that it must occur rapidly, because delays often are costly. Although knowing the timing of neural events is crucial for understanding how the brain guides behaviors using coherent signals from a glimpse of multiple faces, this information is currently lacking in the literature on face ensemble coding. Therefore, we used magnetoencephalography to examine the neurodynamics in the dorsal and ventral visual streams and the periamygdaloid cortex to compare perception of groups of faces versus individual faces. Forty-six participants compared two groups of four faces or two individual faces with varying emotional expressions and chose which group or individual they would avoid. We found that the dorsal stream was activated as early as 68 msec after the onset of stimuli containing groups of faces. In contrast, the ventral stream was activated later and predominantly for individual face stimuli. The latencies of the dorsal stream activation peaks correlated with participants' response times for facial crowds. We also found enhanced connectivity earlier between the periamygdaloid cortex and the dorsal stream regions for crowd emotion perception. Our findings suggest that ensemble coding of facial crowds proceeds rapidly and in parallel by engaging the dorsal stream to mediate adaptive social behaviors, via a distinct route from single face perception.

To what extent are shifts of attention driven by encoding of visual-spatial landmarks, associated with useful locations, or by encoding of environmental cues that act as symbolic representations, providing information about where to look next? In Experiment 1 we found that when cues were presented with a long exposure time (300 ms) attention shifts were driven by the symbolic identity of cue stimuli, independently of their visual-spatial (landmark) features; but when cues were exposed very briefly, (66 ms), attention shifts were independent of symbolic information, and were driven instead by visual landmark features. This unexpected finding was interpreted in terms of the transient and sustained response characteristics of the M-cell and P-cell inputs to the dorsal and ventral visual streams, respectively, and informed our theoretical proposal that attentional effects elicited by visual-spatial landmarks may be driven by dorsal stream ("where pathway") encoding; while attentional effects driven by the symbolic identity of cues may be driven by ventral stream ("what pathway") encoding. Detailed predictions derived from this proposal, and based on distinct physiological properties of the 2 visual streams were tested and confirmed in Experiments 2-6. Our results suggest that a 2-process view of attention shifting can be integrated with dual-stream models of vision. According to this unified theory: (a) Landmarks associated with visually useful locations elicit rapid, nonconscious shifts of attention, via nonsemantic, dorsal visual stream encoding of their features and spatial relationships; (b) Slower, endogenous shifts of attention are elicited by ventral visual stream encoding of symbolic-semantic information. (PsycINFO Database Record

Visuospatial processing impairments are prevalent in individuals with cerebral visual impairment (CVI) and are typically ascribed to "dorsal stream dysfunction" (DSD). However, the contribution of other cortical regions, including early visual cortex (EVC), frontal cortex, or the ventral visual stream, to such impairments remains unknown. Thus, here, we examined fMRI activity in these regions, while individuals with CVI (and neurotypicals) performed a visual search task within a dynamic naturalistic scene. First, behavioral performance was measured with eye tracking. Participants were instructed to search and follow a walking human target. CVI participants took significantly longer to find the target, and their eye gaze patterns were less accurate and less precise. Second, we used the same task in the MRI scanner. Along the dorsal stream, activation was reduced in CVI participants, consistent with the proposed DSD in CVI. Intriguingly, however, visual areas along the ventral stream showed the complete opposite pattern, with greater activation in CVI participants. In contrast, we found no differences in either EVC or frontal cortex between groups. These results suggest that the impaired visuospatial processing abilities in CVI are associated with differential recruitment of the dorsal and ventral visual streams, likely resulting from impaired selective attention.

In order to investigate the functional specificity of the dorsal and ventral visual processing steams we used transcranial magnetic stimulation (TMS) to briefly disrupt one or the other while subjects performed three tasks, involving discrimination of colour or shape or relative position. TMS was delivered over right posterior parietal cortex (PPC) or right lateral occipital (LO) cortex, regions known to have visuo-spatial and object processing properties respectively. LO but not PPC stimulation had a significant effect on reaction time when subjects were asked to make a discrimination of relative shape. PPC stimulation had a significant effect when subjects were asked to discriminate relative position of the same shapes. Stimulation of LO also lengthened reaction times on the position task. There were no effects of stimulation at either site on colour discrimination. Results are discussed within the framework of how the dorsal stream and ventral stream are dissociated following their damage in neurological patients and possible ways in which they may interact in the normal brain.

As we move through our environment, we encounter familiar objects from various viewpoints. Despite the ensuing variability of the images projected onto the retina, we have seemingly little difficulty when it comes to recognizing objects we encounter. We can, however, see how the objects are oriented, suggesting that object recognition is to a certain degree dissociable from perception of other object “features” such as orientation. Changes in orientation of objects, particularly inversion, can also affect how we perceive the objects. A particularly illustrative example (shown in Figure ​Figure1)1) is that of the Thatcher illusion (Thompson, 1980), where the grotesque appearance of a face with its inverted eyes and mouth is “hidden” when the whole face is also inverted. The percept itself, therefore, is affected by the change in orientation. In addition, there are also subtle effects of viewpoint changes on object recognition itself. For example, identifying rotated objects is more difficult when they are briefly presented than when viewing time is unlimited (Lawson and Jolicoeur, 2003), and identifying a face is considerably more difficult the face has been inverted (Yin, 1969), as is discrimination between characters “b” and “d,” or “p” and “q” which requires (physical or mental) rotation of the characters to upright, before we can be certain which letter we are looking at (Corballis and McLaren, 1984). Figure 1 Unaltered and “thatcherized” version of Margaret Thatcher's face. The grotesque appearance of the face when its eyes and mouth are inverted is hidden by the inversion of the whole image. Rotating the pictures to upright makes discrimination ... These subtle, yet persistent, effects of viewpoint changes on perception and recognition arise as a consequence of how visual object processing is handled by the brain. Here, I discuss how neural mechanisms underlying visual processing give rise to perception and recognition which can be both viewpoint dependent and viewpoint invariant depending on the timing of those processes, as well as specific task demands or current “perceptual goals” of an individual. To do so, I will firstly explain how temporal dynamics of low-level visual processing may give rise to impaired recognition at short viewing latencies and suggest that this may also relate to effects of viewpoint changes on perceptual experience. I will then discuss how the perceptual goals of an individual determines whether recognition is accomplished in viewpoint invariant or dependent manner with a particular focus on cognitive operations thought to be subserved by ventral and dorsal visual streams, namely object recognition and mental rotation, respectively.

Dijkerman & de Haan (D&dH) propose a convincing model of somatosensory organization that is inspired by earlier perception-action models of the visual system. In this commentary, we suggest that the dorsal and ventral visual streams both contribute to the control of action, but in different ways. Using the example of grip and load force calibration, we show how the ventral stream can invoke stored information about the material properties of objects originally derived from the somatosensory system.

Development of sensitivity to global form and motion in macaque monkeys (Macaca nemestrina)

Two action systems in the human brain