Investigating category- and shape-selective neural processing in ventral and dorsal visual stream under interocular suppression.

Event Abstract Back to Event Dissociating the role of dorsal and ventral visual streams in object lifting and weight perception Vonne Van Polanen1*, Guy Rens1 and Marco Davare1 1 KU Leuven, Belgium When sequentially lifting a series of differently weighted objects, our fingertip forces are typically scaled according to the weight of the previously lifted object, an effect often referred to as sensorimotor memory [2]. For instance, force rates are higher after the lift of a heavy compared to a light object. Recently, we showed that this effect on force parameters also changes perceptual estimates, where objects are judged lighter after the lift of a heavy compared to a light weight [3]. Here, we aimed to investigate the causal role of the dorsal vs. ventral visual streams in these processes, given they are classically involved in computing motor vs. perceptual parameters, respectively. We used transcranial magnetic stimulation (TMS) to investigate the contribution of the left anterior intraparietal sulcus (aIPS) and lateral occipital (LO) areas, which are important nodes for processing hand-object interactions in the dorsal and ventral streams. Subjects received TMS to either aIPS or LO. Neuronavigation (Brainsight) was used to localize our TMS targets on individual structural brain imaging scans. The left aIPS was defined anatomically as the intersection between the intraparietal and postcentral sulci and LO was located using previously published functional coordinates [1]. Subjects were asked to grip and lift equally sized but differently weighted (light, 2N, or heavy, 6N) objects in a pseudo-randomized order and provide a weight estimate on a self-chosen scale. During object lifting, TMS was applied in a burst of 3 pulses (10Hz) at 120% of the active motor threshold. Three stimulation conditions were compared for each brain area, with stimulation at object contact (dynamic phase), 500 ms after object lift-off (static phase) or no stimulation. We quantified the effect of TMS on perceptual weight estimates, peak grip and load force rates, loading phase duration and mean grip force during stable hold. For each parameter, a mixed ANOVA was performed with TMS target (aIPS or LO) as between-subject factor and TMS condition (dynamic, static, or no stimulation) and object order (light-light, heavy-light, light-heavy, or heavy-heavy) as within-subject factors. When previously lifting a heavy object, peak grip and load force rates were higher and loading phase durations were shorter compared to previously lifting a light object, in line with classical sensorimotor memory effects. It is noteworthy that TMS did not alter this order effect. We only found a general effect of TMS when applied during the dynamic phase, with increased force rate peaks compared to the other TMS conditions. Furthermore, stable grip forces were higher after lifting a heavy object compared to a light one. Interestingly, this effect was cancelled in the aIPS group. No general effect of TMS condition on stable grip force was found. Finally, weight estimations were lower when a light object was preceded by a heavy object compared to a light one, replicating our earlier findings [3]. TMS led to overall lighter weight ratings, independently of the targeted area or timing. Remarkably, the order effect on weight estimations was cancelled when TMS was applied during the static phase over either aIPS or LO. These findings suggest that both aIPS and LO are involved in late phases of object weight perception. Moreover, the role of dorsal and ventral stream areas in mediating sensorimotor memory effects seems limited to aIPS for controlling grip forces in later phases of lifting. Overall, this sheds new light on the interactions between brain networks mediating action and perception during object manipulation.

Action video games foster competitive environments that demand rapid spatial navigation and decision-making. Action video gamers often exhibit faster response times and slightly improved accuracy in vision-based sensorimotor tasks. Background/Objectives: However, the underlying functional and structural changes in the two visual streams of the brain that may be contributing to these cognitive improvements have been unclear. Methods: Using functional and diffusion MRI data, this study investigated the differences in connectivity between gamers who play action video games and nongamers in the dorsal and ventral visual streams. Results: We found that action video gamers have enhanced functional and structural connectivity, especially in the dorsal visual stream. Specifically, there is heightened functional connectivity—both undirected and directed—between the left superior occipital gyrus and the left superior parietal lobule during a moving-dot discrimination decision-making task. This increased connectivity correlates with response time in gamers. The structural connectivity in the dorsal stream, as quantified by diffusion fractional anisotropy and quantitative anisotropy measures of the axonal fiber pathways, was also enhanced for gamers compared to nongamers. Conclusions: These findings provide valuable insights into how action video gaming can induce targeted improvements in structural and functional connectivity between specific brain regions in the visual processing pathways. These connectivity changes in the dorsal visual stream underpin the superior performance of action video gamers compared to nongamers in tasks requiring rapid and accurate vision-based decision-making.

The degree of interaction between the ventral and dorsal visual streams has been discussed in multiple scientific domains for decades. Recently, several white matter tracts that directly connect cortical regions associated with the dorsal and ventral streams have become possible to study due to advancements in automated and reproducible methods. The developmental trajectory of this set of tracts, here referred to as the posterior vertical pathway (PVP), has yet to be described. We propose an input-driven model of white matter development and provide evidence for the model by focusing on the development of the PVP. We used reproducible, cloud-computing methods and diffusion imaging from adults and children (ages 5-8years) to compare PVP development to that of tracts within the ventral and dorsal pathways. PVP microstructure was more adult-like than dorsal stream microstructure, but less adult-like than ventral stream microstructure. Additionally, PVP microstructure was more similar to the microstructure of the ventral than the dorsal stream and was predicted by performance on a perceptual task in children. Overall, results suggest a potential role for the PVP in the development of the dorsal visual stream that may be related to its ability to facilitate interactions between ventral and dorsal streams during learning. Our results are consistent with the proposed model, suggesting that the microstructural development of major white matter pathways is related, at least in part, to the propagation of sensory information within the visual system.

The visual guidance of goal-directed movements requires transformations of incoming visual information that are different from those required for visual perception. For us to grasp an object successfully, our brain must use just-in-time computations of the object’s real-world size and shape, and its orientation and disposition with respect to our hand. These requirements have led to the emergence of dedicated visuomotor modules in the posterior parietal cortex of the human brain (the dorsal visual stream) that are functionally distinct from networks in the occipito-temporal cortex (the ventral visual stream) that mediate our conscious perception of the world. Although the identification and selection of goal objects and an appropriate course of action depends on the perceptual machinery of the ventral stream and associated cognitive modules, the execution of the subsequent goal-directed action is mediated by dedicated online control systems in the dorsal stream and associated motor areas. The dorsal stream allows an observer to reach out and grasp objects with exquisite ease, but by itself, deals only with objects that are visible at the moment the action is being programmed. The ventral stream, however, allows an observer to escape the present and bring to bear information from the past – including information about the function of objects, their intrinsic properties, and their location with reference to other objects in the world. Ultimately then, both streams contribute to the production of goal-directed actions. The principles underlying this division of labour between the dorsal and ventral streams are relevant to the design and implementation of autonomous robotic systems.

To what extent are shifts of attention driven by encoding of visual-spatial landmarks, associated with useful locations, or by encoding of environmental cues that act as symbolic representations, providing information about where to look next? In Experiment 1 we found that when cues were presented with a long exposure time (300 ms) attention shifts were driven by the symbolic identity of cue stimuli, independently of their visual-spatial (landmark) features; but when cues were exposed very briefly, (66 ms), attention shifts were independent of symbolic information, and were driven instead by visual landmark features. This unexpected finding was interpreted in terms of the transient and sustained response characteristics of the M-cell and P-cell inputs to the dorsal and ventral visual streams, respectively, and informed our theoretical proposal that attentional effects elicited by visual-spatial landmarks may be driven by dorsal stream ("where pathway") encoding; while attentional effects driven by the symbolic identity of cues may be driven by ventral stream ("what pathway") encoding. Detailed predictions derived from this proposal, and based on distinct physiological properties of the 2 visual streams were tested and confirmed in Experiments 2-6. Our results suggest that a 2-process view of attention shifting can be integrated with dual-stream models of vision. According to this unified theory: (a) Landmarks associated with visually useful locations elicit rapid, nonconscious shifts of attention, via nonsemantic, dorsal visual stream encoding of their features and spatial relationships; (b) Slower, endogenous shifts of attention are elicited by ventral visual stream encoding of symbolic-semantic information. (PsycINFO Database Record

Visual information is processed in the brain primarily through two distinct pathways, the dorsal and the ventral visual streams. The present functional magnetic resonance imaging study investigated the specialization and integration of dorsal and ventral streams using tasks of object recognition and location detection. The study included 22 healthy adult volunteers who viewed stimuli consisting of grayscale photographs of common household objects presented in blocked design. Participants were asked to either recognize an object or to locate its position. While the location detection task elicited greater activation in the dorsal visual stream, recognizing objects showed greater activation in the middle occipital gyri, left inferior temporal gyrus, and in the left inferior frontal gyrus. The integration between dorsal and ventral brain areas was stronger during location detection than during object recognition. In addition, a principal components analysis found preliminary evidence for a group of regions, such as frontal and parietal cortex, working together in this task. Overall, the results of this study indicate the existence of specialized modules for object recognition and location detection, and possible interactions between areas beyond the visual cortex that may play a role in such tasks.

Reading the prevailing emotion of groups of people ("crowd emotion") is critical to understanding their overall intention and disposition. It alerts us to potential dangers, such as angry mobs or panicked crowds, giving us time to escape. A critical aspect of processing crowd emotion is that it must occur rapidly, because delays often are costly. Although knowing the timing of neural events is crucial for understanding how the brain guides behaviors using coherent signals from a glimpse of multiple faces, this information is currently lacking in the literature on face ensemble coding. Therefore, we used magnetoencephalography to examine the neurodynamics in the dorsal and ventral visual streams and the periamygdaloid cortex to compare perception of groups of faces versus individual faces. Forty-six participants compared two groups of four faces or two individual faces with varying emotional expressions and chose which group or individual they would avoid. We found that the dorsal stream was activated as early as 68 msec after the onset of stimuli containing groups of faces. In contrast, the ventral stream was activated later and predominantly for individual face stimuli. The latencies of the dorsal stream activation peaks correlated with participants' response times for facial crowds. We also found enhanced connectivity earlier between the periamygdaloid cortex and the dorsal stream regions for crowd emotion perception. Our findings suggest that ensemble coding of facial crowds proceeds rapidly and in parallel by engaging the dorsal stream to mediate adaptive social behaviors, via a distinct route from single face perception.

Dissociation and convergence of the dorsal and ventral visual working memory streams in the human prefrontal cortex

In order to investigate the functional specificity of the dorsal and ventral visual processing steams we used transcranial magnetic stimulation (TMS) to briefly disrupt one or the other while subjects performed three tasks, involving discrimination of colour or shape or relative position. TMS was delivered over right posterior parietal cortex (PPC) or right lateral occipital (LO) cortex, regions known to have visuo-spatial and object processing properties respectively. LO but not PPC stimulation had a significant effect on reaction time when subjects were asked to make a discrimination of relative shape. PPC stimulation had a significant effect when subjects were asked to discriminate relative position of the same shapes. Stimulation of LO also lengthened reaction times on the position task. There were no effects of stimulation at either site on colour discrimination. Results are discussed within the framework of how the dorsal stream and ventral stream are dissociated following their damage in neurological patients and possible ways in which they may interact in the normal brain.

Visuospatial processing impairments are prevalent in individuals with cerebral visual impairment (CVI) and are typically ascribed to "dorsal stream dysfunction" (DSD). However, the contribution of other cortical regions, including early visual cortex (EVC), frontal cortex, or the ventral visual stream, to such impairments remains unknown. Thus, here, we examined fMRI activity in these regions, while individuals with CVI (and neurotypicals) performed a visual search task within a dynamic naturalistic scene. First, behavioral performance was measured with eye tracking. Participants were instructed to search and follow a walking human target. CVI participants took significantly longer to find the target, and their eye gaze patterns were less accurate and less precise. Second, we used the same task in the MRI scanner. Along the dorsal stream, activation was reduced in CVI participants, consistent with the proposed DSD in CVI. Intriguingly, however, visual areas along the ventral stream showed the complete opposite pattern, with greater activation in CVI participants. In contrast, we found no differences in either EVC or frontal cortex between groups. These results suggest that the impaired visuospatial processing abilities in CVI are associated with differential recruitment of the dorsal and ventral visual streams, likely resulting from impaired selective attention.

The vertical occipital fasciculus (VOF) is an association fiber tract coursing vertically at the posterolateral corner of the brain. It is re-evaluated as a major fiber tract to link the dorsal and ventral visual stream. Although previous tractography studies showed the VOF’s cortical projections fall in the dorsal and ventral visual areas, the post-mortem dissection study for the validation remains limited. First, to validate the previous tractography data, we here performed the white matter dissection in post-mortem brains and demonstrated the VOF’s fiber bundles coursing between the V3A/B areas and the posterior fusiform gyrus. Secondly, we analyzed the VOF’s structural connectivity with diffusion tractography to link vision-associated cortical areas of the HCP MMP1.0 atlas, an updated map of the human cerebral cortex. Based on the criteria the VOF courses laterally to the inferior longitudinal fasciculus (ILF) and craniocaudally at the posterolateral corner of the brain, we reconstructed the VOF’s fiber tracts and found the widespread projections to the visual cortex. These findings could suggest a crucial role of VOF in integrating visual information to link the broad visual cortex as well as in connecting the dual visual stream.

Human patients with visual field defects following damage to their primary visual cortex (V1) will often misperceive the midpoint of a horizontal line. They tend to shift the midpoint away from the real position towards their blind field. In patients with unilateral neglect, where midpoint shifts can also be observed, these perceptual errors do not lead to errors in an obstacle-avoidance task, which also requires the ability to find the midpoint between two obstacles. This dissociation in neglect patients was taken as evidence that obstacle-avoidance performance is guided by visual information from the dorsal visual stream. Recently it was shown that a patient with hemianopia could avoid an obstacle presented in his blind field. This suggests that obstacle-avoidance behaviour can be guided by subconscious vision alone involving a direct route from extrageniculate structures in the brain to dorsal stream areas. To investigate whether obstacle avoidance relies only on this subconscious route or also uses information from pathways involved in conscious vision, we examined the effect of the hemianopic shift on obstacle-avoidance behaviour. This shift is found in tasks where a conscious visual judgement is required and presumably arises in pathways underlying conscious vision (V1 and ventral stream areas). We compared the performance of six patients with left hemianopia with the performance of six patients with right hemianopia. We found a clear bias in both groups, which also affected obstacle-avoidance performance. It is thus concluded that obstacle avoidance does not bypass the system for conscious vision completely.

Two action systems in the human brain

Primary manipulation knowledge of objects is associated with the functional coupling of pMTG and aIPS

fMRI reveals processing streams in action