Domain specificity in visual cortex.

Asymmetries in the response to visual patterns in the upper and lower visual fields (above and below the centre of gaze) have been associated with ecological factors relating to the structure of typical visual environments. Here, we investigated whether the content of the upper and lower visual field representations in low-level regions of human visual cortex are specialised for visual patterns that arise from the upper and lower visual fields in natural images. We presented image patches, drawn from above or below the centre of gaze of an observer navigating a natural environment, to either the upper or lower visual fields of human participants (n = 7) while we used functional magnetic resonance imaging (fMRI) to measure the magnitude of evoked activity in the visual areas V1, V2, and V3. We found a significant interaction between the presentation location (upper or lower visual field) and the image patch source location (above or below fixation); the responses to lower visual field presentation were significantly greater for image patches sourced from below than above fixation, while the responses in the upper visual field were not significantly different for image patches sourced from above and below fixation. This finding demonstrates an association between the representation of the lower visual field in human visual cortex and the structure of the visual input that is likely to be encountered below the centre of gaze.

A Real-World Size Organization of Object Responses in Occipitotemporal Cortex

Most of our understanding of the functional organization of human visual cortex comes from lesion and functional imaging studies and by extrapolation from results obtained by neuroanatomical and neurophysiological studies in nonhuman primates. Although some single-unit and field potential recordings have been made in human visual cortex, none has provided quantitative characterization of spatial receptive fields (RFs) of individual sites. Here we use subdural electrodes implanted for clinical purposes to quantitatively measure response properties in different regions of human visual cortex. We find significant differences in RF size, response latency, and response magnitude for sites in early visual areas, versus sites in later stages of both the dorsal and ventral streams. In addition, we use this technique to estimate the cortical magnification factor in early human visual cortex. The spatial and temporal resolution of cortical surface recordings suggest that this technique is well suited to examine further issues in visual processing in humans.

Regions in the ventral visual pathway, such as the fusiform face area (FFA) and parahippocampal place area (PPA) are selective for images from specific object categories. Yet images from different object categories differ in their image properties. To investigate how these image properties are represented in the FFA and PPA, we compared neural responses to locally-SCRAMBLED images (in which mid-level, spatial properties are preserved) and globally-SCRAMBLED images (in which mid-level, spatial properties are not preserved). There was a greater response in the FFA and PPA to images from the preferred CATEGORY relative to their non-preferred category for the scrambled conditions. However, there was a greater selectivity for locally-scrambled compared to globally-scrambled images. Next, we compared the magnitude of fMR-adaptation to intact and scrambled images. fMR-adaptation was evident to locally-scrambled images from the preferred category. However, there was no adaptation to globally-scrambled images from the preferred category. These results show that the selectivity to faces and places in the FFA and PPA is dependent on mid-level properties of the image that are preserved by local-scrambling.

Brain activity patterns in high-level visual cortex support accurate linear classification of visual concepts (e.g., objects or scenes). It has long been appreciated that the accuracy of linear classification in any brain area depends on the geometry of its concept manifolds—sets of brain activity patterns that encode images of a concept. However, it is unclear how the geometry of concept manifolds differs between regions of visual cortex that support accurate classification and those that don’t, or how it differs between visual cortex and deep neural networks (DNNs). We estimated geometric properties of concept manifolds that, per a recent theory, directly determine the accuracy of simple “few-shot” linear classifiers. Using a large fMRI dataset, we show that variation in classification accuracy across human visual cortex is driven by a variation in a single geometric property: the distance between manifold centers (“geometric Signal”). In contrast, variation in classification accuracy across early and mid DNN layers is driven by an increase in the effective number of manifold dimensions (“Dimensionality”). Despite this difference in the geometric properties that affect few-shot classification performance in the brain and DNNs, we find that Signal and Dimensionality are strongly, negatively correlated: when Signal increases across brain regions or DNN layers, Dimensionality decreases, and vice versa. We conclude that early visual cortical areas and DNN layers deploy different geometric strategies for accurate linear classification of concepts, even though both are subject to the same constraint.

Human faces contain multiple sources of information. During speech perception, visual information from the talker’s mouth is integrated with auditory information from the talker's voice. By directly recording neural responses from small populations of neurons in patients implanted with subdural electrodes, we found enhanced visual cortex responses to speech when auditory speech was absent (rendering visual speech especially relevant). Receptive field mapping demonstrated that this enhancement was specific to regions of the visual cortex with retinotopic representations of the mouth of the talker. Connectivity between frontal cortex and other brain regions was measured with trial-by-trial power correlations. Strong connectivity was observed between frontal cortex and mouth regions of visual cortex; connectivity was weaker between frontal cortex and non-mouth regions of visual cortex or auditory cortex. These results suggest that top-down selection of visual information from the talker’s mouth by frontal cortex plays an important role in audiovisual speech perception.

Cortical regions apparently selective to faces, places, and bodies have provided important evidence for domain-specific theories of human cognition, development, and evolution. But claims of category selectivity are not quantitatively precise and remain vulnerable to empirical refutation. Here we develop artificial neural network-based encoding models that accurately predict the response to novel images in the fusiform face area, parahippocampal place area, and extrastriate body area, outperforming descriptive models and experts. We use these models to subject claims of category selectivity to strong tests, by screening for and synthesizing images predicted to produce high responses. We find that these high-response-predicted images are all unambiguous members of the hypothesized preferred category for each region. These results provide accurate, image-computable encoding models of each category-selective region, strengthen evidence for domain specificity in the brain, and point the way for future research characterizing the functional organization of the brain with unprecedented computational precision.

We used a multi-voxel classification analysis of functional magnetic resonance imaging (fMRI) data to determine to what extent item-specific information about complex natural scenes is represented in several category-selective areas of human extrastriate visual cortex during visual perception and visual mental imagery. Participants in the scanner either viewed or were instructed to visualize previously memorized natural scene exemplars, and the neuroimaging data were subsequently subjected to a multi-voxel pattern analysis (MVPA) using a support vector machine (SVM) classifier. We found that item-specific information was represented in multiple scene-selective areas: the occipital place area (OPA), parahippocampal place area (PPA), retrosplenial cortex (RSC), and a scene-selective portion of the precuneus/intraparietal sulcus region (PCu/IPS). Furthermore, item-specific information from perceived scenes was re-instantiated during mental imagery of the same scenes. These results support findings from previous decoding analyses for other types of visual information and/or brain areas during imagery or working memory, and extend them to the case of visual scenes (and scene-selective cortex). Taken together, such findings support models suggesting that reflective mental processes are subserved by the re-instantiation of perceptual information in high-level visual cortex. We also examined activity in the fusiform face area (FFA) and found that it, too, contained significant item-specific scene information during perception, but not during mental imagery. This suggests that although decodable scene-relevant activity occurs in FFA during perception, FFA activity may not be a necessary (or even relevant) component of one's mental representation of visual scenes.

Repetition of identical face stimuli leads to fMRI response attenuation (fMRI adaptation, fMRIa) in the core face-selective occipito-temporal visual cortical network, involving the bilateral fusiform face area (FFA) and the occipital face area (OFA). However, the functional relevance of fMRIa observed in these regions is unclear as of today. Therefore, here we aimed at investigating the relationship between fMRIa and face perception ability by measuring in the same human participants both the repetition-induced reduction of fMRI responses and identity discrimination performance outside the scanner for upright and inverted face stimuli. In the correlation analysis, the behavioral and fMRI results for the inverted faces were used as covariates to control for the individual differences in overall object perception ability and basic visual feature adaptation processes, respectively. The results revealed a significant positive correlation between the participants' identity discrimination performance and the strength of fMRIa in the core face processing network, but not in the extrastriate body area (EBA). Furthermore, we found a strong correlation of the fMRIa between OFA and FFA and also between OFA and EBA, but not between FFA and EBA. These findings suggest that there is a face-selective component of the repetition-induced reduction of fMRI responses within the core face processing network, which reflects functionally relevant adaptation processes involved in face identity perception.

Perception Matches Selectivity in the Human Anterior Color Center

Viewing faces or bodies activates category-selective areas of visual cortex, including the fusiform face area (FFA), fusiform body area (FBA), and extrastriate body area (EBA). Here, using fMRI, we investigate the development of these areas, focusing on the right FFA and FBA. Despite the overlap of functionally defined FFA and FBA (54%-75% overlap), we found that these regions developed along different trajectories. With age (7-32 years old), the FFA gradually increased in size and selectivity, and was significantly larger and more face-selective in adults than children. By contrast, the size and selectivity of the FBA did not correlate with age, and were equivalent in children and adults. Whereas in adults the FFA and FBA were comparable in size, in children the FBA was on average 70% larger than the FFA. These findings suggest that, in children, the fusiform gyrus is predominantly selective for bodies, with commensurate face-selective responses apparent later in development. Moreover, differences in the development of the FFA and FBA indicate that overlapping functional brain areas, supported by the same anatomical structure, can develop along different trajectories.

The extrastriate body area (EBA) is one among the multiple, functionally specialized regions of the human visual cortex exhibiting modulation by body-related stimuli. Here we investigate whether activation patterns differ for the perception of one's own body and the bodies of others. We used functional magnetic resonance imaging to identify body-related brain areas and to see how these areas differentiate between images of one's own body and those of others in the absence of facial or motion cues. Whole brain explorative group-level analysis identified body-related blood oxygen level dependent (BOLD) signal enhancement in five regions of the right and in one region of the left hemisphere (right: in the extrastriate visual and parietal cortex and in the precentral gyrus, left: in the extrastriate visual cortex). General linear model group-level random effects analysis of the self-other contrast revealed self-related responses in the extrastriate and parietal regions in the right hemisphere but also in the right middle frontal gyrus. These results suggest the existence of a cortical network for the extraction of body-related information and another cortical network for the extraction of self-related body information. The two networks partially overlap in the right superior and inferior parietal cortices, but are clearly segregated in the extrastriate visual cortex and in the middle frontal gyrus. In addition, we report that the classical EBA is only involved in the analysis of body-related information but not in the assignment of body identity. The latter appears to be accomplished by a network in right hemisphere comprising the fusiform body area, regions of the superior parietal lobe, the inferior parietal cortex, and the middle frontal gyrus.

Representational precision in visual cortex reveals outcome encoding and reward modulation during action preparation

Introduction: The mental load caused by simultaneous multitasking can affect visual information processing and reduce its ability. This study investigated the effect of mental load caused by cognitive tasks simultaneously with visual task on the number of active voxels in the visual cortex. Methods: This study recruited 22 individuals with a mean age of 24.72 ± 5.47 years. 3-Tesla functional magnetic resonance imaging (fMRI) was used to examine the functions of the visual cortex and amygdala region during three different task conditions: visual task alone, visual task with an auditory n-back task, and visual task with an arithmetic task. The visual stimuli consisted of Gabor patches with a contrast of 55% at spatial frequencies of 0.25, 4, and 9 cycles per degree (cpd). These were presented in three trials of eight blocks with a stimulation time of 12 sec and a rest time of 14 sec. Results: Activated brain voxels in the primary, secondary, and associated visual cortex areas were reduced in response to the mental load imposed by the n-back and arithmetic tasks. This reduction was greater for a spatial frequency of 0.25 cpd in the n-back task condition and spatial frequency of 9 cpd in the arithmetic task condition. In addition, the amygdala was stimulated in 2-back task and arithmetic task conditions. Conclusions: This study revealed a decline in the number of activated voxels of the visual cortex due to the mental load caused by simultaneous cognitive tasks, confirming the findings of previous psychophysical studies.

In human adults, ventral extra-striate visual cortex contains a mosaic of functionally specialized areas, some responding preferentially to natural visual categories such as faces (fusiform face area) or places (parahippocampal place area) and others to cultural inventions such as written words and numbers (visual word form and number form areas). It has been hypothesized that this mosaic arises from innate biases in cortico-cortical connectivity. We tested this hypothesis by examining functional resting-state correlation at birth using fMRI data from full-term human newborns. The results revealed that ventral visual regions are functionally connected with their contra-lateral homologous regions and also exhibit distinct patterns of long-distance functional correlation with anterior associative regions. A mesial-to-lateral organization was observed, with the signal of the more lateral regions, including the sites of visual word and number form areas, exhibiting higher correlations with voxels of the prefrontal, inferior parietal and temporal cortices, including language areas. Finally, we observed hemispheric asymmetries in the functional correlation of key areas of the language network that may influence later adult hemispheric lateralization. We suggest that long-distance circuits present at birth constrain the subsequent functional differentiation of the ventral visual cortex.