Bottom-up Retinotopic Organization Supports Top-down Mental Imagery

The human entorhinal-hippocampal circuitry is characterized by an information-specific functional organization where two routes, that are preferentially connected to the parahippocampal cortex or the perirhinal and retrosplenial cortices, divide the entorhinal cortex as well as hippocampal subiculum and CA1 subregions.

The occipital place area represents the local elements of scenes

Conceptual size representation in ventral visual cortex

We used a multi-voxel classification analysis of functional magnetic resonance imaging (fMRI) data to determine to what extent item-specific information about complex natural scenes is represented in several category-selective areas of human extrastriate visual cortex during visual perception and visual mental imagery. Participants in the scanner either viewed or were instructed to visualize previously memorized natural scene exemplars, and the neuroimaging data were subsequently subjected to a multi-voxel pattern analysis (MVPA) using a support vector machine (SVM) classifier. We found that item-specific information was represented in multiple scene-selective areas: the occipital place area (OPA), parahippocampal place area (PPA), retrosplenial cortex (RSC), and a scene-selective portion of the precuneus/intraparietal sulcus region (PCu/IPS). Furthermore, item-specific information from perceived scenes was re-instantiated during mental imagery of the same scenes. These results support findings from previous decoding analyses for other types of visual information and/or brain areas during imagery or working memory, and extend them to the case of visual scenes (and scene-selective cortex). Taken together, such findings support models suggesting that reflective mental processes are subserved by the re-instantiation of perceptual information in high-level visual cortex. We also examined activity in the fusiform face area (FFA) and found that it, too, contained significant item-specific scene information during perception, but not during mental imagery. This suggests that although decodable scene-relevant activity occurs in FFA during perception, FFA activity may not be a necessary (or even relevant) component of one's mental representation of visual scenes.

During real-world scene perception, viewers actively direct their attention through a scene in a controlled sequence of eye fixations. During each fixation, local scene properties are attended, analyzed, and interpreted. What is the relationship between fixated scene properties and neural activity in the visual cortex? Participants inspected photographs of real-world scenes in an MRI scanner while their eye movements were recorded. Fixation-related fMRI was used to measure activation as a function of lower- and higher-level scene properties at fixation, operationalized as edge density and meaning maps, respectively. We found that edge density at fixation was most associated with activation in early visual areas, whereas semantic content at fixation was most associated with activation along the ventral visual stream including core object and scene-selective areas (lateral occipital complex, parahippocampal place area, occipital place area, and retrosplenial cortex). The observed activation from semantic content was not accounted for by differences in edge density. The results are consistent with active vision models in which fixation gates detailed visual analysis for fixated scene regions, and this gating influences both lower and higher levels of scene analysis.

Previous work has shown that different cortical regions are sensitive to objects of differing real-world sizes (Konkle & Oliva, 2012; Mullally & Maguire, 2011; Bainbridge et al, 2012). Whereas a region in the occipito-temporal sulcus (OTS) shows small object selectivity, scene-selective regions (parahippocampal place area, PPA; retrosplenial cortex, RSC; and occipital place area, OPA) show systematically more activity for objects that are large in the world than smaller objects. What is the nature of this scene-like representation of objects? Here, we study an affordance-based object property: "interaction space". Interaction space is the area around objects that users traverse when interacting with the object. This interaction may include calculations of grasping points and surface area of contact, and is not necessarily conjoined with size. To fully deconvolve object interaction from physical size, we conducted a 2 x 2 factor design fMRI study with four conditions: 1) small one-handed objects (i.e., hairbrush), 2) large one-handed objects (i.e., umbrella), 3) small two-handed objects (i.e., hamburger), and 4) large two-handed objects (i.e., guitar). Stimuli were matched for ground truth size (based on physical sizes and weights), subjective size from an online survey, color, luminance, spectral energy, and retinal size. Results from a 2-factor ANOVA on beta values in functionally-defined ROIs show PPA, OPA, and RSC are sensitive to interaction space regardless of size, while PPA, OPA, and OTS are also sensitive to size regardless of interaction space. Importantly, effect sizes for interaction space in the PPA, OPA, and RSC were greater than those for object size, while the reverse was true for the OTS. These results show that interaction space is a perceptual object property that is represented in scene-selective regions, and suggest an overlapping interaction-based representation of objects and scenes in the brain. Meeting abstract presented at VSS 2013

Perceived egocentric distance sensitivity and invariance across scene-selective cortex

Combined representation of visual features in the scene-selective cortex

A recent neuroimaging study in adults found that the occipital place area (OPA)-a cortical region involved in "visually guided navigation" (i.e. moving about the immediately visible environment, avoiding boundaries, and obstacles)-represents visual information about walking, not crawling, suggesting that OPA is late developing, emerging only when children are walking, not beforehand. But when precisely does this "walking selectivity" in OPA emerge-when children first begin to walk in early childhood, or perhaps counterintuitively, much later in childhood, around 8years of age, when children are adult-like walking? To directly test these two hypotheses, using functional magnetic resonance imaging (fMRI) in two groups of children, 5- and 8-year-olds, we measured the responses in OPA to first-person perspective videos through scenes from a "walking" perspective, as well as three control perspectives ("crawling," "flying," and "scrambled"). We found that the OPA in 8-year-olds-like adults-exhibited walking selectivity (i.e. responding significantly more to the walking videos than to any of the others, and no significant differences across the crawling, flying, and scrambled videos), while the OPA in 5-year-olds exhibited no walking selectively. These findings reveal that OPA undergoes protracted development, with walking selectivity only emerging around 8years of age.

The perception and imagery of landmarks activate similar content‐dependent brain areas, including occipital and temporo‐medial brain regions. However, how these areas interact during visual perception and imagery of scenes, especially when recollecting their spatial location, remains unknown. Here, we combined functional magnetic resonance imaging (fMRI), resting‐state functional connectivity (rs‐fc), and effective connectivity to assess spontaneous fluctuations and task‐induced modulation of signals among regions entailing scene‐processing, the primary visual area and the hippocampus (HC), responsible for the retrieval of stored information. First, we functionally defined the scene‐selective regions, that is, the occipital place area (OPA), the retrosplenial complex (RSC) and the parahippocampal place area (PPA), by using the face/scene localizer, observing that two portions of the PPA—anterior and posterior PPA—were consistently activated in all subjects. Second, the rs‐fc analysis (n = 77) revealed a connectivity pathway similar to the one described in macaques, showing separate connectivity routes linking the anterior PPA with RSC and HC, and the posterior PPA with OPA. Third, we used dynamic causal modelling to evaluate whether the dynamic couplings among these regions differ between perception and imagery of familiar landmarks during a fMRI task (n = 16). We found a positive effect of HC on RSC during the retrieval of imagined places and an effect of occipital regions on both RSC and pPPA during the perception of scenes. Overall, we propose that under similar functional architecture at rest, different neural interactions take place between regions in the occipito‐temporal higher‐level visual cortex and the HC, subserving scene perception and imagery.

Human adults flawlessly and effortlessly navigate boundaries and obstacles in the immediately visible environment, a process we refer to as guided navigation. Neuroimaging work in adults suggests this ability involves the occipital place area (OPA) [1, 2]-a scene-selective region in the dorsal stream that selectively represents information necessary for visually guided navigation [3-9]. Despite progress in understanding the neural basis of visually guided navigation, however, little is known about how this system develops. Is navigationally relevant information processing present in the first few years of life? Or does this information processing only develop after many years of experience? Although a handful of studies have found selective responses to scenes (relative to objects) in OPA in childhood [10-13], no study has explored how more specific navigationally relevant information processing emerges in this region. Here, we do just that by measuring OPA responses to first-person perspective motion information-a proxy for the visual experience of actually navigating the immediate environment-using fMRI in 5- and 8-year-old children. We found that, although OPA already responded more to scenes than objects by age 5, responses to first-person perspective motion were not yet detectable at this same age and rather only emerged by age 8. This protracted development was specific to first-person perspective motion through scenes, not motion on faces or objects, and was not found in other scene-selective regions (the parahippocampal place area or retrosplenial complex) or a motion-selective region (MT). These findings therefore suggest that navigationally relevant information processing in OPA undergoes prolonged development across childhood.

The parahippocampal place area (PPA) is one of several brain regions that respond more strongly to scenes than to non-scene items such as objects and faces. The mechanism underlying this scene-preferential response remains unclear. One possibility is that the PPA is tuned to low-level stimulus features that are found more often in scenes than in less-preferred stimuli. Supporting this view, Nasr et al. (2014) recently observed that some of the stimuli that are known to strongly activate the PPA contain a large number of rectilinear edges. They further demonstrated that PPA response is modulated by rectilinearity for a range of non-scene images. Motivated by these results, we tested whether rectilinearity suffices to explain PPA selectivity for scenes. In the first experiment, we replicated the previous finding of modulation by rectilinearity in the PPA for arrays of 2-d shapes. However, two further experiments failed to find a rectilinearity effect for faces or scenes: high-rectilinearity faces and scenes did not activate the PPA any more strongly than low-rectilinearity faces and scenes. Moreover, the categorical advantage for scenes vs. faces was maintained in the PPA and two other scene-selective regions—the retrosplenial complex (RSC) and occipital place area (OPA)—when rectilinearity was matched between stimulus sets. We conclude that selectivity for scenes in the PPA cannot be explained by a preference for low-level rectilinear edges.

Recent research suggests that episodic memory is associated with systematic differences in the localization of neural activity observed during memory encoding and retrieval. The retrieval-related anterior shift is a phenomenon whereby the retrieval of a stimulus event (e.g., a scene image) is associated with a peak neural response which is localized more anteriorly than the response elicited when the stimulus is experienced directly. Here, we examine whether the magnitude of the anterior shift (i.e., the distance between encoding- and retrieval-related response peaks) is moderated by age, and also whether the shift is associated with memory performance. Younger and older human subjects of both sexes underwent fMRI as they completed encoding and retrieval tasks on word-face and word-scene pairs. We localized peak scene and face selectivity for each individual participant within the face-selective precuneus and in three scene-selective (parahippocampal place area [PPA], medial place area, occipital place area) ROIs. In line with recent findings, we identified an anterior shift in the PPA and occipital place area in both age groups and, in older adults only, in the medial place area and precuneus also. Of importance, the magnitude of the anterior shift was larger in older than in younger adults. The shift within the PPA exhibited an age-invariant across-participant negative correlation with source memory performance, such that a smaller displacement between encoding- and retrieval-related neural activity was associated with better performance. These findings provide novel insights into the functional significance of the anterior shift, especially in relation to memory decline in older age.SIGNIFICANCE STATEMENTCognitive aging is associated with reduced ability to retrieve precise details of previously experienced events. The retrieval-related anterior shift is a phenomenon in which category-selective cortical activity at retrieval is localized anterior to the peak activity at encoding. The shift is thought to reflect a bias at retrieval in favor of semantic and abstract information at the expense of low-level perceptual detail. Here, we report that the anterior shift is exaggerated in older relative to younger adults, and we demonstrate that a larger shift in the parahippocampal place area is associated with poorer memory performance. These findings suggest that the shift is sensitive to increasing age and that it is moderated by the quality and content of the retrieved episode.

Path integration, the constant updating of the navigator's knowledge of position and orientation during movement, requires both visuospatial knowledge and memory. This study aimed to develop a systems-level understanding of human path integration by examining the basic building blocks of path integration in humans. To achieve this goal, we used functional imaging to examine the neural mechanisms that support the tracking and memory of translational and rotational components of human path integration. Critically, and in contrast to previous studies, we examined movement in translation and rotation tasks with no defined end-point or goal. Navigators accumulated translational and rotational information during virtual self-motion. Activity in hippocampus, retrosplenial cortex (RSC), and parahippocampal cortex (PHC) increased during both translation and rotation encoding, suggesting that these regions track self-motion information during path integration. These results address current questions regarding distance coding in the human brain. By implementing a modified delayed match to sample paradigm, we also examined the encoding and maintenance of path integration signals in working memory. Hippocampus, PHC, and RSC were recruited during successful encoding and maintenance of path integration information, with RSC selective for tasks that required processing heading rotation changes. These data indicate distinct working memory mechanisms for translation and rotation, which are essential for updating neural representations of current location. The results provide evidence that hippocampus, PHC, and RSC flexibly track task-relevant translation and rotation signals for path integration and could form the hub of a more distributed network supporting spatial navigation. Hum Brain Mapp 37:3636-3655, 2016. © 2016 Wiley Periodicals, Inc.

Scene-selective regions (SSRs), including the parahippocampal place area (PPA), retrosplenial cortex (RSC), and transverse occipital sulcus (TOS), are among the most widely characterized functional regions in the human brain. However, previous studies have mostly focused on the commonality within each SSR, providing little information on different aspects of their variability. In a large group of healthy adults (N = 202), we used functional magnetic resonance imaging to investigate different aspects of topographical and functional variability within SSRs, including interindividual, interhemispheric, and sex differences. First, the PPA, RSC, and TOS were delineated manually for each individual. We then demonstrated that SSRs showed substantial interindividual variability in both spatial topography and functional selectivity. We further identified consistent interhemispheric differences in the spatial topography of all three SSRs, but distinct interhemispheric differences in scene selectivity. Moreover, we found that all three SSRs showed stronger scene selectivity in men than in women. In summary, our work thoroughly characterized the interindividual, interhemispheric, and sex variability of the SSRs and invites future work on the origin and functional significance of these variabilities. Additionally, we constructed the first probabilistic atlases for the SSRs, which provide the detailed anatomical reference for further investigations of the scene network. Hum Brain Mapp 38:2260-2275, 2017. © 2017 Wiley Periodicals, Inc.