Even when experimental conditions are kept constant, a robust and consistent finding in both behavioral and neural experiments designed to examine multisensory processing is striking variability. Although this variability has often been considered uninteresting noise (a term that is laden with strong connotations), emerging work suggests that differences in variability may be an important aspect in describing differences in performance between individuals and groups. In the current review, derived from a symposium at the 2015 International Multisensory Research Forum in Pisa, Italy, we focus on several aspects of variability as it relates to multisensory function. This effort seeks to expand our understanding of variability at levels of coding and analysis ranging from the single neuron through large networks and on to behavioral processes, and encompasses a number of the multimodal approaches that are used to evaluate and characterize multisensory processing including single-unit neurophysiology, electroencephalography (EEG), functional magnetic resonance imaging (fMRI), and electrocorticography (ECoG).

Cross-modal associations refer to non-arbitrary associations of features across sensory modalities. Such associations have been observed between many different sensory features. One association that has rarely been studied so far is between touch and color. In this study, participants were asked to match tactile and haptic adjectives to color samples shown individually on a screen. They could select one to 11 tactile and haptic terms, presented in 11 pairs of opposed adjectives. The results showed a regular pattern in the way tactile and haptic terms were matched to color. Our results further revealed that the colors to which tactile and haptic terms were matched did not fall within the boundaries of color lexical categories, suggesting that the associations were not based on lexicon--despite the frequent occurrence of linguistic expressions such as 'soft pink', not all colors called 'pink' were matched to 'soft'. In contrast with one recent study, the distribution of tactile and haptic terms across the Munsell array suggests that along with brightness and chroma, hue was also relevant to participants' responses. Specifically in the case of hue, several opposed adjectives were relatively well matched to opposed colors, along the orthogonal Yellow/Blue and Red/Green axes, which are suggested to structure the space of hue experience. Possible accounts of these results are considered.

The renewed interest that has emerged around the topic of crossmodal correspondences in recent years has demonstrated that crossmodal matchings and mappings exist between the majority of sensory dimensions, and across all combinations of sensory modalities. This renewed interest also offers a rapidly-growing list of ways in which correspondences affect--or interact with--metaphorical understanding, feelings of 'knowing', behavioral tasks, learning, mental imagery, and perceptual experiences. Here we highlight why, more generally, crossmodal correspondences matter to theories of multisensory interactions.

Low- and high-pitched sounds are perceptually associated with low and high visuospatial elevations, respectively. The spatial properties of this association are not well understood. Here we report two experiments that investigated whether low and high tones can be used as spatial cues to upright for self-orientation and identified the spatial frame(s) of reference used in perceptually binding auditory pitch to visuospatial 'up' and 'down'. In experiment 1, participants' perceptual upright (PU) was measured while lying on their right side with and without high- and low-pitched sounds played through speakers above their left ear and below their right ear. The sounds were ineffective in moving the perceived upright from a direction intermediate between the body and gravity towards the direction indicated by the sounds. In experiment 2, we measured the biasing effects of ascending and descending tones played through headphones on ambiguous vertical or horizontal visual motion created by combining gratings drifting in opposite directions while participants either sat upright or laid on their right side. Ascending and descending tones biased the interpretation of ambiguous motion along both the gravitational vertical and the long-axis of the body with the strongest effect along the body axis. The combination of these two effects showed that axis of maximum effect of sound corresponded approximately to the direction of the perceptual upright, compatible with the idea that 'high' and 'low' sounds are defined along this axis.

Results obtained in both animal models and hemianopic patients indicate that sound, spatially and temporally coincident with a visual stimulus, can improve visual perception in the blind hemifield, probably due to activation of 'multisensory neurons', mainly located in the superior colliculus. In view of this evidence, a new rehabilitation approach, based on audiovisual stimulation of visual field, has been proposed, and applied in adults with visual field reduction due to unilateral brain lesions. So far, results have been very encouraging, with improvements in visual search abilities. Based on these findings, we have investigated the possibility of inducing long-lasting amelioration also in children with a visual deficit due to acquired brain lesions. Our results suggest that, in the absence of spontaneous recovery, audiovisual training can induce activation of visual responsiveness of the oculomotor system also in children and adolescents with acquired lesions and confirm the putatively important role of the superior colliculus (SC) in this process.

Caloric vestibular stimulation (CVS) is a simple physiological manipulation that has been used for a long time in different clinical fields due to its rapid and relevant effects on behaviour. One of the most debated issues in this research field concerns the degree of specificity of such stimulation, namely whether the effects of CVS can be, and to what extent are, independent of the mere influence of non-specific factors such as general arousal, ocular movements or attentional shift towards the stimulated side. The hypothesis that CVS might cause a shift of attention towards the side of the stimulation has been largely supported; moreover, a large amount of evidence is available nowadays to corroborate the specific effect of CVS, providing behavioural and neurophysiological data in both patients and normal subjects. These data converge in indicating that the effects of CVS can be independent of eye deviation and general arousal, can modulate different symptoms in different directions, and do not merely depend on a general shift of attention. The present article is divided into three main sections. In the first section, we describe classical studies that investigate the effects of CVS on neglect and related symptoms. In the second and third parts, we provide an overview of the modulatory effects of CVS on somatosensory processes and body representation in both brain-damaged patients and healthy subjects. Finally, we conclude by discussing the relevance of these new findings for the understanding of the neural mechanisms underlying the modulatory effects of CVS.

This special issue in Multisensory Research aims to cover three such lines of evidence: suggesting that (1) the flexibility of spatial representations, (2) adult plasticity and (3) multimodality, are not properties of associative areas alone, but may depend on the primary visual cortex V1.

Sensory information provided by the vestibular system is crucial in cognitive processes such as the ability to recognize objects. The orientation at which objects are most easily recognized--the perceptual upright (PU)--is influenced by body orientation with respect to gravity as detected from the somatosensory and vestibular systems. To date, the influence of these sensory cues on the PU has been measured using a letter recognition task. Here we assessed whether gravitational influences on letter recognition also extend to human face recognition. 13 right-handed observers were positioned in four body orientations (upright, left-side-down, right-side-down, supine) and visually discriminated ambiguous characters ('p'-from-'d'; 'i'-from-'!') and ambiguous faces used in popular visual illusions ('young woman'-from-'old woman'; 'grinning man'-from-'frowning man') in a forced-choice paradigm. The two transition points (e.g., 'p-to-d' and 'd-to-p'; 'young woman-to-old woman' and 'old woman-to-young woman') were fit with a sigmoidal psychometric function and the average of these transitions was taken as the PU for each stimulus category. The results show that both faces and letters are more influenced by body orientation than gravity. However, faces are more optimally recognized when closer in alignment with body orientation than letters--which are more influenced by gravity. Our results indicate that the brain does not utilize a common representation of upright that governs recognition of all object categories. Distinct areas of ventro-temporal cortex that represent faces and letters may weight bodily and gravitational cues differently--possibly to facilitate the specific demands of face and letter recognition.

Vestibular cognition can be divided into two main functions--a primary vestibular sensation of self-motion and a derived sensation of spatial orientation. Although the vestibular system requires calibration from other senses for optimal functioning, both vestibular spatial and vestibular motion perception are typically employed when navigating without vision. A recent important finding is the cerebellar mediation of the uncoupling of reflex (i.e., the vestibular-ocular reflex) from vestibular motion perception (Perceptuo-Reflex Uncoupling). The brain regions that mediate vestibular motion and vestibular spatial perception is an area of on-going research activity. However, there is data to support the notion that vestibular motion perception is mediated by multiple brain regions. In contrast, vestibular spatial perception appears to be mediated by posterior brain areas although currently the exact locus is unclear. I will discuss the experimental evidence that support this functional dichotomy in vestibular cognition (i.e., motion processing vs. spatial orientation). Along the way I will highlight relevant practical technical tips in testing vestibular cognition.