Sound-Induced Flash Illusion is Resistant to Feedback Training

The present study examined age-related differences in multisensory integration and the effect of spatial disparity on the sound-induced flash illusion—-an illusion used in previous research to assess age-related differences in multisensory integration. Prior to participation in the study, both younger and older participants demonstrated their ability to detect 1–2 visual flashes and 1–2 auditory beep presented unimodally. After passing the pre-test, participants were then presented 1–2 flashes paired with 0–2 beeps that originated from one of five speakers positioned equidistantly 100cm from the participant. One speaker was positioned directly below the screen, two speakers were positioned 50cm to the left and right from the center of the screen, and two more speakers positioned to the left and right 100cm from the center of the screen. Participants were told to report the number of flashes presented and to ignore the beeps. Both age groups showed a significant effect of the beeps on the perceived number of flashes. However, neither younger nor older individuals showed any significant effect of spatial disparity on the sound-induced flash illusion. The presence of a congruent number of beeps increased accuracy for both older and younger individuals. Reaction time data was also analyzed. As expected, older individuals showed significantly longer reaction times when compared to younger individuals. In addition, both older and younger individuals showed a significant increase in reaction time for fusion trials, where two flashes and one beep are perceived as a single flash, as compared to congruent single flash trials. This increase in reaction time was not found for fission trials, where one flash and two beeps were perceived as two flashes. This suggests that processing may differ for the two forms for fission as compared to fusion illusions.

Multisensorial Perception in Chronic Migraine and the Role of Medication Overuse

Sound-induced flash illusion (SiFI) refers to an auditory dominance effect in which observers misperceive the number of visual flashes due to the simultaneous presentation of a different number of auditory beeps. Although the SiFI remains robust despite many factors, little is known about how the dominance of audition over vision changes as a function of spatial location in 3D space and how this corresponds with aging. In the present study, we recruited younger (18-26 years old) and older adults (60-76 years old) and presented visual stimuli in near space and auditory stimuli in far space (Vnear_Afar) or visual stimuli in far space and auditory stimuli in near space (Vfar_Anear), with the aim of exploring the effect of aging on spatial dominance in SiFI. The results showed that both participant groups exhibited a SiFI auditory dominance effect; however, older adults were more susceptible to illusions than younger adults. More importantly, for younger adults, when auditory stimuli were presented in far space, the accuracy and d' indicated that SiFI was significantly enhanced in the fission illusion, and the reaction time (RT) results showed that RT became longer in the fusion illusion. However, for older adults, the SiFI was not affected by the spatial location. Therefore, the present results reveal for the first time that the SiFI effect is modulated by the depth of auditory stimuli. Moreover, older adults were not susceptible to the depth dimension, thus showing age-related sensory decline and specifically showing a decreased ability to localize visual and auditory stimuli.

Sound-induced flash illusion (SIFI) is an auditory-dominated multisensory integration phenomenon in which flashes presented in conjunction with an unequal number of auditory sounds are illusorily perceived as equal in number to the auditory sounds. Previous studies on the factors that impact SIFI have mainly focused on top-down and bottom-up factors. This study aimed to explore the effects of top-down cognitive expectations on the SIFI by manipulating the proportion of trial types. The results showed that the accuracy of judgment was improved and reaction times were shortened when the instructions were consistent with the actual proportion of trial type. When the instructions were not consistent with the actual proportion of trial types, the instructions could still regulate the accuracy and reaction times in judging the fission illusion (i.e., a brief flash accompanied by two auditory stimuli tends to be perceived as two flashes) regardless of the actual proportion of trial types. The results indicated that top-down cognitive expectations could significantly reduce the fission illusion and accelerate the judgment, but the effect was not significant in the fusion illusion (i.e., two brief flashes accompanied by single auditory stimuli tend to be perceived as a single flash) due to the instability of the illusion.

This chapter reviews the functional anatomical bases of visual perception in the retina, the lateral geniculate nucleus (LGN) in the visual thalamus, the primary visual cortex (area V1, also called the striate cortex, and Brodmann area 17), and the extrastriate visual cortical areas of the dorsal and ventral pathways. The sections dedicated to the retina and LGN review the basic anatomical and laminar organization of these two areas, as well as their retinotopic organization and receptive field structure. We also describe the anatomical and functional differ- ences among the magnocellular, parvocelullar and koniocellular pathways. The section dedicated to area V1 reviews the functional maps in this area (retino- topic map, ocular dominance map, orientation selectivity map), as well as their anatomical relationship to each other. Special attention is given to the modular columnar organization of area V1, and to the various receptive field classes in V1 neurons. The section dedicated to extrastriate cortical visual areas describes the "where" and "what" pathways in the dorsal and ventral visual streams, and their respective physiological functions. The temporal dynamics of neurons throughout the visual pathway are critical to understanding visibility and neural information processing. We discuss the role of lateral inhibition circuits in processing spatiotemporal edges, corners, and in the temporal dynamics of vision. We also discuss the effects of eye movements on visual physiology and percep- tion in early visual areas. Our visual and oculomotor systems must achieve a very delicate balance: insufficient eye movements lead to adaptation and visual fading, whereas excessive motion of the eyes produces blurring and unstable vision during fixation. These issues are very important for neural prosthetics, in which electrodes are stabilized on the substrate.

Sound-induced flash illusion (SiFI) is the illusion that participants perceive incorrectly that the number of visual flashes is equal to the number of auditory beeps when presented within 100 ms. Although previous studies found that repetition suppression can reduce an individual's perceptual sensitivity to the SiFI, there is not yet a consensus as to how visual adaptation affects the SiFI. In the present study, we added prolonged adapting visual stimuli prior to the presentation of audiovisual stimuli to investigate whether the bottom-up factor of adaptation affects the SiFI. The adapting visual stimuli consisted of one or two of the same visual stimuli that lasted for 2 minutes in succession, followed by the audiovisual stimuli. Both adaptation conditions showed SiFI effects. The accuracy of adapting double-flashes was significantly lower than that of in adapting a single flash for the fission illusion. Our analyses indicated that such a pattern could be attributed to a lower d' in adapting double-flashes than in adapting a single flash. However, the accuracy, discriminability and criterion were not significantly different between the two adaptation conditions because of the instability of the fusion illusion. Thus, the present study indicated that the reduced perceptual sensitivity based on visual adaptation could enhance the fission illusion in multisensory integration.

DEFICITS IN PREFRONTAL AND SENSORY INTERACTIONS IN TOP-DOWN CONTROL IN SCHIZOPHRENIA

One of the puzzling aspects in the visual attention literature is the discrepancy between electrophysiological and fMRI findings: whereas fMRI studies reveal strong attentional modulation in the earliest visual areas,...

Visual and proprioceptive interaction in patients with bilateral vestibular loss☆

Efficient learning in children with rapid GABA boosting during and after training

A method for mapping retinal images in early visual cortical areas

Perceptual learning induces changes in early and late visual evoked potentials

Brain activity patterns in high-level visual cortex support accurate linear classification of visual concepts (e.g., objects or scenes). It has long been appreciated that the accuracy of linear classification in any brain area depends on the geometry of its concept manifolds—sets of brain activity patterns that encode images of a concept. However, it is unclear how the geometry of concept manifolds differs between regions of visual cortex that support accurate classification and those that don’t, or how it differs between visual cortex and deep neural networks (DNNs). We estimated geometric properties of concept manifolds that, per a recent theory, directly determine the accuracy of simple “few-shot” linear classifiers. Using a large fMRI dataset, we show that variation in classification accuracy across human visual cortex is driven by a variation in a single geometric property: the distance between manifold centers (“geometric Signal”). In contrast, variation in classification accuracy across early and mid DNN layers is driven by an increase in the effective number of manifold dimensions (“Dimensionality”). Despite this difference in the geometric properties that affect few-shot classification performance in the brain and DNNs, we find that Signal and Dimensionality are strongly, negatively correlated: when Signal increases across brain regions or DNN layers, Dimensionality decreases, and vice versa. We conclude that early visual cortical areas and DNN layers deploy different geometric strategies for accurate linear classification of concepts, even though both are subject to the same constraint.

Contrast adaptation is a fundamental visual process that has been extensively investigated and used to infer the selectivity of visual cortex. We recently reported an apparent disconnect between the effects of contrast adaptation on perception and functional magnetic resonance imaging BOLD response adaptation, in which adaptation between chromatic and achromatic stimuli measured psychophysically showed greater selectivity than adaptation measured using BOLD signals. Here we used magnetoencephalography (MEG) recordings of neural responses to the same chromatic and achromatic adaptation conditions to characterize the neural effects of contrast adaptation and to determine whether BOLD adaptation or MEG better reflect the measured perceptual effects. Participants viewed achromatic, L-M isolating, or S-cone isolating radial sinusoids before adaptation and after adaptation to each of the three contrast directions. We measured adaptation-related changes in the neural response to a range of stimulus contrast amplitudes using two measures of the MEG response: the overall response amplitude, and a novel time-resolved measure of the contrast response function, derived from a classification analysis combined with multidimensional scaling. Within-stimulus adaptation effects on the contrast response functions in each case showed a pattern of contrast-gain or a combination of contrast-gain and response-gain effects. Cross-stimulus adaptation conditions showed that adaptation effects were highly stimulus selective across early, ventral, and dorsal visual cortical areas, consistent with the perceptual effects.

The visual system employs a sophisticated balance of attentional mechanisms: salient stimuli are prioritized for visual processing, yet observers can also ignore such stimuli when their goals require directing attention elsewhere. A powerful determinant of visual salience is local feature contrast: if a local region differs from its immediate surround along one or more feature dimensions, it will appear more salient. We used high-resolution functional MRI (fMRI) at 7T to characterize the modulatory effects of bottom-up salience and top-down voluntary attention within multiple sites along the early visual pathway, including visual areas V1-V4 and the lateral geniculate nucleus (LGN). Observers viewed arrays of spatially distributed gratings, where one of the gratings immediately to the left or right of fixation differed from all other items in orientation or motion direction, making it salient. To investigate the effects of directed attention, observers were cued to attend to the grating to the left or right of fixation, which was either salient or nonsalient. Results revealed reliable additive effects of top-down attention and stimulus-driven salience throughout visual areas V1-hV4. In comparison, the LGN exhibited significant attentional enhancement but was not reliably modulated by orientation- or motion-defined salience. Our findings indicate that top-down effects of spatial attention can influence visual processing at the earliest possible site along the visual pathway, including the LGN, whereas the processing of orientation- and motion-driven salience primarily involves feature-selective interactions that take place in early cortical visual areas.NEW & NOTEWORTHY While spatial attention allows for specific, goal-driven enhancement of stimuli, salient items outside of the current focus of attention must also be prioritized. We used 7T fMRI to compare salience and spatial attentional enhancement along the early visual hierarchy. We report additive effects of attention and bottom-up salience in early visual areas, suggesting that salience enhancement is not contingent on the observer's attentional state.