Visual speech differentially modulates beta, theta, and high gamma bands in auditory cortex.

INTRODUCTION Speech is multisensory. The addition of visual speech to auditory speech greatly improves comprehension, especially under noisy auditory conditions. However, the neural mechanism for this visual enhancement of auditory speech is poorly understood. We used electrocorticography (ECoG) to study how auditory, visual, and audiovisual speech is processed in the posterior superior temporal gyrus (pSTG), an area of auditory association cortex involved in audiovisual speech integration. We hypothesized that early visual mouth movements modulate audiovisual speech integration through a mechanism of cross-modal suppression, suggesting that the pSTG response to early mouth movements should correlate with comprehension benefits gained by the addition of visual speech to auditory speech. METHODS Words were presented under auditory-only (AUD), visual-only (VIS), and audiovisual (AV) conditions to epilepsy patients (n = 8) implanted with intracranial electrodes for phase-2 monitoring. We measured high-frequency broadband activity (75-150 Hz), a marker for local neuronal firing, in 28 electrodes over the pSTG. RESULTS The early neural response to visual-only words was compared to the reduction in neural response seen from AUD to AV words, a reduction correlated with an improvement in speech comprehension that occurs with the addition of visual to auditory speech. In words that showed a comprehension benefit with the addition of visual speech, there was a strong early response to visual speech and a correlation between early visual response and the AUD-AV difference (r = 0.64, P = 104). In words where visual speech did not provide any comprehension benefit, there was a weak early visual response and no correlation (r = 0.18, P = .35). CONCLUSION Words with a visual speech comprehension benefit also elicit a strong neural response to early visual speech in pSTG, while words with no comprehension benefit do not cause a strong early response. This suggests that cross-modal suppression of auditory association cortex (pSTG) by early visual plays an important role in audiovisual speech perception.

ObjectiveThis study aimed to elucidate the distributions of abnormal activities, as well as the functional connectivity and topological properties of brain networks, in patients diagnosed with anti-N-methyl-D-aspartate receptor (NMDAR) encephalitis.MethodFrom February 2016 to February 2025, acute-phase magnetoencephalography (MEG) data were successfully acquired from 16 patients diagnosed with anti-NMDAR encephalitis at the Affiliated Brain Hospital of Nanjing Medical University. MEG was employed to evaluate the power spectral density (PSD) across multiple frequency bands. Further analysis concentrated on functional connectivity and the topological characteristics of brain networks in order to identify distinctive neurophysiological features associated with the condition.ResultsDuring the acute phase, the PSD in the delta band (1–3 Hz) showed greater power in posterior regions and lower power in anterior regions, with the highest energy concentrated bilaterally in the occipitoparietal and temporal areas. In the theta band (5–7 Hz), the PSD was predominantly localized to the bilateral occipitoparietal regions. The beta1 band (13–20 Hz) was primarily distributed in the right temporo-occipitoparietal regions, while the beta2 band (20–30 Hz) was predominantly distributed in the left temporal, occipitoparietal, and certain frontal regions. Functional connectivity analysis revealed enhanced connections between the left caudal anterior cingulate (CAC_L) and the left superior parietal lobe in the delta and theta bands. Increased connectivity was also observed between the left frontal pole and Precuneus_L, CAC_L, and the left superior temporal gyrus (STG_L)in the theta and beta2 bands. Furthermore, enhanced connectivity between STG_L and Pericalcarine_R was observed in the theta, beta2, and gamma bands. Patients with anti-NMDAR encephalitis demonstrated significantly reduced global efficiency and notable increases in average path length, local efficiency, and clustering coefficient in multiple bands, suggesting local clustering of brain networks during the acute phase.ConclusionAlterations in PSD distribution and brain networks across different frequency bands may provide valuable insights into the electrophysiological changes observed in the brains of anti-NMDAR encephalitis patients. Furthermore, these findings may offer valuable mechanistic insights that could contribute to the development of future diagnostic strategies.Supplementary InformationThe online version contains supplementary material available at 10.1007/s00415-025-13302-x.

While cochlear implants (CIs) have transformed the lives of hundreds of thousands of profoundly deaf individuals worldwide, the ability of individual patients to understand speech through their CI varies widely. The longitudinal study reported in this thesis aimed to investigate the role of cortical function and plasticity in helping to predict and explain variability in individual CI outcome. Speech-evoked cortical activations, measured using functional near-infrared spectroscopy (fNIRS), and behavioural measures of speech perception were acquired in adult CI recipients before implantation through to six months after CI activation. As anticipated, cochlear implantation enabled the significant recovery of auditory speech perception over the first six months of CI use, yet individual performance varied widely across CI users. fNIRS enabled the measurement of speech-evoked cortical activations from bilateral superior temporal cortex (STC) that were free from CI-generated artefacts. Cortical activation to visual speech measured before implantation was able to significantly predict future CI outcome measured following six months of CI use. This pre-implant measure of brain activity provided unique predictive value above that of well-established clinical characteristics, including the age-at-onset and duration of deafness. When examining changes in cortical activation from before to after implantation, a greater increase in STC activation to visual speech was found to be related to better CI outcome. These visual-related changes also predicted changes in STC activation to auditory speech. These results highlight the importance of visual speech cues and coupling between the auditory and visual modalities during the recovery of auditory function with a CI. Together, the findings demonstrate the potential of fNIRS as a brain-imaging tool that is uniquely well-suited for use in cochlear implantation. Future applications of this technology could help to explain individual variability in CI success and to deliver more accurate clinical prognoses for CI candidates.

Stress initiates alterations in electrophysiological brain activity that are correlated with increases in muscle sympathetic nerve activity (MSNA), heart rate (HR), and blood pressure (BP). However, we do not know if changes in brain activity occur solely in regions comprising the central autonomic network, or if other large-scale brain networks are involved in the stress-induced pressor response. To answer this question, this study measured connectivity between different brain regions at rest and during acute stress, using magnetoencephalography in 29 healthy individuals. Whole head and regions of interest analyses were performed using phase-lag indices as a connectivity metric. Regions of interest were confined to the central autonomic, sensorimotor, salience, default, and central executive networks. Functional connectivity was calculated on magnetoencephalography recordings that were filtered into delta (1-4 Hz), theta (4-8 Hz), alpha (8-13 Hz), beta (13-30 Hz), low gamma (30-80 Hz), and high gamma (80-120 Hz) bands. Substantial reductions in connectivity were observed during cognitive stress. These were largely characterized by reduced parahippocampal-sensorimotor connectivity in beta and high gamma bands. Moreover, reduced connectivity within the central autonomic, sensorimotor, and default mode networks was noted, specifically as a reduction in the alpha band between the precuneus and hippocampus. We observed a salience-directed switching between the default and executive networks, driven by reduced right anterior cingulate-right insula connectivity. Furthermore, we observed reduced right medial prefrontal cortex-brainstem connectivity in beta band. Our results indicate that stress influences the functional connectivity of several key brain regions that interact with multiple large-scale brain networks linked to mental and physical states.NEW & NOTEWORTHY This study reveals significant reductions in functional connectivity among several large-scale brain networks during stress. Reduced connectivity was observed within central autonomic, sensorimotor, default, salience, and executive networks in alpha (8-13 Hz), beta (13-30 Hz), and high gamma (80-120) bands, including reduced connectivity between the right medial prefrontal cortex and the brainstem.

Syntactic and auditory spatial processing in the human temporal cortex: An MEG study

Despite a large body of research, we continue to lack a detailed account of how auditory processing of continuous speech unfolds in the human brain. Previous research showed the propagation of low-level acoustic features of speech from posterior superior temporal gyrus toward anterior superior temporal gyrus in the human brain (Hullett et al., 2016). In this study, we investigate what happens to these neural representations past the superior temporal gyrus and how they engage higher-level language processing areas such as inferior frontal gyrus. We used low-level sound features to model neural responses to speech outside of the primary auditory cortex. Two complementary imaging techniques were used with human participants (both males and females): electrocorticography (ECoG) and fMRI. Both imaging techniques showed tuning of the perisylvian cortex to low-level speech features. With ECoG, we found evidence of propagation of the temporal features of speech sounds along the ventral pathway of language processing in the brain toward inferior frontal gyrus. Increasingly coarse temporal features of speech spreading from posterior superior temporal cortex toward inferior frontal gyrus were associated with linguistic features such as voice onset time, duration of the formant transitions, and phoneme, syllable, and word boundaries. The present findings provide the groundwork for a comprehensive bottom-up account of speech comprehension in the human brain.SIGNIFICANCE STATEMENT We know that, during natural speech comprehension, a broad network of perisylvian cortical regions is involved in sound and language processing. Here, we investigated the tuning to low-level sound features within these regions using neural responses to a short feature film. We also looked at whether the tuning organization along these brain regions showed any parallel to the hierarchy of language structures in continuous speech. Our results show that low-level speech features propagate throughout the perisylvian cortex and potentially contribute to the emergence of "coarse" speech representations in inferior frontal gyrus typically associated with high-level language processing. These findings add to the previous work on auditory processing and underline a distinctive role of inferior frontal gyrus in natural speech comprehension.

Background: Post-stroke gait rehabilitation strategies predominantly target steady-state patterns. Demanding walking environments more closely approximate real-world motor control demands than stable conditions, yet their neural correlates in stroke patients remain unclear. Methods: Sixty stroke patients completed three walking tasks: stable level-ground walking, asymmetrical walking task, and visual-deprived ambulation, with synchronized electroencephalography (EEG) recordings. Spectral power was computed across delta, theta, alpha, beta, and gamma frequency bands. Brain functional connectivity was assessed via weighted phase lag index, with graph theory metrics quantifying brain functional network features. Results: During the asymmetrical walking task, spectral power analysis exhibited reduced theta-band power and increased power in beta and gamma frequency bands. Brain functional networks showed weakened theta-band functional connectivity, and enhanced frontal-occipital connections in alpha, beta, and gamma frequency bands, accompanied by prolonged character path length in the delta frequency band and diminished clustering coefficients in alpha and gamma frequency bands. Under visual-deprivation ambulation, spectral power analysis exhibited suppressed delta and theta power and attenuated dominance in alpha, beta, and gamma frequency bands. The corresponding brain functional networks showed decoupled functional connectivity in delta and theta frequency bands, enhanced alpha-band frontal-parietal-temporal-occipital connections, and frontal-parietal-temporal interactions in the beta band, accompanied by increased delta character path length, diminished clustering coefficient, longer character path lengths and smaller clustering coefficients shown in alpha, beta, and gamma frequency bands. Conclusions: Demanding environmental challenges drive beneficial brain adaptations and could be harnessed to promote adaptive neuroplasticity in stroke rehabilitation. Trial registration:The study protocol was registered on ClinicalTrials.gov (No. NCT06395142).

Towards a fronto-temporal neural network for the decoding of angry vocal expressions

Speech comprehension is improved by viewing a speaker's face, especially in adverse hearing conditions, a principle known as inverse effectiveness. However, the neural mechanisms that help to optimize how we integrate auditory and visual speech in such suboptimal conversational environments are not yet fully understood. Using human EEG recordings, we examined how visual speech enhances the cortical representation of auditory speech at a signal-to-noise ratio that maximized the perceptual benefit conferred by multisensory processing relative to unisensory processing. We found that the influence of visual input on the neural tracking of the audio speech signal was significantly greater in noisy than in quiet listening conditions, consistent with the principle of inverse effectiveness. Although envelope tracking during audio-only speech was greatly reduced by background noise at an early processing stage, it was markedly restored by the addition of visual speech input. In background noise, multisensory integration occurred at much lower frequencies and was shown to predict the multisensory gain in behavioral performance at a time lag of ∼250 ms. Critically, we demonstrated that inverse effectiveness, in the context of natural audiovisual (AV) speech processing, relies on crossmodal integration over long temporal windows. Our findings suggest that disparate integration mechanisms contribute to the efficient processing of AV speech in background noise. The behavioral benefit of seeing a speaker's face during conversation is especially pronounced in challenging listening environments. However, the neural mechanisms underlying this phenomenon, known as inverse effectiveness, have not yet been established. Here, we examine this in the human brain using natural speech-in-noise stimuli that were designed specifically to maximize the behavioral benefit of audiovisual (AV) speech. We find that this benefit arises from our ability to integrate multimodal information over longer periods of time. Our data also suggest that the addition of visual speech restores early tracking of the acoustic speech signal during excessive background noise. These findings support and extend current mechanistic perspectives on AV speech perception.

Auditory cortex encodes lipreading information through spatially distributed activity

Learning to read alphabetic languages starts with learning letter–speech-sound associations. How this process changes brain function during development is still largely unknown. We followed 102 children with varying reading skills in a mixed-longitudinal/cross-sectional design from the prereading stage to the end of elementary school over five time points (n = 46 with two and more time points, of which n = 16 fully-longitudinal) to investigate the neural trajectories of letter and speech sound processing using fMRI. Children were presented with letters and speech sounds visually, auditorily, and audiovisually in kindergarten (6.7yo), at the middle (7.3yo) and end of first grade (7.6yo), and in second (8.4yo) and fifth grades (11.5yo). Activation of the ventral occipitotemporal cortex for visual and audiovisual processing followed a complex trajectory, with two peaks in first and fifth grades. The superior temporal gyrus (STG) showed an inverted U-shaped trajectory for audiovisual letter processing, a development that in poor readers was attenuated in middle STG and absent in posterior STG. Finally, the trajectories for letter-speech-sound integration were modulated by reading skills and showed differing directionality in the congruency effect depending on the time point. This unprecedented study captures the development of letter processing across elementary school and its neural trajectories in children with varying reading skills.

Regions of the human posterior superior temporal gyrus and sulcus (pSTG/S) respond to the visual mouth movements that constitute visual speech and the auditory vocalizations that constitute auditory speech, and neural responses in pSTG/S may underlie the perceptual benefit of visual speech for the comprehension of noisy auditory speech. We examined this possibility through the lens of multivoxel pattern responses in pSTG/S. BOLD fMRI data was collected from 22 participants presented with speech consisting of English sentences presented in five different formats: visual-only; auditory with and without added auditory noise; and audiovisual with and without auditory noise. Participants reported the intelligibility of each sentence with a button press and trials were sorted post-hoc into those that were more or less intelligible. Response patterns were measured in regions of the pSTG/S identified with an independent localizer. Noisy audiovisual sentences with very similar physical properties evoked very different response patterns depending on their intelligibility. When a noisy audiovisual sentence was reported as intelligible, the pattern was nearly identical to that elicited by clear audiovisual sentences. In contrast, an unintelligible noisy audiovisual sentence evoked a pattern like that of visual-only sentences. This effect was less pronounced for noisy auditory-only sentences, which evoked similar response patterns regardless of intelligibility. The successful integration of visual and auditory speech produces a characteristic neural signature in pSTG/S, highlighting the importance of this region in generating the perceptual benefit of visual speech.

EEG activation patterns during the performance of tasks involving different components of mental calculation

Frontiers Events is a rapidly growing calendar management system dedicated to the scheduling of academic events. This includes announcements and invitations, participant listings and search functionality, abstract handling and publication, related events and post-event exchanges. Whether an organizer or participant, make your event a Frontiers Event!

Preschool impairments in auditory processing and speech perception uniquely predict future reading problems