Sensorimotor integration during human self-vocalization: Insights from invasive electrophysiology

SUMMARYNeuronal oscillations are suggested to play an important role in auditory working memory (WM), but their contribution to content-specific representations has remained unclear. Here, we measure magnetoencephalography during a retro-cueing task with parametric ripple-sound stimuli, which are spectrotemporally similar to speech but resist non-auditory memory strategies. Using machine learning analyses, with rigorous between-subject cross-validation and non-parametric permutation testing, we show that memorized sound content is strongly represented in phase-synchronization patterns between subregions of auditory and frontoparietal cortices. These phase-synchronization patterns predict the memorized sound content steadily across the studied maintenance period. In addition to connectivity-based representations, there are indices of more local, “activity silent” representations in auditory cortices, where the decoding accuracy of WM content significantly increases after task-irrelevant “impulse stimuli.” Our results demonstrate that synchronization patterns across auditory sensory and association areas orchestrate neuronal coding of auditory WM content. This connectivity-based coding scheme could also extend beyond the auditory domain.

Across the animal kingdom, neural responses in the auditory cortex are suppressed during vocalization, and humans are no exception. A common hypothesis is that suppression increases sensitivity to auditory feedback, enabling the detection of vocalization errors. This hypothesis has been previously confirmed in non-human primates, however a direct link between auditory suppression and sensitivity in human speech monitoring remains elusive. To address this issue, we obtained intracranial electroencephalography (iEEG) recordings from 35 neurosurgical participants during speech production. We first characterized the detailed topography of auditory suppression, which varied across superior temporal gyrus (STG). Next, we performed a delayed auditory feedback (DAF) task to determine whether the suppressed sites were also sensitive to auditory feedback alterations. Indeed, overlapping sites showed enhanced responses to feedback, indicating sensitivity. Importantly, there was a strong correlation between the degree of auditory suppression and feedback sensitivity, suggesting suppression might be a key mechanism that underlies speech monitoring. Further, we found that when participants produced speech with simultaneous auditory feedback, posterior STG was selectively activated if participants were engaged in a DAF paradigm, suggesting that increased attentional load can modulate auditory feedback sensitivity.

Neural correlates of impaired vocal feedback control in post-stroke aphasia

Effector-independent brain network for auditory-motor integration: fMRI evidence from singing and cello playing

Towards a fronto-temporal neural network for the decoding of angry vocal expressions

A previous study reported that perturbed auditory feedback affected voicing production [Mitsuya, MacDonald, and Munhall (2014). J. Acoust. Soc. Am., 135, 2986-2994]. In this study, we investigated whether perturbed auditory feedback would also affect voicing perception. Eighteen native Japanese speakers participated in the experiment. Half of the participants performed an auditory feedback task in which a syllable sound /da/ was presented simultaneously with the participant’s utterance of /ta/. The other participants did a passive listening task in which participants heard a syllable sound /da/ without the utterance. Before and after each task, participants performed a /da/-/ta/ speech production task and a speech identification task of / da/-/ta/ continuum varying in voice-onset time (VOT). Results showed that perturbed auditory feedback lengthened the VOT of /ta/ production, whereas passive listening did not affect voicing production. Regarding voicing perception, passive listening shortened the VOT boundary of /da/-/ta/, which may be due to selective adaptation. On the other hand, perturbed auditory feedback did not vary the boundary. One interpretation of these results is that the effects of voicing production modulation on voicing perception can be cancelled out by selective adaptation, which may have occurred by listening to a syllable sound /da/ during auditory feedback task.A previous study reported that perturbed auditory feedback affected voicing production [Mitsuya, MacDonald, and Munhall (2014). J. Acoust. Soc. Am., 135, 2986-2994]. In this study, we investigated whether perturbed auditory feedback would also affect voicing perception. Eighteen native Japanese speakers participated in the experiment. Half of the participants performed an auditory feedback task in which a syllable sound /da/ was presented simultaneously with the participant’s utterance of /ta/. The other participants did a passive listening task in which participants heard a syllable sound /da/ without the utterance. Before and after each task, participants performed a /da/-/ta/ speech production task and a speech identification task of / da/-/ta/ continuum varying in voice-onset time (VOT). Results showed that perturbed auditory feedback lengthened the VOT of /ta/ production, whereas passive listening did not affect voicing production. Regarding voicing perception, passive listening shortened the VOT bou...

Motor and visual influences on auditory neural processing during speaking and listening

Despite a large body of research, we continue to lack a detailed account of how auditory processing of continuous speech unfolds in the human brain. Previous research showed the propagation of low-level acoustic features of speech from posterior superior temporal gyrus toward anterior superior temporal gyrus in the human brain (Hullett et al., 2016). In this study, we investigate what happens to these neural representations past the superior temporal gyrus and how they engage higher-level language processing areas such as inferior frontal gyrus. We used low-level sound features to model neural responses to speech outside of the primary auditory cortex. Two complementary imaging techniques were used with human participants (both males and females): electrocorticography (ECoG) and fMRI. Both imaging techniques showed tuning of the perisylvian cortex to low-level speech features. With ECoG, we found evidence of propagation of the temporal features of speech sounds along the ventral pathway of language processing in the brain toward inferior frontal gyrus. Increasingly coarse temporal features of speech spreading from posterior superior temporal cortex toward inferior frontal gyrus were associated with linguistic features such as voice onset time, duration of the formant transitions, and phoneme, syllable, and word boundaries. The present findings provide the groundwork for a comprehensive bottom-up account of speech comprehension in the human brain.SIGNIFICANCE STATEMENT We know that, during natural speech comprehension, a broad network of perisylvian cortical regions is involved in sound and language processing. Here, we investigated the tuning to low-level sound features within these regions using neural responses to a short feature film. We also looked at whether the tuning organization along these brain regions showed any parallel to the hierarchy of language structures in continuous speech. Our results show that low-level speech features propagate throughout the perisylvian cortex and potentially contribute to the emergence of "coarse" speech representations in inferior frontal gyrus typically associated with high-level language processing. These findings add to the previous work on auditory processing and underline a distinctive role of inferior frontal gyrus in natural speech comprehension.

Neural processing of speech in noise recognition in preschool children with different auditory processing abilities: a fNIRS study.

Benefits of intensive speech treatment have been documented for a range of speech signs in English speakers with Parkinson's Disease (PD). However, the answer to a critical question that whether the same treatment benefits speech variables including intelligibility in Mandarin speakers is still unclear. In order to develop a targeted speech treatment for Mandarin speakers with PD, we reviewed the efficacy of intensive speech treatment to improve vocal loudness and functional communication and discuss possible explanations for efficacy on Mandarin speakers with PD. Literatures about intensive speech treatment for Mandarin speakers with PD were retrieved from PubMed, Web of Science, Embase, China National Knowledge Infrastructure (CNKI), Wanfang and Weipu Database for Chinese Technical Periodicals (VIP) Database. Search strategy was (voice therapy OR speech therapy OR voice treatment OR speech treatment OR voice training OR speech training OR voice rehabilitation OR speech rehabilitation OR Lee Silverman voice treatment OR intensive speech treatment) and (Parkinson's disease) and (Mandarin speakers OR Chinese OR Chinese people). Five randomized controlled trials were selected and possible explanations for efficacy on individuals with PD are discussed. Further research directions are suggested. The existing evidence from treatment efficacy studies of intensive speech treatment provides support for improving vocal loudness, speech intelligibility, pitch and rate in Mandarin speakers with PD. Our future research will continue to work to conduct a large sample multicenter randomized controlled trial to provide high quality evidence and understand the basic mechanisms accompanying treatment-related change.

Cortical Activation to Auditory Mismatch Elicited by Frequency Deviant and Complex Novel Sounds: A PET Study

Active listening has been reported to elicit a different sensory response from passive listening and is generally observed as an increase in the magnitude of activation. Sensory activation differences may therefore be masked by the effect of attention. The present study measured activation induced by static and modulated tones, while controlling attention by using target-discrimination and passive listening tasks. The factorial design enabled us to determine whether the stimulus-induced activation in auditory cortex was independent of the information-processing demands of the task. Contrasted against a silent baseline, listening to the tones induced widespread activation in the temporal cortex, including Heschl's gyrus (HG), planum temporale, superior temporal gyrus (STG), and superior temporal sulcus. No additional auditory areas were recruited in the response to modulated tones compared to static tones, but there was an increase in the response in the STG, anterior to HG. Relative to passive listening, the active task increased the response in the STG, posterior to HG. The active task also recruited regions in the frontal and parietal cortex and subcortical areas. These findings indicate that preferential responses to the changing spectro-temporal properties of the stimuli and to the target-discrimination task involve distinct, non-overlapping areas of the secondary auditory cortex. Thus, in the present study, differences in sensory activation were not masked by the effects of attention.

Functional connectivity is scaffolded by the structural connections of the brain. Disruptions of either structural or functional connectivity can lead to deficits in cognitive functions and increase the risk for neurodevelopmental disorders such as attention deficit hyperactivity disorder (ADHD). To date, very little research has examined the association between structural and functional connectivity in typical development, while no studies have attempted to understand the development of structure-function coupling in children with ADHD. 175 individuals (84 typically developing children and 91 children with ADHD) participated in a longitudinal neuroimaging study with up to three waves. In total, we collected 278 observations between the ages 9 and 14 (139 each in typically developing controls and ADHD). Regional measures of structure-function coupling were calculated at each timepoint using Spearman’s rank correlation and mixed effect models were used to determine group differences and longitudinal changes in coupling over time. In typically developing children, we observed increases in structure-function coupling strength across multiple higher-order cognitive and sensory regions. Overall, weaker coupling was observed in children with ADHD, mainly in the prefrontal cortex, superior temporal gyrus, and inferior parietal cortex. Further, children with ADHD showed an increased rate of coupling strength predominantly in the inferior frontal gyrus, superior parietal cortex, precuneus, mid-cingulate, and visual cortex, compared to no corresponding change over time in typically developing controls. This study provides evidence of the joint maturation of structural and functional brain connections in typical development across late childhood to mid-adolescence, particularly in regions that support cognitive maturation. Findings also suggest that children with ADHD exhibit different patterns of structure-function coupling, suggesting atypical patterns of coordinated white matter and functional connectivity development predominantly in the regions overlapping with the default mode network, salience network, and dorsal attention network during late childhood to mid-adolescence.

Processing of speech and nonspeech sounds occurs bilaterally within primary auditory cortex and surrounding regions of the superior temporal gyrus; however, the manner in which these regions interact during speech and nonspeech processing is not well understood. Here, we investigate the underlying neuronal architecture of the auditory system with magnetoencephalography and a mismatch paradigm. We used a spoken word as a repeating "standard" and periodically introduced 3 "oddball" stimuli that differed in the frequency spectrum of the word's vowel. The closest deviant was perceived as the same vowel as the standard, whereas the other 2 deviants were perceived as belonging to different vowel categories. The neuronal responses to these vowel stimuli were compared with responses elicited by perceptually matched tone stimuli under the same paradigm. For both speech and tones, deviant stimuli induced coupling changes within the same bilateral temporal lobe system. However, vowel oddball effects increased coupling within the left posterior superior temporal gyrus, whereas perceptually equivalent nonspeech oddball effects increased coupling within the right primary auditory cortex. Thus, we show a dissociation in neuronal interactions, occurring at both different hierarchal levels of the auditory system (superior temporal versus primary auditory cortex) and in different hemispheres (left versus right). This hierarchical specificity depends on whether auditory stimuli are embedded in a perceptual context (i.e., a word). Furthermore, our lateralization results suggest left hemisphere specificity for the processing of phonological stimuli, regardless of their elemental (i.e., spectrotemporal) characteristics.

Cross-sectional studies of the language system in early infancy suggest that the basic neural mechanisms are in place even before birth. This study represents the first of its kind, using a large longitudinal sample of infants, to delineate the early language-related transition toward interhemispheric functional asymmetry in the brain using resting-state functional MRI. More generally, our findings suggest that increasing interhemispheric functional symmetry in the first year might be a general principle of the developing brain governing multiple functional systems, including those that will eventually become lateralized in adulthood. Although resting-state functional MRI cannot provide direct insights into the developmental mechanisms of language lateralization, this study reveals language-related functional connectivity changes during infancy, marking critical points in the development of the brain's functional architecture.