Motor and visual influences on auditory neural processing during speaking and listening

Speech production difficulties are apparent in people who stutter (PWS). PWS also have difficulties in speech perception compared to controls. It is unclear whether the speech perception difficulties in PWS are independent of, or related to, their speech production difficulties. To investigate this issue, functional MRI data were collected on 13 PWS and 13 controls whilst the participants performed a speech production task and a speech perception task. PWS performed poorer than controls in the perception task and the poorer performance was associated with a functional activity difference in the left anterior insula (part of the speech motor area) compared to controls. PWS also showed a functional activity difference in this and the surrounding area [left inferior frontal cortex (IFC)/anterior insula] in the production task compared to controls. Conjunction analysis showed that the functional activity differences between PWS and controls in the left IFC/anterior insula coincided across the perception and production tasks. Furthermore, Granger Causality Analysis on the resting-state fMRI data of the participants showed that the causal connection from the left IFC/anterior insula to an area in the left primary auditory cortex (Heschl’s gyrus) differed significantly between PWS and controls. The strength of this connection correlated significantly with performance in the perception task. These results suggest that speech perception difficulties in PWS are associated with anomalous functional activity in the speech motor area, and the altered functional connectivity from this area to the auditory area plays a role in the speech perception difficulties of PWS.

Based on studies of syntactic and semantic learning, it has been proposed that certain aspects of second language learning may be more adversely affected by delays in language learning than others. Here, this proposal is extended to the phonological domain in which the acquisition of English word stress patterns by early (AOA <6 years) and late (AOA >14 years) Spanish–English bilinguals is investigated. The knowledge of English word stress was investigated by three behavioral tasks. In a production task, participants produced two syllable nonwords in both noun and verb sentence frames. In a perception task, participants indicated a preference for first or last syllable stress on the nonwords. Real words that were phonologically similar to the test items were also collected from each participant. Regression analyses and ANOVAs were conducted to determine the effect of syllable structure, lexical class, and stress pattern of phonologically similar words on the data from the production and perception tasks. Early bilinguals patterned similarly to the native English participants. Late bilinguals showed little evidence of learning prosodically based stress patterns but did show evidence of application of distributional patterns based on lexical class and analogy in stress assignment. [Research supported by NIH.]

Across the animal kingdom, neural responses in the auditory cortex are suppressed during vocalization, and humans are no exception. A common hypothesis is that suppression increases sensitivity to auditory feedback, enabling the detection of vocalization errors. This hypothesis has been previously confirmed in non-human primates, however a direct link between auditory suppression and sensitivity in human speech monitoring remains elusive. To address this issue, we obtained intracranial electroencephalography (iEEG) recordings from 35 neurosurgical participants during speech production. We first characterized the detailed topography of auditory suppression, which varied across superior temporal gyrus (STG). Next, we performed a delayed auditory feedback (DAF) task to determine whether the suppressed sites were also sensitive to auditory feedback alterations. Indeed, overlapping sites showed enhanced responses to feedback, indicating sensitivity. Importantly, there was a strong correlation between the degree of auditory suppression and feedback sensitivity, suggesting suppression might be a key mechanism that underlies speech monitoring. Further, we found that when participants produced speech with simultaneous auditory feedback, posterior STG was selectively activated if participants were engaged in a DAF paradigm, suggesting that increased attentional load can modulate auditory feedback sensitivity.

Effective human speech requires the neural integration of ongoing vocal production with the auditory and somatosensory feedback signals that are produced. We are using invasive electrophysiology techniques in patient volunteers undergoing neurosurgical treatment in order to gain insights into these mechanisms and underlying neural circuits. By using multi-contact electrode arrays chronically implanted over the perisylvian temporal lobe auditory cortex (e.g. area PLST) and the inferior frontal gyrus (IFG), we can examine local field potentials and frequency-specific responses from cortical areas important for both vocal production and speech sound processing. Our initial studies have found that during self-vocalization, focal areas within higher order auditory cortex on the superior temporal gyrus (STG) show response modulation compared to the responses of the same areas during passive listening. Manipulation of the auditory feedback that a speaker receives during vocalization (e.g. pitch-shifted or delayed auditory feedback) leads to further modulation of these PLST sites. Measures of functional connectivity including electrical stimulation tract tracing or phase-synchrony analysis demonstrate that portions of PLST are functionally connected to regions of the IFG. These findings support forward models for vocal control in which efference copies of premotor cortex activity modulate sub-regions of auditory cortex.

Functional near-infrared spectroscopy (fNIRS), a non-invasive optical neuroimaging technique, has demonstrated its great potential in monitoring cerebral activity as an alternative to functional magnetic resonance imaging (fMRI) in research and clinical usage. fNIRS has seen increasing applications in studying the auditory cortex in healthy subjects and cochlear implant users. However, fNIRS is susceptible to motion artifacts, especially those related to jaw movement, which can affect fNIRS signals in speech and auditory tasks. This study aimed to investigate the motion artifacts related to jaw movements including clenching, speaking, swallowing, and sniffing in a group of human subjects, and test whether our previously established denoising algorithm namely PCA-GLM can reduce the motion artifacts. Our results have shown that the jaw movements introduced artifacts that resemble task-evoked activations and that the PCA-GLM method effectively reduced the motion artifacts due to the clenching movements. The preliminary results of the present study underline the importance of the removal of the jaw-movement-related artifacts in fNIRS signals and suggest the efficacy of our PCA-GLM method in reducing the motion artifacts. Clinical Relevance- This work studies the motion artifacts due to jaw movements that frequently occur in speech perception and production tasks and validates the efficacy of an established denoising algorithm which benefits fNIRS studies on auditory and language functions.

Effects of auditory and visual feedback on remote pilot manual flying performance

Effector-independent brain network for auditory-motor integration: fMRI evidence from singing and cello playing

The neural responses to sensory consequences of a self-produced motor act are suppressed compared with those in response to a similar but externally generated stimulus. Previous studies in the somatosensory and auditory systems have shown that the motor-induced suppression of the sensory mechanisms is sensitive to delays between the motor act and the onset of the stimulus. The present study investigated time-dependent neural processing of auditory feedback in response to self-produced vocalizations. ERPs were recorded in response to normal and pitch-shifted voice auditory feedback during active vocalization and passive listening to the playback of the same vocalizations. The pitch-shifted stimulus was delivered to the subjects' auditory feedback after a randomly chosen time delay between the vocal onset and the stimulus presentation. Results showed that the neural responses to delayed feedback perturbations were significantly larger than those in response to the pitch-shifted stimulus occurring at vocal onset. Active vocalization was shown to enhance neural responsiveness to feedback alterations only for nonzero delays compared with passive listening to the playback. These findings indicated that the neural mechanisms of auditory feedback processing are sensitive to timing between the vocal motor commands and the incoming auditory feedback. Time-dependent neural processing of auditory feedback may be an important feature of the audio-vocal integration system that helps to improve the feedback-based monitoring and control of voice structure through vocal error detection and correction.

ABSTRACTThe rehabilitation of speech disorders benefits from providing visual information which may improve speech motor plans in patients. We tested the proof of concept of a rehabilitation method (Sensori-Motor Fusion, SMF; Ultraspeech player) in one post-stroke patient presenting chronic non-fluent aphasia. SMF allows visualisation by the patient of target tongue and lips movements using high-speed ultrasound and video imaging. This can improve the patient’s awareness of his/her own lingual and labial movements, which can, in turn, improve the representation of articulatory movements and increase the ability to coordinate and combine articulatory gestures. The auditory and oro-sensory feedback received by the patient as a result of his/her own pronunciation can be integrated with the target articulatory movements they watch. Thus, this method is founded on sensorimotor integration during speech. The SMF effect on this patient was assessed through qualitative comparison of language scores and quantitative analysis of acoustic parameters measured in a speech production task, before and after rehabilitation. We also investigated cerebral patterns of language reorganisation for rhyme detection and syllable repetition, to evaluate the influence of SMF on phonological-phonetic processes. Our results showed that SMF had a beneficial effect on this patient who qualitatively improved in naming, reading, word repetition and rhyme judgment tasks. Quantitative measurements of acoustic parameters indicate that the patient’s production of vowels and syllables also improved. Compared with pre-SMF, the fMRI data in the post-SMF session revealed the activation of cerebral regions related to articulatory, auditory and somatosensory processes, which were expected to be recruited by SMF. We discuss neurocognitive and linguistic mechanisms which may explain speech improvement after SMF, as well as the advantages of using this speech rehabilitation method.

Neural correlates of impaired vocal feedback control in post-stroke aphasia

Neurobiology of speaking and stuttering

As eye movements are mostly automatic and overtly generated to attain visual goals, individuals have a poor metacognitive knowledge of their own eye movements. We present an exploratory study on the effects of real-time continuous auditory feedback generated by eye movements. We considered both a tracking task and a production task where smooth pursuit eye movements (SPEM) can be endogenously generated. In particular, we used a visual paradigm which enables to generate and control SPEM in the absence of a moving visual target. We investigated whether real-time auditory feedback of eye movement dynamics might improve learning in both tasks, through a training protocol over 8 days. The results indicate that real-time sonification of eye movements can actually modify the oculomotor behavior, and reinforce intrinsic oculomotor perception. Nevertheless, large inter-individual differences were observed preventing us from reaching a strong conclusion on sensorimotor learning improvements.

A description is given of an experiment in which an attempt was made to show that audio-visual feedback is more effective in intonation learning than auditory feedback. The factors in the experiment were feedback mode and practice time. The results showed a significant effect of audio-visual feedback over auditory feedback, whereas practice time did not seem to be a major factor. Feedback modality was shown to influence learning behavior. -

To verify the effect of delayed auditory feedback on speech fluency of individuals who stutter with and without central auditory processing disorders. The participants were twenty individuals with stuttering from 7 to 17 years old and were divided into two groups: Stuttering Group with Auditory Processing Disorders (SGAPD): 10 individuals with central auditory processing disorders, and Stuttering Group (SG): 10 individuals without central auditory processing disorders. Procedures were: fluency assessment with non-altered auditory feedback (NAF) and delayed auditory feedback (DAF), assessment of the stuttering severity and central auditory processing (CAP). Phono Tools software was used to cause a delay of 100 milliseconds in the auditory feedback. The "Wilcoxon Signal Post" test was used in the intragroup analysis and "Mann-Whitney" test in the intergroup analysis. The DAF caused a statistically significant reduction in SG: in the frequency score of stuttering-like disfluencies in the analysis of the Stuttering Severity Instrument, in the amount of blocks and repetitions of monosyllabic words, and in the frequency of stuttering-like disfluencies of duration. Delayed auditory feedback did not cause statistically significant effects on SGAPD fluency, individuals with stuttering with auditory processing disorders. The effect of delayed auditory feedback in speech fluency of individuals who stutter was different in individuals of both groups, because there was an improvement in fluency only in individuals without auditory processing disorder.

The present work clarifies the neural underpinning of inattentional deafness under high visual load. The findings of near-simultaneous load effects on both visual and auditory evoked responses suggest shared audiovisual processing capacity. Temporary depletion of shared capacity in perceptually demanding visual tasks leads to a momentary reduction in sensory processing of auditory stimuli, resulting in inattentional deafness. The dynamic "push-pull" pattern of load effects on visual and auditory processing furthers our understanding of both the neural mechanisms of attention and of cross-modal effects across visual and auditory processing. These results also offer an explanation for many previous failures to find cross-modal effects in experiments where the visual load effects may not have coincided directly with auditory sensory processing.