Investigation of interaction between speech perception and production using auditory feedback

ABSTRACTNormal auditory feedback contributes to moment-to-moment control of speech production. Effects of auditory feedback’s absence on hearing-impaired individuals are widely documented, but auditory perturbation has not been investigated. Our objective was to evaluate the effect of delayed auditory feedback (DAF) and frequency altered feedback (FAF) on speech production among prelingual cochlear implant (CI) users and normal hearing (NH) individuals, to evaluate CI users’ reliance on auditory feedback. Twenty young adults (10 CI, 10 NH), without developmental and cognitive impairments, participated in the study. Under variable auditory feedback conditions, speech production (spontaneous or reading aloud) was measured using speech rate, percentage of interruptions, fundamental frequency (F0), and relative intensity. Results showed that (1) both DAF and FAF caused slower speech rates and more interruptions while reading aloud, with DAF having larger effect; (2) altered feedback produced no differences between groups, except an increase in F0 for CI users during DAF; and (3) CI users’ ability to understand speech via phone and without lip-reading was positively correlated with performance under DAF. These findings suggest that auditory perturbation similarly affects speech production among prelingual CI users and NH individuals, indicating CI users depend on auditory feedback to the same degree as normal hearing individuals.

Speech perception relies on auditory and visual cues and there are strong links between speech perception and production. We aimed to evaluate the role of auditory and visual modalities on speech perception and production in adults with impaired hearing or sight versus those with normal hearing and sight. We examined speech perception and production of three isolated vowels (/i/, /y/, /u/), which were selected based on their different auditory and visual perceptual saliencies, in 12 deaf adults who used one or two cochlear implants (CIs), 14 congenitally blind adults, and 16 adults with normal sight and hearing. The results showed that the deaf adults who used a CI had worse vowel identification and discrimination perception and they also produced vowels that were less typical or precise than other participants. They had different tongue positions in speech production, which possibly partly explains the poorer quality of their spoken vowels. Blind individuals had larger lip openings and smaller lip protrusions for the rounded vowel and unrounded vowels, compared to the other participants, but they still produced vowels that were similar to those produced by the adults with normal sight and hearing. In summary, the deaf adults, even though they used CIs, had greater difficulty in producing accurate vowel targets than the blind adults, whereas the blind adults were still able to produce accurate vowel targets, even though they used different articulatory strategies.

Effects of testosterone on speech production and perception: Linking hormone levels in males to vocal cues and female voice attractiveness ratings

Dissociating the functions of three left posterior superior temporal regions that contribute to speech perception and production

Across the animal kingdom, neural responses in the auditory cortex are suppressed during vocalization, and humans are no exception. A common hypothesis is that suppression increases sensitivity to auditory feedback, enabling the detection of vocalization errors. This hypothesis has been previously confirmed in non-human primates, however a direct link between auditory suppression and sensitivity in human speech monitoring remains elusive. To address this issue, we obtained intracranial electroencephalography (iEEG) recordings from 35 neurosurgical participants during speech production. We first characterized the detailed topography of auditory suppression, which varied across superior temporal gyrus (STG). Next, we performed a delayed auditory feedback (DAF) task to determine whether the suppressed sites were also sensitive to auditory feedback alterations. Indeed, overlapping sites showed enhanced responses to feedback, indicating sensitivity. Importantly, there was a strong correlation between the degree of auditory suppression and feedback sensitivity, suggesting suppression might be a key mechanism that underlies speech monitoring. Further, we found that when participants produced speech with simultaneous auditory feedback, posterior STG was selectively activated if participants were engaged in a DAF paradigm, suggesting that increased attentional load can modulate auditory feedback sensitivity.

Motor and visual influences on auditory neural processing during speaking and listening

Activity in anterior sensorimotor regions is found in speech production and some perception tasks. Yet, how sensorimotor integration supports these functions is unclear due to a lack of data examining the timing of activity from these regions. Beta (~20 Hz) and alpha (~10 Hz) spectral power within the EEG μ rhythm are considered indices of motor and somatosensory activity, respectively. In the current study, perception conditions required discrimination (same/different) of syllables pairs (/ba/ and /da/) in quiet and noisy conditions. Production conditions required covert and overt syllable productions and overt word production. Independent component analysis was performed on EEG data obtained during these conditions to (1) identify clusters of μ components common to all conditions and (2) examine real-time event-related spectral perturbations (ERSP) within alpha and beta bands. 17 and 15 out of 20 participants produced left and right μ-components, respectively, localized to precentral gyri. Discrimination conditions were characterized by significant (pFDR < 0.05) early alpha event-related synchronization (ERS) prior to and during stimulus presentation and later alpha event-related desynchronization (ERD) following stimulus offset. Beta ERD began early and gained strength across time. Differences were found between quiet and noisy discrimination conditions. Both overt syllable and word productions yielded similar alpha/beta ERD that began prior to production and was strongest during muscle activity. Findings during covert production were weaker than during overt production. One explanation for these findings is that μ-beta ERD indexes early predictive coding (e.g., internal modeling) and/or overt and covert attentional/motor processes. μ-alpha ERS may index inhibitory input to the premotor cortex from sensory regions prior to and during discrimination, while μ-alpha ERD may index sensory feedback during speech rehearsal and production.

Benefits of intensive speech treatment have been documented for a range of speech signs in English speakers with Parkinson's Disease (PD). However, the answer to a critical question that whether the same treatment benefits speech variables including intelligibility in Mandarin speakers is still unclear. In order to develop a targeted speech treatment for Mandarin speakers with PD, we reviewed the efficacy of intensive speech treatment to improve vocal loudness and functional communication and discuss possible explanations for efficacy on Mandarin speakers with PD. Literatures about intensive speech treatment for Mandarin speakers with PD were retrieved from PubMed, Web of Science, Embase, China National Knowledge Infrastructure (CNKI), Wanfang and Weipu Database for Chinese Technical Periodicals (VIP) Database. Search strategy was (voice therapy OR speech therapy OR voice treatment OR speech treatment OR voice training OR speech training OR voice rehabilitation OR speech rehabilitation OR Lee Silverman voice treatment OR intensive speech treatment) and (Parkinson's disease) and (Mandarin speakers OR Chinese OR Chinese people). Five randomized controlled trials were selected and possible explanations for efficacy on individuals with PD are discussed. Further research directions are suggested. The existing evidence from treatment efficacy studies of intensive speech treatment provides support for improving vocal loudness, speech intelligibility, pitch and rate in Mandarin speakers with PD. Our future research will continue to work to conduct a large sample multicenter randomized controlled trial to provide high quality evidence and understand the basic mechanisms accompanying treatment-related change.

Speech production difficulties are apparent in people who stutter (PWS). PWS also have difficulties in speech perception compared to controls. It is unclear whether the speech perception difficulties in PWS are independent of, or related to, their speech production difficulties. To investigate this issue, functional MRI data were collected on 13 PWS and 13 controls whilst the participants performed a speech production task and a speech perception task. PWS performed poorer than controls in the perception task and the poorer performance was associated with a functional activity difference in the left anterior insula (part of the speech motor area) compared to controls. PWS also showed a functional activity difference in this and the surrounding area [left inferior frontal cortex (IFC)/anterior insula] in the production task compared to controls. Conjunction analysis showed that the functional activity differences between PWS and controls in the left IFC/anterior insula coincided across the perception and production tasks. Furthermore, Granger Causality Analysis on the resting-state fMRI data of the participants showed that the causal connection from the left IFC/anterior insula to an area in the left primary auditory cortex (Heschl’s gyrus) differed significantly between PWS and controls. The strength of this connection correlated significantly with performance in the perception task. These results suggest that speech perception difficulties in PWS are associated with anomalous functional activity in the speech motor area, and the altered functional connectivity from this area to the auditory area plays a role in the speech perception difficulties of PWS.

Models of both speech perception and speech production typically postulate a processing level that involves some form of phonological processing. There is disagreement, however, on the question of whether there are separate phonological systems for speech input versus speech output. We review a range of neuroscientific data that indicate that input and output phonological systems partially overlap. An important anatomical site of overlap appears to be the left posterior superior temporal gyrus. We then present the results of a new event‐related functional magnetic resonance imaging (fMRI) experiment in which participants were asked to listen to and then (covertly) produce speech. In each participant, we found two regions in the left posterior superior temporal gyrus that responded both to the perception and production components of the task, suggesting that there is overlap in the neural systems that participate in phonological aspects of speech perception and speech production. The implications for neural models of verbal working memory are also discussed in connection with our findings.

In order to investigate the relation between reading accuracy and speech processing, 20 children from grades 2 and 3 who were skilled in reading were compared with 20 less skilled readers on a speech perception and production task. The two groups of readers were indistinguishable in their production of the two-syllable words dippy, deepy, tippy, and teepy and in their perception of the stop consonants /d/ versus /t/. Less skilled readers were significantly less accurate than the skilled readers in a vowel identification task involving the lax and tense high vowels /i/ and /i/. The error pattern for vowel identification was similar across groups, with both groups making fewer errors when short and longer segments were alternated. The results imply that vowel phonemes are less securely represented in the perceptual system of less skilled readers than are consonant phonemes. In addition, the results raise the possibility that a selective perceptual impairment underlies at least some of the phonemic awareness problems that have been associated with poor reading.

Integration of articulatory and spectrum features based on the hybrid HMM/BN modeling framework

Auditory speech perception enables listeners to access phonological categories from speech sounds. During speech production and speech motor learning, speakers' experience matched auditory and somatosensory input. Accordingly, access to phonetic units might also be provided by somatosensory information. The present study assessed whether humans can identify vowels using somatosensory feedback, without auditory feedback. A tongue-positioning task was used in which participants were required to achieve different tongue postures within the /e, ε, a/ articulatory range, in a procedure that was totally nonspeech like, involving distorted visual feedback of tongue shape. Tongue postures were measured using electromagnetic articulography. At the end of each tongue-positioning trial, subjects were required to whisper the corresponding vocal tract configuration with masked auditory feedback and to identify the vowel associated with the reached tongue posture. Masked auditory feedback ensured that vowel categorization was based on somatosensory feedback rather than auditory feedback. A separate group of subjects was required to auditorily classify the whispered sounds. In addition, we modeled the link between vowel categories and tongue postures in normal speech production with a Bayesian classifier based on the tongue postures recorded from the same speakers for several repetitions of the /e, ε, a/ vowels during a separate speech production task. Overall, our results indicate that vowel categorization is possible with somatosensory feedback alone, with an accuracy that is similar to the accuracy of the auditory perception of whispered sounds, and in congruence with normal speech articulation, as accounted for by the Bayesian classifier.

Acoustic and perceptual appraisal of speech production in pediatric cochlear implant users

This retrospective study aimed to evaluate the outcomes of bilateral cochlear implantation in patients with severe-to-profound sensorineural hearing loss at the Timisoara Municipal Emergency Clinical Hospital ENT Clinic. The study involved 77 participants, divided into four groups based on their hearing loss characteristics and implantation history. Assessments were conducted pre- and post-implantation, focusing on speech perception, speech production, and reading achievement. Standard surgical procedures were performed, and participants were provided with a comprehensive rehabilitation program involving auditory training and communication therapy. The variables considered for analysis included demographic factors, implantation period, and quality of life assessment, with no statistically significant differences pre-implantation between the four study groups. Results revealed significant improvements in speech perception, speech production, and reading achievement after cochlear implantation. In adult patients, speech perception scores increased from 21.3% to 73.4% for WIPI and from 22.7% to 68.4% for HINT after 12 months of rehabilitation. Speech production scores improved from 33.5% to 76.8% and reading achievement scores increased from 76.2 to 106.3. Moreover, there was a significant improvement in patients’ quality of life following cochlear implantation, with mean scores increasing from 2.0 to 4.2. Although it is known that bilateral cochlear implantation significantly improves speech perception, speech production, reading achievement, and quality of life in patients with severe-to-profound sensorineural hearing loss, this is the first study of its kind from Romania. Further research is warranted to optimize patient selection and rehabilitation strategies to maximize outcomes and determine better policies towards funding and access of cochlear implants for a wider range of patients in need.