Sound Localization and Sensitivity to Interaural Time Differences in Human Infants

Behavioral sensitivity to interaural time differences in the rabbit

Binaural sound source localization is an important technique for speech enhancement, video conferencing, and human-robot interaction, etc. However, in realistic scenarios, the reverberation and environmental noise would degrade the precision of sound direction estimation. Therefore, reliable sound localization is essential to practical applications. To deal with these disturbances, this paper presents a novel binaural sound source localization approach based on reverberation weighting and generalized parametric mapping. First, the reverberation weighting as a preprocessing stage, is used to separately suppress the early and late reverberation, while preserving interaural cues. Then, two binaural cues, i.e., interaural time and intensity differences, are extracted from the frequency-domain representations of dereverberated binaural signals for the online localization. Their corresponding templates are established using the training data. Furthermore, the generalized parametric mapping is proposed to build a generalized parametric model for describing relationships between azimuth and binaural cues analytically. Finally, a two-step sound localization process is introduced to refine azimuth estimation based on the generalized parametric model and template matching. Experiments in both simulated and real scenarios validate that the proposed method can achieve better localization performance compared to state-of-the-art methods.

1. The ability of ferrets to localize sounds in space was determined before and after large unilateral lesions of the inferior colliculus. Three animals sustained restricted lesions that destroyed the inferior colliculus caudally but spared some tissue rostrally. These restricted lesions did not extend substantially beyond the cytoarchitectonic boundaries of the inferior colliculus. Four animals received more extensive lesions that destroyed all of the inferior colliculus, including the rostral pole. These lesions also involved to various degrees other midbrain structures, including the dorsal nucleus of the lateral lemniscus and the lateral tegmentum. Psychophysical curves and minimum audible angles were obtained for midline and left and right lateral fields. Comparisons were made of deficits ipsilateral and contralateral to the lesion. 2. The animals were tested in a semicircular apparatus with loudspeakers located at various positions around the periphery. Separate sound localization tests were conducted for midline, left, and right field positions. In each test the animals were trained first to discriminate between speakers separated by 60 degrees. They were then tested with progressively smaller angles of speaker separation to obtain their psychophysical threshold (minimum audible angle). All critical tests of sound localization were based on the ability of animals to identify the location of a 45-ms noise burst presented at the beginning of each trial. Correct responses were rewarded by delivery of a small quantity of water from spouts located around the perimeter of the apparatus. 3. Unilateral lesions restricted to the inferior colliculus had relatively little effect on sound localization. All three animals with restricted lesions were still capable of localizing a single noise burst and minimum audible angles were similar before and after surgery for midline, left, and right field tests. There was no difference in postoperative performance ipsilateral and contralateral to the lesion site. 4. More extensive unilateral lesions that included the dorsal nucleus of the lateral lemniscus and the lateral tegmentum as well as the inferior colliculus resulted in severe deficits in sound localization. Each of the four animals with large unilateral lesions had a substantial impairment in sound localization in the field contralateral to the lesion site. Postoperative performance in the contralateral field was too low to obtain a minimum audible angle for these animals. Midline sound localization was also affected in some cases but ipsilateral sound localization was only slightly affected.

This review article reviews the contemporary studies of localization ability for different populations in different listening environments and provides possible future research directions. The ability to accurately localize a sound source relying on three cues (interaural time difference, interaural level difference, and spectral cues) is important for communication, learning, and safety. Confounding effects including noise and reverberation, which exist in common listening environments, mask or alter localization cues and negatively affect localization performance. Hearing loss, a common public health issue, also affects localization accuracy. Although hearing devices have been developed to provide excellent audibility of speech signals, less attention has been paid to preserving and replicating crucial localization cues. Unique challenges are faced by users of various hearing devices, including hearing aids, bone-anchored hearing instruments, and cochlear implants. Hearing aids have failed to consistently improve localization performance and, in some cases, significantly impair sound localization. Bone-conduction hearing instruments show little to no benefit for sound localization performance in most cases, although some improvement is seen in binaural users. Although cochlear implants provide great hearing benefit to individuals with severe-to-profound sensorineural hearing loss, cochlear implant users have significant difficulty localizing sound, even with two implants. However, technologies in each of these areas are advancing to reduce interference with desired sound signals and preserve localization cues to help users achieve better hearing and sound localization in real-life environments.

The localization of low-frequency sounds (less than 3 kHz) along the azimuth involves comparing the ongoing difference in the time of arrival of a sound at the two ears. Information about interaural time differences (ITDs) is derived from an initial comparison performed in the superior olivary complex. However, little is known about which aspects of this information are transformed as it ascends the brainstem. To address this issue, we compared the ITD sensitivity of neurons in the inferior colliculus (IC) and auditory thalamus, successive stations in the auditory pathway. We found ITD sensitivity in the IC and thalamus to be similar in several respects. At both levels, the large majority of neurons responded maximally to ITDs within the range that a rabbit would normally encounter (+/- 300 microseconds) and preferred ipsilateral delays, delays that would be created by sounds in the contralateral sound field. The range of frequencies over which ITD sensitivity was expressed was also similar in the midbrain and thalamus. Several differences were also apparent. In comparison to IC neurons, neurons in the thalamus responded over more restricted ranges of ITD, responded at lower rates, and, in response to monaural stimulation, showed an increased influence of inhibition. Finally, a greater proportion of thalamic units had characteristic delays corresponding to intermediate discharge rates. The preservation of a bias for ipsilateral delays from IC to thalamus suggests that a representation of contralateral azimuths is present at both levels. Similarities between the two levels suggest that information about ITDs is faithfully transmitted from midbrain to thalamus. Differences in ITD sensitivity, such as the sharper tuning for ITDs, suggest that the thalamus is not a simple relay. Enhanced sensitivity to ITDs should translate to better-defined azimuthal receptive fields, and therefore may be a step toward achieving an optimal representation of azimuth within the auditory pathway.

Finding the source of a sound by ear is called sound localization, and most animals, including nocturnal owls, that use sound signals for communication, prey capture, and predator evasion can localize sound. Sound localization and its brain mechanisms are better known in the barn owl than in any other animal. The barn owl can localize sound equally well in two dimensions, azimuth, or the horizontal plane, and elevation, or the vertical plane. Experiments show that the barn owl uses interaural time difference for determining sound azimuth and interaural intensity difference for elevation. When a sound signal reaches one ear before the other ear, an interaural time difference results. Sound travels 1 cm in 29 μsec. The maximum interaural time difference experienced by the barn owl is about 170 μsec when sound propagates along the aural axis; the minimum time difference is zero when sound emanates from a place equidistant to the two ears. Thus, interaural time disparity varies systematically as a function of sound azimuth. Interaural intensity difference is due to the head's shadow in the sound field. The ear in the shadow registers a weaker signal than the other ear.KeywordsInferior ColliculusCochlear NucleusSound LocalizationInteraural Time DifferenceNucleus MagnocellularisThese keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Optimizing sound localization with hearing AIDS.

Interaural time difference (ITD) detection plays a critical role in sound localization. Some neurophysiology experiments found that the ITD discrimination threshold for single neuron in medial superior olive (MSO) is about 20 μs. In order to reveal the ITD coding mechanism essentially, an ITD detection model has been proposed in this paper based on the anatomical structure of the mammalian auditory system. Most previous research only discuss the relationship between the ITDs and the spike rate of the MSO neuron. In these results, the spike rate difference is under 1 spike/s when the ITD changes in 20 μs. It means the neuron needs more than 1 s to distinguish the ITD by spike rate coding. This explanation contradicts with the rapid and accurate sound localization response in animal psychoacoustics experiments. In our study, the neural coding in ITD detection model has been investigated via the approach of circle maps and symbolic dynamics. With these two methods, the ITDs under 20 μs can be detected in 1 s. This neural coding hypothesis agrees with the ITD detection response time in the animal behavior experiments.

ObjectiveReview of recent studies on spatial-hearing abilities in children who use bilateral cochlear implants (BiCIs); compare performance of children who use BiCIs with children who have normal hearing.MethodsResults from recent studies are reviewed in two categories. First, studies measured spatial hearing by using sound localization or identification methods, thereby focusing on localization accuracy. Second, studies that measured the ability of children to discriminate between sound source positions in the horizontal plane, thereby focusing on localization acuity where performance was quantified using the minimum audible angle (MAA).ResultsChildren with BiCIs have localization errors that vary widely. There is evidence that for many children errors are smaller when using two vs. one implant. In the bilateral condition, some children's performance falls within the range of errors seen in children with normal hearing (less than 30° root mean square), but most children have errors that are significantly greater than those of children with normal hearing. On MAA tasks, performance is generally significantly better (lower MAAs) when children are tested in the bilateral listening mode than in the unilateral listening mode. However, MAAs are generally higher than those measured in children with normal hearing.DiscussionResults are discussed in the context of auditory experience, and also with regard to the lack of availability of binaural cues presented through the CI speech processors when the children are using their processors in everyday listening situations. The potential roles of interaural timing vs. level cues are discussed.

Bilateral implant recipients theoretically have access to binaural cues. Research in postlingually deafened adults with cochlear implants (CIs) indicates minimal evidence for true binaural hearing. Congenitally deafened children who experience spatial hearing with bilateral CIs, however, might perceive binaural cues in the CI signal differently. There is limited research examining binaural hearing in children with CIs, and the few published studies are limited by the use of unrealistic speech stimuli and background noise. The purposes of this study were to (1) replicate our previous study of binaural hearing in postlingually deafened adults with AzBio sentences in prelingually deafened children with the pediatric version of the AzBio sentences, and (2) replicate previous studies of binaural hearing in children with CIs using more open-set sentences and more realistic background noise (i.e., multitalker babble). The study was a within-participant, repeated-measures design. The study sample consisted of 14 children with bilateral CIs with at least 25 mo of listening experience. Speech recognition was assessed using sentences presented in multitalker babble at a fixed signal-to-noise ratio. Test conditions included speech at 0° with noise presented at 0° (S0N0), on the side of the first CI (90° or 270°) (S0N1stCI), and on the side of the second CI (S0N2ndCI) as well as speech presented at 0° with noise presented semidiffusely from eight speakers at 45° intervals. Estimates of summation, head shadow, squelch, and spatial release from masking were calculated. Results of test conditions commonly reported in the literature (S0N0, S0N1stCI, S0N2ndCI) are consistent with results from previous research in adults and children with bilateral CIs, showing minimal summation and squelch but typical head shadow and spatial release from masking. However, bilateral benefit over the better CI with speech at 0° was much larger with semidiffuse noise. Congenitally deafened children with CIs have similar availability of binaural hearing cues to postlingually deafened adults with CIs within the same experimental design. It is possible that the use of realistic listening environments, such as semidiffuse background noise as in Experiment II, would reveal greater binaural hearing benefit for bilateral CI recipients. Future research is needed to determine whether (1) availability of binaural cues for children correlates with interaural time and level differences, (2) different listening environments are more sensitive to binaural hearing benefits, and (3) differences exist between pediatric bilateral recipients receiving implants in the same or sequential surgeries.

Background and Aim: Many older adults experience difficulty in speech perception in noisy environments and fast speech. Speech perception is dependent on bottom-up and top-down auditory processing information. This study aimed to investigate the relationship between Interaural Time Difference (ITD) and speech processing speed in older adults with difficulty in speech perception in noise. Methods: In this study, 36 Iranian older adults with normal hearing (23 men and 13 women) aged 65–75 years who had complaints about the difficulty with speech perception in noise, participated. The ITD test with two stimuli (high-pass and low-pass noise) was used to asess the auditory localization ability. Time-Compressed Speech Test (TCST) and reaction time test were used to measure their speech processing speed. Pearson correlation test was performed to examine the relationship between ITD and speech processing speed. Results: The auditory localization errors were more significant for ITDs with low-pass noise than high-pass noise. The results showed a negative correlation between localization errors and the TCST score at time compression ratios of 40% (p=0.005) and 60% (p=0.002). The highest correlation was observed between ITD (low-pass noise) and the TCST score at the time compression ratio of 60% in the right ear (r=–0.66). The mean ITD errors were not significantly correlated to the reaction time test score (p>0.05). Conclusion: Word recognition in the elderly declines with increasing speech rate. The findings of this study can be used in clinical practice for consultation and rehabilitation of older adults with communication difficulties. Keywords: Sound localization; speed processing; speech perception; elderly

The acoustical cues for sound location are generated by spatial- and frequency-dependent filtering of propagating sound waves by the head and external ears. Although rats have been a common model system for anatomy, physiology, and psychophysics of localization, there have been few studies of the acoustical cues available to rats. Here, directional transfer functions (DTFs), the directional components of the head-related transfer functions, were measured in six adult rats. The cues to location were computed from the DTFs. In the frontal hemisphere, spectral notches were present for frequencies from approximately 16 to 30 kHz; in general, the frequency corresponding to the notch increased with increases in source elevation and in azimuth toward the ipsilateral ear. The maximum high-frequency envelope-based interaural time differences (ITDs) were 130 mus, whereas low-frequency (<3.5 kHz) fine-structure ITDs were 160 mus; both types of ITDs were larger than predicted from spherical head models. Interaural level differences (ILDs) strongly depended on location and frequency. Maximum ILDs were <10 dB for frequencies <8 kHz and were as large as 20-40 dB for frequencies >20 kHz. Removal of the pinna eliminated the spectral notches, reduced the acoustic gain and ILDs, altered the acoustical axis, and reduced the ITDs.

Sound localization is crucial for the survival and reproduction of animals, including non-auditory specialist animals such as the majority of avian species. The chicken (Gallus gallus) is a well-suited representative of a non-auditory specialist bird and several aspects of its auditory system have been well studied in the last decades. We conducted a behavioral experiment where 3 roosters performed a sound localization task with broad-band noise, using a 2-alternative forced choice paradigm. We determined the minimum audible angle (MAA) as measure for localization acuity. In general, our results compare to previous MAA measurements with hens in Go/NoGo tasks. The chicken has high localization acuity compared to other auditory generalist bird species tested so far. We found that chickens were better at localizing broadband noise with long duration (1 s; MAA = 16°) compared to brief duration (0.1 s; MAA = 26°). Moreover, the interaural difference in time of arrival and level (ITD and ILD, respectively) at these MAAs are comparable to what measured in other non-auditory specialist bird species, indicating that they might be sufficiently broad to be informative for azimuthal sound localization.

Barn owls perform sound localization based on analyses of interaural differences in arrival time and intensity of sound. Two kinds of neural signals representing the interaural time difference (ITD) and the interaural intensity difference (IID) are processed in parallel in anatomically separate pathway. We explain briefly the neural models of pathways of ITD and IID detection which we have already presented [1,2]. We present a neural network model of ICc ls in which the signals representing ITD and IID are first combined with each other. It is shown using our neural models how the neural map, in which ITD and IID are represented along the axes being perpendicular mutually, can be generated in ICc ls by the excitatory inputs from ICc core representing ITD and the inhibitory inputs from bilateral VLVps representing IID. We show that the firing rates of ICc ls neuron are well represented by a suppressive multiplication of ITD and IID inputs. This seems to be the origin of the multiplicative binding found in ICx by Pena and Konishi [3].

Multisensory interactions involve coordination and sometimes competition between multiple senses. Vision usually dominates audition in spatial judgments when light and sound stimuli are presented from two different physical locations. This study investigated the influence of vision on the perceived location of a phantom sound source placed in a stereo sound field using a pair of loudspeakers emitting identical signals that were delayed or attenuated relative to each other. Results show that although a similar horizontal range (+/-45°) was reported for timing-modulated and level-modulated signals, listeners' localization performance showed greater variability for the timing signals. When visual stimuli were presented simultaneously with the auditory stimuli, listeners showed stronger visual bias for timing-modulated signals than level-modulated and single-speaker control signals. Trial-to-trial errors remained relatively stable over time, suggesting that sound localization uncertainty has an immediate and long-lasting effect on the across-modal bias. Binaural signal analyses further reveal that interaural differences of time and intensity-the two primary cues for sound localization in the azimuthal plane-are inherently more ambiguous for signals placed using timing. These results suggest that binaural ambiguity is intrinsically linked with localization variability and the strength of cross-modal bias in sound localization.