Adaptive Bit-Plane Scanning for Scalable Audio

A perceptually enhanced prioritized bit-plane audio coding algorithm is presented in this paper. According to the energy distribution in different frequency regions, the bit-planes are prioritized with optimized parameters. Based on the statistical modeling of the frequency spectrum, a much more simplified implementation of prioritized bit-plane coding is integrated with the recent release of MPEG-4 scalable lossless (SLS) audio coding structure by replacing the sequential bit-plane coding in the enhancement layer. With zero extra side information, trivial added complexity, and modification to the original SLS structure, extensive experimental results show that the perceptual quality of SLS with noncore and very low core bit-rate is improved significantly in a wide range of bit-rate combinations. Fully scalable audio coding up to lossless with much enhanced perceptual quality is thus achieved.

Most existing audio steganographic methods embed secret messages according to a pseudorandom number generator, thus some auditory sensitive parts in cover audio, such as mute or near-mute segments, will be contaminated, which would lead to poor perceptual quality and may introduce some detectable artifacts for steganalysis. In this paper, we propose a novel adaptive audio steganography in the time domain based on the advanced audio coding (AAC) and the Syndrome-Trellis coding (STC). The proposed method firstly compresses a given wave signal into AAC compressed file with a high bitrate, and then obtains a residual signal by comparing the signal before and after AAC compression. According to the quantity and sign of the residual signal, \(\pm 1\) embedding costs are assigned to the audio samples. Finally, the STC is used to create the stego audio. The extensive results evaluated on 10,000 music and 10,000 speech audio clips have shown that our method can significantly outperform the conventional \(\pm 1\) LSB based steganography in terms of security and audio quality.

In this paper, we describe the implementation of the multi-channel AAC encoder system for digital audio broadcasting. The encoder system is based on MPEG-2/4 advanced audio coding (AAC) and is capable of real-time encoding up to 5.1 channel audio. To give a flexible functionality, it consists of multiple DSPs, IEC61937 and TCP/IP interface and 6 channel audio input facilities. The reference AAC decoder was implemented for verification test of the encoder. The encoder system is also integrated with the AAC streaming system for interoperation test. Through these tests, the encoder system is verified to be a good solution for high quality audio broadcasting.

Enhanced aacPlus is an audio codec which is composed of advanced audio coding (AAC), spectral band replication (SBR), and parametric stereo (PS) for efficient audio coding at low bit rates. We propose a new coding scheme for lossless bit rate reduction of PS in enhanced aacPlus. We first determine the optimal contexts for context-based coding of quantized stereo parameter indexes in PS. Then we propose a coding scheme which is based on context-based coding using the determined optimal contexts in conjunction with arithmetic coding. The proposed scheme has normal and memory-reduced versions, both of which are shown to guarantee significant and consistent lossless bit rate reduction of PS. The saved bits by the proposed scheme can be used for the other modules of enhanced aacPlus, AAC and SBR.

AC-3 audio coding technology is a kind of perceptual audio coder (PAC) developed by the Dolby Company. Up to 5 full-bandwidth channels and one subwoofer channel (cutoff at 120 Hz) are available in AC-3 to provide multi-channel, low bit rate, and high perceptual quality of audio. This explains why AC-3 has become the audio standard of many international standards. In this paper, we focus on the real-time software implementation issues of AC-3. Two fast algorithms of the time-frequency transform, one for memory economization and the other is for time domain subsampling, are presented. Meanwhile, we state the current performance status of our AC-3 decoder.

During the last decade, CD-quality digital audio has essentially replaced analog audio. Emerging digital audio applications for network, wireless, and multimedia computing systems face a series of constraints such as reduced channel bandwidth, limited storage capacity, and low cost. These new applications have created a demand for high-quality digital audio delivery at low bit rates. In response to this need, considerable research has been devoted to the development of algorithms for perceptually transparent coding of high-fidelity (CD-quality) digital audio. As a result, many algorithms have been proposed, and several have now become international and/or commercial product standards. This paper reviews algorithms for perceptually transparent coding of CD-quality digital audio, including both research and standardization activities. This paper is organized as follows. First, psychoacoustic principles are described, with the MPEG psychoacoustic signal analysis model 1 discussed in some detail. Next, filter bank design issues and algorithms are addressed, with a particular emphasis placed on the modified discrete cosine transform, a perfect reconstruction cosine-modulated filter bank that has become of central importance in perceptual audio coding. Then, we review methodologies that achieve perceptually transparent coding of FM- and CD-quality audio signals, including algorithms that manipulate transform components, subband signal decompositions, sinusoidal signal components, and linear prediction parameters, as well as hybrid algorithms that make use of more than one signal model. These discussions concentrate on architectures and applications of those techniques that utilize psychoacoustic models to exploit efficiently masking characteristics of the human receiver. Several algorithms that have become international and/or commercial standards receive in-depth treatment, including the ISO/IEC MPEG family (-1, -2, -4), the Lucent Technologies PAC/EPAC/MPAC, the Dolby AC-2/AC-3, and the Sony ATRAC/SDDS algorithms. Then, we describe subjective evaluation methodologies in some detail, including the ITU-R BS.1116 recommendation on subjective measurements of small impairments. This paper concludes with a discussion of future research directions.

In this paper, we develop a 3D audio reproduction scheme for the purpose of delivering audio over IP networks. In this scheme, audio streams constructed at a server are composed of the TCP/IP header followed by multi-channel audio data compressed by MPEG advanced audio coding (AAC), and the decoded audio signals are played out on a stereo loudspeaker system at the client. Since the audio source is recorded by a multi-channel microphone but the playout is dedicated to stereo speakers, the quality mismatch between the multi-channel and the stereo system should be overcome. As a potential solution, we first investigate the effect of 3D audio processing on the audio quality at the client by applying a head-related transfer function (HRTF). Next, a crosstalk cancellation process is applied to the audio with 3D effects in order to improve the immersion of the processed 3D effects on a stereo loudspeaker system. Finally, we evaluate the performance of the 3D audio reproduction system in terms of the identification of an audio source and quality comparison before and after applying the crosstalk cancellation technique.

In this contribution the influence of different broadband OFDM schemes on the perceptual audio quality of narrowband wireless microphone links is evaluated, since coexistence scenarios of wireless microphones and Orthogonal frequency-division multiplexing (OFDM) based services arise in the TV bands. Therefore, we present different non-contiguous cyclic-prefix (CP-)OFDM and offset quadrature amplitude modulation (OQAM-)OFDM system designs based on the spectrum pooling concept. We measure their power suppression in the subchannel allocated for the wireless microphone. As an indicator of the perceptual audio quality, we measure the objective difference grade of a colored noise audio signal emitted over a consumer-like hardware. The measurements show that the non-contiguous OQAM-OFDM scheme not only introduces lower interference to the FM link, but also has the advantage of requiring less number of notched carriers in comparison to CP-OFDM. By application of non-contiguous OQAM-OFDM with an appropriate number of notched carriers instead of the classical CP-OFDM scheme, wireless microphone systems can still sustain a significant low SIR when non-professional hardware is applied.

Given the popularity of audio and video applications, compressed audio has become an important carrier of covert communication on the Internet. Many novel compressed audio steganography schemes have emerged that offer good hiding capability and aural concealment. In this paper, a universal steganalysis scheme called MultiSpecNet is proposed to detect steganography based on multiple embedding domains (advanced audio coding (AAC) and MPEG-1 Audio Layer III (MP3)), which are currently the two most popular compressed audio standards. The basic idea is that modification of either domain by a steganography scheme will change the time-frequency relationship of the audio signal after decoding. The proposed approach adopts the spectrogram as the input feature to extract richer information. DeepResNet is used to learn the distinguishing feature representations, and multiscale spectrograms are used to enrich the feature diversity. The experimental results show that the proposed scheme is effective at detecting different steganography schemes based on the AAC and MP3 embedding domains. The detection accuracy of the proposed scheme is higher than that achieved by other state-of-the-art schemes. Using spectrograms as the input, DeepResNet achieves better performance than schemes using quantized modified discrete cosine transform (MDCT) coefficients and mel-spectrogram, although the quantized MDCT coefficient is the parameter modified by the steganography schemes directly and mel-spectrogram is very popular and effective for general audio signal analysis. To the best of our knowledge, this work is the first audio steganalysis scheme that can detect multiple steganography schemes in both the MP3 and AAC embedding domains. The method proposed in this paper can be extended to audio steganalysis for other codecs or for audio forensics purposes.

We propose a frame loss concealment technique for decoders compatible with MPEG advanced audio coding (AAC). The spectral information of the lost frame is estimated in the modified discrete cosine transform (MDCT) domain via efficient techniques that are tailored to individual source signal components: in noise-like spectral bins the MDCT coefficients are obtained by shaped-noise insertion, while coefficients in tone-dominant bins are estimated by frame interpolation followed by a refinement procedure so as to optimize the fit of the concealed frames with neighboring frames. Experimental results demonstrate that the proposed technique offers performance superior to techniques adopted in commercial AAC decoders.

Scalable-to-Lossless (SLS) audio compression, as standardized by MPEG, provides a lossy base layer compatible with the Advanced Audio Coding (AAC) format, ensuring state-of-the-art quality in the base layer, and additional fine grained enhancements that eventually provide a lossless compressed version of the signal. While SLS offers highly efficient lossless compression, the perceptual quality of its intermediate lossy layers has been observed to be suboptimal. This paper proposes a modified SLS audio coding scheme that provides enhanced perceptual quality at an intermediate bit-rate, at the expense of an additional parameter per frequency band as side-information. This scheme when coupled with a trellis-based optimization algorithm is demonstrated to outperform, in terms of quality at the intermediate bit-rate, both standard SLS and a recent perceptually enhanced variant, with minimal degradation in lossless coding performance.

This paper proposes audio coding using an efficient long-term prediction method to enhance the perceptual quality of audio codecs to speech input signals at low bit-rates. The MPEG-4 AAC-LTP exploited a similar concept, but its improvement was not significant because of small prediction gain due to long prediction lags and aliased components caused by the transformation with a time-domain aliasing cancelation (TDAC) technique. The proposed algorithm increases the prediction gain by employing a deharmonizing predictor and a long-term compensation filter. The look-back memory elements are first constructed by applying the de-harmonizing predictor to the input signal, then the prediction residual is encoded and decoded by transform audio coding. Finally, the long-term compensation filter is applied to the updated look-back memory of the decoded prediction residual to obtain synthesized signals. Experimental results show that the proposed algorithm has much lower spectral distortion and higher perceptual quality than conventional approaches especially for harmonic signals, such as voiced speech.

The past two decades have witnessed a rapid expansion within the telecommunications industry. This growth has been primarily motivated by the proliferation of digital communication systems and services which have become easily available through wired and wireless systems. Current research trends involve the integration of speech, audio, video and data channels into true multimedia communications over fixed and mobile networks. However, while the available bandwidth in wired terrestrial networks is relatively cheap and expandable, it becomes a limited resource in satellite and cellular-radio systems. In order to accommodate an ever growing number of users while maintaining high quality and low operational costs, it is necessary to maximise spectral efficiency. This has given rise to the development of high rate compression techniques with the ability to adapt to a broad class of input signals and to varying network resources. The research carried out in this thesis has mainly focused on the design of a single algorithm for compressing speech and audio signals sampled at different rates. The algorithms are based on the analysis-by-synthesis linear prediction coding (AbS-LPC) scheme, which has been widely employed in various speech coding standards. However, this bit rate reduction technique is based on the speech production mechanism and as such provides a rigid structure which presents a major limitation for audio coding. In order to improve the audio quality at low rates and to compensate for the errors incurred by the linear prediction during segments of high transitions, the algorithms employ an efficient pulse excitation structure which represents the short innovation sequences with sparse unit magnitude pulses. The scheme proposed for the compression of telephone bandwidth speech and audio signals at 12kb/s achieves similar quality to the G.728 coder at 16kb/s and higher audio quality than the GSM-EFR standard at 12.2kb/s. Wideband speech and audio coding schemes have been designed using both the fullband approach at bit rates of 17 and 19kb/s and also the split band technique at a bit rate of 20kb/s. The perceptual quality is comparable to the G.722 coder operating at 48kb/s. The subband decomposition technique is also adapted to code speech and audio signals sampled at 32kHz. The quality of the coder at 28kb/s is similar to the quality achieved by the MP3 coder at 32kb/s. The algorithm also provides bandwidth and bit rate scalability ranging from 12 to 64kb/s, making it ideal for deployment in rate-adaptive communication systems.

In this paper, we introduce the compressed HDTV over IPv6 system, applications, and its experiment in IPv6 network between Korea and China. We developed the compressed HDTV over IPv6 system which requires 20-25Mbps with MPEG2. The system use 720/30p or 1080i HDTV format and support IPv4/IPv6 and unicast/multicast. The compressed HDTV system provides high quality audio and video with relatively small bandwidth comparing with uncompressed HDTV system, but it suffers about 1 second delay for MPEG2 encoding and decoding. Its high quality video and audio enables applications such as remote lecture/seminar with limited interaction. Using compressed HDTV system, we had two-way experiment which requires 40-50Mbps bandwidth in Gigabit IPv6 network in dual stack mode. This paper contains brief experiment result including jitter and packet loss. We expect practical application of compressed HDTV system such as remote lecture and seminar between Korea and China.

In this paper, electroencephalography (EEG) measurements are used to infer change in cortical functional connectivity in response to change in audio stimulus. Experiments are conducted wherein the EEG activity of human subjects is recorded as they listen to audio sequences whose quality varies with time. A causal information theoretic framework is then proposed to measure the information flow between EEG sensors appropriately grouped into different regions of interest (ROI) over the cortex. A new causal bidirectional information (CBI) measure is defined as an improvement over standard directed information measures for the purposes of identifying connectivity between ROIs in a generalized cortical network setting. CBI can be intuitively interpreted as a causal bidirectional modification of directed information, and inherently calculates the divergence of the observed data from a multiple access channel with feedback. Further, we determine the analytical relationship between the different causal measures and compare how well they are able to distinguish between the perceived audio quality. The connectivity results inferred indicate a significant change in the rate of information flow between ROIs as the subjects listen to different audio qualities, with CBI being the best in discriminating between the perceived audio quality, compared to using standard directed information measures.