Perceived visual motion descriptors from MPEG-2 for content-based HDTV annotation and retrieval

Our research concentrates on developing a novel HDTV content management system that enables end users to search, retrieve and browse archived standard definition (SD) and high definition (HD) television material for program production and content repurposing in a digital television studio. We have developed the first system that automatically analyzes motion occurring in MPEG-2 coded SD and HD videos within the compressed domain itself and produces descriptors characterizing the global visual motion in videos, for content-based search and retrieval applications. We describe our robust and efficient scheme for automatically generating a flow characterization of a video bitstream without decompression, which is a frame-type-independent uniform motion representation amenable for consistent interpretation and computed from the raw motion vectors encoded in the MPEG-2 bitstreams. We propose novel techniques to handle all the different prediction schemes that are employed with different frame types and picture structures of MPEG-2 during the motion compensation process to deal with interlaced and progressive modes. Experiments with thousands of frames from SD and HD video streams demonstrate the accuracy of our flow estimation process and the effectiveness of utilizing flow vectors for annotation of perceived global motion in video streams.

Content-based retrieval in video databases has become an important task with the availability of large quantities of data in both public and proprietary archives. Most of video systems are based on feature classification, but problems appear because of “semantic gap” between high-level human concepts and the machine-readable low-level visual features. In this paper we adopt a relevance feedback approach (RF) to bridge the semantic gap by progressively collecting feedback from the user, which allows the machine to discover the semantic meanings of objects or events. Experimental tests conducted on more than 91 hours of video footage show an improvement of up to 90% in retrieval accuracy, compared to classic classification-based retrieval.

Video caption detection and extraction is an important step for information retrieval in video databases. In this paper, we extract text information in video by fully utilizing the temporal information contained in the video. First we create a binary abstract sequence from a video segment. By analyzing the statistical pixel changes in the sequence, we can effectively locate the (dis)appealing frames of captions. Finally we extract the captions to create a summary of the video segment.

Terrestrial broadcast television in the United States has remained essentially unchanged in the last fifty years except for the addition of color and stereo sound. Today, personal computers are addressing the need for random access of high resolution images and CD quality audio. Furthermore, advances in digital video compression and digital communication technology have cleared the way toward offering high resolution video and audio services to consumers using traditional analog communications channels. In 1987, the U.S. Federal Communications Commission (FCC) chartered an advisory committee to recommend an advanced television system for the United States. From 1990 to 1992, the Advanced Television Test Center (ATTC) tested four all-digital systems, one analog High Definition Television (HDTV) system, and one enhancement NTSC system using broadcast and cable television environment simulators. The formation of the HDTV Grand Alliance in May of 1993 resulted from the withdrawal of the only analog HDTV system from the competition and a stalemate between the other four all-digital systems. The HDTV Grand Alliance system is composed of the best components from previously competing digital systems demonstrated to the FCC. Moving Pictures Experts Group (MPEG-2) syntax is used with novel encoding techniques to deliver a set of video scanning formats for a variety of applications. This paper describes the important features and concepts embodied in the HDTV Grand Alliance system.

In order to improve the real-time transmission ability of motion video data, it is necessary to compress video data. A real-time compression method for motion video data based on wavelet analysis and vector quantization is proposed. The two-dimensional wavelet transform is used to decompose the motion video and transform the time and frequency domain, and the quantization error is used to compensate for the video data. According to the method, the motion video data under the Internet of things are processed by LBG vector quantization, and the method of error compensation coding is used to smooth the noise of the motion video data under the Internet of things. The motion video of the N codebook is coded and combined with the multi-layer wavelet scale decomposition method, the real-time compression of the motion video data under the Internet of things is realized. Simulation results show that the proposed method can achieve better real-time compression and transmission of motion video data, and lower output error rate.

Efficient error protection strategies for robust satellite broadcast of high-definition television (HDTV) and conventional TV are investigated. The concatenated Reed-Solomon/convolutional code is preferred over the RS code for fewer adverse effects on variable-length codes. A decoded bit error rate of 10/sup -10/ or below can be achieved for all transmitted information at a low threshold E/sub b//N/sub 0/. The most critical video packet data are received near-error-free by using an additional layer of block coding with minimal redundancy and complexity. The effect of loss of synchronization for variable-length codewords due to channel errors is minimized by simple error detection and concealment methods. Digital transmission architectures for the satellite broadcast of HDTV and conventional TV are outlined. >

With high-definition television becoming the mainstream of technology development,people have higher and higher demand on video quality. This paper analyses HD video quality based on distortion cased by compression, then proposes mothed of feature extraction based on H.264. This metric shows good performance compared with MOS and can be used in real-time evaluation.

Sarnoff Corporation (formally the David Samoff Research Center) is leading a joint venture consisting of Comark, NBC, IBM, MCI , Sun Microsystems, Thomson, Philips and Advanced Modular Solutions to develop a high definition compressed digital studio. This paper provides an overview of the NIST High Definition Television (HDTV) Broadcast Technology joint venture.

Face detection is important in many algorithms in the areas of machine object recognition and pattern recognition. The kaleidoscope of applications for face detection extends across automatic image and home video content annotation, face-image stabilisation and face recognition systems. By using information derived from colour, luminosity and frequency the face detection algorithm proposed in this paper aims to determine the location of multiple frontal and non-frontal faces in compressed MPEG-1, MPEG-2 video or JPEG image content. The described algorithm requires only low computational resources on CE devices and offers at one and the same time extremely high detection rates.

In a broadcast channel, a single transmitter communicates to receivers with different channel capacities, a typical example of which is the over-the-air television broadcasting. A natural question that arises is evaluation of the optimal information transfer rate in such an environment. For the two-receiver case, we examine various transmission scenarios in this environment and focus on the theoretically optimal superposition scheme, where the information intended for the better channel is superimposed on the portion of information common to both receivers. As a result, a basic grade of service is maintained throughout the entire coverage area in addition to a higher quality service offered to the receivers with better reception conditions. Using end-to-end distortion and coverage channel signal-to-noise ratio threshold measures, three specific embedded signaling modes are introduced. We demonstrate that a generalized embedding scheme provides a practical trade-off between distortion and coverage radius. The scheme is also formulated in terms of an optimization problem, seeking the best embedding factor for a given application. To verify the theoretical results, we idealize a dual rate transmission system over a Gaussian broadcast channel, in which receivers are distributed according to a circularly symmetric exponential pdf. The numerical results indicate that this model offers a higher per capita data rate comparing to the conventional single rate transmission systems. Application of this multirate broadcast holds promise for multiresolution transmission of digital audio and high definition television.

The compressed domain video watermarking has been less expensive since complete decoding and then re-encoding is not required for watermark embedding. Handling synchronization error due to embedding is a challenging task, especially, due to motion compensation. In this paper, we propose an embedding scheme that can minimize desynchronization in the watermark extraction process at the decoder for embedding in compressed videos with better visual quality. Experimental results show the effectiveness of the proposed scheme.

HD video data is visible in the real-time compression processing is one of the key technologies, The current video compression codec hardware platform mainly includes: ASIC, DSP and SoC. These three kinds of SOC chips have become the mainstream of the codec chip market because of their low cost, low power consumption and high integration. According to Da Vinci of TI processor TMS320DM368 as the core architecture, The hardware system of high definition video compression processing based on embedded technology is designed, which includes video input ISIF interface module, communication module, core processor module, peripheral circuit module and power module. This system supports 1080P30 HD video capture hardware frame, H.264 encoding compression and local storage, can be widely used in industrial control, medical, aerospace and other industries, has important application value in engineering.

In this paper, we describe a fully automatic video retrieval prototype system that uses an image or a video sequence of an interested identity as probe. The system is based on face vision techniques including face detection and tracking, face alignment and recognition. Given a film or TV sitcom, first face trajectories are extracted in video by head tracking that decompose the video into segments corresponding to certain identity, then frames containing faces of higher quality are selected and normalized according to face alignment results, and finally different segments are associated by face recognition. Experiments are carried out on news video, feature length film video and TV sitcom to show its effectiveness. Potential usage of our system includes intelligent DVD/VCD browsing, video database retrieval, meeting record browsing, etc.

There are several methods to implement DWT. But lifting scheme is preferred because it reduces the computational complexity and is easy to implement. 9/7 filter coefficient are used in lifting scheme since they are originally implemented in JPEG codec 2000. Much architecture were developed using lifting scheme. But the number of computations is more leading to less efficient architecture. As an existing work, CSD algorithm based parallel flipped lifting 2D DWT using dual-scan technique (CSDPF) is designed with the modified flipping scheme using Canonical Signed Digit(CSD) algorithm.In order to reduce the computations Flipping Structure for a Lifting based Discrete Wavelet Transform using Sub Expression Sharing (SES) is developed for image compression. To improve the computational efficiency, area and power requirements sub expression sharing technique is used. In the case where several multipliers are present in a network of operators, the savings is achieved by identifying common subexpressions and sharing the two most common subexpressions that is expected to save the number of additions. It reduces the arithmetic resources like shifter and adder in its implementation. Using SES method the number of computations is reduced to half of the total computations. Hence a computationally efficient architecture with area and power reduction by 32% and 5% respectively is designed. The various applications include fax transmission, satellite remote sensing, high definition television, storage and transmission of CT and MRI scans etc.

Visual database systems require efficient indexing to enable fast access to the images and video sequences in the database. Since image and video data are voluminous, compression is essential for storage and transmission. The International Standards Organization has proposed the JPEG and MPEG standards for image and video compression, respectively. In order to avoid the unnecessary decompression and recompression operations in the searching process, it is efficient to index the image/video in compressed form. In this paper, we present image and video indexing techniques in the compressed domain.