Video Compression - From Concepts to the H.264/AVC Standard

In modern world more image and video compression technologies improving gradually. But major barrier of the new technologies concepts are repeated from authors. Because authors can’t find in depth of the papers from various technologies. So Survey of Video Compression Techniques very helpful for these types problems in video compression areas. Video compression techniques such as DCT coding, Quantization, Entropy coding, Motion estimation are widely used in video compression techniques. The main focus of this paper is to analyse video compression techniques required for video processing especially to discover how much amount of data to compressed, which techniques is faster and visual quality better and so on. We evaluate the video compression techniques for finding compression ratio in terms of performance, speed and accuracy. We also compare video compression techniques with conventional methods.

Compression of images process is a step in the image processing. It is concerned with the transmission and storage of digitally created images. Fractal coding is a potential image and video compression approach with good reconstruction fidelity and relatively large compression ratios, because of its simplicity and great performance; fractal image compression (FIC) is a particularly popular approach in image compression applications. However, it has a significant disadvantage in the form of a long encoding time. This is because encoding any small bit necessitates a massive similarity search in the original data As a result; the FIC search time is reduced while the quality of the reconstructed images is maintained acceptable level in many introduced paper and other still a study topic in progress. Fractal images are images that are self-similar in that each individual part is the same as the total. This paper will discusses many attempts for more author that working on image and video compression using fractal compression technique based on various approach and with each discuss focuses on the main parameter of compression such compression ratio (CR), peak signal to noise ratio (PSNR) and encoding time, as well as the details of data set the used for testing also writing with each technique to creating fractal video and image compression. Index Terms— FIC, Video compression, parallel processing, Iteration Function System (IFS), Image processing.

Video compression has great significance in the communication of motion pictures. Video compression techniques try to remove the different types of redundancy within or between video sequences. In the temporal domain, the video compression techniques remove the redundancies between the highly correlated consequence frames of the video. In the spatial domain, the video compression techniques remove the redundancies between the highly correlated consequence pixels (samples) in the same frame. Evolving neural-networks based video coding research efforts are focused on improving existing video codecs by performing better predictions that are incorporated within the same codec framework or holistic methods of end-to-end video compression schemes. Current neural network-based video compression adapts static codebook to achieve compression that leads to learning inability from new samples. This paper proposes a modified video compression model that adapts the genetic algorithm to build an optimal codebook for adaptive vector quantization that is used as an activation function inside the neural network’s hidden layer. Background subtraction algorithm is employed to extract motion objects within frames to generate the context-based initial codebook. Furthermore, Differential Pulse Code Modulation (DPCM) is utilized for lossless compression of significant wavelet coefficients; whereas low energy coefficients are lossy compressed using Learning Vector Quantization (LVQ) neural networks. Finally, Run Length Encoding (RLE) is engaged to encode the quantized coefficients to achieve a higher compression ratio. Experiments have proven the system’s ability to achieve higher compression ratio with acceptable efficiency measured by PSNR.

The overall objective of the project was to develop fast decompression and playback routines for full motion, color video. A survey was done of existing standards and potential new routines and techniques for video compression and playback to determine which were suitable for use on the Army Contact Test Set (CTS) III computer. Playback speeds were preferred to be at 30 frames per second on the target architecture. Compression ratios were expected to store several minutes of synchronized video in 1 MB. Playback routines were Windows 3.1 compatible. Identification of any hardware upgrades assoaated with playback were made when necessary. A demonstration of existing LLNL algorithms for still frame decompression which represented a current benchmark of data compression performance was completed. NOVA Management and LLNL used some of the compression technologies developed or currently being developed at LLNL to address the requirements of this SBIR. LLNL started by evaluating current compression technologies or combinations thereof to estimate the best compression ratio LLNL could achieve at this stage. LLNL ported some of our software from the SUN workstation environment to the PC or equivalent environment (e.g., MAC) so as to closely match the computer environment suggested by the Army. Finally, LLNL designed and outlined new algorithms to meet the desired video compression of CTS.

The purpose of this CRADA was to establish a framework for LLNL and NOVA Management, Inc. to Cooperatively develop video compression routines to be used to condense maintenance documentation provided on computers issued to Army mechanics to help them diagnose and repair equipment faults. In the past, paper technical manuals were the only means of communicating fault isolation, diagnostics and repair action information to maintenance personnel. The need for this information was at the weapon system itself as well as at the maintenance depot. This project addressed the need for means of efficient storage and retrieval of video (bandwidth issue) by maintenance personnel as they moved through the diagnostic procedures. Several research and development projects have employed interactive stored video as a means of providing maintenance information to the soldier. The problem with this approach was the massive data storage requirement. The overall objective of the project was to develop fast decompression and playback routines for full motion, coIor video. A survey was done of existing standards and potential new routines and techniques for video compression and playback to determine which were suitable for use on the CTS. Playback speeds were preferred to beat 30 frames per second on the target architecture. Compression ratios were expected to store several minutes of synchronized video in 1 MB. Playback routines were Windows 3.1 compatible. Identification of any hardware upgrades associated with playback were made when necessary. A demonstration of existing LLNL algorithms for still frame decompression which represented a current benchmark of data compression performance was completed. NOVA Management and LLNL used some of the compression technologies developed or currently being developed at LLNL to address the requirements of this SBIR. LLNL started by evaluating current compression technologies or combinations thereof to estimate the best compression ratio LLNL could achieve at this stage. LLNL ported some of our software from the SUN workstation environment to the PC or equivalent environment (e.g., MAC) so as to closely match the computer environment suggested by the Army. Finally, LLNL designed and outlined new algorithms to meet the desired video compression of CTS.

The huge usage of digital multimedia via communications, wireless communications, Internet, Intranet and cellular mobile leads to incurable growth of data flow through these Media. The researchers go deep in developing efficient techniques in these fields such as compression of data, image and video. Recently, video compression techniques and their applications in many areas (educational, agriculture, medical …) cause this field to be one of the most interested fields. Wavelet transform is an efficient method that can be used to perform an efficient compression technique. This work deals with the developing of an efficient video compression approach based on frames difference approaches that concentrated on the calculation of frame near distance (difference between frames). The selection of the meaningful frame depends on many factors such as compression performance, frame details, frame size and near distance between frames. Three different approaches are applied for removing the lowest frame difference. In this paper, many videos are tested to insure the efficiency of this technique, in addition a good performance results has been obtained.

As video technology continues to seamlessly weave itself into the fabric of daily life, there is a growing need for enhanced storage and efficient video transmission. This surge in demand has led to heightened expectations and standards for video compression technology. Machine learning as an up-and-coming technology can play its advantages in the field of video compression. This article reviews the current state of research on combining video compression techniques with machine learning. The article provides an overview of various research avenues for enhancement, spanning from conventional video compression algorithms to the fusion of traditional compression frameworks with machine learning methodologies, and even the development of novel end-to-end compression algorithms. In additional, the article explores the possible various application scenarios of machine learning-based video compression algorithms based on the characteristics of such non-standard and arithmetic demanding algorithms. At the end, the article speculates on the future of video compression algorithms based on the content of the various studies reviewed in the article.

Video signals tend to contain significant temporal compression because of the high degree of correlation between consecutive frames. This means that existing video compression technologies have not utilized all the information that is readily available in such signals. In particular, we will discuss a novel video compression technique that is capable of exploiting temporal redundancy to improve the details while processing requirements are kept low. In our case, the transformation is applied by converting the 3D video data into 2D space. This transformation allows for applying 2D transforms to search for temporal redundancy and makes motion compensation which is rather expensive computationally unnecessary. This transformation combines the spatial and temporal relations of the video signal and provides each group of pictures (GOP) with a single image with higher spatial relations. We then use SPIHT to increase the compression efficiency as a result of the properties of wavelet-transformed images. The use of discrete wavelet transform (DWT) provides a level of de-correlation that allows effective energy compaction to take place resulting in high video compression ratios. A wide range of experiments clearly indicates the potential of our technique especially when the bit rates are high and with slow-motion videos.

This paper presents a new technique for region-oriented video compression based on the minimization of a minimum description length (MDL) criterion. The proposed video compression scheme is based on a region-based motion compensation approach in which the displaced frame difference is partially coded together with the segmentation and the motion parameters. The region-based segmentation is approximated by a polygonal representation which permits to significantly reduce the segmentation coding cost. The polygonal approximation which minimizes the MDL criterion is finally considered as optimal. Experimental results are presented on real video sequences.

Micro-video has fragmented propagation mode and short, flat, and fast features. The convenience of its shooting and dissemination is widely used by the public. In addition to the development of Internet technology, the video compression technology has also played an important role. In this paper, three kinds of micro-video compression coding techniques are selected and analyzed; they are MPEG-4, AVC/H.264, and HEVC/H.265. The three video compression techniques are compared by the film trailer compression experiment, and the conclusion is applied to the micro-video compression of scientific research projects. Combining the actual advantages and disadvantages of the scheme, it is beneficial to the effective application of micro-video coding technology in practical projects.

The daunting yet increasing volume of videos on the Internet brings the challenges of storage and indexing to existing online video services. Current techniques like video compression and summarization are still struggling to achieve the two often conflicting goals of low storage and high visual and semantic fidelity. In this work, we develop a new system for video summarization, called Near-Lossless Video Summarization (NLVS), which is able to summarize a video stream with the least information loss by using an extremely small piece of metadata. The summary consists of a set of synthesized mosaics and representative keyframes, a compressed audio stream, as well as the metadata about video structure and motion. Although at a very low compression ratio (i.e., 1/30 of H.264 baseline in average, where traditional compression techniques like H.264 fail to preserve the fidelity), the summary still can be used to reconstruct the original video (with the same duration) nearly without semantic information loss. We show that NLVS is a powerful tool for significantly reducing video storage through both objective and subjective comparisons with state-of-the-art video compression and summarization techniques.

From the Publisher: The field of signal recovery, which is relatively mature, has long been associated with a wealth of powerful mathematical techniques such as Bayesian estimation, and the theory of projections onto convex sets (to name just two). This book illustrates, for the first time in a complete volume how these techniques can be brought to bear on the very important problems of image and video compression and transmission.

Encoder adaptable difference detection for low power video compression in surveillance system

We propose a video compression technique based on neural networks which is completely different from existing techniques. Existing video compression techniques have used a neural network as a video compressor. In other words, video compression flow of the existing techniques was: an original video is inputted to a neural network, and the neural network outputs compressed expression of the video. In this paper, we propose a technique for storing a video into a neural network. In this technique, the neural network is treated as a compressed expression of the video. Our purpose is to find the configuration of the neural network that stores and compresses the video efficiently. We implement two models of the neural network. One is a multilayer perceptron whose input is t, and output is \(frame_t\). The other is the Long short-term memory (LSTM) whose inputs are past frames like \(frame_{t - 2}\) and \(frame_{t - 1}\), and output is predicted \(frame_t\). If a data amount required to express the neural network is smaller than the video, it can be regarded as a compressed video. As the result of experiments, it is shown that the data amount of the LSTM implementation was larger than the original video. However, that of the multilayer perceptron one was about a half of the original video, and value of the structural similarity (SSIM), which is a metric of image quality, was about 0.99.

Block based transform coding is the most popular technique for image and video compression. However, images compressed using block based algorithms exhibit blocking which is one of the most annoying artifacts in compressed images and video. Many deblocking algorithms have been proposed to improve the quality of the reconstructed image. Although the deblocking operation improves the image appearance by smoothing the block discontinuities, a loss of information also occurs during this process. As a consequence, there is a need to develop methods to reduce the blocking artifacts while minimizing the information loss. We propose a novel fusion based technique to minimize the loss of useful information which may result from the deblocking operation. The loss of key image information can be reduced by fusing a deblocking result and the compressed image.