A novel video error concealment technique using modified boundary matching algorithm with correlation function

We use particle filtering for correcting the erroneous motion vectors (MVs), which are derived from the boundary matching algorithm (BMA) in packet video communications. Assuming a two-state Markov channel model for transmission, the error of the extracted MVs by BMA is shown to be modeled by the Gaussian mixture distribution. Formulating the problem in the state space, we deploy particle filtering for denoising the erroneous MVs. The main challenge of using particle filters is high computational complexity that is directly related to the number of particles. The proposed particle filtering scheme is efficient even if the number of particles is decreased. Experimental results are provided to show the efficiency of this filtering approach compared to a recent scheme based on Kalman filtering. The experiments show meaningful increase in the quality of the recovered video sequences in terms of PSNR up to 3 dB compared with the other error concealment techniques. Also, the computational complexity of the proposed scheme is discussed.

Error concealment at a decoder is an efficient method to reduce the degradation of visual quality caused by channel errors. In this paper, we propose a novel spatio-temporal error concealment algorithm based on the spatial-temporal fading (STF) scheme which has been recently introduced. Although STF achieves good performance for the error concealment, several drawbacks including blurring still remain in the concealed blocks. To alleviate these drawbacks, in the proposed method, hybrid approaches with adaptive weights are proposed. First, the boundary matching algorithm and the decoder motion vector estimation which are well-known temporal error concealment methods are adaptively combined to compensate for the defect of each other. Then, an edge preserved method is utilized to reduce the blurring effects caused by the bilinear interpolation for spatial error concealment. Finally, two concealed results obtained by the hybrid spatial and temporal error concealment are pixel-wisely blended with adaptive weights. Experimental results exhibit that the proposed method outperforms conventional methods including STF in terms of the PSNR performance as well as subjective visual quality, and the computational complexity of the proposed method is similar to that of STF.

Purpose – The purpose of this paper is to solve the pack loss problem of video transmitted over error‐prone channels. Pack loss generally affects the visual quality of reconstructed frames significantly. Consequently, a grey approach to error concealment (EC) is proposed.Design/methodology/approach – Note that missing information in error blocks can be found before and after the error frame. Thus, two adjacent error‐free frames are utilized to conceal error blocks caused by packet loss. This paper presents an EC approach based on grey polynomial interpolation (GPI) which is called the GTEC. In the GTEC, the following stages are involved. First, error blocks due to packed loss are detected. Then, optimal reference blocks in adjacent frames are found through boundary matching algorithm (BMA). Finally, estimated blocks are obtained by the GPI. By replacing error blocks with the estimated blocks, EC is completed in the GTEC.Findings – In the simulation, the proposed GTEC is compared with the EC scheme in H.26...

Low-complexity error concealment techniques for mobile applications are studied extensively in this paper. The boundary matching algorithm (BMA) is an attractive choice for mobile video concealment due to its low complexity. Here, we examine a variant of BMA called the outer boundary matching algorithm (OBMA). Although BMA and OBMA are similar in their design principle, it is empirically observed that OBMA outperforms BMA by a significant margin (typically, 0.5 dB or higher) while maintaining the same level of complexity. In this work, we attempt to explain the superior performance of OBMA, and conclude that OBMA provides an excellent tradeoff between the complexity and the quality of concealed video for a wide range of test video sequences and error conditions.

In this paper, a prescription-based error concealment (PEC) method is proposed. PEC relies on pre-analyses of the concealment error image (CEI) for I-frames and the optimal error concealment scheme for P-frames at encoder side. CEI is used to enhance the image quality at decoder side after error concealment (by spatial interpolation or zero motion) of the corrupted intra-coded MBs. A set of pre-selected error concealment methods is evaluated for each corrupted inter-coded MB to determine the optimal one for the decoder. Both the CEI and the scheme indices are considered as the prescriptions for decoder and transmitted along with the video bit stream based on a reversible data embedding technique. Experiments show that the proposed method is capable of achieving PSNR improvement of up to 1.48 dB, at a considerable bit-rate, when the packet loss rate is 20%

In this paper, the error concealment techniques as motion vector extrapolation (MVE), boundary matching (BM), side matching (SM), 16/spl times/16-MB-based and 8/spl times/8-block-based concealment are implemented and compared with feedback-based no waiting ARQ (NWARQ) error recovery technique. A new error concealment method using preprocessing (PREP) and search is proposed and implemented. This new method tries to use the information of surrounding MV as much as possible, and find a more precise motion vector using additional search processing in a search window centered by the estimated motion vector. Simulation results, based JM1.4 codec of JVT, show that both NWARQ and PREP can significantly improve the reconstruction video quality. And the combined PREP, SEARCH and NWARQ techniques can greatly achieve improved performance. From the simulation results, the SM and 16/spl times/16-MB-based concealment methods show better performance than BM and 8/spl times/8-block-based concealment.

The problem of error control and concealment in video communication is becoming increasingly important because of the growing interest in video delivery over unreliable channels such as wireless networks and the Internet. This paper reviews the techniques that have been developed for error control and concealment. These techniques are described in three categories according to the roles that the encoder and decoder play in the underlying approaches. Forward error concealment includes methods that add redundancy at the source end to enhance error resilience of the coded bit streams. Error concealment by postprocessing refers to operations at the decoder to recover the damaged areas based on characteristics of image and video signals. Last, interactive error concealment covers techniques that are dependent on a dialogue between the source and destination. Both current research activities and practice in international standards are covered.

This paper presents an efficient error concealment method for multiview video plus depth (MVD) delivery over error-prone channels based on the view synthesis information. Specifically, we propose an enhanced temporal error concealment (TEC) method by estimating the probable partition and missing MVs of a corrupted macroblock (MB) using the synthesized information. Furthermore, the view synthesis error concealment (VSEC) approach that directly uses the synthesized pixels to conceal the corrupted MBs is also adaptively utilized together with the TEC approach. Experimental results have shown the effectiveness of the proposed method compared with the existing methods in terms of both objective and subjective measures.

Error concealment is a well-known technique to improve reproduced picture quality in cases which parts of the coded picture are not available at a decoder for reconstruction. The conventional error concealment methods generally make use of the correlation between a damaged marcoblock and its adjacent macroblocks in the same frame and/or the previous frame. However, performance results of concealment methods are different each other and dependent on how much damaged frames and macroblocks are correlated to surrounding ones temporally and spatially. Moreover, most of them can not conceal effectively the consecutively damaged frames or macro blocks caused by wireless bursty packet loss features, since motion vectors and correlation information between the damaged images are already destroyed. The proposed error concealment aware error resilient video coding is a new method which has an intelligent error concealment selector by using pre-estimation technique of the possibly damaged motion vectors at the encoder. The method recommends the best error concealment per macroblock by transmitting additionally its error concealment selection codes to the decoder. The chosen error concealment helps to conceal the damaged MB at the decoder even when losses of frames are bursty. The experimental results show the substantial effectiveness to improve video quality at the cost of a little bit overhead at the transmitted bit streams.

Compressed video bit-streams are extremely sensitive to packet loss over error-prone channels. Error concealment (EC) has been considered as one of error control techniques to improve the reconstructed picture quality against transmission errors. However, EC methods show poor image reconstruction performance due to unavailable scene change information of the video sequence, especially when an abrupt scene change occurs. In this paper, we propose an effective EC method based on scene change detection algorithm (SCDA), which provides information to decide whether spatial or temporal EC is better to be used for intra and inter frames respectively. The simulation results show that the proposed method highly improves the subjective quality of incorrectly decoded frames and obtains an average gain of 0.7dB compared with the H.264/AVC Joint Model reference software.

Video transmission in error-prone networks suffers bit errors and packet losses that degrade the decoded video quality. In this paper, a video error concealment scheme based on H.264/AVC is proposed to enhance the error robustness using reversible data hiding. At the encoder, motion vectors of macro blocks belonging to the region of interest (ROI) are embedded into the background region within the same frame. The histogram modification technique based on quantized DCT coefficients of coded macro blocks is used to achieve loss less recovery after data extraction. If a macro block in the ROI is found missing at the decoder, the embedded motion vector can be extracted from the corresponding host macro block for the recovery of the missing macro block. This proposed scheme makes a tradeoff between error concealment performance and compression efficiency. Experimental results show the better reconstructed video quality can be achieved compared with the related error concealment methods.

In this paper, we propose a novel spatial image error concealment (EC) method based on deep neural network. Considering that the natural images have local correlation and non-local self-similarity, we use the local information to predict the missing pixels and the non-local information to correct the predictions. The deep neural network we utilize can be divided into two parts: the prediction part and the auto-encoder (AE) part. The first part utilizes the local correlation among pixels to predict the missing ones. The second part extracts image features, which are used to collect similar samples from the whole image. In addition, a novel adaptive scan order based on the joint credibility of the support area and reconstruction is also proposed to alleviate the error propagation problem. The experimental results show that the proposed method can reconstruct corrupted images effectively and outperform the compared state-of-the-art methods in terms of objective and perceptual metrics.

Region-based error concealment of right-view frames for stereoscopic video transmission

Efficient error protection strategies for robust satellite broadcast of high-definition television (HDTV) and conventional TV are investigated. The concatenated Reed-Solomon/convolutional code is preferred over the RS code for fewer adverse effects on variable-length codes. A decoded bit error rate of 10/sup -10/ or below can be achieved for all transmitted information at a low threshold E/sub b//N/sub 0/. The most critical video packet data are received near-error-free by using an additional layer of block coding with minimal redundancy and complexity. The effect of loss of synchronization for variable-length codewords due to channel errors is minimized by simple error detection and concealment methods. Digital transmission architectures for the satellite broadcast of HDTV and conventional TV are outlined. >

Multi-view video plus depth (MVD) is an efficient format of 3D video. MVD video can be encoded by either H.264/AVC or HEVC standard to gain higher compression ratio, which benefits their broadcasting over the Internet. However, the encoded and transferred MVD video tends to develop worse visual quality degradation caused by lossy network channel. Therefore, error concealment is here to help refrain this problem. In this paper, we propose a classification-related error concealment method for MVD video. Within our method, motion-based classification is used to judge whether the corrupted blocks are static or not. If so, the blocks from reference frames are adopted to conceal the corrupted blocks. Otherwise, view-specific based concealment procedures, which are designed in accordance with view features, are used to conceal the corrupted blocks in different views. Experimental results on AVC-based Test Model (ATM) show the superiority of this concealment scheme to several other error concealment methods in PSNR along with acceptable execution time increase.