Adjacent LBP and LTP based background modeling with mixed-mode learning for foreground detection

This paper presents a hybrid pixel-based background (HPB) model, which is constructed by single stable record and multi-layer astable records after initial learning. The image foreground object detection must face the problems of moving background, illumination changes, chaotic, etc. in real word applications. In our approach, the HPB model can be used for background subtraction to extract objects precisely in various complex scenes. Using the multi-layer astable records, we also propose the homogeneous background subtraction that can detect the foreground object with less record memory. Based on the benchmark videos, the experimental results show that single stable and 3-layer multi-layer astable records can be enough for background model construction and then updated quickly to overcome the background variation. The proposed approach can improve the averages Error Rate of foreground object detection up to 86% when comparing with the latest works.

[ACCESS RESTRICTED TO THE UNIVERSITY OF MISSOURI AT REQUEST OF AUTHOR.] Camera traps are a popular tool to sample animal populations because they are noninvasive, detect a variety of species, and can record many thousands of animal detections per deployment. Cameras are typically set to take bursts of multiple images for each detection, and are deployed in arrays of dozens or hundreds of sites, often resulting in millions of images per study. The task of converting images to animal detection records from such large image collections is daunting, and made worse by situations that generate copious empty pictures from false triggers (e.g. camera malfunction or moving vegetation) or pictures of humans. We offer the first widely available computer vision tool for processing camera trap images. Our results show that the tool is accurate and results in substantial time savings for processing large image datasets, thus improving our ability to monitor wildlife across large scales with camera traps. In this dissertation, we have developed new image/video processing and computer vision algorithms for efficient and accurate object detection and sequence-level classiffication from natural scene camera-trap images. This work addresses the following five major tasks: (1) Human-animal detection. We develop a fast and accurate scheme for human-animal detection from highly cluttered camera-trap images using joint background modeling and deep learning classification. Specifically, first, We develop an effective background modeling and subtraction scheme to generate region proposals for the foreground objects. We then develop a cross-frame image patch verification to reduce the number of foreground object proposals. Finally, We perform complexity-accuracy analysis of deep convolutional neural networks (DCNN) to develop a fast deep learning classification scheme to classify these region proposals into three categories: human, animals, and background patches. The optimized DCNN is able to maintain high level of accuracy while reducing the computational complexity by 14 times. Our experimental results demonstrate that the proposed method outperforms existing methods on the camera-trap dataset. (2) Object segmentation from natural scene. We first design and train a fast DCNN for animal-human-background object classification, which is used to analyze the input image to generate multi-layer feature maps, representing the responses of different image regions to the animal-human-background classifier. From these feature maps, we construct the so-called deep objectness graph for accurate animal-human object segmentation with graph cut. The segmented object regions from each image in the sequence are then verfied and fused in the temporal domain using background modeling. Our experimental results demonstrate that our proposed method outperforms existing state-of-the-art methods on the camera-trap dataset with highly cluttered natural scenes. (3) DCNN domain background modeling. We replaced the background model with a new more efficient deep learning based model. The input frames are segmented into regions through the deep objectness graph then the region boundaries of the input frames are multiplied by each other to obtain the regions of movement patches. We construct the background representation using the temporal information of the co-located patches. We propose to fuse the subtraction and foreground/background pixel classiffcation of two representation : a) chromaticity and b) deep pixel information. (4) Sequence-level object classiffcation. We proposed a new method for sequence-level video recognition with application to animal species recognition from camera trap images. First, using background modeling and cross-frame patch verification, we developed a scheme to generate candidate object regions or object proposals in the spatiotemporal domain. Second, we develop a dynamic programming optimization approach to identify the best temporal subset of object proposals. Third, we aggregate and fuse the features of these selected object proposals for efficient sequence-level animal species classification.

Background modeling and subtraction is a natural technique for object detection in videos captured by a static camera, and also a critical preprocessing step in various high-level computer vision applications. However, there have not been many studies concerning useful features and binary segmentation algorithms for this problem. We propose a pixelwise background modeling and subtraction technique using multiple features, where generative and discriminative techniques are combined for classification. In our algorithm, color, gradient, and Haar-like features are integrated to handle spatio-temporal variations for each pixel. A pixelwise generative background model is obtained for each feature efficiently and effectively by Kernel Density Approximation (KDA). Background subtraction is performed in a discriminative manner using a Support Vector Machine (SVM) over background likelihood vectors for a set of features. The proposed algorithm is robust to shadow, illumination changes, spatial variations of background. We compare the performance of the algorithm with other density-based methods using several different feature combinations and modeling techniques, both quantitatively and qualitatively.

We developed an automatic object segmentation system to separate the foreground objects from the background scene in the MPEG video sequence. The system consists of two modules: the background modeling and updating module and the foreground object extraction module. For the first module and comparing to existing methods, the background model can be constructed no matter whether there exist moving foreground objects or not. In addition, the background model is capable of handling the illumination changes and intrusive but motionless targets by using the short-term approach and long-term approach, respectively, to keep updating the background model. For the second module, the noises and shadows are eliminated and the holes are filled in order to reduce the false and the missing foreground detection components, respectively. Furthermore, one particular function in this module is the automatic digital matting, which can be applied to have visually accurate segmentation result for the foreground objects.KeywordsVideo SequenceBackground SubtractionBackground ModelForeground ObjectObject SegmentationThese keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

In allusion to the common occlusion problems in video segmentation methods, a novel improved video object segmentation method based on background registration is proposed. At first, the high frequency message and most noise of the images were eliminated by 1-D wavelet transform. Then, calculate the front background modeling and the back background modeling by comparing the static index and the static threshold, and employ the secondary frame difference to optimize the front background modeling and the back background modeling, then the initializing background modeling can be obtained. Accumulated frame difference was used to optimize the initializing background modeling to reduce the probability of background that is misjudged in foreground, which makes further improvement on the segmentation results. Last pick-up the video object is obtained by mathematic morphologic method. Experimental results show that the background registration method was very non-sensitive to static threshold and has strong robustness. The algorithm can overcome effectively the occlusion and quickly giving accurate segmentation results from the sequence with static background for video object segmentation, it’s also can preferable the method in spatial accuracy.

This paper presents a real-time surveillance system for detecting and tracking people, which takes full advantage of local texture patterns, under a stationary monocular camera. A novel center-symmetric scale invariant local ternary pattern feature is put forward to combine with pattern kernel density estimation for building a pixel-level-based background model. The background model is then used to detect moving foreground objects on every newly captured frame. A variant of a fast human detector that utilizes local texture patterns is adopted to look for human objects from the foreground regions, and it is assisted by a head detector, which is proposed to find in advance the candidate locations of human, to reduce computational costs. Each human object is given a unique identity and is represented by a spatio-color-texture object model. The real-time performance of tracking is achieved by a fast mean-shift algorithm coupled with several efficient occlusion-handling techniques. Experiments on challenging video sequences show that the proposed surveillance system can run in real-time and is quite robust in segmenting and tracking people in complex environments that include appearance changes, abrupt motion, occlusions, illumination variations and clutter.

Moving objects detection in video is essential for many computer vision applications and it is considered as a challenging research issue due to dynamic changes in object size, shape, complex background and illumination changes. In this research article a novel method to detect moving objects in video is proposed grounded on Locality Preserving Projections (LPP) and also thorough analysis of variations in neighbor mode and weight mode for constructing adjacency graph is given. LPP is an unsupervised subspace learning approach used for dimensionality reduction, which preserves the neighborhood structure of dataset while detection, which is vital in further steps accurate tracking and recognition of objects. The proposed method is tested on standard datasets with complex environments and experimental results obtained with variations in neighborhood modes and weight modes are encouraging.

Background subtraction method is widely used in most of the video motion detection algorithms especially for video surveillance application. Background subtraction is used to extract moving or static foreground objects from the background scene. The efficiency of foreground-background segmentation heavily relies on background model which must be able to cope with changes in the scene and granularity of the foreground objects. The robust background model can produce good foreground segmentation results and it is still a great challenge to get accurate and high performance result today. In this paper, a video foreground-background segmentation approach is proposed. This approach is based on Codebook (CB) model with Kalman Filter. This approach can be used to extract foreground objects from the video stream. The Lab color space is used in this approach to calculate color difference between two pixels using CIEDE2000 color difference formula. Extracted foreground object from video sequence using this approach is useful for object detection in video surveillance applications. This approach has been tested with PETS and CDnet2014 datasets and segmentation results accuracy are evaluated compare with ground truth.

Adaptive bootstrapping management by keypoint clustering for background initialization

Approximation-free running SVD and its application to motion detection

This work proposes a novel method for detection of motion based object having dynamic scenario in the background. The suggested scheme has a strong potential for real-time applications especially for rafting, river, sea-beach, swimming pools, ponds, etc. Apart from these, this work is very beneficial for surveillance of border, tunnel, traffic in the sea, forest, restricted zones, deep zones, etc. This work develops a statistical p based background subtraction method and implemented in three stages. In the first stage, a background model is developed using few initial frames. In the second stage, this work classifies the foreground using the difference frame and the appropriate threshold value. An automatic threshold value is generated at run-time and updated iteratively. It also reduces the problem of using a constant threshold. In the third stage, morphological filters and connected component based region filtering technique is applied to enhance the detection quality. The extensive experimental result shows more accurate results of proposed method. It also demonstrates better performance against considered state-of-the-art methods.

Background modeling techniques are used for moving object detection in video. Many algorithms exist in the field of object detection with different purposes. In this paper, we propose an improvement of moving object detection based on codebook segmentation. We associate the original codebook algorithm with an edge detection algorithm. Our goal is to prove the efficiency of using an edge detection algorithm with a background modeling algorithm. Throughout our study, we compared the quality of the moving object detection when codebook segmentation algorithm is associated with some standard edge detectors. In each case, we use frame-based metrics for the evaluation of the detection. The different results are presented and analyzed.

Background modeling from surveillance video plays a key role in event detection and human action recognition. Its goal is finding moving objects in video that are independent of the background scene. Among many background modeling algorithms, robust principle component analysis is a recently popular technique, which characterizes the moving objects via L1 norm. However, L1 norm often leads to inaccurate solution. To overcome this limiting, this paper proposes a background modeling method based on transformed L1 function (BM-TL1). The motivation is that transformed L1 function can interpolates L0 and L1 norms by tuning a parameter. Another merit of the transformed L1 function is it enjoys closed form iterative thresholding function, and thus can be optimized efficiently. Experiments demonstrate the effectiveness of the proposed methods.

We propose a new method for background modeling. Our method is based on the two complementary approaches. One uses the probability density function(PDF) to approximate background model. The PDF is estimated non-parametrically by using Parzen density estimation. And foreground object is detected based on the estimated PDF. The other method is based on the evaluation of the local texture at pixel-level resolution while reducing the effects of variations in lighting. Fusing their approach realize robust object detection under varying illumination. Several experiments show the effectiveness of our approach.

Background subtraction is a widely used technique for detecting moving objects in image sequences. Very often background subtraction approaches assume the availability of one or more clear frames (i.e., without foreground objects) at the beginning of the image sequence in input. This strong assumption is not always correct, especially when dealing with dynamic background. In this paper, we present the results of an on-line and real-time background initialization method, called IMBS, which generates a reliable initial background model even if no clear frames are available. The accuracy of the proposed approach is calculated on a set of seven publicly available benchmark sequences. Experimental results demonstrate that IMBS generates accurate background models with respect to eight different quality metrics.