Learning Via Watching: A Weakly Supervised Moving Object Detector for Satellite Videos

Moving object detection in a video plays an important role in many vision applications. Recently, moving object detection using appearance modeling based on a convolutional neural network has been actively developed. However, the CNN- based methods usually require the user’s supervision of the first frame so that it becomes highly dependent on the training dataset. In contrast, the method of finding a foreground, which models a background occupying a large proportion in an image, can detect a moving object efficiently in an unsupervised manner. However, existing methods based on background modeling in a pan-tilt-zoom (PTZ) camera suffer many false positives or loss of moving objects due to the estimation error of camera motion. To overcome the aforementioned limitations, we propose a moving object detection method for a PTZ camera through two background models. In an unsupervised way, our method builds the two background models that have different roles: 1) a coarse background model for detecting large changes, and 2) a fine background model for detecting small changes. In more detail, the coarse background model builds a block-based Gaussian model, and the fine model builds a sample consensus model. Both models are adaptively updated according to the estimated camera motion in the video recorded by a PTZ camera. Then, each foreground result from two background models is incorporated to fill the moving object region. Through experiments, the proposed method achieves better performance than the state-of-the-art methods and operates in real-time without parallel processing. In addition, we showed the effectiveness of the proposed model through improved results of moving object detection through combination with the latest supervised method.

Moving object detection in video satellite image is studied. A detection algorithm based on deep learning is proposed. The small scale characteristics of remote sensing video objects are analyzed. Firstly, background subtraction algorithm of adaptive Gauss mixture model is used to generate region proposals. Then the objects in region proposals are classified via the deep convolutional neural network. Thus moving objects of interest are detected combined with prior information of sub-satellite point. The deep convolution neural network employs a 21-layer residual convolutional neural network, and trains the network parameters by transfer learning. Experimental results about video from Tiantuo-2 satellite demonstrate the effectiveness of the algorithm.

Moving objects have been detected using various object detection techniques. Two categories for moving object detection techniques are frame differencing based and background subtraction based. These techniques are limited by camera scene complexity, light conditions, video type etc. Frame differencing based techniques process videos faster compared to background subtraction based techniques. Frame differencing based techniques detects only the boundary of the moving object and may fail for slow moving objects. These techniques for moving object detection can be improved by using sound data as most video recording cameras are equipped with a microphone. Sounds from human footsteps can be recorded with video and used with frame differencing techniques to improve moving object detection results. Camera microphones also record background noise with other background sound. This noisy data has been filtered out using the Fourier transform. When peak locations for each footstep sound are determined, and a Full Width at Half Maxima is computed for each peak, the number of frames within this width are counted, these frames are verify the presence of a moving object.

Moving object detection in urban scenes is important for the guidance of autonomous vehicles, robot navigation, and monitoring. In this paper moving objects are automatically detected using three sequential frames and tracked over a longer period. To this extend we modify the plane+parallax, fundamental matrix, and trifocal tensor algorithms to operate on three sequential frames automatically, and test their ability to detect moving objects in challenging urban scenes. Frame-to-frame correspondences are established with the use of SIFT keys. The keys that are consistently matched over three frames are used by the algorithms to distinguish between static objects and moving objects. The tracking of keys for the detected moving objects increases their reliability over time, which is quantified by our results. To evaluate the three different algorithms, we manually segment the moving objects in real world data and report the fraction of true positives versus false positives. Results show that the plane+parallax method performs very well on our datasets and we prove that our modification to this method outperforms the original method. The proposed combination of the advanced plane+parallax method with the trifocal tensor method improves on the moving object detection and their tracking for one of the four video sequences.

Moving object detection is an important and basic step in any video surveillance application. Detected object has used an input to higher level tasks such as tracking, event detection, and behavioral analysis. There are several challenges in moving object detection such as illumination changes, occlusion, shadow, bootstrap, dynamic background etc. Detection of moving object having similar color as background structure is called as camouflage, which is another big challenge. The method of detecting camouflage moving object is known as Decamouflaging. In recent years, the researchers are attracted towards the camouflage moving object detection due to its application in the military. In this review paper, different techniques using various features for camouflaged moving obj ect detection were studied.

Moving object detection and feature extraction algorithm in video sequences are discussed in this paper. There are several problems in moving object detection and extraction from outdoor video surveillance, that is, moving object detection algorithm is easily interfered by background of video monitor, the feature of moving object is difficult to extract from video source, and the vibration of picture frame in outdoor video surveillance causing by wind factors effects the incorrect extraction of the moving object. The vibration causing by wind factors was corrected and an enhancement inter-frame difference algorithm based on difference histogram threshold selection is presented in this paper. The experiment results prove that this method can detect and extract the moving object accurately and efficiently, and it can meet the needs of real-time detection.

Moving object detection is an important research hotspot in the field of image processing, which is the basis of object classification and object tracking. On the one hand, moving object detection should adapt to the changes of environment and itself, on the other hand, it should take into account the accuracy and real-time of detection. ViBe algorithm is a simple and fast algorithm in moving object detection methods. It has no specific requirements for video format, color space, and background relationship. It only needs a small number of sample values to cover the background samples, and has both accuracy and computational efficiency. How to choose parameters is the key problem to determine the performance of ViBe algorithm. This paper mainly studies the ViBe detection method for moving objects, and optimizes the main parameters of the ViBe algorithm through simulation. Firstly, the sample radius is selected according to the target resolution; Secondly, the updating factor of time parameters and the number of samples in the pixel model are optimized; Finally, the minimum matching number is selected to constrain the number of matching samples to classify new pixels. The experimental results show that the method has good performance in moving object detection and can retain the integrity of moving objects.

Moving object detection under varying illumination is a prominent area of research in the field of computer vision. The detected object results from moving object framework, suffers from factors like noise, change in object scene, shadow, changes in illumination etc. So there is a growing interest to develop a robust moving object detection framework under varying illumination scenario. A significant amount of methods have been proposed over recent years on moving object detection under varying illumination condition. In this paper some of the recent effective methods based on accuracy have been reviewed. In this paper, methods reviewed include illumination sensitive feature and illumination invariant feature approaches for moving object detection under illumination varying background conditions. Methods reviewed in this paper include qualitative and quantitative comparison to guide the reader a clear insight to the computer vision community, those who are especially working in moving object detection under different illumination conditions.

Moving object detection with a mobile image sensor is an important task when considering mobile robots for use in human environments. In this paper, we propose a novel method/or effectively solving the problem of detecting moving objects for mobile robots by using the stereo omni-directional system (SOS) which has a complete spherical FOV. We first predict the depth image for the present time from the self-motion of the SOS and the depth image obtained at the previous time, and then detect the moving objects by comparing the predicted depth image with the actual one obtained at the present time. Experiments in the real world show the effectiveness of the proposed method.

Moving object detection is a fundamental step in various computer vision applications. Robust Principal Component Analysis (RPCA) based methods have often been employed for this task. However, the performance of these methods deteriorates in the presence of dynamic background scenes, camera jitter, camouflaged moving objects, and/or variations in illumination. It is because of an underlying assumption that the elements in the sparse component are mutually independent, and thus the spatiotemporal structure of the moving objects is lost. To address this issue, we propose a spatiotemporal structured sparse RPCA algorithm for moving objects detection, where we impose spatial and temporal regularization on the sparse component in the form of graph Laplacians. Each Laplacian corresponds to a multi-feature graph constructed over superpixels in the input matrix. We enforce the sparse component to act as eigenvectors of the spatial and temporal graph Laplacians while minimizing the RPCA objective function. These constraints incorporate a spatiotemporal subspace structure within the sparse component. Thus, we obtain a novel objective function for separating moving objects in the presence of complex backgrounds. The proposed objective function is solved using a linearized alternating direction method of multipliers based batch optimization. Moreover, we also propose an online optimization algorithm for real-time applications. We evaluated both the batch and online solutions using six publicly available datasets that included most of the aforementioned challenges. Our experiments demonstrated the superior performance of the proposed algorithms compared with the current state-of-the-art methods.

Moving object detection is critical for automated video analysis in many vision-related tasks, such as surveillance tracking, video compression coding, etc. Robust Principal Component Analysis (RPCA), as one of the most popular moving object modelling methods, aims to separate the temporally-varying (i.e., moving) foreground objects from the static background in video, assuming the background frames to be low-rank while the foreground to be spatially sparse. Classic RPCA imposes sparsity of the foreground component using <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$\ell _1$</tex-math></inline-formula> -norm, and minimizes the modeling error via <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$\ell _2$</tex-math></inline-formula> -norm. We show that such assumptions can be too restrictive in practice, which limits the effectiveness of the classic RPCA, especially when processing videos with dynamic background, camera jitter, camouflaged moving object, etc. In this paper, we propose a novel RPCA-based model, called Hyper RPCA, to detect moving objects on the fly. Different from classic RPCA, the proposed Hyper RPCA jointly applies the maximum correntropy criterion (MCC) for the modeling error, and Laplacian scale mixture (LSM) model for foreground objects. Extensive experiments have been conducted, and the results demonstrate that the proposed Hyper RPCA has competitive performance for foreground detection to the state-of-the-art algorithms on several well-known benchmark datasets.

We propose a technique for removing traces of movable objects from occupancy grid maps based on deep neural networks, dubbed enhanced occupancy grid map generation (E-OGM-G). In E-OGM-G, we capture camera images synchronized and aligned with LiDAR rays, semantically segment these images, and compute which laser rays of the LiDAR hit pixels segmented as belonging to movable objects. By clustering laser rays that are close together in a 2D projection, we are able to identify clusters that belong to movable objects and avoid using them in the process of generating the OGMs – this allows generating OGMs clean of movable objects. Clean OGMs are important for several aspects of self-driving cars’ operation (i.e., localization). We tested E-OGM-G using data obtained in a real-world scenario – a 2.6 km stretch of a busy multi-lane urban road. Our results showed that E-OGM-G can achieve a precision of 81.19% considering the whole OGMs generated, of 89.76% considering a track in these OGMs of width of 12 m, and of 100.00% considering a track of width of 3.4 m. We then tested a self-driving car using the automatically cleaned OGMs. The self-driving car was able to properly localize itself and to autonomously drive itself in the world using the cleaned OGMs. These successful results showed that the proposed technique is effective in removing movable objects from static OGMs.

Moving Object Detection systems have long been in use to look at security sensitive areas. The manufacture of video investigating systems sensible desires fast, reliable and durable algorithms for moving object detection classification pursuit and activity analysis. Moving object detection is that the essential step for extra analysis of video. It handles segmentation of moving objects from stationary background objects. Object classification step categorizes detected objects into preened classes like human, vehicle, animal, clutter, etc. it's a necessity to inform apart objects from each other therefore on trace and analyse their actions reliably. In previous system we have got performed background subtraction by victimization clever Edge Detection. In clever Edge Detection technique we tend to tend to square measure taking 2 photos for comparison those square measure background image and foreground image. Previous strategies for object detection square measure methodology along side object detectors image segmentation and Background subtraction. Our methodology aims to section objects supported motion info and it contains a part of background modelling. In the previous strategies we tend to tend to square measure conducting background subtraction only for photos. For this we tend to tend to projected an image component wise background modelling and subtraction technique mistreatment multiple choices. Hence, throughout this color, gradient and Hear-Like choices square measure integrated to handle the variation element. Thus, motion segmentation and background subtraction square measure the foremost connected topics to the current paper.

Current Moving Object Detectors in airborne Region of Interest (ROI) coding systems for police surveillance applications used on-board of UAVs are often based on Global Motion Estimation (GME) techniques. Since in these scenarios the camera is moving, simple background removal approaches cannot be applied without a Global Motion Compensation (GMC). Common GMC algorithms assume the ground to be planar, allowing the pixels of the previous frame to be motion compensated into the current frame by applying a projective transformation. The difference image between the compensated frame and the current frame emphasis regions containing possible motion. Such moving object detectors are great in terms of run-time efficiency but are known to lack in terms of accuracy - especially for unstructured regions of moving objects - as well as the robustness against noise. Superpixel segmentation was recently proposed to overcome the issue of the imprecise region cuts given by the difference image. It provides a greatly improved true positive detection rate, but unintentionally also increases the area of false positives. This paper proposes the use of a mesh-based GME and GMC to detect the moving object regions wherein a cluster filter eliminates errors in the optical flow by assuming a smooth vector field as the global motion model. In doing so we improve the coding efficiency of the fully automatic ROI coding system by more than 24% for moving object areas conserving the detection benefits of the integration of superpixel segmentation.

Self-mixing interferometry (SMI) is superior to other laser interferometry methods due to its simplicity and compactness. However, SMI signals are often complex and difficult to process due to interference in the form of variations in the effective reflectivity of the target, noisy signals, complex signal shapes, and other dependencies. Deep neural networks have been a very popular area of research in computer artificial intelligence in recent years, allowing more implicit features to be uncovered than traditional shallow machine learning. It has been shown that convolutional and back-propagation neural networks can be used for SMI signal processing. There are also studies that have used machine learning genetic algorithms for absolute distance measurement. Based on the above, this study used convolutional neural networks to form a deep neural network for absolute distance measurement based on SMI technology. We first trained the deep convolutional neural network at different feedback strengths. The results of the Convolutional Neural Network (CNN) model showed a coefficient of determination of 0.9987. which is consistent with the required model. The trained network was then used to estimate absolute distances with and without the addition of noise. The comparison proves that the proposed method is noise-proof and has high adaptability for measurements under different conditions.