Features-Based Moving Objects Tracking for Smart Video Surveillances: A Review

In this paper we propose multiple cameras using real time tracking for surveillance and security system. It is extensively used in the research field of computer vision applications, like that video surveillance, authentication systems, robotics, pre-stage of MPEG4 image compression and user inter faces by gestures. The key components of tracking for surveillance system are extracting the feature, background subtraction and identification of extracted object. Video surveillance, object detection and tracking have drawn a successful increased interest in recent years. A object tracking can be understood as the problem of finding the path (i.e. trajectory) and it can be defined as a procedure to identify the different positions of the object in each frame of a video. Based on the previous work on single detection using single stationary camera, we extend the concept to enable the tracking of multiple object detection under multiple camera and also maintain a security based system by multiple camera to track person in indoor environment, to identify by my proposal system which consist of multiple camera to monitor a person. Present study mainly aims to provide security and detect the moving object in real time video sequences and live video streaming. Based on a robust algorithm for human body detection and tracking in videos created with support of multiple cameras.

Network video surveillance has been a popular security application for many years. Target tracking in a cluttered environment remains one of the challenging problems of video surveillance. The task of target tracking is a key component of video surveillance and monitoring systems. It provides input to high-level processing such as recognition, access control or re-identification or is used to initialize the analysis and classification of human activities. Intelligent and automated security surveillance systems have become an active research area in recent time due to an increasing demand for such systems in public areas such as airports, underground stations and mass events. In this context, tracking of stationary foreground regions is one of the most critical requirements for surveillance systems based on the tracking of abandoned or stolen objects or parked vehicles. Object tracking based techniques are the most popular choice to detect stationary foreground objects because they work reasonably well when the camera is stationary and the change in ambient lighting is gradual, and they also represent the most popular choice to separate foreground objects from the current frame. In this paper, we did the literature survey on different technique and finally carried out our methodology for the same situation.

Object detection in video surveillance is typically done through background subtraction or temporal differencing. While these techniques perform very well under scenes where there are minimal light changes, they begin to fail when the scene contains rapid illumination changes. The effects of this is most profound in indoor environments. Under these conditions, the background modeling techniques produce large numbers of false positives. This paper proposes a sequential approach to suppressing these false positives. Both frame and region level spatial scales are considered to detect sudden light changes and make use of Gabor filter responses and edge maps to identify and remove false positives.

This paper proposes human tracking and recognition method in a camera network. Human matching in a multi-camera surveillance system is a fundamental issue for increasing the accuracy of recognition in multiple views of cameras. In camera network, videos have different characteristics such as pose, scale and illumination. Therefore it is necessary to use a hybrid scheme of scale invariant feature transform to detection and recognition human's behaviors. The main focus of this paper is to analyze activities for tracking and recognition humans to extract trajectories. Extracting the trajectories help to detect abnormal behavior which may be occluded in single- camera surveillance. KEYWORDS: Camera network, Multi-camera surveillance, Human's behavior, Trajectories extraction. I. INTRODUCTION Tracking and behavior recognition are two fundamental tasks in video surveillance systems which are widely employed in commercial applications for purposes of statistics gathering and processing. The number of cameras and complexity of surveillance systems have been continuously increasing to have better coverage and accuracy. Multi-camera systems become increasingly attractive in machine vision. Applications include multi view object tracking, event detection, occlusion handling and etc. In this paper, we develop method for tracking and recognition by a traffic video surveillance system of two cameras with a partially overlapping field of view. This paper is organized as follows: an overview of the past works in section2. Our proposed architecture and algorithm is presented in section3. Results of subjective evaluations and objective performance measurements with respect to Ground-truth are presented in section4. Section5 contains the conclusion.

Now a day, video surveillance has gained the most attention in real-time applications. Because of the improvement in domain of machine learning, various methodologies have been designed for multi-object detection. The real-time surveillance systems are the need of various organization as security; hence, this area of research has important. This paper introduces a new methodology for Moving object detection. In the area of real-time video surveillance systems, multi-object detection and object tracking are an important step in video processing. The moving system is critical for many of the application such as operational robot, surveillance systems in military. These real-time surveillance systems are more useful for intelligence gathering, security issues, and many personal needs. Different techniques are used for this task and research is vastly done to make this system automated and to make it reliable. In this research, subjective quality assessment of object detection and object tracking is discussed in detail. In the proposed system, the background subtraction is done from the clean original image and use of CNN with this. We have applied background subtraction method with different filtering algorithms. We have implemented and tried MoD2 and KNN algorithm on the test video and fetched the foreground image. After this, we have applied CNN to track the object. After tracking the objects, we have found out the accuracy with background subtraction method and without background subtraction method. The proposed system improved by approximately 2% as compared to existing techniques.

UTOMATED video surveillance addresses real-time observation of people and vehicles within a busy environment, leading to a description of their actions and interactions. The technical issues include moving object detection and tracking, object classification, human motion analysis, and activity understanding, touching on many of the core topics of computer vision, pattern analysis, and aritificial intelligence. Video surveillance has spawned large research projects in the United States, Europe, and Japan, and has been the topic of several international conferences and workshops in recent years. There are immediate needs for automated surveillance systems in commercial, law enforcement, and military applications. Mounting video cameras is cheap, but finding available human resources to observe the output is expensive. Although surveillance cameras are already prevalent in banks, stores, and parking lots, video data currently is used only “after the fact” as a forensic tool, thus losing its primary benefit as an active, real-time medium. What is needed is continuous 24-hour monitoring of surveillance video to alert security officers to a burglary in progress or to a suspicious individual loitering in the parking lot, while there is still time to prevent the crime. In addition to the obvious security applications, video surveillance technology has been proposed to measure traffic flow, detect accidents on highways, monitor pedestrian congestion in public spaces, compile consumer demographics in shopping malls and amusement parks, log routine maintainence tasks at nuclear facilities, and count endangered species. The numerous military applications include patrolling national borders, measuring the flow of refugees in troubled areas, monitoring peace treaties, and providing secure perimeters around bases and embassies. The 11 papers in this special section illustrate topics and techniques at the forefront of video surveillance research. These papers can be loosely organized into three categories. Detection and tracking involves real-time extraction of moving objects from video and continuous tracking over time to form persistent object trajectories. C. Stauffer and W.E.L. Grimson introduce unsupervised statistical learning techniques to cluster object trajectories produced by adaptive background subtraction into descriptions of normal scene activity. Viewpoint-specific trajectory descriptions from multiple cameras are combined into a common scene coordinate system using a calibration technique described by L. Lee, R. Romano, and G. Stein, who automatically determine the relative exterior orientation of overlapping camera views by observing a sparse set of moving objects on flat terrain. Two papers address the accumulation of noisy motion evidence over time. R. Pless, T. Brodský, and Y. Aloimonos detect and track small objects in aerial video sequences by first compensating for the self-motion of the aircraft, then accumulating residual normal flow to acquire evidence of independent object motion. L. Wixson notes that motion in the image does not always signify purposeful travel by an independently moving object (examples of such “motion clutter” are wind-blown tree branches and sun reflections off rippling water) and devises a flow-based salience measure to highlight objects that tend to move in a consistent direction over time. Human motion analysis is concerned with detecting periodic motion signifying a human gait and acquiring descriptions of human body pose over time. R. Cutler and L.S. Davis plot an object’s self-similarity across all pairs of frames to form distinctive patterns that classify bipedal, quadripedal, and rigid object motion. Y. Ricquebourg and P. Bouthemy track apparent contours in XT slices of an XYT sequence volume to robustly delineate and track articulated human body structure. I. Haritaoglu, D. Harwood, and L.S. Davis present W4, a surveillance system specialized to the task of looking at people. The W4 system can locate people and segment their body parts, build simple appearance models for tracking, disambiguate between and separately track multiple individuals in a group, and detect carried objects such as boxes and backpacks. Activity analysis deals with parsing temporal sequences of object observations to produce high-level descriptions of agent actions and multiagent interactions. In our opinion, this will be the most important area of future research in video surveillance. N.M. Oliver, B. Rosario, and A.P. Pentland introduce Coupled Hidden Markov Models (CHMMs) to detect and classify interactions consisting of two interleaved agent action streams and present a training method based on synthetic agents to address the problem of parameter estimation from limited real-world training examples. M. Brand and V. Kettnaker present an entropyminimization approach to estimating HMM topology and

Autonomous multisensor tracking surveillance system

Detection of objects precisely in video surveillance system is vital for many applications such as abnormal activity detection, congestion analysis, person identification, military fields. For detection of objects, background subtraction and temporal detection methods are used. In background subtraction method moving and static objects which enters into a camera viewing region has been detected. In this method reference frame will be captured during camera initialization. It uses a reference frame as background, detects present frame and takes the difference between two frames. In this paper objects are detected in multiple regions separately from single camera instead of using multiple cameras to monitor different objects in different regions. And also user will have control to select required single or multiple regions to detect the object. This will reduces the overall cost of the system and increases the processing speed of the system if we choose a particular region. Accuracy of the object detection in different regions increases since it allows using different parameters like thresholding separately. So that it monitors different activities at the same time. Also detection of objects based on comparison, object of interest from stored data base is presented using single static camera view with good real time performance.

A real-time object detecting and tracking system for outdoor night surveillance

Object detection and tracking under complex environment are challenging because of the disturbances induced by background clutter, illumination changes, occlusions and other factors. The bulk of traditional algorithms basically rely on hand‐crafted features, which are not sufficiently robust to a complex environment. Moreover, the processes of detection and tracking are separated, which leads to the overall efficiency not high. In this study, a novel local probability model (LPM)‐based mean shift (MS) algorithm is proposed to integrate object detection and tracking. The main contributions include: (i) a new framework based on the combination of LPM and MS is established for the integration of object tracking and detection. (ii) For object detection, the training and prediction of LPM are built by stacked denoising autoencoders based deep learning. (iii) For object tracking, an MS tracking algorithm leveraging LPM is modified to improve the tracking efficiency under a complex environment. Experimental results demonstrate that the proposed method is superior to the colour histograms based MS and histograms of oriented gradients based MS in terms of robustness and tracking accuracy.

This paper presents efficient object tracking in video sequences using multiple features by embedding mean shift into particle filters. When clutter background and occlusions are present. Particle filtering is used because it is very robust and performs well for non-linear and non-Gaussian dynamic state estimation problems. The image features, such as shape, texture, color, contours, and random motion appearance can be used to track the moving object(s) in videos. We proposed a smart video surveillance system with real-time as well as offline stored video database for moving object detection, classification and tracking capabilities. The graphical user interface of the proposed system using MATLAB 2012b is implemented that operates on both color and gray scale video images from a stationary camera. In this method, we proposed real time moving object detection and tracking system using static webcam that can processes 800*600, 640*480, and 320*240 resolution video sequences for capturing live scene as well as stored database of segmented videos. Issues related with object detection and tracking is jointly employed using mean shift and particle filters. Tracker will estimate the dynamic shape and random appearance of objects. Tracking requires location and shape of object in every segmented frame. Rectangular bounding box is used to improve the estimate of its shape and appearance. Target object may experience partial occlusions, intersection with other objects with similar color distributions, abrupt motion speed changes, and cluttered background. Test result shows improvement in terms of robustness, tracking drifts, accuracy of tracked bounding box to occlusions.

Object tracking is a technique for finding moving objects of interest and estimating their trajectory or path with regard to time in a series of images. It involves object representation, detection, and tracking. It becomes an important field of study due to the need in video surveillance, traffic monitoring, live sport video analysis and many other applications. In this paper, both static camera-based and dynamic camera-based object tracking techniques have been developed. The static camera-based object tracking was developed with NI LabVIEW, and Shape adaptive mean-shift algorithm has been used for tracking. In case of dynamic camera-based object tracking, an optimal Fuzzy-PID controller has been designed to adjust the position of the pan/tilt mechanism so as to trace the object’s trajectory. Genetic algorithm (GA) was used to find the optimal values of the operating ranges (scaling factors) of the membership functions. The performance of the system has been tested by different trajectories like step, sinusoidal, circular and elliptical at different frequencies 1, 50 and 100 rad/sec. The system has best performance at low frequencies and when the frequency or speed of the object increases, the system performance decreases which complies for real systems. The simulation results demonstrate that GA tuned Fuzzy-PID controller has given us the best results in terms of reduced steady-state error, faster rise time and settling time, and object position stabilization than PID, Fuzzy and Fuzzy-PID controllers, which shows that optimal Fuzzy-PID controller designed is more appropriate and efficient.

Object tracking in video is a challenging problem in several applications such as video surveillance, video compression, video retrieval, and video editing. Tracking an object in a video is not easy due to loss of information caused by illumination changing in a scene, occlusions with other objects, similar target appearances, and inaccurate tracker responses. In this paper, we present a novel object detection and tracking algorithm via structured output prediction classifier. Given an initial bounding box with its position, we first divide it into sub-blocks with a predefined size. Next, we extract the features from each sub-blocks with Haar-like features method. And then we learn those features with a structured output prediction classifier. We treat the sub-blocks obtained from the initial bounding box as positive samples and then randomly choose negative samples from search windows defined by the specific area around the bounding box. After that, we obtain prediction scores for each sub-blocks both from positive and negative samples. We construct a region-graph with sub-blocks as nodes and classifier’s score as weight to detect the target object in each frame. Our experimental results show that the proposed method outperforms state-of-the-art object tracking algorithms.KeywordsObject DetectionObject TrackingSupport Vector Machine

Background information is crucial for many video surveillance applications such as object detection and scene understanding. In this paper, we present a novel pixel-to-model (P2M) paradigm for background modeling and restoration in surveillance scenes. In particular, the proposed approach models the background with a set of context features for each pixel, which are compressively sensed from local patches. We determine whether a pixel belongs to the background according to the minimum P2M distance, which measures the similarity between the pixel and its background model in the space of compressive local descriptors. The pixel feature descriptors of the background model are properly updated with respect to the minimum P2M distance. Meanwhile, the neighboring background model will be renewed according to the maximum P2M distance to handle ghost holes. The P2M distance plays an important role of background reliability in the 3-D spatial–temporal domain of surveillance videos, leading to the robust background model and recovered background videos. We applied the proposed P2M distance for foreground detection and background restoration on synthetic and real-world surveillance videos. Experimental results show that the proposed P2M approach outperforms the state-of-the-art approaches both in indoor and outdoor surveillance scenes.

Automated event recognition in video data has numerous practical applications for security and transportation. The ability to recognize events in practice depends on precisely detecting and tracking objects of interest in the video data. Numerous factors, such as lighting, weather, camera placement, scene complexity, and data compression can degrade the performance of automated algorithms. As a preprocessing step, developing a set of robust background models can substantially improve system performance. Our object detection and tracking algorithms estimate the object position and attributes within the context of this model to provide more reliable event recognition under challenging conditions. We present an approach to robustly modeling the background as a function of the data acquisition conditions. One element of this approach is automated assessment of the image quality which informs the choice of which background model to use for a given video stream. The video quality model rests on a suite of image metrics computed in real-time from the video, whereas the background models are constructed from historical data collected over a range of conditions. We will describe the formulation of both models. Results from a recent experiment will quantify the empirical performance for recognition of events of interest.