A Survey on Object Detect, Track and Identify Using Video Surveillance

Many researchers are getting attracted in the field of object tracking in video surveillance, which is an important application and emerging research area in image processing. Video tracking is the process of locating a moving object or multiple objects over a time using camera. Due to key features of video surveillance, it has a variety of uses like human-computer interactions, security and surveillance, video communication, traffic control, public areas such as airports, underground stations, mass events, etc. Tracking a target in a cluttered premise is still one of the challenging problems of video surveillance. A sequential flow of moving object detection, its classification, tracking and identifying the behavior completes the processing framework of video surveillance. This paper takes insight into tracking methods, their categorization into different types, focuses on important and useful tracking methods. In this paper, we provide a brief overview of tracking strategies like region based, active contour based, etc with their positive and negative aspects. Different tracking methods are mentioned with detailed description. We review general strategies under literature survey on different techniques and finally stating the analysis of possible research directions.

Autonomous multisensor tracking surveillance system

Video surveillance is one of the most active research topics in the computer vision due to the increasing need for security. Although surveillance systems are getting cheaper, the cost of having human operators to monitor the video feed can be very expensive and inefficient. To overcome this problem, the automated visual surveillance system can be used to detect any suspicious activities that require immediate action. The framework of a video surveillance system encompasses a large scope in machine vision, they are background modelling, object detection, moving objects classification, tracking, motion analysis, and require fusion of information from the camera networks. This paper reviews recent techniques used by researchers for detection of moving object detection and tracking in order to solve many surveillance problems. The features and algorithms used for modelling the object appearance and tracking multiple objects in outdoor and indoor environment are also reviewed in this paper. This paper summarizes the recent works done by previous researchers in moving objects tracking for single camera view and multiple cameras views. Nevertheless, despite of the recent progress in surveillance technologies, there still are challenges that need to be solved before the system can come out with a reliable automated video surveillance.

Now a day, video surveillance has gained the most attention in real-time applications. Because of the improvement in domain of machine learning, various methodologies have been designed for multi-object detection. The real-time surveillance systems are the need of various organization as security; hence, this area of research has important. This paper introduces a new methodology for Moving object detection. In the area of real-time video surveillance systems, multi-object detection and object tracking are an important step in video processing. The moving system is critical for many of the application such as operational robot, surveillance systems in military. These real-time surveillance systems are more useful for intelligence gathering, security issues, and many personal needs. Different techniques are used for this task and research is vastly done to make this system automated and to make it reliable. In this research, subjective quality assessment of object detection and object tracking is discussed in detail. In the proposed system, the background subtraction is done from the clean original image and use of CNN with this. We have applied background subtraction method with different filtering algorithms. We have implemented and tried MoD2 and KNN algorithm on the test video and fetched the foreground image. After this, we have applied CNN to track the object. After tracking the objects, we have found out the accuracy with background subtraction method and without background subtraction method. The proposed system improved by approximately 2% as compared to existing techniques.

UTOMATED video surveillance addresses real-time observation of people and vehicles within a busy environment, leading to a description of their actions and interactions. The technical issues include moving object detection and tracking, object classification, human motion analysis, and activity understanding, touching on many of the core topics of computer vision, pattern analysis, and aritificial intelligence. Video surveillance has spawned large research projects in the United States, Europe, and Japan, and has been the topic of several international conferences and workshops in recent years. There are immediate needs for automated surveillance systems in commercial, law enforcement, and military applications. Mounting video cameras is cheap, but finding available human resources to observe the output is expensive. Although surveillance cameras are already prevalent in banks, stores, and parking lots, video data currently is used only “after the fact” as a forensic tool, thus losing its primary benefit as an active, real-time medium. What is needed is continuous 24-hour monitoring of surveillance video to alert security officers to a burglary in progress or to a suspicious individual loitering in the parking lot, while there is still time to prevent the crime. In addition to the obvious security applications, video surveillance technology has been proposed to measure traffic flow, detect accidents on highways, monitor pedestrian congestion in public spaces, compile consumer demographics in shopping malls and amusement parks, log routine maintainence tasks at nuclear facilities, and count endangered species. The numerous military applications include patrolling national borders, measuring the flow of refugees in troubled areas, monitoring peace treaties, and providing secure perimeters around bases and embassies. The 11 papers in this special section illustrate topics and techniques at the forefront of video surveillance research. These papers can be loosely organized into three categories. Detection and tracking involves real-time extraction of moving objects from video and continuous tracking over time to form persistent object trajectories. C. Stauffer and W.E.L. Grimson introduce unsupervised statistical learning techniques to cluster object trajectories produced by adaptive background subtraction into descriptions of normal scene activity. Viewpoint-specific trajectory descriptions from multiple cameras are combined into a common scene coordinate system using a calibration technique described by L. Lee, R. Romano, and G. Stein, who automatically determine the relative exterior orientation of overlapping camera views by observing a sparse set of moving objects on flat terrain. Two papers address the accumulation of noisy motion evidence over time. R. Pless, T. Brodský, and Y. Aloimonos detect and track small objects in aerial video sequences by first compensating for the self-motion of the aircraft, then accumulating residual normal flow to acquire evidence of independent object motion. L. Wixson notes that motion in the image does not always signify purposeful travel by an independently moving object (examples of such “motion clutter” are wind-blown tree branches and sun reflections off rippling water) and devises a flow-based salience measure to highlight objects that tend to move in a consistent direction over time. Human motion analysis is concerned with detecting periodic motion signifying a human gait and acquiring descriptions of human body pose over time. R. Cutler and L.S. Davis plot an object’s self-similarity across all pairs of frames to form distinctive patterns that classify bipedal, quadripedal, and rigid object motion. Y. Ricquebourg and P. Bouthemy track apparent contours in XT slices of an XYT sequence volume to robustly delineate and track articulated human body structure. I. Haritaoglu, D. Harwood, and L.S. Davis present W4, a surveillance system specialized to the task of looking at people. The W4 system can locate people and segment their body parts, build simple appearance models for tracking, disambiguate between and separately track multiple individuals in a group, and detect carried objects such as boxes and backpacks. Activity analysis deals with parsing temporal sequences of object observations to produce high-level descriptions of agent actions and multiagent interactions. In our opinion, this will be the most important area of future research in video surveillance. N.M. Oliver, B. Rosario, and A.P. Pentland introduce Coupled Hidden Markov Models (CHMMs) to detect and classify interactions consisting of two interleaved agent action streams and present a training method based on synthetic agents to address the problem of parameter estimation from limited real-world training examples. M. Brand and V. Kettnaker present an entropyminimization approach to estimating HMM topology and

In this paper we propose multiple cameras using real time tracking for surveillance and security system. It is extensively used in the research field of computer vision applications, like that video surveillance, authentication systems, robotics, pre-stage of MPEG4 image compression and user inter faces by gestures. The key components of tracking for surveillance system are extracting the feature, background subtraction and identification of extracted object. Video surveillance, object detection and tracking have drawn a successful increased interest in recent years. A object tracking can be understood as the problem of finding the path (i.e. trajectory) and it can be defined as a procedure to identify the different positions of the object in each frame of a video. Based on the previous work on single detection using single stationary camera, we extend the concept to enable the tracking of multiple object detection under multiple camera and also maintain a security based system by multiple camera to track person in indoor environment, to identify by my proposal system which consist of multiple camera to monitor a person. Present study mainly aims to provide security and detect the moving object in real time video sequences and live video streaming. Based on a robust algorithm for human body detection and tracking in videos created with support of multiple cameras.

One of the major threats to the Extra High Voltage (EHV) transmission lines is the external force or intrusion incurred by construction trucks especially a truck crane. Several accidents occurred when the truck crane drove into the area under transmission lines and stretch its arm (jib) which broke the lines. In this paper, a video surveillance system is proposed for detecting and tracking truck cranes. By using the codebook algorithm, the foreground objects are detected and then cranes can be recognized by using a Gaussian mixture model. A Kalman filter based tracking algorithm is invoked to monitor the movement of the crane. The jib of the crane is then detected by using a set of combined criterions as well as its extension angle is computed by using Hough transform. If the crane is parked over a certain period of time, or the jib extension angle exceeds predefined thresholds, the remote acousto-optic alarm system will be activated to deliver an alarm signal to the operators of truck crane. The preliminary experiments showed that the system is able to achieve automatic detection of truck cranes.

This chapter presents a novel MoG based method for foreground detection and segmentation in video surveillance. Normal MoG is difficult to deal with the foreground objects stay in the scene for a long time and segment different foreground objects from one blob. We improve MoG by adopting posterior feedback information of object tracking based on statistics to robustly modeling the background and to perfect the foreground segmentation result. Experiments and comparisons show that our method is robust and accurate for detecting foreground object in video surveillance.

Detecting moving objects by using an adaptive background model is a critical component for many vision-based applications. In this paper, we propose a novel background modeling algorithm for traffic video surveillance based on objects dynamicity. Our algorithm is based on the definition of background as a set of static objects and on the observation that a static object is a set of pixels having the same appearance in long time interval. The normalized RGB color is used to describe the appearance under change lighting conditions, and a binary label is introduced to capture the dynamicity of objects over time. Finally, the cardinality function, calculated in each continued time period, is used to select persistent appearance corresponding to background objects. An update formula is proposed to reconstruct background model periodically based on current frame and last background image. Experimental results from several video sequences validate the effectiveness of the proposed algorithm

This chapter introduces intrinsic camera calibration with focus on video surveillance. Calibration of camera-specific parameters such as the focal length is mandatory for metrological problems, for example, measuring a vehicle’s speed. However, it also improves target classification, target detection, and target tracking. Geometry has become important in multi-camera systems that hand over and track objects across cameras. We present the basic geometric concept behind calibration and show which information about the cameras, the scene, and the images is necessary to realize automatic methods. Self-calibration will be a key technology for the practical deployment of future smart video cameras.

Recently, in computer vision and video surveillance applications, moving object recognition and tracking have become more popular and are hard research issues. When an item is left unattended in a video surveillance system for an extended period of time, it is considered abandoned. Detecting abandoned or removed things from complex surveillance recordings is challenging owing to various variables, including occlusion, rapid illumination changes, and so forth. Background subtraction used in conjunction with object tracking are often used in an automated abandoned item identification system, to check for certain pre-set patterns of activity that occur when an item is abandoned. An upgraded form of image processing is used in the preprocessing stage to remove foreground items. In subsequent frames with extended duration periods, static items are recognized by utilizing the contour characteristics of foreground objects. The edge-based object identification approach is used to classify the identified static items into human and nonhuman things. An alert is activated at a specific distance from the item, depending on the analysis of the stationary object. There is evidence that the suggested system has a fast reaction time and is useful for monitoring in real time. The aim of this study is to discover abandoned items in public settings in a timely manner.

Aiming at the problems of large parameter capacity and heavy dependence on acceleration framework for complex target detection and tracking model, the conversion method between artificial neural network and impulse neural network is studied in this work to implement target detection and tracking task based on the spiking neural network. Firstly, the convolution modules Alexnet, vgg11-5c and vgg16-8c of the full convolution twin network Siamese-FC are properly adjusted and cut to adapt with the characteristics and limitations of impulse neurons, and then the Norm-SiamFC network model is constructed and trained. Finally, the migration parameters are adopted to construct a spiking network Spiking-SiamFC for object detection and tracking, which achieves good tracking effect and occupies less resources, thus the model can be widely utilized in edge devices with limited resource storage capacity.

In the efforts to fight crimes and terrorism, governments install video surveillance equipment that works like thousands of eyes in airports, ports, major roadways, government buildings, and important facilities. However, such kinds of surveillance system were hardware dependence and high budget for the installation. This paper is addressed to the development of the web-based real-time video surveillance framework. The proposed real-time many-to-many surveillance system can provide users to dynamically plug in their digital photographic equipments, such as web camera and CCTV (digital video) through the Internet without the installation of extra software. The constructed system also achieves an adjustable motion detection facility which can trigger the video recording and the real-time e-mail notification via PC or 3G mobile message.

In this paper an uncooled infrared camera with embedded target detection and tracking capability is presented. The camera is built upon four main electronic cards. Sensor card is designed to read and digitize the analog output signal generated by the infrared (IR) imaging sensor. FPGA card carries out the control process of the data transfer between sensor card and other peripherals. Target detection/tracking task is on the row image data provided by the FPGA card is carried out on the DSP card. Frame thresholding and differencing methods are used for target detection. Kalman filter is utilized for target tracking. According to the experimental results, camera is capable of performing target detection and tracking tasks in real time.

With the continuous deepening of economic globalization and the continuous development of Internet big data, the spread of martial arts culture has attracted people’s attention. The advent of the Internet big data era has brought new opportunities and media for the dissemination of martial arts culture but also brought certain risks and challenges. This paper firstly uses the literature method, logical analysis method, and related theories of communication, with the help of the SWOT strategic analysis method, to analyze the internal advantages and disadvantages faced by martial arts culture communication itself, as well as the external opportunities in the context of the Internet big data era and challenges. In order to realize the target detection and tracking task of Martial athletes, this paper proposes a target detection and tracking algorithm for Martial athletes. First, the algorithm constructs and trains a fully CNN-based athlete target detection model, which can detect the first frame of athlete targets in martial arts competitions or martial arts training videos. Experiments show that the athlete positioning information output by the detection model and the video frame sequence are jointly input into the athlete target tracking module based on neighborhood similarity, so as to realize the target tracking of martial arts athletes.