Prediction-based object tracking and coverage in visual sensor networks

Wireless visual sensor network (VSN) can be said to be a special class of wireless sensor network (WSN) with smart-cameras. Due to its visual sensing capability, it has become an effective tool for applications such as large area surveillance, environmental monitoring and objects tracking. Different from a conventional WSN, VSN typically includes relatively expensive camera sensors, enhanced flash memory and a powerful CPU. While energy consumption is dominated primarily by data transmission and reception, VSN consumes extra power onimage sensing, processing and storing operations. The well-known energy-hole problem of WSNs has a drastic impact on the lifetime of VSN, because of the additional energy consumption of a VSN. Most prior research on VSN energy issues are primarily focusedon a single device or a given specific scenario. In this paper, we propose a novel optimal two-tier deployment strategy for a large scale VSN. Our two-tier VSN architecture includes tier-1 sensing network with visual sensor nodes (VNs) and tier-2 network having only relay nodes (RNs). While sensing network mainly performs image data collection, relay network only for wards image data packets to the central sink node. We use uniform random distribution of VNs to minimize the cost of VSN and RNs are deployed following two dimensional Gaussian distribution so as to avoid energy-hole problem. Algorithms are also introduced that optimizes deployment parameters and are shown to enhance the lifetime of the VSN in a cost effective manner.

During the last decade, visual monitoring has gained an increasing interest especially in the field of smart cities and intelligent transportation systems. This paper describes a feature-based vehicle tracking system in visual sensor networks at roundabouts. In the proposed system, the tasks for vehicle tracking are divided among smart camera nodes and the receiver. Smart camera nodes are embedded devices equipped with camera sensor, multiprocessors for video processing and computer vision tasks, and an RF transceiver for wireless communication. They are responsible for the vehicle detection and classification as well as features extraction. In order to satisfy the constraints of the visual sensor network in terms of power and communication resources, we assume that only the features are transmitted to the sink node. The received features will then be used to retrieve the vehicle trajectories. In order to train the vehicle classifier used at the camera nodes and to test the proposed tracking approach, a training database was built by placing cameras around a realworld roundabout. The system is shown to be capable of tracking vehicles even in partial occlusion cases.

Barrier coverage, an important research area with respect to camera sensor networks, consists of a number of camera sensors to detect intruders that pass through the barrier area. Existing works on barrier coverage such as local face-view barrier coverage and full-view barrier coverage typically assume that each intruder is considered as a point. However, the crucial feature (e.g., size) of the intruder should be taken into account in the real-world applications. In this paper, we propose a realistic resolution criterion based on a three-dimensional (3D) sensing model of a camera sensor for capturing the intruder’s face. Based on the new resolution criterion, we study the barrier coverage of a feasible deployment strategy in camera sensor networks. Performance results demonstrate that our barrier coverage with more practical considerations is capable of providing a desirable surveillance level. Moreover, compared with local face-view barrier coverage and full-view barrier coverage, our barrier coverage is more reasonable and closer to reality. To the best of our knowledge, our work is the first to propose barrier coverage for 3D camera sensor networks.

Wireless sensor networks are an important research area that has attracted a lot of attention in the past few years. Most of this attention, however, has focused on wireless sensor network collect scalar data such as temperature and vibration. Scalar data is insufficient for many applications such as video surveillance and traffic monitoring. Whereas, camera sensors collect video data, which are rich in information and offer tremendous potential when used in wireless sensor networks. Video sensor networks continue to gain increase interest due to their ability to collect video information for a wide range of applications in recent years. However, knowledge about these types of networks is mostly related to visual algorithms, leaving the issues such as the coverage of video sensor network and the transmission of video data aside. In this paper, we first highlight the issues and opportunities of video sensor network. And then we discuss key research issue on video sensor network, specifically camera coverage problem, network architecture, and low-power video data processing and communication. Finally, we identify enabling approaches in this area.

In this work, we propose the cubature Kalman filter (CKF) based distributed object tracking algorithm in a visual sensor network (VSN). A VSN consists of several distributed smart cameras having the ability to process and analyze the retrieved data locally. The first objective is to optimize the tracking process within the VSN through the CKF. Under the conditions of non-linear motion and observation model, the CKF based method features a considerably better tracking accuracy than the extended Kalman filter (EKF) based method in terms of the mean square error (MSE). Although, the particle filter (PF) based method shows better performance than the CKF, it is computationally very complex. The second objective is to optimize the object tracking by aggregating the tracking results from multiple cameras. Assuming the VSN is a multi-camera network with overlapping field of views (FOVs), cameras having the same object in their FOV exchange their local estimates of the object's position and velocity. During the estimation process, each of the participating cameras aggregates the received states via a consensus algorithm. Thus, the object's real state is more accurately predicted by the resulting joint state than it would be by processing only a single camera's observation.

A prediction-based approach for features aggregation in Visual Sensor Networks

Directional sensors in wireless visual sensor networks attract growing attention as a promising tool for monitoring the real world; directional sensors consume energy for two main tasks: sensing and communication. Since a VSN contains a number of configurable visual sensors with changeable spherical sectors of restricted angle known as a field of view that is intended to monitor a number of targets located in a random manner over a given area. Therefore maximizing the network lifetime through minimizing power consumption while covering the targets remains a challenge. In this paper, the problem of obtaining a disjoint set cover includes a minimum number of camera sensors is solved. The problem is known to be NP-complete. The sustainable design is improving an existing Iterative Target Oriented Algorithm (ITOA) to cover moving targets move randomly over a given area of deployment starting from entry points reaching to exit ones in a realistic simulation. To evaluate the performance of the modified algorithm, a comparison is provided with three existing algorithms (Iterative centralized Greedy Algorithm (ICGA), Iterative Centralized Forced-directed Algorithm ICFA, and Iterative Target Oriented Algorithm ITOA). Simulation results revealed that the sustainable scheme can find a disjoint set with a minimum number of sensors covers the maximum number of moving targets in an energy-efficient way and extended network lifetime.

Visual Sensor Networks (VSNs), formed by large number of low-cost, small-size visual sensor nodes, represent a new trend in surveillance and monitoring practices. Sensor collaboration is essential to VSNs and normally performed among sensors having similar measurements. The directional sensing characteristics of imagers and the presence of visual occlusion present unique challenges to neighborhood formation, as geographically-close neighbors might not monitor similar scenes. In this paper, we propose the concept of forming semantic neighbors, where collaboration is only performed among geographically-close nodes that capture similar images, thus requiring image comparison as a necessary step. To avoid large amount of data transfer, we propose feature-based image comparison as features provide more compact representation of the image. The paper studies several representative feature detectors and descriptors, in order to identify a suitable feature-based image comparison system for the resource-constrained VSN. We consider two sets of metrics from both the resource consumption and accuracy perspectives to evaluate various combinations of feature detectors and descriptors. Based on experimental results obtained from the Oxford dataset and the MSP dataset, we conclude that the combination of Harris detector and moment invariants presents the best balance between resource consumption and accuracy for semantic neighbor formation in VSNs.

In camera sensor network research, physical camera sensor network platforms with low power and low cost are needed for testing and validating algorithms. It is also necessary that the camera nodes be calibrated precisely. In this work, we first develop and evaluate a low power and low cost wireless camera sensor network platform. The camera sensor nodes in this platform transmit a grayscale image over a wireless channel to a master control station. Then we propose a simple, light-weight algorithm to perform distributed calibration of the camera sensor nodes. The camera sensor nodes use their imaging abilities in collaboration with a cooperative moving target to determine their own positions and orientations. The proposed algorithm requires simple arithmetic calculations and hence it can be realized on low power processors. This calibration algorithm has been implemented and evaluated on the developed physical camera sensor network platform.

When visual sensor networks (VSNs) enter daily life in society, they not only bring great convenience but also cause people to worry about privacy. Traditional image encryption uses the snowflake effect to protect the privacy, but this can compromise the usability of directly browsing images captured by nodes in VSNs. Recently, thumbnail-preserving encryption (TPE) has been proposed to balance image usability and privacy. However, the Markov chain’s limited connectivity and high time cost, which result in low efficiency, may preclude its application in VSNs. Motivated by this, we propose a novel TPE scheme to protect the image collected in VSNs’ privacy efficiently. We first deeply study the bijective relationship between the three-pixel group and its rank, and then propose a new number method for both, based on which we design the efficient rank mapping. Subsequently, an efficient thumbnail-preserving image encryption via three-pixel rank mapping (E-TPE) is designed, achieving NR security and enhancing the Markov chain’s connectivity. The experiments demonstrate the scheme’s efficiency; that is, it is currently the quickest ideal-TPE scheme with NR security, and a good balance is achieved between usability and privacy.

Recent developments in image and video technologies enabled easy access to a new type of sensor-based networks, Visual Sensor Networks (VSN). VSNs are gaining a lot of attention lately. They are used in several applications including surveillance and telepresence. They consist of several low-cost, low-power visual nodes with sensing, data processing, and communication capabilities. These tiny nodes are able to collect large volumes of images, process them, and send extracted data to each other and to the base station for further analysis. Unfortunately, the huge amount of data captured and processed is faced with the limited resources of such platforms. There are several challenges involved with the design and implementation of VSNs. This chapter presents an overview of visual nodes, architectures, and challenges. It also reviews available VSN platforms and compares their processing capabilities, highlighting the need for new lightweight but efficient image processing algorithms and architectures.

Nowadays visual sensor networks are used in emergency or time of surveillance of remote area where human reach is not possible. There situations arise when mobility of nodes is required in visual sensor network. In this paper we considers mobility of visual sensor nodes and tries to maximize the lifetime of network using priority if nodes. We use hierarchical and heterogeneous architecture for deploying nodes. In this we use two types of nodes. On this architecture we use prioritized scheduling technique to maximize the lifetime of network. Result shows lifetime is increased compare to the stationary nodes as after same time we get more live sensors than stationary system.

Recently much research has been conducted in visual sensor networks. Compared to traditional sensor networks, vision networks differ in various aspects such as the amount of data to be processed and transmitted, the requirements on quality-of-service, and the level of collaboration among the sensor nodes. This paper deals with sensor fusion on visual sensor networks. We focus here on methods for fusing data from various distributed sensors and present a generic framework for fusion on embedded sensor nodes. This paper extends our previous work on distributed smart cameras and presents our approach toward the transformation of smart cameras into a distributed, embedded multisensor network. Our generic fusion model has been completely implemented on a distributed embedded system. It provides a middleware which supports automatic mapping of our fusion model to the target hardware. This middleware features dynamic reconfiguration to support modification of the fusion application at runtime without loss of sensor data. The feasibility and reusability of the I-SENSE concept is demonstrated with experimental results of two case studies: vehicle classification and bulk good separation. Qualitative and quantitative benefits of multilevel information fusion are outlined in this article.

Aiming at the complexity of the network transmission environment and the decentralization of the monitoring sites in the middle route of the South to North Water Diversion Project, this article presents a water conservancy monitoring architecture based on the visual sensor networks. First, a network assessment method is proposed to evaluate the sensor networks condition, and the encoder is adjusted with the result of the sensor networks condition evaluation. Then, based on distributed database architecture and visualization system construction, a three-level structure of the water conservancy monitoring system is designed and built. The experiment results show that the water conservancy monitoring system proposed in this article meets the transmission requirement under the complex sensor networks condition of water conservancy project. The water conservancy monitoring system has been applied to the middle route of the South to North Water Diversion Project, which achieves the needs of engineering applications.

Multi-tier topology model is an appropriate choice to accomplish the application-specific tasks in many wireless visual sensor networks. In a general multi-tier architecture, the first tier is composed of scalar nodes. This tier activates the camera nodes of the second tier within its communication range only when it is necessary. However, in many cases the activated camera nodes do not detect any events because of the directionality of their sensing range. In this paper, we present field of view clustering as a new clustering method to reduce the unneeded visual activations of camera nodes and overcome the waste of energy. We also improve this clustering method by presenting a solution named Random Neglect. As the simulation results indicate, our proposed solutions are successful in saving the energy of camera nodes and prolonging network lifetime while providing high detection performance.