Design and implementation of pedestrian detection system based on video image

Anomaly detection in crowd surveillance videos is a critical task for ensuring public safety and security. In this research paper, we propose a comprehensive framework for anomaly detection using deep learning techniques, specifically Recurrent Neural Networks (RNNs), Convolutional Neural Networks (CNNs), and Generative Adversarial Networks (GANs). Our objective is to narrow the gap between computational complexity and detection effectiveness while satisfying the demand for explainability in anomaly detection systems. The proposed framework leverages the UCSD Ped2 dataset and focuses on incorporating spatial constraints to enhance anomaly detection performance. We introduce novel approaches for feature extraction and anomaly detection using GANs, aiming to capture essential spatial and temporal information while reducing computational complexity. Specifically, we develop encoders within the GAN framework to map input data to a lower-dimensional latent space and perform anomaly detection based on the similarity between latent codes. Through extensive experimentation and evaluation, we compare the performance of RNNs, CNNs, and GANs in detecting anomalies in crowd surveillance videos. Various evaluation metrics, including precision, recall, F1 score, ROC-AUC, and PR-AUC, is considered to assess the effectiveness of each approach. Additionally, they studied hyperparameters such as learning rate, batch size, network architecture, and GAN-specific parameters to optimize anomaly detection performance. Our results demonstrate the usefulness of the proposed framework in achieving robust and explainable anomaly detection in crowd surveillance videos. By combining advanced deep learning techniques with spatial constraints and explainability considerations, our research contributes to the development of more reliable and interpretable anomaly detection systems for real-world applications.

The goal of this special issue was to bring together experts working on applying models, principles, and knowledge of human audio-visual perception and cognition to optimize video processing algorithms and applications. This is an area where our deeper understanding of visual perception to video processing will lead to new breakthroughs in visual information processing. Attentional focus is an important aspect of perception that helps understand user interest and intent. Determining points of saliency is computationally complex. Compressed-domain methods thus become valuable tools for developing computationally efficient and practical solutions. In BCompressed-Domain Correlates of Human Fixations in Dynamic Scenes^ (10. 1007/s11042-015-2802-3) authors present a method for detecting points of fixation in H.264/ AVC video using motion vectors, block coding modes and coded residuals parsed from a H. 164/AVC bitstream. Egocentric videos are captured usingwearable cameras and used to detect a wearer’s point of view. Amount of video captured using wearable cameras is increasing and saliency detection in such videos enables applications such as efficient video summarization. In BGeometrical Cues in Visual Saliency Models for Active Object Recognition in Egocentric Videos^ (10.1007/ s11042-015-2803-2) authors use geometrical cues to improve saliency detection in videos. Action recognition from videos is a challenging task with many applications including surveillance and social behavior understanding. Inspired by models of neural response to visual input, the paper entitled BDeep Learning Human Actions from Video via Sparse Filtering and Locally Competitive Algorithms^ (10.1007/s11042-015-2808-x) presents a method that combines sparse filtering with locally competitive algorithms for applications in action recognition. Multimed Tools Appl (2015) 74:10053–10056 DOI 10.1007/s11042-015-2957-y

We propose an end-to-end system for text detection and recognition in natural scenes and consumer videos. Maximally Stable Extremal Regions which are robust to illumination and viewpoint variations are selected as text candidates. Rich shape descriptors such as Histogram of Oriented Gradients, Gabor filter, corners and geometrical features are used to represent the candidates and classified using a support vector machine. Positively labeled candidates serve as anchor regions for word formation. We then group candidate regions based on geometric and color properties to form word boundaries. To speed up the system for practical applications, we use Partial Least Squares approach for dimensionality reduction. The detected words are binarized, filtered and passed to a hidden Markov model based Optical Character Recognition (OCR) system for recognition. We show significant improvement in text detection and recognition tasks over previous approaches on a large consumer video dataset. Furthermore, the event detection system built upon the OCR output of this approach outperformed multiple other OCR-only based submissions in the recently concluded NIST TRECVID 2013 multimedia event detection evaluations.

This paper presents a robust adaptive moving human detection and recognition method in videos. The human detection method consists of modified moving average background model with supportive secondary model and an adaptive threshold selection model based on Gaussian distribution. The moving average background model is used for background modeling and the background subtraction system is used to provide foreground image through difference image between current image and background model. The adaptive threshold method is used to simultaneously update the system to environment changes. The modified human model consists of five parts with robust features to facilitate human recognition process. For recognition purpose Support Vector Machine has been used as classifier. Experimental results show the effectiveness of proposed system.

This paper presents a high-spatial-resolution dataset with remote sensing images of the Brazilian Cerrado for land use and land cover classification. The Biome Cerrado Dataset (CerraData) is a large database created from 150 scenes of the CBERS-4A satellite. Images were created by merging the near-infrared, green, and blue bands. Moreover, pan-sharpening was performed between all the scenes and their respective panchromatic bands, resulting in a final spatial resolution of two meters. A total of 2.5 million tiles of 256x256 pixels were derived from these scenes. From this total, 50 thousand tiles were labeled. We also conducted a few-shot learning experiment considering a training set with only 100 samples, 11 deep neural networks (DNNs), and two traditional machine learning (ML) algorithms, i.e., support vector machine (SVM) and random forest (RF). Results show that the DNN DenseNet-161 was the best model but its performance can be improved if it is used only as a feature extractor, leaving the classification task for the traditional ML algorithms. However, by decreasing the size of the training set, smarter approaches are needed. The labeled subset of CerraData as well as the source code we developed to support this study are available on-line: https://github.com/ai41uc/CerraData-code-data.

An exhaustive measurement of re-sampling detection in lossy compressed images using deep learning approach

As a research hotspot in the field of current computer vision, pedestrian detection is widely applied to many fields, such as video surveillance and autonomous driving. However, the accuracy of pedestrian detection under video surveillance is poor, and the miss rate of small target pedestrians is high. In this paper, an improves the YOLOv3 algorithm and a YOLOv3-Multi pedestrian detection model had been proposed. First, referring to the residual structure of DarkNet, the shallow features and deep features had been up-sampled and connected to obtain a multi-scale detection layer. Then, according to different special detection categories, the spatial pyramid pool (SPP) is introduced to strengthen the detection of small targets. The experimental results show that our method improves the average accuracy by 2.54%, 6.43% and 8.99%compared with YOLOv3, SSD and YOLOv2 on the VOC dataset.

In this paper we proposed a new method for pedestrian detection in images and videos. Our method uses a sliding window to search through images. In order to extract the features, each window is divided into overlapping cells and features are extracted from them. The feature that we extracted to describe each window is based on analysis of gradient distribution of each cell. After gradient distribution of a cell computed, the PCA is applied on it and using a mathematical expression that gauges the attitude of edges we got the feature of the cell. Putting the features of the cells next to each other forms the feature vector of the window. Then, the extracted features are classified using Support Vector Machine (SVM). Finally, the learned SVM model tested on the INRIA pedestrian dataset. The proposed method was compared with Histograms of Oriented Gradient (HOG) approach and the results show that our method has comparable detection accuracy as well as having more robustness when facing with noise.

Text detection and recognition in scene images and videos attract much attention in computer vision recently. However, most existing text detection and recognition methods only focus on static images. In this paper an end-to-end scene text recognition method based on multi frame tracking is proposed for text in videos, in which temporal information is employed to improve performance. First, an end-to-end text recognition method based on a unified deep neural network is used to detect and recognize text in each frame of the input video. Then, multi frame text tracking is employed through associations of texts in current frame and several previous frames to obtain final results. Experiments on ICDAR datasets demonstrate that the proposed method outperforms the state-of-the-art methods in end-to-end video text recognition.

In the field of computer vision, pedestrian detection is a significant research area that is frequently applied in areas like intelligent driving and video surveillance. The reliability and accuracy of subsequent tasks like pedestrian tracking and behavior analysis are directly impacted by the accuracy and effectiveness of pedestrian detection. However, there are still a number of difficulties with pedestrian detection tasks because of the variety of factors, including the shape, scale, and posture of pedestrians, as well as background interference and changes in lighting. Based on research on pertinent domestic and international literature, this article examines the key techniques for identifying pedestrians. Introduce frequently used datasets for pedestrian detection first. The model can then be split into two categories based on its training process: one-stage detection algorithms and two-stage detection algorithms. For each stage type, this study offers a thorough introduction to representative algorithms. A summary of its current state of development and future prospects was then given.

Though Faster R-CNN based two-stage detectors have witnessed significant boost in pedestrian detection accuracy, they are still slow for practical applications. One solution is to simplify this working flow as a single-stage detector. However, current single-stage detectors (e.g. SSD) have not presented competitive accuracy on common pedestrian detection benchmarks. Accordingly, a structurally simple but effective module called Asymptotic Localization Fitting (ALF) is proposed, which stacks a series of predictors to directly evolve the default anchor boxes of SSD step by step to improve detection results. Additionally, combining the advantages from residual learning and multi-scale context encoding, a bottleneck block is proposed to enhance the predictors' discriminative power. On top of the above designs, an efficient single-stage detection architecture is designed, resulting in an attractive pedestrian detector in both accuracy and speed. A comprehensive set of experiments on two of the largest pedestrian detection datasets (i.e. CityPersons and Caltech) demonstrate the superiority of the proposed method, comparing to the state of the arts on both the benchmarks.

Three-phase induction motors (IMs) are one of the most employed electric machines in industrial and household applications. Condition monitoring of these machines is essential to avoid unplanned maintenance and thereby enhance the availability. Artificial Intelligence (AI) technologies are emerging as an advanced tool for automating condition monitoring process to detect incipient faults at early stages. Machine Learning (ML) algorithms have been identified as a promising approach for condition monitoring of IMs and predicting maintenance to avoid failures. However, selecting the suitable ML algorithm for a given application is challenging because there is no predefined set of application-based algorithms. In addition, raw data processing and feature selection need careful attention to improve the accuracy of the results. This paper reviews supervised ML algorithms that can be used for condition monitoring of IMs and identifies their benefits and drawbacks. It then discusses how the dominant features from raw data can be selected through time domain and frequency domain analysis using the acoustic data collected from a three-phase induction motor. The study investigates classification accuracy of each ML algorithm and a procedure for selecting an algorithm based on the experimental results. Results of this study show that Support Vector Machines (SVM) algorithm outperforms other competing algorithms in condition monitoring of IMs when the dominant frequency components obtained through Fast Fourier Transform (FFT) are used as training data.

Pedestrian detection technology is the use of computer vision technology to determine whether there are pedestrians in static images or video images, and accurately mark pedestrians. Intelligent vehicles, intelligent monitoring, human behaviour analysis and other aspects are related to pedestrian detection technology, so pedestrian detection technology has been widely concerned by all walks of life. However, in some application environments, the network setting is flexible and the location of the device can be changed at any time, so it is difficult to establish a pedestrian detection system by wired way, and the pedestrian detection system can only be established through WSN. It is necessary to consider how to complete pedestrian detection through intelligent terminal under the condition of limited computing power. Many researchers have put forward a lot of algorithms, which are constantly optimized, but there are still many problems to be solved in practical application. In this paper, aiming at the intelligent terminal in WSN environment with limited computing power, a pedestrian detection system based on HOG+SVM is designed, which can detect moving pedestrians in video in real time. The detection system is mainly composed of detection algorithm and video acquisition module. After the test of INRIA and CVC data set, the accuracy of the detection algorithm in this paper is 89.06%. This method is tested under the intelligent terminal with limited computing power, with a good detection effect.

Prediction of steam/water stratified flow characteristics in NPPs transients using SVM learning algorithm with combination of thermal-hydraulic model and new data mapping technique

For real applications of pedestrian detection, both detection speed and detection accuracy are important. In this paper we propose a detector based on effective comparison features (ECFs) for simultaneously improving detection accuracy and speed. ECFs are defined as the features helping to improve actual performance. Using only these ECFs as feature candidates for the split nodes of decision trees, our detector can achieve accurate results. As an additional benefit, detection speed is improved by earlier rejection of negative samples. Experiments are conducted using well-known benchmark datasets for pedestrian detection. The experimental results of our ECF detector show that our detection speed is 1–2 orders of magnitude faster than the speed of state-of-the-art algorithms, with comparable detection accuracy.