Variational Abnormal Behavior Detection With Motion Consistency.

We propose a method to detect abnormal crowd behavior using integrated multiple behavior models. Traditional abnormal detection methods are based only on personal behavior models. However, a single behavior model cannot accurately reflect complex crowd behavior. To solve this problem, we introduce an integrated multiple behavior model for accurate abnormal behavior detection in a complex crowd scene. We use not only the personal behavior model, but also multiple social behavior models. The experimental results show that our proposed method efficiently detects the abnormal behavior in a crowded scene.

As society develops, the demand for security is rapidly increasing. Accordingly, there is growing interest in research on methods to detect and prevent abnormal behavior using surveillance cameras in public places and private spaces such as shopping malls and airports for human safety. Many detection techniques based on deep learning models have been researched in the field of abnormal behavior detection. However, due to the lack of labeled abnormal behavior data, there are significant difficulties in developing an effective detection system. This paper surveys methods for deep learning methods to detect abnormal human behavior in surveillance video and presents recent techniques. First, I will introduce popular datasets that have often been used in previous research. After that, we categorized the existing methods for detecting abnormal behavior using deep learning into three types: supervised learning, unsupervised learning, and partially-supervised learning. We then explained the basic concepts and advantages of each method and summarized their shortcomings. We also briefly describe future research directions based on the advantages and disadvantages of each method. Based on this, it is expected that the technology of video surveillance systems that apply abnormal behavior detection will further develop.

Artificial features are adopted in most of the existing abnormal behavior detection. However, it is difficult to choose and design an effective behavior feature for the reason of highly computational complexity and complex scenarios. To solve this problem, temporal consistency based weak supervised abnormal behavior detection method is proposed in this paper. First, temporal gram matrices are constructed for a given video sequence. Then, a pair of behavior units (Candidate action fragment) are formed by exploiting the temporal consistency and the smoothness of human behavior, which helps to locate the start frame and end frame of the related class of abnormal behavior in the video sequence to train the corresponding classifier. Finally, sparse reconstruction is here utilized to detect abnormal behavior. Experiments conducted on common database including CAVIAR and Crossing demonstrate the effectiveness of the proposed method.

Abnormal behaviour detection is crucial given the reliance on video surveillance for public safety. However, most vision-based methods fail to adapt to the variability and complexity of the crowd scenes inherent in real-world scenarios. This study introduced an abnormal crowd behaviour detection algorithm based on lightweight Graphic Neural Networks (GNNs) using trajectory similarities and spatial-temporal attributes. Integrating Graph Attention Networks (GATs) to encode the graph structure, creating latent embeddings that capture both local and global relationships within crowds. Also introducing an autoencoder (AE) structure to identify anomalies by comparing true movement with the decoded output. Anomaly is detected when the reconstruction error is high. Experiments on UCSD Pedestrians and ShanghaiTech campus datasets show the successful use of trajectory similarities as graph features for GNNs to generate logical embeddings of crowd movement and highlight the impact of time windows on anomaly detection precision as reflected in F1-scores. The Area Under the Curve (AUC) metric shows stability, highlighting the model’s balanced performance. Qualitative analysis of the ShanghaiTech campus dataset illustrates the model’s ability to align detection with visual anomalies. Overall, this study demonstrates the effectiveness of the proposed graph-based anomaly detection framework for crowd monitoring through a lightweight model suitable for CCTV.

In this paper; we propose a novel crowd behavior representation method to detect abnormal behaviors in videos. An adaptive optical flow filtering method is proposed to utilize low-level optical flow informations. Furthermore, a simple framework is developed to detect and to localize abnormal crowd behavior using adaptive optical flow filtering result. The proposed method is more robust than other modeling methods in representing different behaviors. In this model, a normal behavior is presented by the general value. Some outliers in the temporal domain or spatial domain are presented by a higher value. Spatio-temporal cuboids are extracted from the filtering result to present the likelihood of anomaly in the frame. Experimental evaluations are performed on two public datasets with comparison to the provisos abnormal behavior detection methods in the literature. Experimental results show that the proposed methods outperform previous abnormal behavior detection techniques in the literature.

Video abnormal behavior detection is an important research direction in the field of computer vision and has been widely used in surveillance video. This paper proposes an abnormal behavior detection model based on human skeletal structure and recurrent neural network, which uses dynamic skeletal features for abnormal behavior detection. The model in this paper extracts key points from multiple frames through the human pose estimation algorithm, obtains human skeleton information, and inputs it into the established autoencoder recurrent neural network to detect abnormal human behavior from video sequences. Compared with traditional appearance-based models, our method has better anomaly detection performance under multi-scene and multi-view.KeywordsAbnormal behavior detectionGRUAutoencoderSkeletal information

The world population continues to grow. The size of gatherings at various venues under different circumstances is tremendously increasing. Any mass assembly has potential risk of the lethal crowd disaster. The various algorithms in computer vision techniques are being developed as a part of proactive system for crowd management. This paper presents novel approach to identify abnormal crowd behavior. The algorithm employedoptical flow method to estimate displacement vectors of moving crowd and computation of crowd motion energy. The crowd motion energy was further modified by crowd motion intensity (CMI). The peaks in the CMI characteristics were the indicators of abnormal activity and were detected more accurately by applying threshold. The algorithm has been tested on standard UMN dataset with an average accuracy of 91.66 percentages. The accuracy has been improved with application of threshold. Adaptive threshold may aid to further improve the performance of algorithm.

A novel automatic detection method for abnormal behavior of single fish using image fusion

This paper proposes a new algorithm for abnormal behavior detection in surveillance video. Firstly, the motion information image of each frame is constructed by calculating the optical flow size and the angle difference between the optical flow vectors between consecutive frames, and then the obtained motion image information is input into the convolutional neural network (CNN) for training, and used for video abnormal behavior detection. In the algorithm, the motion information image generated based on optical flow information can provide the motion information features in the video image more accurately, which makes it easier to distinguish the normal behavior and abnormal behavior of the video. The experiment of this algorithm is carried out on the commonly used data set PETS 2009. Experimental results show that the proposed method and other algorithms have a significant improvement in the accuracy of abnormal behavior detection.

Abnormal behavior detection in surveillance videos based on deep learning has becomea hot topic in current research. However, due to the complexity and variability of crowd movement and external environment, detecting abnormal behavior faces great challenges. Current abnormal behavior recognition models have limitations in feature extraction and pay insufficient attention to dynamic temporal features. To address these problems, a spatiotemporal enhancement anomaly detection method based on multi-channel coupling is proposed. Based on the SlowFast network, a multi-channel coupled temporal enhancement module and a spatial enhancement module are introduced respectively to extract more discriminative static and dynamic feature information. A large number of experiments are carried out on three benchmark datasets (Violent Flow, Hockey Fight, and Real-life Violence Situations). The results show that the prediction accuracy of the proposed abnormal behavior recognition method reaches 95.3%、97.3%and respectively 94%, thus verifying the effectiveness of the method.

Modeling abnormal behavior detection in the intelligent video monitoring system for recognition or detection of special event has attracted significant research interest in recent years. In order to achieve more effective recognition of abnormal behavior detection of the intelligent video surveillance system, this paper proposes a working human abnormal operation recognition approach based on deep multi-instance sorting model. Firstly, the uncut long video is sparse to obtain normal and abnormal behavior video segments, and the RGB and optical flow features in the segment are extracted by the deep convolution network. Video feature vectors are obtained by the consensus function and feature extractor. Then, multi-instance sorting learning is used to assign abnormality scores between 0 and 1 to feature vectors. When the abnormal values of abnormal packets are higher than those of normal packets, the abnormality score is returned and the high abnormality score is determined as an abnormal behavior. The experiments on the open THUMOS14 data set and our own XAGCWD data set using CUDA GPU accelerated computing to demonstrate that our approach improves the recognition accuracy about 10.8% and high accuracy of abnormal detection. The main purpose of this research is to apply the model proposed in this paper to the intelligent workshop behavior monitoring system to effectively realize the safety management of workshop personnel.

Amid rapid advancements in artificial intelligence, the detection of abnormal human behaviors in complex traffic environments has garnered significant attention. However, detection errors frequently occur due to interference from complex backgrounds, small targets, and other factors. Therefore, this paper proposes a research methodology that integrates the anomaly detection YOLO-SGCF algorithm with the tracking BoT-SORT-ReID algorithm. The detection module uses YOLOv8 as the baseline model, incorporating Swin Transformer to enhance global feature modeling capabilities in complex scenes. CBAM and CA attention are embedded into the Neck and backbone, respectively: CBAM enables dual-dimensional channel-spatial weighting, while CA precisely captures object location features by encoding coordinate information. The Neck layer incorporates GSConv convolutional modules to reduce computational load while expanding feature receptive fields. The loss function is replaced with Focal-EIoU to address sample imbalance issues and precisely optimize bounding box regression. For tracking, to enhance long-term tracking stability, ReID feature distances are incorporated during the BoT-SORT data association phase. This integrates behavioral category information from YOLO-SGCF, enabling the identification and tracking of abnormal pedestrian behaviors in complex environments. Evaluations on our self-built dataset (covering four abnormal behaviors: Climb, Fall, Fight, Phone) show mAP@50%, precision, and recall reaching 92.2%, 90.75%, and 86.57% respectively-improvements of 3.4%, 4.4%, and 6% over the original model-while maintaining an inference speed of 328.49 FPS. Additionally, generalization testing on the UCSD Ped1 dataset (covering six abnormal behaviors: Biker, Skater, Car, Wheelchair, Lawn, Runner) yielded an mAP score of 92.7%, representing a 1.5% improvement over the original model and outperforming existing mainstream models. Furthermore, the tracking algorithm achieved an MOTA of 90.8% and an MOTP of 92.6%, with a 47.6% reduction in IDS, demonstrating superior tracking performance compared to existing mainstream algorithms.

ABSTRACTThe detection of abnormal behaviours with fast and automatic recognising is significant in crowded areas to provide higher security to the public. The adoption of deep learning and machine learning‐based abnormal behaviour detection models enhances the influential detection and real‐time security monitoring in crowds. The researchers have remotely evaluated the heart rate based on physiological information to detect abnormal activities in various years. Over the past few years, several progress have been made, and there are still some issues concerning processing time, accuracy, and computational complexity. The developed approaches detects the activities of anomalies like traffic rule violations, riots, fighting, and stampede, in addition, several anomalous entities such as abandoned luggage and weapons at the sensitive place automatically in time. However, the identification of video anomalies methods poses several challenges because of various environmental conditions, the ambiguous nature of the anomaly, lack of proper datasets, and the complex nature of human characteristics. In recent days, there have been only a few devoted surveys associated with deep learning related video anomaly identification as the research domain is in its initial stages. In this review work, the abnormal behaviour analysis models using deep learning are reviewed in depth in for security applications. Based on the traditionally used abnormal behaviour analysis models in crowded scenes, we widely categorised the methods into classification using object tracking, classification using handcrafted extracted features, classification using non‐contact heart rate variability and blood pressure, analysing motion patterns from the visual frames, and classification using face images. We also discuss the comparative analysis of the previous methods with respect to datasets, computational infrastructure, and performance measures for both qualitative and quantitative analysis. In addition, the open and trending research challenges are analysed for future research.

The dangerous and harmful factors of machinery manufacturing mainly include human unsafe behavior and consciousness factors, unsafe state factors of equipment and adverse environmental factors. The characteristics and classification of abnormal behavior are analyzed, the detection methods of operators' abnormal running behavior are compared, and the discrimination basis of operators' abnormal running behavior is analyzed. The wearable inertial sensor is studied. The acceleration sensor is used to measure the acceleration of the measured object, and the gyroscope sensor can measure the angle of the human body relative to the ground. MPU9250 is selected as the measurement tool of acceleration and angle to identify the abnormal behavior of the human body, and cooperate with the single chip microcomputer, It is conducive to the detection and early warning of abnormal behavior of mechanical operators.

In order to improve the effect of network public opinion data abnormal behavior detection, an artificial intelligence-based network public opinion data abnormal behavior detection method is proposed. By constructing the network public opinion data model, recognizing the evolution rule of network public opinion data, locating the abnormal data area according to the behavior detection algorithm, and using the probability neural network under artificial intelligence to detect the abnormal data behavior. The experimental results show that the detection method proposed this time is 28.12% and 84.37% higher than the two traditional methods when detecting large-scale public opinion abnormal behavior data. It can be seen that the detection method based on artificial intelligence is not restricted by the volume of network data, and the detection effect is better.KeywordsArtificial intelligenceNetwork public opinionData abnormal behaviorDetection method