An automated detection model of threat objects for X-ray baggage inspection based on depthwise separable convolution

One of the fundamental problems of computer vision is to extract 3D shape and motion from images. This can be achieved when a scene or object is observed from different viewpoints or over a period of time. There is a wide range of applications, ranging from digitizing cultural heritage to vision-based autonomous robot navigation. This talk will present several approaches to solve this problem. First, we’ll discuss techniques for 3D shape recovery for static objects and scenes. One particular case is the 3D mapping and localization in large environments from images, e.g. urban 3D reconstruction from vehicleborne cameras or localization from cell-phone images. Next, we’ll shift our focus to modeling dynamic scenes, e.g. people who are moving around. In addition to explicitly 3D modeling an event, we'll consider the possibility to perform video-based rendering from casually captured videos. Speaker Bio-Sketch: Marc Pollefeys is a full professor in the Dept. of Computer Science of ETH Zurich since 2007 where he is the head of the Institute for Visual Computing and leads the Computer Vision and Geometry lab. He currently also remains associated with the Dept. of Computer Science of the University of North Carolina at Chapel Hill where he started as an assistant professor in 2002 and became an associate professor in 2005. Before this he was a postdoctoral researcher at the Katholieke Universiteit Leuven in Belgium, where he also received his M.S. and Ph.D. degrees in 1994 and 1999, respectively. His main area of research is computer vision. One of his main research goals is to develop flexible approaches to capture visual representations of real world objects, scenes and events. Dr. Pollefeys has received several prizes for his research, including a Marr prize, an NSF CAREER award, a Packard Fellowship and a European Research Council Starting Grant. He is the author or co-author of more than 130 peer-reviewed publications. He is the General Chair for the European Conference on Computer Vision 2014 (ECCV), was a Program Co-Chair for the IEEE Conference on Computer Vision and Pattern Recognition 2009 (CVPR), was general/program co-chair of the Third Symposium on 3D Data Processing, Visualization and Transmission and has organized workshops and courses at major vision and graphics conferences and has served on the program committees of many conferences. Prof. Pollefeys is/was on the Editorial Board of the IEEE Transactions on Pattern Analysis and Machine Intelligence and the International Journal of Computer Vision as well as several other journals in computer vision, graphics and robotics.

In industry, it is becoming common to detect and recognize industrial workpieces using deep learning methods. In this field, the lack of datasets is a big problem, and collecting and annotating datasets in this field is very labor intensive. The researchers need to perform dataset annotation if a dataset is generated by themselves. It is also one of the restrictive factors that the current method based on deep learning cannot expand well. At present, there are very few workpiece datasets for industrial fields, and the existing datasets are generated from ideal workpiece computer aided design (CAD) models, for which few actual workpiece images were collected and utilized. We propose an automatic industrial workpiece dataset generation method and an automatic ground truth annotation method. Included in our methods are three algorithms that we proposed: a point cloud based spatial plane segmentation algorithm to segment the workpieces in the real scene and to obtain the annotation information of the workpieces in the images captured in the real scene; a random multiple workpiece generation algorithm to generate abundant composition datasets with random rotation workpiece angles and positions; and a tangent vector based contour tracking and completion algorithm to get improved contour images. With our procedures, annotation information can be obtained using the algorithms proposed in this paper. Upon completion of the annotation process, a json format file is generated. Faster R-CNN (Faster R-convolutional neural network), SSD (single shot multibox detector) and YOLO (you only look once: unified, real-time object detection) are trained using the datasets proposed in this paper. The experimental results show the effectiveness and integrity of this dataset generation and annotation method.

Object detection is a fundamental problem in computer vision, with applications spanning self-driving cars, surveillance systems, medical imaging, robotics, and smart cities. Among the myriad of algorithms developed for this task, the You Only Look Once (YOLO) family stands out for its ability to perform real-time and accurate object detection. This article provides a comprehensive analysis of the YOLO algorithm series, from YOLOv1 to YOLOv8, evaluating them across key performance metrics, including precision, recall, mean Average Precision (mAP), frames per second (FPS), and overall effectiveness. Unlike traditional two-stage detectors such as R-CNN, YOLO formulates object detection as a single regression problem: a single pass over the image simultaneously predicts bounding boxes and class probabilities. This end-to-end design enables YOLO to achieve high speed while maintaining a competitive accuracy-efficiency trade-off. We examine architectural innovations across YOLO versions, including batch normalization, anchor boxes, residual blocks, feature pyramid networks, and attention mechanisms, and discuss their impact on performance. Lightweight models (e.g., YOLOv5-Nano, YOLOv8-Small) are explored with a focus on their suitability for mobile and embedded systems, highlighting YOLO’s adaptability to resource-constrained environments. Challenges such as small object detection, occlusion, and domain-specific tuning are also addressed. This article serves as a practical guide for researchers, developers, and practitioners aiming to leverage YOLO for real-world object detection tasks.

The Photogrammetric RecordVolume 37, Issue 177 p. 144-145 Notes Conference on Computer Vision and Pattern Recognition (CVPR) 2022 First published: 22 March 2022 https://doi.org/10.1111/phor.5_12405Read the full textAboutPDF ToolsRequest permissionExport citationAdd to favoritesTrack citation ShareShare Give accessShare full text accessShare full-text accessPlease review our Terms and Conditions of Use and check box below to share full-text version of article.I have read and accept the Wiley Online Library Terms and Conditions of UseShareable LinkUse the link below to share a full-text version of this article with your friends and colleagues. Learn more.Copy URL Share a linkShare onFacebookTwitterLinked InRedditWechat No abstract is available for this article. Volume37, Issue177March 2022Pages 144-145 RelatedInformation

The k-nearest neighbors (k-NN) classification rule has proven extremely successful in countless many computer vision applications. For example, image categorization often relies on uniform voting among the nearest prototypes in the space of descriptors. In spite of its good generalization properties and its natural extension to multi-class problems, the classic k-NN rule suffers from high variance when dealing with sparse prototype datasets in high dimensions. A few techniques have been proposed in order to improve k-NN classification, which rely on either deforming the nearest neighborhood relationship by learning a distance function or modifying the input space by means of subspace selection. From the computational standpoint, many methods have been proposed for speeding up nearest neighbor retrieval, both for multidimensional vector spaces and nonvector spaces induced by computationally expensive distance measures. In this paper, we propose a novel boosting approach for generalizing the k-NN rule, by providing a new k-NN boosting algorithm, called UNN (Universal Nearest Neighbors), for the induction of leveraged k-NN. We emphasize that UNN is a formal boosting algorithm in the original boosting terminology. Our approach consists in redefining the voting rule as a strong classifier that linearly combines predictions from the k closest prototypes. Therefore, the k nearest neighbors examples act as weak classifiers and their weights, called leveraging coefficients, are learned by UNN so as to minimize a surrogate risk, which upper bounds the empirical misclassification rate over training data. These leveraging coefficients allows us to distinguish the most relevant prototypes for a given class. Indeed, UNN does not affect the k-nearest neighborhood relationship, but rather acts on top of k-NN search. We carried out experiments comparing UNN to k-NN, support vector machines (SVM) and AdaBoost on categorization of natural scenes, using state-of-the art image descriptors (Gist and Bag-of-Features) on real images from Oliva and Torralba (Int. J. Comput. Vis. 42(3):145–175, 2001), Fei-Fei and Perona (IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), pp. 524–531, 2005), and Xiao et al. (IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3485–3492, 2010). Results display the ability of UNN to compete with or beat the other contenders, while achieving comparatively small training and testing times.

Object detection is challenging in the computer vision area and is crucial in autonomous driving systems. The largest number of traditional techniques or the use of deep learning are evaluated in the urban area, but in rural areas, there is little research carried out. The goal of this work is object detection in rural roads, this paper presents the use of deep learning frameworks used as You Only Look Once (YOLO) and another that belongs to the same category of one-stage is the well-known Single Shot Multi-Box Detector (SSD), in the state of the literature, produces excellent results in detecting objects in real-time. These models behave differently in network architecture, for this reason, we use images of rural roads with different environments to achieve an optimal balance between precision and precision in the detection of objects. Furthermore, as there is no dataset in these environments, we created our own data set to perform the experiments due to the difficulty of this problem. The result of both detectors has produced acceptable results under certain conditions like lighting conditions, viewing perspectives, partial occlusion of the object.

Object detection plays a crucial role in computer vision applications, ranging from autonomous vehicles to surveillance systems. One-stage object detectors have emerged as a powerful solution by simplifying detection pipelines, enabling real-time performance while maintaining competitive accuracy. This article provides a comprehensive survey of one-stage obj ect detection models, including you only look once (YOLO), single shot multibox detector (SSD), and PaddlePaddle YOLO (PP-YOLO) variants. A central question guides this exploration: How can incremental architectural refinements and training strategies improve the trade-off between speed, accuracy, and computational efficiency in object detection models for real-time applications? Through a detailed analysis of key innovations, performance metrics, and practical applications, this survey highlights the evolution of these models and their contributions to bridging the gap between research and deployment. Additionally, the paper identifies current challenges, such as small-object detection and resource efficiency, and proposes future research directions to advance the field further.

With the continuous development of technology, the application of computer vision technology in cost monitoring of construction projects is becoming increasingly important. By utilizing computer vision technology, construction companies can monitor the progress of construction sites, material usage, and allocation of human resources in real-time, thereby better controlling project costs. The application of this technology can not only improve the efficiency of construction projects, but also reduce human errors and waste, which is of great significance for the successful completion of projects. Therefore, construction companies should actively adopt computer vision technology to improve the efficiency and accuracy of cost monitoring. In recent years, China's economy has continued to grow, continuously driving the development of infrastructure and manufacturing industries. However, at the same time, the production safety situation in China is becoming increasingly severe, and safety accidents continue to occur. One of the main causes of safety accidents is human misconduct, which includes workers wearing uniforms and safety helmets improperly during construction. Workers engage in some dangerous behaviors during construction, such as making phone calls, falling, and squatting for long periods of time. In response to the above issues, this article studies how the SSD (Single Shot MultiBox Detector) algorithm, CNN (Convolutional Neural Networks) algorithm, and YOLO (You only look once) algorithm can be applied to the behavior detection of construction workers, and compares them with existing object detection algorithms through experiments. The experimental data shows that the AP (Average precision), AP50, and AP75 values of the SSD-CNN algorithm in this article are 51.29%, 69.85%, and 54.81%, respectively. Among all the algorithms, the values of the three indicators rank in the top few.

The objective of this study is to examine two powerful components: the YOLO (You Only Look Once) framework for object recognition on edge devices and the MobileNet architecture. With the rising demand for real-time, efficient, and accurate object detection in constrained environments, these models offer distinct advantages suited to different applications. YOLO is renowned for its high accuracy and speed, making it ideal for complex detection tasks, whereas MobileNet is optimized for efficiency, enabling deployment on devices with limited computational resources. The paper discusses the evolution of these models, their architectural differences, and their respective strengths and limitations when implemented on edge devices. Furthermore, we explore the feasibility of integrating these frameworks into a hybrid model that leverages the lightweight feature extraction of MobileNet and the robust detection capabilities of YOLO. Such a hybrid approach could significantly enhance real-time object detection performance across a wide range of hardware platforms.  Researchers and practitioners seeking to deploy advanced object detection models in real-world applications, particularly where computational efficiency and accuracy are paramount may find this review as a valuable resource.

Abstract- With the rapid growth of urban populations and the increasing number of vehicles on the road, traffic congestion has become a significant problem in metropolitan areas. Conventional traffic control systems, which rely on pre-set signal timers, often fail to address real-time traffic conditions effectively, leading to inefficient traffic flow, increased fuel consumption, and environmental degradation. The paper “Smart Traffic Control System Based on Traffic Density Using YOLO” introduces a novel approach to address this issue by integrating artificial intelligence and computer vision into traffic management. The proposed system utilizes the YOLO (You Only Look Once) object detection algorithm to detect and classify vehicles in real-time from live video feeds captured at intersections. YOLO, known for its speed and accuracy in object detection tasks, calculates the vehicle density in each direction. Based on the detected density, the system dynamically adjusts the green light duration for each lane, ensuring that the direction with higher traffic receives longer green light periods. This method aims to optimize signal switching and minimize overall vehicle wait time. The paper outlines the complete architecture of the system, which includes modules for video input processing, vehicle detection using YOLO, traffic density computation, and adaptive signal timing control. By leveraging deep learning, the system enhances decision-making capabilities without relying on costly hardware like inductive loops or infrared sensors. This review evaluates the effectiveness and innovation of the proposed system, comparing it with traditional and sensor-based models. It highlights the advantages of using YOLO, such as real-time processing, high accuracy, and scalability. Additionally, the review discusses the system’s limitations, such as dependency on video clarity and environmental conditions, and proposes areas for future enhancement, including integration with cloud computing and edge AI for broader deployment. Keywords- Smart Traffic Control System, YOLO Object Detection, Traffic Density Estimation, Real-Time Traffic Monitoring, Adaptive Traffic Signal Control, Vehicle Classification ( Cars, Bikes, Buses, Trucks, Rikshaws), Intelligent Transportation System.

The natural phenomenon of harmful algae bloom (HAB) has a bad impact on the quality of pure and freshwater. It increases the risk to human health, water bodies and overall aquatic ecosystem. It is necessary to continuously monitor and perform proper action against HAB. The inspection of algae blooms by using conventional methods, like algae detection under microscopes, is a difficult, expensive, and time-consuming task, however, computer vision-based deep learning models play a vital role in identifying and detecting harmful algae growth in aquatic ecosystems and water reservoirs. Many studies have been conducted to address harmful algae growth by using a CNN based model, however, the YOLO model is considered more accurate in identifying the algae. This advanced deep learning method is extensively used to detect algae and classify them according to their corresponding category. In this study, we used various versions of the convolution neural network (CNN) based on the You Only Look Once (YOLO) model. Recently YOLOv5 has been getting more attention due to its performance in real-time object detection. We performed a series of experiments on our custom microscopic images dataset by using YOLOv3, YOLOv4, and YOLOv5 to detect and classify the harmful algae bloom (HAB) of four classes. We used pre-processing techniques to enhance the quantity of data. The mean average precision (mAP) of YOLOv3, YOLOv4, and YOLO v5 is 75.3%, 83.0%, and 91.0% respectively. For the monitoring of algae bloom in freshwater, computer-aided based systems are very helpful and effective. To the best of our knowledge, this work is pioneering in the AI community for applying the YOLO models to detect algae and classify from microscopic images.

Hand gesture recognition has great applications in human-computer interaction (HCI), human-robot interaction (HRI), and supporting the deaf and mute. To build a hand gesture recognition model using deep learning (DL) with high results then needs to be trained on many data and in many different conditions and contexts. In this paper, we publish the TQU-HG dataset of large RGB images with low resolution (640×480) pixels, low light conditions, and fast speed (16 fps). TQU-HG dataset includes 60,000 images collected from 20 people (10 male, 10 female) with 15 gestures of both left and right hands. A comparative study with two branches: i) based on Mediapipe TML and ii) Based on convolutional neural networks (CNNs) (you only look once (YOLO); YOLOv5, YOLOv6, YOLOv7, YOLOv8, YOLO-Nas, single shot multiBox detector (SSD) VGG16, residual network (ResNet)18, ResNext50, ResNet152, ResNext50, MobileNet V3 small, and MobileNet V3 large), the architecture and operation of CNNs models are also introduced in detail. We especially fine-tune the model and evaluate it on TQU-HG and HaGRID datasets. The quantitative results of the training and testing are presented (F1-score of YOLOv8, YOLO-Nas, MobileNet V3 small, ResNet50 is 98.99%, 98.98%, 99.27%, 99.36%, respectively on the TQU-HG dataset and is 99.21%, 99.37%, 99.36%, 86.4%, 98.3%, respectively on the HaGRID dataset). The computation time of YOLOv8 is 6.19 fps on the CPU and 18.28 fps on the GPU.

This paper explores and evaluates the potential of deep neural network (DNN)-based machine learning algorithms on embed-ded many-core processors in cyber-physical systems, such as self-driving systems. To run applications in embedded systems, a plat-form characterized by low power consumption with high accuracy and real-time performance is required. Furthermore, a platform is required that allows the coexistence of DNN applications and other applications, including conventional real-time control soft-ware, to enable advanced embedded systems, such as self-driving systems. Clustered many-core processors, such as Kalray MPPA3-80 Coolidge, can run multiple applications on a single platform because each cluster can run applications independently. Moreover, MPPA3-80 integrates multiple arithmetic elements that operate at low frequencies, thereby enabling high performance and low power consumption comparable to that of embedded graphics processing units. Furthermore, the Kalray Neural Network (KaNN) code generator, a deep learning inference compiler for the MPPA3-80 platform, can efficiently perform DNN inference on MPPA3-80. This paper evaluates DNN models, including You Only Look Once (YOLO)-based and Single Shot MultiBox Detector (SSD)-based mod-els, on MPPA3-80. The evaluation examines the frame rate and power consumption in relation to the size of the input image, the computational accuracy, and the number of clusters.

Vision-based structural displacement monitoring of rotor has attracted extensive attention from scholars due to its non-contact, non-damage, and multi-point synchronous measurement advantages. However, there is a lack of one comprehensive dataset and benchmark for rotor detection since the problem of limited acquisition equipment or on-site environment in the industrial field. For that, a large benchmark for rotor’s vibration displacement detection is introduced in this paper. Firstly, a rotor vibration displacement detection network (RDNet) for rotating structures is proposed and state-of-the-art performance is achieved. Secondly, the evaluation criteria are designed to evaluate the rotor image detection accuracy using the mean Average Precision@0.5:0.95 (mAP@0.5:0.95), the Frames Per Second (FPS), and the Normalized Root Mean Squared Error (NRMSE) as performance indicators. Thirdly, a dataset namely Rotor V1.0 is built, which contains three frames (high, middle, and low) of 13,500 rotor images. It is the rotor dataset for vibration displacement monitoring of rotating structures. Lastly, the baseline performance resulted from traditional methods (i.e., match template and support vector machines) and deep learning methods (i.e., CenterNet, Faster Region-convolutional neural networks (Faster R-CNN), RetinaNet, Single Shot MultiBox Detector (SSD), and You only look once (YOLO)) are reported and analyzed. It is hoped that RDNet, evaluation criteria, and the novel Rotor V1.0 dataset can promote the implementation of visual vibration measurement tasks in industrial sites.

Wild birds are monitored with the important objectives of identifying their habitats and estimating the size of their populations. Especially in the case of migratory bird, they are significantly recorded during specific periods of time to forecast any possible spread of animal disease such as avian influenza. This study led to the construction of deep-learning-based object-detection models with the aid of aerial photographs collected by an unmanned aerial vehicle (UAV). The dataset containing the aerial photographs includes diverse images of birds in various bird habitats and in the vicinity of lakes and on farmland. In addition, aerial images of bird decoys are captured to achieve various bird patterns and more accurate bird information. Bird detection models such as Faster Region-based Convolutional Neural Network (R-CNN), Region-based Fully Convolutional Network (R-FCN), Single Shot MultiBox Detector (SSD), Retinanet, and You Only Look Once (YOLO) were created and the performance of all models was estimated by comparing their computing speed and average precision. The test results show Faster R-CNN to be the most accurate and YOLO to be the fastest among the models. The combined results demonstrate that the use of deep-learning-based detection methods in combination with UAV aerial imagery is fairly suitable for bird detection in various environments.