Real-Time Pedestrian Detection using YOLO

This paper provides a comprehensive study of the security of YOLO (You Only Look Once) model series for object detection, emphasizing their evolution, technical innovations, and performance across the COCO dataset. The robustness of YOLO models under adversarial attacks and image corruption, offering insights into their resilience and adaptability, is analyzed in depth. As real-time object detection plays an increasingly vital role in applications such as autonomous driving, security, and surveillance, this review aims to clarify the strengths and limitations of each YOLO iteration, serving as a valuable resource for researchers and practitioners aiming to optimize model selection and deployment in dynamic, real-world environments. The results reveal that YOLOX models, particularly their large variants, exhibit superior robustness compared to other YOLO versions, maintaining higher accuracy under challenging conditions. Our findings serve as a valuable resource for researchers and practitioners aiming to optimize YOLO models for dynamic and adversarial real-world environments while guiding future research toward developing more resilient object detection systems.

An operator feels a burden when he/she controls a rescue robot remotely because he/she has to keep watching camera images to find the target object. We think that this burden can be reduced by the combination of Head Mounted Display (HMD) and object recognition by deep learning. In the first half part of this study, we examine the effect that how presentation method by You Only Look Once (YOLO), a deep learning algorithm, and its recognition results to an operator wearing HMD. In the experiment, three methods of presentation were set: no display of object recognition, display only one object recognition result, and display 80 kinds of object recognition results. Under each presentation method, we measured the time it took for the operator to operate the robot and complete the given task. Additionally, we ask a questionnaire for each experiment. The results of the questionnaire showed that the method to present only one object recognition result was useful. In the second half part of this study, we develop a system to present 3D images with YOLO added, to further ease the burden of object search. Furthermore, we numerically prove that this system represents depth. In the experiment, two methods of displaying were set up: 2D images with Bounding Box (BB) by YOLO and 3D images with BB by YOLO. For each method of presentation, the operator operated the robot and recorded the number of objects found within a time limit. Additionally, we asked a questionnaire at the end of the search in each condition and at the end of all the experiments. The results of the questionnaire suggested points that need to be improved. Furthermore, we consider the flicker of the image found in the experiment.

As seen in the COVID-19 pandemic, one of the most important measures is physical distance in viruses transmitted from person to person. According to the World Health Organization (WHO), it is mandatory to have a limited number of people in indoor spaces. Depending on the size of the indoors, the number of persons that can fit in that area varies. Then, the size of the indoor area should be measured and the maximum number of people should be calculated accordingly. Computers can be used to ensure the correct application of the capacity rule in indoors monitored by cameras. In this study, a method is proposed to measure the size of a prespecified region in the video and count the people there in real time. According to this method: (1) predetermining the borders of a region on the video, (2) identification and counting of people in this specified region, (3) it is aimed to estimate the size of the specified area and to find the maximum number of people it can take. For this purpose, the You Only Look Once (YOLO) object detection model was used. In addition, Microsoft COCO dataset pre-trained weights were used to identify and label persons. YOLO models were tested separately in the proposed method and their performances were analyzed. Mean average precision (mAP), frame per second (fps), and accuracy rate metrics were found for the detection of persons in the specified region. While the YOLO v3 model achieved the highest value in accuracy rate and mAP (both 0.50 and 0.75) metrics, the YOLO v5s model achieved the highest fps rate among non-Tiny models.

Abstract- With the rapid growth of urban populations and the increasing number of vehicles on the road, traffic congestion has become a significant problem in metropolitan areas. Conventional traffic control systems, which rely on pre-set signal timers, often fail to address real-time traffic conditions effectively, leading to inefficient traffic flow, increased fuel consumption, and environmental degradation. The paper “Smart Traffic Control System Based on Traffic Density Using YOLO” introduces a novel approach to address this issue by integrating artificial intelligence and computer vision into traffic management. The proposed system utilizes the YOLO (You Only Look Once) object detection algorithm to detect and classify vehicles in real-time from live video feeds captured at intersections. YOLO, known for its speed and accuracy in object detection tasks, calculates the vehicle density in each direction. Based on the detected density, the system dynamically adjusts the green light duration for each lane, ensuring that the direction with higher traffic receives longer green light periods. This method aims to optimize signal switching and minimize overall vehicle wait time. The paper outlines the complete architecture of the system, which includes modules for video input processing, vehicle detection using YOLO, traffic density computation, and adaptive signal timing control. By leveraging deep learning, the system enhances decision-making capabilities without relying on costly hardware like inductive loops or infrared sensors. This review evaluates the effectiveness and innovation of the proposed system, comparing it with traditional and sensor-based models. It highlights the advantages of using YOLO, such as real-time processing, high accuracy, and scalability. Additionally, the review discusses the system’s limitations, such as dependency on video clarity and environmental conditions, and proposes areas for future enhancement, including integration with cloud computing and edge AI for broader deployment. Keywords- Smart Traffic Control System, YOLO Object Detection, Traffic Density Estimation, Real-Time Traffic Monitoring, Adaptive Traffic Signal Control, Vehicle Classification ( Cars, Bikes, Buses, Trucks, Rikshaws), Intelligent Transportation System.

Object detection is a fundamental problem in computer vision, with applications spanning self-driving cars, surveillance systems, medical imaging, robotics, and smart cities. Among the myriad of algorithms developed for this task, the You Only Look Once (YOLO) family stands out for its ability to perform real-time and accurate object detection. This article provides a comprehensive analysis of the YOLO algorithm series, from YOLOv1 to YOLOv8, evaluating them across key performance metrics, including precision, recall, mean Average Precision (mAP), frames per second (FPS), and overall effectiveness. Unlike traditional two-stage detectors such as R-CNN, YOLO formulates object detection as a single regression problem: a single pass over the image simultaneously predicts bounding boxes and class probabilities. This end-to-end design enables YOLO to achieve high speed while maintaining a competitive accuracy-efficiency trade-off. We examine architectural innovations across YOLO versions, including batch normalization, anchor boxes, residual blocks, feature pyramid networks, and attention mechanisms, and discuss their impact on performance. Lightweight models (e.g., YOLOv5-Nano, YOLOv8-Small) are explored with a focus on their suitability for mobile and embedded systems, highlighting YOLO’s adaptability to resource-constrained environments. Challenges such as small object detection, occlusion, and domain-specific tuning are also addressed. This article serves as a practical guide for researchers, developers, and practitioners aiming to leverage YOLO for real-world object detection tasks.

<b><sc>Abstract.</sc></b> Seed phenotyping is the idea of analyzing the morphometric characteristics of a seed to predict the behavior of the seed in terms of development, tolerance and yield in various environmental conditions. The performance of seed phenotyping requires that the morphometry of seeds be estimated which can be a complex task to perform considering that seeds, even of a certain variety, are not uniform. As a result, the manual estimation of seed morphometry requires a ginormous amount of man-power. In recent times, applications, both mobile and desktop, that estimate seed morphometry from images have become available. While the applications alleviate the problem to a degree, one key problem is the segmentation of clustered seeds on images. It is often the case that the seeds on the image are in contact with each other which makes it hard to distinguish one seed from another. This phenomenon inevitably leads to erroneous estimates of seed morphometry. Recent developments in the field of machine learning have led to the development of neural networks that perform object detection and instance segmentation. The focus of the work is the application and feasibility analysis of the state-of-the-art object detection and localization neural networks, Mask R-CNN and YOLO (You Only Look Once), for seed phenotyping using Tensorflow. One of the major bottlenecks of such an endeavor is the need for a large amount of training data. While the capture of a multitude of seed images is taunting, the images are also required to be annotated to indicate the boundaries of the seeds on the image and converted to data formats that the neural networks are able to consume. Although tools that manually perform the task of annotation are available for free, the amount of time required is enormous. In order to tackle such a scenario, the idea of domain randomization i.e. the technique of applying models trained on images containing simulated objects to real-world objects, is considered. Besides, transfer learning i.e. the idea of applying the knowledge obtained while solving a problem to a different problem, is used. The networks are trained on pre-trained weights from the popular ImageNet and COCO data sets. Five types of seeds i.e. canola, rough rice, sorghum, soy and wheat, are experimented with, as part of the work. The performance of the technique is evaluated using average precision and recall. In order to apply domain randomization, a sample of 40 seeds of each type is considered. Images of each of the seeds are captured and then laid on a uniform background in different orientations and sizes. In essence, this procedure creates a multitude of training images that are used to train the neural networks. This technique ensures that the user does need to possess numerous seeds to train the neural networks. Also, a plethora of training images can be generated on-demand with a desired number of seeds on each image. The ability to scale and orient the seed instances on the images means that the neural networks can be trained to be scale-invariant, a common problem in image processing. Upon the segmentation of seeds, a technique that closely follows the guidelines laid out by the International Seed Morphology Association is proposed to estimate the morphometry of the seeds using the neural networks. Briefly, the standard US government issued coin, the Penny, is used. Since the dimensions of the penny are known in advance, a relationship between the coin morphometry in pixels and metric units is established. This relationship is later leveraged to perform a simple cross-multiplication to yield the morphometry of the seeds in question.

In this work, we present our intelligent SSD, SeeSSD , an energy-efficient computational SSD for a real-time object detection system. SeeSSD embeds an FPGA-based CNN processing engine and the firmware that performs the convolutional operation on the target image. SeeSSD processes the image data at the storage before sending it to the host. This reduces the amount of data transferred to the host and lowers the data movement overhead, thus reducing transfer time and saving power. By using our SeeSSD system and YOLO_Embed, an object detection neural network model, we are able to outperform the fastest YOLO model for an embedded controller, YOLO-Lite, in terms of performance, accuracy, and energy efficiency. YOLO (You Only Look Once) models are a series of one-stage object detection neural models that have become very popular due to their fast speed and high accuracy. The contribution of this work includes designing and implementing our SeeSSD system with a lightweight object detection model, YOLO_Embed, for reducing the data movement overhead, performing real-time inference, and lowering the overall power consumption. We implemented the entire software stack associated with the SeeSSD system; on-device CNN acceleration engine implemented on FPGA, object identification interface for SeeSSD using YOLO_Embed, and embedded software layer in SeeSSD for on-device convolutional processing. We calculated our YOLO_Embed model’s accuracy on object detection dataset benchmarks such as PASCAL VOC 2012, which came out to be 38.1% mAP (mean Accuracy Precision). Our system was able to perform inference in 0.21 seconds while reducing the power consumption by approximately 1.2 × and 1.4 × for CPU-Only and CPU+GPU systems, respectively. We were also able to reduce the data movement overhead by 24 × for a single target image.

Object detection has become the cornerstone of various real-world applications, ranging from autonomous driving where it helps detect road objects to medical imaging for early disease prediction and gesture recognition systems. Due to their ability to operate continuously and cost-effectively, computer vision models are increasingly being employed in surveillance and monitoring tasks. Unlike humans, who can intuitively recognize and understand objects within images, machines require advanced algorithms to mimic such capabilities. A key challenge in computer vision lies in recognizing and tracking objects in real-time with accuracy and reliability. Human visual systems perform these tasks naturally and swiftly, enabling complex activities like driving. For computers to match such performance, efficient object detection models along with additional hardware such as sensors are essential. This study presents a comparative analysis of two popular deep learning-based object detection algorithms You Only Look Once (YOLO) and Faster Region-based Convolution Neural Network (Faster RCNN). Both models are evaluated based on their detection accuracy, speed, and performance in real-time scenarios. The paper aims to highlight the strengths and limitations of each model, offering insights into their suitability for different applications. The findings suggest that while both algorithms have their merits, the choice between them depends on the specific requirements of a task, such as the trade-off between detection speed and precision. Comparative study shows that Faster RCNN outperforms its accuracy compared with YOLO.

Visual tracking is a fundamental technology in computer vision, with wide-ranging applications in fields such as robotics, autonomous driving, augmented reality, and security systems. A key challenge in these domains is ensuring stable object tracking in dynamic and complex environments. Tracking objects in real-world settings presents difficulties like occlusion, lighting changes, and sudden object movements, all of which demand the development of robust algorithms that can handle such variability effectively. This research introduces a novel single object visual tracking technique that leverages the YOLO (You Only Look Once) object detection model, combined with an adaptive particle filter. By integrating YOLO's precise object detection capabilities with the continuous state estimation offered by particle filters, this approach achieves stable object tracking, even in challenging environments. At the heart of the proposed algorithm is a dynamic fusion of YOLO detection results with image feature-based particle weight updates. When YOLO successfully detects an object, the position and size data of the object are used to adjust the state and weights of the particles, resulting in improved tracking accuracy and quick recovery from events such as sudden movements or occlusions. Conversely, in situations where YOLO detection is unavailable, the algorithm seamlessly transitions to a pure particle filter mode. In this fallback mode, visual features, such as image color histograms, are used to update particle weights, ensuring continuous and robust tracking even during temporary detection failures. The object’s dynamic state is modeled using an 8-dimensional vector, which includes information about position, velocity, size, and size-change rate. This comprehensive state representation enables precise tracking of various object motions and size transformations. Additionally, a Bhattacharyya distance-based weight calculation method is employed to assess particle similarity more effectively. Experimental results demonstrate that the proposed method excels in various challenging scenarios, including those with sudden object movements, partial occlusions, and lighting variations. The algorithm consistently delivers stable tracking, underscoring its robustness and adaptability. The contributions of this research have potential applications in fields such as autonomous driving, SLAM (Simultaneous Localization and Mapping), and augmented reality. Specifically, this technique could enhance pedestrian and vehicle tracking in autonomous driving systems and improve the accuracy of dynamic object tracking and environmental mapping in SLAM. It is also likely to play a key role in real-world applications like person tracking in security systems, player motion analysis in sports, and focused tracking in medical imaging. Future research directions include expanding the method to handle multi-object tracking and optimizing its real-time performance, broadening its applicability. Additionally, further improvements in tracking accuracy and robustness may be achieved by incorporating deep learning-based feature extraction and integrating data from various sensors.

Abstract—Object detection is a computer vision technique that locates objects in images or videos by creating bounding boxes around them. In this paper, we propose a model based on object detection using deep learning technologies along with text to speech conversion.An object detection system uses a deep learningmodel to detect objects using YOLO (You Only Look Once) and text-to- speech (TTS) to synthesize a voice announcement about each object. The system we used is built using python OpenCV tool and Google text to speech (gTTS) is used to convert text into audio segment. First variations of YOLO algorithm are compared and then the best one is used according to result we get it by training it on COCO dataset. After the object is detected, the name of the detected object is displayed then the voice output is generated by using Google Text To Speech(gTTS) module. The contribution we make is to present a visual substitution system that uses features extraction and matching to recognize objects with a voice feedback. Index Terms—Object Detection, YOLO, Open CV, python, Google Text To Speech

Cigarettes are processed products from tobacco products which are used by burning and then smoked. Smoking activities are often found in everyday life, including in public infrastructure. The approach taken to prevent this activity generally uses manual information or human intervention. In terms of this approach, there are often many problems and failures due to the lack of manpower and supporting rules. Therefore, this study was structured with the aim of being able to detect smoking objects in real time using the You Only Look Once (YOLO) method. YOLO which is based on deep learning is very good at detecting objects, this model provides a single convolution neural network in assigning location and classification. So that in its application, YOLO is very fast in detecting and recognizing objects. This study conducted experiments on the training dataset in testing the YOLOv3, YOLOv3-Tiny and YOLOv4 models. The best training results were obtained in the YOLOv4 model with a composition of 80% training and 20% validation data sharing with a Mean Average Precision (mAP) of 92.54% and an F1-Score of 0.89. This study also conducted experiments on testing to detect cigarettes in real time, where the system can detect cigarettes up to a distance of 4.5 meters, and the highest detection accuracy is obtained at a distance of 1 meter, namely 99.03%.

The You Only Look Once (YOLO) network is considered highly suitable for real-time object detection tasks due to its characteristics, such as high speed, single-shot detection, global context awareness, scalability, and adaptability to real-world conditions. This work introduces a comprehensive analysis of various YOLO models for detecting cracks in concrete structures, aiming to assist in the selection of an optimal model for future detection and segmentation tasks. The YOLO models are initially trained on a dataset containing both images with and without cracks, producing a generalized model capable of extracting abstract features beneficial for crack detection. Subsequently, transfer learning is employed using a dataset that reflects real-world conditions, such as occlusions, varying crack sizes, and rotations, to further refine the model. Crack detection in concrete remains challenging due to the wide variation in crack sizes, aspect ratios, and complex backgrounds. To achieve optimal performance, we test different versions of YOLO, a state-of-the-art single-shot detector, and aim to balance inference speed and mean average precision (mAP). Our results indicate that YOLOv10 demonstrates superior performance, achieving a mean average precision (mAP) of 74.52% with an inference time of 19.5 milliseconds per image, making it the most effective among the models tested.

YOLO-YCbCr based smoke segmentation method for fire detection was proposed in this study to enhance smoke segmentation performance with reduction in computational cost. The proposed method consists of the deep learning object detection model, You Only Look Once (YOLO), and the color space-based segmentation model, rule-based YCbCr. YOLO is used to detect smoke objects in the input fire images through bounding boxes. The images in the bounding boxes are characterized based on YCbCr color space and the proposed YCbCr rules derived by considering smoke image characteristics segment smoke region. In order to evaluate the smoke segmentation performance, six different fire incident video data were used. The mean intersection over union (IoU) value of the proposed method was improved by approximately 31.3% and 24.5% respectively when compared to the reference models: YOLO-RGB model and YOLO-CIELAB model. It was found that YOLO significantly reduced the erroneous smoke segmentation and YCbCr rules derived from the smoke color features were effective in the smoke segmentation.

Real-time deep learning-based position control of a mobile robot

The objective of this study is to examine two powerful components: the YOLO (You Only Look Once) framework for object recognition on edge devices and the MobileNet architecture. With the rising demand for real-time, efficient, and accurate object detection in constrained environments, these models offer distinct advantages suited to different applications. YOLO is renowned for its high accuracy and speed, making it ideal for complex detection tasks, whereas MobileNet is optimized for efficiency, enabling deployment on devices with limited computational resources. The paper discusses the evolution of these models, their architectural differences, and their respective strengths and limitations when implemented on edge devices. Furthermore, we explore the feasibility of integrating these frameworks into a hybrid model that leverages the lightweight feature extraction of MobileNet and the robust detection capabilities of YOLO. Such a hybrid approach could significantly enhance real-time object detection performance across a wide range of hardware platforms.&nbsp; Researchers and practitioners seeking to deploy advanced object detection models in real-world applications, particularly where computational efficiency and accuracy are paramount may find this review as a valuable resource.