Design of Gaze Evaluation System in Driving Using Eye Tracking and Object Detection

The on‐tree counting of chestnut fruit (bur) is essential for yield estimation and monitoring of fruit load as well as tree health, which is important in determining the management strategy for orchards, markets, and tree health monitoring. However, the practice is still conducted by manual count or farmers’ intuition. Precise and effective counting method is yet to be established. This study attempted to count chestnut fruits with the object detection algorithm, You Only Look Once (YOLO), using the RGB imagery collected with an unmanned aerial vehicle (UAV). The model trained with 500 images (7866 burs labeled with bounding boxes) in YOLO version 4 (v4) could count the number of burs with a R2 value of 0.98 and a root mean square error of 6.3 (8.3% of the mean) relative to the manual count in the data set for each whole tree (n = 53). The R2 of linear regression between the number of burs obtained with the YOLOv4 model and the total yield was 0.76, with a standard error of 1.08 kg tree−1 (26.4% of coefficient of variation), which was equivalent to the in situ burs count by an expert technician. In addition, the number of burs counted with the YOLOv4 model after the adjustment of trunk circumference was negatively correlated with nut weight. Overall, the study revealed that YOLO algorithm coupled with UAV‐based RGB imagery is a precise and efficient method for on‐tree burs detection, which could be used as an indicator of yield and fruit load.

An operator feels a burden when he/she controls a rescue robot remotely because he/she has to keep watching camera images to find the target object. We think that this burden can be reduced by the combination of Head Mounted Display (HMD) and object recognition by deep learning. In the first half part of this study, we examine the effect that how presentation method by You Only Look Once (YOLO), a deep learning algorithm, and its recognition results to an operator wearing HMD. In the experiment, three methods of presentation were set: no display of object recognition, display only one object recognition result, and display 80 kinds of object recognition results. Under each presentation method, we measured the time it took for the operator to operate the robot and complete the given task. Additionally, we ask a questionnaire for each experiment. The results of the questionnaire showed that the method to present only one object recognition result was useful. In the second half part of this study, we develop a system to present 3D images with YOLO added, to further ease the burden of object search. Furthermore, we numerically prove that this system represents depth. In the experiment, two methods of displaying were set up: 2D images with Bounding Box (BB) by YOLO and 3D images with BB by YOLO. For each method of presentation, the operator operated the robot and recorded the number of objects found within a time limit. Additionally, we asked a questionnaire at the end of the search in each condition and at the end of all the experiments. The results of the questionnaire suggested points that need to be improved. Furthermore, we consider the flicker of the image found in the experiment.

Detecting pedestrians in a crowded scene in real time is a challenging task in monitoring and managing crowd. Many researchers around the world have addressed this task and managed to achieve satisfactory results. However, the problem of automating detection of pedestrians in the crowd is still an open issue depending on the density of crowd in a scene. To ensure safety and security, automating the crowd detection and tracking process in real time is necessary in designing a robust and secure system. Detecting and localizing objects has successfully aided in identifying the major problems with detecting pedestrians and has been a major step forward in managing crowd automatically. In this paper, we have used tiny YOLOv4. YOLO (You Only Look Once) has proved quite useful in detecting and localizing objects in an image with impressive response speed. YOLO network usually scales an entire image into fixed sized grids and then identifies and detects the region into these grids using bounding boxes. Using transfer learning on an already trained YOLO inception model on COCO dataset, detection of pedestrians in surveillance videos is handled. The paper discusses the implementation and detection performance of the proposed YOLOv4 tiny model on the UCSD pedestrian Detection dataset with promising results.

Object detection is a fundamental problem in computer vision, with applications spanning self-driving cars, surveillance systems, medical imaging, robotics, and smart cities. Among the myriad of algorithms developed for this task, the You Only Look Once (YOLO) family stands out for its ability to perform real-time and accurate object detection. This article provides a comprehensive analysis of the YOLO algorithm series, from YOLOv1 to YOLOv8, evaluating them across key performance metrics, including precision, recall, mean Average Precision (mAP), frames per second (FPS), and overall effectiveness. Unlike traditional two-stage detectors such as R-CNN, YOLO formulates object detection as a single regression problem: a single pass over the image simultaneously predicts bounding boxes and class probabilities. This end-to-end design enables YOLO to achieve high speed while maintaining a competitive accuracy-efficiency trade-off. We examine architectural innovations across YOLO versions, including batch normalization, anchor boxes, residual blocks, feature pyramid networks, and attention mechanisms, and discuss their impact on performance. Lightweight models (e.g., YOLOv5-Nano, YOLOv8-Small) are explored with a focus on their suitability for mobile and embedded systems, highlighting YOLO’s adaptability to resource-constrained environments. Challenges such as small object detection, occlusion, and domain-specific tuning are also addressed. This article serves as a practical guide for researchers, developers, and practitioners aiming to leverage YOLO for real-world object detection tasks.

YOLO-YCbCr based smoke segmentation method for fire detection was proposed in this study to enhance smoke segmentation performance with reduction in computational cost. The proposed method consists of the deep learning object detection model, You Only Look Once (YOLO), and the color space-based segmentation model, rule-based YCbCr. YOLO is used to detect smoke objects in the input fire images through bounding boxes. The images in the bounding boxes are characterized based on YCbCr color space and the proposed YCbCr rules derived by considering smoke image characteristics segment smoke region. In order to evaluate the smoke segmentation performance, six different fire incident video data were used. The mean intersection over union (IoU) value of the proposed method was improved by approximately 31.3% and 24.5% respectively when compared to the reference models: YOLO-RGB model and YOLO-CIELAB model. It was found that YOLO significantly reduced the erroneous smoke segmentation and YCbCr rules derived from the smoke color features were effective in the smoke segmentation.

In this work, we present our intelligent SSD, SeeSSD , an energy-efficient computational SSD for a real-time object detection system. SeeSSD embeds an FPGA-based CNN processing engine and the firmware that performs the convolutional operation on the target image. SeeSSD processes the image data at the storage before sending it to the host. This reduces the amount of data transferred to the host and lowers the data movement overhead, thus reducing transfer time and saving power. By using our SeeSSD system and YOLO_Embed, an object detection neural network model, we are able to outperform the fastest YOLO model for an embedded controller, YOLO-Lite, in terms of performance, accuracy, and energy efficiency. YOLO (You Only Look Once) models are a series of one-stage object detection neural models that have become very popular due to their fast speed and high accuracy. The contribution of this work includes designing and implementing our SeeSSD system with a lightweight object detection model, YOLO_Embed, for reducing the data movement overhead, performing real-time inference, and lowering the overall power consumption. We implemented the entire software stack associated with the SeeSSD system; on-device CNN acceleration engine implemented on FPGA, object identification interface for SeeSSD using YOLO_Embed, and embedded software layer in SeeSSD for on-device convolutional processing. We calculated our YOLO_Embed model’s accuracy on object detection dataset benchmarks such as PASCAL VOC 2012, which came out to be 38.1% mAP (mean Accuracy Precision). Our system was able to perform inference in 0.21 seconds while reducing the power consumption by approximately 1.2 × and 1.4 × for CPU-Only and CPU+GPU systems, respectively. We were also able to reduce the data movement overhead by 24 × for a single target image.

Object detection is a critical component in intelligent surveillance, disaster response, and autonomous dronebased monitoring systems. In recent years, the You Only Look Once (YOLO) family of algorithms has transformed real-time object detection by achieving an effective balance between detection speed and accuracy. This review paper presents a comprehensive analysis of YOLO models from YOLOv1 to YOLOv8, emphasizing their architectural evolution, backbone development, and feature extraction strategies. Each version’s key innovations are discussed in detail—from YOLOv1’s unified detection framework and YOLOv2’s introduction of anchor boxes to YOLOv8’s advanced anchor-free detection mechanism. The comparative evaluation focuses on model accuracy (mAP), inference speed (FPS), and deployment feasibility for embedded and UAV-based systems. Findings from existing literature and experimental insights reveal that successive YOLO versions have progressively enhanced small object detection, robustness to scale variation, and computational efficiency. Overall, the study concludes that YOLOv8 currently achieves the most optimal trade-off between precision, speed, and resource utilization, establishing it as a leading framework for real-time aerial human detection and a promising foundation for future advancements in autonomous surveillance and rescue applications.

Loss of consciousness (fainting) is a critical condition that requires prompt treatment, especially in the context of elderly health services and independent patient care. This research aims to develop a web-based information system that is able to detect fainting events in real-time using the You Only Look Once (YOLO) algorithm version 11, which is one of the latest approaches in deep learning-based object detection. The system is designed to monitor video from the surveillance camera directly, make visual inferences of the patient's posture, and provide automatic notifications if a loss of consciousness condition is detected. The dataset used comes from the Roboflow platform with a total of 9,081 annotated images representing the fainting position. The YOLOv11 model was trained and tested using training data sharing, validation, and testing methods. The test results showed that the model achieved mAP, precison, recall and F1-Score values of 98.70%, 98.00%, 97.30% and 97.65%. The developed information system is able to display the detection visually through the bounding box on the dashboard and record the time of the incident. With this performance, this system shows great potential in improving patient safety through intelligent monitoring and automatic response in hospital, nursing home, and residential environments. This research also opens up opportunities for the development of more adaptive AI-based health monitoring systems and computer vision in the future.

The objective of this study is to examine two powerful components: the YOLO (You Only Look Once) framework for object recognition on edge devices and the MobileNet architecture. With the rising demand for real-time, efficient, and accurate object detection in constrained environments, these models offer distinct advantages suited to different applications. YOLO is renowned for its high accuracy and speed, making it ideal for complex detection tasks, whereas MobileNet is optimized for efficiency, enabling deployment on devices with limited computational resources. The paper discusses the evolution of these models, their architectural differences, and their respective strengths and limitations when implemented on edge devices. Furthermore, we explore the feasibility of integrating these frameworks into a hybrid model that leverages the lightweight feature extraction of MobileNet and the robust detection capabilities of YOLO. Such a hybrid approach could significantly enhance real-time object detection performance across a wide range of hardware platforms.  Researchers and practitioners seeking to deploy advanced object detection models in real-world applications, particularly where computational efficiency and accuracy are paramount may find this review as a valuable resource.

In this paper, a real-time image detection system for unmanned aerial vehicle (UAV) is presented. First, the You Only Look Once (YOLO) detector is retrained to detect and recognize objects in UAV images fast and accurately. The retrained YOLO detector possesses a tradeoff between quickly objects identification and precisely objects localization, accounting for 4 general moving objects (i.e., car, bus, truck and pedestrian) in UAV images. Second, extra 4,000 UAV images shot by the embedded UAV camera are fed into the YOLO which is used to predict bounding-box with label probabilities from a full image. The YOLO is compared with the Faster Region Convolutional Neural Network, as well as other deep-learning frameworks for object detection. Field experiments on UAV videos shot in various backgrounds are performed to testify that the proposed system can detect objects in UAV images effectively and robustly, achieving a real-time detection speed at 15 frames per second and a satisfying accuracy on the wild test set of 400 UAV images with a Graphic Processing Unit (GPU) acceleration.

With the continuous advancement of industrial automation, product quality inspection has become increasingly important in the manufacturing process. Traditional inspection methods, which often rely on manual checks or simple machine vision techniques, suffer from low efficiency and insufficient accuracy. In recent years, deep learning technology, especially the YOLO (You Only Look Once) algorithm, has emerged as a prominent solution in the field of product defect detection due to its efficient real-time detection capabilities and excellent classification performance. This study aims to use the YOLO algorithm to detect and classify defects in product images. By constructing and training a YOLO model, we conducted experiments on multiple industrial product datasets. The results demonstrate that this method can achieve real-time detection while maintaining high detection accuracy, significantly improving the efficiency and accuracy of product quality inspection. This paper further analyzes the advantages and limitations of the YOLO algorithm in practical applications and explores future research directions.

In this chapter, a human detection system based on unsupervised learning method K-means clustering followed by deep learning approach You Only Look Once (YOLO) on thermal imagery has been proposed. Generally, images in the visible spectrum are used to conduct such human detection, which are not suitable for nighttime due to low visibility, hence for evaluation of our system. Hence, long wave infrared (LWIR) images have been used to implement the proposed work in this chapter. The system follows a two-step approach of generating anchor boxes using K-means clustering and then using those anchor boxes in 252 layered single shot detector (YOLO) to predict proper boundary boxes. The dataset of such images is provided by FLIR company. The dataset contains 6822 images for training purposes and 757 images for the validation. This proposed system can be used for real-time object detection as YOLO can achieve much higher rate of processing when compared to traditional method like HAAR cascade classifier in long wave infrared imagery (LWIR).

Advancements in image processing and deep learning offer considerable opportunities for automated defect assessment in civil structures. However, these systems cannot work interactively with human inspectors. Mixed reality (MR) can be adopted to address this by involving inspectors in various stages of the assessment process. This paper integrates You Only Look Once (YOLO) v5n and YOLO v5m with the Canny algorithm for real-time concrete crack detection and skeleton extraction with a Microsoft HoloLens 2 MR device. The YOLO v5n demonstrates a superior mean average precision (mAP) 0.5 and speed, while YOLO v5m achieves the highest mAP 0.5 0.95 among the other YOLO v5 structures. The Canny algorithm also outperforms the Sobel and Prewitt edge detectors with the highest F1 score. The developed MR-based system could not only be employed for real-time defect assessment but also be utilized for the automatic recording of the location and other specifications of the cracks for further analysis and future re-inspections.

This paper provides a comprehensive study of the security of YOLO (You Only Look Once) model series for object detection, emphasizing their evolution, technical innovations, and performance across the COCO dataset. The robustness of YOLO models under adversarial attacks and image corruption, offering insights into their resilience and adaptability, is analyzed in depth. As real-time object detection plays an increasingly vital role in applications such as autonomous driving, security, and surveillance, this review aims to clarify the strengths and limitations of each YOLO iteration, serving as a valuable resource for researchers and practitioners aiming to optimize model selection and deployment in dynamic, real-world environments. The results reveal that YOLOX models, particularly their large variants, exhibit superior robustness compared to other YOLO versions, maintaining higher accuracy under challenging conditions. Our findings serve as a valuable resource for researchers and practitioners aiming to optimize YOLO models for dynamic and adversarial real-world environments while guiding future research toward developing more resilient object detection systems.

As seen in the COVID-19 pandemic, one of the most important measures is physical distance in viruses transmitted from person to person. According to the World Health Organization (WHO), it is mandatory to have a limited number of people in indoor spaces. Depending on the size of the indoors, the number of persons that can fit in that area varies. Then, the size of the indoor area should be measured and the maximum number of people should be calculated accordingly. Computers can be used to ensure the correct application of the capacity rule in indoors monitored by cameras. In this study, a method is proposed to measure the size of a prespecified region in the video and count the people there in real time. According to this method: (1) predetermining the borders of a region on the video, (2) identification and counting of people in this specified region, (3) it is aimed to estimate the size of the specified area and to find the maximum number of people it can take. For this purpose, the You Only Look Once (YOLO) object detection model was used. In addition, Microsoft COCO dataset pre-trained weights were used to identify and label persons. YOLO models were tested separately in the proposed method and their performances were analyzed. Mean average precision (mAP), frame per second (fps), and accuracy rate metrics were found for the detection of persons in the specified region. While the YOLO v3 model achieved the highest value in accuracy rate and mAP (both 0.50 and 0.75) metrics, the YOLO v5s model achieved the highest fps rate among non-Tiny models.