Preprocessing of Object Images Before Their Detection Using YOLO Neural Network

Object detection and recognition is an essential task in computer vision with numerous real-world applications such as surveillance, self-driving cars, and robotics. In recent years, deep learning-based approaches have significantly improved the accuracy and speed of object detection and recognition. The You Only Look Once version 3 (YOLOv3) algorithm is a popular deep learning-based approach that can detect and recognize objects in real-time. The Common Objects in Context (COCO) dataset is a large-scale dataset with over 330,000 labeled images and more than 2.5 million object instances, making it a popular choice for object detection and recognition tasks. In this paper, we propose a deep learning-based approach for real-time object detection and recognition using the YOLOv3 architecture and COCO dataset. We evaluate our approach based on several performance metrics, including mean average precision (mAP), frames per second (FPS), total object detection time, object detection accuracy, false positive rate, number of detected objects, and mean intersection over union (mIoU). Our results show that our approach achieves a mean average precision of 0.76 on the COCO dataset and a real-time performance of 40 frames per second on a single GPU. Additionally, our approach achieves an object detection accuracy of 93.5%, a false positive rate of 6.5%, and a mean intersection over union of 0.65. Our proposed approach shows promising results for real-time object detection and recognition and can be applied to various real-world applications.

Lesion segmentation in dermoscopic images significantly enhances the diagnostic performance of AI-based classification models. However, conventional methods often require pixel-level annotations, which are resource-intensive and prone to errors caused by external artifacts, such as hair and skin markings. We propose a hybrid framework called SAM-enhanced YOLO, which integrates the Segment Anything Model (SAM) with You Only Look Once (YOLO) for precise pixel-level segmentation. This method combines YOLO's efficient lesion localization with SAM's advanced zero-shot segmentation capabilities. To further validate the framework, we compared it against traditional methods, including GrabCut and Otsu's thresholding, as well as SAM used without YOLO (SAM-only). For SAM-only, lesion segmentation was initialized at the image center to simulate a typical dermoscopic imaging setup. SAM-enhanced YOLO demonstrated superior segmentation performance, achieving an Intersection over Union (IoU) of 0.738 and an F1-score (the harmonic mean of precision and recall) of 0.833, compared to 0.578 and 0.683 with SAM-only, respectively. This represents a 28% improvement in IoU and a 22% improvement in F1-score compared to SAM-only. The results were consistent across lesion shapes and contrast conditions, with SAM-enhanced YOLO exhibiting the lowest variability and highest robustness among the evaluated methods. By reducing the need for pixel-level annotations and outperforming both standalone SAM and traditional methods, SAM-enhanced YOLO provides a scalable and resource-efficient solution for dermoscopic lesion segmentation. This framework holds significant potential for improving diagnostic workflows in clinical and resource-limited settings.

Object detection is a fundamental problem in computer vision, with applications spanning self-driving cars, surveillance systems, medical imaging, robotics, and smart cities. Among the myriad of algorithms developed for this task, the You Only Look Once (YOLO) family stands out for its ability to perform real-time and accurate object detection. This article provides a comprehensive analysis of the YOLO algorithm series, from YOLOv1 to YOLOv8, evaluating them across key performance metrics, including precision, recall, mean Average Precision (mAP), frames per second (FPS), and overall effectiveness. Unlike traditional two-stage detectors such as R-CNN, YOLO formulates object detection as a single regression problem: a single pass over the image simultaneously predicts bounding boxes and class probabilities. This end-to-end design enables YOLO to achieve high speed while maintaining a competitive accuracy-efficiency trade-off. We examine architectural innovations across YOLO versions, including batch normalization, anchor boxes, residual blocks, feature pyramid networks, and attention mechanisms, and discuss their impact on performance. Lightweight models (e.g., YOLOv5-Nano, YOLOv8-Small) are explored with a focus on their suitability for mobile and embedded systems, highlighting YOLO’s adaptability to resource-constrained environments. Challenges such as small object detection, occlusion, and domain-specific tuning are also addressed. This article serves as a practical guide for researchers, developers, and practitioners aiming to leverage YOLO for real-world object detection tasks.

A challenging and attractive task in computer vision is underwater object detection. Although object detection techniques have achieved good performance in general datasets, problems of low visibility and color bias in the complex underwater environment have led to generally poor image quality; besides this, problems with small targets and target aggregation have led to less extractable information, which makes it difficult to achieve satisfactory results. In past research of underwater object detection based on deep learning, most studies have mainly focused on improving detection accuracy by using large networks; the problem of marine underwater lightweight object detection has rarely gotten attention, which has resulted in a large model size and slow detection speed; as such the application of object detection technologies under marine environments needs better real-time and lightweight performance. In view of this, a lightweight underwater object detection method based on the MobileNet v2, You Only Look Once (YOLO) v4 algorithm and attentional feature fusion has been proposed to address this problem, to produce a harmonious balance between accuracy and speediness for target detection in marine environments. In our work, a combination of MobileNet v2 and depth-wise separable convolution is proposed to reduce the number of model parameters and the size of the model. The Modified Attentional Feature Fusion (AFFM) module aims to better fuse semantic and scale-inconsistent features and to improve accuracy. Experiments indicate that the proposed method obtained a mean average precision (mAP) of 81.67% and 92.65% on the PASCAL VOC dataset and the brackish dataset, respectively, and reached a processing speed of 44.22 frame per second (FPS) on the brackish dataset. Moreover, the number of model parameters and the model size were compressed to 16.76% and 19.53% of YOLO v4, respectively, which achieved a good tradeoff between time and accuracy for underwater object detection.

YOLO-YCbCr based smoke segmentation method for fire detection was proposed in this study to enhance smoke segmentation performance with reduction in computational cost. The proposed method consists of the deep learning object detection model, You Only Look Once (YOLO), and the color space-based segmentation model, rule-based YCbCr. YOLO is used to detect smoke objects in the input fire images through bounding boxes. The images in the bounding boxes are characterized based on YCbCr color space and the proposed YCbCr rules derived by considering smoke image characteristics segment smoke region. In order to evaluate the smoke segmentation performance, six different fire incident video data were used. The mean intersection over union (IoU) value of the proposed method was improved by approximately 31.3% and 24.5% respectively when compared to the reference models: YOLO-RGB model and YOLO-CIELAB model. It was found that YOLO significantly reduced the erroneous smoke segmentation and YCbCr rules derived from the smoke color features were effective in the smoke segmentation.

The objective of this study is to examine two powerful components: the YOLO (You Only Look Once) framework for object recognition on edge devices and the MobileNet architecture. With the rising demand for real-time, efficient, and accurate object detection in constrained environments, these models offer distinct advantages suited to different applications. YOLO is renowned for its high accuracy and speed, making it ideal for complex detection tasks, whereas MobileNet is optimized for efficiency, enabling deployment on devices with limited computational resources. The paper discusses the evolution of these models, their architectural differences, and their respective strengths and limitations when implemented on edge devices. Furthermore, we explore the feasibility of integrating these frameworks into a hybrid model that leverages the lightweight feature extraction of MobileNet and the robust detection capabilities of YOLO. Such a hybrid approach could significantly enhance real-time object detection performance across a wide range of hardware platforms.  Researchers and practitioners seeking to deploy advanced object detection models in real-world applications, particularly where computational efficiency and accuracy are paramount may find this review as a valuable resource.

The coronavirus disease (COVID-19) is primarily disseminated through physical contact. As a precaution, it is recommended that indoor spaces have a limited number of people and at least one meter apart. This study proposes a real-time method for monitoring physical distancing compliance in indoor spaces using computer vision and deep learning techniques. The proposed method utilizes YOLO (You Only Look Once), a popular convolutional neural network-based object detection model, pre-trained on the Microsoft COCO (Common Objects in Context) dataset to detect persons and estimate their physical distance in real time. The effectiveness of the proposed method was assessed using metrics including accuracy rate, frame per second (FPS), and mean average precision (mAP). The results show that the YOLO v3 model had the most remarkable accuracy (87.07%) and mAP (89.91%). On the other hand, the highest fps rate of up to 18.71 was achieved by the YOLO v5s model. The results demonstrate the potential of the proposed method for effectively monitoring physical distancing compliance in indoor spaces, providing valuable insights for future use in other public health scenarios.

Object detection is a common and challenging problem in today's world. Also due to the rapid development of deep learning employing underlying deep models over the past ten years, many researchers have investigated and contributed to improving the performance of object identification and associated tasks such as object classification, localization, and segmentation. Inference time and detection accuracy are used to rate the effectiveness of any object detector. In terms of detection accuracy, it is observed that the two-stage detectors outperform the single-stage detector however, single-stage detectors outperform their rivals in terms of inference time. Additionally, You Only Look Once (YOLO) and its versions have improved detection accuracy, some-times surpassing two-stage detectors. In this study, we performed a co-design methodology for hardware and software (HW/SW) aimed at Central Processing Unit (CPU) + Field Programmable Gate Array (FPGA) based heterogeneous platform which is Xilinx FPGA Kria KV260. A CNN-based algorithm is first extended to the YOLOv4, v5L, and v5s framework before being implemented on the Kria KV260, an out-of-the-box platform for developing advanced vision applications. A reduced computation time is observed for the deployment of the Machine Learning model on Kria KV260.

Object detection and tracking is one of the key applications of wireless sensor networks (WSNs). The key issues associated with this application include network lifetime, object detection and localization accuracy. To ensure the high quality of the service, there should be a trade-off between energy efficiency and detection accuracy, which is challenging in a resource-constrained WSN. Most researchers have enhanced the application lifetime while achieving target detection accuracy at the cost of high node density. They neither considered the system cost nor the object localization accuracy. Some researchers focused on object detection accuracy while achieving energy efficiency by limiting the detection to a predefined target trajectory. In particular, some researchers only focused on node clustering and node scheduling for energy efficiency. In this study, we proposed a mobile object detection and tracking framework named the Energy Efficient Object Detection and Tracking Framework (EEODTF) for heterogeneous WSNs, which minimizes energy consumption during tracking while not affecting the object detection and localization accuracy. It focuses on achieving energy efficiency via node optimization, mobile node trajectory optimization, node clustering, data reporting optimization and detection optimization. We compared the performance of the EEODTF with the Energy Efficient Tracking and Localization of Object (EETLO) model and the Particle-Swarm-Optimization-based Energy Efficient Target Tracking Model (PSOEETTM). It was found that the EEODTF is more energy efficient than the EETLO and PSOEETTM models.

Fast detection of cannibalism behavior of juvenile fish based on deep learning

Intersection over Union (IoU) is an important function in object detection based on deep learning. But, there is a gap between the used distance losses and this metric value of maximizing. This paper improves the IoU function based on IoU. Redesigned the neural network structure, and used the PASCAL VOC2012 dataset. The structure model of the neural network is compare with others in the accuracy of object detection. Experimental results show that our method can achieve good results in object detection. The approach provides a new idea for object detection.

This paper outlines an FPGA-accelerated perception sub-system for real-time object detection employing the You Only Look Once (YOLO) v5 model. The system uses the Deep Learning Processing Unit (DPU) B4096 implemented on the Xilinx Kria KV260 platform for efficient deep learning inference. The implementation shows a <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$7.5 \times$</tex> speedup over traditional CPU solutions, achieving up to 59.94 Frames Per Second (FPS) for the YOLOv5 Nano model and 17.4 FPS for the YOLOv5 Large model. The system further shows high detection accuracy with a mean Average Precision (mAP) of 0.76 and an average Intersection over Union (IoU) of 0.72 for the intelligent traffic perception system. The implementation incorporates optimized data pipelines, quantized models, and high-throughput inference methodologies within the Kria Docker environment, utilizing OpenCV, Xilinx Runtime(XRT), and Vitis AI Runtime (VART). The results highlight that an effective hardware-software co-design approach, combining high throughput, optimal resource utilization, and reliable inference accuracy, significantly enhances the performance of FPGA-based AI (Artificial intelligence) workloads in applications such as surveillance, industrial automation, and production line safety.

Object detection has become the cornerstone of various real-world applications, ranging from autonomous driving where it helps detect road objects to medical imaging for early disease prediction and gesture recognition systems. Due to their ability to operate continuously and cost-effectively, computer vision models are increasingly being employed in surveillance and monitoring tasks. Unlike humans, who can intuitively recognize and understand objects within images, machines require advanced algorithms to mimic such capabilities. A key challenge in computer vision lies in recognizing and tracking objects in real-time with accuracy and reliability. Human visual systems perform these tasks naturally and swiftly, enabling complex activities like driving. For computers to match such performance, efficient object detection models along with additional hardware such as sensors are essential. This study presents a comparative analysis of two popular deep learning-based object detection algorithms You Only Look Once (YOLO) and Faster Region-based Convolution Neural Network (Faster RCNN). Both models are evaluated based on their detection accuracy, speed, and performance in real-time scenarios. The paper aims to highlight the strengths and limitations of each model, offering insights into their suitability for different applications. The findings suggest that while both algorithms have their merits, the choice between them depends on the specific requirements of a task, such as the trade-off between detection speed and precision. Comparative study shows that Faster RCNN outperforms its accuracy compared with YOLO.

YOLO Based Breast Masses Detection and Classification in Full-Field Digital Mammograms

In this paper we propose a novel set of techniques for real-time Multi-Target Multi-Camera (MTMC) tracking of vehicles in congested, low speed environments, such as those of drive-thru scenarios, where metrics such as the number of vehicles, time of stay, and interactions between vehicles and staff are needed and must be highly accurate. Traditional methods of tracking based on Intersection over Union (IoU) and basic appearance features produce fragmented trajectories of misidentifications under these conditions. Furthermore, detectors, such as YOLO (You Only Look Once) architectures, exhibit different types of errors due to vehicle proximity, lane changes, and occlusions. Our methodology introduces a new tracker algorithm, Multi-Object Tracker based on Corner Displacement (MTCD), that improves the robustness against bounding box deformations by analysing corner displacement patterns and several other factors involved. The proposed solution was validated on real-world drive-thru footage, outperforming standard IoU-based trackers like Nvidia Discriminative Correlation Filter (NvDCF) tracker. By maintaining accurate cross-camera trajectories, our framework enables the extraction of critical operational metrics, including vehicle dwell times and person–vehicle interaction patterns, which are essential for optimizing service efficiency. This study tackles persistent tracking challenges in constrained environments, showcasing practical applications for real-world surveillance and logistics systems where precision is critical. The findings underscore the benefits of incorporating geometric resilience and delayed decision-making into MTMC architectures. Furthermore, our approach offers the advantage of seamless integration with existing camera infrastructure, eliminating the need for new deployments.