Real- Time Image-based Calorie Estimation using YOLOv4 Object Detection

Automation is spread in all daily life and business activities to facilitate human life and working conditions. Robots, automated cars, unmanned vehicles, robot arms, automated factories etc. are getting place in our lives. For these automated actors, one important task is recognizing objects and obstacles in the target environment. Object detection, determining the objects and their location in the environment, is one of the most important solution for this task. With deep learning techniques like Convolutional Neural Network and GPU processing, object detection has become more accurate and faster, and getting attention of researchers. In recent years, many articles about object detection algorithms and usage of object detection have been published. There are surveys about the object detection algorithms, but they have introduced algorithms and focused on common application areas. With this survey, we aim to show that object detection algorithms have very large and different application area. In this study, we have given a brief introduction to deep learning. We have then focused on standard object detection algorithms based on deep learning and their applications in different research areas in recent years to give an idea for future works. Also, the datasets and evaluation metrics used in the research are listed.

Compared with the traditional object detection algorithm, the object detection algorithm based on deep learning has stronger robustness to complex scenarios, which is the hot direction of current research. According to the process characteristics of the object detection algorithm based on deep learning, it is divided into two-stage object detection algorithm and single-stage object detection algorithm, focusing on the problems solved by some classical algorithms and their advantages and disadvantages. In view of the problem of object detection, especially small object detection, the commonly used data sets and performance evaluation indicators are summarized; the characteristics, advantages, and detection difficulties of various common data sets are compared; the challenges faced by commonly used object detection methods and small object detection are systematically summarized; the latest work of small object detection methods based on deep learning is sorted out; and the small object detection methods based on multiscale and small object detection methods based on super-resolution are introduced. At the same time, the lightweight strategy for target detection methods and the performance of some lightweight models are introduced; the characteristics, advantages, and limitations of various methods are summarized; and the future development direction of small object detection methods based on deep learning is prospected.

Object detection is an important part of remote sensing image analysis. With the development of the earth observation technology and convolutional neural network, remote sensing image object detection technology based on deep learning has received more and more attention and research. At present, many excellent object detection algorithms have been proposed and applied in the field of remote sensing. In this paper, the object detection algorithms of remote sensing image is systematically summarized, the main contents include the traditional remote sensing image object detection method and the method based on deep learning, emphasis on summarize the remote sensing image object detection algorithm based on deep learning and its development course, then we introduced the rule of performance evaluation of object detection and datasets that commonly used. Finally, the future development trend is analyzed and prospected. It is hoped that this summary and analysis can provide some reference for future research on object detection technology in remote sensing field.

In recent years, computer vision technology has developed rapidly, as one of its important research directions, object detection has received widespread attention due to its high accuracy. Meanwhile, object detection has many application fields, such as intelligent transportation, medical and health, security systems, etc. Traditional object detection methods have limitations when applied to complex real-world scenarios. To improve the shortcomings of conventional methods, deep learning based object detection algorithms have significantly improved the efficiency of object detection and become a research hotspot in object detection. This article summarizes the algorithms into two-stage and one-stage object detection algorithms based on the technical processes and structural differences in handling object detection tasks. Firstly, several common two-stage and one-stage object detection algorithms and their applications in real-world scenarios are introduced. Then their data sets and algorithm performance are analyzed and compared. Finally, according to the results of the comparison, the existing problems of the two-stage object detection algorithm and the one-stage object detection method are discussed, and their future development directions are pointed out.

Artificial intelligence and machine learning have great ability to solve real-time problems related to various fields and have many applications. One such subfield is deep learning, deep learning has many architectures like DNN, CNN and RNN. One of the major applications of deep learning is object detection. YOLO a SOTA object detector considered to be a smart convolutional neural network having capability of detecting objects in the image, classifying them accordingly and localizing the object perfectly with annotations. YOLOv4 is employed in this work for multiple object detection in image and video for traffic surveillance applications trained using a custom dataset created with Indian road traffic images. 9 different classes namely Car, Bus, Van, Truck, Two-wheeler, Auto, Person, Bicycle and Mini truck are considered in creating custom dataset. Proposed custom model trained for 500 epochs with a custom image dataset has achieved a training mAP of 92% and a training loss of 0.001. Achieved an accuracy of 99.28%, sensitivity of 94.44% and MCC of 96.78% on unseen or test dataset. Proposed model predicted all the classes with an average precision of 98.32%. This proves that our model is robust and proficient in detecting road traffic classes and has scope in developing traffic surveillance systems.

Object detection in images is a computing demanding task which usually needs to deal with the detection of different classes of objects, and thus requiring variations and adaptations easily provided by software solutions. Object detection algorithms are being part of real-time smarter embedded systems, such as automotive, medical, robotics and security systems. In most embedded systems, efficient implementations of object oriented algorithms need to provide high performance, low power consumption, and programmability to allow greater development flexibility. The Histogram of Oriented Gradients (HOG) is one of the most widely used algorithms for object detection in images. In this paper, we show our work towards mapping the HOG algorithm to an FPGA-based system consisting of multiple Nios II softcore processors and bearing in mind high-performance and programmability issues. We show how to reduce 19x the algorithms execution time by source to source transformations and specially avoiding redundant processing. Furthermore, we show how the use of pipelining processing using three Nios II processors allows a speedup of 49x compared to the embedded baseline application.

Computer vision (CV) and human-computer interaction (HCI) are essential in many technological fields. Researchers in CV are particularly interested in real-time object detection techniques, which have a wide range of applications, including inspection systems. In this study, we design and implement real-time object detection and recognition systems using the single-shoot detector (SSD) algorithm and deep learning techniques with pre-trained models. The system can detect static and moving objects in real-time and recognize the object's class. The primary goals of this research were to investigate and develop a real-time object detection system that employs deep learning and neural systems for real-time object detection and recognition. In addition, we evaluated the free available, pre-trained models with the SSD algorithm on various types of datasets to determine which models have high accuracy and speed when detecting an object. Moreover, the system is required to be operational on reasonable equipment. We tried and evaluated several deep learning structures and techniques during the coding procedure and developed and proposed a highly accurate and efficient object detection system. This system utilizes freely available datasets such as MS Common Objects in Context (COCO), PASCAL VOC, and Kitti. We evaluated our system's accuracy using various metrics such as precision and recall. The proposed system achieved a high accuracy of 97% while detecting and recognizing real-time objects.

Low-light object detection involves identifying and locating objects in images captured under poor lighting conditions. It plays a significant role in surveillance and security, night pedestrian recognition, and autonomous driving, showcasing broad application prospects. Most existing object detection algorithms and datasets are designed for normal lighting conditions, leading to a significant drop in detection performance when applied to low-light environments. To address this issue, we propose a Low-Light Detection with Low-Light Enhancement (LDWLE) framework. LDWLE is an encoder-decoder architecture where the encoder transforms the raw input data into a compact, abstract representation (encoding), and the decoder gradually generates the target output format from the representation produced by the encoder. Specifically, during training, low-light images are input into the encoder, which produces feature representations that are decoded by two separate decoders: an object detection decoder and a low-light image enhancement decoder. Both decoders share the same encoder and are trained jointly. Throughout the training process, the two decoders optimize each other, guiding the low-light image enhancement towards improvements that benefit object detection. If the input image is normally lit, it first passes through a low-light image conversion module to be transformed into a low-light image before being fed into the encoder. If the input image is already a low-light image, it is directly input into the encoder. During the testing phase, the model can be evaluated in the same way as a standard object detection algorithm. Compared to existing object detection algorithms, LDWLE can train a low-light robust object detection model using standard, normally lit object detection datasets. Additionally, LDWLE is a versatile training framework that can be implemented on most one-stage object detection algorithms. These algorithms typically consist of three components: the backbone, neck, and head. In this framework, the backbone functions as the encoder, while the neck and head form the object detection decoder. Extensive experiments on the COCO, VOC, and ExDark datasets have demonstrated the effectiveness of LDWLE in low-light object detection. In quantitative measurements, it achieves an AP of 25.5 and 38.4 on the synthetic datasets COCO-d and VOC-d, respectively, and achieves the best AP of 30.5 on the real-world dataset ExDark. In qualitative measurements, LDWLE can accurately detect most objects on both public real-world low-light datasets and self-collected ones, demonstrating strong adaptability to varying lighting conditions and multi-scale objects.

Over the past decade, Deep Learning (DL) techniques have demonstrated remarkable advancements across various domains, driving their widespread adoption. Particularly in medical image analysis, DL received greater attention for tasks like image segmentation, object detection, and classification. This paper provides an overview of DL-based object recognition in medical images, exploring recent methods and emphasizing different imaging techniques and anatomical applications. Utilizing a meticulous quantitative and qualitative analysis following PRISMA guidelines, we examined publications based on citation rates to explore into the utilization of DL-based object detectors across imaging modalities and anatomical domains. Our findings reveal a consistent rise in the utilization of DL-based object detection models, indicating unexploited potential in medical image analysis. Predominantly within Medicine and Computer Science domains, research in this area is most active in the US, China, and Japan. Notably, DL-based object detection methods have gotten significant interest across diverse medical imaging modalities and anatomical domains. These methods have been applied to a range of techniques including CR scans, pathology images, and endoscopic imaging, showcasing their adaptability. Moreover, diverse anatomical applications, particularly in digital pathology and microscopy, have been explored. The analysis underscores the presence of varied datasets, often with significant discrepancies in size, with a notable percentage being labeled as private or internal, and with prospective studies in this field remaining scarce. Our review of existing trends in DL-based object detection in medical images offers insights for future research directions. The continuous evolution of DL algorithms highlighted in the literature underscores the dynamic nature of this field, emphasizing the need for ongoing research and fitted optimization for specific applications.

Deep learning-based object detection in low-altitude UAV datasets: A survey

At the current stage, the rapid Development of autonomous driving has made object detection in traffic scenarios a vital research task. Object detection is the most critical and challenging task in computer vision. Deep learning, with its powerful feature extraction capabilities, has found widespread applications in safety, military, and medical fields, and in recent years has expanded into the field of transportation, achieving significant breakthroughs. This survey is based on the theory of deep learning. It systematically summarizes the Development and current research status of object detection algorithms, and compare the characteristics, advantages and disadvantages of the two types of algorithms. With a focus on traffic signs, vehicle detection, and pedestrian detection, it summarizes the applications and research status of object detection in traffic scenarios, highlighting the strengths, limitations, and applicable scenarios of various methods. It introduces techniques for optimizing object detection algorithms, summarizes commonly used object detection datasets and traffic scene datasets, along with evaluation criteria, and performs comparative analysis of the performance of deep learning algorithms. Finally, it concludes the development trends of object detection algorithms in traffic scenarios, providing research directions for intelligent transportation and autonomous driving.

The objective of this thesis was to evaluate the viability of implementation of an object recognition algorithm driven by deep learning for aerospace manufacturing, maintenance and assembly tasks. Comparison research has found that current computer vision methods such as, spatial mapping was limited to macro-object recognition because of its nodal wireframe analysis. An optical object recognition algorithm was trained to learn complex geometric and chromatic characteristics, therefore allowing for micro-object recognition, such as cables and other critical components. This thesis investigated the use of a convolutional neural network with object recognition algorithms. The viability of two categories of object recognition algorithms were analyzed: image prediction and object detection. Due to a viral epidemic, this thesis was limited in analytical consistency as resources were not readily available. The prediction-class algorithm was analyzed using a custom dataset comprised of 15 552 images of the MaxFlight V2002 Full Motion Simulator’s inverter system, and a model was created by transfer-learning that dataset onto the InceptionV3 convolutional neural network (CNN). The detection-class algorithm was analyzed using a custom dataset comprised of 100 images of two SUVs of different brand and style, and a model was created by transfer-learning that dataset onto the YOLOv3 deep learning architecture. The tests showed that the object recognition algorithms successfully identified the components with good accuracy, 99.97% mAP for prediction-class and 89.54% mAP. For detection-class. The accuracies and data collected with literature review found that object detection algorithms are accuracy, created for live -feed analysis and were suitable for the significant applications of AVI and aircraft assembly. In the future, a larger dataset needs to be complied to increase reliability and a custom convolutional neural network and deep learning algorithm needs to be developed specifically for aerospace assembly, maintenance and manufacturing applications.

This paper proposes a Computer Vision and Deep Learning-based system for predicting the calorie contents of multiple-dish food items by taking their top view images. The system leverages Convolutional Neural Networks (CNNs) through current research in Object Detection and Semantic Segmentation to carry out a refined Image Segmentation procedure to loosely simulate Instance Segmentation, in which each pixel is identified from the instance of objects for each object detected in an image. The identified pixels are in the form of masks/segmentations associated with distinct food items. Then, these output masks are used for carrying out volume and mass estimation for the detected food items using a reference object. Using the estimated volume, mass, and other prior known information, the calories for food items are estimated through a calorie table lookup. The system developed in this research accomplishes transfer learning by also evaluating the results on previously unseen data. Upon evaluation, the system achieves a mean average precision (mAP) of 89.30% for object detection and a percentage accuracy of 93.06% for calorie prediction.

Basic tasks in computer vision, object detection and localization have many applications in autonomous driving, robotics, surveillance, and healthcare [1]. Deep learning has enabled previously unheard-of levels of accuracy and robustness in object detection and localization tasks, revolutionizing the area in recent years. This paper provides a thorough overview of the most recent developments and approaches in the application of deep learning algorithms for localization and object detection. First, we go over the basic ideas behind object identification and localization, emphasizing the difficulties caused by different item sizes, occlusions, and cluttered backgrounds. We then explore the nuances of deep learning architectures designed specifically for these kinds of tasks: anchor-free approaches like Center Net, single-shot detectors like YOLO, and region-based detectors like Faster R-CNN. We investigate feature extraction networks, object detecting heads, and training procedures for best performance as we investigate the underlying mechanics of these architectures. We also go over important assessment measures and datasets that are necessary for benchmarking and training object detection algorithms. We stress the significance of using strong evaluation techniques to guarantee the dependability and capacity for generalization of the suggested algorithms. Apart from technical concerns, we investigate practical uses cases where object detection and localization are essential, like autonomous vehicle pedestrian identification, surveillance system object tracking, and medical imaging anomaly detection. Lastly, we examine new developments and directions for the discipline, such as integrating multimodal data, handling domain shifts, and improving object detection algorithms' interpretability and fairness. Our goal is to stimulate further developments in computer vision systems by offering scholars, professionals, and hobbyists insightful knowledge about the problems and cutting-edge methods of object recognition and localization through this thorough review. The content of the paper is succinctly summarized in this abstract, which also highlights the significance of deep learning, object detection and localization, important methodology, datasets, applications, and future developments in the field.

Object detection is a crucial problem in computer vision that involves accurately locating objects in images or videos to identify instances to be detected. It has various applications, including facial detection, intelligent driving assistance, and satellite remote sensing detection. This review aims to aid researchers in quickly comprehending object detection. It covers the concept of object detection algorithms, analyzes the development history of object detection algorithms, and elaborates on the evolution process of object detection algorithms from independent development to combination with deep learning technology. The article divides object detection based on whether anchor boxes are generated during the detection process. It discusses the types of anchor boxes and non-anchor boxes and analyzes the current research status of single-stage and two-stage object detection algorithms. It also summarizes classic model structures in the development process of object detection algorithms and introduces difficulties in object detection. The article aims to solve the problem of object detection with a small number of samples and without detailed annotations during the training process. It summarizes and compares the advantages and disadvantages of various classic models, mainstream datasets, and evaluation indicators. Additionally, it looks forward to current challenges and future development directions in the field of object detection.