Object Detection from the Satellite Images Using Divide and Conquer Model

In computer vision, significant advances have been made in recent years on object recognition and detection with the rapid development of deep learning, especially deep convolutional neural networks (CNN). The majority of deep learning methods for object detection have been developed for large objects and their performances on small-object detection are not very good. This paper contributes to research in low-resolution small-object detection by evaluating the performances of leading deep learning methods for object detection using a common dataset, which is a new dataset for bird detection, called Little Birds in Aerial Imagery (LBAI), created from real-life aerial imagery data. LBAI contains birds with sizes ranging from 10px to 40px. In our experiments, some of the best deep learning architectures were implemented and applied to LBAI, which include object detection techniques such as YOLOv2, SSH, and Tiny Face, in addition to small instance segmentation techniques including U-Net and Mask R-CNN. Among the object detection methods, experimental results demonstrated that SSH performed the best for easy cases, whereas Tiny Face performed the best for hard cases, i.e. where a cluttered background makes detecting birds difficult. Among small instance segmentation methods, experimental results revealed U-Net achieved slightly better performance than Mask R-CNN.

Compared with the traditional object detection algorithm, the object detection algorithm based on deep learning has stronger robustness to complex scenarios, which is the hot direction of current research. According to the process characteristics of the object detection algorithm based on deep learning, it is divided into two-stage object detection algorithm and single-stage object detection algorithm, focusing on the problems solved by some classical algorithms and their advantages and disadvantages. In view of the problem of object detection, especially small object detection, the commonly used data sets and performance evaluation indicators are summarized; the characteristics, advantages, and detection difficulties of various common data sets are compared; the challenges faced by commonly used object detection methods and small object detection are systematically summarized; the latest work of small object detection methods based on deep learning is sorted out; and the small object detection methods based on multiscale and small object detection methods based on super-resolution are introduced. At the same time, the lightweight strategy for target detection methods and the performance of some lightweight models are introduced; the characteristics, advantages, and limitations of various methods are summarized; and the future development direction of small object detection methods based on deep learning is prospected.

Deep learning methods for object detection in smart manufacturing: A survey

In recent years, computer vision technology has developed rapidly, as one of its important research directions, object detection has received widespread attention due to its high accuracy. Meanwhile, object detection has many application fields, such as intelligent transportation, medical and health, security systems, etc. Traditional object detection methods have limitations when applied to complex real-world scenarios. To improve the shortcomings of conventional methods, deep learning based object detection algorithms have significantly improved the efficiency of object detection and become a research hotspot in object detection. This article summarizes the algorithms into two-stage and one-stage object detection algorithms based on the technical processes and structural differences in handling object detection tasks. Firstly, several common two-stage and one-stage object detection algorithms and their applications in real-world scenarios are introduced. Then their data sets and algorithm performance are analyzed and compared. Finally, according to the results of the comparison, the existing problems of the two-stage object detection algorithm and the one-stage object detection method are discussed, and their future development directions are pointed out.

The development of computer technology and computer vision has had a significant positive impact on the daily lives of blind people, especially in efforts to improve their navigation skills. This research aims to introduce a superior object detection method, especially to support the sustainability and effectiveness of blind navigation. The main focus of the research is the use of YOLOv8, the latest version of YOLO, as an object detection method and distance measurement technology from OpenCV. The main challenge to address involves improving object detection accuracy and performance, which is an important key to ensuring safe and effective navigation for blind people. In this context, blind people often face obstacles in their mobility, especially when walking in environments that may be full of obstacles or obstacles. Therefore, better object detection methods become essential to ensure the identification of nearby objects that may involve obstacles or potential threats, thus preventing possible accidents or difficulties in daily commuting. Involving YOLOv8 as an object detection method provides the advantage of a high level of accuracy, although with a slight increase in detection duration and GPU power consumption compared to previous versions. The research results show that YOLOv8 provides a low error rate, with an average error percentage of 3.15%, indicating very optimal results. Using a combined performance evaluation approach of YOLOv8 and OpenCV distance measurement metrics, this research not only seeks to improve accuracy but also efficiency in detection time and power consumption. This research makes an important contribution to the presentation of technological solutions that can help improve mobility and safety for blind people, bringing a real positive impact on the facilitation of their daily lives.

Accurate identification of road object is crucial for intelligent traffic systems. However, due to the complexity of road traffic scenarios, developing efficient and accurate road object detection methods has been a challenging task. In this study, a new improved method for road object detection is proposed, named Enhanced YOLOv5 algorithm and Deep Schedule Object Detection (DSOD) algorithm. Real traffic scenes from the BDD100k dataset are used for training and testing the object detection model. The dataset consists of 9 different types of road objects in various traffic scenarios. The Mosaic data augmentation algorithm is applied to merge images in the dataset. Mean Average Precision (mAP), Precision (P), and Recall (R) are used as evaluation metrics to compare the enhanced YOLOv5 model with the most common models. Experimental results demonstrate that the DSOD algorithm achieves success in intelligent traffic object detection, significantly improving the accuracy and robustness of road object recognition. Additionally, the developed model shows significant performance improvement in accurately identifying objects in complex traffic scenes. These results suggest that the DSOD algorithm is a promising choice for intelligent road recognition and can easily adapt to different traffic scenarios. Furthermore, employing cloud computing for real-time detection meets the requirements of intelligent cooperative vehicles and enhances their visual perception capabilities.

A survey on object detection in optical remote sensing images

Algorithms based on deep learning are taking off as solutions to several problems in numerous fields. Numerous deep learning architectures like convolutional neural networks, recurrent neural networks, deep belief networks, artificial neural networks and deep neural networks have been used in fields such as audio recognition, machine vision, processing of natural language, recognition of speech, social network filtering, computer vision, translating languages and bioinformatics. One such application of deep learning architectures is object detection. Object detection in satellite and aerial imagery undertakes an important role in a long list of applications and has allured a lot of attention which resulted in exceptional progress in recent years. It has abundant uses in various fields such as surveillance, military, national security, urban planning, environmental applications, traffic control and forestry. Several issues like varying size, background and orientation of the target object make the automatic detection of target in satellite imagery a challenging issue. Recent research in this field has given better speed and accuracy to the detection of the target object. With the rise in the data being generated by the Earth Observation programs, it is becoming much more imperative to find better and efficient ways to exploit this data by improving upon the existing Deep Learning research. In this paper, we bring forth a wide-ranging analysis of the recent advancements in methods of object detection based on deep learning to recognize the objects in satellite imagery.KeywordsDeep learningObject detectionSatellite imageryRemote sensingYou Only Look Once (YOLO)You Only Look Twice (YOLT)Single Shot Detector (SSD)Convolutional Neural Networks (CNN)Faster Region-based Convolutional Neural Networks (Faster RCNN)Hybrid Deep Convolutional Neural Network (HDNN)Satellite Imagery Multiscale Rapid Detection with Windowed Networks (SIMRDWN)

Object detection and tracking has always been one of the important research directions in computer vision. The purpose is to determine whether the object is contained in the input image and enclose the object with a bounding box. However, most object detection and tracking methods are applied to daytime objects, and the processing of nighttime objects is imprecise. In this paper, a spectral-spatial feature enhancement algorithm for nighttime object detection and tracking is proposed, which is inspired by symmetrical neural networks. The proposed method consists of the following steps. First, preprocessing is performed on unlabeled nighttime images, including low-light enhancement, object detection, and dynamic programming. Second, object features for daytime and nighttime times are extracted and modulated with a domain-adaptive structure. Third, the Siamese network can make full use of daytime and nighttime object features, which is trained as a tracker by the above images. Fourth, the test set is subjected to feature enhancement and then input to the tracker to obtain the final detection and tracking results. The feature enhancement step includes low-light enhancement and Gabor filtering. The spatial-spectral features of the target are fully extracted in this step. The NAT2021 dataset is used in the experiments. Six methods are employed as comparisons. Multiple judgment indicators were used to analyze the research results. The experimental results show that the method achieves excellent detection and tracking performance.

The development of technological devices, such as satellites and drones, has made it easier to collect images and videos from above. With rich and diverse data sources, the problem of detecting objects in aerial images is formed to serve real-life situations: rescue missions, social scenarios, security needs, and more. This issue attracts a lot of attention from researchers in computer vision because of its high applicability in real life. However, object detection in images collected from drones faces many significant challenges due to the complex factors of real-life environments. To overcome these difficulties, many studies focus on developing effective models for detecting and tracking objects from UAV systems. In this paper, our primary emphasis is comprehensive survey of methodologies pertaining to horizontal and oriented object detection. We analyzed and compared existing approaches such as CNN-based vs. Transformer-based, Anchor-based vs. Anchor-free. Moreover, we also learned about ways to represent objects using bounding boxes in oriented object detection. After researching many practical and innovative techniques in different approaches, we have carefully selected 15 methods for horizontal object detection and 18 for oriented object detection that were recently researched and developed to conduct classifications, surveys and assessments. We also provide a taxonomy mind map to assist readers in gaining an overview of the methods we surveyed. Additional, we examine 17 aerial image datasets collected from platforms and in various locations worldwide. These are typical datasets used to serve two primary tasks: Horizontal Object Detection and Oriented Object Detection. Then, we compared the experimental resultsof the previously introduced methods on four typical datasets: VisDrone, UAVDT, DOTAv1.0, and HRSC2016. The above datasets present diversity in the number of classes and the complexity of real-life conditions. Furthermore, they have been tested with various methods and shown remarkable results. For the reasons mentioned, we have enough basis to confirm that the comparison results are objective so that other research groups can make accurate comments and assessments on experimental methods on each dataset. We believe that updating and synthesizing the latest research will provide complete and comprehensive information, helping researchers to have more survey material for the development of the field of object detection in the future.

Object detection is one of the most important domains in computer vision tasks, which is an important branch of artificial intelligence. It aims at finding and locating the accurate position of objects in given pictures or videos. With the development of deep learning techniques, more powerful and robust algorithms have emerged to deal with multi-scale, high-level features to overcome the limitations of traditional pipeline of object detectors. The popularity of transformer framework enables larger capacity datasets by processing self-attention mechanism, and the object detection methods have evolved into a new era. This paper first reviews traditional object detection pipeline and brief history of deep learning, afterwards it focuses on the classification of deep learning-based object detection methods covering Convolution Neural Network based and transformer-based methods. Commonly used datasets and metrics are also covered in the next part. The Convolution Neural Network based methods mainly contain two-stage and one-stage detectors, Convolution Neural Network is the underlying structure of these methods convolutional stages are fundamental parts. Transformer-based models convert traditional object detection issues into end-to-end detection, which is widely used in dealing with images. Finally, the promising future of object detection areas are listed to show guidance on future work.

Recently real-time detection, and recognition of an object of interest are becoming vital tasks in visual data processing and computer vision. Various models have been deployed to implement object detection and tracking in multiple fields. However, conventional classifiers are often faced with challenging tasks that visual frames come distorted due to overlapping, camera motion blur, changing subject appearances, and environmental variations. Models using OpenCV-based HAAR feature-based cascade classifiers, without integrating any error minimizing object detection algorithm, were unable to accurately detect an object and track it in a changing environment. Therefore, developing an embedded powerful framework for realtime object detection and recognition becomes more of a vital need for future implementation in various fields. This study presents a powerful technique for a real-time detector that utilizes integrated Deep Learning Neural Networks (DNN) for optimal computational accuracy. Deploying such a framework will ensure the flexibility and reliability of the detector by eliminating the sources of distortion previously mentioned. The model relies on integrating the ImageAI deep learning libraries and You Only Look Once (YOLO-v3) object detection method with a DarkNet53 architecture. The algorithm was trained using the TensorFlow framework to ensure accurate data processing. This paper targets one vital component of our long-term project of developing a multi-agent system, as the proposed model is to be implemented in autonomous agents for the detection of landmines, ocean debris, and wildlife beside environmental scanning missions. In this study the performance of the model has been assessed through detecting and collecting tennis balls as a preliminary test for real-world applications. The model was able to approach the desirable result of surpassing the accuracy of conventional detectors.

Object detection has played a pivotal role in numerous mission-critical applications. This paper presents a focal error diversity framework, called EDI, for strengthening the robustness of object detection ensembles under benign and adversarial scenarios. We introduce an ensemble pruning method for object detection using a novel focal error diversity measure as the robustness synergy indicator. Given a base model pool, it recommends top sub-ensembles with a smaller ensemble size yet achieving equivalent or even better mAP performance than using all available object detection models as a large ensemble. This is made possible by our negative sampling methods for object detection to capture the degree of negative correlations and the focal error diversity to measure the failure independence of component detection models in an ensemble. Extensive experiments on three object detection benchmark datasets validate that EDI effectively selects space-time efficient object detection ensembles with high mAP performance.

In time-sensitive applications such as satellite reconnaissance and disaster response, fast and accurate detection of targets in Synthetic Aperture Radar images is of critical importance. This places dual demands on object detection models for both efficient training and rapid deployment. However, the presence of pervasive speckle noise, unstable image quality, and the complex relationship between targets and backgrounds in SAR images often leads to slow convergence and limited performance when using conventional training methods. To address these challenges, this paper proposes an efficient training method for SAR object detection based on adaptive sample quality, aiming to enhance the learning efficiency and final performance of detection models within limited training time. Experimental results show that, on the HRSID dataset, the proposed method improves mAP@50 by 0.162, 0.117, and 0.109 compared to the Random, CLF-RSD, and CLML strategies. On the SAR-Aircraft dataset, the improvements are 0.189, 0.161, and 0.124.

We are witnessing daily acquisition of large amounts of aerial and satellite imagery. Analysis of such large quantities of data can be helpful for many practical applications. In this letter, we present an automatic content-based analysis of aerial imagery in order to detect and mark arbitrary objects or regions in high-resolution images. For that purpose, we proposed a method for automatic object detection based on a convolutional neural network. A novel two-stage approach for network training is implemented and verified in the tasks of aerial image classification and object detection. First, we tested the proposed training approach using UCMerced data set of aerial images and achieved accuracy of approximately 98.6%. Second, the method for automatic object detection was implemented and verified. For implementation on GPGPU, a required processing time for one aerial image of size 5000 $\times$ 5000 pixels was around 30 s.