Multi-Scale Real-Time Object Detection With Densely Connected Network

The you-only-look-once (YOLO) v2 object detector uses a single stage object detection network. YOLO v2 is faster than other two-stage deep learning object detectors, such as regions with convolutional neural networks (Faster R-CNNs).The YOLO v2 model runs a deep learning CNN on an input image to produce network predictions. The object detector decodes the predictions and generates bounding boxes YOLO v2 uses anchor boxes to detect classes of objects in an image. For more details, see Anchor Boxes for Object Detection. The YOLO v2 predicts these three attributes for each anchor box: Intersection over union (IoU) — Predicts the objectness score of each anchor box. Anchor box offsets — Refine the anchor box position. Class probability — Predicts the class label assigned to each anchor box. The figure shows predefined anchor boxes (the dotted lines) at each location in a feature map and the refined location after offsets are applied. Matched boxes with a class are in color. You can design a custom YOLO v2 model layer by layer. The model starts with a feature extractor network, which can be initialized from a pretrained CNN or trained from scratch. The detection subnetwork contains a series of Conv, Batch norm, and ReLu layers, followed by the transform and output layers, yolov2TransformLayer and yolov2OutputLayer objects, respectively.yolov2TransformLayertransforms the raw CNN output into a form required to produce object detections.yolov2OutputLayerdefines the anchor box parameters and implements the loss function used to train the detect.

Object detection is a challenging computer vision problem with numerous practical applications. Due to low accuracy and slow detection speed in object detection, we propose a real-time object detection algorithm based on YOLOv3. First, to solve the problem that features are likely to be lost in the feature extraction process of YOLOv3, a DB-Darknet-53 feature extraction network embedded in inception structure is designed, which effectively reduces the loss of features. Second, the detection network of YOLOv3 and the reuse of deep features in multiscale detection network are improved. Finally, the numbers and sizes of anchor boxes are selected by K -means clustering analysis, and the detection model is obtained by means of multiscale training. The improved algorithm has a mean average precision of 0.835 on the PASCAL VOC data set and a detection speed of 35.8 f / s, which is better than YOLOv3.

Object detection and recognition of road scenes are crucial tasks of the autonomous driving environmental perception system. The low inference speed and accuracy in object detection models hinder the development of autonomous driving technology. Searching for improvement of detection accuracy and speed is still a challenging task. For solving these problems, we proposed an MCS-YOLO algorithm. Firstly, a coordinate attention module is inserted into the backbone to aggregate the feature map’s spatial coordinate and cross-channel information. Then, we designed a multiscale small object detection structure to improve the recognition sensitivity of dense small object. Finally, we applied the Swin Transformer structure to the CNN to enable the network to focus on contextual spatial information. Conducting ablation study on the autonomous driving dataset BDD100K, MCS-YOLO algorithm achieves a mean average precision of 53.6% and a recall rate of 48.3%, which are 4.3% and 3.9% better than the YOLOv5s algorithm respectively. In addition, it can achieve real-time detection speed of 55 frames per second in a real scene. The results show that the MCS-YOLO algorithm is effective and superior in the task of automatic driving object detection.

Spatial-temporal action detection in videos is a challenging problem that has attracted considerable attention in recent years. Most current approaches address action detection as an object detection problem, which utilizes successful object detection frameworks such as Faster R-CNN to operate action detection at every single frame first, and then generates action tubes by linking bounding boxes across the whole video in an offline fashion. However, unlike object detection in static images, temporal context information is vital for action detection in videos. Therefore, we propose an online action detection model that leverages the spatial-temporal context information existing in videos to perform action inference and localization. More specifically, we try to depict the spatial-temporal context pattern of actions via an encoder-decoder model that is based on a convolutional recurrent neural network. The model accepts a video snippet as input and encodes the dynamic information inside the snippet in the forward pass. During the backward pass, the decoder resolves the information for action detection with the current appearance or motion cue at each time stamp. In addition, we devise an incremental action-tube construction algorithm that enables our model to accomplish action prediction ahead of time and performs action detection in an online fashion. To evaluate the performance of our method, we conduct experiments on three popular public datasets UCF-101, UCF-Sports, and J-HMDB-21. The experimental results demonstrate that our method can achieve competitive or superior performance when compared to the state-of-the-art methods. To encourage further research, we release our project on "https://github.com.hjjpku.OATD."

ABSTRACTObject detection has played an important role in the remote sensing (RS) image understanding domain, but it still suffers from challenges, including the complexity of the image background, the variety of objects and differences of target scales. Although many studies applying deep learning methods to object detection have been presented, effective methods of multiscale object detection in RS images are still lacking. In this paper, we propose a novel object detection approach based on the Multiscale-SELU-DenseNet (MSE-DenseNet) and the dynamic anchor assignment (DAA) strategy. We fuse a highly modified DenseNet and a feature pyramid network into the MSE-DenseNet to extract multi-level feature descriptions of RS images, and then we use them to detect objects on various scales. To further improve the detection performance, we propose a DAA strategy for assigning prior anchor boxes. The experimental results show that our proposed method outperforms state-of-the-art detection methods on the VHR-10 dataset and maintains a real-time detection speed.

Object detection is a critical component in intelligent surveillance, disaster response, and autonomous dronebased monitoring systems. In recent years, the You Only Look Once (YOLO) family of algorithms has transformed real-time object detection by achieving an effective balance between detection speed and accuracy. This review paper presents a comprehensive analysis of YOLO models from YOLOv1 to YOLOv8, emphasizing their architectural evolution, backbone development, and feature extraction strategies. Each version’s key innovations are discussed in detail—from YOLOv1’s unified detection framework and YOLOv2’s introduction of anchor boxes to YOLOv8’s advanced anchor-free detection mechanism. The comparative evaluation focuses on model accuracy (mAP), inference speed (FPS), and deployment feasibility for embedded and UAV-based systems. Findings from existing literature and experimental insights reveal that successive YOLO versions have progressively enhanced small object detection, robustness to scale variation, and computational efficiency. Overall, the study concludes that YOLOv8 currently achieves the most optimal trade-off between precision, speed, and resource utilization, establishing it as a leading framework for real-time aerial human detection and a promising foundation for future advancements in autonomous surveillance and rescue applications.

Video object detection is essential for airport surface surveillance, but the objects on the scene are mostly small objects with low resolution, they have no obvious feature information. Due to the scale differences of the objects and the fixed receptive field on the feature maps, detectors cannot model multi‐scale context information and cover all objects. In addition, although the video detection algorithm can be used as a method to solve the problem of small object detection, the temporal feature fusion method of current video detection is very dependent on the quality of a single feature map. Therefore, this paper aims to enhance the features of small objects of a single image. First, an attentional multi‐scale feature fusion enhancement (A‐MSFFE) network is built on the memory‐enhanced global‐local aggregation (MEGA) to supplement semantic and spatial information of small objects. Then, a context feature enhancement (CFE) module is designed for obtaining different receptive fields through different dilated convolutions. Meanwhile, a video detection dataset about the airport is established. Finally, the experimental results show that the proposed method can improve the detection accuracies of small objects and outperform other state‐of‐the‐art video object detection algorithms in self‐built airport dataset.

Compared with the traditional object detection algorithm, the object detection algorithm based on deep learning has stronger robustness to complex scenarios, which is the hot direction of current research. According to the process characteristics of the object detection algorithm based on deep learning, it is divided into two-stage object detection algorithm and single-stage object detection algorithm, focusing on the problems solved by some classical algorithms and their advantages and disadvantages. In view of the problem of object detection, especially small object detection, the commonly used data sets and performance evaluation indicators are summarized; the characteristics, advantages, and detection difficulties of various common data sets are compared; the challenges faced by commonly used object detection methods and small object detection are systematically summarized; the latest work of small object detection methods based on deep learning is sorted out; and the small object detection methods based on multiscale and small object detection methods based on super-resolution are introduced. At the same time, the lightweight strategy for target detection methods and the performance of some lightweight models are introduced; the characteristics, advantages, and limitations of various methods are summarized; and the future development direction of small object detection methods based on deep learning is prospected.

Object detection in videos is widely used in entertainment, robotics, surveillance etc. A major challenge in effective object detection is observed when there is occlusion, bad illumination or cluttered background. Besides, cameras do not provide any mechanism for detecting moving objects after capture. Researchers have proposed different methods for object detection in video frames, ranging from traditional to deep learning approaches. However, using the right method in the right situation for efficient and accurate detection is a concern. Even though deep learning has shown high accuracy in detection, the training and testing time and cost is a concern. In our research, we explore the best motion models for tracking objects in a video sequence. The characteristics of each model was analyzed and the results were compared using different types of videos. Our observations determine that depending on the quality of input video, traditional approaches show high accuracy in detection, comparable to state-of-the art methods.

Object detection is an important yet challenging task in video understanding & analysis, where one major challenge lies in the proper balance between two contradictive factors: detection accuracy and detection speed. In this paper, we propose a new adaptive patch-of-interest composition approach for boosting both the accuracy and speed for object detection. The proposed approach first extracts patches in a video frame which have the potential to include objects-of-interest. Then, an adaptive composition process is introduced to compose the extracted patches into an optimal number of sub-frames for object detection. With this process, we are able to maintain the resolution of the original frame during object detection (for guaranteeing the accuracy), while minimizing the number of inputs in detection (for boosting the speed). Experimental results on various datasets demonstrate the effectiveness of the proposed approach.

Object detection has become the cornerstone of various real-world applications, ranging from autonomous driving where it helps detect road objects to medical imaging for early disease prediction and gesture recognition systems. Due to their ability to operate continuously and cost-effectively, computer vision models are increasingly being employed in surveillance and monitoring tasks. Unlike humans, who can intuitively recognize and understand objects within images, machines require advanced algorithms to mimic such capabilities. A key challenge in computer vision lies in recognizing and tracking objects in real-time with accuracy and reliability. Human visual systems perform these tasks naturally and swiftly, enabling complex activities like driving. For computers to match such performance, efficient object detection models along with additional hardware such as sensors are essential. This study presents a comparative analysis of two popular deep learning-based object detection algorithms You Only Look Once (YOLO) and Faster Region-based Convolution Neural Network (Faster RCNN). Both models are evaluated based on their detection accuracy, speed, and performance in real-time scenarios. The paper aims to highlight the strengths and limitations of each model, offering insights into their suitability for different applications. The findings suggest that while both algorithms have their merits, the choice between them depends on the specific requirements of a task, such as the trade-off between detection speed and precision. Comparative study shows that Faster RCNN outperforms its accuracy compared with YOLO.

With the rapid development of autonomous driving technology, traditional object detection algorithms often face challenges such as the trade-off between model parameters and recognition accuracy, insufficient detection accuracy, and slow detection speed when dealing with vehicle and pedestrian detection tasks in complex scenarios. To address these challenges, we propose a novel lightweight real-time driving scene detection network, FEEP-YOLO. Based on the YOLOv8 algorithm, our network not only maintains high detection accuracy but also achieves faster training speed and fewer model parameters. FEEP-YOLO employs a lightweight network, Faster Net, to significantly reduce model parameters, thereby accelerating detection speed and better meeting real-time requirements. To further improve detection accuracy, we introduce an EMA attention module into the network and optimize the bounding box loss function, adopting the EIOU loss function to enhance target features and reduce background interference. Additionally, to detect small objects more accurately, we add feature layers rich in semantic information to the detection end. Experimental results demonstrate that FEEP-YOLO outperforms YOLOv8 in terms of both detection speed and accuracy on the KITTI and SODA datasets, while significantly reducing the number of model parameters and model size. FEEP-YOLO achieves high detection speed while improving detection accuracy and reducing computational resource consumption, meeting the practical application requirements under limited computing power, memory space and power consumption. The key contribution of FEEP-YOLO lies in its ability to balance accuracy speed, and efficiency, making it a robust solution for real-time autonomous driving applications in complex environments.

Object detection and recognition is an essential task in computer vision with numerous real-world applications such as surveillance, self-driving cars, and robotics. In recent years, deep learning-based approaches have significantly improved the accuracy and speed of object detection and recognition. The You Only Look Once version 3 (YOLOv3) algorithm is a popular deep learning-based approach that can detect and recognize objects in real-time. The Common Objects in Context (COCO) dataset is a large-scale dataset with over 330,000 labeled images and more than 2.5 million object instances, making it a popular choice for object detection and recognition tasks. In this paper, we propose a deep learning-based approach for real-time object detection and recognition using the YOLOv3 architecture and COCO dataset. We evaluate our approach based on several performance metrics, including mean average precision (mAP), frames per second (FPS), total object detection time, object detection accuracy, false positive rate, number of detected objects, and mean intersection over union (mIoU). Our results show that our approach achieves a mean average precision of 0.76 on the COCO dataset and a real-time performance of 40 frames per second on a single GPU. Additionally, our approach achieves an object detection accuracy of 93.5%, a false positive rate of 6.5%, and a mean intersection over union of 0.65. Our proposed approach shows promising results for real-time object detection and recognition and can be applied to various real-world applications.

During past few years’ significant usage of video monitoring has been observed in several places. Video monitoring has always helped in improvement of security specific aspects. These systems provide major helping hand in monitoring through multiple object detection methods. However, there are certain challenges related to weather conditions which needs to be addressed. In view of this in this paper, we study multiple object detection in surveillance videos through hybrid deep gaussian mixture ensembles. This method integrates multiple deep gaussian mixture components to form ensembles which helps to develop multiple object detection solutions in surveillance videos. The computational system consists of ensemble of three major deep gaussian mixture components. The ensemble pipeline is formed with augmenting, bagging and stacking methods. The ensemble consists of hybrid object detection paradigm with steps background analysis, video pre-processing, data integration, object detection, foreground detection and post-processing. The computational pipeline is successfully experimented with ViSOR and CDnet 2014 benchmarked datasets. All results are validated with accuracy, precision, sensitivity or recall, specificity, F1-Score and RMSE metrics. Several comparative studies are performed with state-of-the-art methods as well as baselines. The experimental results demonstrate superiority of this method in comparison with other methods. Ablation studies have also been performed here with superior results. This system presents robustness in multiple object detection for real life challenges such as sudden illumination variation, shadow presence, long term occlusion and formation of dynamic backgrounds. It provides cost-effective, more profitable, efficient and sustainable real time multiple object detection solutions

Unmanned Aerial Vehicles (UAVs) have gained significant traction for real-time surveillance applications such as object tracking and search-and-rescue missions. A key enabler of these capabilities is the integration of a real-time, highly accurate object detection system. While available two-stage detectors like R-CNN, Fast R-CNN, Faster R-CNN, and Mask R-CNN achieve high detection accuracy and precise localization by dividing the image into regions and classifying each region, they are often slow, complex, and resource-intensive, making them unsuitable for real-time applications. To address this limitation, this research utilizes a Darknet-based YOLOv3 (You Only Look Once, Version 3), a state-of-the-art algorithm for real-time object detection in videos, live feeds, and images. Leveraging a deep Convolutional Neural Network (CNN), YOLOv3 efficiently learns features and predicts object locations and class probabilities in a single pass, ensuring high-speed and reliable detection. A real-time aerial surveillance system for quadcopter application using machine vision is proposed. The training dataset, obtained from the internet and self-taken images from a camera, was manually annotated into three critical categories: suspect, bandit, and weapon. The dataset was subsequently divided into training and testing subsets. Experimental results demonstrate that the proposed system achieves outstanding detection accuracy, with an overall mean average precision (mAP@0.5) of 93.82%, precision of 94%, and recall of 83%. Compared to a ResNet-50-based Faster R-CNN model, the YOLOv3-based approach outperformed, achieving success rates of 0.81 for the Bandit class and 1.00 for both Suspect and Weapon classes. This research improves drone-based AI for real-time object detection in security systems, enhancing efficiency and adaptability. It also creates specialized datasets, including a tailored bandit dataset, to support future UAV security research.