MambaRetinaNet: Improving remote sensing object detection by fusing Mamba and multi-scale convolution

Forest fires have continually endangered personal safety and social property. To reduce the occurrences of forest fires, it is essential to detect forest fire smoke accurately and quickly. Traditional forest fire smoke detection based on convolutional neural networks (CNNs) needs many hand-designed components and shows poor ability to detect small and inconspicuous smoke in complex forest scenes. Therefore, we propose an improved early forest fire smoke detection model based on deformable transformer for end-to-end object detection (deformable DETR). We use deformable DETR as a baseline containing the best sparse spatial sampling for smoke with deformable convolution and relation modeling capability of the transformer. We integrate a Multi-scale Context Contrasted Local Feature module (MCCL) and a Dense Pyramid Pooling module (DPPM) into the feature extraction module for perceiving features of small or inconspicuous smoke. To improve detection accuracy and reduce false and missed detections, we propose an iterative bounding box combination method to generate precise bounding boxes which can cover the entire smoke object. In addition, we evaluate the proposed approach using a quantitative and qualitative self-made forest fire smoke dataset, which includes forest fire smoke images of different scales. Extensive experiments show that our improved model’s forest fire smoke detection accuracy is significantly higher than that of the mainstream models. Compared with deformable DETR, our model shows better performance with improvement of mAP (mean average precision) by 4.2%, APS (AP for small objects) by 5.1%, and other metrics by 2% to 3%. Our model is adequate for early forest fire smoke detection with high detection accuracy of different-scale smoke objects.

<p>This paper addresses object detection and scene perception for connected and autonomous vehicles. Road object detection at high accuracy and fast inference speed is a challenging task for safe autonomous driving as false positives arising from false localization can lead to fatal outcomes. The paper proposes a convolutional neural network (CNN) to recognize images to enhance intelligent adaptive behavior in autonomous vehicles by correctly classifying, detecting, and segmenting spatially distributed objects in the driving environment. By focusing on specific regions of an image, the most significant region of the image is learned by appending a CNN with probabilistic attention mechanism aided with transformers. The proposed approach is analyzed for detection efficiency and accuracy to distinguish different objects to make appropriate driving decisions. The proposed method is validated on the publicly available Berkeley deep drive (BDD) dataset and shows an accuracy comparable to other state-of-the-art deep learning algorithms to make driving decisions based on real-time assessment of the temporal states encountered while navigating the driving environment. The proposed model performance is evaluated using mean average precision (mAP) and speed-accuracy trade-off. </p>

Real-time object detection and tracking in video streams has become a fundamental component of modern intelligent systems, enabling applications in surveillance, autonomous driving, robotics, healthcare monitoring, and smart cities. The rapid advancement of deep learning techniques has significantly improved the accuracy and efficiency of detecting and tracking multiple objects under complex and dynamic environments. This study presents a deep learning–based framework for real-time object detection and tracking in continuous video streams, emphasizing both computational efficiency and detection robustness.The proposed system integrates a state-of-the-art convolutional neural network (CNN)-based object detector with a reliable multi-object tracking algorithm. The detection module identifies objects of interest in each frame, while the tracking component maintains consistent identities across consecutive frames by utilizing motion prediction and feature association strategies. To achieve real-time performance, the model is optimized through lightweight network architectures and parallel processing on GPU hardware. Data augmentation and transfer learning techniques are employed to enhance generalization and reduce training time. Performance evaluation is conducted on benchmark video datasets using standard metrics such as precision, recall, mean Average Precision (mAP), and tracking accuracy. Experimental results demonstrate that the proposed framework achieves high detection accuracy while maintaining low latency, making it suitable for real-time deployment. Furthermore, the system effectively handles challenges such as occlusion, scale variation, and illumination changes. This research presents a comprehensive study on real-time object detection and tracking in video streams using deep learning techniques. The proposed framework integrates YOLO-based object detection with Deep SORT multi-object tracking to achieve robust spatial localization and temporal identity preservation. The study evaluates performance using benchmark datasets including COCO, MOT17, and KITTI. Mathematical formulations of detection loss, Kalman filtering, and data association are presented. Experimental analysis using precision, recall, mAP, MOTA, ROC-AUC, and PR-AUC demonstrates that the system achieves high detection accuracy while maintaining real-time performance above 35 frames per second. The findings confirm that deep learning-based frameworks provide scalable and efficient solutions for surveillance, autonomous vehicles, and intelligent monitoring systems.

Object detection algorithms using convolutional neural networks (CNNs) achieve high detection accuracy, but it is challenging to realize real-time object detection due to their high computational complexity, especially on resource-constrained mobile platforms. In this article, we propose an algorithm-hardware co-optimization approach to designing a real-time object detection system. We first develop a compact object detection model based on a binarized neural network (BNN), which employs a new layer structure, the DenseToRes layer, to mitigate information loss due to deep quantization. We also propose an efficient object detection processor that runs object detection with high throughput using limited hardware rescources. We develop a resource-efficient processing unit supporting variable precision with minimal hardware overheads. Implemented in field-programmable gate array (FPGA), the object detection processor achieves 64.51 frames/s throughput with 64.92 mean average precision (mAP) accuracy. Compared to prior FPGA-based designs for object detection, our design achieves high throughput with competitive accuracy and lower hardware implementation costs.

Unmanned Aerial Vehicles (UAVs) have gained significant traction for real-time surveillance applications such as object tracking and search-and-rescue missions. A key enabler of these capabilities is the integration of a real-time, highly accurate object detection system. While available two-stage detectors like R-CNN, Fast R-CNN, Faster R-CNN, and Mask R-CNN achieve high detection accuracy and precise localization by dividing the image into regions and classifying each region, they are often slow, complex, and resource-intensive, making them unsuitable for real-time applications. To address this limitation, this research utilizes a Darknet-based YOLOv3 (You Only Look Once, Version 3), a state-of-the-art algorithm for real-time object detection in videos, live feeds, and images. Leveraging a deep Convolutional Neural Network (CNN), YOLOv3 efficiently learns features and predicts object locations and class probabilities in a single pass, ensuring high-speed and reliable detection. A real-time aerial surveillance system for quadcopter application using machine vision is proposed. The training dataset, obtained from the internet and self-taken images from a camera, was manually annotated into three critical categories: suspect, bandit, and weapon. The dataset was subsequently divided into training and testing subsets. Experimental results demonstrate that the proposed system achieves outstanding detection accuracy, with an overall mean average precision (mAP@0.5) of 93.82%, precision of 94%, and recall of 83%. Compared to a ResNet-50-based Faster R-CNN model, the YOLOv3-based approach outperformed, achieving success rates of 0.81 for the Bandit class and 1.00 for both Suspect and Weapon classes. This research improves drone-based AI for real-time object detection in security systems, enhancing efficiency and adaptability. It also creates specialized datasets, including a tailored bandit dataset, to support future UAV security research.

Real-time and accurate robot detection and localization is important for the RoboCup Middle size League (MSL) soccer robots. In the current robot detection methods used by most of the teams, the black-color-based information is used to distinguish robots from the environment, which is not robust if the robot changes its makers' color according to the current rule. Considering the good performance of deep learning on the feature extraction and object detection, in this paper, we propose a novel approach for robot detection and localization based on Convolutional Neural Networks (CNNs) for RoboCup MSL soccer robots. The approach is composed of two stages: robot detection using the RGB image, and robot localization using the depth point cloud. The high accuracy and mean average precision (mAP) verify that the proposed method is suitable for robot detection during the MSL competition, which will benifit the following strategy design and obstacle avoidance procedures. The proposed approach can be easily exploited to deal with different objects and adapted to be used in other RoboCup leagues. The acquired dataset is made available for the community.

This research proposes a novel hardware-optimized design to accelerate Convolutional Neural Networks (CNNs) using Verilog HDL. The design is specifically developed for the DARKNET-19 system model, which serves as the backbone of the YOLOv3-tiny algorithm, a widely used framework for real-time object detection in dynamic environments. The CNN architecture was implemented in Verilog HDL and synthesized using Synopsys Design Compiler, with a focus on improving both object detection accuracy and hardware resource efficiency. The proposed design efficiently performs key CNN operations, including convolution, pooling, and activation, enabling faster real-time object detection compared to many existing methods. To improve performance, the hardware design incorporates parallel processing techniques, allowing multiple computations to be executed simultaneously. This significantly reduces the system latency and power consumption. The convolutional layers of the DARKNET-19 architecture are efficiently mapped onto the hardware platform, ensuring optimized data storage and fast memory access, which further enhances processing speed and detection accuracy. An innovative feature of the design is a 2-dimensional image preprocessing module that prepares input images before they are fed into the CNN. This preprocessing stage includes image resizing, brightness normalization, and color adjustment, which helps the CNN process visual data more effectively. After preprocessing, the images pass through several CNN layers. The convolutional layers extract key features from the images, while the pooling and activation layers refine these features to improve detection performance. Finally, the processed data is analyzed by the YOLOv3-tiny algorithm, which identifies and locates objects in the images with high precision. Experimental results demonstrate that the proposed high-speed and resource-efficient hardware architecture is well-suited for real-time object detection applications, particularly in highly dynamic and unpredictable environments.

Visual attribute classification has been widely discussed due to its impact on lots of applications, such as face recognition, action recognition and scene representation. Recently, Convolutional Neural Networks (CNNs) have demonstrated promising performance in image recognition, object detection and many other computer vision areas. Such networks are able to automatically learn a hierarchy of discriminate features that richly describe image content. However, dimensions of features of CNNs are usually very large. In this paper, we propose a visual attribute classification system based on feature selection and CNNs. Extensive experiments have been conducted using the Berkeley Attributes of People dataset. The best overall mean average precision (mAP) is about 89.2%.

Sonar image object detection is essential in underwater rescue and resource exploration. Although many convolution neural network (CNN)-based object detection algorithms have achieved great success in natural images. However, for underwater sonar images, problems, such as seabed reverberation noise interference, low proportion of foreground object region pixels, and poor imaging resolution, present considerable challenges to achieving accurate underwater object detection. To address these problems, we propose a novel sonar image object detector called the multilevel feature fusion network (MLFFNet). The detector consists of multiscale convolution module (MS-Conv), multilevel feature extraction module (ML-FEM), multilevel feature fusion module (ML-FFM), neighborhood channel attention mechanism (N-CAM), multiscale feature pyramid module (MS-FPN), and feature association module (FA). First, we use the MS-Conv to extract different scale feature information in the object region. Second, the ML-FEM and ML-FFM are used to obtain the local detail and global context features. Third, the N-CAM and MS-FPN are used to obtain the foreground objects’ semantic feature and position feature, and suppress the background region noise interference. Finally, we use the FA module to enhance the category and feature correlation of different objects. Extensive experiments are conducted on the real scene sonar image dataset. The experimental results demonstrate that MLFFNet performs better than other state-of-the-art object detection methods. Code and dataset are publicly at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/darkseid-arch/SonarMLFFNet</uri> .

Advanced driver assistance systems (ADASs) and autonomous vehicles are expected to increase safety, lower energy and fuel consumption, and lower pollutants from road traffic. The advanced driver assistance system’s major features include lane detection and tracking. Finding color line marks on the road is the technique of lane detection. The process of lane tracking aims to help the vehicle continue traveling along a predetermined course. Hence, automatic detection of lanes using convolutional neural networks (CNNs) models has gained popularity in the current economic development. This paper also aims at detecting various objects using convolutional neural networks. In this work, we offer object classification and detection, a demanding topic in computer vision and image processing. As a result, we deployed convolutional neural networks on the Keras platform with TensorFlow support. The experimental results illustrate the amount of time needed to train, test, and generate the model using a constrained computing environment. Here, we trained the system for about 80 images which have taken a couple of seconds to detect with better accuracy. Traffic sign recognition is carried out, which is a significant area of research in ADAS. It is crucial for driverless vehicles and is frequently used to read stationary or moving road signs along the side of the road. A comprehensive recognition system is made up of traffic sign detection (TSD) and categorization (TSC). The paper also aimed at traffic sign recognition, which is crucial to consider, because traffic sign recognition is typically applied to portable devices. The model’s detection accuracy is ensured as long as the speed is maintained. The model developed in this study is 99.89% accurate.

Deep convolutional neural network (DCNN) based computer vision methods have great progress in object detection tasks. And object detection is essential to many applications such as autonomous robots and vehicles. However, it is difficult for object detection system to be deployed on embedded platforms due to its intensive computing architecture. We present an object detector MobileNet-SSD which can be deployed on embedded platforms. The object detector presented in this work based on Single Shot Detector (SSD) framework and replace the feature extractor with a more light weight network MobileNetV1. General matrix to matrix multiplication is used to simplify the calculation of convolution operation and is further optimized using ARM NEON technology. Finally, the object detector MobileNet-SSD is deployed on embedded platform and achieves 1.13FPS with 0.72 mean average precision on PASCAL VOC dataset.

In this paper, an efficient instance segmentation scheme based on deep convolutional neural networks is proposed to deal with unconstrained psoriasis images for computer-aided diagnosis. To achieve instance segmentation, the You Only Look At CoefficienTs (YOLACT) network composed of backbone, feature pyramid network (FPN), Protonet, and prediction head is used to deal with psoriasis images. The backbone network is used to extract feature maps from an image, and FPN is designed to generate multiscale feature maps for effectively classifying and localizing objects with multiple sizes. The prediction head is used to predict the classification information, bounding box information, and mask coefficients of objects. Some prototypes generated by Protonet are combined with mask coefficients to estimate the pixel-level shapes for objects. To achieve instance segmentation for unconstrained psoriasis images, YOLACT++ with a pretrained model is retrained via transfer learning. To evaluate the performance of the proposed scheme, unconstrained psoriasis images with different severity levels are collected for testing. As for subjective testing, the psoriasis regions and normal skin areas can be located and classified well. The four performance indices of the proposed scheme were higher than 93% after cross validation. About object localization, the Mean Average Precision (mAP) rates of the proposed scheme were at least 85.9% after cross validation. As for efficiency, the frames per second (FPS) rate of the proposed scheme reached up to 15. In addition, the F1_score and the execution speed of the proposed scheme were higher than those of the Mask Region-Based Convolutional Neural Networks (R-CNN)-based method. These results show that the proposed scheme based on YOLACT++ can not only detect psoriasis regions but also distinguish psoriasis pixels from background and normal skin pixels well. Furthermore, the proposed instance segmentation scheme outperforms the Mask R-CNN-based method for unconstrained psoriasis images.

In this work, we present an approach based on multilevel local as well as global Convolutional Neural Network (CNN) feature matching to retrieve near duplicate images. CNN features are suitable for visual matching. The CNN features of entire image may not give accuracy in retrieval due to various image editing/capturing operations. Our retrieval task focuses on matching image pairs based on local and global levels. In local matching, an image is segmented into fixed size blocks followed by extracting patches by considering neighboring regions at different levels. Matching local image patches at different levels provides robustness to our retrieval model. In local patch extraction, we select blocks containing SURF feature points instead of selecting all blocks. CNN features are extracted and stored for each image patch and then followed by extraction of global CNN features. Finally, similarity between image pairs is computed by considering all extracted CNN features. Our similarity function is based on correlation and number of blocks found in matching. We implemented our proposed approach on benchmarking Holiday dataset. Retrieval results show remarkable improvement in mean average precision (mAP) on the dataset.

Artificial intelligence (AI) is an important tool for improving agricultural tasks. In particular, object detection methods based on convolutional neural networks (CNNs) enable the detection and classification of objects directly in the field. Combined with unmanned aerial vehicles (UAVs, drones), these methods allow efficient crop monitoring. The primary challenge is to develop models that are both accurate and feasible under real-world conditions. This study addresses this challenge by evaluating marigold flower detection using three groups of CNN detectors: canonical models, including YOLOv2, Faster R-CNN, and SSD with their original backbones; modified versions of these detectors using DarkNet-53; and modern architectures, including YOLOv11, YOLOv12, and the RT-DETR. The dataset consisted of 392 images from marigold fields, which were manually labeled and augmented to a total of 940 images. The results showed that YOLOv2 with DarkNet-53 achieved the best performance, with 98.8% mean average precision (mAP) and 97.9% F1-score (F1). SSD and Faster R-CNN also improved, reaching 63.1% and 52.8%, respectively. Modern models obtained strong results: YOLOv11 and YOLOv12 reached 96–97%, and RT-DETR 93.5%. The modification of YOLOv2 allowed this classical detector to compete directly with, and even surpass, recent models. Precision–recall (PR) curves, F1-scores, and complexity analysis confirmed the trade-offs between accuracy and efficiency. These findings demonstrate that while modern detectors are efficient baselines, classical models with updated backbones can still deliver state-of-the-art results for UAV-based crop monitoring.

— In today's era, the challenge of object detection within laboratory spaces is paramount. The need for automated monitoring systems supporting object detection within laboratory settings, particularly for service robots, is crucial for scientific research and safety. Utilizing convolutional artificial neural networks has shown promising capabilities in object recognition. This paper proposes a novel method for detecting and localizing specific objects within laboratory environments using deep learning techniques. Employing a lightweight primary feature extractor allows for the identification of crucial object features without imposing excessive computational demands. Additionally, a depthwise separable convolution module is introduced, designed to capture essential components within multi-level convolutional patches specific to laboratory conditions. To address the challenges encountered within laboratory spaces, a new dataset is proposed, encompassing issues such as lighting variations, blurriness, occlusions, and complex backgrounds. Evaluation results indicate that the proposed model surpasses other lightweight object detection models in laboratory settings, offering high accuracy and efficiency. This model can be efficiently implemented on low-tier devices, ensuring real-time object detection and processing within laboratory environments. Keywords — object detection, service robot, convolutional neural networks, You Only Look Once version 5. Abstrak — Di era sekarang ini, tantangan deteksi objek di dalam ruang laboratorium menjadi sangat penting. Kebutuhan akan sistem pemantauan otomatis yang mendukung deteksi objek di dalam laboratorium, khususnya untuk robot servis, sangat penting untuk penelitian ilmiah dan keselamatan. Memanfaatkan jaringan saraf tiruan convolutional telah menunjukkan kemampuan yang menjanjikan dalam pengenalan objek. Makalah ini mengusulkan metode baru untuk mendeteksi dan melokalisasi objek tertentu di dalam lingkungan laboratorium menggunakan teknik pembelajaran mendalam. Menggunakan ekstraktor fitur utama yang ringan memungkinkan identifikasi fitur objek yang penting tanpa membebani komputasi yang berlebihan. Selain itu, modul konvolusi yang dapat dipisahkan secara mendalam juga diperkenalkan, yang dirancang untuk menangkap komponen penting dalam patch konvolusi multi-level yang spesifik untuk kondisi laboratorium. Untuk mengatasi tantangan yang dihadapi di dalam ruang laboratorium, dataset baru diusulkan, yang mencakup masalah seperti variasi pencahayaan, kekaburan, oklusi, dan latar belakang yang kompleks. Hasil evaluasi menunjukkan bahwa model yang diusulkan melampaui model pendeteksian objek ringan lainnya di lingkungan laboratorium, menawarkan akurasi dan efisiensi yang tinggi. Model ini dapat diimplementasikan secara efisien pada perangkat tingkat rendah, memastikan pendeteksian dan pemrosesan objek secara real-time di lingkungan laboratorium. Kata kunci — deteksi objek, robot layanan, jaringan saraf konvolusi, Anda Hanya Melihat Sekali versi 5.