Method for assessing rodent infestation in plateau based on SegFormer

A multi-scale semantic feature fusion method for remote sensing crop classification

Infrared small target detection is widely used in aerial target detection and tracking system because of its long detection distance and strong anti-jamming ability. Aiming at the shortcomings of the current infrared small target detection algorithm, such as low precision rate and high false alarm rate when dealing with complex background. In this paper, we propose an end-to-end infrared small target detection model (called MFSSD) based on multi-scale feature fusion. Considering the trait of the targets, we propose a feature fusion module by using a refinement and fusion feature map method, and improve the correlation of different channels through the SP Module. The experimental results of three different sequences of infrared image detection show that the average detection accuracy of the MFSSD algorithm in infrared small target detection is as high as 87.8%. Compared with the traditional multi-scale feature fusion detection algorithm, both the precision rate and the recall rate have been significantly improved.

To address the problem of inaccurate representation, inadequate fusion and unsmooth results in video-based single person three-dimensional human pose estimation, a multi-scale spatial-temporal feature fusion method is proposed. Firstly, the joint, limb and upper/lower body tokens were defined in spatial domain to represent the spatial multi-scale features of human body using positional embeddings. Secondly, the spatial multi-scale feature fusion module was constructed based on self-attention mechanism and multilayer perceptron to fuse joint, limb and upper/lower body features, obtaining initial pose feature sequence. Lastly, the temporal multi-scale encoding was established for temporal feature fusion to acquire final pose feature sequence, and optimize the generation of refined three-dimensional human pose through temporal decoding. Experimental results on Human3.6M dataset show that the mean per joint position error and joint velocity errors are 33.6 and 2.4 respectively, which reduce by 2.3% and 4.0%. The proposed method can improve three-dimensional human pose estimation accuracy and generate precise and smooth results while reducing computational cost. Furthermore, experimental results on HumanEva-I dataset show that the proposed method also has a certain degree of generalization ability.

Image dehazing is critical for visual enhancement and a wide range of computer vision applications. Despite significant advancements, challenges remain in preserving fine details and adapting to diverse, non-uniformly degraded scenes. To address these issues, we propose a novel image dehazing method that introduces a contrastive learning framework, enhanced by the InfoNCE loss, to improve model robustness. In this framework, hazy images are treated as negative samples and their clear counterparts as positive samples. By optimizing the InfoNCE loss, the model is trained to maximize the similarity between positive pairs and minimize that between negative pairs, thereby improving its ability to distinguish haze artifacts from intrinsic scene features and better preserving the structural integrity of images. In addition to contrastive learning, our method integrates a multi-scale dynamic feature fusion with a hybrid attention mechanism. Specifically, we introduce dynamically adjustable frequency band filters and refine the hybrid attention module to more effectively capture fine-grained, cross-scale image details. Extensive experiments on the RESIDE-6K and RS-Haze datasets demonstrate that our approach outperforms most existing methods, offering a promising solution for practical image dehazing applications.

Online knowledge distillation conducts knowledge transfer among all student models to alleviate the reliance on pre-trained models. However, existing online methods rely heavily on the prediction distributions and neglect the further exploration of the representational knowledge. In this paper, we propose a novel Multi-scale Feature Extraction and Fusion method (MFEF) for online knowledge distillation, which comprises three key components: Multi-scale Feature Extraction, Dual-attention and Feature Fusion, towards generating more informative feature maps for distillation. The multiscale feature extraction exploiting divide-and-concatenate in channel dimension is proposed to improve the multi-scale representation ability of feature maps. To obtain more accurate information, we design a dual-attention to strengthen the important channel and spatial regions adaptively. Moreover, we aggregate and fuse the former processed feature maps via feature fusion to assist the training of student models. Extensive experiments on CIF AR-10, CIF AR-100, and CINIC-10 show that MFEF transfers more beneficial representational knowledge for distillation and outperforms alternative methods among various network architectures

Small object detection on drone-captured images is a recently popular and challenging task. From the drone’s perspective, the object scale varies significantly, and tiny objects lack distinguishable appearance information in complex backgrounds, which leads to undesired effects. To solve the issue mentioned above, we propose U-YOLO based on the original YOLOv5 model. We first extend the multi-scale feature fusion network and add a detection head for tiny objects. Secondly, we integrate the convolutional block attention model (CBAM) in the detection head to focus on the critical region of the feature map. Lastly, an attention feature fusion module based on contextual information is designed to combine local and global contextual details of small objects and attention mechanisms to enhance the multi-scale feature fusion capability. Experiments on dataset VisDrone2021-DET show that U-YOLO not only improves the detection performance on drone-captured scenarios but also has a real-time detection speed. Compared to baseline model (YOLOv5s), the mAP result of U-YOLO is increased from 19.07 to 24.1%, and the detection speed is 39FPS. It provides a good balance between detection accuracy and speed, promoting the progress of small object detection algorithms on UAV platforms.

The control of rodent pests with novel rodenticides is an important strategy subsequently they are cost-effective in reduction of agriculture damage in the urban environment. The current field study was conducted to test the efficiency of newly formulated baits of zinc phosphide (2%) and brodifacoum (0.005%) in combination and alone mixed with additives for the control of field rats prevailing wheat-groundnut cropping system of the Pothwar region, Pakistan. Burrow baiting and bait stations were employed at the early flowering stages of the respective crops, and continued through three growth stages (germination, peg formation/flowering and maturity). Treatment efficacy of the trials was assessed through counts of active rodent burrows before and after treatments at the three growth stages of these crops. The results indicated variable degrees of reduction in burrow activities following the three bait applications. The reductions in rodent activity in wheat were 88.8% at germination, 92.0% at flowering/grain formation and 95.5% at maturity stage. In groundnut, the rodent activities were reduced by 91.8%, 93.5% and 95.8% at germination, peg formation, and maturity stages, respectively. The estimated mortality at all three growth stages of both wheat and groundnut ranged between 60 and 85%. A significant impact of three rodenticides treatments on the reduction of rodent burrow density in both wheat and groundnut crops (P < 0.05) was observed. Nonetheless, comparison of the mean values reveals that the number of burrows reduced at the maturity stages (P > 0.05). The results revealed that this combination of rodenticides have more potential in enhancing bait acceptance and could be benefit to the agricultural ecosystem and may reduce the impact of secondary poisoning and environmental risks.

The classification of high-resolution (HR) synthetic aperture radar (SAR) images is of great importance for SAR scene interpretation and application. However, the presence of intricate spatial structural patterns and complex statistical nature makes SAR image classification a challenging task, especially in the case of limited labeled SAR data. This paper proposes a novel HR SAR image classification method, using a multi-scale deep feature fusion network and covariance pooling manifold network (MFFN-CPMN). MFFN-CPMN combines the advantages of local spatial features and global statistical properties and considers the multi-feature information fusion of SAR images in representation learning. First, we propose a Gabor-filtering-based multi-scale feature fusion network (MFFN) to capture the spatial pattern and get the discriminative features of SAR images. The MFFN belongs to a deep convolutional neural network (CNN). To make full use of a large amount of unlabeled data, the weights of each layer of MFFN are optimized by unsupervised denoising dual-sparse encoder. Moreover, the feature fusion strategy in MFFN can effectively exploit the complementary information between different levels and different scales. Second, we utilize a covariance pooling manifold network to extract further the global second-order statistics of SAR images over the fusional feature maps. Finally, the obtained covariance descriptor is more distinct for various land covers. Experimental results on four HR SAR images demonstrate the effectiveness of the proposed method and achieve promising results over other related algorithms.

The performance of underwater target detection algorithms is affected by poor imaging quality in underwater environments. Due to the arithmetic power limitation of underwater devices, existing deep learning networks are unable to provide efficient detection processes with high detection accuracy. Lightweight CNN models have been actively applied for underwater environment detection, yet their lite feature fusion networks cannot provide effective fusion effects and reduce the detection accuracy. In this paper, a lightweight algorithm based on multi-scale feature fusion was proposed, with the model parameters greatly reduced, improving the target detection accuracy. The forward propagation memory overhead is reduced by using multi-scale shared convolutional kernels and pooling operations to co-construct the query matrix in the Tansformer encoding stage. Then, the feature fusion path is optimized in order to enhance the connection of multi-scale features. A multiscale feature adaptive fusion strategy is used to enhance the detection performance and reduce the dependence on the complex feature extraction network. The feature extraction network is also reparameterized to simplify the operation. Using the UPRC offshore dataset for validation, the study results have demonstrated that the statistical mAP metrics validate the detection accuracy. Compared with SSD, RetinaNet and YOLOv5-s improved by 13%, 8.6%, and 0.8%, while the number of parameters decreased by 76.09%, 89.74%, and 87.67%. In addition, compared with the YOLOv5-lite model algorithm with the same parameter volume, the mAP is improved by 3.8%, which verifies the accuracy and efficiency of the algorithm in this paper.

Due to the influence of the shooting angle of view and the flight height, the images taken by UAV often have complex backgrounds and contain a large number of small and unevenly distributed objects. In order to solve the problem that it is difficult to accurately locate and recognize small objects in UAV images under complex backgrounds, this paper proposes an multi-scale feature fusion algorithm D-A-FS SSD (Dilated-Attention-Feature Fusion SSD) based on the combination of dilated convolution and attention mechanism. In the process of feature extraction, the receptive field of the feature is expanded through the dilated convolution, which improves the network's feature expression of object distribution and scale difference information. And a attention network is used in our method to effectively suppresse the background information. In the multi-scale detection stage, our method fuses the low-level feature map responsible for detecting small objects with the high-level feature map which have much higher semantic information to improve the recognition accuracy of small objects. Experimental results show that our method effectively improves the accuracy of UAV image object detection.

Object detection (OD) in unmanned aerial vehicle (UAV) images faces many challenges, with diverse-scale objects and small objects being particularly prominent issues. To alleviate these challenges, we propose a novel multiscale feature learning and feature fusion network under the guidance of deformable convolution. First, a deformable convolution-guided feature learning (DCGFL) block is designed in the backbone to extract more effective multiscale features. The DCGFL block leverages the adaptability of deformable convolution to the shapes and scales of objects, akin to spatial attention. Moreover, it also employs channel attention to identify important feature maps. Hence, the proposed backbone possesses the functionality of spatial attention and channel attention. Second, in the neck, we devise a simple generalized feature pyramid network (SimpleGFPN) with several deformable convolution-guided feature fusion (DCGFF) blocks to fuse multiscale features. The proposed neck has cross-layer and cross-scale pathways, facilitating effective information exchange and fusion between shallow spatial and deep semantic features. Third, the SIoU loss is used to better model the bounding box regression loss. Finally, experimental results on the VisDrone2021 and UAVDT datasets show that the proposed method outperforms the compared OD methods. In terms of mean average precision, we obtain 37.8% on VisDrone2021 and 18.5% on UAVDT.

Automatic modulation classification (AMC), as a key technology of cognitive radio, has become a focal point of research. However, most deep learning-based AMC methods require an extensive number of labeled signals to acquire a comprehensive understanding of modulation types, placing substantial pressure on signal acquisition and labeling. To solve this issue, we propose a few-shot AMC (FSAMC) method to facilitate rapid generalization and recognition with limited data, namely multi-scale feature fusion and distribution similarity network (MS2F-DS). Firstly, we design a multi-scale feature fusion (MS2F) model, which aims to extract features with varying fields of view and boost feature fusion, enabling the derivation of contextual information from the signal. Furthermore, we introduce a distribution similarity (DS) classifier to address the insufficient measurement of current similarity measurement functions by considering both micro and macro perspectives of vectors, further increasing intra-class compactness and inter-class separability. Finally, extensive experiments were conducted on 3-way 1, 3, and 5-shot FSAMC tasks using public datasets RML2016.10a and RML2016.10b, and the results demonstrated the effectiveness of our method.

The fully convolutional networks (FCNs) have been widely applied in numerous medical image segmentation tasks. However, tissue regions usually have large variations of shape and scale, so the ability of neural networks to learn multi-scale features is important to the segmentation performance. In this paper, we improve the network for multi-scale feature fusion, in the medical image segmentation by introducing two feature fusion modules: i) global attention multi-scale feature fusion module (GMF); ii) local dense multi-scale feature fusion module (LMF). GMF aims to use global context information to guide the recalibration of low-level features from both spatial and channel aspects, so as to enhance the utilization of effective multi-scale features and suppress the noise of low-level features. LMF adopts bottom-up top-down structure to capture context information, to generate semantic features, and to fuse feature information at different scales. LMF can integrate local dense multi-scale context features layer by layer in the network, thus improving the ability of network to encode interdependent relationships among boundary pixels. Based on the above two modules, we propose a novel medical image segmentation framework (GLF-Net). We evaluated the proposed network and modules on challenging brain tumor segmentation and pancreas segmentation datasets, and very competitive performance has been achieved.

With special consideration for complex scenes and densely distributed small objects, this frequently leads to serious false and missed detections for unmanned aerial vehicle (UAV) images in small object detection scenarios. Consequently, we propose a UAV image small object detection algorithm, termed SMA-YOLO. Firstly, a parameter-free simple slicing convolution (SSC) module is integrated in the backbone network to slice the feature maps and enhance the features so as to effectively retain the features of small objects. Subsequently, to enhance the information exchange between upper and lower layers, we design a special multi-cross-scale feature pyramid network (M-FPN). The C2f-Hierarchical-Phantom Convolution (C2f-HPC) module in the network effectively reduces information loss by fine-grained multi-scale feature fusion. Ultimately, adaptive spatial feature fusion detection Head (ASFFDHead) introduces an additional P2 detection head to enhance the resolution of feature maps to better locate small objects. Moreover, the ASFF mechanism is employed to optimize the detection process by filtering out information conflicts during multi-scale feature fusion, thereby significantly optimizing small object detection capability. Using YOLOv8n as the baseline, SMA-YOLO is evaluated on the VisDrone2019 dataset, achieving a 7.4% improvement in mAP@0.5 and a 13.3% reduction in model parameters, and we also verified its generalization ability on VAUDT and RSOD datasets, which demonstrates the effectiveness of our approach.

Change detection (CD) in remote sensing imagery is crucial for monitoring environmental variations over time. Recent advancements have introduced numerous effective algorithms, significantly enhancing the performance of CD tasks. However, various challenges still persist, such as complex backgrounds, small targets, and diverse change types. To address these challenges, we propose a novel Mamba-based multi-scale feature enhancement method. Our method leverages the strengths of state space models in handling long sequences by reformulating the pyramid (multi-scale) feature fusion as a sequence processing task. This approach enables our model to efficiently capture both long-range context and fine-grained local details, which are critical for effective feature learning and mitigating the aforementioned challenges. Moreover, we introduce scale-level embedding and auxiliary loss to optimize and regulate the model's training process. These enhancements not only accelerate training but also improve the model's generalization capability. Extensive experiments are conducted on four leading benchmarks: WHUCD, SYSU-CD, LEVIR-CD, and DSIFN-CD datasets. The results demonstrate that our approach consistently delivers state-of-theart performance, surpassing other cutting-edge methods by a significant margin. The source code will be made available at https://github.com/Band-127/Pyramid-Mamba-CD upon formal acceptance of the paper.