Cervical Cell Segmentation Method Based on Global Dependency and Local Attention

In recent years, attention mechanisms have shown great potential in various computer vision tasks. However, most existing methods focus on developing more complex attention modules for better performance, which inevitably increases the complexity of the model. To overcome performance and complexity tradeoffs, this paper proposes efficient spatial and channel attention (ESCA), a symmetric, comprehensive, and efficient attention module. By analyzing squeeze-and-excitation (SE), convolutional block attention module (CBAM), coordinate attention (CA), and efficient channel attention (ECA) modules, we abandon the dimension-reduction operation of SE module, verify the negative impact of global max pooling (GMP) on the model, and apply a local cross-channel interaction strategy without dimension reduction to learn attention. We not only care about the channel features of the image, we also care about the spatial location of the target on the image, and we take into account the effectiveness of channel attention, so we designed the symmetric ESCA module. The ESCA module is effective, as demonstrated by its application in the ResNet-50 classification benchmark. With 26.26 M parameters and 8.545 G FLOPs, it introduces a mere 0.14% increment in FLOPs while achieving over 6.33% improvement in Top-1 accuracy and exceeding 3.25% gain in Top-5 accuracy. We perform image classification and object detection tasks on ResNet, MobileNet, YOLO, and other architectures on popular datasets such as Mini ImageNet, CIFAR-10, and VOC 2007. Experiments show that ESCA can achieve great improvement in model accuracy at a very small cost, and it performs well among similar models.

In this paper, we focus on the semantic image synthesis task that aims at transferring semantic label maps to photo-realistic images. Existing methods lack effective semantic constraints to preserve the semantic information and ignore the structural correlations in both spatial and channel dimensions, leading to unsatisfactory blurry and artifact-prone results. To address these limitations, we propose a novel Dual Attention GAN (DAGAN) to synthesize photo-realistic and semantically-consistent images with fine details from the input layouts without imposing extra training overhead or modifying the network architectures of existing methods. We also propose two novel modules, i.e., position-wise Spatial Attention Module (SAM) and scale-wise Channel Attention Module (CAM), to capture semantic structure attention in spatial and channel dimensions, respectively. Specifically, SAM selectively correlates the pixels at each position by a spatial attention map, leading to pixels with the same semantic label being related to each other regardless of their spatial distances. Meanwhile, CAM selectively emphasizes the scale-wise features at each channel by a channel attention map, which integrates associated features among all channel maps regardless of their scales. We finally sum the outputs of SAM and CAM to further improve feature representation. Extensive experiments on four challenging datasets show that DAGAN achieves remarkably better results than state-of-the-art methods, while using fewer model parameters.

Case instance segmentation of small farmland based on Mask R-CNN of feature pyramid network with double attention mechanism in high resolution satellite images

In recent years, the research of deep learning has received extensive attention, and many breakthroughs have been made in various fields. On this basis, a neural network with the attention mechanism has become a research hotspot. In this paper, we try to solve the image classification task by implementing channel and spatial attention mechanism which improve the expression ability of neural network model. Different from previous studies, we propose an attention module consisting of channel attention module (CAM) and spatial attention module (SAM). The proposed module derives attention graphs from channel dimension and spatial dimension respectively, then the input features are selectively learned according to the importance of the features. Besides, this module is lightweight and can be easily integrated into image classification algorithms. In the experiment, we combine the deep residual network model with the attention module and the experimental results show that the proposed method brings higher image classification accuracy. The channel attention module adds weight to the signals on different convolution channels to represent the correlation. For different channels, the higher the weight, the higher the correlation which required more attention. The main function of spatial attention is to capture the most informative part in the local feature graph, which is a supplement to channel attention. We evaluate our proposed module based on the ImageNet-1K and Cifar-100 respectively. Through a large number of comparative experiments, our proposed model achieved outstanding performance.

Electricity is the basis for everyday life, and defect detection of insulators of high-voltage transmission lines is the key to ensuring power transmission. In order to overcome the problems of low accuracy of traditional target detection algorithms for small targets, weak representation ability of feature maps and little key information extraction, an improved CBAM attention-based insulator defect detection method CBAM-YOLOv8 based on YOLOv8 was proposed. The core is to apply the combination of Channel Attention Module and Spatial Attention Module to process the channel attention and spatial attention modules respectively for the input feature layers. Experiments show that the AP in the CPLID dataset is improved by 4.7% and the FPS is reduced by 2.7% compared with the original YOLOv8, which proves that the proposed method can maintain a high detection speed while greatly improving the detection accuracy, providing a more effective and safer solution for the detection of high-voltage transmission lines, and greatly reducing the labor cost and operation risk.

Impurity monitoring study for corn kernel harvesting based on machine vision and CPU-Net

In recent years, vein biometrics has gained significant attention due to its high security and privacy features. While deep neural networks have become the predominant classification approaches for their ability to automatically extract discriminative vein features, they still face certain drawbacks: 1) Existing transformer-based vein classifiers struggle to capture interactive information among different attention modules, limiting their feature representation capacity; 2) Current label enhancement methods, although effective in learning label distributions for classifier training, fail to model long-range relations between classes. To address these issues, we present ALE-IVT, an Attention Label Enhancement-based Interactive Vein Transformer for palm-vein recognition. First, to extract vein features, we propose an interactive vein transformer (IVT) consisting of three branches, namely spatial attention, channel attention, and convolutional module. In order to enhance performance, we integrate an interactive module that facilitates the sharing of discriminative features among the three branches. Second, we explore an attention-based label enhancement (ALE) approach to learn label distribution. ALE employs a self-attention mechanism to capture correlation between classes, enabling the inference of label distribution for classifier training. As self-attention can model long-range dependencies between classes, the resulting label distribution provides enhanced supervised information for training the vein classifier. Finally, we combine ALE with IVT to create ALE-IVT, trained in an end-to-end manner to boost the recognition accuracy of the IVT classifier. Our experiments on three public datasets demonstrate that our IVT model surpasses existing state-of-the-art vein classifiers. In addition, ALE outperforms current label enhancement approaches in term of recognition accuracy.

RGAM: A novel network architecture for 3D point cloud semantic segmentation in indoor scenes

Sheep behavior recognition helps to monitor the health status of sheep and prevent the outbreak of infectious diseases. Aiming at the problems of low detection accuracy and slow speed due to the crowding of sheep in real farming scenarios, which can easily obscure each other, this study proposes a lightweight sheep behavior recognition model based on the YOLOv8n model. First, the Convolutional Block Attention Module (CBAM) is introduced and improved in the YOLOv8n model, and the channel attention module and spatial attention module are changed from serial to parallel to construct a novel attention mechanism, PCBAM, to enhance the network’s attention to the sheep and eliminate redundant background information; second, the ordinary convolution in the backbone network is replaced with depth-separable convolution, which effectively reduces the number of parameters in the model and reduces the computational complexity. The study takes the housed breeding sheep as the test object, installs a camera diagonally above the sheep pen to collect images and makes a data set for testing, and in order to verify the superiority of the PD-YOLO model, compares it with a variety of target detection models. The experimental results show that the mean average precision (mAP) of the model proposed in this paper are 95.8%, 98.9%, and 96.2% for the three postures of sheep lying, feeding, and standing, respectively, which are 8.5%, 0.8%, and 0.8% higher than those of YOLOv8n, respectively, and the size of the model has been reduced by 13.3% and the amount of computation has been reduced by 12.1%. The inference speed reaches 52.1 FPS per second, which is better than other models in meeting the real-time detection requirement. To verify the practicality of this research method, the PD-YOLO model was deployed on the RK3399Pro development board for testing, and a high inference speed was achieved. It can provide effective technical support for sheep smart farming.

In this paper, we propose a novel fusion framework based on a dense network with channel and spatial attention (CSpA-DN) for PET and MR images. In our approach, an encoder composed of the densely connected neural network is constructed to extract features from source images, and a decoder network is leveraged to yield the fused image from these features. Simultaneously, a self-attention mechanism is introduced in the encoder and decoder to further integrate local features along with their global dependencies adaptively. The extracted feature of each spatial position is synthesized by a weighted summation of those features at the same row and column with this position via a spatial attention module. Meanwhile, the interdependent relationship of all feature maps is integrated by a channel attention module. The summation of the outputs of these two attention modules is fed into the decoder and the fused image is generated. Experimental results illustrate the superiorities of our proposed CSpA-DN model compared with state-of-the-art methods in PET and MR images fusion according to both visual perception and objective assessment.

Object tracking can be considered as an object detection task. However, in general, an object detector cannot differentiate among intraclass instances and cannot fully exploit the spatiotemporal clues between successive frames. In order to solve these problems, in this paper, we proposed a novel object tracking framework based on object detection. We name the new framework TSTrack. Firstly, transformer is used in the target guidance module to extract the object’s features to guide the backbone network to complete the positioning task, which can solve the problem of distinguishing the instances within the classification. Secondly, self-attention mechanism is introduced into the model, which is mainly completed by spatial attention module (SAM) and channel attention module (CAM). By using the characteristics of self-attention mechanism, the attention matrix is dynamically self-learned in two dimensions of space and channel to obtain a more robust object representation. The proposed model is evaluated on the OTB-2013, OTB-50, OTB-2015 and VOT-2016 benchmarks, and the experimental results demonstrate the excellent tracking performance and robustness of our model.

Finding ships in water using high-resolution radar images is goal of synthetic aperture radar (SAR) ship detection, which works in any lighting or weather scenario. By taking advantage of ships' distinct scattering characteristics against water's surface, it is an essential tool for border security, maritime surveillance, and monitoring illicit fishing or trafficking. To accurately recognize ships in synthetic aperture radar (SAR) images in real-time, this study presents AMTNet, a new attention-enhanced multiscale transformer network. Despite abundance of structural information in SAR images, object detection remains a tough task due to speckle noise and diverse backdrops. suggested AMTNet integrates a ResNet-based multiscale convolutional backbone, a spatial attention module (SAM), a channel attention module (CAM), and transformer-based contextual modeling to solve these problems. In addition, a feature exchange system is implemented to address issue of domain gaps that might be generated by differences in environment and sensors in bi-temporal SAR images. To improve accuracy of change detection and localization, this Siamese design allows cooperative exploitation of spatial, temporal, and contextual signals. Compared to top models like MSDFF-Net, GLDet, and LEAD-YOLO, AMTNet outperforms them all on SSDD dataset, with metrics like detection speed (138.5 FPS), accuracy (94.60 percent), recall (95.15 percent), and F1-score (74.87%). Attention processes and feature exchange have been proven to play a key role in ablation research. Another proof of model's practicality is its resilience in face of occlusion and noise. With its excellent performance in a variety of SAR imaging settings and its high interpretability, AMTNet is a computationally economical and effective option for marine surveillance.

3D shape recognition is a critical research topic in the field of computer vision, attracting substantial attention. Existing approaches mainly focus on extracting distinctive 3D shape features; however, they often neglect the model’s robustness and lack refinement in deep features. To address these limitations, we propose the point-view fusion attention network that aims to extract a concise, informative, and robust 3D shape descriptor. Initially, our approach combines multi-view features with point cloud features to obtain accurate and distinguishable fusion features. To effectively handle these fusion features, we design a dual-attention convolutional network which consists of a channel attention module and a spatial attention module. This dual-attention mechanism greatly enhances the generalization ability and robustness of 3D recognition models. Notably, we introduce a strip-pooling layer in the channel attention module to refine the features, resulting in improved fusion features that are more compact. Finally, a classification process is performed on the refined features to assign appropriate 3D shape labels. Our extensive experiments on the ModelNet10 and ModelNet40 datasets for 3D shape recognition and retrieval demonstrate the remarkable accuracy and robustness of the proposed method.

Summary Detecting fault from seismic images is really useful for interpretation of geologic structures and stratigraphic features. With the recent developments in deep learning, this study makes it possible for efficient seismic fault detection based on convolutional neural network. In this work, we propose a general segmentation network that works on real 3D seismic data. We propose a novel network (GCS-Net) which includes a global context block (GC) and channel attention module together with spatial attention module (CS) between the encoder and decoder, instead of the U-Net based convolutional neural network. The GC block is able to capture the long-range dependencies and the CS block is utilized to further integrate local features with their global dependencies adaptively. The proposed approach was trained on a synthetic seismic data and tested by the real data. Experimental results show that our method has better performance to some extent.

Different types of partial discharge (PD) cause different damages to gas-insulated substation (GIS), so it is very important to correctly identify the type of PD for evaluating the GIS insulation condition. The traditional PD pattern recognition algorithm has the limitations of low recognition accuracy and slow recognition speed in engineering applications. To effectively diagnose the GIS PD type and safeguard the safe and reliable operation of the distribution network, a GIS PD method based on improved CBAM-ResNet was proposed in this paper. And the improved CBAM-ResNet takes advantage of the residual neural network and attention mechanism. In particular, the channel attention module and the spatial attention module are connected in parallel in the improved CBAM. The experimental results showed that the GIS PD pattern recognition method proposed herein has a recognition rate of 93.58%, 95.00%, 93.55%, and 93.88% against the four PD types. Compared with the traditional PD pattern recognition algorithm, the algorithm has the advantages of a lightweight model and more accurate recognition results, which carry better engineering application values.