• Home
  • Search
  • A Visible and Synthetic Aperture Radar Image Fusion Algorithm Based on a Transformer and a Convolutional Neural Network
  • Cite Icon1
  • https://doi.org/10.3390/electronics13122365Copy DOI Icon

A Visible and Synthetic Aperture Radar Image Fusion Algorithm Based on a Transformer and a Convolutional Neural Network

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

For visible and Synthetic Aperture Radar (SAR) image fusion, this paper proposes a visible and SAR image fusion algorithm based on a Transformer and a Convolutional Neural Network (CNN). Firstly, in this paper, the Restormer Block is used to extract cross-modal shallow features. Then, we introduce an improved Transformer–CNN Feature Extractor (TCFE) with a two-branch residual structure. This includes a Transformer branch that introduces the Lite Transformer (LT) and DropKey for extracting global features and a CNN branch that introduces the Convolutional Block Attention Module (CBAM) for extracting local features. Finally, the fused image is output based on global features extracted by the Transformer branch and local features extracted by the CNN branch. The experiments show that the algorithm proposed in this paper can effectively achieve the extraction and fusion of global and local features of visible and SAR images, so that high-quality visible and SAR fusion images can be obtained.

Similar Papers
  • Research Article
  • Citations2

Evaluation of optical and synthetic aperture radar image fusion methods: a case study applied to Sentinel imagery

  • Jun 01, 2023
  • International Journal of Power Electronics and Drive Systems/International Journal of Electrical and Computer Engineering
  • Jose Manuel Monsalve-Tellez +2
  • Research Article
  • Citations18

Random Walks for Synthetic Aperture Radar Image Fusion in Framelet Domain

  • Aug 30, 2017
  • IEEE Transactions on Image Processing
  • Xiaoyuan Yang +2
  • Research Article
  • Citations5

Multitask saliency detection model for synthetic aperture radar (SAR) image and its application in SAR and optical image fusion

  • Apr 17, 2018
  • Journal of Electronic Imaging
  • Chunhui Liu
  • Conference Article

Multi-Pass Automotive Synthetic Aperture Radar Image Fusion

  • May 01, 2023
  • Jason M Merlo +1
  • PDF
  • Research Article
  • Citations5

DAFCNN: A Dual-Channel Feature Extraction and Attention Feature Fusion Convolution Neural Network for SAR Image and MS Image Fusion

  • Jun 13, 2023
  • Remote Sensing
  • Jiahao Luo +3
  • Conference Article
  • Citations1

Information-theoretic Heterogeneity Analysis for Evaluating the Performances of SAR Image Fusion Techniques

  • Jan 01, 2006
  • Jing Zhu +1
  • Research Article
  • Citations52

High Resolution SAR Image Classification Using Global-Local Network Structure Based on Vision Transformer and CNN

  • Jan 01, 2022
  • IEEE Geoscience and Remote Sensing Letters
  • Xingyu Liu +4
  • PDF
  • Research Article
  • Citations14

Ship Classification in SAR Imagery by Shallow CNN Pre-Trained on Task-Specific Dataset with Feature Refinement

  • Nov 25, 2022
  • Remote Sensing
  • Haitao Lang +4
  • Research Article
  • Citations20

GCN-YOLO: YOLO Based on Graph Convolutional Network for SAR Vehicle Target Detection

  • Jan 01, 2024
  • IEEE Geoscience and Remote Sensing Letters
  • Peiyao Chen +2
  • PDF
  • Research Article
  • Citations39

Comparative Analysis of Pixel-Level Fusion Algorithms and a New High-Resolution Dataset for SAR and Optical Image Fusion

  • Nov 27, 2023
  • Remote Sensing
  • Jinjin Li +5
  • Conference Article
  • Citations11

Airborne SAR and optical image fusion based on IHS transform and joint non-negative sparse representation

  • Jul 01, 2016
  • Chunhui Liu +2
  • Research Article

MDCA-Net: a multi-directional alignment and dynamic context aggregation network for optical and SAR image fusion

  • Nov 30, 2025
  • Geo-spatial Information Science
  • Tao Chen +5
  • PDF
  • Research Article
  • Citations59

IHS-GTF: A Fusion Method for Optical and Synthetic Aperture Radar Data

  • Aug 28, 2020
  • Remote Sensing
  • Zhenfeng Shao +2
  • Research Article
  • Citations9

A Novel Method Combining Global Visual Features and Local Structural Features for SAR ATR

  • Jan 01, 2023
  • IEEE Geoscience and Remote Sensing Letters
  • Chen Li +2
  • PDF
  • Research Article
  • Citations9

SAR Image Matching Based on Local Feature Detection and Description Using Convolutional Neural Network

  • May 24, 2022
  • Security and Communication Networks
  • Mohammed Elwan +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.