• Home
  • Search
  • A Multitask CNN-Transformer Network for Semantic Change Detection From Bitemporal Remote Sensing Images
  • Cite Icon17
  • https://doi.org/10.1109/tgrs.2024.3486787Copy DOI Icon

A Multitask CNN-Transformer Network for Semantic Change Detection From Bitemporal Remote Sensing Images

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Bitemporal remote sensing (RS) semantic change detection (SCD) involves discerning and categorizing changes in the same geographical area across two RS images taken at different times. High-performance SCD approaches typically address this task using multitask networks that simultaneously handle binary change detection (BCD) and semantic segmentation (SS). Despite significant advancements in SCD research, constructing a multitask network that fully explores the correlation between BCD and SS remains challenging. To address this, we propose a novel approach called the multitask CNN-transformer network (MCTNet), tailored for SCD using bitemporal RS images. Our Siamese network simultaneously tackles SS and BCD via three subnetworks: two for SS and one for BCD. The methodology begins with a multiscale convolutional neural network (CNN) extracting local features from input images, and converting them into tokens. A Transformer module with an encoder-decoder architecture then captures long-range dependencies among these visual tokens. The extracted features are subsequently passed to multitask heads, generating predicted outputs. To ensure that the BCD results remain consistent regardless of the order of images in the input pair, we introduce spatiotemporal feature learning (SFL), enabling the acquisition of temporal-symmetric representations for BCD. Extensive experimental validation on the WHU-CD, SECOND, and HRSCD datasets demonstrates the effectiveness and efficiency of MCTNet for both SS and BCD tasks. The source code for this article will be published on GitHub in the future <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/kangziwen1/MCTNet</uri>.

Similar Papers
  • Research Article

G-CDNet: A Generalized Architecture for Both Semantic and Binary Change Detection Tasks

  • Jan 01, 2026
  • IEEE Transactions on Geoscience and Remote Sensing
  • Xiuwei Zhang +10
  • Research Article
  • Citations83

Semantic feature-constrained multitask siamese network for building change detection in high-spatial-resolution remote sensing imagery

  • May 12, 2022
  • ISPRS Journal of Photogrammetry and Remote Sensing
  • Qian Shen +5
  • Research Article
  • Citations16

A Semantic Change Detection Network Based on Boundary Detection and Task Interaction for High-Resolution Remote Sensing Images.

  • Sep 01, 2025
  • IEEE transactions on neural networks and learning systems
  • Yingjie Tang +5
  • Research Article
  • Citations7

Semantic Information Collaboration Network for Semantic Change Detection in Remote Sensing Images

  • Jan 01, 2024
  • IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
  • Xiaogang Ning +5
  • Research Article
  • Citations108

Large-scale deep learning based binary and semantic change detection in ultra high resolution remote sensing imagery: From benchmark datasets to urban application

  • Sep 24, 2022
  • ISPRS Journal of Photogrammetry and Remote Sensing
  • Shiqi Tian +5
  • Research Article
  • Citations251

ChangeMask: Deep multi-task encoder-transformer-decoder architecture for semantic change detection

  • Nov 27, 2021
  • ISPRS Journal of Photogrammetry and Remote Sensing
  • Zhuo Zheng +4
  • PDF
  • Research Article
  • Citations32

Spatial-Temporal Semantic Perception Network for Remote Sensing Image Semantic Change Detection

  • Aug 20, 2023
  • Remote Sensing
  • You He +5
  • Research Article
  • Citations109

Joint Spatio-Temporal Modeling for Semantic Change Detection in Remote Sensing Images

  • Jan 01, 2024
  • IEEE Transactions on Geoscience and Remote Sensing
  • Lei Ding +5
  • Research Article
  • Citations66

MTSCD-Net: A network based on multi-task learning for semantic change detection of bitemporal remote sensing images

  • Apr 01, 2023
  • International Journal of Applied Earth Observation and Geoinformation
  • Fengzhi Cui +1
  • Research Article
  • Citations41

Temporal-agnostic change region proposal for semantic change detection

  • Sep 27, 2023
  • ISPRS Journal of Photogrammetry and Remote Sensing
  • Shiqi Tian +5
  • Research Article

Semantic-centric change detection framework: considering spatiotemporal heterogeneity and spatiotemporal correlation of land cover

  • Oct 14, 2025
  • International Journal of Digital Earth
  • Shasha Hou +7
  • Research Article

S3CD: A Self-Supervised Semantic Change Detection Method by Mining Transition Patterns and Consistency in Remote Sensing Images.

  • Mar 01, 2026
  • IEEE transactions on cybernetics
  • Yang Qu +3
  • Research Article

MSCD-Net: From Unimodal to Multimodal Semantic Change Detection

  • Jan 01, 2025
  • IEEE Transactions on Geoscience and Remote Sensing
  • Jian Wang +7
  • Research Article
  • Citations22

Multi-temporal urban semantic understanding based on GF-2 remote sensing imagery: from tri-temporal datasets to multi-task mapping

  • Aug 20, 2023
  • International Journal of Digital Earth
  • Sunan Shi +8
  • Research Article
  • Citations18

BT-HRSCD: High-Resolution Feature Is What You Need for a Semantic Change Detection Network With a Triple-Decoding Branch

  • Jan 01, 2024
  • IEEE Transactions on Geoscience and Remote Sensing
  • Sheng Fang +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.