MSGATN: A Superpixel-Based Multi-Scale Siamese Graph Attention Network for Change Detection in Remote Sensing Images

ABSTRACTIn this article, we propose a novel difference image (DI) creation method for unsupervised change detection in multi-temporal multi-spectral remote-sensing images based on deep learning theory. First, we apply deep belief network to learn local and high-level features from the local neighbour of a given pixel in an unsupervised manner. Second, a back propagation algorithm is improved to build a DI based on selected training samples, which can highlight the difference on changed regions and suppress the false changes on unchanged regions. Finally, we get the change trajectory map using simple clustering analysis. The proposed scheme is tested on three remote-sensing data sets. Qualitative and quantitative evaluations show its superior performance compared to the traditional pixel-level and texture-level-based approaches.

Deep learning has achieved great success in remote sensing image change detection (CD). However, most methods focus only on the changed regions of images and cannot accurately identify their detailed semantic categories. In addition, most CD methods using convolutional neural networks (CNN) have difficulty capturing sufficient global information from images. To address the above issues, we propose a novel symmetric multi-task network (SMNet) that integrates global and local information for semantic change detection (SCD) in this paper. Specifically, we employ a hybrid unit consisting of pre-activated residual blocks (PR) and transformation blocks (TB) to construct the (PRTB) backbone, which obtains more abundant semantic features with local and global information from bi-temporal images. To accurately capture fine-grained changes, the multi-content fusion module (MCFM) is introduced, which effectively enhances change features by distinguishing foreground and background information in complex scenes. In the meantime, the multi-task prediction branches are adopted, and the multi-task loss function is used to jointly supervise model training to improve the performance of the network. Extensive experimental results on the challenging SECOND and Landsat-SCD datasets, demonstrate that our SMNet obtains 71.95% and 85.65% at mean Intersection over Union (mIoU), respectively. In addition, the proposed SMNet achieves 20.29% and 51.14% at Separated Kappa coefficient (Sek) on the SECOND and Landsat-SCD datasets, respectively. All of the above proves the effectiveness and superiority of the proposed method.

Automatic change detection is an interesting research area in remote sensing (RS) technology aims to detect the changes in synthetic aperture radar (SAR) and multi-temporal hyperspectral images acquired at different time intervals. This method identifies the differences between the images and accomplishes the classification result into changed and unchanged areas. However, the existing algorithms are degraded due to noises present in the RS images. The main aim of the proposed method is the automatic semantic segmentation based change detection that produces a final change between the two input images. This paper proposes a feature learning method named deep lab dilated convolutional neural network (DL-DCNN) for the detection of changes from the images. The proposed approach consists of three stages: (i) pre-processing, (ii) semantic segmentation based change detection and (iii) accuracy assessment. Initially, preprocessing is performed to correct the errors and to obtain detailed information from the scene. Then, map the changes between the two images with the help of a trained network. The DCNN network performs fine-tuning and determines the relationship between two images as changed and unchanged pixel areas. The experimental analysis conducted on various datasets and compared with several existing algorithms. The experimental analysis is performed in terms of F-score, percentage correct classification, kappa coefficient, and overall error rate measures to show a better performance measure than the other state-of-art approaches.

Illegal waste dumping not only encroaches on land resources but also threatens the health of the surrounding residents. The traditional artificial waste monitoring solution requires professional workers to conduct field investigations. This solution not only requires high labor resources and economic costs but also demands a prolonged cycle for updating the monitoring status. Therefore, some scholars use deep learning to achieve automatic waste detection from satellite imagery. However, relevant models cannot effectively capture multi-scale features and enhance key information. To further bolster the monitoring efficiency of urban solid waste, we propose a novel multi-scale context fusion network for solid waste detection in remote sensing images, which can quickly collect waste distribution information in a large-scale range. Specifically, it introduces a new guidance fusion module that leverages spatial attention mechanisms alongside the use of large kernel convolutions. This module helps guide shallow features to retain useful details and adaptively adjust multi-scale spatial receptive fields. Meanwhile, it proposes a novel context awareness module based on heterogeneous convolutions and gating mechanisms. This module can effectively capture richer context information and provide anisotropic features for waste localization. In addition, it also designs an effective multi-scale interaction module based on cross-guidance and coordinate perception. This module not only enhances critical information but also fuses multi-scale semantic features. To substantiate the effectiveness of our approach, we conducted a series of comprehensive experiments on two representative urban waste detection datasets. The outcomes of relevant experiments indicate that our methodology surpasses other deep learning models. As plug-and-play components, these modules can be flexibly integrated into existing object detection frameworks, thereby delivering consistent enhancements in performance. Overall, we provide an efficient solution for monitoring illegal waste dumping, which contributes to promoting eco-friendly development.

Change detection is a process of identifying changed ground objects by comparing image pairs obtained at different times. Compared with the pixel-level and object-level change detection, scene-level change detection can provide the semantic changes at image level, so it is important for many applications related to change descriptions and explanations such as urban functional area change monitoring. Automatic scene-level change detection approaches do not require ground truth used for training, making them more appealing in practical applications than nonautomatic methods. However, the existing automatic scene-level change detection methods only utilize low-level and mid-level features to extract changes between bitemporal images, failing to fully exploit the deep information. This article proposed a novel automatic binary scene-level change detection approach based on deep learning to address these issues. First, the pretrained VGG-16 and change vector analysis are adopted for scene-level direct predetection to produce a scene-level pseudo-change map. Second, pixel-level classification is implemented by using decision tree, and a pixel-level to scene-level conversion strategy is designed to generate the other scene-level pseudo-change map. Third, the scene-level training samples are obtained by fusing the two pseudo-change maps. Finally, the binary scene-level change map is produced by training a novel scene change detection triplet network (SCDTN). The proposed SCDTN integrates a late-fusion subnetwork and an early fusion subnetwork, comprehensively mining the deep information in each raw image as well as the temporal correlation between two raw images. Experiments were performed on a public dataset and a new challenging dataset, and the results demonstrated the effectiveness and superiority of the proposed approach

Deep learning (DL) algorithms are considered as a methodology of choice for remote-sensing image analysis over the past few years. Due to its effective applications, deep learning has also been introduced for automatic change detection and achieved great success. The present study attempts to provide a comprehensive review and a meta-analysis of the recent progress in this subfield. Specifically, we first introduce the fundamentals of deep learning methods which are frequently adopted for change detection. Secondly, we present the details of the meta-analysis conducted to examine the status of change detection DL studies. Then, we focus on deep learning-based change detection methodologies for remote sensing images by giving a general overview of the existing methods. Specifically, these deep learning-based methods were classified into three groups; fully supervised learning-based methods, fully unsupervised learning-based methods and transfer learning-based techniques. As a result of these investigations, promising new directions were identified for future research. This study will contribute in several ways to our understanding of deep learning for change detection and will provide a basis for further research. Some source codes of the methods discussed in this paper are available from: https://github.com/lazharkhelifi/deeplearning_changedetection_remotesensing_review.

Change detection by comparing two bitemporal images is one of the most fundamental challenges for dynamic monitoring of the Earth surface. In this article, we propose a metric learning-based generative adversarial network (GAN) (MeGAN) to automatically explore seasonal invariant features for pseudochange suppressing and real change detection. To achieve this purpose, a seasonal invariant term is introduced to maximally suppress pseudochanges, whereas the MeGAN explores the transition patterns between adjacent images in a self-learning fashion. Different from the previous works on bitemporal imagery change detection, the proposed MeGAN have the following contributions: 1) it automatically explores change patterns from the complex bitemporal background without human intervention and 2) it aims to maximally exclude pseudochanges from the seasonal transition term and map out real changes efficiently. To our best knowledge, this is the first time we incorporate the seasonal transition term and GAN for change detection between bitemporal images. At last, to demonstrate the robustness of the proposed method, we included two data sets which are the Google Earth data and the Landsat data, for bitemporal change detection and evaluation. The experimental results indicated that the proposed method is able to perform change detection with precision can be as high as 81% and 88% for the Google Earth and Landsat data set, respectively.

This paper presents a cosegmentation-based method for building change detection from multitemporal high-resolution (HR) remotely sensed images, providing a new solution to object-based change detection (OBCD). First, the magnitude of a difference image is calculated to represent the change feature. Next, cosegmentation is performed via graph-based energy minimization by combining the change feature with image features at each phase, directly resulting in foreground as multitemporal changed objects and background as unchanged area. Finally, the spatial correspondence between changed objects is established through overlay analysis. Cosegmentation provides a separate and associated, rather than a separate and independent, multitemporal image segmentation method for OBCD, which has two advantages: 1) both the image and change features are used to produce foreground segments as changed objects, which can take full advantage of multitemporal information and produce two spatially corresponded change detection maps by the association of the change feature, having the ability to reveal the thematic, geometric, and numeric changes of objects and 2) the background in the cosegmentation result represents the unchanged area, which naturally avoids the problem of matching inconsistent unchanged objects caused by the separate and independent multitemporal segmentation strategy. Experimental results on five HR datasets verify the effectiveness of the proposed method and the comparisons with the state-of-the-art OBCD methods further show its superiority.

Change detection (CD) is an important remote sensing (RS) data analysis technology. Existing remote sensing change detection (RS-CD) technologies cannot fully consider situations where pixels between bitemporal images do not correspond well on a one-to-one basis due to factors such as seasonal changes and lighting conditions. Existing networks construct two identical feature extraction branches through convolution, which share weights. The two branches work independently and do not merge until the feature mapping is sent to the decoder head. This results in a lack of feature information interaction between the two images. So, directing attention to the change area is of research interest. In complex backgrounds, the loss of edge details is very important. Therefore, this paper proposes a new CD algorithm that extracts multi-scale feature information through the backbone network in the coding stage. According to the task characteristics of CD, two submodules (the Feature Interaction Module and Detail Feature Guidance Module) are designed to make the feature information between the bitemporal RS images fully interact. Thus, the edge details are restored to the greatest extent while fully paying attention to the change areas. Finally, in the decoding stage, the feature information of different levels is fully used for fusion and decoding operations. We build a new CD dataset to further verify and test the model’s performance. The generalization and robustness of the model are further verified by using two open datasets. However, due to the relatively simple construction of the model, it cannot handle the task of multi-classification CD well. Therefore, further research on multi-classification CD algorithms is recommended. Moreover, due to the high production cost of CD datasets and the difficulty in obtaining them in practical tasks, future research will look into semi-supervised or unsupervised related CD algorithms.

This study aimed to investigate the effect of automatic attentional bias on change detection and recognition memory performance. In this context, attractive faces, which have priority in attention selection, were used as stimuli. The data of 110 participants were analyzed (54 females, 56 males, Mage = 20.87 ± 1.80). As a result, there was a significant effect of attractiveness [F(2.73, 295.16) = 37.33, p < .001, ƞp2 = .26] and model gender [F(1, 108) = 6.47, p < .05, ƞp2 = .06] on change detection performance. Accordingly, the fastest performance is when only the target was an attractive female; the slowest performance was observed when only the distractors were attractive female. On the other hand, the data of 94 participants (46 females, 48 males, Mage = 21.05 ± 1.95) were analyzed for the recognition memory. Accordingly, low memory performance was generally observed. Memory sensitivity was significantly lower for attractive faces (-.31) than average-looking ones (.59). Besides, bias to respond “old” for attractive faces were higher than average-looking faces for both model genders. Therefore, the findings suggest that the decision criterion was more liberal for attractive faces (for females -.06, for males -.46) than average faces (for females .15, for males .33). On the other hand, there was no significant effect of the participant gender on both attention and memory tasks (p > .05). The study is the first known change detection and recognition memory study to examine participant gender, model gender, and attractiveness together. The limitations of the study and suggestions for future studies are handled in the discussion section.

With its synoptic view and the repeatability, satellite remote sensing can provide timely, accurate and consistent information about earth’s surface for cost-effective monitoring of environmental changes. In this chapter, recent development in change detection techniques using multitemporal remotely sensed images were reviewed. The chapter covers change detection methods for both optical and SAR images. Various aspects of change detection processes were presented including data preprocessing, change image generation and change detection algorithms such as unsupervised and supervised change detection as well as pixel-based and object-based change detection. The review shows that significant progress has been made in the field of change detection and innovative methods have been developed for change detection using both multitemporal SAR and optical data. Attempts have been made for change detection using multitemporal multisensor/cross-sensor images. The review also identified a number of challenges and opportunities in change detection.

In this study, the unsupervised detection of urban changes, based on high-spatial resolution SAR imagery, is approached using the object-oriented paradigm. Multidate images segmentation strategy was adopted to avoid the creation of sliver polygon. Following segmentation, a change image was generated by comparing objects' mean intensities using a modified version of the traditional ratio operator. Three different unsupervised thresholding algorithms—that is, Kittler-Illingworth algorithm, Otsu method, and outlier detection technique—are used to threshold the change image and generate a binary change map. Two TerraSAR-X SAR images acquired over Shanghai in August, 2008, and September, 2011, were used to test the methods. The results indicate that, compared with pixel-based, the object-based approach helps in improving the quality of the produced change maps. The results also show that the three unsupervised thresholding algorithms performed equally well.

Change detection for multitemporal hyperspectral images (HSIs) has always been a research hotspot of remote sensing. However, most current detection methods only use spectral information or spatial information separately, and there are many false detection areas in the detection results. Besides, the feature extraction method based on neural networks needs a huge amount of training samples, but collecting labeled training samples for change detection tasks is difficult. Therefore, this letter proposes a hyperspectral change detection method based on a simplified 3-D convolutional autoencoder (S3DCAECD). First, the framework is based on deep unsupervised autoencoder (AE), which can extract deep spectral–spatial features from bitemporal images without the need for prior information. Second, by adding a 3-D convolution kernel and eliminating the pooling layer, the structure of 3-D convolutional AE is simplified, which can reduce spectral redundancy and improve data processing speed. Finally, a softmax classifier with a 2-D convolutional layer added is used to obtain the detection result, and only a few label samples are needed to train the classifier. Three HSIs' experimental results indicate that the accuracy of the S3DCAECD is more than 95% on three experimental datasets and it has better detection results than several commonly used methods.

Change detection is usually treated as a problem of explicitly detecting land cover transitions in satellite images obtained at different times, and helps with emergency response and government management. This study presents an unsupervised change detection method based on the image fusion of multi-temporal images. The main objective of this study is to improve the accuracy of unsupervised change detection from high-resolution multi-temporal images. Our method effectively reduces change detection errors, since spatial displacement and spectral differences between multi-temporal images are evaluated. To this end, a total of four cross-fused images are generated with multi-temporal images, and the iteratively reweighted multivariate alteration detection (IR-MAD) method—a measure for the spectral distortion of change information—is applied to the fused images. In this experiment, the land cover change maps were extracted using multi-temporal IKONOS-2, WorldView-3, and GF-1 satellite images. The effectiveness of the proposed method compared with other unsupervised change detection methods is demonstrated through experimentation. The proposed method achieved an overall accuracy of 80.51% and 97.87% for cases 1 and 2, respectively. Moreover, the proposed method performed better when differentiating the water area from the vegetation area compared to the existing change detection methods. Although the water area beneath moderate and sparse vegetation canopy was captured, vegetation cover and paved regions of the water body were the main sources of omission error, and commission errors occurred primarily in pixels of mixed land use and along the water body edge. Nevertheless, the proposed method, in conjunction with high-resolution satellite imagery, offers a robust and flexible approach to land cover change mapping that requires no ancillary data for rapid implementation.

Encoding strategy accounts for individual differences in change detection measures of VSTM