SAR Image Registration Using An Improved Anisotropic Gaussian-SIFT Algorithm

For Synthetic Aperture Radar (SAR) image registration, successive processes following feature extraction are required by both the traditional feature-based method and the deep learning method. Among these processes, the feature matching process—whose time and space complexity are related to the number of feature points extracted from sensed and reference images, as well as the dimension of feature descriptors—proves to be particularly time consuming. Additionally, the successive processes introduce data sharing and memory occupancy issues, requiring an elaborate design to prevent memory leaks. To address these challenges, this paper introduces the OptionEM-based reinforcement learning framework to achieve end-to-end SAR image registration. This framework outputs registered images directly without requiring feature matching and the calculation of the transformation matrix, leading to significant processing time savings. The Transformer architecture is employed to learn image features, while a correlation network is introduced to learn the correlation and transformation matrix between image pairs. Reinforcement learning, as a decision process, can dynamically correct errors, making it more-efficient and -robust compared to supervised learning mechanisms such as deep learning. We present a hierarchical reinforcement learning framework combined with Episodic Memory to mitigate the inherent problem of invalid exploration in generalized reinforcement learning algorithms. This approach effectively combines coarse and fine registration, further enhancing training efficiency. Experiments conducted on three sets of SAR images, acquired by TerraSAR-X and Sentinel-1A, demonstrated that the proposed method’s average runtime is sub-second, achieving subpixel registration accuracy.

We address the application of model-supported exploitation techniques to synthetic aperture radar (SAR) imagery. The emphasis is on monitoring SAR imagery using wide area 2D and/or 3D site models along with contextual information. We consider here the following tasks useful in monitoring: (a) site model construction using segmentation and labeling techniques, (b) target detection, (c) target classification and indexing, and (d) SAR image-site model registration. The 2-D wide area site models used here for SAR image exploitation differ from typical site models developed for RADIUS applications, in that they do not model specific facilities, but constitute wide area site models of cultural features such as urban clutter areas, roads, clearings, fields, etc. These models may be derived directly from existing site models, possibly constructed from electro-optical (EO) observations. When such models are not available, a set of segmentation and labeling techniques described here can be used for the construction of 2D site models. The use of models can potentially yield critical information which can disambiguate target signatures in SAR images. We address registration of SAR and EO images to a common site model. Specific derivations are given for the case of registration within the RCDE platform. We suggest a constant false alarm rate (CFAR) detection scheme and a topographic primal sketch (TPS) based classification scheme for monitoring target occurrences in SAR images. The TPS of an observed target is matched against candidate targets TPSs synthesized for the preferred target orientation, inferred from context (e.g. road or parking lot targets). Experimental results on real and synthetic SAR images are provided.

This paper proposes a novel method on Synthetic Aperture Radar (SAR) Image denoising, which is based on context modeling combined with multiscale orthogonal bandlet coefficients. For the main influence of SAR image is multiplicative speckle noise, the logarithm uniform transform is used to convert it to additive noise. In this paper, the multiscale orthogonal bandlet transform is applied to noisy SAR Image. The contextual model is used to compute contextual values of bandlet coefficients on each scale. Therefore, bandlet coefficients are reconstructed into some parts by contextual values. The spatially adaptive soft-threshold (T) is to denoise SAR image in each part. Experimental results demonstrate that this method outperforms the methods of Ehance-Lee (E-lee), contextual model based on wavelet domain (Wavelet-context), and Hidden Markov Tree model bases on wavelet domain (Wavelet-hmt) on there indexes: Floating index (FI), Standard deviation and Edge saving index of vertical direction, by using a real SAR image. However, the method can not only reduce the speckle noise but also preserve edges and high frequency information, and gets considerable visual effect on SAR Image denoising.

Synthetic aperture radar (SAR) imaging has been widely applied in drones for its consistent surveillance capability and invulnerability to smoke or cloud. Yet drone platform is unstable and observing distance is much shorter than satellite. As a consequence, the SAR image registration, which is a crucial process in SAR imaging, is influenced by sparkling scattering spots and coherent speckle noise. In this paper, we propose a multi-layer method to improve SAR registration performance on drones. ORB method is applied to mitigate sparkle scattering spot. Multi-layer feature clustering can eliminate the error matches by coherent speckle noise. Experiments were carried out to valid the proposed method. Results demonstrate that the proposed method can improve SAR image registration performance on unstable aerial platforms.

The traditional template matching strategy of optical and synthetic aperture radar (SAR) is sensitive to the nonlinear transformation between two images. In some cases, the optical and SAR image pairs do not conform to the affine transformation condition. To address this issue, this study presents a novel template matching strategy which uses the One-Class Support Vector Machine (SVM) to remove outliers. First, we propose a method to construct the similarity map dataset using the SEN1-2 dataset for training the One-Class SVM. Second, a four-step strategy for optical and SAR image registration is presented in this paper. In the first step, the optical image is divided into some grids. In the second step, the strongest Harris response point is selected as the feature point in each grid. In the third step, we use Gaussian pyramid features of oriented gradients (GPOG) descriptor to calculate the similarity map in the search region. The trained One-Class SVM is used to remove outliers through similarity maps in the fourth step. Furthermore, the number of improve matches (NIM) and the rate of improve matches (RIM) are designed to measure the effect of image registration. Finally, this paper designs two experiments to prove that the proposed strategy can correctly select the matching points through similarity maps. The experimental results of the One-Class SVM in dataset show that the One-Class SVM can select the correct points in different datasets. The image registration results obtained on the second experiment show that the proposed strategy is robust to the nonlinear transformation between optical and SAR images.

Accurate optical and synthetic aperture radar (SAR) image registration is crucial to multisensor remote sensing applications. Though several algorithms have been proposed, the practical implementation that directly matches large and high-resolution optical and SAR images remains underexplored by the community. Equipped with the satellite positioning parameters, optical and SAR images can be roughly registered based on geographic coordinates. However, the relative positioning accuracy is still dozens, even hundreds of pixels due to the inaccuracies of sensor parameters and elevation. Consequently, we propose a robust registration algorithm, which consists of two stages, where the horizontal positioning errors can be reduced in the first stage, and then, we fine-tune the correspondences in the second stage. Specifically, we propose a novel template matching method based on the dilated convolutional feature (DCF) and epipolar-oriented phase correlation. DCF is constructed by a depthwise-separable dilated convolution with multichannel gradients, which are generated by the Sobel operator for optical images and a ratio of exponentially weighted averages (ROEWA) operator for SAR images. Due to the large reception field of dilated convolution, DCF can retain invariance even for large relative positioning errors. The epipolar-oriented rectangle template, which stretches along the epipolar line, is then proposed to capture more overlapping areas compared to square templates. Furthermore, the outlier removal is implemented in the coordinate system of optical images to avoid the effect of range compression in SAR images. Inliers are finally used to refine the rational polynomial coefficients (RPCs) based on the bundle adjustment technique. Experimental results on high-resolution optical and SAR image products of various scenarios demonstrate the effectiveness of the proposed registration framework. The relative positioning errors of the refined RPCs can be reduced from hundreds of pixels to the subpixel level.

The usage of a hypersonic platform for remote sensing application has promising prospects, especially for hypersonic platform-borne synthetic aperture radar (SAR) imaging. However, the high-speed of hypersonic platform will lead to extreme friction between the platform and air, which will cause the ionization of air. The ionized gas forms the plasma sheath wrapped around the hypersonic platform. The plasma sheath will severely affect the propagation of SAR signal and further affect the SAR imaging. Therefore, hypersonic platform-borne SAR imaging should be studied from a physical perspective. In this paper, hypersonic platform-borne SAR imaging under plasma sheath is analyzed. The SAR signal propagation in plasma sheath is computed using scatter matrix method. The proposed SAR signal model is verified by using a ground experiment system. Moreover, the effect of attenuation caused by plasma sheath on SAR imaging is studied under different SAR parameters and plasma sheath. The result shows that attenuation caused by plasma sheath will degrade the SAR imaging quality and even cause the point and area targets to be submerged into the noise. The real SAR images under plasma sheath also illustrate this phenomenon. Furthermore, by studying imaging results under different SAR and plasma parameters, it can be concluded that the severe degradation of SAR imaging quality appears at condition of high plasma sheath electron density and low SAR carrier frequency. The work in this paper will be beneficial for the study of hypersonic platform-borne SAR imaging and design of hypersonic SAR imaging systems in the future.

As synthetic aperture radar (SAR) data is more and more popular in recent days, the fusion of SAR and optical image become inevitable and desirable problem. Image Registration is the fundamental for data fusion, and has been wildly studied. However, literature on registration between SAR and optical image remain little, which means the problem is still challenge and open. On one hand, the SAR and optical image are from totally different sensor with variant imaging mechanism. On the other hand, Simple features could not enough to maintain the accuracy and efficiency of multi-modal registration. We propose a new method for SAR and optical image registration. Different from current methods mainly based on intensity feature or point feature, our method matches two images by their boundary features. A globalized boundary detection algorithm are used for feature extraction. The extracted boundaries were then matched by coherence point drift algorithm. Experiments prove that our method could achieve pixel-level precision, and perform robust for different resolutions.

Common feature representation in optical and synthetic aperture radar (SAR) image registration is one of the most challenging tasks due to the significant geometric and radiometric differences. This letter proposed a <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Prominent structure-guided feature (PSGF)</i> representation for SAR and optical image registration. Firstly, the prominent structure of the image is highlighted based on windowed inherent variations, which is conducive to identifying more accurate and reliable corresponding points. Secondly, the maximum response index filter banks are proposed to extract structure features with multi-orientation convolution results. Then the structure feature-guided representation generated from this filtering map is quantized in histograms. Finally, the descriptor with radiation invariance is employed for feature matching, enabling automatic image registration with high accuracy. Comparative analysis with state-of-the-art methods on diverse terrain data demonstrates the superiority of the proposed PSGF method for SAR and optical image registration.

Availability of the sufficient number of matching pairs is the major challenge for optical to SAR (Synthetic Aperture Radar) image registration. Recently, a distinctive order based self-similarity operator (DOBSS) has been proposed to register the optical images. In this paper, a modified version of the distinctive order based self-similarity (M-DOBSS) is proposed to register the optical and SAR images. The proposed M-DOBSS provides more distinctiveness than the standard DOBSS operator. It can significantly increase the number of matching pairs between the optical and SAR images. Experiments on different sets of optical-SAR image pairs demonstrates the effectiveness of the proposed method.

Synthetic aperture radar (SAR) images are corrupted by multiplicative speckle noise, which will influence the human interpretation and computer-aided scene analysis. In this paper, we propose a CGMRF-like based technique for speckle reduction of SAR images. Unlike active line elements of CGMRF, the static line elements are determined once for the SAR images by modified Touzi's edge detector, and used to guide the despeckling process. So we refer to this as CGMRF-like based technique. Experimental results demonstrate that our proposed approach can not only reduce speckle effectively, but also preserve edge features.

In general, synthetic aperture radar (SAR) imaging and image processing are two sequential steps in SAR image processing. Due to the large size of SAR images, most image processing algorithms require image segmentation before processing. However, the existence of speckle noise in SAR images, as well as poor contrast and the uneven distribution of gray values in the same target, make SAR images difficult to segment. In order to facilitate the subsequent processing of SAR images, this paper proposes a new method that combines the back-projection algorithm (BPA) and a first-order gradient operator to enhance the edges of SAR images to overcome image segmentation problems. For complex-valued signals, the gradient operator was applied directly to the imaging process. The experimental results of simulated images and real images validate our proposed method. For the simulated scene, the supervised image segmentation evaluation indexes of our method have more than 1.18%, 11.2% and 11.72% improvement on probabilistic Rand index (PRI), variability index (VI), and global consistency error (GCE). The proposed imaging method will make SAR image segmentation and related applications easier.

Ship detection from synthetic aperture radar (SAR) images is a hot topic, but the difficulty in collecting labeled SAR images may hinder the development of deep-learning-based detection methods. Inspired by the idea of domain adaptation, in this article, we propose a hierarchical similarity alignment neural network (HSANet) for ship detection in SAR images, which is a domain adaptive (DA) approach with optical remote sensing images as training samples. The kernel target of HSANet is to mine and align both the global structure and the local instance information between SAR and optical images, where two modules, structural alignment module (SAM) and prototype alignment module (PAM), are designed to, respectively, conduct two hierarchies of alignment process. In general, SAM attempts to extract the global structure similarity which exists in image-level feature representation, while PAM tends to extract the local shape similarity which is instance-level representation. To be specific, SAM is developed by Fourier-based feature alignment, which tries to describe the similar structural relationship between optical and SAR images. Meanwhile, PAM is proposed based on the conjoint confidence analysis where the instance-level ship representations of the source and target domains is aligned. SAM and PAM work together to construct a hierarchical domain adaptation network for SAR ship detection. Experiments on several public datasets may indicate the effectiveness of the proposed method.

A novel three-step method to reduce speckle in Synthetic Aperture Radar (SAR) images is presented. First, an edge detector is used to detect the edge orientations in SAR images. Second, using a data processing method named empirical mode decomposition, the SAR image is smoothed along four directions: horizontal, vertical, left diagonal and right diagonal, respectively. Third, the SAR image is reconstructed such that if the edge direction is horizontal, the pixel smoothed along the horizontal direction is used to reconstruct the image, and so on; if an edge is not detected, the mean of the four directionally smoothed images is used to reconstruct the image. Application of this method to SAR images has shown that it is well balanced in the quality of visual appearance, mean preservation, edge preservation, and reduction of the standard deviation.

ABSTRACTThe speckle noise of synthetic aperture radar (SAR) images limits its application in change detection. Compared with improved ratio (IR) and log-ratio (LR) operators, the neighborhood-based ratio (NR) technique can restrain the influence of speckle noise and is more suitable for change detection in SAR images. However, we find three drawbacks of NR by analyzing this method carefully. To overcome these defects, we propose an improved neighborhood-based ratio (INR) approach for change detection in SAR images. INR restructures the NR operator to exploit the neighborhood information more reasonably and is expected to reduce the impact of speckle noise better. IR, LR, mean ratio operator, NR, and INR are tested on two data sets to compare their performances in change detection of SAR images. Experimental results show that the proposed method can obtain better difference image than other state-of-art methods and improve the accuracy of change detection in SAR images effectively.