SAR and optical image registration based on edge features

Common feature representation in optical and synthetic aperture radar (SAR) image registration is one of the most challenging tasks due to the significant geometric and radiometric differences. This letter proposed a <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Prominent structure-guided feature (PSGF)</i> representation for SAR and optical image registration. Firstly, the prominent structure of the image is highlighted based on windowed inherent variations, which is conducive to identifying more accurate and reliable corresponding points. Secondly, the maximum response index filter banks are proposed to extract structure features with multi-orientation convolution results. Then the structure feature-guided representation generated from this filtering map is quantized in histograms. Finally, the descriptor with radiation invariance is employed for feature matching, enabling automatic image registration with high accuracy. Comparative analysis with state-of-the-art methods on diverse terrain data demonstrates the superiority of the proposed PSGF method for SAR and optical image registration.

The traditional template matching strategy of optical and synthetic aperture radar (SAR) is sensitive to the nonlinear transformation between two images. In some cases, the optical and SAR image pairs do not conform to the affine transformation condition. To address this issue, this study presents a novel template matching strategy which uses the One-Class Support Vector Machine (SVM) to remove outliers. First, we propose a method to construct the similarity map dataset using the SEN1-2 dataset for training the One-Class SVM. Second, a four-step strategy for optical and SAR image registration is presented in this paper. In the first step, the optical image is divided into some grids. In the second step, the strongest Harris response point is selected as the feature point in each grid. In the third step, we use Gaussian pyramid features of oriented gradients (GPOG) descriptor to calculate the similarity map in the search region. The trained One-Class SVM is used to remove outliers through similarity maps in the fourth step. Furthermore, the number of improve matches (NIM) and the rate of improve matches (RIM) are designed to measure the effect of image registration. Finally, this paper designs two experiments to prove that the proposed strategy can correctly select the matching points through similarity maps. The experimental results of the One-Class SVM in dataset show that the One-Class SVM can select the correct points in different datasets. The image registration results obtained on the second experiment show that the proposed strategy is robust to the nonlinear transformation between optical and SAR images.

For Synthetic Aperture Radar (SAR) image registration, successive processes following feature extraction are required by both the traditional feature-based method and the deep learning method. Among these processes, the feature matching process—whose time and space complexity are related to the number of feature points extracted from sensed and reference images, as well as the dimension of feature descriptors—proves to be particularly time consuming. Additionally, the successive processes introduce data sharing and memory occupancy issues, requiring an elaborate design to prevent memory leaks. To address these challenges, this paper introduces the OptionEM-based reinforcement learning framework to achieve end-to-end SAR image registration. This framework outputs registered images directly without requiring feature matching and the calculation of the transformation matrix, leading to significant processing time savings. The Transformer architecture is employed to learn image features, while a correlation network is introduced to learn the correlation and transformation matrix between image pairs. Reinforcement learning, as a decision process, can dynamically correct errors, making it more-efficient and -robust compared to supervised learning mechanisms such as deep learning. We present a hierarchical reinforcement learning framework combined with Episodic Memory to mitigate the inherent problem of invalid exploration in generalized reinforcement learning algorithms. This approach effectively combines coarse and fine registration, further enhancing training efficiency. Experiments conducted on three sets of SAR images, acquired by TerraSAR-X and Sentinel-1A, demonstrated that the proposed method’s average runtime is sub-second, achieving subpixel registration accuracy.

We address the application of model-supported exploitation techniques to synthetic aperture radar (SAR) imagery. The emphasis is on monitoring SAR imagery using wide area 2D and/or 3D site models along with contextual information. We consider here the following tasks useful in monitoring: (a) site model construction using segmentation and labeling techniques, (b) target detection, (c) target classification and indexing, and (d) SAR image-site model registration. The 2-D wide area site models used here for SAR image exploitation differ from typical site models developed for RADIUS applications, in that they do not model specific facilities, but constitute wide area site models of cultural features such as urban clutter areas, roads, clearings, fields, etc. These models may be derived directly from existing site models, possibly constructed from electro-optical (EO) observations. When such models are not available, a set of segmentation and labeling techniques described here can be used for the construction of 2D site models. The use of models can potentially yield critical information which can disambiguate target signatures in SAR images. We address registration of SAR and EO images to a common site model. Specific derivations are given for the case of registration within the RCDE platform. We suggest a constant false alarm rate (CFAR) detection scheme and a topographic primal sketch (TPS) based classification scheme for monitoring target occurrences in SAR images. The TPS of an observed target is matched against candidate targets TPSs synthesized for the preferred target orientation, inferred from context (e.g. road or parking lot targets). Experimental results on real and synthetic SAR images are provided.

An Improved Anisotropic Gaussian-Scale Invariant Feature Transform (IAG-SIFT) algorithm is proposed to register the Synthetic Aperture Radar (SAR) images. The standard SIFT algorithm generates isotropic Gaussian scale space which blurs lots of details in the image. The Anisotropic Scale Space (ASS) can preserve more details than the isotropic one. However, in many SAR registration methods, the gradient calculation of the ASS is performed by using the simple differential equation which is not appropriate for SAR images. As the SAR images contain multiplicative speckle noise, simple difference operation is not suitable for gradient calculation. It can reduce the number of correct matches in SAR image registration. So, in this paper, a Gaussian-Gamma-Shaped Bi-Window (GGS-BW) is used for ratio based gradient computation which is very effective for SAR images. The proposed IAG-SIFT method significantly improves the matching performance between the SAR images. The Experimental results show the effectiveness of proposed IAG-SIFT algorithm in SAR image registration.

Synthetic aperture radar (SAR) imaging has been widely applied in drones for its consistent surveillance capability and invulnerability to smoke or cloud. Yet drone platform is unstable and observing distance is much shorter than satellite. As a consequence, the SAR image registration, which is a crucial process in SAR imaging, is influenced by sparkling scattering spots and coherent speckle noise. In this paper, we propose a multi-layer method to improve SAR registration performance on drones. ORB method is applied to mitigate sparkle scattering spot. Multi-layer feature clustering can eliminate the error matches by coherent speckle noise. Experiments were carried out to valid the proposed method. Results demonstrate that the proposed method can improve SAR image registration performance on unstable aerial platforms.

Accurate optical and synthetic aperture radar (SAR) image registration is crucial to multisensor remote sensing applications. Though several algorithms have been proposed, the practical implementation that directly matches large and high-resolution optical and SAR images remains underexplored by the community. Equipped with the satellite positioning parameters, optical and SAR images can be roughly registered based on geographic coordinates. However, the relative positioning accuracy is still dozens, even hundreds of pixels due to the inaccuracies of sensor parameters and elevation. Consequently, we propose a robust registration algorithm, which consists of two stages, where the horizontal positioning errors can be reduced in the first stage, and then, we fine-tune the correspondences in the second stage. Specifically, we propose a novel template matching method based on the dilated convolutional feature (DCF) and epipolar-oriented phase correlation. DCF is constructed by a depthwise-separable dilated convolution with multichannel gradients, which are generated by the Sobel operator for optical images and a ratio of exponentially weighted averages (ROEWA) operator for SAR images. Due to the large reception field of dilated convolution, DCF can retain invariance even for large relative positioning errors. The epipolar-oriented rectangle template, which stretches along the epipolar line, is then proposed to capture more overlapping areas compared to square templates. Furthermore, the outlier removal is implemented in the coordinate system of optical images to avoid the effect of range compression in SAR images. Inliers are finally used to refine the rational polynomial coefficients (RPCs) based on the bundle adjustment technique. Experimental results on high-resolution optical and SAR image products of various scenarios demonstrate the effectiveness of the proposed registration framework. The relative positioning errors of the refined RPCs can be reduced from hundreds of pixels to the subpixel level.

Availability of the sufficient number of matching pairs is the major challenge for optical to SAR (Synthetic Aperture Radar) image registration. Recently, a distinctive order based self-similarity operator (DOBSS) has been proposed to register the optical images. In this paper, a modified version of the distinctive order based self-similarity (M-DOBSS) is proposed to register the optical and SAR images. The proposed M-DOBSS provides more distinctiveness than the standard DOBSS operator. It can significantly increase the number of matching pairs between the optical and SAR images. Experiments on different sets of optical-SAR image pairs demonstrates the effectiveness of the proposed method.

This paper examines a feature-level fusion framework for detecting and mapping land degradation (LD) and enabling sustainable land management (SLM) in semi-arid areas using optical sensors and Synthetic Aperture Radar (SAR) satellite data. The objectives of this review were to (i) determine the trends and geographical location of land degradation mapping publications, (ii) to identify and report current challenges pertaining to mapping LD using multiscale remote sensing data, (iii) to recommend a way forward for monitoring LD using multiscale remote sensing data. The study reviewed 78 peer-reviewed research articles published over the past 24 years (1998–2022). Image fusion has the potential to be more useful in various remote sensing applications than individual sensor image data, making it more informative and valuable in the interpretation process. In addition, this review discusses the importance of SAR and optical image fusion, pixel-level techniques, applications, and major classes of quality metrics for objectively assessing fusion performance. The literature review alluded that the SAR and optical image fusion in the detection and mapping of land degradation and enabling sustainable land management has not been fully explored. Advanced techniques such as the fusion of SAR and optical satellite imageries need to be incorporated for the detection and mapping of LD, as well as the promotion of SLM in halting LD in South African drylands and around the world. We conclude that there is scope for further research on the fusion of SAR and optical images, as new micro-wave and optical sensors with higher resolution are introduced on a regular basis. The results of this review contribute to a better understanding of the applications of SAR and optical image fusion in future research in the severely degraded drylands of southern Africa. KEY RESEARCH GAPS The fusion of SAR and optical data still remains an open challenge. The future of different remote sensing applications lies in this kind of fusion. Land degradation is one of the greatest challenges amongst the environmental problems in South Africa, causing a reduction in the capacity of the land to perform ecosystem functions and services that support society and development. Yet, in South Africa, there are no studies that have widely investigated the potential for a fusion of SAR and optical data to detect and map land degradation and SLM practices. This paper established a baseline for understanding the application of a fusion of SAR and optical data as rapid tools for mapping, monitoring, and evaluating LD, as well as the impacts of SLM practices in South Africa’s degraded drylands.

The equator’s unique combination of high humidity and temperature renders optical satellite imagery highly susceptible to persistent cloud cover. In contrast, synthetic aperture radar (SAR) offers a robust alternative due to its ability to penetrate clouds with microwave imaging. This study addresses the challenges of cloud-induced data gaps and cross-sensor geometric biases by proposing an advanced optical and SAR image-matching framework specifically designed for cloud-prone equatorial regions. We use a prompt-driven visual segmentation model with automatic prompt point generation to produce cloud masks that guide cross-modal feature-matching and joint adjustment of optical and SAR data. This process results in a comprehensive digital orthophoto map (DOM) with high geometric consistency, retaining the fine spatial detail of optical data and the all-weather reliability of SAR. We validate our approach across four equatorial regions using five satellite platforms with varying spatial resolutions and revisit intervals. Even in areas with more than 50 percent cloud cover, our method maintains sub-pixel edging accuracy under manual check points and delivers comprehensive DOM products, establishing a reliable foundation for downstream environmental monitoring and ecosystem analysis.

This letter presents an effective approach for synthetic aperture radar (SAR) image registration. Corresponding edge features are extracted by exploring the local spatial relationship around corresponding speeded-up robust feature points. Only edge pairs that are matched in the aspect of distance and orientation to the center feature points are taken as effective edge features. For edge-point set matching, we introduce the coherent point drift (CPD) registration method. CPD is able to maintain the global topological structure of edges and is robust to outliers. We refine the original CPD by taking our confidence on edge points as prior information. A new objective function is deduced, resulting in a better registration performance. Experimental results show that the proposed method performs well in terms of registration robustness and accuracy.

Synthetic Aperture Radar (SAR) images are efficient and reliable source of information in extraction of damaged regions in case of floods. In assessment of damage accurately due to floods, image registration of optical (before-flood) and SAR images (after-flood) has to be carried out efficiently. In this paper, we discuss a robust multi-sensor image registration algorithm using scale invariant feature points for keypoint extraction. For matching the keypoints, a multi-objective genetic algorithm is developed with angle, distance and vicinity criterion as the fitness functions. This optimization process helps in matching the scale invariant feature points. From the obtained results, the performance of the image registration is evaluated and it is concluded that the proposed approach is efficient.

In single band and single polarized synthetic aperture radar (SAR) images, the information is limited to intensity and texture only and it is very difficult to interpret such SAR images without any a priori information. For unsupervised classification of SAR images, M-band wavelet decomposition is performed on the SAR image and sub-band selection on the basis of energy levels is applied to improve the classification results since sparse representation of sub-bands degrades the performance of classification. Then, textural features are obtained from selected sub-bands and integrated with intensity features. An adaptive neuro-fuzzy algorithm is used to improve computational efficiency by extracting significant features. K-means classification is performed on the extracted features and land features are labeled. This classification algorithm involves user defined parameters. To remove the user dependency and to obtain maximum achievable classification accuracy, an algorithm is developed in this paper for classification accuracy in terms of the parameters involved in the segmentation process. This is very helpful to develop the automated land-cover monitoring system with SAR, where optimized parameters are to be identified only once and these parameters can be applied to SAR imagery of the same scene obtained year after year. A single band, single polarized SAR image is classified into water, urban and vegetation areas using this method and overall classification accuracy is obtained in the range of 85.92%–93.70% by comparing with ground truth data.

Synthetic Aperture Radar (SAR) is an active remote sensing system which can be installed on aircraft, satellite and other carriers with the advantages of all day and night and all-weather ability. It is the important problem that how to deal with SAR and extract information reasonably and efficiently. Particularly SAR image geometric correction is the bottleneck to impede the application of SAR. In this paper we introduces image registration and the Susan algorithm knowledge firstly, then introduces the process of SAR image registration based on Susan algorithm and finally presents experimental results of SAR image registration. The Experiment shows that this method is effective and applicable, no matter from calculating the time or from the calculation accuracy.

Ship detection from synthetic aperture radar (SAR) images is a hot topic, but the difficulty in collecting labeled SAR images may hinder the development of deep-learning-based detection methods. Inspired by the idea of domain adaptation, in this article, we propose a hierarchical similarity alignment neural network (HSANet) for ship detection in SAR images, which is a domain adaptive (DA) approach with optical remote sensing images as training samples. The kernel target of HSANet is to mine and align both the global structure and the local instance information between SAR and optical images, where two modules, structural alignment module (SAM) and prototype alignment module (PAM), are designed to, respectively, conduct two hierarchies of alignment process. In general, SAM attempts to extract the global structure similarity which exists in image-level feature representation, while PAM tends to extract the local shape similarity which is instance-level representation. To be specific, SAM is developed by Fourier-based feature alignment, which tries to describe the similar structural relationship between optical and SAR images. Meanwhile, PAM is proposed based on the conjoint confidence analysis where the instance-level ship representations of the source and target domains is aligned. SAM and PAM work together to construct a hierarchical domain adaptation network for SAR ship detection. Experiments on several public datasets may indicate the effectiveness of the proposed method.