A Deep Learning Solution for Height Reconstruction in SAR Tomography

In single band and single polarized synthetic aperture radar (SAR) images, the information is limited to intensity and texture only and it is very difficult to interpret such SAR images without any a priori information. For unsupervised classification of SAR images, M-band wavelet decomposition is performed on the SAR image and sub-band selection on the basis of energy levels is applied to improve the classification results since sparse representation of sub-bands degrades the performance of classification. Then, textural features are obtained from selected sub-bands and integrated with intensity features. An adaptive neuro-fuzzy algorithm is used to improve computational efficiency by extracting significant features. K-means classification is performed on the extracted features and land features are labeled. This classification algorithm involves user defined parameters. To remove the user dependency and to obtain maximum achievable classification accuracy, an algorithm is developed in this paper for classification accuracy in terms of the parameters involved in the segmentation process. This is very helpful to develop the automated land-cover monitoring system with SAR, where optimized parameters are to be identified only once and these parameters can be applied to SAR imagery of the same scene obtained year after year. A single band, single polarized SAR image is classified into water, urban and vegetation areas using this method and overall classification accuracy is obtained in the range of 85.92%–93.70% by comparing with ground truth data.

The usage of a hypersonic platform for remote sensing application has promising prospects, especially for hypersonic platform-borne synthetic aperture radar (SAR) imaging. However, the high-speed of hypersonic platform will lead to extreme friction between the platform and air, which will cause the ionization of air. The ionized gas forms the plasma sheath wrapped around the hypersonic platform. The plasma sheath will severely affect the propagation of SAR signal and further affect the SAR imaging. Therefore, hypersonic platform-borne SAR imaging should be studied from a physical perspective. In this paper, hypersonic platform-borne SAR imaging under plasma sheath is analyzed. The SAR signal propagation in plasma sheath is computed using scatter matrix method. The proposed SAR signal model is verified by using a ground experiment system. Moreover, the effect of attenuation caused by plasma sheath on SAR imaging is studied under different SAR parameters and plasma sheath. The result shows that attenuation caused by plasma sheath will degrade the SAR imaging quality and even cause the point and area targets to be submerged into the noise. The real SAR images under plasma sheath also illustrate this phenomenon. Furthermore, by studying imaging results under different SAR and plasma parameters, it can be concluded that the severe degradation of SAR imaging quality appears at condition of high plasma sheath electron density and low SAR carrier frequency. The work in this paper will be beneficial for the study of hypersonic platform-borne SAR imaging and design of hypersonic SAR imaging systems in the future.

In recent years, the rapid development of Deep Learning (DL) has provided a new method for ship detection in Synthetic Aperture Radar (SAR) images. However, there are still four challenges in this task. (1) The ship targets in SAR images are very sparse. A large number of unnecessary anchor boxes may be generated on the feature map when using traditional anchor-based detection models, which could greatly increase the amount of computation and make it difficult to achieve real-time rapid detection. (2) The size of the ship targets in SAR images is relatively small. Most of the detection methods have poor performance on small ships in large scenes. (3) The terrestrial background in SAR images is very complicated. Ship targets are susceptible to interference from complex backgrounds, and there are serious false detections and missed detections. (4) The ship targets in SAR images are characterized by a large aspect ratio, arbitrary direction and dense arrangement. Traditional horizontal box detection can cause non-target areas to interfere with the extraction of ship features, and it is difficult to accurately express the length, width and axial information of ship targets. To solve these problems, we propose an effective lightweight anchor-free detector called R-Centernet+ in the paper. Its features are as follows: the Convolutional Block Attention Module (CBAM) is introduced to the backbone network to improve the focusing ability on small ships; the Foreground Enhance Module (FEM) is used to introduce foreground information to reduce the interference of the complex background; the detection head that can output the ship angle map is designed to realize the rotation detection of ship targets. To verify the validity of the proposed model in this paper, experiments are performed on two public SAR image datasets, i.e., SAR Ship Detection Dataset (SSDD) and AIR-SARShip. The results show that the proposed R-Centernet+ detector can detect both inshore and offshore ships with higher accuracy than traditional models with an average precision of 95.11% on SSDD and 84.89% on AIR-SARShip, and the detection speed is quite fast with 33 frames per second.

In general, synthetic aperture radar (SAR) imaging and image processing are two sequential steps in SAR image processing. Due to the large size of SAR images, most image processing algorithms require image segmentation before processing. However, the existence of speckle noise in SAR images, as well as poor contrast and the uneven distribution of gray values in the same target, make SAR images difficult to segment. In order to facilitate the subsequent processing of SAR images, this paper proposes a new method that combines the back-projection algorithm (BPA) and a first-order gradient operator to enhance the edges of SAR images to overcome image segmentation problems. For complex-valued signals, the gradient operator was applied directly to the imaging process. The experimental results of simulated images and real images validate our proposed method. For the simulated scene, the supervised image segmentation evaluation indexes of our method have more than 1.18%, 11.2% and 11.72% improvement on probabilistic Rand index (PRI), variability index (VI), and global consistency error (GCE). The proposed imaging method will make SAR image segmentation and related applications easier.

We address the application of model-supported exploitation techniques to synthetic aperture radar (SAR) imagery. The emphasis is on monitoring SAR imagery using wide area 2D and/or 3D site models along with contextual information. We consider here the following tasks useful in monitoring: (a) site model construction using segmentation and labeling techniques, (b) target detection, (c) target classification and indexing, and (d) SAR image-site model registration. The 2-D wide area site models used here for SAR image exploitation differ from typical site models developed for RADIUS applications, in that they do not model specific facilities, but constitute wide area site models of cultural features such as urban clutter areas, roads, clearings, fields, etc. These models may be derived directly from existing site models, possibly constructed from electro-optical (EO) observations. When such models are not available, a set of segmentation and labeling techniques described here can be used for the construction of 2D site models. The use of models can potentially yield critical information which can disambiguate target signatures in SAR images. We address registration of SAR and EO images to a common site model. Specific derivations are given for the case of registration within the RCDE platform. We suggest a constant false alarm rate (CFAR) detection scheme and a topographic primal sketch (TPS) based classification scheme for monitoring target occurrences in SAR images. The TPS of an observed target is matched against candidate targets TPSs synthesized for the preferred target orientation, inferred from context (e.g. road or parking lot targets). Experimental results on real and synthetic SAR images are provided.

Ship detection in synthetic aperture radar (SAR) images is becoming a research hotspot. In recent years, as the rise of artificial intelligence, deep learning has almost dominated SAR ship detection community for its higher accuracy, faster speed, less human intervention, etc. However, today, there is still a lack of a reliable deep learning SAR ship detection dataset that can meet the practical migration application of ship detection in large-scene space-borne SAR images. Thus, to solve this problem, this paper releases a Large-Scale SAR Ship Detection Dataset-v1.0 (LS-SSDD-v1.0) from Sentinel-1, for small ship detection under large-scale backgrounds. LS-SSDD-v1.0 contains 15 large-scale SAR images whose ground truths are correctly labeled by SAR experts by drawing support from the Automatic Identification System (AIS) and Google Earth. To facilitate network training, the large-scale images are directly cut into 9000 sub-images without bells and whistles, providing convenience for subsequent detection result presentation in large-scale SAR images. Notably, LS-SSDD-v1.0 has five advantages: (1) large-scale backgrounds, (2) small ship detection, (3) abundant pure backgrounds, (4) fully automatic detection flow, and (5) numerous and standardized research baselines. Last but not least, combined with the advantage of abundant pure backgrounds, we also propose a Pure Background Hybrid Training mechanism (PBHT-mechanism) to suppress false alarms of land in large-scale SAR images. Experimental results of ablation study can verify the effectiveness of the PBHT-mechanism. LS-SSDD-v1.0 can inspire related scholars to make extensive research into SAR ship detection methods with engineering application value, which is conducive to the progress of SAR intelligent interpretation technology.

<p>The velocity of glaciers is commonly derived by offset tracking using pairwise cross correlation or feature matching of either optical or synthetic aperture radar (SAR) images.  SAR images, however, are inherently affected by noise-like radar speckle and require therefore much larger images patches for successful tracking compared to the patch size used with optical data. As a consequence, glacier velocity maps based on SAR offset tracking have a relatively low resolution compared to the nominal resolution of SAR sensors. Moreover, tracking may fail because small features on the glacier surface cannot be detected due to radar speckle. Although radar speckle can be reduced by applying spatial low-pass filters (e.g. 5x5 boxcar), the spatial smoothing reduces the image resolution roughly by an order of magnitude which strongly reduces the tracking precision. Furthermore, it blurs out small features on the glacier surface, and therefore tracking can also fail unless clear features like large crevasses are visible.</p><p>In order to create high resolution velocity maps from SAR images and to generate speckle-free radar images of glaciers, we present a new method that derives the glacier surface velocity field by correlating temporally averaged sub-stacks of a series of SAR images. The key feature of the method is to warp every pixel in each SAR image according to its temporally increasing offset with respect to a reference date. The offset is determined by the glacier velocity which is obtained by maximizing the cross-correlation between the averages of two sub-stacks. Currently, we need to assume that the surface velocity is constant during the acquisition period of the image series but this assumption can be relaxed to a certain extend.</p><p>As the method combines the information of multiple images, radar speckle are highly suppressed by temporal multi-looking, therefore the signal-to-noise ratio of the cross-correlation is significantly improved. We found that the method outperforms the pair-wise cross-correlation method for velocity estimation in terms of both the coverage and the resolution of the velocity field. At the same time, very high resolution radar images are obtained and reveal features that are otherwise hidden in radar speckle.</p><p>As the reference date, to which the sub-stacks are averaged, can be arbitrarily chosen a smooth flow animation of the glacier surface can be generated based on a limited number of SAR images. The presented method could build a basis for a new generation of tracking methods as the method is excellently suited to exploit the large number of emerging free and globally available high resolution SAR image time series.</p>

This paper proposes a novel method on Synthetic Aperture Radar (SAR) Image denoising, which is based on context modeling combined with multiscale orthogonal bandlet coefficients. For the main influence of SAR image is multiplicative speckle noise, the logarithm uniform transform is used to convert it to additive noise. In this paper, the multiscale orthogonal bandlet transform is applied to noisy SAR Image. The contextual model is used to compute contextual values of bandlet coefficients on each scale. Therefore, bandlet coefficients are reconstructed into some parts by contextual values. The spatially adaptive soft-threshold (T) is to denoise SAR image in each part. Experimental results demonstrate that this method outperforms the methods of Ehance-Lee (E-lee), contextual model based on wavelet domain (Wavelet-context), and Hidden Markov Tree model bases on wavelet domain (Wavelet-hmt) on there indexes: Floating index (FI), Standard deviation and Edge saving index of vertical direction, by using a real SAR image. However, the method can not only reduce the speckle noise but also preserve edges and high frequency information, and gets considerable visual effect on SAR Image denoising.

Ship detection from synthetic aperture radar (SAR) images is a hot topic, but the difficulty in collecting labeled SAR images may hinder the development of deep-learning-based detection methods. Inspired by the idea of domain adaptation, in this article, we propose a hierarchical similarity alignment neural network (HSANet) for ship detection in SAR images, which is a domain adaptive (DA) approach with optical remote sensing images as training samples. The kernel target of HSANet is to mine and align both the global structure and the local instance information between SAR and optical images, where two modules, structural alignment module (SAM) and prototype alignment module (PAM), are designed to, respectively, conduct two hierarchies of alignment process. In general, SAM attempts to extract the global structure similarity which exists in image-level feature representation, while PAM tends to extract the local shape similarity which is instance-level representation. To be specific, SAM is developed by Fourier-based feature alignment, which tries to describe the similar structural relationship between optical and SAR images. Meanwhile, PAM is proposed based on the conjoint confidence analysis where the instance-level ship representations of the source and target domains is aligned. SAM and PAM work together to construct a hierarchical domain adaptation network for SAR ship detection. Experiments on several public datasets may indicate the effectiveness of the proposed method.

Sea ice is critical to map for safe and efficient maritime navigation, to mitigate ship trapping and capsizing. Sea ice is also vital to monitor to assess the state of the changing climate and a critical component in climate and weather models, reflecting sunlight towards space and acting as an insulating material between the ocean surface and the atmosphere.Professional sea ice analysts at national ice services map sea ice based on Synthetic Aperture Radar (SAR) images acquired by satellites, such as the Sentinel-1 (S1) satellite constellation. The ice analysts manually interpret the SAR images using their in-depth knowledge and experience to create sea ice charts with information on the sea ice conditions.A challenge for the S1 5.4 GHz SAR measurements is that the radar wave does not penetrate deep into the sea ice and is scattered/reflected by the surface. Therefore, the SAR images provide information primarily about the sea ice surface, useful for identifying and classify sea ice conditions. The charts describe, among others, the sea ice’s stage of development - the type of sea ice - an indicator of its thickness. The manual charting process apply sea ice classes, defined by the International Ice Charting Working Group (IICWG) on behalf of the World Meteorological Organization (WMO). Considerable uncertainties are associated with the ice classes that can vary from, e.g. 30-200cm or 70-120cm in thickness. Deep-learning models that produce stage-of-development information from S1 radar images exist but has the same inherent limitations of the sea ice charts in the model outputs.Current state-of-the-art sea ice thickness retrieval methods relies on altimeter satellites, such as the CryoSat-2 (CS2) satellite. The distance between the ocean and the sea ice is measured, known as the sea ice freeboard. For a Ku-band radar altimeter like CS2, it is assumed that the radar response penetrates the snow and returns from the sea ice surface. As the true penetration is unknown, and the radar wave propagation is delayed when the signal passes through snow, the measured quantity is known as the radar freeboard.The sea ice thickness can be estimated with an accuracy of 20-40% using the radar freeboard by calculating the sea ice's buoyancy based on snow and ice density estimates, and auxiliary snow depth information. However, CS2 only measures 1600m across the orbit and can thus only monitor sea ice thickness in the Arctic monthly - insufficient for many applications, such as maritime navigation, and leaves data record gaps. S1 SAR on the other hand, cover 400km in Extra Wide mode across the orbit with repeating coverage every week.Here, we present our preliminary results of circumventing the limitations of CS2 and S1 by training supervised deep-learning convolutional neural network (CNN) models to recognise sea ice textures in S1 SAR images and assign sea ice radar freeboard estimates acquired by CS2. This approach transfers information acquired by CS2 to S1, which we call Cryo2S1. A Cryo2S1 dataset is curated, containing several thousand collocated S1 SAR images and along-track CS2 measurements during 2020-2021.

Synthetic aperture radar (SAR) image target detection and recognition (SAR-TDR) tasks have become research hot spots in the remote sensing application. These targets include ships, vehicles, aircraft, oil tanks, bridges, and so on. However, with the rapid development of SAR technology and increasingly complex electromagnetic environment, complex characteristics of SAR images bring severe challenges to the accurate SAR-TDR via traditional physical models or manual feature-extraction-based machine learning methods. In recent years, deep learning (DL), as a powerful automatic feature extraction algorithm, has been widely used in the computer vision domain. More specifically, DL has also been introduced into the SAR-TDR tasks and has effectively achieved good performance in terms of accuracy, real-time processing, etc. With the rapid development of DL, SAR image processing, and practical requirements of SAR-TDR in civilian and military domains, it is crucial to conduct a systematic survey on SAR-TDR in the past few years. In this survey article, we mainly conduct a systematic overview of DL-based SAR-TDR literature on two tasks, i.e., target recognition (e.g., ground vehicles, ships, and aircraft) and target detection (e.g., ships, aircraft, change detection, sea surface oil spills, and oil tanks). More specifically, our related works about these topics are also presented to verify the effectiveness of DL-based methods. First, several DL methods (e.g., convolutional neural networks, recurrent neural networks, autoencoders, and generative adversarial networks), commonly used in SAR-TDR, are briefly introduced. Then, a systematic review of DL-based SAR-TDR (including our related works) is presented. Finally, the current challenges and future possible research directions are deeply analyzed and discussed.

A novel three-step method to reduce speckle in Synthetic Aperture Radar (SAR) images is presented. First, an edge detector is used to detect the edge orientations in SAR images. Second, using a data processing method named empirical mode decomposition, the SAR image is smoothed along four directions: horizontal, vertical, left diagonal and right diagonal, respectively. Third, the SAR image is reconstructed such that if the edge direction is horizontal, the pixel smoothed along the horizontal direction is used to reconstruct the image, and so on; if an edge is not detected, the mean of the four directionally smoothed images is used to reconstruct the image. Application of this method to SAR images has shown that it is well balanced in the quality of visual appearance, mean preservation, edge preservation, and reduction of the standard deviation.

ABSTRACTThe speckle noise of synthetic aperture radar (SAR) images limits its application in change detection. Compared with improved ratio (IR) and log-ratio (LR) operators, the neighborhood-based ratio (NR) technique can restrain the influence of speckle noise and is more suitable for change detection in SAR images. However, we find three drawbacks of NR by analyzing this method carefully. To overcome these defects, we propose an improved neighborhood-based ratio (INR) approach for change detection in SAR images. INR restructures the NR operator to exploit the neighborhood information more reasonably and is expected to reduce the impact of speckle noise better. IR, LR, mean ratio operator, NR, and INR are tested on two data sets to compare their performances in change detection of SAR images. Experimental results show that the proposed method can obtain better difference image than other state-of-art methods and improve the accuracy of change detection in SAR images effectively.

This paper proposes an Synthetic Aperture Radar (SAR) imaging and detection model of multiple targets at the maritime scene. The sea surface sample is generated according to the composite rough surface theory. The SAR imaging model is constructed based on a hybrid EM calculation approach with the fast ray tracing strategy and the modified facet Small Slope Approximation (SSA) solution. Numerical simulations calculate the EM scattering and the SAR imaging of the multiple cone targets above the sea surface, with the scattering mechanisms analyzed and discussed. The SAR imaging datasets are then set up by the SAR image simulations. A modified YOLOv7 neural network with the Spatial Pyramid Pooling Fast Connected Spatial Pyramid Convolution (SPPFCSPC) module, Convolutional Block Attention Module (CBAM), modified Feature Pyramid Network (FPN) structure and extra detection head is developed. In the training process on our constructed SAR datasets, the precision rate, recall rate, mAP@0.5 and mAP@0.5:0.95 are 97.46%, 90.08%, 92.91% and 91.98%, respectively, after 300 rounds of training. The detection results show that the modified YOLOv7 has a good performance in selecting the targets out of the complex sea surface and multipath interference background.

Recognition of occluded objects in synthetic aperture radar (SAR) images is a significant problem for automatic target recognition. In this paper, we present a hidden Markov modeling (HMM) based approach for recognizing objects in synthetic aperture radar (SAR) images. We identify the peculiar characteristics of SAR sensors and using these characteristics we develop feature based multiple models for a given SAR image of an object. The models exploiting the relative geometry of feature locations or the amplitude of SAR radar return are based on sequentialization of scattering centers extracted from SAR images. In order to improve performance we integrate these models synergistically using their probabalistic estimates for recognition of a particular target at a specific azimuth. Experimental results are presented using both synthetic and real SAR images.