Deep Learning Meets SAR: Concepts, models, pitfalls, and perspectives

The paper provides a review into the steps involved in acquiring and processing synthetic aperture radar (SAR) data transmitted by the European remote sensing (ERS) satellites. The paper reports on a simple MATLAB-based SAR processing system, that reads the image out of the complex SAR data files and that is suitable for use in the classroom to demonstrate one of the procedures used in SAR data processing. The paper can also help a beginner in the field of SAR signal processing to get information and understand the basics that are necessary to acquire and process a SAR image. The data, provided by the Alaskan Satellite Facility (ASF), is categorized into different levels and the paper describes the process of obtaining the level-1 basic image from the level-0 raw data file provided by ASF.

The real-time processing of synthetic aperture radar (SAR) data has a high requirement for the processor, which is a difficult problem in SAR real-time processing. With the rapid development of optoelectronic devices, traditional electrical SAR data processing can be converted into optoelectronic processing to improve the processing speed. In this paper, a new type of optical device is proposed to improve the processing speed of SAR data. With the help of a spatial light modulator (SLM), the initial SAR signal and matched filter function are loaded on the input plane and spectrum plane of the 4f system, respectively. Using an optical lens with the function of the Fourier transform, the Fourier transform and inverse Fourier transform of the SAR signal are carried out to realize the fast imaging of SAR. In theory, the processing speed of SAR data is the speed of light. Compared with traditional methods such as the range-Doppler (RD) algorithm, it is no longer necessary to carry out a one-dimensional Fourier transform but to carry out matching filtering for the azimuth and range of the spectrum plane of 4f system at the same time. In this way, it is not necessary to introduce a cylindrical lens, only a spherical lens is needed to realize the Fourier transform imaging of SAR. Finally, a two-dimensional SAR processing optical system is built to obtain the SAR image in real time.

One of the problems associated with synthetic aperture radar (SAR) data analysis is the presence of random noise or speckle SAR data, being achromatic in nature, which offers very limited scope for the detection and delineation of various terrain features. ERS-1 SAR data for the coastal region of West Bengal, India were processed (a) to suppress the random noise using various filters, (b) to generate the intensity, hue and saturation (IHS) transform from temporal SAR data, and (c) to study the synergism of SAR data with optical sensor data. The results indicate that the Gamma MSP filter with a 5 5 pixel kernel size has been the most efficient in suppressing the noise and concurrently improving the image contrast. The IHS transform of temporal SAR data made it easier to discriminate between various wetland categories. This was also the case with hybrid image generated by the Indian Remote Sensing Satellite (IRS-1B) Linear Imaging and Self-scanning Sensor (LISS-II) data when compared to SAR data alone.

SAR image formation scheme implementation and endorsement sprouting from Level-0 data decoding

Despite recent research on the potential of dual- (DP) and full-polarimetry (FP) Synthetic Aperture Radar (SAR) data for crop mapping, the capability of compact polarimetry (CP) SAR data has not yet been thoroughly investigated. This is of particular concern, given the availability of such data from RADARSAT Constellation Mission (RCM) shortly. Previous studies have illustrated potential for accurate crop mapping using DP and FP SAR features, yet what contribution each feature makes to the model accuracy is not well investigated. Accordingly, this study examined the potential of the early- to mid-season (i.e., May to July) RADARSAT-2 SAR images for crop mapping in an agricultural region in Manitoba, Canada. Various classification scenarios were defined based on the extracted features from FP SAR data, as well as simulated DP and CP SAR data at two different noise floors. Both overall and individual class accuracies were compared for multi-temporal, multi-polarization SAR data using the pixel- and object-based random forest (RF) classification schemes. The late July C-band SAR observation was the most useful data for crop mapping, but the accuracy of single-date image classification was insufficient. Polarimetric decomposition features extracted from CP and FP SAR data produced relatively equal or slightly better classification accuracies compared to the SAR backscattering intensity features. The RF variable importance analysis revealed features that were sensitive to depolarization due to the volume scattering are the most important FP and CP SAR data. Synergistic use of all features resulted in a marginal improvement in overall classification accuracies, given that several extracted features were highly correlated. A reduction of highly correlated features based on integrating the Spearman correlation coefficient and the RF variable importance analyses boosted the accuracy of crop classification. In particular, overall accuracies of 88.23%, 82.12%, and 77.35% were achieved using the optimized features of FP, CP, and DP SAR data, respectively, using the object-based RF algorithm.

The objectives of this research are to develop robust methods for segmentation of multitemporal synthetic aperture radar (SAR) and optical data and to investigate the fusion of multitemporal ENVISAT advanced synthetic aperture radar (ASAR) and Chinese HJ-1B multispectral data for detailed urban land-cover mapping. Eight-date multiangle ENVISAT ASAR images and one-date HJ-1B charge-coupled device image acquired over Beijing in 2009 are selected for this research. The edge-aware region growing and merging (EARGM) algorithm is developed for segmentation of SAR and optical data. Edge detection using a Sobel filter is applied on SAR and optical data individually, and a majority voting approach is used to integrate all edge images. The edges are then used in a segmentation process to ensure that segments do not grow over edges. The segmentation is influenced by minimum and maximum segment sizes as well as the two homogeneity criteria, namely, a measure of color and a measure of texture. The classification is performed using support vector machines. The results show that our EARGM algorithm produces better segmentation than eCognition, particularly for built-up classes and linear features. The best classification result (80%) is achieved using the fusion of eight-date ENVISAT ASAR and HJ-1B data. This represents 5%, 11%, and 14% improvements over eCognition, HJ-1B, and ASAR classifications, respectively. The second best classification is achieved using fusion of four-date ENVISAT ASAR and HJ-1B data (78%). The result indicates that fewer multitemporal SAR images can achieve similar classification accuracy if multitemporal multiangle dual-look-direction SAR data are carefully selected.

Method for image classification considering Probability Density Function (PDF) based on simplified beta distributions is proposed. In this paper, image classification for Synthetic Aperture Radar (SAR) data is concerned. In particular, Probability Density Function (PDF) of SAR data is followed by not multivariate normal distribution but Chi-Square like distribution. It, however, is not always true that the PDF of SAR data is followed by Chi-Square distribution. Due to the mismatch between Chi-Square distribution and actual distribution, classification performance gets worth. In this paper, simplified beta distribution is assumed for the PDF of the SAR data. Furthermore, it is used to add texture information to the SAR data when the Maximum Likelihood classification is applied. In the paper, “Contrast” of texture feature is added to the SAR data. Through the experiments with real SAR data, it is found that matching error between real PDF and the proposed simplified beta distribution is smaller than the normal distribution. It is also found that applying the proposed distribution-adaptive maximum likelihood method using the simplified beta-distribution could achieve a classification accuracy improvement of 94.7% and 12.1%.

Fresh water is a scarce resource in the West-African Sahel region, seasonally influenced by droughts and floods. Particularly in terms of climate change, the importance of wetlands increases for flora, fauna, human population, agriculture, livestock and fishery. Hence, access to open water is a key factor. Long-term monitoring of water dynamics is of great importance, especially with regard to the spatio-temporal extend of wetlands and drylands. It can predict future trends and facilitate the development of adequate management strategies. Lake Tabalak, a Ramsar wetland of international importance, is one of the most significant ponds in Niger and a refuge for waterbirds. Nevertheless, human population growth increased the pressure on this ecosystem, which is now degrading for all uses. The main objective of the study is a long-term monitoring of the Lake Tabalak’s water dynamics to delineate permanent and seasonal water bodies, using weather- and daytime-independent multi-sensor and multi-temporal Synthetic Aperture Radar (SAR) data available for the study area. Data of the following sensors from 1993 until 2016 are used: Sentinel-1A, TerraSARX, ALOS PALSAR-1/2, Envisat ASAR, RADARSAT-1/2, and ERS-1/2. All SAR data are processed with the Multi-SAR-System, unifying the different characteristics of all above mentioned sensors in terms of geometric, radiometric and polarimetric resolution to a consistent format. The polarimetric representation in Kennaugh elements allows fusing single-polarized data acquired by older sensors with multi-polarized data acquired by current sensors. The TANH-normalization guarantees a consistent and therefore comparable description in a closed data range in terms of radiometry. The geometric aspect is solved by projecting all images to an earth-fixed coordinate system correcting the brightness by the help of the incidence angle. The elevation model used in the geocoding step is the novel global model produced by the TanDEM-X satellite mission. The advantage of the Multi-SAR-System is that it comprises ortho-rectification, radiometric enhancement, normalization and Kennaugh decomposition, independent from sensors, modes, polarizations or acquisition date of SAR data. In addition, optical satellite data can be included as well, to fill gaps where SAR data are missing due to the special normalization scheme. This kind of pre-processing is exclusively implemented at the Earth Observation Center of the German Aerospace Center in Oberpfaffenhofen, Germany. Therefore, the dynamic change of the open water of the Lake Tabalak could be classified over dry and rainy seasons and years, using different SAR data. The study provides a unique database and contributes to a better understanding of wetland systems in the Sahel region influenced by human pressure and climate change.

Recent drastic reductions in the Arctic sea-ice cover have raised an interest in understanding the role of sea ice in the global system as well as pointed out a need to understand the physical processes that lead to such changes. Satellite remote-sensing data provide important information about remote ice areas, and Synthetic Aperture Radar (SAR) data have the advantages of penetration of the omnipresent cloud cover and of high spatial resolution. A challenge addressed in this paper is how to extract information on sea-ice types and sea-ice processes from SAR data. We introduce, validate and apply geostatistical and statistical approaches to automated classification of sea ice from SAR data, to be used as individual tools for mapping sea-ice properties and provinces or in combination. A key concept of the geostatistical classification method is the analysis of spatial surface structures and their anisotropies, more generally, of spatial surface roughness, at variable, intermediate-sized scales. The geostatistical approach utilizes vario parameters extracted from directional vario functions, the parameters can be mapped or combined into feature vectors for classification. The method is flexible with respect to window sizes and parameter types and detects anisotropies. In two applications to RADARSAT and ERS-2 SAR data from the area near Point Barrow, Alaska, it is demonstrated that vario-parameter maps may be utilized to distinguish regions of different sea-ice characteristics in the Beaufort Sea, the Chukchi Sea and in Elson Lagoon. In a third and a fourth case study the analysis is taken further by utilizing multi-parameter feature vectors as inputs for unsupervised and supervised statistical classification. Field measurements and high-resolution aerial observations serve as basis for validation of the geostatistical-statistical classification methods. A combination of supervised classification and vario-parameter mapping yields best results, correctly identifying several sea-ice provinces in the shore-fast ice and the pack ice. Notably, sea ice does not have to be static to be classifiable with respect to spatial structures. In consequence, the geostatistical-statistical classification may be applied to detect changes in ice dynamics, kinematics or environmental changes, such as increased melt ponding, increased snowfall or changes in the equilibrium line.

ABSTRACTSentinel-1A synthetic aperture radar (SAR) data present an opportunity for acquiring crop information without restrictions caused by weather and illumination conditions, at a spatial resolution appropriate for individual rice fields and a temporal resolution sufficient to capture the growth profiles of different crop species. This study investigated the use of multi-temporal Sentinel-1A SAR data and Landsat-derived normalized difference vegetation index (NDVI) data to map the spatial distribution of paddy rice fields across parts of the Sanjiang plain, in northeast China. The satellite sensor data were acquired throughout the rice crop-growing season (May–October). A co-registered set of 10 dual polarization (VH/VV) SAR and NDVI images depicting crop phenological development were used as inputs to Support Vector Machine (SVM) and Random Forest (RF) machine learning classification algorithms in order to map paddy rice fields. The results showed a significant increase in overall classification when the NDVI time-series data were integrated with the various combinations of multi-temporal polarization channels (i.e. VH, VV, and VH/VV). The highest classification accuracies overall (95.2%) and for paddy rice (96.7%) were generated using the RF algorithm applied to combined multi-temporal VH polarization and NDVI data. The SVM classifier was most effective when applied to the dual polarization (i.e. VH and VV) SAR data alone and this generated overall and paddy rice classification accuracies of 91.6% and 82.5%, respectively. The results demonstrate the practicality of implementing RF or SVM machine learning algorithms to produce 10 m spatial resolution maps of paddy rice fields with limited ground data using a combination of multi-temporal SAR and NDVI data, where available, or SAR data alone. The methodological framework developed in this study is apposite for large-scale implementation across China and other major rice-growing regions of the world.

<p>Deep learning models have achieved remarkable success in many different fields and attracted many interests. Several researchers attempted to apply deep learning models to synthetic aperture radar (SAR) data processing, but it did not have the same breakthrough as the other fields, including optical remote sensing. SAR data are in complex domain by nature and processing them with real-valued (RV) networks neglects the phase component which conveys important and distinctive information. A complex-valued (CV) end-to-end deep network is developed in this study for the reconstruction and classification of CV-SAR data. Azimuth subaperture decomposition is utilized to incorporate physics-aware attributes of the CV-SAR into the deep model. Moreover, the correlation coefficient amplitude (coherence) of the CV-SAR images depends on the SAR system characteristics and physical properties of the target. This coherency should be considered and preserved in the processing chain of the CV-SAR data. The coherency preservation of the CV deep networks for CV-SAR images, which is mostly neglected in the literature, is evaluated in this study. Furthermore, a large-scale CV-SAR annotated dataset for the evaluation of the CV deep networks is lacking. A semantically annotated CVSAR dataset from Sentinel-1 single look complex stripmap mode data [S1SLC_CVDL (complex-valued deep learning) dataset] is developed and introduced in this study. The experimental analysis demonstrated the better performance of the developed CV deep network for CV-SAR data classification and reconstruction in comparison with the equivalent RV model and more complicated RV architectures, as well as its coherency preservation and physics-aware capability.</p>

The systematic evaluation of synthetic aperture radar (SAR) data analysis tools, such as segmentation and classification algorithms for geographic information systems, is difficult given the unavailability of ground-truth data in most cases. Therefore, testing is typically limited to small sets of pseudoground-truth data collected manually by trained experts, or primitive synthetic sets composed of simple geometries. To address this issue, we investigate the potential of employing an alternative approach, which involves the synthesis of SAR data and corresponding label fields from real SAR data for use as a reliable evaluation testbed. Given the scale-dependent nonstationary nature of SAR data, a new modeling approach that combines a resolution-oriented hierarchical method with a region-oriented binary tree structure is introduced to synthesize such complex data in a realistic manner. Experimental results using operational RADARSAT SAR sea-ice data and SIR-C/X-SAR land-mass data show that the proposed hierarchical approach can better model complex nonstationary scale structures than local MRF approaches and existing nonparametric methods, thus making it well suited for synthesizing SAR data and the corresponding label fields for potential use in the systematic evaluation of SAR data analysis tools.

Interpretation of synthetic aperture radar (SAR) data processing is difficult because the geometry and spectral range of SAR are different from optical imagery. Consequently, SAR imaging can be a complementary data to multispectral (MS) optical remote sensing techniques because it does not depend on solar illumination and weather conditions. This study presents a multisensor fusion of SAR and MS data based on the use of classification and regression tree (CART) and support vector machine (SVM) through a decision fusion system. First, different feature extraction strategies were applied on SAR and MS data to produce more spectral and textural information. To overcome the redundancy and correlation between features, an intrinsic dimension estimation method based on noise-whitened Harsanyi, Farrand, and Chang determines the proper dimension of the features. Then, principal component analysis and independent component analysis were utilized on stacked feature space of two data. Afterward, SVM and CART classified each reduced feature space. Finally, a fusion strategy was utilized to fuse the classification results. To show the effectiveness of the proposed methodology, single classification on each data was compared to the obtained results. A coregistered Radarsat-2 and WorldView-2 data set from San Francisco, USA, was available to examine the effectiveness of the proposed method. The results show that combinations of SAR data with optical sensor based on the proposed methodology improve the classification results for most of the classes. The proposed fusion method provided approximately 93.24% and 95.44% for two different areas of the data.

Detailed information on spatial distribution of wetland classes is crucial for monitoring this important productive ecosystem using advanced remote sensing tools and data. Although the potential of full- and dual-polarimetric (FP and DP) Synthetic Aperture Radar (SAR) data for wetland classification has been well examined, the capability of compact polarimetric (CP) SAR data has not yet been thoroughly investigated. This is of great significance, since the upcoming RADARSAT Constellation Mission (RCM), which will soon be the main source of SAR observations in Canada, will have CP mode as one of its main SAR configurations. This also highlights the necessity to fully exploit such important Earth Observation (EO) data by examining the similarities and dissimilarities between FP and CP SAR data for wetland mapping. Accordingly, this study examines and compares the discrimination capability of extracted features from FP and simulated CP SAR data between pairs of wetland classes. In particular, 13 FP and 22 simulated CP SAR features are extracted from RADARSAT-2 data to determine their discrimination capabilities both qualitatively and quantitatively in three wetland sites, located in Newfoundland and Labrador, Canada. Seven of 13 FP and 15 of 22 CP SAR features are found to be the most discriminant, as they indicate an excellent separability for at least one pair of wetland classes. The overall accuracies of 87.89%, 80.67%, and 84.07% are achieved using the CP SAR data for the three wetland sites (Avalon, Deer Lake, and Gros Morne, respectively) in this study. Although these accuracies are lower than those of FP SAR data, they confirm the potential of CP SAR data for wetland mapping as accuracies exceed 80% in all three sites. The CP SAR data collected by RCM will significantly contribute to the efforts ongoing of conservation strategies for wetlands and monitoring changes, especially on large scales, as they have both wider swath coverage and improved temporal resolution compared to those of RADARSAT-2.

Lineaments are the linear geological features can extend from few meters to hundreds of kms. Geologically lineaments are either structural or stratigraphical, typically it will comprise fault, fold axis, bedding contacts, dyke intrusions, shear zone or a straight coast line. Mapping lineaments using remote sensing is economical, faster can act as a preliminary study for geophysical survey such as gravity, electrical, magnetic and seismic etc. Generally, lineaments have been mapped using the optical remote sensing data such as Landsat, Resourcesat etc. For India, Lineaments were mapped using the LISS III and LISS IV of Resourcesat-1 & 2 at a scale of 1:50k. However in tropical region like India, limited exposure of ground due to vegetation cover, lineaments may go unnoticed in optical remote sensing data. This problem can be overcome by Synthetic Aperture Radar (SAR) data, which can penetrate ground significantly. With the launch of RISAT-1 satellite, data availability of SAR data is immense for Indian region. Aim of this study to explore the SAR data and merged SAR and optical data for lineament mapping.