PolSAR-SFCGN: An End-to-End PolSAR Superpixel Fully Convolutional Generation Network

Polarimetric Synthetic Aperture Radar (PolSAR) image classification is an important research content in the field of remote sensing. However, the lack of effective labeled data and the serious class distribution shift problem between different datasets hinder the application of deep learning networks in PolSAR image classification. Therefore, this paper proposes a Bi-classifier adversarial network based on covariance difference matrix and Convolutional Block Attention Module (CBAM) to solve the cross-domain problem in PolSAR images. Firstly, since PolSAR image processing generally uses the covariance matrix or coherence matrix of a single target pixel to construct the data set, which cannot effectively use the local information of PolSAR data,Therefore, the PolSAR coherence difference matrix P is proposed as the description of the PolSAR image difference information. Secondly, due to the different importance of features between neighboring pixels, the CBAM mechanism is introduced in order to exploit the spatial information of PolSAR data. Finally, in order to solve the cross-domain problem of PolSAR images more effectively, a bi-classifier adversarial network based on covariance difference matrix and CBAM is proposed. In this paper, we conduct experiments on public datasets, using images of San FranciscoⅠ acquired in 2008 as the source domain, and images of San Francisco Ⅱ acquired in 1992 as the target domain data. The experimental results show that the proposed method can effectively solve the cross-domain problem of PolSAR images.

With the improvement of spatial resolution of polarimetric synthetic aperture radar (PolSAR ) images, there was more research on texture features extracted from PolSAR images; however, the performance of texture features derived from different descriptors in PolSAR images was not fully explored. In this study, the performance of combining polarization features with texture features extracted by four descriptors, respectively, in land cover classification was explored. The experimental results indicated that: (1) different texture features have different abilities to distinguish ground objects; (2) with the improvement of spatial resolution of PolSAR images, texture features should not be ignored; (3) polarization features are very important for land cover classification, texture features can be used as auxiliary features to further improve the classification accuracy. This study could serve as a meaningful reference for information extraction from PolSAR images.

The phase difference, amplitude product, and amplitude ratio between two polarizations are important discriminators for terrain classification, which derives a significant statistical-distribution-based polarimetric synthetic aperture radar (PolSAR) image classification. Traditionally, statistical-distribution-based PolSAR image classification models pay attention to two aspects: searching for a suitable distribution to model certain PolSAR image and a satisfactory solution for the corresponding distribution model with samples in every terrain. Usually, the described distribution form is too complicated to build. Besides, inaccurate parameter estimation may lead to poor classification performance for PolSAR image. In order to refrain from this phenomenon, a variational thought is adopted for the statistical-distribution-based PolSAR classification method in this paper. First, a mixture Wishart model is built to model the PolSAR image to replace the complicated distribution for the PolSAR image. Second, a learning-based method is suggested instead of inaccurate point estimation of parameters to determine the distribution for every class in the mixture Wishart model. Finally, the proposed learning-based mixture Wishart model will be built as a variational form to realize a parametric model for PolSAR image classification. In the experiments, it will be proved that the class centers are easier to distinguish among different terrains learned from the proposed variational model. In addition, a classification performance on the PolSAR image is superior to the original point estimation Wishart model on both visual classification result and accuracy.

Deep neural networks have achieved remarkable results in the field of polarimetric synthetic aperture radar (PolSAR) image classification. However, PolSAR is affected by speckle imaging, resulting in PolSAR images usually containing a large amount of speckle noise, which usually leads to the poor spatial consistency of classification results and insufficient classification accuracy. Semantic segmentation methods based on deep learning can realize the task of image segmentation and classification at the same time, producing fine-grained and smooth classification maps. However, these approaches require enormous labeled data sets, which are laborious and time-consuming. Due to these issues, a new multi-modal contrastive fully convolutional network, named MCFCN, is proposed for PolSAR image classification in this paper, which combines multi-modal features of the same pixel as inputs to the model based on a fully convolutional network and accomplishes the classification task using only a small amount of labeled data through contrastive learning. In addition, to describe the PolSAR terrain targets more comprehensively and enhance the robustness of the classifier, a pixel overlapping classification strategy is proposed, which can not only improve the classification accuracy effectively but also enhance the stability of the method. The experiments demonstrate that compared with existing classification methods, the classification results of the proposed method for three real PolSAR datasets have higher classification accuracy.

Recently, convolutional neural networks (CNNs) have been successfully utilized in polarimetric synthetic aperture radar (PolSAR) image classification and obtained promising results. However, most CNN-based classification methods require a large number of labeled samples and it is difficult to obtain sufficient labeled samples. For this reason, an ensemble dual-branch CNN (EDb-CNN) is proposed for PolSAR image classification with small samples. First, to solve the problem of the small sample in PolSAR image classification, a new data enhancement method based on the superpixel algorithm is proposed to expand the number of labeled samples. Second, to obtain different scales of features from PolSAR images, a Db-CNN model is proposed. This model contains two parallel CNN structures. One CNN branch is used to extract the polarization features from the complex coherency matrix. The other branch is utilized to extract the spatial features based on weighted spatial neighborhood. On the top of these two branches, a feature fusion model is adopted to combine these two deep features, and a weighted loss function is employed to improve the learning procedure. Then, the ensemble learning algorithm is used for each CNN branch and Db-CNN network to obtain the better classification results. Finally, a postprocess algorithm based on the superpixel algorithm is proposed to improve the consistency of classification results. Experiments on two PolSAR datasets show that the proposed method achieves a much better performance than other classification methods, especially when only a few labeled samples are available.

Polarimetric synthetic aperture radar (PolSAR) image classification has achieved great progress, but there still exist some obstacles. On the one hand, a large amount of PolSAR data is captured. Nevertheless, most of them are not labeled with land cover categories, which cannot be fully utilized. On the other hand, annotating PolSAR images relies more on domain knowledge and manpower, which makes pixel-level annotation harder. To alleviate the above problems, by integrating contrastive learning and transformer, we propose a novel patch-level PolSAR image classification, i.e., two-staged contrastive learning and sub-patch attention based network (TCSPANet). Firstly, the two-staged contrastive learning based network (TCNet) is designed for learning the representation information of PolSAR images without supervision, and obtaining the discrimination and comparability for actual land covers. Then, resorting to transformer, we construct the sub-patch attention encoder (SPAE) for modelling the context within patch samples. For training the TCSPANet, two patch-level datasets are built up based on unsupervised and semi-supervised methods. When predicting, the classification algorithm, classifying or splitting, is put forward to realise non-overlapping and coarse-to-fine patch-level classification. The classification results of multi-PolSAR images with one trained model suggests that our proposed model is superior to the compared methods.

In recent years, sparse representation-based techniques have shown great potential for pattern recognition problems. In this paper, the problem of polarimetric synthetic aperture radar (PolSAR) image classification is investigated using sparse representation-based classifiers (SRCs). We propose to take advantage of both polarimetric information and contextual information by combining sparsity-based classification methods with the concept of superpixels. Based on polarimetric feature vectors constructed by stacking a variety of polarimetric signatures and a superpixel map, two strategies are considered to perform polarimetric-contextual classification of PolSAR images. The first strategy starts by classifying the PolSAR image with pixel-wise SRC. Then, spatial regularization is imposed on the pixel-wise classification map by using majority voting within superpixels. In the second strategy, the PolSAR image is classified by taking superpixels as processing elements. The joint sparse representation-based classifier (JSRC) is employed to combine the polarimetric information contained in feature vectors and the contextual information provided by superpixels. Experimental results on real PolSAR datasets demonstrate the feasibility of the proposed approaches. It is proven that the classification performance is improved by using contextual information. A comparison with several other approaches also verifies the effectiveness of the proposed approach.

Supervised polarimetric synthetic aperture radar (PolSAR) image classification demands a large amount of precisely labeled data. However, such data are difficult to obtain. Therefore, many unsupervised methods have been proposed for unsupervised PolSAR image classification. The classification maps of unsupervised methods contain many high-confidence samples. These samples, which are often ignored, can be used as supervisory information to improve classification performance on PolSAR images. This study proposes a new unsupervised PolSAR image classification framework. The framework combines high-confidence superpixel pseudo-labeled samples and semi-supervised classification methods. The experiments indicated that this framework could achieve higher-level effectiveness in unsupervised PolSAR image classification. First, superpixel segmentation was performed on PolSAR images, and the geometric centers of the superpixels were generated. Second, the classification maps of rotation-domain deep mutual information (RDDMI), an unsupervised PolSAR image classification method, were used as the pseudo-labels of the central points of the superpixels. Finally, the unlabeled samples and the high-confidence pseudo-labeled samples were used to train an excellent semi-supervised method, similarity matching (SimMatch). Experiments on three real PolSAR datasets illustrated that, compared with the excellent RDDMI, the accuracy of the proposed method was increased by 1.70%, 0.99%, and 0.8%. The proposed framework provides significant performance improvements and is an efficient method for improving unsupervised PolSAR image classification.

Considering the clustering algorithms could explore the label information automatically, this paper proposes a new method in terms of polarimetric synthetic aperture radar (POLSAR) image classification, which named a clustering-wishart-auto-encoder (WAE) classification model. With considering the statistical distribution characteristic of the POLSAR image, the WAE classification model, which proposed by ourselves, could improve the classification performance of the POLSAR image to some extent. The clustering-WAE classification model, that embedded the K-means clustering algorithm into the objective function of the WAE model, has the ability to improve the network performance. Our proposed method could minimize the difference of intra-class data and maximize the difference of inter-class data, from which the obtained POLSAR image features will be more compact to their corresponding cluster centers. Via simultaneously considering the compactness and statistical distribution of data, our method is capable of improving the POLSAR image classification results. The effectiveness of our proposed classification model has been demonstrated on four real POLSAR data sets.

Wishart distance of covariance matrices and Euclidean distance of polarimetric features are two important similarity measurements for polarimetric synthetic aperture radar (Pol-SAR) image classification. This paper proposes a feature extraction method by combing the two distances for Pol-SAR image classification. Firstly, two weight graphs are constructed based on the two distances to represent the local information of the data. Specifically, the neighbouring samples are sought in a local region to reduce the computation burden and utilize the spatial information. Then the dimensionality reduction model is constructed based on the two weight graphs and co-regularization. The co-regularization aims to minimize the dissimilarity of low-dimensional features corresponding to two graphs. Finally, the obtained low-dimensional features are used for PolSAR image classification. Experimental results on real PolSAR datasets demonstrate the effectiveness and superiority of the proposed method.

The availability of polarimetric synthetic aperture radar (PolSAR) images has increased, and consequently, the classification of such images has received immense attention. Among different classification methods in the literature, it is possible to distinguish them according to learning paradigm and approach. Unsupervised methods have as advantage the independence of labeled data for training. Regarding the approach, image classification can be performed based on its individual pixels or on previously identified regions in the image. Previous studies verified that the region-based classification of PolSAR images using stochastic distances can produce better results in comparison with the pixel-based. Faced with the independence of training data by unsupervised methods and the potential of the region-based approach with stochastic distances, this study proposes a version of the unsupervised K -means algorithm for PolSAR region-based classification based on stochastic distances. The Bhattacharyya stochastic distance between Wishart distributions was adopted to measure the dissimilarity among regions of the PolSAR image. Additionally, a measure was proposed to compare unsupervised classification results. Two case studies that consider real and simulated images were conducted, and the results showed that the proposed version of K -means achieves higher accuracy values in comparison with the classic version.

Oil slicks and lookalikes (e.g., plant oil and oil emulsion) all appear as dark areas in polarimetric Synthetic Aperture Radar (SAR) images and are highly heterogeneous, so it is very difficult to use a single feature that can allow classification of dark objects in polarimetric SAR images as oil slicks or lookalikes. We established multi-feature fusion to support the discrimination of oil slicks and lookalikes. In the paper, simple discrimination analysis is used to rationalize a preferred features subset. The features analyzed include entropy, alpha, and Single-bounce Eigenvalue Relative Difference (SERD) in the C-band polarimetric mode. We also propose a novel SAR image discrimination method for oil slicks and lookalikes based on Convolutional Neural Network (CNN). The regions of interest are selected as the training and testing samples for CNN on the three kinds of polarimetric feature images. The proposed method is applied to a training data set of 5400 samples, including 1800 crude oil, 1800 plant oil, and 1800 oil emulsion samples. In the end, the effectiveness of the method is demonstrated through the analysis of some experimental results. The classification accuracy obtained using 900 samples of test data is 91.33%. It is here observed that the proposed method not only can accurately identify the dark spots on SAR images but also verify the ability of the proposed algorithm to classify unstructured features.

The robustness of the supervised polarimetric synthetic aperture radar (PolSAR) image classification is severely affected by two main aspects, namely, the quantity and quality of the labeled training pixels. Specifically, limited manually labeled pixels with respect to the large scale of PolSAR image have limited the performance of the automatic classification methods, while manually labeled training pixels shall be unfaithful with the speckle and impure cell for their low qualities. In order to address the above two fundamental problems, we propose a robust semisupervised probability graphic-based classification framework. First, a semisupervised learning scheme is implemented to simultaneously exploit both labeled and unlabeled pixels for information compensation. Moreover, structural relationship among neighboring pixels inducing from the prior information is further benefit to reduce the influence of limited labeled pixels. Second, a robust classification loss function is added in the process of training classifier to enhance the robustness to the noisy labeled pixels. Third, unfaithful limited labeled data can be settled with a hybrid generative/discriminative classification framework, where labeled and unlabeled pixels are simultaneously exploited for learning high-level feature for the low-quality pixels. The effectiveness of the proposed framework on the specific aspect is validated in experiments on real PolSAR data sets, which reveal the superiority in both visual performance and classification accuracy compared with the state-of-the-art methods. Totally speaking, our model has improved the classification accuracy by at least 20% on data set Flevoland, 10% on Oberpfaffenhofen, and 5% on Weihe River than the compared ones.

Polarimetric synthetic aperture radar (PolSAR) images classification is an important topic for PolSAR images understanding and interpretation. However, traditional pixel-based PolSAR image classification that takes image pixel as a processing unit cannot make full use of spatial information and, thus, may not obtain the satisfactory classification results. Hence, this letter proposed an attention-based multiscale sequential network for PolSAR images classification increasing the multiscale spatial information between pixels by way of spatial sequence. Specifically, the long short-term memory (LSTM) network is introduced to convert the time sequence into spatial sequence to extract the spatial features. Then, to obtain the more abundant spatial features and select more important spatial information, an attention-based multiscale spatial-enhanced LSTM (AMSE-LSTM) is proposed to enhance the relationship between pixel spatial information. Finally, a new mixed loss function is defined to improve the classification performance. Experimental results with two real PolSAR data show that compared with state-of-the-art methods, the proposed method can achieve a much better performance and overall classification accuracy.

Polarimetric synthetic aperture radar (PolSAR) image semantic segmentation is currently of great importance for synthetic aperture radar (SAR) image interpretation, especially in agricultural applications. Several convolutional neural networks (CNNs) have been implemented for SAR image semantic segmentation in urban or land cover applications. However, existing CNNs often break one semantic area into several pieces or confuse the adjacent semantic area in a PolSAR image. To address these issues uniformly, a refined pyramid scene parsing network (PSPNet) is proposed for PolSAR image semantic segmentation in an agricultural areas. Compared to conventional PSPNet architecture, the refined PSPNet adopts a multilevel feature fusion design in its decoder to effectively exploit the features learned from its different encoder branches. Besides, a polarimetric channel attention module is incorporated into the network to capture rich polarimetric features in a PolSAR image. Furthermore, an edge-aware loss function is devised to guide the network to refine pixel-level edge information directly from semantic segmentation prediction, separating easily confused agriculture area with sharp contours. Experimental results on one airborne millimeter-wave PolSAR dataset verify that the proposed network achieves promising semantic segmentation accuracy and preferable spatial consistency.