Target recognition in synthetic aperture radar image based on PCANet

Synthetic Aperture Radar (SAR) images are prone to be contaminated by noise, which makes it very difficult to perform target recognition in SAR images. Inspired by great success of very deep convolutional neural networks (CNNs), this paper proposes a robust feature extraction method for SAR image target classification by adaptively fusing effective features from different CNN layers. First, YOLOv4 network is fine-tuned to detect the targets from the respective MF SAR target images. Second, a very deep CNN is trained from scratch on the moving and stationary target acquisition and recognition (MSTAR) database by using small filters throughout the whole net to reduce the speckle noise. Besides, using small-size convolution filters decreases the number of parameters in each layer and, therefore, reduces computation cost as the CNN goes deeper. The resulting CNN model is capable of extracting very deep features from the target images without performing any noise filtering or pre-processing techniques. Third, our approach proposes to use the multi-canonical correlation analysis (MCCA) to adaptively learn CNN features from different layers such that the resulting representations are highly linearly correlated and therefore can achieve better classification accuracy even if a simple linear support vector machine is used. Experimental results on the MSTAR dataset demonstrate that the proposed method outperforms the state-of-the-art methods.

ABSTRACTAutomatic Target Recognition (ATR) based on Synthetic Aperture Radar (SAR) images plays a key role in military applications. However, there are difficulties with this traditional recognition method. Principally, it is a challenge to design robust features and classifiers for different SAR images. Although Convolutional Neural Networks (CNNs) are very successful in many image classification tasks, building a deep network with limited labeled data remains a problem. The topologies of CNNs like the fully connected structure will lead to redundant parameters and the negligence of channel-wise information flow. A novel CNNs approach, called Group Squeeze Excitation Sparsely Connected Convolutional Networks (GSESCNNs), is therefore proposed as a solution. The group squeeze excitation performs dynamic channel-wise feature recalibration with less parameters than squeeze excitation. Sparsely connected convolutional networks are a more efficient way to operate the concatenation of feature maps from different layers. Experimental results on Moving and Stationary Target Acquisition and Recognition (MSTAR) SAR images, demonstrate that this approach achieves, at 99.79%, the best prediction accuracy, outperforming the most common skip connection models, such as Residual Networks and Densely Connected Convolutional Networks, as well as other methods reported in the MSTAR dataset.

This paper proposes an automatic target recognition (ATR) method for synthetic aperture radar (SAR) images based on information-decoupled representation. A typical SAR image of a ground target can be divided into three parts: target region, shadow and background. From the aspect of SAR target recognition, the target region and shadow contain discriminative information. However, they also include some confusing information because of the similarities of different targets. The background mainly contains redundant information, which has little contribution to the target recognition. Because the target segmentation may impair the discriminative information in the target region, the relatively simpler shadow segmentation is performed to separate the shadow region for information decoupling. Then, the information-decoupled representations are generated, i.e., the target image, shadow and original image. The background is retained in the target image, which represents the coupling of target backscattering and background. The original image and generated target image are classified using the sparse representation-based classification (SRC). Then, their classification results are combined by a score-level fusion for target recognition. The shadow image is not used because of its lower discriminability and possible segmentation errors. To evaluate the performance of the proposed method, extensive experiments are conducted on the Moving and Stationary Target Acquisition and Recognition (MSTAR) dataset under both standard operating condition (SOC) and various extended operating conditions (EOCs). The proposed method can correctly classify 10 classes of targets with the percentage of correct classification (PCC) of 94.88% under SOC. With the PCCs of 93.15% and 75.03% under configuration variance and 45° depression angle, respectively, the superiority of the proposed is demonstrated in comparison with other methods. The robustness of the proposed method to both uniform and nonuniform shadow segmentation errors is validated with the PCCs over 93%. Moreover, with the maximum average precision of 0.9580, the proposed method is more effective than the reference methods on outlier rejection.

Synthetic aperture radar (SAR) image target detection and recognition (SAR-TDR) tasks have become research hot spots in the remote sensing application. These targets include ships, vehicles, aircraft, oil tanks, bridges, and so on. However, with the rapid development of SAR technology and increasingly complex electromagnetic environment, complex characteristics of SAR images bring severe challenges to the accurate SAR-TDR via traditional physical models or manual feature-extraction-based machine learning methods. In recent years, deep learning (DL), as a powerful automatic feature extraction algorithm, has been widely used in the computer vision domain. More specifically, DL has also been introduced into the SAR-TDR tasks and has effectively achieved good performance in terms of accuracy, real-time processing, etc. With the rapid development of DL, SAR image processing, and practical requirements of SAR-TDR in civilian and military domains, it is crucial to conduct a systematic survey on SAR-TDR in the past few years. In this survey article, we mainly conduct a systematic overview of DL-based SAR-TDR literature on two tasks, i.e., target recognition (e.g., ground vehicles, ships, and aircraft) and target detection (e.g., ships, aircraft, change detection, sea surface oil spills, and oil tanks). More specifically, our related works about these topics are also presented to verify the effectiveness of DL-based methods. First, several DL methods (e.g., convolutional neural networks, recurrent neural networks, autoencoders, and generative adversarial networks), commonly used in SAR-TDR, are briefly introduced. Then, a systematic review of DL-based SAR-TDR (including our related works) is presented. Finally, the current challenges and future possible research directions are deeply analyzed and discussed.

In this review paper, several studies and researches were surveyed for assisting future researchers to identify available techniques in the field of classification of Synthetic Aperture Radar (SAR) images. SAR images are becoming increasingly important in a variety of remote sensing applications due to the ability of SAR sensors to operate in all types of weather conditions, including day and night remote sensing for long ranges and coverage areas. Its properties of vast planning, search, rescue, mine detection, and target identification make it very attractive for surveillance and observation missions of Earth resources. With the increasing popularity and availability of these images, the need for machines has emerged to enhance the ability to identify and interpret these images effectively. This is due to the fact that SAR image processing requires the formation of an image from the measured radar scatter returns, followed by a treatment to discover and define the image's composition. After reviewing several previous studies that succeeded in achieving a classification of SAR images for specific goals, it became obvious that they could be generalized to all types of SAR images. The most prominent use of Convolutional Neural Networks (CNN) was successful in extracting features from the images and training the neural network to analyze and classify them into classes according to these features. The dataset used in this model was obtained from the Moving and Stationary Target Acquisition and Recognition (MSTAR) database, which consists of a set of SAR images of military vehicles, for which the application of the CNN approach achieved a final accuracy of 97.91% on ten different classes.

Target Recognition Using Pre-Trained Convolutional Neural Networks and Transfer Learning

Target segmentation of synthetic aperture radar (SAR) images is one of the challenging problems in SAR image interpretation, which often serves as a processing step for SAR target recognition. Target segmentation tries to separate the target from the background thus eliminating the interference of background noises or clutters. However, the segmentation may also discard a part of the target characteristics and the target shadow which also contain discriminative information for target recognition. Then the tradeoff between interference elimination and discriminability loss will cause some effects on the target recognition. This paper aims to evaluate the influence of target segmentation on target recognition. Target recognition under standard operating condition (SOC) and several extended operating conditions (EOCs), i.e., depression angle variance and noise corruption, is conducted on the moving and stationary target acquisition and recognition (MSTAR) dataset using the original image and segmented target image, respectively. Moreover, the recognition performance under target segmentation errors is also evaluated. By comparing the recognition performance, the effects of target segmentation can be illustrated.

Images from different aspect views for one target, known as multiple views, are widely applied to improve synthetic aperture radar (SAR) target recognition. However, most of existing multi-view methods have strict constraint on the angle interval among multiple views. In this paper, a new multiview fusion method free from interval limitation using expectation maximization (EM) is explored for SAR image classification. Firstly, we apply convolutional neural network (CNN) to extract features effectively owning to its powerful ability of feature learning and then obtain the classification probability. Secondly, Multi-view Label Set (MLS) is automatically constructed from multiple views according to the probability and finally we use EM algorithm to classify SAR images intelligently. It is worth noting that the proposed method can be used flexibly according to the number of perspectives obtained and without angle interval constraint among multiple views. Experiments demonstrate that the proposed method has better recognition performance than some state-of-the-art methods on the Moving and Stationary Target Acquisition and Recognition (MSTAR) dataset.

Synthetic aperture radar (SAR) target recognition under extended operating conditions (EOCs) is a challenging problem due to the complex application environment, especially for insufficient target variations and corrupted SAR images in the training samples. This paper proposes a new strategy to solve these problems for target recognition. The SAR images are firstly characterized by multi-scale components of monogenic signal. The generated monogenic features are decomposed to learn a class dictionary and a shared dictionary, which represent the possible intraclass variations information and the common information, respectively. Moreover, a sparse representation of the class dictionary and a dense representation of the shared dictionary are jointly employed to represent a query sample for classification. The validity of the proposed strategy is demonstrated with multiple comparative experiments on moving and stationary target acquisition and recognition (MSTAR) database.

The synthetic aperture radar (SAR) image preprocessing techniques and their impact on target recognition performance are researched. The performance of SAR target recognition is improved by composing a variety of preprocessing techniques. The preprocessing techniques achieve the effects of suppressing background redundancy and enhancing target characteristics by processing the size and gray distribution of the original SAR image, thereby improving the subsequent target recognition performance. In this study, image cropping, target segmentation, and image enhancement algorithms are used to preprocess the original SAR image, and the target recognition performance is effectively improved by combining the above three preprocessing techniques. On the basis of image enhancement, the monogenic signal is used for feature extraction and then the sparse representation-based classification (SRC) is used to complete the decision. The experiments are conveyed on the moving and stationary target acquisition and recognition (MSTAR) dataset, and the results prove that the combination of multiple preprocessing techniques can effectively improve the SAR target recognition performance.

Attributed scattering center is one of important features of Synthetic Aperture Radar (SAR) image. In this paper, a method for the matching of attributed scattering centers and its application to SAR target recognition is proposed. First, the attributed scattering centers of the test SAR image and template SAR images are extracted on the basis of the attributed scattering model. Second, the Hungarian algorithm is employed to match the two scattering center sets. Based on the one to one correspondence, we design a new similarity measure to evaluate the similarity between the two scattering center sets that will decide the target type of the test image. The similarity measure considers the effects of each individual scattering center, single matching pair, and missing alarms and false alarms; thus, it is more comprehensive. The experiment based on moving and stationary target acquisition and recognition database demonstrates the validity of the proposed method.

In order to improve synthetic aperture radar (SAR) target recognition performance, this paper proposes a novel method using multi-level deep features. The multi-level deep features are learned by the convolutional neural network (CNN), which are capable of describing the target characteristics from different aspects. In order to make full use of the discrimination contained in the multi-level deep features, the joint sparse representation (JSR) is used as the basic classifier, which performs the multi-task learning to jointly classify the multi-level deep features. It could not only represent each feature properly but also consider the correlations between different levels of features. Based on the solutions from JSR, the target label is classified as the training class with the minimum reconstruction error. By fully exploiting the discriminative information contained in the multi-level deep features, the proposed method could effectively enhance SAR target recognition performance. The moving and stationary target acquisition and recognition (MSTAR) dataset is employed in the experiments. The results show that the proposed method could achieve a significantly high recognition rate of 99.38% for classifying 10 classes of targets under the standard operating condition (SOC), which is higher than those from some reference methods drawn from current literatures. Under different types of extended operating conditions (EOCs), the overall performance of the proposed method keeps superior over the reference methods. In addition, the outlier rejection capability of the proposed method is also better than the compared methods. All these experimental results validate the high effectiveness of the proposed method.

Synthetic aperture RADAR (SAR) is an emerging technology primarily used for high resolution ground mapping. SAR's capability to perform under adverse weather conditions, day or night makes it advantageous for many civilian and military applications. It is an active imaging system and inherently suffers from speckle noise, which is multiplicative in nature. Speckle noise originates from the interferen'ce of the coherent wave fronts associated with the reflected signal. The quality of SAR images is significantly degraded by this interference. Conventional intensity-based image processing techniques do not perform well for SAR images because of multiplicative nature of speckle. A variety of suggested image segmentation techniques suitable for SAR images have been analysed in this paper. The paper performs comparative analysis of image segmentation techniques that are based on different features of the images and are specialized to perform on SAR images. Experiments are performed on synthetically generated images and real SAR images obtained from Moving and Stationary Target Acquisition and Recognition (MSTAR) public database.

A synthetic aperture radar (SAR) automatic target recognition can effectively improve the utilization efficiency of SAR image data. In order to improve the generalization and accuracy of SAR image target recognition, a convolutional neural network model is proposed to be applied to SAR image target recognition. Firstly, the network structure is designed for the characteristics of SAR image. Secondly, the introduction of dense block network structure improves the generalization performance of the model. Finally, Dropout reduced the computational complexity of the network and improved the generalization performance of the model. Experimental data were obtained from the United States Moving and Stationary Target Acquisition and recognition database. Experimental results of 10 types of target recognition showed that the overall recognition rate of the improved convolutional neural network is 99.18%. The convolutional neural network model proposed in this study improves the accuracy and generalization of the network, and is an effective method for target recognition of SAR images.

Identifying the aspect for a given target is an important issue in synthetic aperture radar (SAR) image interpretation. A new SAR target aspect identification method based on machine learning theory is proposed in this paper. First, the aspect angles of the SAR target are discretized, and the spatial relationships of the neighborhoods of the SAR target samples are established. Then an optimal linear mapping is solved based on the proposed subspace aspect discriminant analysis. The samples will be projected into a low-dimensional space and be of a better aspect identifiability than in their original space. Finally, the projected samples are fed into a multilayer neural network, and the aspects of the SAR targets will be indicated. Experimental results have shown the superiority of the proposed method based on the moving and stationary target acquisition and recognition (MSTAR) data set.