New SAR target recognition based on YOLO and very deep multi-canonical correlation analysis

This paper proposes an automatic target recognition (ATR) method for synthetic aperture radar (SAR) images based on information-decoupled representation. A typical SAR image of a ground target can be divided into three parts: target region, shadow and background. From the aspect of SAR target recognition, the target region and shadow contain discriminative information. However, they also include some confusing information because of the similarities of different targets. The background mainly contains redundant information, which has little contribution to the target recognition. Because the target segmentation may impair the discriminative information in the target region, the relatively simpler shadow segmentation is performed to separate the shadow region for information decoupling. Then, the information-decoupled representations are generated, i.e., the target image, shadow and original image. The background is retained in the target image, which represents the coupling of target backscattering and background. The original image and generated target image are classified using the sparse representation-based classification (SRC). Then, their classification results are combined by a score-level fusion for target recognition. The shadow image is not used because of its lower discriminability and possible segmentation errors. To evaluate the performance of the proposed method, extensive experiments are conducted on the Moving and Stationary Target Acquisition and Recognition (MSTAR) dataset under both standard operating condition (SOC) and various extended operating conditions (EOCs). The proposed method can correctly classify 10 classes of targets with the percentage of correct classification (PCC) of 94.88% under SOC. With the PCCs of 93.15% and 75.03% under configuration variance and 45° depression angle, respectively, the superiority of the proposed is demonstrated in comparison with other methods. The robustness of the proposed method to both uniform and nonuniform shadow segmentation errors is validated with the PCCs over 93%. Moreover, with the maximum average precision of 0.9580, the proposed method is more effective than the reference methods on outlier rejection.

Synthetic aperture radar (SAR) image target detection and recognition (SAR-TDR) tasks have become research hot spots in the remote sensing application. These targets include ships, vehicles, aircraft, oil tanks, bridges, and so on. However, with the rapid development of SAR technology and increasingly complex electromagnetic environment, complex characteristics of SAR images bring severe challenges to the accurate SAR-TDR via traditional physical models or manual feature-extraction-based machine learning methods. In recent years, deep learning (DL), as a powerful automatic feature extraction algorithm, has been widely used in the computer vision domain. More specifically, DL has also been introduced into the SAR-TDR tasks and has effectively achieved good performance in terms of accuracy, real-time processing, etc. With the rapid development of DL, SAR image processing, and practical requirements of SAR-TDR in civilian and military domains, it is crucial to conduct a systematic survey on SAR-TDR in the past few years. In this survey article, we mainly conduct a systematic overview of DL-based SAR-TDR literature on two tasks, i.e., target recognition (e.g., ground vehicles, ships, and aircraft) and target detection (e.g., ships, aircraft, change detection, sea surface oil spills, and oil tanks). More specifically, our related works about these topics are also presented to verify the effectiveness of DL-based methods. First, several DL methods (e.g., convolutional neural networks, recurrent neural networks, autoencoders, and generative adversarial networks), commonly used in SAR-TDR, are briefly introduced. Then, a systematic review of DL-based SAR-TDR (including our related works) is presented. Finally, the current challenges and future possible research directions are deeply analyzed and discussed.

ABSTRACTAutomatic Target Recognition (ATR) based on Synthetic Aperture Radar (SAR) images plays a key role in military applications. However, there are difficulties with this traditional recognition method. Principally, it is a challenge to design robust features and classifiers for different SAR images. Although Convolutional Neural Networks (CNNs) are very successful in many image classification tasks, building a deep network with limited labeled data remains a problem. The topologies of CNNs like the fully connected structure will lead to redundant parameters and the negligence of channel-wise information flow. A novel CNNs approach, called Group Squeeze Excitation Sparsely Connected Convolutional Networks (GSESCNNs), is therefore proposed as a solution. The group squeeze excitation performs dynamic channel-wise feature recalibration with less parameters than squeeze excitation. Sparsely connected convolutional networks are a more efficient way to operate the concatenation of feature maps from different layers. Experimental results on Moving and Stationary Target Acquisition and Recognition (MSTAR) SAR images, demonstrate that this approach achieves, at 99.79%, the best prediction accuracy, outperforming the most common skip connection models, such as Residual Networks and Densely Connected Convolutional Networks, as well as other methods reported in the MSTAR dataset.

A synthetic aperture radar (SAR) automatic target recognition can effectively improve the utilization efficiency of SAR image data. In order to improve the generalization and accuracy of SAR image target recognition, a convolutional neural network model is proposed to be applied to SAR image target recognition. Firstly, the network structure is designed for the characteristics of SAR image. Secondly, the introduction of dense block network structure improves the generalization performance of the model. Finally, Dropout reduced the computational complexity of the network and improved the generalization performance of the model. Experimental data were obtained from the United States Moving and Stationary Target Acquisition and recognition database. Experimental results of 10 types of target recognition showed that the overall recognition rate of the improved convolutional neural network is 99.18%. The convolutional neural network model proposed in this study improves the accuracy and generalization of the network, and is an effective method for target recognition of SAR images.

Multifeature decision fusion is an effective way to promote the performance of target recognition of synthetic aperture radar (SAR) images. This paper proposes a joint multifeature decision fusion strategy for target recognition in SAR images based on multitask compressive sensing (MtCS). The proposed method can exploit the intercorrelations among different features by enforcing the constraint on the sparsity pattern. Furthermore, the time consumption for MtCS is almost the same with that of single feature-based compressive classification, such as sparse representation-based classification. Experiments on the moving and stationary target acquisition and recognition dataset and comparison with several state-of-the-art methods demonstrate the validity of the proposed method.

Images from different aspect views for one target, known as multiple views, are widely applied to improve synthetic aperture radar (SAR) target recognition. However, most of existing multi-view methods have strict constraint on the angle interval among multiple views. In this paper, a new multiview fusion method free from interval limitation using expectation maximization (EM) is explored for SAR image classification. Firstly, we apply convolutional neural network (CNN) to extract features effectively owning to its powerful ability of feature learning and then obtain the classification probability. Secondly, Multi-view Label Set (MLS) is automatically constructed from multiple views according to the probability and finally we use EM algorithm to classify SAR images intelligently. It is worth noting that the proposed method can be used flexibly according to the number of perspectives obtained and without angle interval constraint among multiple views. Experiments demonstrate that the proposed method has better recognition performance than some state-of-the-art methods on the Moving and Stationary Target Acquisition and Recognition (MSTAR) dataset.

Synthetic aperture radar (SAR) are high resolution imaging radar systems. In many SAR applications classifying objects that are detected within the SAR image is important. In this paper an approach is proposed to tackle the Synthetic SAR Automatic Target Recognition (ATR) problem. The proposed scheme is based on a transfer leaning approach where three different pre-trained Convolutional Neural Networks (CNNs) are used as feature extractors in combination with a Support Vector Machine classifier (SVM). The CNNs used in this paper are AlexNet, VGG16 and GoogLeNet. The performance of these three CNNs is compared in regards to the SAR-ATR problem; where it is observed that AlexNet gives the best performance accuracy of 99.27%.

Synthetic aperture radar (SAR) target recognition under extended operating conditions (EOCs) is a challenging problem due to the complex application environment, especially for insufficient target variations and corrupted SAR images in the training samples. This paper proposes a new strategy to solve these problems for target recognition. The SAR images are firstly characterized by multi-scale components of monogenic signal. The generated monogenic features are decomposed to learn a class dictionary and a shared dictionary, which represent the possible intraclass variations information and the common information, respectively. Moreover, a sparse representation of the class dictionary and a dense representation of the shared dictionary are jointly employed to represent a query sample for classification. The validity of the proposed strategy is demonstrated with multiple comparative experiments on moving and stationary target acquisition and recognition (MSTAR) database.

A synthetic aperture radar (SAR) target classification method has been developed, in the study, based on dynamic target reconstruction. According to SAR azimuthal sensitivity, the truly useful training samples for the reconstructing the test sample are those with approaching azimuths and same labels. Hence, the proposed method performs linear presentation of the test sample on the local dictionary established by several training samples selected from each class under the azimuthal correlation. By properly adjusting the azimuthal correlation constraint, the test sample can be reconstructed at different levels by different scales of training samples. During the classification phase, the reconstruction error vectors from different levels are combined by linear fusion and the label of the test sample is determined based on the fused errors. Experimental conditions are setup on the moving and stationary target acquisition and recognition (MSTAR) dataset to evaluate the proposed method. The results confirm the effectiveness of the proposed method.

In recent years, convolutional neural network (CNN) has been increasingly considered as a promising technology for military and homeland security applications. The fusion of CNN and Support vector machine (SVM), a popular traditional machine learning approach, has received intensive attention in the field of synthetic aperture radar (SAR) automatic target recognition (ATR). This paper, firstly, discusses the effects of some preprocessing and image enhancement methods on the performance of SAR ATR, starting with the pre-trained AlexNet in a transfer-learning based approach. Secondly, the architecture of AlexNet is modified to form a new model suitable for SAR ATR. Finally, we propose a hybrid model associated with the success of the learning feature of our CNN model and the ability of SVM to process high-dimensional dataset effectively. To evaluate the proposed method, experiments are performed on the Moving and Stationary Target Acquisition and Recognition (MSTAR) public database. The comparative results demonstrate that these preprocessing and enhancement methods prior to the deep-learning process are not necessary since the feature representation ability of AlexNet is already powerful. Furthermore, experimental results on the benchmark MSTAR dataset illustrate the effectiveness of the proposed new model. On classification of ten-class targets, the commonly used translation augmentation for training data has been performed. By combining the CNN and SVM, the classification accuracy percentages can be slightly improved for our proposed new model.

Automatic targets recognition (ATR) for synthetic aperture radar (SAR) image is very important. ATR can be used in traffic management, national frontier safety, and so on. Traditional algorithms for SAR ATR is composed of extraction features and training classifier. The features are essential for the classification accuracy. However, choosing good features by hand is a hard task. The deep convolutional neural networks (CNNs) which can learn features automatically have got a great performance in natural images. However, the CNNs have many parameters and need a lot of data to train such networks. The remote-sensing data of SAR is limited. Then, the authors need a simple network which needs not much data and easy to train. The principal component analysis network (PCANet) is a shallow network that performs well in the recognition task and needs no hand features choosing. Though this network has produced a wide application in the natural images, it is rarely used in the SAR images. The experimental result of the moving and stationary target acquisition and recognition (MSTAR) dataset shows that the PCANet can achieve over 99% accuracy on ten-class targets. This result is better than traditional algorithms and is very close to the results of deep-learning methods.

In this review paper, several studies and researches were surveyed for assisting future researchers to identify available techniques in the field of classification of Synthetic Aperture Radar (SAR) images. SAR images are becoming increasingly important in a variety of remote sensing applications due to the ability of SAR sensors to operate in all types of weather conditions, including day and night remote sensing for long ranges and coverage areas. Its properties of vast planning, search, rescue, mine detection, and target identification make it very attractive for surveillance and observation missions of Earth resources. With the increasing popularity and availability of these images, the need for machines has emerged to enhance the ability to identify and interpret these images effectively. This is due to the fact that SAR image processing requires the formation of an image from the measured radar scatter returns, followed by a treatment to discover and define the image's composition. After reviewing several previous studies that succeeded in achieving a classification of SAR images for specific goals, it became obvious that they could be generalized to all types of SAR images. The most prominent use of Convolutional Neural Networks (CNN) was successful in extracting features from the images and training the neural network to analyze and classify them into classes according to these features. The dataset used in this model was obtained from the Moving and Stationary Target Acquisition and Recognition (MSTAR) database, which consists of a set of SAR images of military vehicles, for which the application of the CNN approach achieved a final accuracy of 97.91% on ten different classes.

The synthetic aperture radar (SAR) image preprocessing techniques and their impact on target recognition performance are researched. The performance of SAR target recognition is improved by composing a variety of preprocessing techniques. The preprocessing techniques achieve the effects of suppressing background redundancy and enhancing target characteristics by processing the size and gray distribution of the original SAR image, thereby improving the subsequent target recognition performance. In this study, image cropping, target segmentation, and image enhancement algorithms are used to preprocess the original SAR image, and the target recognition performance is effectively improved by combining the above three preprocessing techniques. On the basis of image enhancement, the monogenic signal is used for feature extraction and then the sparse representation-based classification (SRC) is used to complete the decision. The experiments are conveyed on the moving and stationary target acquisition and recognition (MSTAR) dataset, and the results prove that the combination of multiple preprocessing techniques can effectively improve the SAR target recognition performance.

A synthetic aperture radar (SAR) target recognition method was proposed based on multivariate empirical mode decomposition (MEMD). MEMD was the general extension of traditional EMD, which could avoid the mode mixing problems. MEMD was employed to process SAR images to obtain the multi-layer intrinsic mode functions (IMF), which could better reflect the time-frequency properties of the targets. Different layers of IMFs could effectively complement each other while sharing some inner correlations because they are generated from the same target. In the classification phase, the joint sparse representation was employed to represent the IMFs. The joint sparse representation could solve several related sparse representation tasks based on the idea of multi-task learning. It could produce more precise estimations than the solutions of single tasks. According to the sparse coefficient vectors corresponding to different IMFs, the reconstruction errors of different classes for the representation of the test sample can be calculated. Afterwards, the target label of the test sample can be determined. Experiments were conducted on the Moving and Stationary Target Acquisition and Recognition (MSTAR) dataset, by comparison with existing methods under the standard operating condition, depression angle variance, noise corruption, and target occlusion, the results confirm the validity of the proposed method.

In order to improve synthetic aperture radar (SAR) target recognition performance, this paper proposes a novel method using multi-level deep features. The multi-level deep features are learned by the convolutional neural network (CNN), which are capable of describing the target characteristics from different aspects. In order to make full use of the discrimination contained in the multi-level deep features, the joint sparse representation (JSR) is used as the basic classifier, which performs the multi-task learning to jointly classify the multi-level deep features. It could not only represent each feature properly but also consider the correlations between different levels of features. Based on the solutions from JSR, the target label is classified as the training class with the minimum reconstruction error. By fully exploiting the discriminative information contained in the multi-level deep features, the proposed method could effectively enhance SAR target recognition performance. The moving and stationary target acquisition and recognition (MSTAR) dataset is employed in the experiments. The results show that the proposed method could achieve a significantly high recognition rate of 99.38% for classifying 10 classes of targets under the standard operating condition (SOC), which is higher than those from some reference methods drawn from current literatures. Under different types of extended operating conditions (EOCs), the overall performance of the proposed method keeps superior over the reference methods. In addition, the outlier rejection capability of the proposed method is also better than the compared methods. All these experimental results validate the high effectiveness of the proposed method.