Multi-Mode Channel Position Attention Fusion Side-Scan Sonar Transfer Recognition

The most popular and crucial piece of equipment for underwater target detection right now is side-scan sonar, which primarily plays a crucial role in underwater operations. Unfortunately, in general, side-scan sonar images have low resolution and suffer from significant noise interference, making target recognition with these images highly challenging. In this paper, we employ deep learning techniques to recognize underwater targets using side scan sonar imagery. This paper begins by outlining the current state of underwater target detection research as well as briefly describing its importance and historical context. The imaging process of side-scan sonar pictures is studied in greater depth, and it is determined that noise on sonar images is caused principally by the combined effect of external and internal noise. This causes extra noise in sonar pictures, lowering image quality and affecting target identification performance. Proper sonar image pre-processing findings can provide more consistent target detection help. After then, the YOLOv5 target detection algorithm is investigated and improved. By performing several sets of comparison trials, the updated technique improves the accuracy and speed of side-scan sonar image target recognition and finally overcomes the issues of missed detection, false detection, and low accuracy of overlapping tiny object recognition.

Attributed scattering center is one of important features of Synthetic Aperture Radar (SAR) image. In this paper, a method for the matching of attributed scattering centers and its application to SAR target recognition is proposed. First, the attributed scattering centers of the test SAR image and template SAR images are extracted on the basis of the attributed scattering model. Second, the Hungarian algorithm is employed to match the two scattering center sets. Based on the one to one correspondence, we design a new similarity measure to evaluate the similarity between the two scattering center sets that will decide the target type of the test image. The similarity measure considers the effects of each individual scattering center, single matching pair, and missing alarms and false alarms; thus, it is more comprehensive. The experiment based on moving and stationary target acquisition and recognition database demonstrates the validity of the proposed method.

This paper proposes an automatic target recognition (ATR) method for synthetic aperture radar (SAR) images based on information-decoupled representation. A typical SAR image of a ground target can be divided into three parts: target region, shadow and background. From the aspect of SAR target recognition, the target region and shadow contain discriminative information. However, they also include some confusing information because of the similarities of different targets. The background mainly contains redundant information, which has little contribution to the target recognition. Because the target segmentation may impair the discriminative information in the target region, the relatively simpler shadow segmentation is performed to separate the shadow region for information decoupling. Then, the information-decoupled representations are generated, i.e., the target image, shadow and original image. The background is retained in the target image, which represents the coupling of target backscattering and background. The original image and generated target image are classified using the sparse representation-based classification (SRC). Then, their classification results are combined by a score-level fusion for target recognition. The shadow image is not used because of its lower discriminability and possible segmentation errors. To evaluate the performance of the proposed method, extensive experiments are conducted on the Moving and Stationary Target Acquisition and Recognition (MSTAR) dataset under both standard operating condition (SOC) and various extended operating conditions (EOCs). The proposed method can correctly classify 10 classes of targets with the percentage of correct classification (PCC) of 94.88% under SOC. With the PCCs of 93.15% and 75.03% under configuration variance and 45° depression angle, respectively, the superiority of the proposed is demonstrated in comparison with other methods. The robustness of the proposed method to both uniform and nonuniform shadow segmentation errors is validated with the PCCs over 93%. Moreover, with the maximum average precision of 0.9580, the proposed method is more effective than the reference methods on outlier rejection.

Synthetic aperture radar (SAR) image target detection and recognition (SAR-TDR) tasks have become research hot spots in the remote sensing application. These targets include ships, vehicles, aircraft, oil tanks, bridges, and so on. However, with the rapid development of SAR technology and increasingly complex electromagnetic environment, complex characteristics of SAR images bring severe challenges to the accurate SAR-TDR via traditional physical models or manual feature-extraction-based machine learning methods. In recent years, deep learning (DL), as a powerful automatic feature extraction algorithm, has been widely used in the computer vision domain. More specifically, DL has also been introduced into the SAR-TDR tasks and has effectively achieved good performance in terms of accuracy, real-time processing, etc. With the rapid development of DL, SAR image processing, and practical requirements of SAR-TDR in civilian and military domains, it is crucial to conduct a systematic survey on SAR-TDR in the past few years. In this survey article, we mainly conduct a systematic overview of DL-based SAR-TDR literature on two tasks, i.e., target recognition (e.g., ground vehicles, ships, and aircraft) and target detection (e.g., ships, aircraft, change detection, sea surface oil spills, and oil tanks). More specifically, our related works about these topics are also presented to verify the effectiveness of DL-based methods. First, several DL methods (e.g., convolutional neural networks, recurrent neural networks, autoencoders, and generative adversarial networks), commonly used in SAR-TDR, are briefly introduced. Then, a systematic review of DL-based SAR-TDR (including our related works) is presented. Finally, the current challenges and future possible research directions are deeply analyzed and discussed.

A synthetic aperture radar (SAR) automatic target recognition can effectively improve the utilization efficiency of SAR image data. In order to improve the generalization and accuracy of SAR image target recognition, a convolutional neural network model is proposed to be applied to SAR image target recognition. Firstly, the network structure is designed for the characteristics of SAR image. Secondly, the introduction of dense block network structure improves the generalization performance of the model. Finally, Dropout reduced the computational complexity of the network and improved the generalization performance of the model. Experimental data were obtained from the United States Moving and Stationary Target Acquisition and recognition database. Experimental results of 10 types of target recognition showed that the overall recognition rate of the improved convolutional neural network is 99.18%. The convolutional neural network model proposed in this study improves the accuracy and generalization of the network, and is an effective method for target recognition of SAR images.

Digital filters designed using wavelet theory are applied to high resolution deep-towed side-scan sonar data from the median valley walls, crestal mountains, and flanks of the Mid-Atlantic Ridge at 29°10′ N. With proper tuning, the digital filters are able to identify the location, orientation, length, and width of highly reflective linear features in sonar images. These features are presumed to represent the acoustic backscatter from axis-facing normal faults. The fault locations obtained from the digital filters are well correlated with visual geologic interpretation of the images. The side-scan sonar images are also compared with swath bathymetry from the same area. The digitally filtered bathymetry images contain nine of the eleven faults identified by eye in the detailed geologic interpretation of the side-scan data. Faults with widths (measured perpendicular to their strike) of less than about 150 m are missed in the bathymetry analysis due to the coarser resolution of these data. This digital image processing technique demonstrates the potential of wavelet-based analysis to reduce subjectivity and labor involved in mapping and analyzing topographic features in side-scan sonar and bathymetric image data.

Multifeature decision fusion is an effective way to promote the performance of target recognition of synthetic aperture radar (SAR) images. This paper proposes a joint multifeature decision fusion strategy for target recognition in SAR images based on multitask compressive sensing (MtCS). The proposed method can exploit the intercorrelations among different features by enforcing the constraint on the sparsity pattern. Furthermore, the time consumption for MtCS is almost the same with that of single feature-based compressive classification, such as sparse representation-based classification. Experiments on the moving and stationary target acquisition and recognition dataset and comparison with several state-of-the-art methods demonstrate the validity of the proposed method.

Side-scan sonar (SSS) plays a crucial role in underwater exploration. Autonomous analysis of SSS images is vital for detecting unknown targets in underwater environments. However, due to the complexity of the underwater environment, few highlighted areas of the target, blurred feature details, and the difficulty of collecting data from SSS, achieving high-precision autonomous target recognition in SSS images is challenging. This article solves this problem by improving the You Only Look Once v7 (YOLOv7) model to achieve high-precision object detection in SSS images. First, we enhance and enlarge real and experimental images using the denoising–diffusion model to establish a self-made SSS image data set, as there are data pictures of the detection target in the SSS images obtained from real experiments. Since the SSS image has large areas without targets, this article introduces a vision transformer (ViT) for dynamic attention and global modeling, which improves the model's weight in the target region. Second, the convolutional block attention module is adopted to further improve the feature expression ability and reduce floating-point operations. Finally, this article uses Scylla-Intersection over Union as the loss function to increase the accuracy of the model's inference. Experiments on the SSS image data set demonstrate that the improved YOLOv7 model outperforms other technologies, with an average accuracy (mAP0.5) and (mAP0.5:0.95) of 78.00% and 48.11%, respectively. These results are 3.47% and 2.9% higher than the YOLOv7 model. The improved YOLOv7 algorithm proposed in this article has great potential for object detection and recognition of SSS images.

Synthetic Aperture Radar (SAR) images are prone to be contaminated by noise, which makes it very difficult to perform target recognition in SAR images. Inspired by great success of very deep convolutional neural networks (CNNs), this paper proposes a robust feature extraction method for SAR image target classification by adaptively fusing effective features from different CNN layers. First, YOLOv4 network is fine-tuned to detect the targets from the respective MF SAR target images. Second, a very deep CNN is trained from scratch on the moving and stationary target acquisition and recognition (MSTAR) database by using small filters throughout the whole net to reduce the speckle noise. Besides, using small-size convolution filters decreases the number of parameters in each layer and, therefore, reduces computation cost as the CNN goes deeper. The resulting CNN model is capable of extracting very deep features from the target images without performing any noise filtering or pre-processing techniques. Third, our approach proposes to use the multi-canonical correlation analysis (MCCA) to adaptively learn CNN features from different layers such that the resulting representations are highly linearly correlated and therefore can achieve better classification accuracy even if a simple linear support vector machine is used. Experimental results on the MSTAR dataset demonstrate that the proposed method outperforms the state-of-the-art methods.

Target segmentation of synthetic aperture radar (SAR) images is one of the challenging problems in SAR image interpretation, which often serves as a processing step for SAR target recognition. Target segmentation tries to separate the target from the background thus eliminating the interference of background noises or clutters. However, the segmentation may also discard a part of the target characteristics and the target shadow which also contain discriminative information for target recognition. Then the tradeoff between interference elimination and discriminability loss will cause some effects on the target recognition. This paper aims to evaluate the influence of target segmentation on target recognition. Target recognition under standard operating condition (SOC) and several extended operating conditions (EOCs), i.e., depression angle variance and noise corruption, is conducted on the moving and stationary target acquisition and recognition (MSTAR) dataset using the original image and segmented target image, respectively. Moreover, the recognition performance under target segmentation errors is also evaluated. By comparing the recognition performance, the effects of target segmentation can be illustrated.

Synthetic Aperture Radar (SAR) image edge detection is one of the important steps for earth observation and target recognition,and it is recognized a difficult problem by domestic and foreign researchers because of the presence of speckle noise. A study was undertaken in this paper to speckle noise suppression and edge detail holding for SAR image edge detection, and we present an intelligent edge detection approach based on fuzzy theory and information fusion. Some typical SAR images were selected for edge detection using this approach in order to verify the result of relevant speckle noise suppression and edge detail holding. Results shows that this method can effectively inhibit the SAR image speckle noise and has smart edge detection ability. Unlike classical SAR image edge detection methods, this approach is a comprehensive integrated of different intelligent information processing methods, and it shows good robustness and universality.

Synthetic aperture radar (SAR) target recognition under extended operating conditions (EOCs) is a challenging problem due to the complex application environment, especially for insufficient target variations and corrupted SAR images in the training samples. This paper proposes a new strategy to solve these problems for target recognition. The SAR images are firstly characterized by multi-scale components of monogenic signal. The generated monogenic features are decomposed to learn a class dictionary and a shared dictionary, which represent the possible intraclass variations information and the common information, respectively. Moreover, a sparse representation of the class dictionary and a dense representation of the shared dictionary are jointly employed to represent a query sample for classification. The validity of the proposed strategy is demonstrated with multiple comparative experiments on moving and stationary target acquisition and recognition (MSTAR) database.

The purpose of the paper is to extract the region of interest (ROI) from the coarse detected synthetic aperture radar (SAR) images and discriminate if the RO I contains a target or not, so as to eliminate the false alarm, and prepare for the target recognition. Th e automatic target clustering is one of the most difficult tasks in the SAR-image automatic target recognition system. The density-based spatial clustering of applications with noise (DBSCAN) relies on a density-based notion of clusters which is designed to discover clusters of arbitrary shape. DBSCAN was first used in the SAR image processing, which has many excellent features: only two insensitivity parameters (radius of neighborhood and minimum number of points) are needed; clusters of arbitrary shapes which fit in with the coarse detected SAR images can be discovered; and the cal culation time and memory can be reduced. In the multi-feature ROI discrimination scheme, we extract several target features which contain the geometry features such asthe area discriminator and Radon -transform based target profile discriminator, the distribution characteristics such as the EFF discrimina tor, and the EM scattering property such as the PPR discriminator. The synthesized judgment effectively eliminates the false alarms. Keywords: automatic target recognition, synthetic aperture radar images,

Side scan sonar images have great application prospects in underwater surveys, target detection, and engineering activities. However, the acquired sonar images exhibit low illumination, scattered noise, distorted outlines, and unclear edge textures due to the complicated undersea environment and intrinsic device flaws. Hence, this paper proposes a multi-scale fusion strategy for side scan sonar (SSS) image correction to improve the low contrast and noise interference. Initially, an SSS image was decomposed into low and high frequency sub-bands via the non-subsampled shearlet transform (NSST). Then, modified multi-scale retinex (MMSR) was employed to enhance the contrast of the low frequency sub-band. Next, sparse dictionary learning (SDL) was utilized to eliminate high frequency noise. Finally, the process of NSST reconstruction was completed by fusing the emerging low and high frequency sub-band images to generate a new sonar image. The experimental results demonstrate that the target features, underwater terrain, and edge contours could be clearly displayed in the image corrected by the multi-scale fusion strategy when compared to eight correction techniques: BPDHE, MSRCR, NPE, ALTM, LIME, FE, WT, and TVRLRA. Effective control was achieved over the speckle noise of the sonar image. Furthermore, the AG, STD, and E values illustrated the delicacy and contrast of the corrected images processed by the proposed strategy. The PSNR value revealed that the proposed strategy outperformed the advanced TVRLRA technology in terms of filtering performance by at least 8.8%. It can provide sonar imagery that is appropriate for various circumstances.

Synthetic aperture radar (SAR) is able to form high-resolution images, which is beneficial for target identification and recognition. However, High-resolution SAR image formation is of immense computation, especially for large scene. In practice, the region of interest (ROI) that needs high resolution imaging may constitute only a small portion of the whole scene. Since ROI detection may only require image resolution much lower than the highest resolution that can be achieved from SAR data, it is efficient to generate an "adequately low resolution" image to find ROI. If target recognition is needed, full-resolution images can be generated for ROI. In this paper, a novel two-stage framework of SAR image formation and processing is developed. Fast factorized back-projection (FFBP) algorithm is introduced to generate SAR images recursively. The FFBP significantly reduces computation complexity with minimal loss in accuracy compared with traditional back-projection (BP) algorithm through recursive stages. At each stage the resolution of images is finer than previously. When the resolution is adequate for target detection, a detection procedure is processed to find ROI in the whole scene. Full resolution image for ROI is then generated by integrating the low resolution images. Moreover, since moving targets appear at different positions in the "adequately low-resolution" image series, moving targets can be also detected. Simulation results show that with single-pass high-resolution SAR data, the method generates low-resolution images quickly for ROI and moving target detection, and provides high-resolution details efficiently for ROI.