An Approach on Image Processing of Deep Learning Based on Improved SSD

Synthetic aperture radar (SAR) ship detection based on deep learning has been widely applied in recent years. However, two main obstacles are hindering SAR ship detection. First, the identification of ships in a port is seriously disrupted by the presence of onshore buildings. It is difficult for the existing detection algorithms to effectively distinguish the targets from such a complex background. Additionally, it appears more complicated to accurately locate densely arranged ships. Second, the ships in SAR images exist at a variety of scales due to multiresolution imaging modes and the variety of ship shapes; these pose a much greater challenge to ship detection. To solve the above problems, this paper proposes an object detection network combined with an attention mechanism to accurately locate targets in complex scenarios. To address the diverse scales of ship targets, we construct a loss function that incorporates the generalized intersection over union (GIoU) loss to reduce the scale sensitivity of the network. For the final processing of the results, soft nonmaximum suppression (Soft-NMS) is also introduced into the model to reduce the number of missed detections for ship targets in the presence of severe overlap. The experimental results reveal that the proposed model exhibits excellent performance on the extended SAR ship detection dataset (SSDD) while achieving real-time detection.

Synthetic Aperture Radar (SAR) Ship Detection (SSD) is an important application, and it has been widely used in commercial and military fields. With the development of remote sensing technology, the use of a large amount of increasing unlabeled data is a challenge for model training, and the interference caused by the reefs and the nearshore facilities is also a challenge for SAR ship detection. In this work, we propose a Feature Integration Attention Detection (FIAD) Network to detect ships in SAR images, namely the FIAD Net. The FIAD Net has two contributions: a ModiBYOL method based on self-supervised learning and a novel Feature Integration Attention (FIA) module. The FIA module could enhance the feature learning ability of the backbone network, and the ModiBYOL could utilize the unlabeled data as a source for backbone pre-training. Experiments on the OpenSARShip dataset, the SAR ship detection dataset (SSDD), and the SAR Ship dataset show that the proposed method achieves an accuracy comparable to the state-of-art methods with a speed of 47 Frames Per Second (FPS). Besides, the effectiveness of the proposed modules is studied through an ablation study.

Recently, convolutional neural network based methods have been studied for ship detection in optical remote sensing images. However, it is challenging to apply them to microwave synthetic aperture radar (SAR) images. First, most of the regions in the inshore scene include scattered spots and noises, which dramatically interfere with ship detection. Besides, SAR ship images contain ship targets of different sizes, especially small ships with dense distribution. Unfortunately, small ships have fewer distinguishing features making it difficult to be detected. In this article, we propose a novel SAR ship detection network called feature enhanced pyramid and shallow feature reconstruction network (FEPS-Net) to solve the above problems. We design a feature enhancement pyramid, which includes a spatial enhancement module to enhance spatial position information and suppress background noise, and the feature alignment module to solve the problem of feature misalignment during feature fusion. Additionally, to solve the problem of small ship detection in SAR ship images, we design a shallow feature reconstruction module to extract semantic information from small ships. The effectiveness of the proposed network for SAR ship detection is demonstrated by experiments on two publicly available datasets: SAR ship detection dataset and high-resolution SAR images dataset. The experimental results show that the proposed FEPS-Net has advantages in SAR ship detection over the current state-of-the-art methods.

In recent years, the growing demand for synthetic aperture radar (SAR) ship detection on mobile and satellite platforms has made lightweight detection models an important research focus. However, existing SAR ship detection methods are often limited by high computational cost and inefficient utilization of intrinsic SAR characteristics, particularly the loss of edge and high-frequency information during downsampling and the insufficient interaction of multi-scale features across network layers. To address these issues, we propose a lightweight and efficient detection framework named ESENet, which is designed from the perspective of preserving discriminative information, improving cross-scale feature interaction, and reducing structural redundancy. Specifically, a lightweight feature extraction module is introduced to alleviate high-frequency and edge information loss caused by conventional pooling operations, thereby enhancing the representation of small and low-contrast ship targets commonly present in SAR images. Furthermore, a Slender bidirectional feature pyramid network is designed by streamlining cross-layer connections and reducing redundant fusion paths, enabling effective multi-scale feature aggregation with lower computational complexity while strengthening edge-aware feature propagation. In addition, an optimized detection head with parameter sharing across scales is employed to further reduce model parameters and computational overhead without sacrificing detection accuracy or inference speed. Extensive experiments conducted on multiple public SAR ship detection datasets demonstrate the effectiveness of the proposed ESENet, achieving average accuracy rates of 91.1% on HRSID, 98.9% on SSDD, 97.3% on SSDD+, and 72.1% on synthetic and real-world small-object ship detection dataset, while maintaining a compact model size of only 1.3 M parameters, which confirms its suitability for resource-constrained SAR ship detection applications.

In light of recent advances in deep learning and Synthetic Aperture Radar (SAR) technology, there has been a growing adoption of ship detection models that are based on deep learning methodologies. However, the efficiency of SAR ship detection models is significantly impacted by complex backgrounds, noise, and multi-scale ships (the number of pixels occupied by ships in SAR images varies significantly). To address the aforementioned issues, this research proposes a Pyramid Pooling Attention Network (PPA-Net) for SAR multi-scale ship detection. Firstly, a Pyramid Pooled Attention Module (PPAM) is designed to alleviate the influence of background noise on ship detection while its parallel component favors the processing of multiple ship sizes. Different from the previous attention module, the PPAM module can better suppress the background noise in SAR images because it considers the saliency of ships in SAR images. Secondly, an Adaptive Feature Balancing Module (AFBM) is developed, which can automatically balance the conflict between ship semantic information and location information. Finally, the detection capabilities of the ship detection model for multi-scale ships are further improved by introducing the Atrous Spatial Pyramid Pooling (ASPP) module. This innovative module enhances the detection model’s ability to detect ships of varying scales by extracting features from multiple scales using atrous convolutions and spatial pyramid pooling. PPA-Net achieved detection accuracies of 95.19% and 89.27% on the High-Resolution SAR Images Dataset (HRSID) and the SAR Ship Detection Dataset (SSDD), respectively. The experimental results demonstrate that PPA-Net outperforms other ship detection models.

Due to its great application value in the military and civilian fields, ship detection in synthetic aperture radar (SAR) images has always attracted much attention. However, ship targets in High-Resolution (HR) SAR images show the significant characteristics of multi-scale, arbitrary directions and dense arrangement, posing enormous challenges to detect ships quickly and accurately. To address these issues above, a novel YOLO-based arbitrary-oriented SAR ship detector using bi-directional feature fusion and angular classification (BiFA-YOLO) is proposed in this article. First of all, a novel bi-directional feature fusion module (Bi-DFFM) tailored to SAR ship detection is applied to the YOLO framework. This module can efficiently aggregate multi-scale features through bi-directional (top-down and bottom-up) information interaction, which is helpful for detecting multi-scale ships. Secondly, to effectively detect arbitrary-oriented and densely arranged ships in HR SAR images, we add an angular classification structure to the head network. This structure is conducive to accurately obtaining ships’ angle information without the problem of boundary discontinuity and complicated parameter regression. Meanwhile, in BiFA-YOLO, a random rotation mosaic data augmentation method is employed to suppress the impact of angle imbalance. Compared with other conventional data augmentation methods, the proposed method can better improve detection performance of arbitrary-oriented ships. Finally, we conduct extensive experiments on the SAR ship detection dataset (SSDD) and large-scene HR SAR images from GF-3 satellite to verify our method. The proposed method can reach the detection performance with precision = 94.85%, recall = 93.97%, average precision = 93.90%, and F1-score = 0.9441 on SSDD. The detection speed of our method is approximately 13.3 ms per 512 × 512 image. In addition, comparison experiments with other deep learning-based methods and verification experiments on large-scene HR SAR images demonstrate that our method shows strong robustness and adaptability.

Synthetic aperture radar (SAR) ship detection plays an important role in the field of maritime security. However, certain unique imaging properties make it challenging to extract the shape features of ships, such as speckle noise and strong scattering interference from irrelevant objects. These factors result in inaccurate ship localization and obvious false alarms under complex large-scale inshore scenes. To address this issue, we propose the scattering region topology network (SRT-Net), which can dynamically capture the comprehensive global context and enhance the ship saliency. This is achieved through two key modules, namely the scattering region topological structure pyramid (SRTP) and the ship saliency enhancement (SSE) module. The former provides richer semantic information to distinguish the object from the background, while the latter offers an extra pixel-level classification task to guide accurate bounding box regression. Thanks to the guidance of richer information, the proposed method can achieve fewer false alarms and enhance location accuracy. Additionally, we introduce a scale feature adaptive (SFA) loss to balance the attention to ships with various scales, which improves the robustness of multiscale ship detection. The proposed method achieves state-of-the-art performance under complex inshore scenes, and its effectiveness is verified by experiments on a large-scale SAR ship detection dataset (LSSDD) and a public SAR ship detection dataset (SSDD+).

DL-based Synthetic Aperture Radar (SAR) ship detection has tremendous advantages in numerous areas. However, it still faces some problems, such as the lack of prior knowledge, which seriously affects detection accuracy. In order to solve this problem, we propose a scene-aware SAR ship detection method based on unsupervised sea-land segmentation. This method follows a classical two-stage framework and is enhanced by two models: the unsupervised land and sea segmentation module (ULSM) and the land attention suppression module (LASM). ULSM and LASM can adaptively guide the network to reduce attention on land according to the type of scenes (i.e., inshore scene and offshore scene) and add prior knowledge (sea-land segmentation information) to the network, thereby reducing the network's attention to land directly and enhancing offshore detection performance relatively. This increases the accuracy of ship detection and enhances the interpretability of the model. Specifically, in consideration of the lack of land–sea segmentation labels in existing deep learning-based SAR ship detection datasets, ULSM uses an unsupervised approach to classify the input data scene into inshore and offshore types and performs sea-land segmentation for inshore scenes. LASM uses the sea-land segmentation information as prior knowledge to reduce the network's attention to land. We conducted our experiments using the publicly available SSDD dataset, which demonstrated the effectiveness of our network.

Ship detection in synthetic aperture radar (SAR) images is becoming a research hotspot. In recent years, as the rise of artificial intelligence, deep learning has almost dominated SAR ship detection community for its higher accuracy, faster speed, less human intervention, etc. However, today, there is still a lack of a reliable deep learning SAR ship detection dataset that can meet the practical migration application of ship detection in large-scene space-borne SAR images. Thus, to solve this problem, this paper releases a Large-Scale SAR Ship Detection Dataset-v1.0 (LS-SSDD-v1.0) from Sentinel-1, for small ship detection under large-scale backgrounds. LS-SSDD-v1.0 contains 15 large-scale SAR images whose ground truths are correctly labeled by SAR experts by drawing support from the Automatic Identification System (AIS) and Google Earth. To facilitate network training, the large-scale images are directly cut into 9000 sub-images without bells and whistles, providing convenience for subsequent detection result presentation in large-scale SAR images. Notably, LS-SSDD-v1.0 has five advantages: (1) large-scale backgrounds, (2) small ship detection, (3) abundant pure backgrounds, (4) fully automatic detection flow, and (5) numerous and standardized research baselines. Last but not least, combined with the advantage of abundant pure backgrounds, we also propose a Pure Background Hybrid Training mechanism (PBHT-mechanism) to suppress false alarms of land in large-scale SAR images. Experimental results of ablation study can verify the effectiveness of the PBHT-mechanism. LS-SSDD-v1.0 can inspire related scholars to make extensive research into SAR ship detection methods with engineering application value, which is conducive to the progress of SAR intelligent interpretation technology.

Ship detection on synthetic aperture radar (SAR) imagery has many valuable applications for both civil and military fields and has received extraordinary attention in recent years. The traditional detection methods are insensitive to multiscale ships and usually time‐consuming, results in low detection accuracy and limitation for real‐time processing. To balance the accuracy and speed, an end‐to‐end ship detection method for complex inshore and offshore scenes based on deep convolutional neural networks (CNNs) is proposed in this paper. First, the SAR images are divided into different grids, and the anchor boxes are predefined based on the responsible grids for dense ship prediction. Then, Darknet‐53 with residual units is adopted as a backbone to extract features, and a top‐down pyramid structure is added for multiscale feature fusion with concatenation. By this means, abundant hierarchical features containing both spatial and semantic information are extracted. Meanwhile, the strategies such as soft non‐maximum suppression (Soft‐NMS), mix‐up and mosaic data augmentation, multiscale training, and hybrid optimization are used for performance enhancement. Besides, the model is trained from scratch to avoid learning objective bias of pretraining. The proposed one‐stage method adopts end‐to‐end inference by a single network, so the detection speed can be guaranteed due to the concise paradigm. Extensive experiments are performed on the public SAR ship detection dataset (SSDD), and the results show that the method can detect both inshore and offshore ships with higher accuracy than other mainstream methods, yielding the accuracy with an average of 95.52%, and the detection speed is quite fast with about 72 frames per second (FPS). The actual Sentinel‐1 and Gaofen‐3 data are utilized for verification, and the detection results also show the effectiveness and robustness of the method.

Synthetic Aperture Radar (SAR) ship detection has been a research hotspot and is significant for marine surveillance. Traditional constant false alarm rate (CFAR) detector has the disadvantages of high false alarm and poor adaptability. Deep learning provides a unique solution for SAR ship detection. However, the traditional deep network cannot reach very deep thus the accuracy is limited, and the training speed is slow. In this paper, a very deep network ResNet with higher accuracy and faster training speed is applied to train the SAR ship detection model. Moreover, transfer learning is applied to combat the small dataset. The proposed method is tested on a general SAR ship dataset and achieves 94.7% average precision. Comparative experiments show that our method has the best performance and which verifies the effectiveness of our method.

Ship targets are important carriers of maritime behavior, and ship target detection has important economic and military value. Owing to its excellent characteristics, synthetic aperture radar (SAR) is widely used to detect sea targets. SAR ship detection has always been a popular field of research. The excellent performance of deep neural networks in computer vision has facilitated their application to SAR image detection. However, several problems remain in SAR ship detection at this stage. First, SAR ship targets differ significantly in size, and how to deal with multi-scale ship detection has, therefore, been a difficult research topic. Second, the size of a SAR ship target is small in low-resolution images, and thus, dealing with small size target detection is also difficult. Therefore, we propose a dense connection DetNet (DDNet), which is specifically used for SAR ship detection. The network consists of two parts: backbone sub-network and prediction sub-network. In the backbone subnetwork, we refer to DetNet, and use a stacked convolution layer instead of large downsampling to make it more suitable for small ship detection. In the prediction sub-network, we use a dense connection to fuse features of different scales, allowing it to better deal with multi-scale ship detection. The feature reuse strategy is used to improve the parameter efficiency. The experiments on SAR ship datasets show that our method performs better than other methods in small-size and complex background ship detection.

This research proposes a novel hardware-optimized design to accelerate Convolutional Neural Networks (CNNs) using Verilog HDL. The design is specifically developed for the DARKNET-19 system model, which serves as the backbone of the YOLOv3-tiny algorithm, a widely used framework for real-time object detection in dynamic environments. The CNN architecture was implemented in Verilog HDL and synthesized using Synopsys Design Compiler, with a focus on improving both object detection accuracy and hardware resource efficiency. The proposed design efficiently performs key CNN operations, including convolution, pooling, and activation, enabling faster real-time object detection compared to many existing methods. To improve performance, the hardware design incorporates parallel processing techniques, allowing multiple computations to be executed simultaneously. This significantly reduces the system latency and power consumption. The convolutional layers of the DARKNET-19 architecture are efficiently mapped onto the hardware platform, ensuring optimized data storage and fast memory access, which further enhances processing speed and detection accuracy. An innovative feature of the design is a 2-dimensional image preprocessing module that prepares input images before they are fed into the CNN. This preprocessing stage includes image resizing, brightness normalization, and color adjustment, which helps the CNN process visual data more effectively. After preprocessing, the images pass through several CNN layers. The convolutional layers extract key features from the images, while the pooling and activation layers refine these features to improve detection performance. Finally, the processed data is analyzed by the YOLOv3-tiny algorithm, which identifies and locates objects in the images with high precision. Experimental results demonstrate that the proposed high-speed and resource-efficient hardware architecture is well-suited for real-time object detection applications, particularly in highly dynamic and unpredictable environments.

In recent years, the rapid development of Deep Learning (DL) has provided a new method for ship detection in Synthetic Aperture Radar (SAR) images. However, there are still four challenges in this task. (1) The ship targets in SAR images are very sparse. A large number of unnecessary anchor boxes may be generated on the feature map when using traditional anchor-based detection models, which could greatly increase the amount of computation and make it difficult to achieve real-time rapid detection. (2) The size of the ship targets in SAR images is relatively small. Most of the detection methods have poor performance on small ships in large scenes. (3) The terrestrial background in SAR images is very complicated. Ship targets are susceptible to interference from complex backgrounds, and there are serious false detections and missed detections. (4) The ship targets in SAR images are characterized by a large aspect ratio, arbitrary direction and dense arrangement. Traditional horizontal box detection can cause non-target areas to interfere with the extraction of ship features, and it is difficult to accurately express the length, width and axial information of ship targets. To solve these problems, we propose an effective lightweight anchor-free detector called R-Centernet+ in the paper. Its features are as follows: the Convolutional Block Attention Module (CBAM) is introduced to the backbone network to improve the focusing ability on small ships; the Foreground Enhance Module (FEM) is used to introduce foreground information to reduce the interference of the complex background; the detection head that can output the ship angle map is designed to realize the rotation detection of ship targets. To verify the validity of the proposed model in this paper, experiments are performed on two public SAR image datasets, i.e., SAR Ship Detection Dataset (SSDD) and AIR-SARShip. The results show that the proposed R-Centernet+ detector can detect both inshore and offshore ships with higher accuracy than traditional models with an average precision of 95.11% on SSDD and 84.89% on AIR-SARShip, and the detection speed is quite fast with 33 frames per second.

In recent years, convolutional neural network (CNN) has been studied extensively in synthetic aperture radar (SAR) ship detection for its powerful feature extraction and classification capability, and has significantly improved the accuracy and robustness in condition of large scenes, multi-resolutions, and complex backgrounds. At present, a lot of related research focuses on design more efficient net structures. There have not been studies on how the detection performance varies for images with different complexity, backgrounds, surroundings, and quality. Taking two open-access SAR datasets, i.e. SSDD and UCAS_SARShip, as our source datasets, this paper first divides all the images into four classes according to their surroundings and backgrounds, then, dividing each class of images to training subset, validating subset, and test subset based on their features (image quality, noise level, complexity, etc.). Secondly, a large number of SAR ship detection experiments are conducted with five representative CNN based detectors on the four datasets we made. The experimental results show that detection preference is serious for each of the five detectors when they were trained with one of the four datasets. The research in this paper is a benefit for peers to understand and analyze detection preference, besides provide some valuable reference for the collection and division of SAR datasets for ship detection in the following research.