Research on intelligent recognition method for self‐blast state of glass insulator based on mixed data augmentation

To identify and locate industrial textile defects accurately, this study proposes a textile detection model based on a convolution neural network (CNN) known as Faster R-CNN. First, a textile defect feature map was extracted by ResNet-101 deep convolution network. Faster R-CNN only extracts features from the last layer of the feature map, which leads to a loss of low-level location information. The proposed method adds the feature pyramid network (FPN) to the network architecture to make an independent prediction for each level in the feature extraction stage. The extracted feature map is input into the regional proposal network, among which the overlapping regional proposals are suppressed. The proposed improved Faster R-CNN model with Region Proposal Network (RPN), Soft Non-Maximum Suppression (NMS), and Region of Interest (ROI) Align can achieve a detection accuracy of 98% and an mean of Average Precision (mAP) of 85%, which is more competitive than the state-of-the-art deep learning-based object detection algorithms.

Improving the precision of weakly supervised multiscale objects localization is of significant challenge in computer vision, especially when tackling the small objects. in this paper, we propose to integrate the feature pyramid network (FPN) with convolutional neural network (CNN) for weakly supervised object localization, where the FPN is built upon the outputs of different layers of the CNN. Then, we upsample the high-level maps by nearest-neighbor interpolation and fuse with the low-level maps in the FPN to produce multi-scale fused maps which features of both high resolution and strong semantics. Finally, we produce class activation maps by each layer of the FPN and gain multiple prediction scores by wildcat spatial pooling. To acquire more precise localization, we select the class activation map that corresponds to the highest score across all multiscale maps for object localization. In particular, we choose the maximum response regions of the class activation map for pointwise localization and choose the largest connected component above the threshold in the class activation map for bounding box localization. By applying the proposed strategy over PASCAL VOC dataset and MS COCO dataset, it is demonstrated that our strategy is highly effective in improving the precision of weakly supervised object localization as compared with some of the state-of-the-art weakly supervised methods.

Most Facial Expression Recognition (FER) systems rely on machine learning approaches that require large databases for an effective training. As these are not easily available, a good solution is to augment the databases with appropriate data augmentation (DA) techniques, which are typically based on either geometric transformation or oversampling augmentations (e.g., generative adversarial networks (GANs)). However, it is not always easy to understand which DA technique may be more convenient for FER systems because most state-of-the-art experiments use different settings which makes the impact of DA techniques not comparable. To advance in this respect, in this paper, we evaluate and compare the impact of using well-established DA techniques on the emotion recognition accuracy of a FER system based on the well-known VGG16 convolutional neural network (CNN). In particular, we consider both geometric transformations and GAN to increase the amount of training images. We performed cross-database evaluations: training with the "augmented" KDEF database and testing with two different databases (CK+ and ExpW). The best results were obtained combining horizontal reflection, translation and GAN, bringing an accuracy increase of approximately 30%. This outperforms alternative approaches, except for the one technique that could however rely on a quite bigger database.

The effective use of multi-scale features remains an open problem for object detection tasks. Recently, proposed object detectors have usually used Feature Pyramid Networks (FPN) to fuse multi-scale features. Since Feature Pyramid Networks use a relatively simple feature map fusion approach, it can lead to the loss or misalignment of semantic information in the fusion process. Several works have demonstrated that using a bottom-up structure in a Feature Pyramid Network can shorten the information path between lower layers and the topmost feature, allowing an adequate exchange of semantic information from different layers. We further enhance the bottom-up path by proposing a multi-scale residual aggregation Feature Pyramid Network (MSRA-FPN), which uses a unidirectional cross-layer residual module to aggregate features from multiple layers bottom-up in a triangular structure to the topmost layer. In addition, we introduce a Residual Squeeze and Excitation Module to mitigate the aliasing effects that occur when features from different layers are aggregated. MSRA-FPN enhances the semantic information of the high-level feature maps, mitigates the information decay during feature fusion, and enhances the detection capability of the model for large objects. It is experimentally demonstrated that our proposed MSRA-FPN improves the performance of the three baseline models by 0.5–1.9% on the PASCAL VOC dataset and is also quite competitive with other state-of-the-art FPN methods. On the MS COCO dataset, our proposed method can also improve the performance of the baseline model by 0.8% and the baseline model’s performance for large object detection by 1.8%. To further validate the effectiveness of MSRA-FPN for large object detection, we constructed the Thangka Figure Dataset and conducted comparative experiments. It is experimentally demonstrated that our proposed method improves the performance of the baseline model by 2.9–4.7% on this dataset and can reach up to 71.2%.

HIGHLIGHTSWe propose a balanced feature pyramid network model to achieve automatic recognition of agricultural pests.We propose and improved feature pyramid module to address the problems of the large semantic gap before feature fusion in FPN (feature pyramid network), information loss during feature fusion, and how to utilize complementary information to strengthen features after feature fusion.Our method is evaluated on the pest dataset and achieves better recognition results, the mAP (mean Average Precision) reaches 90.04%, and the final mAP after combining with the data enhancement strategy reaches 92.56%.Abstract.In order to ensure the steady improvement of the quality and efficiency of agricultural production, the precise prevention and control of agriculture pests should be given top priority. Based on the Faster R-CNN model, we propose a feature-augmented recognition model (FARM) for the detection of agricultural pests to improve the professional level of pest control. Firstly, we select VoVNet as the backbone network to extract rich visual information. Secondly, in view of the existing problems of FPN (Feature Pyramid Network), we propose a feature pyramid enhancement network to improve it. Finally, we use an adaptive anchor box network to train anchor boxes to avoid the problem of unbalanced positive and negative samples caused by artificial parameter adjustment. The experimental result shows that our method can achieve better recognition results; the mAP on the agricultural pest dataset reaches 90.04%, and the final mAP after combining with the data enhancement strategy reaches 92.56%. Keywords: Adaptive anchor box, Agricultural pests, Feature augmented, Feature pyramid.

YOLOv3 is a deep learning-based real-time object detector and is mainly used in applications such as video surveillance and autonomous vehicles. In this paper, we proposed an improved YOLOv3 (You Only Look Once version 3) applied Duplex FPN, which enhanced large object detection by utilizing low-level feature information. The conventional YOLOv3 improved the small object detection performance by applying FPN (Feature Pyramid Networks) structure to YOLOv2. However, YOLOv3 with an FPN structure specialized in detecting small objects, so it is difficult to detect large objects. Therefore, this paper proposed an improved YOLOv3 applied Duplex FPN, which can utilize low-level location information in high-level feature maps instead of the existing FPN structure of YOLOv3. This improved the detection accuracy of large objects. Also, an extra detection layer was added to the top-level feature map to prevent failure of detection of parts of large objects. Further, dimension clusters of each detection layer were reassigned to learn quickly how to accurately detect objects. The proposed method was compared and analyzed in the PASCAL VOC dataset. The experimental results showed that the bounding box accuracy of large objects improved owing to the Duplex FPN and extra detection layer, and the proposed method succeeded in detecting large objects that the existing YOLOv3 did not.

In this paper, we propose a novel feature map compression method for Video Coding for Machines (VCM). The proposed method performs a principal component analysis (PCA)-based transform on feature pyramid network (FPN) feature maps using predefined basis and mean vectors. In addition, the proposed method reduces redundancy between different resolution levels within FPN feature maps based on redundancy between FPN layers. The fixed predefined basis and mean are employed through PCA with a set of training data set. For any input videos, transform coefficients are obtained by performing transform with the fixed basis and compressed using Versatile Video Coding (VVC). Experimental results show that the proposed method achieves 89.22% and 86.57% BD-rate gain compared to the VCM feature anchor in instance segmentation, and object detection, respectively.

Aiming at the problem of missing traffic video frames, this paper proposes a complementary model of generative adversarial networks. The model uses the Feature Pyramid Network (FPN) to obtain feature maps of multiple scales on the input video frame. By fusing feature maps of different scales, it can better integrate the semantic information on the frame. The local patch discriminator added to the discriminator model effectively ensures the accuracy and continuity of the completed frame. Experimental results on Caltech pedestrian dataset and KITTI dataset show the good performance of the proposed model.KeywordsGenerative adversarial networksFeature Pyramid NetworkSemantic information

To address the issue of multi-scale detection, current detectors usually generate hierarchical feature pyramid by a naive combination of top-down features with lateral features. Due to the limited effective receptive fields in the top-down pathway, the generated regions are only associated with the neighbor regions of the coarse feature maps, which is harmful for pyramidal feature generation. And considering the weak representation of simply merging of top-down and lateral pathways, the pyramidal feature maps with strong semantics are difficult to obtain. In this paper, we present the Residual Dilation based Feature Pyramid Network (RDFPN) to exploit the inherent correlation of regions in feature pyramid. The goal of RDFPN is to produce more appropriate hierarchical feature maps for multi-scale detection. With Residual-50 network in Faster R-CNN framework, RDFPN outperforms the original FPN on the challenging COCO dataset without bells and whistles.

Mammography is the primary procedure for breast cancer screening, attempting to reduce breast cancer mortality risk with early detection. Deep learning methods have shown strong applicability to various medical images datasets. Due to paucity of available labeled medical images, accurate computer assisted diagnosis requires intensive data augmentation (DA) techniques, such as geometric/intensity transformations of original images. This data when used along with the training data helps to address the limited medical image dataset collected from various sources. Generative Adversarial Networks (GANs) is one of the DA techniques. GAN trained on images can generate new images that contain many authentic characteristics and look realistic to human observers. Therefore, this paper focuses on overcoming the problem of limited labeled dataset, using Deep Convolution GANs (DCGANs). To analyze the closeness between the original and synthetic images, a visualization tool ImageJ was used. In order to validate the proposed model, a visual Turing test was conducted with the help of medical experts.

Side-scan sonar (SSS) images present unique challenges to computer vision due to their lower resolution, smaller targets, and fewer features. Although the mainstream backbone networks have shown promising results on traditional vision tasks, they utilize traditional convolution to reduce the dimensionality of feature maps, which may cause information loss for small targets and decrease performance in SSS images. To address this problem, based on the yolov8 network, we proposed a new underwater target detection model based on upsampling and downsampling. Firstly, we introduced a new general downsampling module called shallow robust feature downsampling (SRFD) and a receptive field convolution (RFCAConv) in the backbone network. Thereby multiple feature maps extracted by different downsampling techniques can be fused to create a more robust feature map with a complementary set of features. Additionally, an ultra-lightweight and efficient dynamic upsampling module (Dysample) is introduced to improve the accuracy of the feature pyramid network (FPN) in fusing different levels of features. On the underwater shipwreck dataset, our improved model’s mAP50 increased by 4.4% compared to the baseline model.

The lack of the sufficient and diverse training data is one of the main challenges limiting performances of the machine learning enabled applications in optical networks. Here, we propose a deep learning based sequential data augmentation technique for the aggregate traffic data augmentation for diverse optical network scenarios. A generative adversarial network (GAN) model is trained with the experimental traffic data to automatically extract the substantial characteristics of the experimental traffic data through the zero-sum game theory and then augment the traffic data adaptively. The statistical evaluation parameters of the augmented traffic are mean, variance and Hurst exponent. To add comparisons, two other classical generative models including the statistical parameter configuration (SPC) model and the variational autoencoder (VAE) model are also adopted to generate the traffic data that are similar to the actual traffic data. The comprehensive comparisons among the proposed GAN, the SPC and VAE show that the performances of the GAN exceed those of the SPC and the VAE obviously. The mean and the variance of the augmented traffic data from the GAN are almost equal to those of the experimental traffic data, where the average deviations are both within 2%. The Hurst exponent of the augmented traffic data from the GAN is respectively near 90% and 96% of those of the experimental traffic data in the access network and the core network. To estimate the similarity intuitively, the well-known k-mean algorithm is used to cluster the augmented traffic data according to the centroids determined by the corresponding experimental traffic data and the clustering accuracies are all higher than 95% for 6 kinds of typical traffic types in the optical networks. These results demonstrate that the proposed GAN is able to effectively generate the traffic data that is very close to the experimental traffic data and is difficult to be distinguished for diverse traffic types. Moreover, a relatively small dataset with a few hundred pieces of experimental traffic data is required and the amount of the augmented traffic data from the GAN is unlimited in theory, which can be augmented as much as we need. The proposed traffic data augmentation technique also has the potential to be utilized in other sequential data augmentation applications for the optical networks.

Successful training of convolutional neural networks (CNNs) requires a substantial amount of data. With small datasets, networks generalize poorly. Data Augmentation techniques improve the generalizability of neural networks by using existing training data more effectively. Standard data augmentation methods, however, produce limited plausible alternative data. Generative Adversarial Networks (GANs) have been utilized to generate new data and improve the performance of CNNs. Nevertheless, data augmentation techniques for training GANs are underexplored compared to CNNs. In this work, we propose a new GAN architecture for augmentation of chest X-rays for semi-supervised detection of pneumonia and COVID-19 using generative models. We show that the proposed GAN can be used to effectively augment data and improve classification accuracy of disease in chest X-rays for pneumonia and COVID-19. We compare our augmentation GAN model with Deep Convolutional GAN and traditional augmentation methods (rotate, zoom, etc.) on two different X-ray datasets and show our GAN-based augmentation method surpasses other augmentation methods for training a GAN in detecting anomalies in X-ray images.

Synthetic Aperture Radar (SAR) is an active microwave sensor that has attracted widespread attention due to its ability to observe the ground around the clock. Research on multi-scale and multi-category target detection methods holds great significance in the fields of maritime resource management and wartime reconnaissance. However, complex scenes often influence SAR object detection, and the diversity of target scales also brings challenges to research. This paper proposes a multi-category SAR image object detection model, CCDS-YOLO, based on YOLOv5s, to address these issues. Embedding the Convolutional Block Attention Module (CBAM) in the feature extraction part of the backbone network enables the model’s ability to extract and fuse spatial information and channel information. The 1 × 1 convolution in the feature pyramid network and the first layer convolution of the detection head are replaced with the expanded convolution, Coordinate Conventional (CoordConv), forming a CRD-FPN module. This module more accurately perceives the spatial details of the feature map, enhancing the model’s ability to handle regression tasks compared to traditional convolution. In the detector segment, a decoupled head is utilized for feature extraction, offering optimal and effective feature information for the classification and regression branches separately. The traditional Non-Maximum Suppression (NMS) is substituted with the Soft Non-Maximum Suppression (Soft-NMS), successfully reducing the model’s duplicate detection rate for compact objects. Based on the experimental findings, the approach presented in this paper demonstrates excellent results in multi-category target recognition for SAR images. Empirical comparisons are conducted on the filtered MSAR dataset. Compared with YOLOv5s, the performance of CCDS-YOLO has been significantly improved. The mAP@0.5 value increases by 3.3% to 92.3%, the precision increases by 3.4%, and the mAP@0.5:0.95 increases by 6.7%. Furthermore, in comparison with other mainstream detection models, CCDS-YOLO stands out in overall performance and anti-interference ability.

Object detection is increasingly in demand in IoT service applications. Deep learning based object detection algorithms are now in fashion. As the most popular multi-scale object detection network at present, Feature Pyramid Network achieves feature augmentation by fusing features of neighboring layers. It is widely used in the most advanced object detectors to detect objects of different scales. In this paper, we propose a new attention mechanism guided bidirectional feature pyramid architecture named AgBFPN to enhance the transfer of semantic and spatial information between each feature map. We design Channel Attention Guided Fusion(CAGF) Module and Spatial Attention Guided Fusion(SAGF) Module to enhance feature fusion. The CAGF mitigates the loss of information induced by channel reduction and better transfers the semantic information from high-level to low-level features. The SAGF passes the rich spatial information of shallow features into deep features. Our experiments show that AgBFPN achieves higher Average Precision for multi-scale object detection.