Steel Sheet Defect Detection using Feature Pyramid Network and RESNET

With the development of productivity, people set higher demands on the quality of steel. In recent years, artificial intelligence, especially deep learning-based computer vision technology has attracted great attention, which can be used for detecting steel surface defects such as scratches, patches, and rust spots. However, due to the complexity of the strip steel surface, it is still a challenge to accurately and effectively detect defect regions by the existing defects detection methods. Therefore, we propose a unique saliency model, i.e., deeper feature integration network to highlight the defect regions on the strip steel surface. To be specific, after each encoder stage, we introduce the multiscale global feature extraction module to elevate the multiscale deep features from the encoder. Meanwhile, we deploy the deeper feature extraction module, which contains a bidirectional feature extraction unit, to dig the effective representation for defects. Particularly, the forward one is equipped with a channel-space weighted module and the backward one is equipped with a split attention module. After that, the features from the two branches are progressively integrated by the decoder, yielding the final high-quality saliency maps that give a good depiction of the strip steel surface defects. Extensive experiments are executed on the public dataset, and the comparison results show that our model performs better than the 15 state-of-the-art methods, which proves the effectiveness and superiority of the proposed model.

An efficient re-parameterization feature pyramid network on YOLOv8 to the detection of steel surface defect

With the development of industrial economy, more and more enterprises use machine vision and artificial intelligence to replace manual detection. Therefore, the research of steel surface defect detection based on artificial intelligence is of great significance to promote the rapid development of intelligent factory and intelligent manufacturing system. In this paper, Yolov5 deep learning algorithm is used to build a classification model of steel surface defects to realize the classification and detection of steel surface defects. At the same time, on the basis of Yolov5, combined with the attention mechanism, the backbone network is improved to further improve the classification model of steel surface defects. The experiment shows that the Recall and mAP of improved Yolov5 perform better on the steel surface defect data set. Compared with Yolov5, the number of C3CA-Yolov5 parameters decreased by 13.02%, and the size of pt files decreased by 12.72%; the number of C3ECA-Yolov5 parameters decreased by 13.36%, and the size of pt files decreased by 13.22%.

Surface defects have a serious detrimental effect on the quality of steel. To address the problems of low efficiency and poor accuracy in the manual inspection process, intelligent detection technology based on machine learning has been gradually applied to the detection of steel surface defects. An improved YOLOv8 steel surface defect detection model called YOLOv8-MGVS is designed to address these challenges. The MLCA mechanism in the C2f module is applied to increase the feature extraction ability in the backbone network. The lightweight GSConv and VovGscsp cross-stage fusion modules are added to the neck network to reduce the loss of semantic information and achieve effective information fusion. The self-attention mechanism is exploited into the detection network to improve the detection ability of small targets. Defect detection experiments were carried out on the NEU-DET dataset. Compared with YOLOv8n from experimental results, the average accuracy, recall rate, and frames per second of the improved model were improved by 5.2%, 10.5%, and 6.4%, respectively, while the number of parameters and computational costs were reduced by 5.8% and 14.8%, respectively. Furthermore, the defect detection generalization experiments on the GC-10 dataset and SDD DET dataset confirmed that the YOLOv8-MGVS model has higher detection accuracy, better lightweight, and speed.

Detection of surface defects in strip steel is crucial in industrial automation to ensure steel quality. Recently, learning-based detection methods have gained prominence among researchers for their robust capabilities. However, accurately delineating clear area boundaries remains a challenge, particularly in the complex backgrounds of steel surfaces. In this paper, we propose the edge-aware Interactive Refinement Network (EAIRNet) to address this challenge. EAIRNet comprises three core modules: a Multiscale Feature Extractor, a Sal-Edge Interactive Module, and a regional attention guided module (RAGM). Firstly, our network extracts multiscale features using ResNet from the steel surface environment. Subsequently, features from encoder’s stage 3–5 are integrated to derive edge features. The SEIM facilitates interaction between salient and edge features in the decoder stage, thereby enhancing the network’s focus on defect area boundaries and refining detection precision. Additionally, we introduce the RAGM to improve the focus of shallow decoder layers on defect areas. Our EAIRNet’s effectiveness is proven through comprehensive experimental results on the public dataset named SD-Saliency-900, in comparison to state-of-the-art methods.

The classification of steel surface defects plays a very important role in analyzing their causes to improve manufacturing process and eliminate defects. However, defective samples are very scarce in actual production, so using very few samples to construct a good classifier is a challenge to be addressed. If the layer number of the model with proper depth is increased, the model accuracy will decrease (not caused by overfit), and the training error as well as the test error will be very high. This is called the degradation problem. In this paper, we propose to use feature extraction + feature transformation + nearest neighbors to classify steel surface defects. In order to solve the degradation problem caused by network deepening, the three feature extraction networks of Residual Net, Mobile Net and Dense Net are designed and analyzed. Experiment results show that in the case of a small sample number, Dense block can better solve the degradation problem caused by network deepening than Residual block. Moreover, if Dense Net is used as the feature extraction network, and the nearest neighbor classification algorithm based on Euclidean metric is used in the new feature space, the defect classification accuracy can reach 92.33% when only five labeled images of each category are used as the training set. This paper is of some guiding significance for surface defect classification when the sample number is small.

A New Ensemble Approach based on Deep Convolutional Neural Networks for Steel Surface Defect classification

Defect classification is an important aspect of steel surface defect detection. Traditional approaches for steel surface defect classification employ convolutional neural networks (CNNs) to improve accuracy, typically by increasing network depth and parameter count. However, this approach overlooks the significant memory overhead of large models, and the incremental gains in accuracy diminish as the number of parameters increases. To address these issues, a multi-scale lightweight neural network model (MM) is proposed. The MM model, with a fusion encoding module as its core, constructs a multi-scale neural network by utilizing the Gaussian difference pyramid. This approach enhances the network’s ability to capture patterns at different resolutions while achieving superior model accuracy and efficiency. Experimental results on a dataset from a hot-rolled strip steel plant demonstrate that the MM network achieves a classification accuracy of 98.06% in defect classification tasks. Compared to networks such as ResNet-50, ResNet-101, VGG, AlexNet, MobileNetV2, and MobileNetV3, the MM model not only reduces the number of model parameters and compresses model size but also achieves better classification accuracy.

Steel is widely used in the aerospace, machinery and automotive industries. Surface defects not only have a negative impact on the appearance of steel but also significantly reduce its wear resistance, high temperature resistance, corrosion resistance and fatigue strength. Therefore, the detection of steel surface defects is very important to improve the quality of steel production. The limited availability of surface defect samples in the industrial sector poses significant challenges for the accurate detection of defects in high-quality materials. In addition, the existing defect detection model is highly complex and not easy to deploy. To solve this problem, a lightweight defect detection network suitable for steel defects is proposed. The cross-layer feature fusion (CFF) in the design enables effective utilisation of multi-layer semantic features, facilitating the detection of small defects in steel. Secondly, a new loss function is designed to make up for the problems of small data volume and uneven data distribution. The experimental results demonstrate that the steel surface defect detection method proposed in this paper achieves the highest detection performance on widely used public datasets such as RSDDS, NEUS and NRSD-CR(test), while maintaining the lowest model complexity.

This study introduces Hybrid-DC, a hybrid deep-learning model integrating ResNet-50 and Vision Transformer (ViT) for high-accuracy steel surface defect classification. Hybrid-DC leverages ResNet-50 for efficient feature extraction at both low and high levels and utilizes ViT’s global context learning to enhance classification precision. A unique hybrid attention layer and an attention fusion mechanism enable Hybrid-DC to adapt to the complex, variable patterns typical of steel surface defects. Experimental evaluations demonstrate that Hybrid-DC achieves substantial accuracy improvements and significantly reduced loss compared to traditional models like MobileNetV2 and ResNet, with a validation accuracy reaching 0.9944. The results suggest that this model, characterized by rapid convergence and stable learning, can be applied for real-time quality control in steel manufacturing and other high-precision industries, enhancing automated defect detection efficiency.

Histopathological examination holds a crucial role in cancer grading and serves as a significant reference for devising individualized patient treatment plans in clinical practice. Nevertheless, the distinctive features of numerous histopathological image targets frequently contribute to suboptimal segmentation performance. In this paper, we propose a UNet-based multi-scale context fusion algorithm for medical image segmentation, which extracts rich contextual information by extracting semantic information at different encoding stages and assigns different weights to the semantic information at different scales through TBSFF module to improve the learning ability of the network for features. Through multi-scale context fusion and feature selection networks, richer semantic features and detailed information are extracted. The target can be more accurately segmented without significantly increasing the extra overhead. The results demonstrate that our algorithm achieves superior Dice and IoU scores with a relatively small parameter count. Specifically, on the GlaS dataset, the Dice score is 90.56, and IoU is 83.47. For the MoNuSeg dataset, the Dice score is 79.07, and IoU is 65.98.

As manufacturing speed increases in the steel industry, fast and exact product inspection becomes more important. This paper deals with defect detection and classification algorithm for high-speed steel bar in coil. We enhance an acquired image by use of a special subtractive method and find the position of defect using local entropy and morphology. The extracted statistical features are then presented to a classifier. We use neural network and fuzzy inference system as a classifier and compare their results. The best accuracy, % 97.19, is obtained by the neural network.

Visual inspection of steel surface defects based on domain adaptation and adaptive convolutional neural network

In this study, we use a neural network approach instead of the traditional manual approach to solve the problem regarding the detection of defects on steel surfaces. We introduce several attention mechanisms to improve the Yolo v8 neural network trained on a steel defect detection dataset. The results show that our improved Yolo v8 model improves the robustness of the model more significantly and can detect more detailed steel surface defects.

With the rapid development of deep learning technologies, the detection of steel surface defects has made significant progress, especially in automated industrial production environments. This paper reviews the current state of research on steel surface defect detection, focusing on deep learning-based methods. We discuss traditional and modern techniques, including Convolutional Neural Networks (CNN), YOLO, and other object detection frameworks. We also highlight the challenges faced in this field, such as data dependency, small target detection, multi-scale recognition, and the need for model generalization and industrial deployment. The review emphasizes the necessity of overcoming the limitations of existing models, such as accuracy and efficiency, to achieve real-time, reliable defect detection in complex industrial settings.