A Welding Defect Detection Model Based on Hybrid-Enhanced Multi-Granularity Spatiotemporal Representation Learning.

This study aims to develop and validate an interpretable deep learning (DL) model and a nomogram based on endoscopic ultrasound (EUS) images for the prediction of pathological grading in pancreatic neuroendocrine tumors (PNETs). This multicenter retrospective study included 108 patients with PNETs, who were divided into train (n = 81, internal center) and test cohorts (n = 27, external centers). Univariate and multivariate logistic regression were used for screening demographic characteristics and EUS semantic features. Deep transfer learning was employed using a pre-trained ResNet18 model to extract features from EUS images. Feature selection was conducted using the least absolute shrinkage and selection operator (LASSO), and various machine learning algorithms were utilized to construct DL models. The optimal model was then integrated with clinical features to develop a nomogram. The performance of the model was assessed using the area under the curve (AUC), calibration curves, decision curve analysis (DCA), and clinical impact curves (CIC). The nomogram, which integrates the optimal DL model (Naive Bayes) with clinical features, achieved AUC values of 0.928 (95% CI 0.849–0.981) in the train cohort and 0.882 (95% CI 0.778–0.954) in the test cohort. Calibration curves revealed minimal discrepancies between predicted and actual probabilities, with mean absolute errors of 4.5% and 6.6% in the train and test cohorts, respectively. DCA and CIC demonstrated substantial net benefit and clinical utility. The SHapley Additive exPlanations (SHAP) method provided insights into the contribution of each DL feature to the model’s predictions. This study developed and validated a novel interpretable DL model and nomogram using EUS images and machine learning, which holds promise for enhancing the clinical application of EUS in identifying PNETs’ pathological grading.

BackgroundGrain count is crucial to wheat yield composition and estimating yield parameters. However, traditional manual counting methods are time-consuming and labor-intensive. This study developed an advanced deep learning technique for the segmentation counting model of wheat grains. This model has been rigorously tested on three distinct wheat varieties: ‘Bainong 307’, ‘Xinmai 26’, and ‘Jimai 336’, and it has achieved unprecedented predictive counting accuracy.MethodThe images of wheat ears were taken with a smartphone at the late stage of wheat grain filling. We used image processing technology to preprocess and normalize the images to 480*480 pixels. A CBAM-HRNet wheat grain segmentation counting deep learning model based on the Convolutional Block Attention Module (CBAM) was constructed by combining deep learning, migration learning, and attention mechanism. Image processing algorithms and wheat grain texture features were used to build a grain counting and predictive counting model for wheat grains.ResultsThe CBAM-HRNet model using the CBAM was the best for wheat grain segmentation. Its segmentation accuracy of 92.04%, the mean Intersection over Union (mIoU) of 85.21%, the category mean pixel accuracy (mPA) of 91.16%, and the recall rate of 91.16% demonstrate superior robustness compared to other models such as HRNet, PSPNet, DeeplabV3+ , and U-Net. Method I for spike count, which calculates twice the number of grains on one side of the spike to determine the total number of grains, demonstrates a coefficient of determination R2 of 0.85, a mean absolute error (MAE) of 1.53, and a mean relative error (MRE) of 2.91. In contrast, Method II for spike count involves summing the number of grains on both sides to determine the total number of grains, demonstrating a coefficient of determination R2 of 0.92, an MAE) of 1.15, and an MRE) of 2.09%.ConclusionsImage segmentation algorithm of the CBAM-HRNet wheat spike grain is a powerful solution that uses the CBAM to segment wheat spike grains and obtain richer semantic information. This model can effectively address the challenges of small target image segmentation and under-fitting problems in training. Additionally, the spike grain counting model can quickly and accurately predict the grain count of wheat, providing algorithmic support for efficient and intelligent wheat yield estimation.

With the continuous development of deep learning technologies, fault prediction techniques based on various neural networks have been evolving. The deep learning modules based on U-Net residual networks have shown significant advantages in both learning efficiency and effectiveness. In this paper, we propose a deep learning model that integrates a 3D U-Net residual architecture, Convolutional Block Attention Module (CBAM), and Multi-scale Enhanced Global Attention (MEGA) module for automatic seismic fault detection and segmentation. This model can effectively handle complex 3D seismic data, fully exploiting both spatial and channel information, significantly improving the prediction accuracy for small faults, while only slightly increasing the computational cost.Firstly, the model uses the 3D U-Net as the backbone framework, where the residual blocks (BasicRes) extract features through multiple convolution layers. The CBAM module is incorporated to apply attention weighting, enhancing the model's ability to focus on critical information. The CBAM module combines channel attention and spatial attention, effectively adjusting the importance of feature maps from different dimensions, enabling the model to identify potential fault features in complex seismic data.Secondly, the MEGA module is introduced into the model, which further improves the model's feature representation ability by fusing multi-scale features and applying a global attention mechanism. By weighting global information, the MEGA module helps the model better capture key seismic fault features during feature fusion. This design allows the model to focus not only on local details but also to fully utilize the global contextual information in 3D data, thereby enhancing the accuracy of fault detection.After validation, the model achieved promising results in seismic fault detection tasks, automatically identifying and segmenting fault structures in seismic data. The accuracy was improved from 80% with the original 3D U-Net residual network to 85%-87%. This provides strong support for applications such as seismic exploration and subsurface imaging.Keywords: Seismic Fault Detection, 3D U-Net, Convolutional Block Attention Module (CBAM), Multi-scale Enhanced Global Attention (MEGA), Deep Learning

MRI image classification of brain tumors is critical for accurate and early diagnosis. New developments in deep learning have revealed that inserting attention mechanisms into convolutional neural networks can greatly improve classification performance. This work assesses the effectiveness of Squeeze-and-Excitation (SE) and Convolutional Block Attention Module (CBAM) integrated with the ResNet50 model for brain tumor classification. The SE module recalibrates channel-wise feature responses, while CBAM enhances feature representation by combining channel and spatial attention. The SE and CBAM are combined with ResNet50, greatly increasing classification accuracy, precision, and recall when compared to the basic model, according to experimental results on MRI datasets. The suggested model employs attention mechanisms to focus valuable information selectively and suppress irrelevant information. The experiments on publicly available brain tumor datasets display great improvements over basic CNN models, with precision, recall, accuracy, as well as F1 score at 0.9914, 0.9903, 0.9945, and 0.9908, respectively. From these results, the importance of attention mechanisms in deep learning models for medical imaging is highlighted, which suggests that SE and CBAM modules can be available as more dependable and effective instruments for brain tumor classification in clinical settings. Future studies should investigate transformer-based and hybrid attention techniques to enhance automated brain tumor categorization.

PurposeTo differentiate complicated appendicitis (CA) from uncomplicated appendicitis (UA) in children, we developed and validated an artificial intelligence (AI) model using a multimodal approach integrating ultrasound images and clinical data.MethodsA retrospective analysis was performed on 372 pathologically confirmed pediatric appendicitis cases (230 male, 142 female) from three centers, all with preoperative abdominal ultrasound. Deep learning (DL) features and radiomic features were extracted from appendiceal ultrasound images using deep transfer learning (DTL) and conventional radiomic methods, respectively. We selected 12 radiomic features, 9 DL features, and 3 clinical features—namely, white blood cell count (WBC), neutrophil count (NEU), and C-reactive protein (CRP)—for building the machine learning classification model. Based on these features, four distinct models were constructed: the Rad model (radiomic features only), the DL model (DL features only), the DTL model (combined radiomic and DL features), and the Combine model (integrating all three feature types: radiomic, DL, and clinical features). Model performance was evaluated using receiver operating characteristic (ROC) curves, decision curve analysis (DCA), and the DeLong test. Finally, the combined model was compared to the performance of clinicians with varying levels of experience.ResultsThe combined model demonstrated consistently favorable performance across all cohorts (AUC: 0.940, 0.895, 0.866, and 0.783 for training and validation sets, respectively). The model's accuracy (0.862) and positive predictive value (0.896) were comparable to senior surgeons (0.741, 0.970) and superior to junior surgeons (0.672, 0.865) in the internal validation cohort. DCA confirmed the clinical utility of the combined model over conventional strategies.ConclusionOur ultrasound-based AI model provides reliable differentiation between CA and UA in children, offering potential value as a diagnostic support tool for clinical decision making.

A molten pool image gathering system is designed based on multiple visions. By using a composite filter, it can effectively overcome the interference of the welding arc and obtain a clear molten pool image. A series of image processing algorithms has been proposed based on the features of the molten pool image. A median filtering has been used to remove the noise of the molten pool image. A canny multi-threshold method has been used to extract the edge characteristics of the molten pool. Then the edge feature of the molten pool can be gotten after false edge removing and iterative fitting.

Plant disease detection plays a critical role in ensuring agricultural productivity and food security. Accurate and efficient identification of plant diseases can aid in timely interventions, reducing potential crop losses. This paper presents a comprehensive study involving the application of deep learning models, namely CNN, ResNet, VGG, and Inception, to grayscale plant disease image datasets for apple, grape, and corn. The datasets consist of grayscale images divided into multiple disease classes. Initial experiments using standard deep learning models demonstrated reasonable accuracy. To further enhance performance, manual feature extraction techniques, including Histogram of Oriented Gradients (HOG), Oriented FAST and Rotated BRIEF (ORB), and Scale-Invariant Feature Transform (SIFT), were applied alongside deep features extracted using pretrained VGG and ResNet models. The extracted deep learning and handcrafted features were concatenated to form a comprehensive feature set. A Random Forest Classifier (RFC) was then applied to this combined feature set, resulting in improved accuracy compared to individual models.

Acquiring the growth information of tobacco plants quickly and accurately is an important prerequisite for their daily management. In view of the problem that the convolutional neural network is easily affected by background information, this study introduces the Convolutional Block Attention Module into the U <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2-</sup> Net. This method is mainly composed of an encoder and a decoder. Before the feature map is decoded, it will go through the Convolutional Block Attention Module to filter more important features and inhibit the invalid features. In the decoder, in order to fuse the features of objects in different scales, the feature maps in the decoder are up-sampled and then concatenated. This information aggregation solves the problem of difficult object detection at different scales to some extent. The results of this method are compared with four current mainstream deep learning models(U <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> -Net, DeeplabV3+, PSP-Net, U-Net). The result shows: 1) The U <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> -Net network based on the Convolutional Block Attention Module has the highest extraction accuracy for the UAV visible light remote senseing of tobacco(accuracy was 98.53%, recall was 96.00%,F1-Score was 96.38%, kappa coefficient was 0.95, IOU was 93.02%); 2)In the extraction of the three test areas, the extraction value of this method is highly consistent with the label area value(the area ratios of a total of 13 plants in the three regions were kept between 90% and 100%),the effect is much higher than that of DeeplabV3+ and PSP-Net, and slightly higher than the extraction effect of U <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> -Net and U-Net. 3)In the segmentation of three typical canopy closure regions of A, B, and C, most of the accuracy factors in different regions can reach 94% and above. It can be seen that the method in this study has certain advantages in feature extraction and has certain value in practical application.

Counting the number of wheat ears in images under natural light is an important way to evaluate the crop yield, thus, it is of great significance to modern intelligent agriculture. However, the distribution of wheat ears is dense, so the occlusion and overlap problem appears in almost every wheat image. It is difficult for traditional image processing methods to solve occlusion problem due to the deficiency of high-level semantic features, while existing deep learning based counting methods did not solve the occlusion efficiently. This article proposes an improved EfficientDet-D0 object detection model for wheat ear counting, and focuses on solving occlusion. First, the transfer learning method is employed in the pre-training of the model backbone network to extract the high-level semantic features of wheat ears. Secondly, an image augmentation method Random-Cutout is proposed, in which some rectangles are selected and erased according to the number and size of the wheat ears in the images to simulate occlusion in real wheat images. Finally, convolutional block attention module (CBAM) is adopted into the EfficientDet-D0 model after the backbone, which makes the model refine the features, pay more attention to the wheat ears and suppress other useless background information. Extensive experiments are done by feeding the features to detection layer, showing that the counting accuracy of the improved EfficientDet-D0 model reaches 94%, which is about 2% higher than the original model, and false detection rate is 5.8%, which is the lowest among comparative methods.

MC-ShuffleNetV2: A lightweight model for maize disease recognition

Background: Modern diagnostic pathology workflows involve the integration of histomorphologic, immunohistochemical (IHC), and molecular data to reach a final diagnosis. Recently, advances in deep learning have revolutionized pathology by providing the prospect for expert-level autonomous image analysis tools. Despite recent innovations in deep learning, integrating histomorphologic and molecular information found on respective H&amp;E- and IHC-stained tissue sections still remains a challenge. Here, we aim to address this issue by incorporating computer vision tools, including deep learning and scale-invariant feature transform (SIFT), to align H&amp;E-stained sections with accompanying IHC studies for automated subclassification of gliomas. Methods: To test the workflow, we trained the publicly available VGG19 convolutional neural network (CNN) using patches of pathologist-annotated H&amp;E-stained WSIs to recognize histological patterns of 16 common tissue and brain tumor classes, including diffuse glioma, meningioma, metastatic carcinoma, and schwannoma. To complement the histomorphologic analysis, we optimized several deep learning classifiers, including Mask R-CNN, to recognize various IHC markers, such as Ki-67, IDH1-R132H and ATRX, relevant for molecular subclassification of gliomas. For the integrated analysis, we employed SIFT to align lesional regions of H&amp;E and IHC images. Results: The histomorphologic classifier excelled at classification with accuracies of 100% for glioma, meningioma and metastatic carcinoma, and 93% for schwannoma (n = 125). The Mask R-CNN was tested on 147 images generated from 34 brain tumor Ki-67 WSIs and showed a high concordance with aggregate pathologists’ estimates (n = 3 assessors; y = 0.9712x -1.945, r = 0.9750). Using the deep learning classifiers and SIFT, we were able to identify tumor regions from the H&amp;E images and align them to their corresponding IHC images. This resulted in significant improvement of ATRX and IDH1-R132H quantification compared to unaligned WSIs. Finally, SIFT and partially sampling the lesional regions decreased computational time significantly without compromising accuracy. Conclusion: SIFT can work in concert with deep learning tools to help examine the histomorphologic and molecular patterns of various brain tumors and provide a framework for integrating deep learning tools to provide automated diagnoses. Citation Format: Michael K. Lee, Kevin Faust, Madhumitha Rabindranath, Phedias Diamandis. Automating integration of histomorphologic and immunohistochemistry data using computer vision tools [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2022; 2022 Apr 8-13. Philadelphia (PA): AACR; Cancer Res 2022;82(12_Suppl):Abstract nr 455.

Weeds are one of the primary factors that reduce crop productivity by competing for nutrients and water, causing the plant to lose weight and resulting in reduced grain yield. Traditional agricultural practices often rely on uniform herbicide application, which can contaminate soil and raise costs. On agricultural land, selective weed treatment are an efficient and cost-effective way to control weeds that require a deep learning-based crop and weed segmentation system. Many existing crop and weed segmentation research works focus on achieving precise crop and weed segmentation results, rather than building lightweight models to deploy on edge devices. To attain this, we develop an effective and efficient convolutional neural network, namely the Concatenated Attention U-Net with Convolutional Block Attention Module (CAUC). By integrating Linear Concatenated Blocks (LCB), Attention Gate (AG) connections, and Convolutional Block Attention Module (CBAM), the proposed model efficiently utilizes feature maps among its architectural components to achieve superior performance. Depth-wise convolution layers and 1 × 1 convolution layers in LCBs reduce computational complexity. To enable the proposed model to identify the weed portions in multiple crop fields, we integrated three datasets in this research work, namely the Crop/Weed Field Image Dataset (CWFID), Sugar Beet, and Sunflower datasets. Experimental results on carrot, sugar beet, and sunflower crop datasets demonstrate high Accuracy (99.09%), MIoU (81.02%), and F1-score (99.06%), with a modest model size (5.6 MB) and computational parameters (0.377 million). We developed a lightweight computer vision application (13.7 MB) to demonstrate the model’s efficacy on low-computational devices.

Background: The accurate classification between malignant and benign breast lesions detected on mammograms is a crucial but difficult challenge for reducing false-positive recall rates and improving the efficacy of breast cancer screening. Objective: This study aims to optimize a new deep transfer learning model by implementing a novel attention mechanism in order to improve the accuracy of breast lesion classification. Methods: ResNet50 is selected as the base model to develop a new deep transfer learning model. To enhance the accuracy of breast lesion classification, we propose adding a convolutional block attention module (CBAM) to the standard ResNet50 model and optimizing a new model for this task. We assembled a large dataset with 4280 mammograms depicting suspicious soft-tissue mass-type lesions. A region of interest (ROI) is extracted from each image based on lesion center. Among them, 2480 and 1800 ROIs depict verified benign and malignant lesions, respectively. The image dataset is randomly split into two subsets with a ratio of 9:1 five times to train and test two ResNet50 models with and without using CBAM. Results: Using the area under ROC curve (AUC) as an evaluation index, the new CBAM-based ResNet50 model yields AUC = 0.866 ± 0.015, which is significantly higher than that obtained by the standard ResNet50 model (AUC = 0.772 ± 0.008) (p < 0.01). Conclusion: This study demonstrates that although deep transfer learning technology attracted broad research interest in medical-imaging informatic fields, adding a new attention mechanism to optimize deep transfer learning models for specific application tasks can play an important role in further improving model performances.

Abstract— As cities become smarter, the need for real-time threat detection in surveillance systems increases. Firearm-related incidents in public areas are highly critical, where even a small delay can lead to serious consequences. In this study, we propose a deep- learning-based framework for firearm detection using the YOLOv7 model. To improve performance, we integrated a Convolutional Block Attention Module (CBAM) and a Bi-directional Feature Pyramid Network (BiFPN). The model was trained on a diverse dataset of 18,500 images and 6,200 negative samples to reduce false alarms. It achieves high accuracy with a 95.5% mAP@0.5 and operates at 48 FPS. The false-positive rate was reduced to 5.2%, which was significantly lower than the baseline. For real-world use, the system was optimized for NVIDIA Jetson Nano using pruning and INT8 TensorRT, enabling real-time performance at 28 frames per second (FPS). When a firearm is detected, the system sends instant alerts through MQTT to smart city platforms, allowing for a quick response and automation. Overall, this approach combines Deep Learning, Edge AI, and IoT to enable efficient and reliable real-time surveillance, thereby making smart environments safer. Keyword - Firearm Detection, YOLOv7, Deep Learning, Object Detection, Smart City Surveillance, Edge AI, CBAM, BiFPN, Real- Time Monitoring, IoT Security, NVIDIA Jetson Nano, TensorRT Optimization, MQTT Alerts, Computer Vision

A hybridized feature extraction for COVID-19 multi-class classification on computed tomography images