Error level driven attention guided ensembles models for accurate leather defect detection

The evolution and improvements of deep learning are being used to tackle any research obstacles that could be converted into classification problems in all spheres of life. Each Deep convolutional neural network (DCNN) design's output is determined by the depth and value of the hyperparameters, which explains why so many of them have been proposed. These DCNN architectures must be created entirely from scratch, and they can only be used for the applications for which they were intended. Transfer learning may be used to modify these pre-trained networks so they are more appropriate for particular purposes. This article aims to evaluate the empirical performance of the applicability of pre-trained DCNN models to identify human face presentation threats (FPAD). Human FPAD is one of the most significant and crucial areas of research right now because of the introduction of ambient computing, which necessitates contact-free identification of persons with the help of their biometric traits. Six pre-trained DCNN models are taken into account for an experimental evaluation in human FPAD alias VGG19, VGG16, DensNet121, MobileNet, Xception, and InceptionV3. The investigation makes use of the NUAA and Replay-Attack benchmark FPAD datasets. Thepade's sorted block truncation coding (SBTC) 10-ary features are merged with deep learning features produced from the finest performing finetuned DCNNs to enhance the FPAD capabilities of analyzed machine learning (ML) classifiers. The integration of features of Thepade's SBTC 10-ary and DCNN has considerably increased the FPAD accuracy of ML classifiers with slightly more computations of feature extraction.

Background Incidence rate of thyroid cancer is steadily increasing due to overdiagnosis and overtreatment. Thyroid ultrasound is commonly used to diagnose thyroid cancer. The aim of this study is to examine the accuracy of using deep convolutional neural network (DCNN) models to improve diagnosis of thyroid cancer by analyzing sonographic imaging data from clinical thyroid ultrasound. Methods A total of 131,731 sonographic images from 17,627 thyroid cancer patients and 180,668 sonographic images from 25,325 controls used as training set were obtained from Tianjin Cancer Hospital. Images from anatomical sites that did not have cancer according to location sign on the image were not included. All thyroid cancer patients and 13·2% of controls (51,255 images) were confirmed by pathological reports. DCNN is a specific type of neural network optimized for image recognition. We trained two DCNN models on the training set and subsequently evaluated the performance on one independent internal (Tianjin, 1,118 individuals) and two external (Jilin,154 individuals; Weihai, 1,420 individuals) validation sets. Individuals in the validation sets all have pathological examinations. We compared the specificity/sensitivity of DCNN models with the performance of six thyroid ultrasound radiologists on these three validation sets. Findings DCNN model achieved high performance in identifying thyroid cancer patients versus six experience radiologists: for Tianjin validation set, sensitivity was 92·2% versus 96·9% (95% CI 89·7% - 94·3% vs. 93·9% - 98·6%; p = 0·003), and specificity was 85·6% versus 59·4% (95% CI 82·4% - 88·4% vs. 53% - 65·6%; p < 0·0001); for Jilin validation set, sensitivity was 84·3% versus 92·9% (95% CI 73·6% - 91·9% vs. 84·1% - 97·6%; p = 0·05), and specificity was 86·9% versus 57·1% (95% CI 77·8% - 93·3% vs. 45·9% - 67·9%; p < 0·0001); for Weihai validation set, sensitivity was 84·5% versus 89% (95% CI 81·2% - 87·4% vs. 81·9% - 94%; p = 0·2), and specificity was 87·5% versus 68·6% (95% CI 85·1% - 89·6% vs. 60·7% - 75·8%; p < 0·0001). Interpretation DCNN models exhibited high accuracy, sensitivity, and specificity in identifying thyroid cancer patients at levels comparable to or higher than six experienced radiologists. Conferred by the high specificity of DCNN models, the rate of overdiagnosis and overtreatment of patients with thyroid cancer is expected to decrease. This supports future application of the deep learning models to clinical practice for thyroid cancer diagnosis. However, further validation of these DCNN models in prospective clinical trials is warranted. Funding The Program for Changjiang Scholars and Innovative Research Team in University in China (IRT_14R40), National Natural Science Foundation of China (31801117). Citation Format: Xiangchun Li, Sheng Zhang, Qiang Zhang, Xi Wei, Yi Pan, Jing Zhao, Xiaojie Xin, Xiaoqing Wang, Fan Yang, Jianxin Li, Meng Yang, Qinghua Wang, Xiangqian Zheng, Yanhui Zhao, Lun Zhang, Xudong Wang, Zhimin Zheng, Christopher T. Whitlow, Metin N. Gurcan, Boris Pasche, Ming Gao, Wei Zhang, Kexin Chen. Diagnosis of thyroid cancer using deep convolutional neural network models applied to sonographic images from clinical ultrasound exams [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2019; 2019 Mar 29-Apr 3; Atlanta, GA. Philadelphia (PA): AACR; Cancer Res 2019;79(13 Suppl):Abstract nr 1394.

Fine-grained visual categorization aims to distinguish objects in subordinate classes instead of basic class, and is a challenge visual task due to the high correlation between subordinated classes and large intra-class variation (e.g. different object poses). Although, deep convolutional neural network (DCNN) has brought dramatic success on generic object classification, detection and segmentation with the availability of the large-scale training samples, direct application of DCNN on fine-grained visual categorization, where only decades or at most hundreds of training samples for each subordinate class are available in most public finegrained image datasets, cannot lead to satisfactory classification results due to small number of training samples. This study explores the transfer learning strategy for finegrained dog breed categorization based on the learned CNN models with the large-scale image dataset: ImageNet, and prove promising performance with two DCNN models: AlexNet and VGG-16. Furthermore, we argue that different DCNN architecture may extract the representation of different image aspects due to the previously defined CNN kernel sizes, number and various operations in the model learning procedure, and thus result in different performance for visual categorization. This study proposes to fusion multiple CNN architectures for combining different aspect representations to give more accurate performance. We compressively study the fusion of different layers such as Fc6 and Fc7 in AlexNet and VGG-16, and manifest 2.88% improvement of the fusion architecture over the best performance of the only one DCNN model: VGG-16 from 81.2% to 84.08%.

Deep learning-based computed tomography applied to the diagnosis of rib fractures

Deep convolutional neural networks with ensemble learning and transfer learning for capacity estimation of lithium-ion batteries

The aim of the present study was to explore the diagnostic value of a deep convolutional neural network (DCNN) model for the diagnosis of pulmonary nodules in adolescent and young adult patients with osteosarcoma. For the present study, 675 chest CT images were retrospectively collected from 109 patients with clinically confirmed osteosarcoma who underwent chest CT examination at Hangzhou Third People's Hospital (Hangzhou, China) from March 2011 to February 2022. CT images were then evaluated using the DCNN and manual models. Subsequently, pulmonary nodules of osteosarcoma were divided into calcified nodules, solid nodules, partially solid nodules and ground glass nodules using the DCNN model. Those patients with osteosarcoma who were diagnosed and treated were followed up to observe dynamic changes in the pulmonary nodules. A total of 3,087 nodules were detected, while 278 nodules were missed compared with those determined using the reference standard given by the consensus of three Experienced radiologists., which was analyzed by two diagnostic radiologists. In the manual model group, 2,442 nodules were detected, while 657 nodules were missed. The DCNN model showed significantly higher sensitivity and specificity compared with the manual model (sensitivity, 0.923 vs. 0.908; specificity, 0.552 vs. 0.351; P<0.05). In addition, the DCNN model yielded an area under the curve (AUC) value of 0.795 [95% confidence interval (CI), 0.743-0.846], outperforming that of the manual model (AUC, 0.687; 95% CI, 0.629-0.732; P<0.05). The film reading time of the DCNN model was also significantly shorter compared with that of the manual model [mean ± standard deviation (SD); 173.25±24.10 vs. 328.32±22.72 sec; P<0.05)]. The AUC of calcified nodules, solid nodules, partially solid nodules and ground glass nodules was calculated to be 0.766, 0.771, 0.761 and 0.796, respectively, using the DCNN model. Using this model, the majority of the pulmonary nodules were detected in patients with osteosarcoma at the initial diagnosis (69/109, 62.3%), and the majority of these were found with multiple pulmonary nodules instead of a single nodule (71/109, 65.1% vs. 38/109, 34.9%). These data suggest that, compared with the manual model, the DCNN model proved to be beneficial for the detection of pulmonary nodules in adolescent and young adult patients with osteosarcoma, which may reduce the time of artificial radiograph reading. In conclusion, the proposed DCNN model, developed using data from 675 chest CT images retrospectively collected from 109 patients with clinically confirmed osteosarcoma, may be used as an effective tool to evaluate pulmonary nodules in patients with osteosarcoma.

Food crops are important for nations and human survival. Potatoes are one of the most widely used foods globally. But there are several diseases hampering potato growth and production as well. Traditional methods for diagnosing disease in potato leaves are based on human observations and laboratory tests which is a cumbersome and time-consuming task. The new age technologies such as artificial intelligence and deep learning can play a vital role in disease detection. This research proposed an optimized deep learning model to predict potato leaf diseases. The model is trained on a collection of potato leaf image datasets. The model is based on a deep convolutional neural network architecture which includes data augmentation, transfer learning, and hyper-parameter tweaking used to optimize the proposed model. Results indicate that the optimized deep convolutional neural network model has produced 99.22% prediction accuracy on Potato Disease Leaf Dataset.

Early and accurate identification of brain tumors is essential for determining effective treatment strategies and improving patient outcomes. Artificial intelligence (AI) and deep learning (DL) techniques have shown promise in automating diagnostic tasks based on magnetic resonance imaging (MRI). This study evaluates the performance of four pre-trained deep convolutional neural network (CNN) architectures for the automatic multi-class classification of brain tumors into four categories: Glioma, Meningioma, Pituitary, and No Tumor. The proposed approach utilizes the publicly accessible Brain Tumor MRI Msoud dataset, consisting of 7023 images, with 5712 provided for training and 1311 for testing. To assess the impact of data availability, subsets containing 25%, 50%, 75%, and 100% of the training data were used. A stratified five-fold cross-validation technique was applied. The CNN architectures evaluated include DeiT3_base_patch16_224, Xception41, Inception_v4, and Swin_Tiny_Patch4_Window7_224, all fine-tuned using transfer learning. The training pipeline incorporated advanced preprocessing and image data augmentation techniques to enhance robustness and mitigate overfitting. Among the models tested, Swin_Tiny_Patch4_Window7_224 achieved the highest classification Accuracy of 99.24% on the test set using 75% of the training data. This model demonstrated superior generalization across all tumor classes and effectively addressed class imbalance issues. Furthermore, we deployed and benchmarked the best-performing DL model on embedded AI platforms (Jetson AGX Xavier and Orin Nano), demonstrating their capability for real-time inference and highlighting their feasibility for edge-based clinical deployment. The results highlight the strong potential of pre-trained deep CNN and transformer-based architectures in medical image analysis. The proposed approach provides a scalable and energy-efficient solution for automated brain tumor diagnosis, facilitating the integration of AI into clinical workflows.

e18052 {\rtf1\ansi\ansicpg936\cocoartf1347\cocoasubrtf570 {\fonttbl\f0\froman\fcharset0 Times-Roman;\f1\fnil\fcharset0 Calibri;\f2\fswiss\fcharset0 Helvetica; \f3\fnil\fcharset134 STHeitiSC-Light;\f4\froman\fcharset0 TimesNewRomanPSMT;} {\colortbl;\red255\green255\blue255;\red0\green0\blue0;} \paperw11900\paperh16840\margl1440\margr1440\vieww25400\viewh13600\viewkind0 \deftab720 \pard\pardeftab720 \f0\fs24 \cf2 \expnd0\expndtw0\kerning0 \outl0\strokewidth0 \strokec2 AI platform in mammagraphy to screening breast cancer: a sole center experence. \f1\fs21 \cf0 \kerning1\expnd0\expndtw0 \outl0\strokewidth0 \ \pard\pardeftab720\ri714\qj \cf0 Background: The aim of this study was to use deep convolutional neural network (DCNN) to relieve radiologists ' burden and to minimize misses and interpretation errors of suspicious lesions at digital mammography. Methods: We developed and trained the DCNN model on the training set, then validated it in an internal validation set. The labeled data were used for training the DCNN model, and the mass detection, calcification detection and benign and malignant diagnosis were interpreted respectively. After verifying the feasibility of the DCNN model in the diagnosis of breast cancer, we gradually increased the number of cases in the training set and established the verification set to test the training results. The latest training sets include 21100 atlas of our hospital between April 2010 and October 2017, among which the malignant case atlas is 1774. Each atlas contains 2 ipsilateral mammography images. The verification set includes 1307 atlas, among which the malignant case atlas is 248. Results: The DCNN model achieved high performance in identifying breast cancer patients in the validation sets tested, with sensitivity of 98.02%, specificity of 91.86% \f3 \'a3\'ac \f2 and area under the curve values of 0.9813. As for mass detection, we reached a recall rate of 89.6% on the premise of lowing the false positive to 0.168%. For the latest clinical data between October 2018 and November 2018 including 1043 atlas from 576 patients, the sensitivity was 78.6% (95%CI 62.8-89.1) versus 90.5% (95%CI 76.5 \f4 - \f2 96.9; p=0.021) and specificity was 93.4% (95%CI 91.6 \f4 - \f2 94.8) versus 82.7% (95%CI 80.2 \f4 - \f2 85 \f4 . \f2 0; p&lt;0.0001). Conclusions: The DCNN model showed improved specificity in diagnosis breast cancer compared with a group of skilled radiologists. As the number of cases in the training set increases, the capacity of DCNN model will be further improved.

Data Analytic interpretation of plant species is not widely explored. The image variety of plant species can be investigated with the help of machine learning and deep learning techniques. Machine learning and deep learning make the plant species investigation automated and almost accurate. In this paper, we have proposed a novel native and invasive plant species classification technique. We use the pre-trained deep convolution neural networks (transfer learning) to extract features from plant species and classify them into Native and Invasive. Here, state-of-the-art deep convolution neural network models like InceptionV3, MobileNetV2, ResNetV2, VGG16, and Xception have been explored to extract the feature vectors from images. Furthermore, the features of the images have been used for image classification using the Random Forest algorithm. The performance of the proposed system is verified on the proposed dataset (Native-Invasive) with aerial view images of native and invasive species. Results were obtained using cross-validation techniques. Our experiments demonstrate the potential of our proposed method for achieving excellent performance with a 95% accuracy using Xception with data augmentation, hyper-parameter optimization, and the Random Forest classification technique. The aerial images were captured and labeled by us which is very novel to our experimental setup. After using deep learning models we got promising results. The dataset used to train the plant species classifier will be made available on request.KeywordsFeature extractionTransfer learningRandom ForestDeep learningImage classificationNative plant speciesInvasive plant species

Feature fusion methods have been demonstrated to be effective for many computer vision based applications. These methods generally use multiple hand-crafted features. However, in recent days, features extracted through transfer leaning procedures have been proved to be robust than the hand-crafted features in myriad applications, such as object classification and recognition. The transfer learning is a highly appreciated strategy in deep convolutional neural networks (DCNNs) due to its multifaceted benefits. It heartens us to explore the effect of fusing multiple transfer learning features of different DCNN architectures. Thus, in this work, we extract features of image statistics by exploiting three different pre-trained DCNNs through transfer learning. Then, we transform the features into a generalized subspace through a recently introduced Autoencoder network and fuse them to form intra-class invariant feature vector that is used to train a multi-class Support Vector Machine (SVM). The experimental results on various datasets, including object and action image statistics show that the fusion of multiple transfer learning features improves classification accuracy as compared to fusion of multiple hand-crafted features and usage of single component transfer learning features.

The diabetic foot ulcer (DFU) is a severe complication that affects approximately 33% of diabetes patients globally, often leading to limb amputation if not detected early. This study introduces an automated approach for identifying and classifying DFU using transfer learning. DFU is typically categorized into ischemic and infection states, which are challenging to distinguish visually. We evaluate the effectiveness of pretrained Deep Convolutional Neural Network (DCNN) models for autonomous DFU detection. Seven models are compared: EfficientNetB0, DenseNet121, ResNet101, VGG16, MobileNetV2, InceptionV3, and InceptionResNetV2. Additionally, we propose E-DFu-Net, a novel model derived from existing architectures, designed to mitigate overfitting. Experimental results demonstrate that E-DFu-Net achieves remarkable performance, with 97% accuracy in ischemia classification and 92% in infection classification. This advancement enhances current methodologies and aids practitioners in effectively detecting DFU cases.

CALENDAR

The theoretical basis of the discrete random sample batch classification is not clear and the sample division is not scientific during the process of Deep Convolutional Neural Network (DCNN) model training. Aiming at the problems above, starting from the DCNN detection recognition mechanism, the theory of random discrete samples is given and proved, and a scientific quantitative batch of sample input method is proposed. Combined with image preprocessing, based on the strategy of random dispersion of samples, and scientifically quantified sample input batches, the DCNN model is trained with limited label samples, and then the CT image recognition of pulmonary nodules is carried out. Experimental results based on the LIDC-ID-RI public dataset show that the sensitivity, specificity, and accuracy of the proposed method have reached 96.40%, 95.60%, and 96.00%, respectively. Compared with the multiscale convolutional neural network method and the multiscale multimode image fusion method, the recognition accuracy of the proposed method is improved by 1.6 and 3.49 percentage points, respectively.

Electricity theft is harmful to power grids. Integrating information flows with energy flows, smart grids can help to solve the problem of electricity theft owning to the availability of massive data generated from smart grids. The data analysis on the data of smart grids is helpful in detecting electricity theft because of the abnormal electricity consumption pattern of energy thieves. However, the existing methods have poor detection accuracy of electricity theft since most of them were conducted on one-dimensional (1-D) electricity consumption data and failed to capture the periodicity of electricity consumption. In this paper, we originally propose a novel electricity-theft detection method based on wide and deep convolutional neural networks (CNN) model to address the above concerns. In particular, wide and deep CNN model consists of two components: the wide component and the deep CNN component. The deep CNN component can accurately identify the nonperiodicity of electricity theft and the periodicity of normal electricity usage based on 2-D electricity consumption data. Meanwhile, the wide component can capture the global features of 1-D electricity consumption data. As a result, wide and deep CNN model can achieve the excellent performance in electricity-theft detection. Extensive experiments based on realistic dataset show that wide and deep CNN model outperforms other existing methods.