Optimized Deep Learning Model for Disease Prediction in Potato Leaves

Background Incidence rate of thyroid cancer is steadily increasing due to overdiagnosis and overtreatment. Thyroid ultrasound is commonly used to diagnose thyroid cancer. The aim of this study is to examine the accuracy of using deep convolutional neural network (DCNN) models to improve diagnosis of thyroid cancer by analyzing sonographic imaging data from clinical thyroid ultrasound. Methods A total of 131,731 sonographic images from 17,627 thyroid cancer patients and 180,668 sonographic images from 25,325 controls used as training set were obtained from Tianjin Cancer Hospital. Images from anatomical sites that did not have cancer according to location sign on the image were not included. All thyroid cancer patients and 13·2% of controls (51,255 images) were confirmed by pathological reports. DCNN is a specific type of neural network optimized for image recognition. We trained two DCNN models on the training set and subsequently evaluated the performance on one independent internal (Tianjin, 1,118 individuals) and two external (Jilin,154 individuals; Weihai, 1,420 individuals) validation sets. Individuals in the validation sets all have pathological examinations. We compared the specificity/sensitivity of DCNN models with the performance of six thyroid ultrasound radiologists on these three validation sets. Findings DCNN model achieved high performance in identifying thyroid cancer patients versus six experience radiologists: for Tianjin validation set, sensitivity was 92·2% versus 96·9% (95% CI 89·7% - 94·3% vs. 93·9% - 98·6%; p = 0·003), and specificity was 85·6% versus 59·4% (95% CI 82·4% - 88·4% vs. 53% - 65·6%; p < 0·0001); for Jilin validation set, sensitivity was 84·3% versus 92·9% (95% CI 73·6% - 91·9% vs. 84·1% - 97·6%; p = 0·05), and specificity was 86·9% versus 57·1% (95% CI 77·8% - 93·3% vs. 45·9% - 67·9%; p < 0·0001); for Weihai validation set, sensitivity was 84·5% versus 89% (95% CI 81·2% - 87·4% vs. 81·9% - 94%; p = 0·2), and specificity was 87·5% versus 68·6% (95% CI 85·1% - 89·6% vs. 60·7% - 75·8%; p < 0·0001). Interpretation DCNN models exhibited high accuracy, sensitivity, and specificity in identifying thyroid cancer patients at levels comparable to or higher than six experienced radiologists. Conferred by the high specificity of DCNN models, the rate of overdiagnosis and overtreatment of patients with thyroid cancer is expected to decrease. This supports future application of the deep learning models to clinical practice for thyroid cancer diagnosis. However, further validation of these DCNN models in prospective clinical trials is warranted. Funding The Program for Changjiang Scholars and Innovative Research Team in University in China (IRT_14R40), National Natural Science Foundation of China (31801117). Citation Format: Xiangchun Li, Sheng Zhang, Qiang Zhang, Xi Wei, Yi Pan, Jing Zhao, Xiaojie Xin, Xiaoqing Wang, Fan Yang, Jianxin Li, Meng Yang, Qinghua Wang, Xiangqian Zheng, Yanhui Zhao, Lun Zhang, Xudong Wang, Zhimin Zheng, Christopher T. Whitlow, Metin N. Gurcan, Boris Pasche, Ming Gao, Wei Zhang, Kexin Chen. Diagnosis of thyroid cancer using deep convolutional neural network models applied to sonographic images from clinical ultrasound exams [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2019; 2019 Mar 29-Apr 3; Atlanta, GA. Philadelphia (PA): AACR; Cancer Res 2019;79(13 Suppl):Abstract nr 1394.

The evolution and improvements of deep learning are being used to tackle any research obstacles that could be converted into classification problems in all spheres of life. Each Deep convolutional neural network (DCNN) design's output is determined by the depth and value of the hyperparameters, which explains why so many of them have been proposed. These DCNN architectures must be created entirely from scratch, and they can only be used for the applications for which they were intended. Transfer learning may be used to modify these pre-trained networks so they are more appropriate for particular purposes. This article aims to evaluate the empirical performance of the applicability of pre-trained DCNN models to identify human face presentation threats (FPAD). Human FPAD is one of the most significant and crucial areas of research right now because of the introduction of ambient computing, which necessitates contact-free identification of persons with the help of their biometric traits. Six pre-trained DCNN models are taken into account for an experimental evaluation in human FPAD alias VGG19, VGG16, DensNet121, MobileNet, Xception, and InceptionV3. The investigation makes use of the NUAA and Replay-Attack benchmark FPAD datasets. Thepade's sorted block truncation coding (SBTC) 10-ary features are merged with deep learning features produced from the finest performing finetuned DCNNs to enhance the FPAD capabilities of analyzed machine learning (ML) classifiers. The integration of features of Thepade's SBTC 10-ary and DCNN has considerably increased the FPAD accuracy of ML classifiers with slightly more computations of feature extraction.

The leather industry plays a crucial role in the production of high-quality leather products to remain competitive in the market. Due to various reasons such as material handling and turning, leather defects can appear at different stages of the production process. This paper proposed deep learning techniques, specifically transfer learning, deep convolutional neural networks (D-CNN), and ensemble learning for automating leather defect detection and classification. The dataset was taken from the open source Kaggle. The dataset was preprocessed from the beginning. However, we performed Error Level Analysis (ELA) to detect possible changes or fraud in the image. We also used data augmentation techniques (resizing, rescaling, flipping, rotation, zooming, and contrasting) on the dataset to improve the model performance. This study investigated deep learning architectures for automatic leather defect detection, comparing them with seven deep convolutional neural networks (D-CNN) models and transfer learning architectures. Furthermore, we introduce and evaluate two novel ensemble models: MER built on transfer learning architecture (MobileNetV2, EfficientNetB0, and ResNet50) and AZL built on D-CNN architecture (AlexNet, ZfNet, and LeNet). A key contribution of this study is the demonstration of significant performance improvements achieved by strategically integrating squeeze and excitation and label smoothing techniques into transfer learning, D-CNN, and ensemble frameworks. Our proposed MER ensemble method achieves a state-of-the-art of 96.39% for leather defect detection. The proposed model was evaluated using performance metrics including precision, recall, F1-score, AUC, ROC, and Matthews Correlation Coefficient (MCC). Additionally, Grad-CAM was employed for explainable AI to visualize and interpret the model’s decision-making process. Comparative analysis against separate transfer learning and D-CNN models fails to establish the superior performance of our MER ensemble, which highlights the potential to significantly advance automated quality inspection in leather production. This study provides insights into evaluating the best deep learning techniques for leather defect classification, paving the way for more accurate, efficient, and reliable industrial applications. Proposes a robust deep learning-based framework for automated leather defect detection using transfer learning, deep CNNs, and two novel ensemble models (MER and AZL), enhanced with squeeze-and-excitation and label smoothing techniques. Achieves state-of-the-art performance with the proposed MER ensemble model, achieve 96.39% accuracy, and demonstrates superior results across precision, recall, F1-score, AUC–ROC, and MCC. Integrates Error Level Analysis (ELA), extensive data augmentation, and Grad-CAM–based explainable AI to ensure data reliability, improve generalization, and provide transparent visual interpretation of defect regions for industrial quality inspection.

Electricity theft is harmful to power grids. Integrating information flows with energy flows, smart grids can help to solve the problem of electricity theft owning to the availability of massive data generated from smart grids. The data analysis on the data of smart grids is helpful in detecting electricity theft because of the abnormal electricity consumption pattern of energy thieves. However, the existing methods have poor detection accuracy of electricity theft since most of them were conducted on one-dimensional (1-D) electricity consumption data and failed to capture the periodicity of electricity consumption. In this paper, we originally propose a novel electricity-theft detection method based on wide and deep convolutional neural networks (CNN) model to address the above concerns. In particular, wide and deep CNN model consists of two components: the wide component and the deep CNN component. The deep CNN component can accurately identify the nonperiodicity of electricity theft and the periodicity of normal electricity usage based on 2-D electricity consumption data. Meanwhile, the wide component can capture the global features of 1-D electricity consumption data. As a result, wide and deep CNN model can achieve the excellent performance in electricity-theft detection. Extensive experiments based on realistic dataset show that wide and deep CNN model outperforms other existing methods.

BackgroundSurgical process modeling automatically identifies surgical phases, and further improvement in recognition accuracy is expected with deep learning. Surgical tool or time series information has been used to improve the recognition accuracy of a model. However, it is difficult to collect this information continuously intraoperatively. The present study aimed to develop a deep convolution neural network (CNN) model that correctly identifies the surgical phase during laparoscopic cholecystectomy (LC).MethodsWe divided LC into six surgical phases (P1–P6) and one redundant phase (P0). We prepared 115 LC videos and converted them to image frames at 3 fps. Three experienced doctors labeled the surgical phases in all image frames. Our deep CNN model was trained with 106 of the 115 annotation datasets and was evaluated with the remaining datasets. By depending on both the prediction probability and frequency for a certain period, we aimed for highly accurate surgical phase recognition in the operation room.ResultsNine full LC videos were converted into image frames and were fed to our deep CNN model. The average accuracy, precision, and recall were 0.970, 0.855, and 0.863, respectively.ConclusionThe deep learning CNN model in this study successfully identified both the six surgical phases and the redundant phase, P0, which may increase the versatility of the surgical process recognition model for clinical use. We believe that this model can be used in artificial intelligence for medical devices. The degree of recognition accuracy is expected to improve with developments in advanced deep learning algorithms.

The aim of the present study was to explore the diagnostic value of a deep convolutional neural network (DCNN) model for the diagnosis of pulmonary nodules in adolescent and young adult patients with osteosarcoma. For the present study, 675 chest CT images were retrospectively collected from 109 patients with clinically confirmed osteosarcoma who underwent chest CT examination at Hangzhou Third People's Hospital (Hangzhou, China) from March 2011 to February 2022. CT images were then evaluated using the DCNN and manual models. Subsequently, pulmonary nodules of osteosarcoma were divided into calcified nodules, solid nodules, partially solid nodules and ground glass nodules using the DCNN model. Those patients with osteosarcoma who were diagnosed and treated were followed up to observe dynamic changes in the pulmonary nodules. A total of 3,087 nodules were detected, while 278 nodules were missed compared with those determined using the reference standard given by the consensus of three Experienced radiologists., which was analyzed by two diagnostic radiologists. In the manual model group, 2,442 nodules were detected, while 657 nodules were missed. The DCNN model showed significantly higher sensitivity and specificity compared with the manual model (sensitivity, 0.923 vs. 0.908; specificity, 0.552 vs. 0.351; P<0.05). In addition, the DCNN model yielded an area under the curve (AUC) value of 0.795 [95% confidence interval (CI), 0.743-0.846], outperforming that of the manual model (AUC, 0.687; 95% CI, 0.629-0.732; P<0.05). The film reading time of the DCNN model was also significantly shorter compared with that of the manual model [mean ± standard deviation (SD); 173.25±24.10 vs. 328.32±22.72 sec; P<0.05)]. The AUC of calcified nodules, solid nodules, partially solid nodules and ground glass nodules was calculated to be 0.766, 0.771, 0.761 and 0.796, respectively, using the DCNN model. Using this model, the majority of the pulmonary nodules were detected in patients with osteosarcoma at the initial diagnosis (69/109, 62.3%), and the majority of these were found with multiple pulmonary nodules instead of a single nodule (71/109, 65.1% vs. 38/109, 34.9%). These data suggest that, compared with the manual model, the DCNN model proved to be beneficial for the detection of pulmonary nodules in adolescent and young adult patients with osteosarcoma, which may reduce the time of artificial radiograph reading. In conclusion, the proposed DCNN model, developed using data from 675 chest CT images retrospectively collected from 109 patients with clinically confirmed osteosarcoma, may be used as an effective tool to evaluate pulmonary nodules in patients with osteosarcoma.

The diabetic foot ulcer (DFU) is a severe complication that affects approximately 33% of diabetes patients globally, often leading to limb amputation if not detected early. This study introduces an automated approach for identifying and classifying DFU using transfer learning. DFU is typically categorized into ischemic and infection states, which are challenging to distinguish visually. We evaluate the effectiveness of pretrained Deep Convolutional Neural Network (DCNN) models for autonomous DFU detection. Seven models are compared: EfficientNetB0, DenseNet121, ResNet101, VGG16, MobileNetV2, InceptionV3, and InceptionResNetV2. Additionally, we propose E-DFu-Net, a novel model derived from existing architectures, designed to mitigate overfitting. Experimental results demonstrate that E-DFu-Net achieves remarkable performance, with 97% accuracy in ischemia classification and 92% in infection classification. This advancement enhances current methodologies and aids practitioners in effectively detecting DFU cases.

Deep learning-based computed tomography applied to the diagnosis of rib fractures

Armed conflicts and guerrilla warfare in different geographical locations have caused great trouble to the communities living in respective territories and affected thousands of human lives in the past. Undiscovered land-mines and explosive devices buried in remote areas are still a big threat as most of such anti-personnel mines are hard to detect with conventional methods owing to their improvisational nature of build and assembly and lack of data. In this paper, a methodological workflow is presented to classify and detect such improvised explosive devices (IEDs) using machine learning by virtue of a Ground Penetrating Radar (GPR) based simulator-driven dataset of mines, while targeting Xilinx MPSoC FPGA device. For enabling on-field embedded deployment of machine learning models, certain deep convolutional neural network architectures and models are trained, quantized and compiled for Xilinx Deep-Learning Processing Unit (DPU) on a Zynq UltraScale+ MPSoC ZU3EG. Experiments yield a maximum hardware deployed model accuracy of 89.46%, maximum precision of 95.21% and a recall of 85.28% for InceptionV3. Whereas, MobileNet with a comparatively lower accuracy of 84.35%, provided the best latency of 7.94 ms for inferencing a single image on DPU as compared to InceptionV3 which required 27.03 ms. Such an embedded setup to detect aforementioned type of land-mines is intended to render the possibility of mobility e.g. either for hand-held devices with GPR sensors or similar arrangements on mobile platforms such as autonomous robots.

Interstitial lung disease (ILD) refers to a group of various abnormal inflammations of lung tissues and early diagnosis of these disease patterns is crucial for the treatment. Yet it is difficult to make an accurate diagnosis due to the similarity among the clinical manifestations of these diseases. In order to assist the radiologists, computer-aided diagnosis systems have been developed. Besides, the potential of deep convolutional neural networks (CNNs) is also expected to exert on the medical image analysis in recent years. In this paper, we design a new deep convolutional neural network (CNN) architecture to achieve the classification task of ILD patterns. Furthermore, we also propose a novel two-stage transfer learning (TSTL) method to deal with the problem of the lack of training data, which leverages the knowledge learned from sufficient textural source data and auxiliary unlabeled lung CT data to the target domain. We adopt the unsupervised manner to learn the unlabeled data, by which the objective function composed of the prediction confidence and mutual information are optimized. The experimental results show that our proposed CNN architecture achieves desirable performance and outperforms most of the state-of-the-art ones. The comparative analysis demonstrates the promising feasibility and advantages of the proposed two-stage transfer learning strategy as well as the potential of the knowledge learning from lung CT data. Graphical Abstract The framework of the proposed two-stage transfer learning method.

For the purpose of applying information technology to the creation of ink style painting, the algorithm of ink painting rendering based on the deep learning framework and convolutional neural network model is designed and improved. Firstly, the ink style rendering program is written in Python. Secondly, VGG under Caffe architecture and Illustration 2Vec models are transplanted to TensorFlow architecture, and the image is rendered in ink style based on deep learning framework and convolutional neural network model. Finally, based on Node.js, the server-side program for image ink style rendering is built. Among them, Express is adopted as the Web-side framework, and the front-end page effect is completed. The results show that the ink rendering logic program is applicable, and the expected purpose is achieved.

CALENDAR

Fine-grained visual categorization aims to distinguish objects in subordinate classes instead of basic class, and is a challenge visual task due to the high correlation between subordinated classes and large intra-class variation (e.g. different object poses). Although, deep convolutional neural network (DCNN) has brought dramatic success on generic object classification, detection and segmentation with the availability of the large-scale training samples, direct application of DCNN on fine-grained visual categorization, where only decades or at most hundreds of training samples for each subordinate class are available in most public finegrained image datasets, cannot lead to satisfactory classification results due to small number of training samples. This study explores the transfer learning strategy for finegrained dog breed categorization based on the learned CNN models with the large-scale image dataset: ImageNet, and prove promising performance with two DCNN models: AlexNet and VGG-16. Furthermore, we argue that different DCNN architecture may extract the representation of different image aspects due to the previously defined CNN kernel sizes, number and various operations in the model learning procedure, and thus result in different performance for visual categorization. This study proposes to fusion multiple CNN architectures for combining different aspect representations to give more accurate performance. We compressively study the fusion of different layers such as Fc6 and Fc7 in AlexNet and VGG-16, and manifest 2.88% improvement of the fusion architecture over the best performance of the only one DCNN model: VGG-16 from 81.2% to 84.08%.

Automated image classification is an essential task of the computer vision field. The tagging of images into a set of predefined groups is referred to as image classification. The implementation of computer vision to automate image classification would be beneficial because manual image evaluation and identification can be time-consuming, particularly when there are many images of different classes. Deep learning approaches are proven to overperform existing machine learning techniques in many fields in recent years, and computer vision is one of the most notable examples. The very deep neural network (VDCNN) is a powerful deep learning model for image classification, and this paper examines it briefly using MNIST handwritten digit dataset. This dataset is used to prove the efficacy of very deep neural networks over other deep learning models. The proposed study aims to comprehend the very deep neural network architecture used to accomplish a handwritten digit recognition task. The feasibility of the proposed model is evaluated using mean accuracy, validation accuracy, and standard deviation. The study results of the very deep neural network model are compared to a convolutional neural network and convolutional neural network with batch normalization. According to the results of the comparison study, very deep neural networks achieve high accuracy of 99.1% for a handwritten dataset. The outcome of the proposed work is used to interpret how well a very deep neural network performs when compared to the other two models of deep neural networks. This proposed architecture may be used to automate the classification of handwritten digits dataset.

Recent studies have demonstrated that a well designed deep convolutional neural network (CNN) model achieves competitive performances on detecting the presence of secret message in digital images, compared with the classical rich model based steganalysis. In this paper, we propose to investigate a category of very deep CNN model–the deep residual network (DRN), for steganalysis. DRN is suitable for steganalysis from two aspects. For the first, the DRN model usually contains a large number of network layers, which proves to be effective to capture the complex statistics of digital images. For the second, DRN's residual learning (ResL) method actively strengthens the signal coming from secret messages, which is extremely beneficial for the discrimination between cover images and stego images. Comprehensive experiments on standard dataset show that the DRN model achieves very low detection error rates for the state of arts steganographic algorithms. It also outperforms the classical rich model method and several recently proposed CNN based methods.