DeepTronic: An Electronic Device Classification Model using Deep Convolutional Neural Networks

Convolutional neural network with transfer learning approach for detection of unfavorable driving state using phase coherence image

Tumor Segmentation in Intraoperative Fluorescence Images Based on Transfer Learning and Convolutional Neural Networks.

Integrated digital image processing techniques and deep learning approaches for wheat stripe rust disease detection and grading

This study aimed to compare the axial cranial ultrasound images of normal and open neural tube defect (NTD) fetuses using a deep learning (DL) model and to assess its predictive accuracy in identifying open NTD.It was a prospective case-control study. Axial trans-thalamic fetal ultrasound images of participants with open fetal NTD and normal controls between 14 and 28 weeks of gestation were taken after consent. The images were divided into training, testing, and validation datasets randomly in the ratio of 70:15:15. The images were further processed and classified using DL convolutional neural network (CNN) transfer learning (TL) models. The TL models were trained for 50 epochs. The data was analyzed in terms of Cohen kappa score, accuracy score, area under receiver operating curve (AUROC) score, F1 score validity, sensitivity, and specificity of the test.A total of 59 cases and 116 controls were fully followed. Efficient net B0, Visual Geometry Group (VGG), and Inception V3 TL models were used. Both Efficient net B0 and VGG16 models gave similar high training and validation accuracy (100 and 95.83%, respectively). Using inception V3, the training and validation accuracy was 98.28 and 95.83%, respectively. The sensitivity and specificity of Efficient NetB0 was 100 and 89%, respectively, and was the best.The analysis of the changes in axial images of the fetal cranium using the DL model, Efficient Net B0 proved to be an effective model to be used in clinical application for the identification of open NTD. · Open spina bifida is often missed due to the nonrecognition of the lemon sign on ultrasound.. · Image classification using DL identified open spina bifida with excellent accuracy.. · The research is clinically relevant in low- and middle-income countries..

COVID-19 is highly infectious and causes acute respiratory disease. Machine learning (ML) and deep learning (DL) models are vital in detecting disease from computerized chest tomography (CT) scans. The DL models outperformed the ML models. For COVID-19 detection from CT scan images, DL models are used as end-to-end models. Thus, the performance of the model is evaluated for the quality of the extracted feature and classification accuracy. There are four contributions included in this work. First, this research is motivated by studying the quality of the extracted feature from the DL by feeding these extracted to an ML model. In other words, we proposed comparing the end-to-end DL model performance against the approach of using DL for feature extraction and ML for the classification of COVID-19 CT scan images. Second, we proposed studying the effect of fusing extracted features from image descriptors, e.g., Scale-Invariant Feature Transform (SIFT), with extracted features from DL models. Third, we proposed a new Convolutional Neural Network (CNN) to be trained from scratch and then compared to the deep transfer learning on the same classification problem. Finally, we studied the performance gap between classic ML models against ensemble learning models. The proposed framework is evaluated using a CT dataset, where the obtained results are evaluated using five different metrics The obtained results revealed that using the proposed CNN model is better than using the well-known DL model for the purpose of feature extraction. Moreover, using a DL model for feature extraction and an ML model for the classification task achieved better results in comparison to using an end-to-end DL model for detecting COVID-19 CT scan images. Of note, the accuracy rate of the former method improved by using ensemble learning models instead of the classic ML models. The proposed method achieved the best accuracy rate of 99.39%.

Cotton is one of the most important agricultural products and is closely linked to the economic development of Pakistan. However, the cotton plant is susceptible to bacterial and viral diseases that can quickly spread and damage plants and ultimately affect the cotton yield. The automated and early detection of affected plants can significantly reduce the potential spread of the disease. This paper presents the implementation and performance analysis of bacterial blight and curl virus disease detection in cotton crops through deep learning techniques. The automated disease detection is performed through transfer learning of six pre-trained deep learning models, namely DenseNet121, DenseNet169, MobileNetV2, ResNet50V2, VGG16, and VGG19. A total of 1362 images of local agricultural fields and 1292 images from online resources were used to train and validate the models. Image augmentation techniques were performed to increase the dataset diversity and size. Transfer learning was implemented for different image resolutions ranging from 32×32 to 256×256 pixels. Performance metrics such as accuracy, precision, recall, F1 Score, and prediction time were evaluated for each implemented model. The results indicate higher accuracy, up to 96%, for DenseNet169 and ResNet50V2 models when trained on the 256×256 pixels image dataset. The lowest accuracy, 52%, was obtained by the MobileNetV2 model when trained on low-resolution, 32×32, images. The confusion matrix analysis indicates the true-positive prediction rates higher than 91% for fresh leaves, 87% for bacterial blight, and 76% for curl virus detection for all implemented models when trained and tested on an image dataset of 128×128 pixels or higher resolution.

In dairy herd management, it is significant and irreplaceable for veterinarians to make rapid and effective diagnosis of dairy cow diseases. Based on electronic medical records, deep learning (DL) has been widely used to support clinical decisions for humans. However, this method is rarely adopted in veterinary diagnosis. In addition, most DL models are driven by large datasets, failing to utilize the knowledge acquired by veterinarians in subjective experience, which is critical to disease diagnosis. To address these problems, this paper proposes a DL method for disease diagnosis of dairy cow: convolutional neural network (CNN) based on knowledge graph and transfer learning (KGTL_CNN). Firstly, the structural knowledge was extracted from a knowledge graph of dairy cow diseases, and treated as part of the inputs to the CNN based on knowledge graph (KG_CNN). Then, the model performance was enhanced through pre-training by transfer learning. To verify its performance, experiments were carried out on dairy cow clinical datasets. The results show that our model performed satisfactorily on disease diagnosis: the KG_CNN and KGTL_CNN achieved an F1-score of 85.87% and 86.77%, respectively, higher than that of typical CNN by 6.58% and 7.7%. The research results greatly promote the effective, fast, and automatic clinical diagnosis of dairy cow diseases.

With the increasing integration of artificial intelligence (AI) in several scientific domains, there is a rising demand for advanced AI tools capable of addressing advanced research challenges. A challenge of paramount importance lies in accurately predicting the streamflow within river basins. Effective river flow prediction holds significant relevance, particularly given the substantial societal implications of river usage, encompassing areas such as transportation, agriculture, and power generation. The present study introduces a novel approach to streamflow prediction involving the development of a Deep Learning (DL) model that combines a convolutional neural network with Transfer Learning (TL) techniques to predict streamflow in river systems. With the aim of training the developed DL model, the study employed a time-series dataset containing hydrological data related to two distinct river basins, i.e., Paraíba do Sul, in Brazil, and Zambezi in the state of Mozambique. The developed DL models exhibited the capability to effectively predict the river flow with a one-day horizon, relying on the preceding three or seven days of historical data. To overcome the limited availability of training data and reduce the training time of DL models, TL was leveraged to incorporate two additional distinct time-series datasets, i.e., historical streamflow data from the São Francisco River in Brazil, and climate data from Delhi, India. The application of TL significantly reduced training time, leading only to a minimal decrease in prediction performance. Indeed, in the case DL models were trained on data collected from the Paraíba do Sul River, a substantial reduction in training time was observed - up to 27% - with a modest percentage decrease of 0.31% in test predictive performance (). Similarly, TL induced a significant reduction in training time of up to 48%, while resulting in a modest 2% reduction in test predictive performance () for the Zambezi dataset. The findings underscore the significance of TL as a strategic and viable approach to improve the efficiency of river flow prediction models in the context of basins with limited hydrological data available.

Research in many fields has shown that transfer learning (TL) is well-suited to improve the performance of deep learning (DL) models in datasets with small numbers of samples. This empirical success has triggered interest in the application of TL to cognitive decoding analyses with functional neuroimaging data. Here, we systematically evaluate TL for the application of DL models to the decoding of cognitive states (e.g., viewing images of faces or houses) from whole-brain functional Magnetic Resonance Imaging (fMRI) data. We first pre-train two DL architectures on a large, public fMRI dataset and subsequently evaluate their performance in an independent experimental task and a fully independent dataset. The pre-trained DL models consistently achieve higher decoding accuracies and generally require less training time and data than model variants that were not pre-trained, while also outperforming linear baseline models trained from scratch, clearly underlining the benefits of pre-training. We demonstrate that these benefits arise from the ability of the pre-trained models to reuse many of their learned features when training with new data, providing deeper insights into the mechanisms giving rise to the benefits of pre-training. Yet, we also surface nuanced challenges for whole-brain cognitive decoding with DL models when interpreting the decoding decisions of the pre-trained models, as these have learned to utilize the fMRI data in unforeseen and counterintuitive ways to identify individual cognitive states.

Application of transfer learning and image augmentation technology for tomato pest identification

Electricity load forecasting is a crucial undertaking within all the deregulated markets globally. Among the research challenges on a global scale, the investigation of deep transfer learning (DTL) in the field of electricity load forecasting represents a fundamental effort that can inform artificial intelligence applications in general. In this paper, a comprehensive study is reported regarding day-ahead electricity load forecasting. For this purpose, three sequence-to-sequence (Seq2seq) deep learning (DL) models are used, namely the multilayer perceptron (MLP), the convolutional neural network (CNN) and the ensemble learning model (ELM), which consists of the weighted combination of the outputs of MLP and CNN models. Also, the study focuses on the development of different forecasting strategies based on DTL, emphasizing the way the datasets are trained and fine-tuned for higher forecasting accuracy. In order to implement the forecasting strategies using deep learning models, load datasets from three Greek islands, Rhodes, Lesvos, and Chios, are used. The main purpose is to apply DTL for day-ahead predictions (1–24 h) for each month of the year for the Chios dataset after training and fine-tuning the models using the datasets of the three islands in various combinations. Four DTL strategies are illustrated. In the first strategy (DTL Case 1), each of the three DL models is trained using only the Lesvos dataset, while fine-tuning is performed on the dataset of Chios island, in order to create day-ahead predictions for the Chios load. In the second strategy (DTL Case 2), data from both Lesvos and Rhodes concurrently are used for the DL model training period, and fine-tuning is performed on the data from Chios. The third DTL strategy (DTL Case 3) involves the training of the DL models using the Lesvos dataset, and the testing period is performed directly on the Chios dataset without fine-tuning. The fourth strategy is a multi-task deep learning (MTDL) approach, which has been extensively studied in recent years. In MTDL, the three DL models are trained simultaneously on all three datasets and the final predictions are made on the unknown part of the dataset of Chios. The results obtained demonstrate that DTL can be applied with high efficiency for day-ahead load forecasting. Specifically, DTL Case 1 and 2 outperformed MTDL in terms of load prediction accuracy. Regarding the DL models, all three exhibit very high prediction accuracy, especially in the two cases with fine-tuning. The ELM excels compared to the single models. More specifically, for conducting day-ahead predictions, it is concluded that the MLP model presents the best monthly forecasts with MAPE values of 6.24% and 6.01% for the first two cases, the CNN model presents the best monthly forecasts with MAPE values of 5.57% and 5.60%, respectively, and the ELM model achieves the best monthly forecasts with MAPE values of 5.29% and 5.31%, respectively, indicating the very high accuracy it can achieve.

PurposeTuberculosis (TB) is a severe bacterial infectious lung disease. Millions of people die or experience severe health complications due to TB each year. Accurate, automated, and effective detection of TB is key to curing and preventing person-to-person transmission. In this regard, deep learning (DL) and machine learning (ML) techniques applied to chest X-ray (CXR) images have proved effective. Here, we present our DL- and ML-based approach for TB detection using CXR images.Material and methodsWe implemented convolutional neural network (CNN)-based pre-trained DL models, such as DenseNet121, DenseNet169, DenseNet201, ResNet152, and VGG19, as feature extractors. ML models, including support vector machine (SVM), XGBoost, logistic regression, and a DL-based custom model, were used as classifiers. A total of 2,391 CXR images from three publicly available datasets were considered.ResultsWe found three models achieving the highest value in different evaluation metrics: accuracy (99.91%) with ResNet152 and SVM; recall (99.22%), precision (99.23%), and F1-score (99.22%) with DenseNet169 and the custom classifier; and area under the curve (99.99%) with DenseNet201 and the custom classifier. Among these models, we propose DenseNet169 with the custom classifier as the best performer for potential clinical application, as it reflected a high and well-balanced performance across all evaluation metrics.ConclusionsThis study evaluated pre-trained CNN-based DL and ML models on pre-processed CXR images for the detection of TB. The DenseNet169 model with a custom classifier stands out with its high and well-balanced performance, offering a significant contribution to the effective and automated detection of TB.

Mammography is a gold standard imaging modality and is widely used for breast cancer screening. With recent advances in the field of deep learning, the use of deep convolution neural networks (CNNs) in medical image analysis has become very encouraging. The aim of this study is to exploit CNNs for mass detection in mammograms using pre-trained networks. We use the resnet-50 CNN architecture pre-trained with the ImageNet database to perform mass detection on two publicly available image datasets: CBIS-DDSM and INbreast. We demonstrate that the CNN model pretrained using natural image database (ImageNet) can be effectively finetuned to yield better results, compared to randomly initialized models. Further, the benefit of applying transfer learning on a smaller dataset is demonstrated by using the best model obtained from CBIS-DDSM training to finetune on the INbreast database. We analyzed the adaptability of the CNN’s last fully connected (FC) layer and the all convolutional layers to detect masses. The results showed a testing accuracy of 0.92 and an area under the receiver operating characteristic curve (AUC) of 0.98 for the model finetuned on all convolutional layers, while testing accuracy of 0.86 and AUC=0.93 when the model is trained only on the last FC layer.

Human gait recognition (HGR) has been employed as a biometric technique for security purposes over the last decade. Various factors, including clothing, carrying items, and walking surfaces, can influence the performance of gait recognition. Additionally, identifying individuals from different viewpoints presents a significant challenge in HGR. Numerous conventional and deep learning techniques have been introduced in the literature for HGR, but traditional methods are not well suited to handling large datasets. This research explores the effectiveness of four deep learning models for gait identification in the CASIA B dataset: the convolutional neural network (CNN), multi-layer perceptron (MLP), self-organizing map (SOMs), and transfer learning with EfficientNet. The selected deep learning techniques offer robust feature extraction and the efficient handling of large datasets, making them ideal in enhancing the accuracy of gait recognition. The collection includes gait sequences from 10 individuals, with a total of 92,596 images that have been reduced to 64 × 64 pixels for uniformity. A modified model was developed by integrating sequential convolutional layers for detailed spatial feature extraction, followed by dense layers for classification, optimized through rigorous hyperparameter tuning and regularization techniques, resulting in an accuracy of 97.12% for the test set. This work enhances our understanding of deep learning methods in gait analysis, offering significant insights for choosing optimal models in security and surveillance applications.

An experimental study on classification of thyroid histopathology images using transfer learning