Bayesian deep learning applied to diabetic retinopathy with uncertainty quantification.

COVID-19 is highly infectious and causes acute respiratory disease. Machine learning (ML) and deep learning (DL) models are vital in detecting disease from computerized chest tomography (CT) scans. The DL models outperformed the ML models. For COVID-19 detection from CT scan images, DL models are used as end-to-end models. Thus, the performance of the model is evaluated for the quality of the extracted feature and classification accuracy. There are four contributions included in this work. First, this research is motivated by studying the quality of the extracted feature from the DL by feeding these extracted to an ML model. In other words, we proposed comparing the end-to-end DL model performance against the approach of using DL for feature extraction and ML for the classification of COVID-19 CT scan images. Second, we proposed studying the effect of fusing extracted features from image descriptors, e.g., Scale-Invariant Feature Transform (SIFT), with extracted features from DL models. Third, we proposed a new Convolutional Neural Network (CNN) to be trained from scratch and then compared to the deep transfer learning on the same classification problem. Finally, we studied the performance gap between classic ML models against ensemble learning models. The proposed framework is evaluated using a CT dataset, where the obtained results are evaluated using five different metrics The obtained results revealed that using the proposed CNN model is better than using the well-known DL model for the purpose of feature extraction. Moreover, using a DL model for feature extraction and an ML model for the classification task achieved better results in comparison to using an end-to-end DL model for detecting COVID-19 CT scan images. Of note, the accuracy rate of the former method improved by using ensemble learning models instead of the classic ML models. The proposed method achieved the best accuracy rate of 99.39%.

Electricity load forecasting is a crucial undertaking within all the deregulated markets globally. Among the research challenges on a global scale, the investigation of deep transfer learning (DTL) in the field of electricity load forecasting represents a fundamental effort that can inform artificial intelligence applications in general. In this paper, a comprehensive study is reported regarding day-ahead electricity load forecasting. For this purpose, three sequence-to-sequence (Seq2seq) deep learning (DL) models are used, namely the multilayer perceptron (MLP), the convolutional neural network (CNN) and the ensemble learning model (ELM), which consists of the weighted combination of the outputs of MLP and CNN models. Also, the study focuses on the development of different forecasting strategies based on DTL, emphasizing the way the datasets are trained and fine-tuned for higher forecasting accuracy. In order to implement the forecasting strategies using deep learning models, load datasets from three Greek islands, Rhodes, Lesvos, and Chios, are used. The main purpose is to apply DTL for day-ahead predictions (1–24 h) for each month of the year for the Chios dataset after training and fine-tuning the models using the datasets of the three islands in various combinations. Four DTL strategies are illustrated. In the first strategy (DTL Case 1), each of the three DL models is trained using only the Lesvos dataset, while fine-tuning is performed on the dataset of Chios island, in order to create day-ahead predictions for the Chios load. In the second strategy (DTL Case 2), data from both Lesvos and Rhodes concurrently are used for the DL model training period, and fine-tuning is performed on the data from Chios. The third DTL strategy (DTL Case 3) involves the training of the DL models using the Lesvos dataset, and the testing period is performed directly on the Chios dataset without fine-tuning. The fourth strategy is a multi-task deep learning (MTDL) approach, which has been extensively studied in recent years. In MTDL, the three DL models are trained simultaneously on all three datasets and the final predictions are made on the unknown part of the dataset of Chios. The results obtained demonstrate that DTL can be applied with high efficiency for day-ahead load forecasting. Specifically, DTL Case 1 and 2 outperformed MTDL in terms of load prediction accuracy. Regarding the DL models, all three exhibit very high prediction accuracy, especially in the two cases with fine-tuning. The ELM excels compared to the single models. More specifically, for conducting day-ahead predictions, it is concluded that the MLP model presents the best monthly forecasts with MAPE values of 6.24% and 6.01% for the first two cases, the CNN model presents the best monthly forecasts with MAPE values of 5.57% and 5.60%, respectively, and the ELM model achieves the best monthly forecasts with MAPE values of 5.29% and 5.31%, respectively, indicating the very high accuracy it can achieve.

Using Deep Learning Models to Characterize Major Retinal Features on Color Fundus Photographs

Recognition of human activity based on convolutional neural network has received the interest of researchers in recent years due to its significant improvement in accuracy. A large number of algorithms based on the deep learning approach have been proposed for activity recognition purpose. However, with the increasing advancements in technologies having limited computational resources, it needs to design an efficient deep learning-based approaches with improved utilization of computational resources. This paper presents a simple and efficient 2-Dimensional convolutional neural network (2-D CNN) architecture with very small size convolutional kernel for human activity recognition. The merit of the proposed CNN architecture over standard deep learning architectures is fewer trainable parameters and lesser memory requirement which enables it to train the proposed CNN architecture on low GPU memory-based devices and also works well with smaller as well as larger size datasets. The proposed approach consists of mainly four stages: namely (1) creation of dataset and data augmentation, (2) designing 2-D convolutional neural network (CNN) architecture, (3) the proposed 2-D CNN architecture trained from scratch up to optimum stage, and (4) evaluation of the trained 2-D CNN architecture. To illustrate the effectiveness of the proposed architecture several extensive experiments are conducted on three publicly available datasets, namely IXMAS, YouTube, and UCF101 dataset. The results of the proposed method and its comparison with other state-of-the-art methods [8-12,14,18-26,29-33] demonstrate the usefulness of the proposed method.

Diabetic retinopathy (DR) is one of the leading causes of vision loss in adults and is one of the detrimental side effects of the mass prevalence of Diabetes Mellitus (DM). It is crucial to have an efficient screening method for early diagnosis of DR to prevent vision loss. This paper compares and analyzes the various Machine Learning (ML) techniques, from traditional ML to advanced Deep Learning models. We compared and analyzed the efficacy of Convolutional Neural Networks (CNNs), Capsule Networks (CapsNet), K-Nearest Neighbor (KNN), Support Vector Machine (SVM), decision trees, and Random Forests. This paper also considers determining factors in the evaluation, including contrast enhancements, noise reduction, grayscaling, etc We analyze recent research studies and compare methodologies and metrics, including accuracy, precision, sensitivity, and specificity. The findings highlight the advanced performance of Deep Learning (DL) models, with CapsNet achieving a remarkable accuracy of up to 97.98% and a high precision rate, outperforming other traditional ML methods. The Contrast Limited Adaptive Histogram Equalization (CLAHE) preprocessing technique substantially enhanced the model’s efficiency. Each ML method’s computational requirements are also considered. While most advanced deep learning methods performed better according to the metrics, they are more computationally complex, requiring more resources and data input. We also discussed how datasets like MESSIDOR could be more straightforward and contribute to highly evaluated performance and that there is a lack of consistency regarding benchmark datasets across papers in the field. Using the DL models facilitates accurate early detection for DR screening, can potentially reduce vision loss risks, and improves accessibility and cost-efficiency of eye screening. Further research is recommended to extend our findings by building models with public datasets, experimenting with ensembles of DL and traditional ML models, and considering testing high-performing models like CapsNet.

The significant role of emotion in human daily interaction cannot be over-emphasized, however, the pressing demand for a cutting-edge and highly efficient model for the classification of speech emotion in effective computing has remained a challenging task. Researchers have proposed several approaches for speech emotion classification (SEC) in recent times, but the lingering challenge of the insufficient dataset, which has been limiting the performances of these approaches, is still of major concern. Therefore, this work proposes a deep transfer learning model, a technique that has been yielding tremendous and state-of-the-art results in computer vision, for SEC. Our approach used a pre-trained and optimized model of Visual Geometry Group (VGGNet) convolutional neural network architecture with appropriate fine-tuning for optimal performance. The speech signal is converted to a mel-Spectrogram image suitable for deep learning model input (224\(\,\times \,\)244 x 3) using filterbanks and Fast Fourier transform (FFT) on the speech samples. Multi-layer perceptron (MLP) algorithm is adopted as a classifier after feature extraction is carried out by the deep learning model. Speech pre-processing was carried out on Toronto English Speech Set (TESS) speech emotional corpus used for the study to prevent the low performance of our proposed model. The result of our experiment after evaluation using the TESS dataset shows an improved result in SEC with an accuracy rate of 96.1% and specificity of 97.4%.KeywordsDeep learningSpeech emotionClassificationDeep convolutional neural network

Deep Learning (DL) is a fastest growing and a broader part of machine learning family. Deep learning uses Convolutional Neural Networks (CNN) for image classification as it gives the most accurate results in solving real- world problem. CNN has various pre-trained architecture like AlexNet, GoogleNet, DenseNet, SqueezeNet, ResNet, VGGNet etc. In this study, we have used CNN and AlexNet architecture for detecting the disease in Mango and Potato leaf and compare the accuracy and efficiency between these architectures. The dataset containing 4004 images were used for this work. The images for potato were taken from plantvillage website, while images for mango were collected from GBPUAT field location. The results show that accuracy achieved from AlexNet is higher than CNN architecture.

This article demonstrates a revolutionary deep- learning approach for automated diabetic retinopathy (DR) detection using convolutional neural networks (CNNs). With the help of datasets from the Diabetic Retinopathy Detection 2015 and APTOS 2019 Blindness Detection competitions, our model attempts to accurately classify retinal images into two categories: No DR and Proliferative DR, based on the severity of macular degeneration. We enhance the quality of the dataset and the robustness of the model by carefully preprocessing and augmenting it using various approaches like rotation, flipping, shearing, rescaling, translation, brightness correction, and normalization. We train two models: a regression model and a deep learning model. With an 88% validation accuracy, we demonstrated that our deep learning technique performs better than the regression model. In order to properly determine and classify DR severity levels, this study presents a robust and noise-tolerant system that evolves the field of automated DR detection. Our approach enables early detection and intervention by combining cutting-edge CNN architectures with sophisticated preprocessing techniques, which may lessen the strain of DR- related blindness on healthcare systems. We also demonstrate out drawbacks and suggest areas for additional investigation, such as analyzing ensemble learning and using a variety of datasets to improve the generalizability of the model. As we wrap up, our study emphasizes the potential of deep learning techniques to transform DR diagnosis and treatment, with the goal of enhancing the quality of care for diabetics globally.

As one of the representative algorithms of deep learning, a convolutional neural network (CNN) with the advantage of local perception and parameter sharing has been rapidly developed. CNN-based detection technology has been widely used in computer vision, natural language processing, and other fields. Fresh fruit production is an important socioeconomic activity, where CNN-based deep learning detection technology has been successfully applied to its important links. To the best of our knowledge, this review is the first on the whole production process of fresh fruit. We first introduced the network architecture and implementation principle of CNN and described the training process of a CNN-based deep learning model in detail. A large number of articles were investigated, which have made breakthroughs in response to challenges using CNN-based deep learning detection technology in important links of fresh fruit production including fruit flower detection, fruit detection, fruit harvesting, and fruit grading. Object detection based on CNN deep learning was elaborated from data acquisition to model training, and different detection methods based on CNN deep learning were compared in each link of the fresh fruit production. The investigation results of this review show that improved CNN deep learning models can give full play to detection potential by combining with the characteristics of each link of fruit production. The investigation results also imply that CNN-based detection may penetrate the challenges created by environmental issues, new area exploration, and multiple task execution of fresh fruit production in the future.

Deep learning models have enhanced picture-based semantic pattern identification. Facial photos can assess a person's emotional state and character traits. Due to this motive, we are applying a variety of deep learning architectures to try to infer criminal tendency from face pictures. This study used a simple convolutional neural network (CNN) architecture and multiple pre-trained CNN designs, including VGG-16, VGG-19, and InceptionV3. We compared these systems' effectiveness in identifying criminal traits from human faces. Deep learning models were tested using the National Institute of Standards and Technology's public database. (NIST). Our initiative only used men's images to avoid misunderstanding. VGG CNN models performed best, even with low data, detecting criminal faces with 99.5% accuracy. This index includes Image Classification, Facial Images, Personality Traits, Semantic Pattern Recognition, Deep Learning, and Image Processing.

Breast cancer remains one of the most common cancers amongst women globally. Early detection is crucial for improving survival rates. While mammography is widely used and an effective imaging technique, it can sometimes yield false positive or false negatives. Mammogram interpretation is highly operator-dependent, introducing variability and the potential for diagnostic errors. Additionally, mammographic images have limitations, such as low contrast in breast tissue and overlapping structures that can obscure lesions or mimic abnormalities. These limitations can lead to unnecessary biopsies or delayed diagnosis. These challenges highlight the needs for advanced and data driven diagnostic tools to support and enhance current screening practices.</p> <p>In recent years, machine learning has emerged as a transformative force in the health care industry offering innovative solution to complex medical challenges. One of the most promising applications of this technology is in the early and accurate detection of breast cancer particularly through the mammography image analysis. Machine learning algorithms, especially deep learning models, have shown significant potential in identifying patterns in mammography that may indicate abnormal cases. This study utilizes the power of deep learning particularly Convolutional Neural Networks (CNNs) to enhance the classification of breast ultrasound images.</p> <p>This research proposes a novel two-level classification approach. At the first level classification, the system distinguishes normal from abnormal cases. Next, the second level classification, it further classifies abnormal cases into benign or malignant tumors. To address challenges such as limited and imbalanced datasets, the study incorporates comprehensive preprocessing techniques including contrast enhancement via Contrast Limited Adaptive Histogram Equalization (CLAHE) and region of interest (ROI). The preprocessing step were evaluated separately and in combination to assess their individual contributions. Additionally, data augmentation is utilized to improve model generalization. To further enhance performance and robustness, multiple CNN architectures are combined using an ensemble mechanism. Soft voting and hard voting leverage the strengths of diverse CNNs reducing individual model biases and improving overall accuracy.</p> <p>The main contributions of this research are: (1) the design of a two-level classification system (2) the utilization of multiple preprocessing techniques to improve image quality, (3) the application of voting ensemble learning to improve predictive stability and accuracy, and (4) an extensive evaluation on the BUSI dataset. This breaks down the complex diagnostic task into smaller, manageable steps to allow for more accurate comparisons, analysis, and improvements at each stage.</p> <p>The first preprocessing step involved the application of CLAHE. In the first level classification (normal vs abnormal), performance of various models has been evaluated. The models achieved an 82.05% accuracy for AlexNet, 84.62% for DenseNet, 85.26% for Inception, 82.69% for MobileNet, 82.05% for ResNet and 82.69% for VGG16. The accuracy of soft voting is 96.20% and accuracy of hard voting 92.09%. In the second level classification (benign vs malignant), the models achieved an 75.00% accuracy for AlexNet, 80.47% for DenseNet, 35.94% for Inception, 41.41% for MobileNet, 35.94% for ResNet and 82.81% for VGG16. The accuracy of soft voting is 90.84% and hard voting is 85.76%.</p> <p>The second preprocessing step involved the ROI was implemented. This step helped isolate the regions containing potential abnormalities, such as tumors, while filtering out irrelevant areas. After the application of ROI (normal vs abnormal), the system evaluated the performance of various models. In the first level classification (normal vs abnormal), the models achieved an 82.69% accuracy for AlexNet, 82.69% for DenseNet, 83.97% for Inception, 87.18% for MobileNet, 82.69% for ResNet and 82.05% for VGG16. The accuracy of soft voting is 100.00% and hard voting is 98.08%. In the second level classification (benign vs malignant), the system evaluated the performance of various models. The models achieved an 75.00% accuracy for AlexNet, 80.47% for DenseNet, 35.94% for Inception, 41.41% for MobileNet, 35.94% for ResNet and 82.81% for VGG16. Soft voting achieved 89.15% and hard voting achieved 80.95%.</p> <p>The final step in the preprocessing stage combines both CLAHE and ROI. The combination led to an improvement in classification performance. In the first level classification (normal vs abnormal), the models achieved an 91.77% accuracy for AlexNet, 92.72% for DenseNet, 95.57% for Inception, 96.52% for MobileNet, 76.90% for ResNet and 91.14% for VGG16. The accuracy of soft voting is 90.88% and hard voting is 93.99%. In the second level classification (benign vs malignant), the system evaluated the performance of various models. The models achieved an 87.69% accuracy for AlexNet, 99.23% for DenseNet, 96.92% for Inception, 93.08% for MobileNet, 94.62% for ResNet and 97.69% for VGG16. Soft voting achieved 96.92% and hard voting achieved 97.69%.</p> <p>These results indicate that every preprocessing step contributed to an improvement in classification accuracy across all models. This study demonstrates that a two-level, ensemble-based deep learning system can significantly improve the diagnostic accuracy of breast ultrasound images, offering a promising tool to assist radiologists and support early detection efforts, particularly in resource-constrained healthcare environments.

Plant diseases pose significant economic challenges and may lead to ecological consequences. Although plant pathologists have a significant ability to diagnose plant diseases, rapid, accurate, and early diagnosis of plant diseases by intelligent systems could improve disease control and management. This study evaluates six efficient classification models (classifiers) based on deep learning to detect common tomato diseases by analyzing symptomatic patterns on leaves. Additionally, group learning techniques, including simple and weighted majority voting methods, were employed to enhance classification performance further. Six tomato leaf diseases, including Pseudomonas syringae pv. syringae bacterial spot, Phytophthora infestance late blight, Cladosporium fulvum leaf mold, Septoria lycopersici Septoria leaf spot, Corynespora cassiicola target spot, and Alternaria solani early blight, as well as healthy leaves, resulting in a total of seven classes, were utilized for the classification. Deep learning models, such as convolutional neural networks (CNNs), GoogleNet, ResNet-50, AlexNet, Inception v3, and MobileNet, were utilized, achieving classification accuracies of 65.8%, 84.9%, 93.4%, 89.4%, 93.4%, and 96%, respectively. Furthermore, applying the group learning approaches significantly improved the results, with simple majority voting achieving a classification accuracy of 99.5% and weighted majority voting achieving 100%. These findings highlight the effectiveness of the proposed deep ensemble learning models in accurately identifying and classifying tomato diseases, featuring their potential for practical applications in tomato disease diagnosis and management.

This study, for the first time, presented a novel Bayesian inference deep learning model based on a dilated convolutional ResNet framework, utilizing acoustic emission (AE) signals as inputs to quantify the uncertainty of the compression after impact (CAI) strength in composites. The output of the deep learning model included the mean CAI and the predictive aleatoric uncertainty. The epistemic uncertainty of the model was estimated by randomly sampling the input multiple times. AE signals were divided into a complete training dataset and a partially missing training dataset to investigate the impact of data insufficiency on the uncertainty of deep learning models. The results demonstrate that the deep learning model can provide highly accurate predictions of CAI performance. It is worth noting that on incomplete datasets, the epistemic uncertainty of the predictions increased significantly. To evaluate the effect of noise on the prediction of CAI strength, Gaussian noise with signal‐to‐noise ratios (SNRs) of 10, 5, and 2 dB was introduced during the prediction phase. The Bayesian posterior probability density function becomes lower and wider under the same impact energy as external noise increases. The model exhibited excellent regression performance under SNRs of 10 and 5 dB, validating the robustness of the proposed framework. As noise levels increased, the range of aleatoric uncertainty in the predictions expanded.Highlights A dilated convolution Bayesian deep learning framework for uncertainty quantification of compression after impact strength in laminated composites is proposed. The prediction and uncertainty quantification performance of the framework is evaluated. The effect of data missing and background noise on the uncertainty is investigated.

Deep learning models assist ophthalmologists in early detection of diseases from retinal images and timely treatment. Owing to robust and accurate results from deep learning models, we aim to use convolutional neural network (CNN) to provide a non-invasive method for early detection of eye diseases. We used a hybridized CNN with deep learning (DL) based on two separate CNN blocks, to identify multiple Optic Disc Cupping, Diabetic Retinopathy, Media Haze, and Healthy images. We used the RFMiD dataset, which contains various categories of fundus images representing different eye diseases. Data augmenting, resizing, coping, and one-hot encoding are used among other preprocessing techniques to improve the performance of the proposed model. Color fundus images have been analyzed by CNNs to extract relevant features. Two CCN models that extract deep features are trained in parallel. To obtain more noticeable features, the gathered features are further fused utilizing the Canonical Correlation Analysis fusion approach. To assess the effectiveness, we employed eight classification algorithms: Gradient boosting, support vector machines, voting ensemble, medium KNN, Naive Bayes, COARSE- KNN, random forest, and fine KNN. With the greatest accuracy of 93.39%, the ensemble learning performed better than the other algorithms. The accuracy rates suggest that the deep learning model has learned to distinguish between different eye disease categories and healthy images effectively. It contributes to the field of eye disease detection through the analysis of color fundus images by providing a reliable and efficient diagnostic system.

Deep learning algorithms can be used to design systems that report data on patients and deliver warnings to medical applications or electronic health information if there are changes in the patient's health. These systems could be created using deep Learning. This helps verify that patients get the proper effective care at the proper time for each specific patient. A healthcare decision support system was presented using the Internet of Things and deep learning methods. In the proposed system, we examined the capability of integrating deep learning technology into automatic diagnosis and IoT capabilities for faster message exchange over the Internet. We have selected the suitable Neural Network structure (number of best-hidden layers and activation function classes) to construct the e-health system. In addition, the e-health system relied on data from doctors to understand the Neural Network. In the validation method, the total evaluation of the proposed healthcare system for diagnostics provides dependability under various patient conditions. Based on evaluation and simulation findings, a dual hidden layer of feed-forward NN and its neurons store the tanh function more effectively than other NN. To overcome challenges, this study will integrate artificial intelligence with IoT. This study aims to determine the NN's optimal layer counts and activation function variations.