Diagnosing malaria with AI and image processing

<p>In recent decades, a wealth of research has focused on elucidating the key controls on the mass loss of the Greenland Ice Sheet and its response to climate forcing, specifically in relation to the drivers of spatio-temporally variable outlet glacier change. Despite the increasing availability of high-resolution satellite data, the time-consuming nature of the manual methods traditionally used to analyse satellite imagery has resulted in a significant bottleneck in the monitoring of outlet glacier change. Recent advances in deep learning applied to image processing have opened up a new frontier in the area of automated delineation of glacier termini. However, at this stage, there remains a paucity of research on the use of deep learning for image classification of outlet glacier landscapes. In this contribution, we apply a deep learning approach based on transfer learning to automatically classify satellite images of Helheim glacier, the fastest flowing outlet glacier in eastern Greenland. The method uses the well-established VGG16 convolutional neural network (CNN), and is trained on 224x224 pixel tiles derived from Sentinel-2 RGB bands, which have a spatial resolution of 10 metres. Based on features learned from ImageNet and limited training data, our deep learning model can classify glacial environments with >85% accuracy. In future stages of this research, we will use a new method originally developed for fluvial settings, dubbed ‘CNN-Supervised Classification’ (CSC). CSC uses a pre-trained CNN (in this case our VGG16 model) to replace the human operator’s role in traditional supervised classification by automatically producing new label data to train a pixel-level neural network classifier for any new image. This transferable approach to image classification of outlet glacier landscapes permits not only automated terminus delineation, but also facilitates the efficient analysis of numerous processes controlling outlet glacier behaviour, such as fjord geometry, subglacial plumes, and supra-glacial lakes.</p>

Skin diseases impact millions of people around the world and pose a severe risk to public health. These diseases have a wide range of effects on the skin’s structure, functionality, and appearance. Identifying and predicting skin diseases are laborious processes that require a complete physical examination, a review of the patient’s medical history, and proper laboratory diagnostic testing. Additionally, it necessitates a significant number of histological and clinical characteristics for examination and subsequent treatment. As a disease’s complexity and quantity of features grow, identifying and predicting it becomes more challenging. This research proposes a deep learning (DL) model utilizing transfer learning (TL) to quickly identify skin diseases like chickenpox, measles, and monkeypox. A pre-trained VGG16 is used for transfer learning. The VGG16 can identify and predict diseases more quickly by learning symptom patterns. Images of the skin from the four classes of chickenpox, measles, monkeypox, and normal are included in the dataset. The dataset is separated into training and testing. The experimental results performed on the dataset demonstrate that the VGG16 model can identify and predict skin diseases with 93.29% testing accuracy. However, the VGG16 model does not explain why and how the system operates because deep learning models are black boxes. Deep learning models’ opacity stands in the way of their widespread application in the healthcare sector. In order to make this a valuable system for the health sector, this article employs layer-wise relevance propagation (LRP) to determine the relevance scores of each input. The identified symptoms provide valuable insights that could support timely diagnosis and treatment decisions for skin diseases.

Accurate diagnosis of kidney disease is essential, as it remains a major health concern affecting individuals across all age groups. Early detection is critical to ensuring timely and effective treatment. With the advancement of deep learning, powerful models now offer end-to-end learning capabilities, extracting relevant patterns directly from complex medical data. These models significantly improve diagnostic precision and support clinical decision-making. However, as deep learning models like ANN, CNN, and LSTM become more complex, the need for interpretability has become increasingly important. The trade-off between model performance and transparency remains a persistent gap in the healthcare domain. To address this concern, the present article uses three black-box models to predict the existence of kidney stones. The models were trained using a dataset of unbalanced kidney stones that was first preprocessed using established methods to increase accuracy and balance. Then ANN, CNN, and LSTM models were used, yielding outstanding accuracies of 97 %, 96 %, and 98 %, respectively. To enhance the interpretability of these black-box models, three XAI technique were applied individually to each model which are Saliency Maps, Ablation, and Permutation Feature Importance. These methods successfully identified the most influential features contributing to the predictions which are Serum Creatinine (sc) and Hemoglobin (hemo). The model's interpretability and high accuracy lay the groundwork for energy-efficient, trustworthy AI applications in 6G-based medical ecosystems. The results demonstrate that combining deep learning with XAI enables both high predictive performance and meaningful model transparency. This integration addresses the critical need for interpretable AI in healthcare and contributes to the development of reliable clinical decision support systems.

Accurate and reliable diagnosis is critical for effective treatment planning for brain cancer. Recent advancements in deep learning have significantly enhanced diagnostic capabilities, but challenges persist in optimizing model performance for diverse and complex datasets. This study investigates the application of Polyak-Ruppert Optimization (PRO) to improve the prediction accuracy of conventional deep learning models for brain cancer diagnosis. Utilizing the REpository of Molecular BRAin Neoplasia DaTa (REMBRANDT) database, the proposed framework incorporates the advanced PRO technique to stabilize training and enhance generalization. The PRO’s impacts on convergence rates, model robustness, and predictive accuracy across multiple cancer types are analyzed. Experimental results demonstrate that VGG and ResNet models employing the PRO technique outperform the conventional architectures such as VGG and ResNet in classification metrics such as accuracy, sensitivity, and specificity. The potential of advanced optimization strategies such as PRO to refine deep learning applications in oncology paves the way for more accurate, efficient, and interpretable diagnostic systems.

COVID-19 is highly infectious and causes acute respiratory disease. Machine learning (ML) and deep learning (DL) models are vital in detecting disease from computerized chest tomography (CT) scans. The DL models outperformed the ML models. For COVID-19 detection from CT scan images, DL models are used as end-to-end models. Thus, the performance of the model is evaluated for the quality of the extracted feature and classification accuracy. There are four contributions included in this work. First, this research is motivated by studying the quality of the extracted feature from the DL by feeding these extracted to an ML model. In other words, we proposed comparing the end-to-end DL model performance against the approach of using DL for feature extraction and ML for the classification of COVID-19 CT scan images. Second, we proposed studying the effect of fusing extracted features from image descriptors, e.g., Scale-Invariant Feature Transform (SIFT), with extracted features from DL models. Third, we proposed a new Convolutional Neural Network (CNN) to be trained from scratch and then compared to the deep transfer learning on the same classification problem. Finally, we studied the performance gap between classic ML models against ensemble learning models. The proposed framework is evaluated using a CT dataset, where the obtained results are evaluated using five different metrics The obtained results revealed that using the proposed CNN model is better than using the well-known DL model for the purpose of feature extraction. Moreover, using a DL model for feature extraction and an ML model for the classification task achieved better results in comparison to using an end-to-end DL model for detecting COVID-19 CT scan images. Of note, the accuracy rate of the former method improved by using ensemble learning models instead of the classic ML models. The proposed method achieved the best accuracy rate of 99.39%.

Introduction: Rhegmatogenous retinal detachment (RRD) is one of the most common fundus diseases. Many rural areas of China have few ophthalmologists, and ophthalmologic ultrasound examination is of great significance for remote diagnosis of RRD. Therefore, this study aimed to develop and evaluate a deep learning (DL) model, to be used for automated RRD diagnosis based on ophthalmologic ultrasound images, in order to support timely diagnosis of RRD in rural and remote areas. Methods: A total of 6,000 ophthalmologic ultrasound images from 1,645 participants were used to train and verify the DL model. A total of 5,000 images were used for training and validating DL models, and an independent testing set of 1,000 images was used to test the performance of eight DL models trained using four different DL model architectures (fully connected neural network, LeNet5, AlexNet, and VGG16) and two preprocessing techniques (original, original image augmented). Receiver operating characteristic (ROC) curves were used to analyze their performance. Heatmaps were generated to visualize the process of the best DL model in the identification of RRD. Finally, five ophthalmologists were invited to diagnose RRD independently on the same test set of 1,000 images for performance comparison with the best DL model. Results: The best DL model for identifying RRD achieved an area under the ROC curve (AUC) of 0.998 with a sensitivity and specificity of 99.2% and 99.8%, respectively. The best preprocessing method in each model architecture was the application of original image augmentation (average AUC = 0.982). The best model architecture in each preprocessing method was VGG16 (average AUC = 0.998). Conclusion: The best DL model determined in this study has higher accuracy, sensitivity, and specificity than the ophthalmologists’ diagnosis in identifying RRD based on ophthalmologic ultrasound images. This model may provide support for timely diagnosis in locations without access to ophthalmologic care.

Quantification of legumes biological nitrogen fixation (BNF) is normally done via analytical methods that require sampling, drying, grinding, and laboratory processing. These methods are time-consuming, expensive, and are not accessible to growers. The correlation between the BNF quantity and nodule number and nodule mass can be used to develop tools that allow rapid assessments of the BNF. In this work, we developed a graphical user interface (GUI) based deep learning and image processing system for legume nodule segmentation and classification to determine the characteristics associated with legume nodules using digital images. During image acquisition, the legume root samples were imaged using a smartphone camera and lab-made imaging setup. A total of 1468 digital images were collected from 367 root systems. After the first run of imaging, nodules were separated from the roots, and another image was obtained from the nodules of each sample. For comparison and validations, nodules were manually counted, dried, and weighed. In this study, a categorized image data library was developed and utilized for deep learning and image processing. Digital image processing filters, and image segmentation method were applied to process the digital images of the root systems and determine the number of nodules and provide their characteristics. Deep learning models were used to classify the images into different legume classes. Furthermore, a GUI was successfully developed to simplify the utilization and application of deep learning/digital image processing algorithms. The preliminary results of this study demonstrate that our deep learning/image analysis system has a great potential to accurately quantify, characterize, and count the nodules and that could be extremely valuable to growers.

PurposeTo conduct a head-to-head comparison between deep learning (DL) and radiomics models across institutions for predicting microvascular invasion (MVI) in hepatocellular carcinoma (HCC) and to investigate the model robustness and generalizability through rigorous internal and external validation.MethodsThis retrospective study included 2304 preoperative images of 576 HCC lesions from two centers, with MVI status determined by postoperative histopathology. We developed DL and radiomics models for predicting the presence of MVI using B-mode ultrasound, contrast-enhanced ultrasound (CEUS) at the arterial, portal, and delayed phases, and a combined modality (B + CEUS). For radiomics, we constructed models with enlarged vs. original regions of interest (ROIs). A cross-validation approach was performed by training models on one center’s dataset and validating the other, and vice versa. This allowed assessment of the validity of different ultrasound modalities and the cross-center robustness of the models. The optimal model combined with alpha-fetoprotein (AFP) was also validated. The head-to-head comparison was based on the area under the receiver operating characteristic curve (AUC).ResultsThirteen DL models and 25 radiomics models using different ultrasound modalities were constructed and compared. B + CEUS was the optimal modality for both DL and radiomics models. The DL model achieved AUCs of 0.802–0.818 internally and 0.667–0.688 externally across the two centers, whereas radiomics achieved AUCs of 0.749–0.869 internally and 0.646–0.697 externally. The radiomics models showed overall improvement with enlarged ROIs (P < 0.05 for both CEUS and B + CEUS modalities). The DL models showed good cross-institutional robustness (P > 0.05 for all modalities, 1.6–2.1% differences in AUC for the optimal modality), whereas the radiomics models had relatively limited robustness across the two centers (12% drop-off in AUC for the optimal modality). Adding AFP improved the DL models (P < 0.05 externally) and well maintained the robustness, but did not benefit the radiomics model (P > 0.05).ConclusionCross-institutional validation indicated that DL demonstrated better robustness than radiomics for preoperative MVI prediction in patients with HCC, representing a promising solution to non-standardized ultrasound examination procedures.

Breast cancer is the most prevalent cancer globally and presents a significant threat to human health. The low survival rate for advanced stages highlights the importance of early and accurate diagnosis. Pathology images, providing insights into cancer's cellular aggressiveness, are crucial for breast cancer diagnosis. Advances in deep learning have transformed automated medical image diagnosis. However, traditional deep learning methods, reliant on large labeled datasets, face challenges with the typically small size of medical image datasets. To overcome this, our study combines deep transfer learning (DTL) with convolutional neural networks(CNN). We utilize and enhance a ResNet50 model pretrained on a large dataset. Additionally, we apply four different deep transfer learning methods to feature extraction and classification of the BreakHis dataset, aiming to determine if breast cancer is benign or malignant. Ultimately, our system achieved the best average accuracy rates under four different magnifications: 98.57%, 96.83%, 97.76%, and 97.16%. These results demonstrate the accuracy and potential of deep transfer learning in classifying breast cancer histopathological images and its promising application in tumor prediction.

Deep learning models in genomics; are we there yet?

<strong class="journal-contentHeaderColor">Abstract.</strong> Deep learning techniques have been increasingly used in flood management to overcome the limitations of accurate, yet slow, numerical models and to improve the results of traditional methods for flood mapping. In this paper, we review 58 recent publications to outline the state of the art of the field, identify knowledge gaps, and propose future research directions. The review focuses on the type of deep learning models used for various flood mapping applications, the flood types considered, the spatial scale of the studied events, and the data used for model development. The results show that models based on convolutional layers are usually more accurate, as they leverage inductive biases to better process the spatial characteristics of the flooding events. Models based on fully connected layers, instead, provide accurate results when coupled with other statistical models. Deep learning models showed increased accuracy when compared to traditional approaches and increased speed when compared to numerical methods. While there exist several applications in flood susceptibility, inundation, and hazard mapping, more work is needed to understand how deep learning can assist in real-time flood warning during an emergency and how it can be employed to estimate flood risk. A major challenge lies in developing deep learning models that can generalize to unseen case studies. Furthermore, all reviewed models and their outputs are deterministic, with limited considerations for uncertainties in outcomes and probabilistic predictions. The authors argue that these identified gaps can be addressed by exploiting recent fundamental advancements in deep learning or by taking inspiration from developments in other applied areas. Models based on graph neural networks and neural operators can work with arbitrarily structured data and thus should be capable of generalizing across different case studies and could account for complex interactions with the natural and built environment. Physics-based deep learning can be used to preserve the underlying physical equations resulting in more reliable speed-up alternatives for numerical models. Similarly, probabilistic models can be built by resorting to deep Gaussian processes or Bayesian neural networks.

Deep Learning techniques have been increasingly used in flood management to overcome the limitations of accurate, yet slow, numerical models, and to improve the results of traditional methods for flood mapping. In this paper, we review 58 recent publications to outline the state-of-the-art of the field, identify knowledge gaps, and propose future research directions. The review focuses on the type of deep learning models used for various flood mapping applications, the flood types considered, the spatial scale of the studied events, and the data used for model development. The results show that models based on convolutional layers are usually more accurate as they leverage inductive biases to better process the spatial characteristics of the flooding events. Models based on fully-connected layers, instead, provide accurate results when coupled with other statistical models. Deep learning models showed increased accuracy when compared to traditional approaches and increased speed when compared to numerical methods. While there exist several applications in flood susceptibility, inundation, and hazard mapping, more work is needed to understand how deep learning can assist real-time flood warning during an emergency, and how it can be employed to estimate flood risk. A major challenge lies in developing deep learning models that can generalize to unseen case studies. Furthermore, all reviewed models and their outputs, are deterministic, with limited considerations for uncertainties in outcomes and probabilistic predictions. The authors argue that these identified gaps can be addressed by exploiting recent fundamental advancements in deep learning or by taking inspiration from developments in other applied areas. Models based on graph neural networks and neural operators can work with arbitrarily structured data and thus should be capable of generalizing across different case studies and could account for complex interactions with the natural and built environment. Physics-based deep learning can be used to preserve the underlying physical equations resulting in more reliable speed-up alternatives for numerical models. Similarly, probabilistic models can be built by resorting to Deep Gaussian Processes or Bayesian neural networks.

<strong class="journal-contentHeaderColor">Abstract.</strong> Deep learning techniques have been increasingly used in flood management to overcome the limitations of accurate, yet slow, numerical models and to improve the results of traditional methods for flood mapping. In this paper, we review 58 recent publications to outline the state of the art of the field, identify knowledge gaps, and propose future research directions. The review focuses on the type of deep learning models used for various flood mapping applications, the flood types considered, the spatial scale of the studied events, and the data used for model development. The results show that models based on convolutional layers are usually more accurate, as they leverage inductive biases to better process the spatial characteristics of the flooding events. Models based on fully connected layers, instead, provide accurate results when coupled with other statistical models. Deep learning models showed increased accuracy when compared to traditional approaches and increased speed when compared to numerical methods. While there exist several applications in flood susceptibility, inundation, and hazard mapping, more work is needed to understand how deep learning can assist in real-time flood warning during an emergency and how it can be employed to estimate flood risk. A major challenge lies in developing deep learning models that can generalize to unseen case studies. Furthermore, all reviewed models and their outputs are deterministic, with limited considerations for uncertainties in outcomes and probabilistic predictions. The authors argue that these identified gaps can be addressed by exploiting recent fundamental advancements in deep learning or by taking inspiration from developments in other applied areas. Models based on graph neural networks and neural operators can work with arbitrarily structured data and thus should be capable of generalizing across different case studies and could account for complex interactions with the natural and built environment. Physics-based deep learning can be used to preserve the underlying physical equations resulting in more reliable speed-up alternatives for numerical models. Similarly, probabilistic models can be built by resorting to deep Gaussian processes or Bayesian neural networks.

Electricity load forecasting is a crucial undertaking within all the deregulated markets globally. Among the research challenges on a global scale, the investigation of deep transfer learning (DTL) in the field of electricity load forecasting represents a fundamental effort that can inform artificial intelligence applications in general. In this paper, a comprehensive study is reported regarding day-ahead electricity load forecasting. For this purpose, three sequence-to-sequence (Seq2seq) deep learning (DL) models are used, namely the multilayer perceptron (MLP), the convolutional neural network (CNN) and the ensemble learning model (ELM), which consists of the weighted combination of the outputs of MLP and CNN models. Also, the study focuses on the development of different forecasting strategies based on DTL, emphasizing the way the datasets are trained and fine-tuned for higher forecasting accuracy. In order to implement the forecasting strategies using deep learning models, load datasets from three Greek islands, Rhodes, Lesvos, and Chios, are used. The main purpose is to apply DTL for day-ahead predictions (1–24 h) for each month of the year for the Chios dataset after training and fine-tuning the models using the datasets of the three islands in various combinations. Four DTL strategies are illustrated. In the first strategy (DTL Case 1), each of the three DL models is trained using only the Lesvos dataset, while fine-tuning is performed on the dataset of Chios island, in order to create day-ahead predictions for the Chios load. In the second strategy (DTL Case 2), data from both Lesvos and Rhodes concurrently are used for the DL model training period, and fine-tuning is performed on the data from Chios. The third DTL strategy (DTL Case 3) involves the training of the DL models using the Lesvos dataset, and the testing period is performed directly on the Chios dataset without fine-tuning. The fourth strategy is a multi-task deep learning (MTDL) approach, which has been extensively studied in recent years. In MTDL, the three DL models are trained simultaneously on all three datasets and the final predictions are made on the unknown part of the dataset of Chios. The results obtained demonstrate that DTL can be applied with high efficiency for day-ahead load forecasting. Specifically, DTL Case 1 and 2 outperformed MTDL in terms of load prediction accuracy. Regarding the DL models, all three exhibit very high prediction accuracy, especially in the two cases with fine-tuning. The ELM excels compared to the single models. More specifically, for conducting day-ahead predictions, it is concluded that the MLP model presents the best monthly forecasts with MAPE values of 6.24% and 6.01% for the first two cases, the CNN model presents the best monthly forecasts with MAPE values of 5.57% and 5.60%, respectively, and the ELM model achieves the best monthly forecasts with MAPE values of 5.29% and 5.31%, respectively, indicating the very high accuracy it can achieve.

Malaria is a blood disease caused by the Plasmodium parasites transmitted through the bite of female Anopheles mosquito. Microscopists commonly examine thick and thin blood smears to diagnose disease and compute parasitemia. However, their accuracy depends on smear quality and expertise in classifying and counting parasitized and uninfected cells. Such an examination could be arduous for large-scale diagnoses resulting in poor quality. State-of-the-art image-analysis based computer-aided diagnosis (CADx) methods using machine learning (ML) techniques, applied to microscopic images of the smears using hand-engineered features demand expertise in analyzing morphological, textural, and positional variations of the region of interest (ROI). In contrast, Convolutional Neural Networks (CNN), a class of deep learning (DL) models promise highly scalable and superior results with end-to-end feature extraction and classification. Automated malaria screening using DL techniques could, therefore, serve as an effective diagnostic aid. In this study, we evaluate the performance of pre-trained CNN based DL models as feature extractors toward classifying parasitized and uninfected cells to aid in improved disease screening. We experimentally determine the optimal model layers for feature extraction from the underlying data. Statistical validation of the results demonstrates the use of pre-trained CNNs as a promising tool for feature extraction for this purpose.