Crop type mapping by using transfer learning

Early and accurate identification of brain tumors is essential for determining effective treatment strategies and improving patient outcomes. Artificial intelligence (AI) and deep learning (DL) techniques have shown promise in automating diagnostic tasks based on magnetic resonance imaging (MRI). This study evaluates the performance of four pre-trained deep convolutional neural network (CNN) architectures for the automatic multi-class classification of brain tumors into four categories: Glioma, Meningioma, Pituitary, and No Tumor. The proposed approach utilizes the publicly accessible Brain Tumor MRI Msoud dataset, consisting of 7023 images, with 5712 provided for training and 1311 for testing. To assess the impact of data availability, subsets containing 25%, 50%, 75%, and 100% of the training data were used. A stratified five-fold cross-validation technique was applied. The CNN architectures evaluated include DeiT3_base_patch16_224, Xception41, Inception_v4, and Swin_Tiny_Patch4_Window7_224, all fine-tuned using transfer learning. The training pipeline incorporated advanced preprocessing and image data augmentation techniques to enhance robustness and mitigate overfitting. Among the models tested, Swin_Tiny_Patch4_Window7_224 achieved the highest classification Accuracy of 99.24% on the test set using 75% of the training data. This model demonstrated superior generalization across all tumor classes and effectively addressed class imbalance issues. Furthermore, we deployed and benchmarked the best-performing DL model on embedded AI platforms (Jetson AGX Xavier and Orin Nano), demonstrating their capability for real-time inference and highlighting their feasibility for edge-based clinical deployment. The results highlight the strong potential of pre-trained deep CNN and transformer-based architectures in medical image analysis. The proposed approach provides a scalable and energy-efficient solution for automated brain tumor diagnosis, facilitating the integration of AI into clinical workflows.

Deep learning has already been proved as a powerful state-of-the-art technique for many image understanding tasks in computer vision and other applications including remote sensing (RS) image analysis. Unmanned aircraft systems (UASs) offer a viable and economical alternative to a conventional sensor and platform for acquiring high spatial and high temporal resolution data with high operational flexibility. Coastal wetlands are among some of the most challenging and complex ecosystems for land cover prediction and mapping tasks because land cover targets often show high intra-class and low inter-class variances. In recent years, several deep convolutional neural network (CNN) architectures have been proposed for pixel-wise image labeling, commonly called semantic image segmentation. In this paper, some of the more recent deep CNN architectures proposed for semantic image segmentation are reviewed, and each model’s training efficiency and classification performance are evaluated by training it on a limited labeled image set. Training samples are provided using the hyper-spatial resolution UAS imagery over a wetland area and the required ground truth images are prepared by manual image labeling. Experimental results demonstrate that deep CNNs have a great potential for accurate land cover prediction task using UAS hyper-spatial resolution images. Some simple deep learning architectures perform comparable or even better than complex and very deep architectures with remarkably fewer training epochs. This performance is especially valuable when limited training samples are available, which is a common case in most RS applications.

Here we investigate the application of convolutional neural networks (CNNs) to predict the survival time of patients with Glioblastoma Multiforme (GBM) brain tumor. Our dataset consists of T1-weighted high-resolution MRI images of just 68 GBM patients. We compare two analytic methods for predicting survival time. The first consists of training a small convolutional neural network (CNN) and the second uses extracted deep features from a pre-trained CNN. Our method is completely automated, except for tumor region segmentation. In addition, we utilize a snapshot ensemble approach to boost test accuracy when dealing with limited availability of medical images for CNN training purposes. Our approach achieves an accuracy of 72.06% using a trained small network and 66.18% using a pre-trained deep CNN. Our results compare favorably with the accuracy of 54.41% using histogram of oriented gradients (HOG) features and a non-neural network classifier.

EEG based multi-class seizure type classification using convolutional neural network and transfer learning

Interstitial lung disease (ILD) refers to a group of various abnormal inflammations of lung tissues and early diagnosis of these disease patterns is crucial for the treatment. Yet it is difficult to make an accurate diagnosis due to the similarity among the clinical manifestations of these diseases. In order to assist the radiologists, computer-aided diagnosis systems have been developed. Besides, the potential of deep convolutional neural networks (CNNs) is also expected to exert on the medical image analysis in recent years. In this paper, we design a new deep convolutional neural network (CNN) architecture to achieve the classification task of ILD patterns. Furthermore, we also propose a novel two-stage transfer learning (TSTL) method to deal with the problem of the lack of training data, which leverages the knowledge learned from sufficient textural source data and auxiliary unlabeled lung CT data to the target domain. We adopt the unsupervised manner to learn the unlabeled data, by which the objective function composed of the prediction confidence and mutual information are optimized. The experimental results show that our proposed CNN architecture achieves desirable performance and outperforms most of the state-of-the-art ones. The comparative analysis demonstrates the promising feasibility and advantages of the proposed two-stage transfer learning strategy as well as the potential of the knowledge learning from lung CT data. Graphical Abstract The framework of the proposed two-stage transfer learning method.

The perceived texture directionality is an important, not fully explored image characteristic. In many applications texture directionality detection is of fundamental importance. Several approaches have been proposed, such as the fast Fourier-based method. We recently proposed a method based on the interpolated grey-level co-occurrence matrix (iGLCM), robust to image blur and noise but slower than the Fourier-based method. Here we test the applicability of convolutional neural networks (CNNs) to texture directionality detection. To obtain the large amount of training data required, we built a training dataset consisting of synthetic textures with known directionality and varying perturbation levels. Subsequently, we defined and tested shallow and deep CNN architectures. We present the test results focusing on the CNN architectures and their robustness with respect to image perturbations. We identify the best performing CNN architecture, and compare it with the iGLCM, the Fourier and the local gradient orientation methods. We find that the accuracy of CNN is lower, yet comparable to the iGLCM, and it outperforms the other two methods. As expected, the CNN method shows the highest computing speed. Finally, we demonstrate the best performing CNN on real-life images. Visual analysis suggests that the learned patterns generalize to real-life image data. Hence, CNNs represent a promising approach for texture directionality detection, warranting further investigation.

Purpose Diabetic retinopathy (DR) is one of the dangerous complications of diabetes. Its grade level must be tracked to manage its progress and to start the appropriate decision for treatment in time. Effective automated methods for the detection of DR and the classification of its severity stage are necessary to reduce the burden on ophthalmologists and diagnostic contradictions among manual readers. Design/methodology/approach In this research, convolutional neural network (CNN) was used based on colored retinal fundus images for the detection of DR and classification of its stages. CNN can recognize sophisticated features on the retina and provides an automatic diagnosis. The pre-trained VGG-16 CNN model was applied using a transfer learning (TL) approach to utilize the already learned parameters in the detection. Findings By conducting different experiments set up with different severity groupings, the achieved results are promising. The best-achieved accuracies for 2-class, 3-class, 4-class and 5-class classifications are 86.5, 80.5, 63.5 and 73.7, respectively. Originality/value In this research, VGG-16 was used to detect and classify DR stages using the TL approach. Different combinations of classes were used in the classification of DR severity stages to illustrate the ability of the model to differentiate between the classes and verify the effect of these changes on the performance of the model.

The leather industry plays a crucial role in the production of high-quality leather products to remain competitive in the market. Due to various reasons such as material handling and turning, leather defects can appear at different stages of the production process. This paper proposed deep learning techniques, specifically transfer learning, deep convolutional neural networks (D-CNN), and ensemble learning for automating leather defect detection and classification. The dataset was taken from the open source Kaggle. The dataset was preprocessed from the beginning. However, we performed Error Level Analysis (ELA) to detect possible changes or fraud in the image. We also used data augmentation techniques (resizing, rescaling, flipping, rotation, zooming, and contrasting) on the dataset to improve the model performance. This study investigated deep learning architectures for automatic leather defect detection, comparing them with seven deep convolutional neural networks (D-CNN) models and transfer learning architectures. Furthermore, we introduce and evaluate two novel ensemble models: MER built on transfer learning architecture (MobileNetV2, EfficientNetB0, and ResNet50) and AZL built on D-CNN architecture (AlexNet, ZfNet, and LeNet). A key contribution of this study is the demonstration of significant performance improvements achieved by strategically integrating squeeze and excitation and label smoothing techniques into transfer learning, D-CNN, and ensemble frameworks. Our proposed MER ensemble method achieves a state-of-the-art of 96.39% for leather defect detection. The proposed model was evaluated using performance metrics including precision, recall, F1-score, AUC, ROC, and Matthews Correlation Coefficient (MCC). Additionally, Grad-CAM was employed for explainable AI to visualize and interpret the model’s decision-making process. Comparative analysis against separate transfer learning and D-CNN models fails to establish the superior performance of our MER ensemble, which highlights the potential to significantly advance automated quality inspection in leather production. This study provides insights into evaluating the best deep learning techniques for leather defect classification, paving the way for more accurate, efficient, and reliable industrial applications. Proposes a robust deep learning-based framework for automated leather defect detection using transfer learning, deep CNNs, and two novel ensemble models (MER and AZL), enhanced with squeeze-and-excitation and label smoothing techniques. Achieves state-of-the-art performance with the proposed MER ensemble model, achieve 96.39% accuracy, and demonstrates superior results across precision, recall, F1-score, AUC–ROC, and MCC. Integrates Error Level Analysis (ELA), extensive data augmentation, and Grad-CAM–based explainable AI to ensure data reliability, improve generalization, and provide transparent visual interpretation of defect regions for industrial quality inspection.

Recognition of emotional states using frequency effective connectivity maps through transfer learning approach from electroencephalogram signals

Crop type identification and mapping have been a classic issue essential for agriculture characterisation and food security as well as crop health monitoring. Remote sensing was proven to be an efficient tool to define and study agriculture. The complementarity between optical and radar data can hugely improve crop type identification and mapping. This document presents an overview of more than 40 recent works between 2013 and 2019, related to crop type mapping using satellite imagery, and points the general techniques used. Different classification algorithms was studied and compared, as well as the comparison of the inputs, optimal bands and polarization for radar data, and process giving the best results. It is often concluded that fusion improves results when compared with single data using. Nevertheless, it had been challenging to combine datasets from sensors that had different physical concepts, and progress in this domain require the development of systematic procedures.

Voice disorders are among the most prevalent problems affecting a huge proportion of the population, with the majority of them resulting in communication issues and a deterioration in quality of life. Early detection leads to more effective treatment. Thus, better approaches for accurately diagnosing vocal abnormalities are essential. Machine learning techniques such as Convolutional Neural Networks (CNNs), Random Forests, and transfer learning approaches have all proven useful in this discipline. CNNs offer incredible audio signal processing capabilities, since they can convert raw voice data into spectrograms and automatically extract key properties. CNNs can detect minor patterns associated with numerous voice disorders, improving classification accuracy. Random Forest is a technique used in ensemble learning to enhance robustness and accuracy in classification tasks. The utility of this approach stems from its capacity to overcome existing data processing issues, making it a substantial contribution to the area. Thus, we propose the system with CNN and Random Forest as the classification models and obtained the 97.31% accuracy for transfer learning model.

Feature fusion methods have been demonstrated to be effective for many computer vision based applications. These methods generally use multiple hand-crafted features. However, in recent days, features extracted through transfer leaning procedures have been proved to be robust than the hand-crafted features in myriad applications, such as object classification and recognition. The transfer learning is a highly appreciated strategy in deep convolutional neural networks (DCNNs) due to its multifaceted benefits. It heartens us to explore the effect of fusing multiple transfer learning features of different DCNN architectures. Thus, in this work, we extract features of image statistics by exploiting three different pre-trained DCNNs through transfer learning. Then, we transform the features into a generalized subspace through a recently introduced Autoencoder network and fuse them to form intra-class invariant feature vector that is used to train a multi-class Support Vector Machine (SVM). The experimental results on various datasets, including object and action image statistics show that the fusion of multiple transfer learning features improves classification accuracy as compared to fusion of multiple hand-crafted features and usage of single component transfer learning features.

Transfer Learning (TL) plays a vital role in image classification systems based on Deep Convolutional Neural Networks (DCNNs). Systems employing such technique may be susceptible to distortions on images, motivating the development of robust DCNNs capable of facing these problems. Unfortunately, changes in the architecture of DCNNs are sometimes specific to a kind of distortion and result in models that need to be retrained from scratch. This work proposes the use of autoencoders as intermediaries between pre-trained DCNNs and classifiers, delegating the denoising task to this architecture trained to encode feature maps. The classifiers are then trained to map the inputs from the autoencoder latent spaces to their respective classes. Models employing this approach achieved 3% to 4% increase in accuracy and 50% to 70% reduction in loss on the CIFAR10 and CIFAR100 datasets. The results also showed an up to 80% reduction in loss and up to 15% increase in accuracy for images with unseen distortions compared to the classical TL approach. This work improves classification results and increases robustness to distortions in a straightforward manner.

Chaos Game Representation (CGR) is an emerging means of visualising and representing genomic and proteomic sequences. There exist many open questions related to its effective application to various computational tasks. In this work, we begin to address some of these questions by comparing four variants of the Chaos Game to generate CGR imagery as part of a multi-class classification task to identify the source organism for a given protein. We propose a novel nodal configuration for icosagon and 20-flake CGRs. Using two datasets, we performed fine-tuning using seven deep convolutional neural network (CNN) architectures and report modest performance over random among the 56 test conditions, highlighting certain shortcomings in effectively leveraging CGR in conjunction with deep CNN architectures. Many of the insights from this work will serve to orient subsequent protein-related studies involving CGR-based encoding and be generally applicable to disparate domains seeking to leverage CGR for sequence-type data.

Purpose: The aim of the article is to develop an algorithm for classifying cracks in the analyzed images using modern methods of deep machine learning and transfer learning based on pretrained convolutional neural network - Inception-ResNet-v2. Design/Methodology/Approach: Transfer learning based on the pretrained convolutional neural network was used to categorize the images. The fully conected layer of the Inception-ResNet-v2 network has been modified. The last layer was trained using a two-class (binary) linear SVM (Support Vector Machine). In total, 20,000 training cases (images) were used to train the fully connected layer within transfer learning process. The research analyzed the possibility of using the deep neural networks for quick and fully automatic identification of cracks / defects on the surface of analyzed parts. Findings: The results indicate that pretrained convolutional neural network using SVM to train a fully connected layer is a very effective solution for visual crack / fault detection. In the analyzed model, a positive classification was obtained at the level of 99.89%. Practical Implications: The model presented in the article can be used in quality control carried out by process monitoring. An effective model for identifying defective parts can be used in both logistics and production processes. Originality/Value: A novelty is the use of a freely available, deep neural network trained to classify 1000 categories of various images for binary categorization of faults (cracks). The algorithm was adjusted by replacing the primary, 1000-output fully connected layer in the Inception-ResNet-v2 network with a binary layer (2 categories). The fully connected layer has been trained using the classification version of the popular SVM learner, but thanks to the combination of this layer with the sophisticated fearure extraction ability of the pre-trained Inception-ResNet-v2 deep network, the resulting predictive model enables the classification of defects with a very high level of accuracy.