Deep‑learning based osteoporosis classification in knee X‑rays using transfer‑learning approach

Brain tumour detection is a critical medical procedure where early and accurate diagnosis significantly improves patient outcomes. This study explores the application of deep learning models, specifically VGG19 and InceptionV3, for detecting brain tumours in MRI images. We fine-tuned both models using transfer learning and evaluated them on a dataset of MRI scans. InceptionV3 achieved 100% validation accuracy, while VGG19 achieved 95%, demonstrating their high efficacy in medical image classification. In addition to deep learning, the study integrates insights from traditional image processing techniques, such as edge detection and probabilistic neural networks (PNNs), highlighting how combining deep learning with traditional methods can enhance image preprocessing and quality. The results underscore that while deep learning models are highly effective in brain tumour classification, traditional techniques still play a vital role in optimizing the overall detection process.

Plant disease detection plays a critical role in ensuring agricultural productivity and food security. Accurate and efficient identification of plant diseases can aid in timely interventions, reducing potential crop losses. This paper presents a comprehensive study involving the application of deep learning models, namely CNN, ResNet, VGG, and Inception, to grayscale plant disease image datasets for apple, grape, and corn. The datasets consist of grayscale images divided into multiple disease classes. Initial experiments using standard deep learning models demonstrated reasonable accuracy. To further enhance performance, manual feature extraction techniques, including Histogram of Oriented Gradients (HOG), Oriented FAST and Rotated BRIEF (ORB), and Scale-Invariant Feature Transform (SIFT), were applied alongside deep features extracted using pretrained VGG and ResNet models. The extracted deep learning and handcrafted features were concatenated to form a comprehensive feature set. A Random Forest Classifier (RFC) was then applied to this combined feature set, resulting in improved accuracy compared to individual models.

Detecting programmed death ligand 1 (PD-L1) expression based on immunohistochemical (IHC) staining is an important guide for the treatment of lung cancer with immune checkpoint inhibitors. However, this method has problems such as high staining costs, tumor heterogeneity, and subjective differences among pathologists. Therefore, the application of deep learning models to segment and quantitatively predict PD-L1 expression in digital sections of Hematoxylin and eosin (H&E) stained lung squamous cell carcinoma is of great significance. We constructed a dataset comprising H&E-stained digital sections of lung squamous cell carcinoma and used a Transformer Unet (TransUnet) deep learning network with an encoder-decoder design to segment PD-L1 negative and positive regions and quantitatively predict the tumor cell positive score (TPS). The results showed that the dice similarity coefficient (DSC) and intersection overunion (IoU) of deep learning for PD-L1 expression segmentation of H&E-stained digital slides of lung squamous cell carcinoma were 80 and 72%, respectively, which were better than the other seven cutting-edge segmentation models. The root mean square error (RMSE) of quantitative prediction TPS was 26.8, and the intra-group correlation coefficients with the gold standard was 0.92 (95% CI: 0.90-0.93), which was better than the consistency between the results of five pathologists and the gold standard. The deep learning model is capable of segmenting and quantitatively predicting PD-L1 expression in H&E-stained digital sections of lung squamous cell carcinoma, which has significant implications for the application and guidance of immune checkpoint inhibitor treatments. And the link to the code is https://github.com/Baron-Huang/PD-L1-prediction-via-HE-image.

Deep learning empowers the Google Earth Engine for automated water extraction in the Lake Baikal Basin

This chapter investigates the integration aspects between the Internet of Things and deep learning technologies in efforts directed toward advancing food quality monitoring, thus enhancing issues of safety and food freshness in the supply chain. IoT sensors capture real-time data with regard to environmental conditions including temperature, humidity, and gas composition all through the food production and supply process. Such data is analyzed by deep learning algorithms to detect any kind of anomalies and predict the potential hazards to enable proactive actions toward timely intervention. The chapter deals some IoT devices used for monitoring, namely smart sensors and wearable technologies, while comparing the application of deep learning models for predictive and pattern recognition analytics. Case studies underscore this integrated approach to reducing spoilage, increasing shelf life, and meeting the requirements put forth by today's safety standards.

Deep learning has emerged as a powerful tool in various domains, revolutionising machine learning research. However, one persistent challenge is the scarcity of labelled training data, which hampers the performance and generalisation of deep learning models. To address this limitation, researchers have developed innovative methods to overcome data scarcity and enhance deep model learning capabilities. Two prevalent techniques that have gained significant attention are transfer learning and self-supervised learning. Transfer learning leverages knowledge learned from pre-training on a large-scale dataset, such as ImageNet, and applies it to a target task with limited labelled data. This approach allows models to benefit from the learned representations and effectively transfer knowledge to new tasks, resulting in improved learning performance and generalisation. On the other hand, self-supervised learning focuses on training models using pretext tasks that do not require manual annotation, allowing them to learn valuable representations from large amounts of unlabelled data. These learned representations can then be fine-tuned for downstream tasks, mitigating the need for extensive labelled data. In recent years, transfer and self-supervised learning have found applications in various fields, including medical image processing, video recognition, and natural language processing. These approaches have demonstrated remarkable achievements, enabling breakthroughs in areas such as disease diagnosis, object recognition, and language understanding. However, while these methods offer numerous advantages, they also have limitations. For example, transfer learning may face domain mismatch issues between the pre-training and target domains, while self-supervised learning requires careful design of pretext tasks to ensure meaningful representations. This review paper explores the recent applications of these pre-training methods in various fields within the past three years. It delves into the advantages and limitations of each approach, assesses the performance of models employing these techniques, and identifies potential directions for future research. By providing a comprehensive review of current pre-training methods, this article offers guidance for selecting the best technique for specific deep learning applications to address the data scarcity issue.

Objective: To design a deep transfer learning framework for modeling fluence map predictions for stereotactic body radiation therapy (SBRT) of adrenal cancer and similar sites that usually have a small number of cases. Approach: We developed a transfer learning framework for adrenal SBRT planning that leverages knowledge in a pancreas SBRT planning model. Treatment plans from the two sites had different dose prescriptions and beam settings but both prioritized gastrointestinal sparing. A base framework was first trained with 100 pancreas cases. This framework consists of two convolutional neural networks (CNN), which predict individual beam doses (BD-CNN) and fluence maps (FM-CNN) sequentially for 9-beam intensity-modulated radiation therapy (IMRT) plans. Forty-five adrenal plans were split into training/validation/test sets with the ratio of 20/10/15. The base BD-CNN was re-trained with transfer learning using 5/10/15/20 adrenal training cases to produce multiple candidate adrenal BD-CNN models. The base FM-CNN was directly used for adrenal cases. The deep learning (DL) plans were evaluated by several clinically relevant dosimetric endpoints, producing a percentage score relative to the clinical plans. Main results: Transfer learning significantly reduced the number of training cases and training time needed to train such a DL framework. The adrenal transfer learning model trained with 5/10/15/20 cases achieved validation plan scores of 85.4/91.2/90.7/89.4, suggesting that model performance saturated with 10 training cases. Meanwhile, a model using all 20 adrenal training cases without transfer learning only scored 80.5. For the final test set, the 5/10/15/20-case models achieved scores of 73.5/75.3/78.9/83.3. Significance: It is feasible to use deep transfer learning to train an IMRT fluence prediction framework. This technique could adapt to different dose prescriptions and beam configurations. This framework potentially enables DL modeling for clinical sites that have a limited dataset, either due to few cases or due to rapid technology evolution.

Uncertainty quantification-based robust deep learning for building energy systems considering distribution shift problem

There are some problems in feature extraction and representation of Chinese mental verbs, such as low accuracy and low efficiency. In order to further improve the computational efficiency and accuracy of Chinese mental verb text, based on deep learning theory, activation function and damage function were used to optimize the original model. Considering the calculation method of model gradient, the optimization model describing the characteristics of Chinese mental verbs is finally obtained. The model can be used to analyze the variation of the characteristic parameters of Chinese verbs and the method of representation. Finally, the model error is analyzed by the method of comparative verification. Relevant studies show that the number of outputs and output results corresponding to softmax function will influence the test results of the model. By comparing the curves, it can be seen that the curve corresponding to the output number has an obvious increasing trend, while the corresponding output result curve has an opposite changing trend. The linear and nonlinear characteristics of the two curves are obvious. The real value of the mean square error function shows a change of linear increase, while the corresponding output value shows a change trend of gradual decline, which indicates that the two kinds of data have different influences on the model under related algorithms. It can be seen from the error data that the gradual increase of independent variables will improve the accuracy of the test results. Five different Chinese mental verb parameters have different manifestations in the deep learning model: among them, declarative verbs fluctuate in a small range and have little corresponding influence. However, the fluctuation of nondeclarative verbs and positive and negative declarative verbs is relatively small, and the curve is relatively stable. Negative verbs have a positive influence on the test output. Double negative verbs have negative effects. Finally, the accuracy of the model is verified by calculating the difference between experimental data and model data. This research can provide theoretical support and model verification method for the application of deep learning model in other fields of Chinese language.

Deep learning has become widely used in image analysis. Transfer learning can make use of information from other datasets for the analysis of the chosen dataset. When there is a small number of images at hand, transfer learning using pre-trained models with coefficients already estimated from other datasets is recommended. This is in contrast to deep learning, where most model parameters are re-estimated. Deep transfer learning uses pre-trained models with fixed weight parameters in the lower layers; thus, deep learning can be viewed as a two-stage approach: (1) feature extraction from a lower neural network layer and (2) estimation of a neural network using the extracted features as inputs. Since deep transfer learning is feature extraction, we can extend the two-stage approach to a more general two-stage framework: (1) feature extraction using multiple methods and (2) machine learning methods taking extracted features as inputs. We evaluate the performance of methods with different Stage 1 and Stage 2 approaches in predicting the phenotype leaf numbers based on a multi-view plant imaging dataset. This paper contains an evaluation of different two-stage machine learning methods for multi-view image data in plant image phenotyping.

Depression is one of the most prevalent mental health disorders, significantly impacting an individual's well-being and daily functioning. Early detection is critical for timely intervention, yet traditional diagnostic methods remain subjective and resource-intensive. This paper explores a speech-based approach to depression detection using multi-modal open dataset for mental-disorder analysis (MODMA), which consists of speech recordings from 52 subjects, including 23 depressed individuals and 29 healthy controls. The dataset was preprocessed by segmenting speech signals into non-overlapping 1-second audio segments, resulting in a total of 26, 590 samples. Spectrograms of size 224 × 224 were generated using the short-time Fourier transform to capture time-frequency representations, facilitating the application of deep learning models. Three pre-trained convolutional neural networks i.e., ResNet-50, VGG-19, and EfficientNet-B0 were fine-tuned and evaluated for their ability to classify depressive states. Among these models, EfficientNet-B0 achieved the highest classification accuracy of 95.68%, demonstrating the effectiveness of transfer learning for speech-based depression detection. The results highlight the potential of deep learning in developing objective, scalable, and non-invasive diagnostic tools for mental health assessment. This research contributes to advancing automated depression detection and highlights the feasibility of using a 1-second speech signal segment as a reliable biomarker for mental health disorders.

Alzheimer’s Disease (AD) is a health apprehension of significant proportions that is negatively impacting the ageing population globally. It is characterized by neuronal loss and the formation of structures such as neurofibrillary tangles and amyloid plaques in the early as well as later stages of the disease. Neuroimaging modalities are routinely used in clinical practice to capture brain alterations associated with AD. On the other hand, deep learning methods are routinely used to recognize patterns in underlying data distributions effectively. This work uses Convolutional Neural Network (CNN) architectures in both 2D and 3D domains to classify the initial stages of AD into AD, Mild Cognitive Impairment (MCI) and Normal Control (NC) classes using the positron emission tomography neuroimaging modality deploying data augmentation in a random zoomed in/out scheme. We used novel concepts such as the blurring before subsampling principle and distant domain transfer learning to build 2D CNN architectures. We performed three binaries, that is, AD/NC, AD/MCI, MCI/NC and one multiclass classification task AD/NC/MCI. The statistical comparison revealed that 3D-CNN architecture performed the best achieving an accuracy of 89.21% on AD/NC, 71.70% on AD/MCI, 62.25% on NC/MCI and 59.73% on AD/NC/MCI classification tasks using a five-fold cross-validation hyperparameter selection approach. Data augmentation helps in achieving superior performance on the multiclass classification task. The obtained results support the application of deep learning models towards early recognition of AD.

Deep learning methods have become popular among researchers in the field of fault detection. However, their performance depends on the availability of big datasets. To overcome this problem researchers started applying transfer learning to achieve good performance from small available datasets, by leveraging multiple prediction models over similar machines and working conditions. However, the influence of negative transfer limits their application. Negative transfer among prediction models increases when the environment and working conditions are changing continuously. To overcome the effect of negative transfer, we propose a novel deep transfer learning method, coined deep boosted transfer learning, for wind turbine gearbox fault detection that prevents negative transfer and only focuses on relevant information from the source machine. The proposed method is an instance-based deep transfer learning method that updates the weights of the source and the target machine training samples separately. The weights of different source training samples are gradually decreased to reduce the impact on the final model. The proposed method is verified by the Case Western Reserve University bearing and real field wind farm datasets. The results show that the proposed method ignores negative transfer and achieves higher accuracy compared to standard deep learning and deep transfer learning methods.

Deep learning performs remarkably well on many time series analysis tasks recently. The superior performance of deep neural networks relies heavily on a large number of training data to avoid overfitting. However, the labeled data of many real-world time series applications may be limited such as classification in medical time series and anomaly detection in AIOps. As an effective way to enhance the size and quality of the training data, data augmentation is crucial to the successful application of deep learning models on time series data. In this paper, we systematically review different data augmentation methods for time series. We propose a taxonomy for the reviewed methods, and then provide a structured review for these methods by highlighting their strengths and limitations. We also empirically compare different data augmentation methods for different tasks including time series classification, anomaly detection, and forecasting. Finally, we discuss and highlight five future directions to provide useful research guidance.

Fault diagnosis keeps an essential tool to ensure the safety and reliability of a motor system. Based on deep learning, fault diagnosis models constructed by mining historical fault data of equipment have received extensive attention. However, the high computational cost constrains the application of deep learning models for fault diagnosis, especially when coping with multisource data. Inspired by the model reduction and neural network structure automatic search method, this article proposed a light weight multisensory fusion model for induction motor data fusion and diagnosis. Inverted residual block and network architecture search technology are introduced to accelerate the training speed and prediction speed of the diagnostic model, so that the diagnostic accuracy is maintained at an acceptable level. The effectiveness of the proposed model is demonstrated through motor fault diagnosis experiments. Compared with other popular neural networks, the proposed method is capable of judging fault patterns accurately with shorter prediction time.