A Deep Active Learning Framework for Crack Detection in Digital Images of Paintings

Data annotation for training of supervised learning algorithms has been a very costly procedure. The aim of deep active learning methodologies is to acquire the highest performance in supervised deep learning models by annotating as few data points as possible. As the feature space of data grows, the application of linear models in active learning settings has become insufficient. Therefore, Deep Bayesian Active Learning methodology which represents model uncertainty has been widely studied. In this paper, a study has been conducted in order to increase the performance of Deep Bayesian Active Learning method. Feature dimensionality reduction is performed on data set by using Variational Autoencoder model. Low dimensional data is used to train a Bayesian Multi Layer Perceptron. The proposed method outperformed the Bayesian Multi Layer Perceptron model which is trained on entire feature space in terms of accuracy performance. The accuracy of the proposed method is tested on baseline datasets.

Osteochondrodysplasia, affecting 2–3% of newborns globally, is a group of bone and cartilage disorders that often result in head malformations, contributing to childhood morbidity and reduced quality of life. Current research on this disease using mouse models faces challenges since it involves accurately segmenting (precisely delineating) the developing cartilage in 3D micro-CT images of embryonic mice. Tackling this segmentation task with deep learning (DL) methods is laborious due to the big burden of manual image annotation, expensive due to the high acquisition costs of 3D micro-CT images, and difficult due to embryonic cartilage’s complex and rapidly changing shapes. While DL approaches have been proposed to automate cartilage segmentation, most such models have limited accuracy and generalizability, especially across data from different embryonic age groups. To address these limitations, we propose novel DL methods that can be adopted by any DL architectures—including Convolutional Neural Networks (CNNs), Transformers, or hybrid models—which effectively leverage age and spatial information to enhance model performance. Specifically, we propose two new mechanisms, one conditioned on discrete age categories and the other on continuous image crop locations, to enable an accurate representation of cartilage shape changes across ages and local shape details throughout the cranial region. Extensive experiments on multi-age cartilage segmentation datasets show significant and consistent performance improvements when integrating our conditional modules into popular DL segmentation architectures. On average, we achieve a 1.7% Dice score increase with minimal computational overhead and a 7.5% improvement on unseen data. These results highlight the potential of our approach for developing robust, universal models capable of handling diverse datasets with limited annotated data, a key challenge in DL-based medical image analysis.

Classify image into benign and malignant is one of the basic image processing tools in digital pathology for breast cancer diagnosis. Deep learning methods have received more attention recently by training with large-scale labeled datas, but collecting and annotating clinical data is professional and time-consuming. The proposed work develops a deep active learning framework to reduce the annotation burden, where the method actively selects the valuable unlabeled samples to be annotated instead of random selecting. Besides, compared with standard query strategy in previous active learning methods, the proposed query strategy takes advantage of manual labeling and auto-labeling to emphasize the confidence boosting effect. We validate the proposed work on a public histopathological image dataset. The experimental results demonstrate that the proposed method is able to reduce up to 52% labeled data compared with random selection. It also outperforms deep active learning method with standard query strategy in the same tasks.

Deep learning methods have become popular among researchers in the field of fault detection. However, their performance depends on the availability of big datasets. To overcome this problem researchers started applying transfer learning to achieve good performance from small available datasets, by leveraging multiple prediction models over similar machines and working conditions. However, the influence of negative transfer limits their application. Negative transfer among prediction models increases when the environment and working conditions are changing continuously. To overcome the effect of negative transfer, we propose a novel deep transfer learning method, coined deep boosted transfer learning, for wind turbine gearbox fault detection that prevents negative transfer and only focuses on relevant information from the source machine. The proposed method is an instance-based deep transfer learning method that updates the weights of the source and the target machine training samples separately. The weights of different source training samples are gradually decreased to reduce the impact on the final model. The proposed method is verified by the Case Western Reserve University bearing and real field wind farm datasets. The results show that the proposed method ignores negative transfer and achieves higher accuracy compared to standard deep learning and deep transfer learning methods.

Most existing person re-identification(Re-ID) approaches achieve superior results based on the assumption that a large amount of pre-labelled data is usually available and can be put into training phrase all at once. However, this assumption is not applicable to most real-world deployment of the Re-ID task. In this work, we propose an alternative reinforcement learning based human-in-the-loop model which releases the restriction of pre-labelling and keeps model upgrading with progressively collected data. The goal is to minimize human annotation efforts while maximizing Re-ID performance. It works in an iteratively updating framework by refining the RL policy and CNN parameters alternately. In particular, we formulate a Deep Reinforcement Active Learning (DRAL) method to guide an agent (a model in a reinforcement learning process) in selecting training samples on-the-fly by a human user/annotator. The reinforcement learning reward is the uncertainty value of each human selected sample. A binary feedback (positive or negative) labelled by the human annotator is used to select the samples of which are used to fine-tune a pre-trained CNN Re-ID model. Extensive experiments demonstrate the superiority of our DRAL method for deep reinforcement learning based human-in-the-loop person Re-ID when compared to existing unsupervised and transfer learning models as well as active learning models.

Label shift conditioned hybrid querying for deep active learning

In many real applications, the ground truths of class labels from voltage dip sequences used for training a voltage dip classification system are unknown, and require manual labelling by human experts. This paper proposes a novel deep active learning method for automatic labelling of voltage dip sequences used for the training process. We propose a novel deep active learning method, guided by a generative adversarial network (GAN), where the generator is formed by modelling data with a Gaussian mixture model and provides the estimated probability distribution function (pdf) where the query criterion of the deep active learning method is built upon. Furthermore, the discriminator is formed by a support vector machine (SVM). The proposed method has been tested on a voltage dip dataset (containing 916 dips) measured in a European country. The experiments have resulted in good performance (classification rate 83% and false alarm 3.2%), which have demonstrated the effectiveness of the proposed method.

PurposeThis study aims to investigate the current state of research using deep learning methods for text classification in the tourism and hospitality field and to propose specific guidelines for future research.Design/methodology/approachThis study undertakes a qualitative and critical review of studies that use deep learning methods for text classification in research fields of tourism and hospitality and computer science. The data was collected from the Web of Science database and included studies published until February 2022.FindingsFindings show that current research has mainly focused on text feature classification, text rating classification and text sentiment classification. Most of the deep learning methods used are relatively old, proposed in the 20th century, including feed-forward neural networks and artificial neural networks, among others. Deep learning algorithms proposed in recent years in the field of computer science with better classification performance have not been introduced to tourism and hospitality for large-scale dissemination and use. In addition, most of the data the studies used were from publicly available rating data sets; only two studies manually annotated data collected from online tourism websites.Practical implicationsThe applications of deep learning algorithms and data in the tourism and hospitality field are discussed, laying the foundation for future text mining research. The findings also hold implications for managers regarding the use of deep learning in tourism and hospitality. Researchers and practitioners can use methodological frameworks and recommendations proposed in this study to perform more effective classifications such as for quality assessment or service feature extraction purposes.Originality/valueThe paper provides an integrative review of research in text classification using deep learning methods in the tourism and hospitality field, points out newer deep learning methods that are suitable for classification and identifies how to develop different annotated data sets applicable to the field. Furthermore, foundations and directions for future text classification research are set.

Chest X-ray imaging plays a vital role in the evaluation of thoracic organs, serving as a primary diagnostic tool for various pulmonary conditions. Interpretations of chest X-ray reports can sometimes differ from a physician’s clinical judgment, leading to diagnostic inconsistencies and potential delays in treatment. This study explores whether the application of advanced deep transfer learning techniques can improve the accuracy of chest X-ray interpretation. Deep Learning presents powerful capabilities for processing and interpreting complex imaging data. Convolutional Neural Networks (CNNs) are widely used in deep learning to perform image classification through hierarchical feature extraction. training deep models with large annotated datasets often demands significant computational resources. In this research, MobileNet and Inception V3 architectures are employed to detect diseases such as lung cancer, pneumonia, and tuberculosis from chest X-ray images. Conducted a detailed evaluation of these models and compare their performance with traditional diagnostic approaches. The results demonstrate notable improvements in accuracy and sensitivity, confirming that deep transfer learning techniques significantly enhance diagnostic outcomes. This suggests that MobileNet and Inception V3 can serve as reliable, efficient tools to support radiologists in early detection and decision-making, and contributing to more timely and accurate medical diagnoses.

Style Adaptation Algorithm for Auto-delineation of Rectal Cancer Clinical Target Volume with Deep Active Learning and Attention Mechanism

Facial age recognition has been widely used in real-world applications. Most of current facial age recognition methods use deep learning to extract facial features to identify age. However, due to the high dimension features of faces, deep learning methods might extract a lot of redundant features, which is not beneficial for facial age recognition. To improve facial age recognition effectively, this paper proposed the deep manifold learning (DML), a combination of deep learning and manifold learning. In DML, deep learning was used to extract high-dimensional facial features, and manifold learning selected age-related features from these high-dimensional facial features for facial age recognition. Finally, we validated the DML on Multivariate Observations of Reactions and Physical Health (MORPH) and Face and Gesture Recognition Network (FG-NET) datasets. The results indicated that the mean absolute error (MAE) of MORPH is 1.60 and that of FG-NET is 2.48. Moreover, compared with the state of the art facial age recognition methods, the accuracy of DML has been greatly improved.

Automatic assessment of pain based on deep learning methods: A systematic review

This review paper examines the current state of lung disease diagnosis based on deep learning (DL) methods. Lung diseases, such as Pneumonia, TB, Covid-19, and lung cancer, are significant causes of morbidity and mortality worldwide. Accurate and timely diagnosis of these diseases is essential for effective treatment and improved patient outcomes. DL methods, which utilize artificial neural networks to extract features from medical images automatically, have shown great promise in improving the accuracy and efficiency of lung disease diagnosis. This review discusses the various DL methods that have been developed for lung disease diagnosis, including convolutional neural networks (CNNs), deep neural networks (DNNs), and generative adversarial networks (GANs). The advantages and limitations of each method are discussed, along with the types of medical imaging techniques used, such as X-ray and computed tomography (CT). In addition, the review discusses the most commonly used performance metrics for evaluating the performance of DL for lung disease diagnosis: the area under the curve (AUC), sensitivity, specificity, F1-score, accuracy, precision, and the receiver operator characteristic curve (ROC). Moreover, the challenges and limitations of using DL for lung disease diagnosis, including the limited availability of annotated data, the variability in imaging techniques and disease presentation, and the interpretability and generalizability of DL models, are highlighted in this paper. Furthermore, strategies to overcome these challenges, such as transfer learning, data augmentation, and explainable AI, are also discussed. The review concludes with a call for further research to address the remaining challenges and realize DL's full potential for improving lung disease diagnosis and treatment.

Image target detection and recognition is an important research area in image understanding and computer vision, and has attracted extensive attention of scholars for its wide application. In recent years, with the enlightenment of human vision system, deep learning technology has been put forward, and has become a hot spot. The deep learning model has a multi-layer network structure, which can overcome the shortcomings of the traditional image target recognition methods. In the detection and recognition of image targets, deep learning methods are more and more widely used. This is because the deep learning multilayer network structure can express complex functions in a more concise way than the shallow network, and can learn the deep feature representation. Therefore, this paper uses the method based on deep learning, researches on image target detection and recognition, mainly introduces the region proposal based on the depth of learning based target recognition method of support vector machine algorithm and target detection depth. In this paper, deep learning is applied to image detection and recognition, further to improve the accuracy of image detection and recognition. It has important guiding significance in deep learning and image research.

Sentiment analysis is a subfield of Natural Language Processing (NLP) which tries to process a text to extract opinions or attitudes towards topics or entities. Recently, the use of deep learning methods for sentiment analysis has received noticeable attention from researchers. Generally, different deep learning methods have shown superb performance in sentiment analysis problem. However, deep learning models are different in nature and have different strengths and limitations. For example, convolutional neural networks are useful for extracting local structures from data, while recurrent models are able to learn order dependence in sequential data. In order to combine the advantages of different deep models, in this paper we have proposed a novel approach for aspect-based sentiment analysis which utilizes deep ensemble learning. In the proposed method, we first build four deep learning models, namely CNN, LSTM, BiLSTM and GRU. Then the outputs of these models are combined using stacking ensemble approach where we have used logistic regression as meta-learner. The results of applying the proposed method on the real datasets show that our method has increased the accuracy of aspect-based prediction by 5% to 20% compared to the basic deep learning methods.