- Research Article
32
- 10.1016/j.eswa.2020.114490
Feature concatenation for adversarial domain adaptation
- Dec 13, 2020
- Expert Systems with Applications
- Jingyao Li + 2 more +2
Feature concatenation for adversarial domain adaptation
Adversarial domain adaptation network for tumor image diagnosis
Feature concatenation for adversarial domain adaptation
Feature concatenation for adversarial domain adaptation
AVATAR: Adversarial self-superVised domain Adaptation network for TARget domain
AVATAR: Adversarial self-superVised domain Adaptation network for TARget domain
Minimum Adversarial Distribution Discrepancy for Domain Adaptation
Domain adaptation (DA) refers to generalize a learning technique across the source domain and target domain under different distributions. Therefore, the essential problem in DA is how to reduce the distribution discrepancy between the source and target domains. Typical methods are to embed the adversarial learning technique into deep networks to learn transferable feature representations. However, existing adversarial related DA methods may not sufficiently minimize the distribution discrepancy. In this article, a DA method minimum adversarial distribution discrepancy (MADD) is proposed by combining feature distribution with adversarial learning. Specifically, we design a novel divergence metric loss, named maximum mean discrepancy based on conditional entropy (MMD-CE), and embed it in the adversarial DA network. The proposed MMD-CE loss can address two problems: 1) the misalignment from different class distributions between domains and 2) the equilibrium challenge issue in adversarial DA. Comparative experiments on Office-31, ImageCLEF-DA, and Office-Home data sets with state-of-the-art methods show that our method has some advantageous performances.
Read moreAlleviating the generalization issue in adversarial domain adaptation networks
Alleviating the generalization issue in adversarial domain adaptation networks
Unsupervised Adversarial Domain Adaptation Network for Semantic Segmentation
With the rapid development of deep learning technology, semantic segmentation methods have been widely used in remote sensing data. A pretrained semantic segmentation model usually cannot perform well when the testing images (target domain) have an obvious difference from the training data set (source domain), while a large enough labeled data set is almost impossible to be acquired for each scenario. Unsupervised domain adaptation (DA) techniques aim to transfer knowledge learned from the source domain to a totally unlabeled target domain. By reducing the domain shift, DA methods have shown the ability to improve the classification accuracy for the target domain. Hence, in this letter, we propose an unsupervised adversarial DA network that converts deep features into 2-D feature curves and reduces the discrepancy between curves from the source domain and curves from the target domain based on a conditional generative adversarial networks (cGANs) model. Our proposed DA network is able to improve the semantic labeling accuracy when we apply a pretrained semantic segmentation model to the target domain. To test the effectiveness of the proposed method, experiments are conducted on the International Society for Photogrammetry and Remote Sensing (ISPRS) 2-D Semantic Labeling data set. Results show that our proposed network is able to stably improve overall accuracy not only when the source and target domains are from the same city but with different building styles but also when the source and target domains are from different cities and acquired by different sensors. By comparing with a few state-of-the-art DA methods, we demonstrate that our proposed method achieves the best cross-domain semantic segmentation performance.
Read moreAdversarial domain adaptation network with pseudo-siamese feature extractors for cross-bearing fault transfer diagnosis
Adversarial domain adaptation network with pseudo-siamese feature extractors for cross-bearing fault transfer diagnosis
Multimodal Vigilance Estimation with Adversarial Domain Adaptation Networks
Robust vigilance estimation during driving is very crucial in preventing traffic accidents. Many approaches have been proposed for vigilance estimation. However, most of the approaches require collecting subject-specific labeled data for calibration which is high-cost for real-world applications. To solve this problem, domain adaptation methods can be used to align distributions of source subject features (source domain) and new subject features (target domain). By reusing existing data from other subjects, no labeled data of new subjects is required to train models. In this paper, our goal is to apply adversarial domain adaptation networks to cross-subject vigilance estimation. We adopt two kinds of recently proposed adversarial domain adaptation networks and compare their performance with those of several traditional domain adaptation methods and the baseline without domain adaptation. A publicly available dataset, SEED-VIG, is used to evaluate the methods. The dataset includes electroencephalography (EEG) and electrooculography (EOG) signals, as well as the corresponding vigilance level annotations during simulated driving. Compared with the baseline, both adversarial domain adaptation networks achieve improvements over 10% in terms of Pearson's correlation coefficient. In addition, both methods considerably outperform the traditional domain adaptation methods.
Read moreA Feature Decomposition-Based Method for Automatic Ship Detection Crossing Different Satellite SAR Images
In the face of Synthetic Aperture Radar (SAR) image object detection with different distributions of training and test data, traditional supervised learning methods cannot achieve good detection performance. Domain adaptation (DA) method has been shown to have the ability to solve this problem, but existing DA object detection algorithms all use adversarial DA theory for the detection task, which is ineffective in solving object regression localization in the detection task. In this article, to better solve the above problem, an automatic SAR image ship detection method based on feature decomposition crossing different satellites is proposed. The feature extraction layer of backbone network is divided into low level and high level, where domain-invariant feature extractors are designed for the local features extracted from the low level and the global features extracted from the high level, respectively. We argue that the local and global features extracted from source domain and target domain contain domain-specific features (DSF) for adversarial DA and domain-invariant features (DIF) that contribute to object regression localization. Then, we decompose the local features and global features into DSF and DIF via vector decomposition method. For DSF counterpart, we introduce adversarial DA attention for feature alignment. DIF from the local features are fused into the backbone network for high-level global feature extraction. Finally, by using region proposal network and adversarial domain classifier, we can get the accurate bounding box and object class of SAR image objects. Extensive experiments prove that the proposed method outperforms state-of-the-art methods in terms of detection performance.
Read moreDeep transferable label propagation with prototypical augmentation.
Domain adaptation (DA) seeks to utilize ample labeled data from a source domain to boost the generalization capability of models on an unlabeled target domain with divergent data distributions. Label Propagation (LP) has emerged as an efficient semi-supervised learning paradigm for DA, transferring labels between the source and target domains based on a similarity graph. Nevertheless, existing LP-based DA methods still face significant challenges: (1) Semantic insufficiency in the source training domain impairs the performance of classes with sparse structures, particularly minority classes; (2) Generated pseudo-labels exhibit low reliability due to ambiguous feature distributions; (3) The two-phase architecture decouples domain-invariant feature learning from label propagation, thus failing to achieve mutual enhancement between these two processes for DA tasks; (4) Sample-level graph construction incurs prohibitive computational costs and poor scalability when handling large-scale datasets. To address these issues, we propose a novel DA strategy, Deep Transferable Label Propagation (DTLP), that integrates prototypical augmentation techniques. Specifically, DTLP embeds three core modules into a unified end-to-end system: (1) Prototype-guided feature augmentation, termed Prototypical Augmentation (ProAug), which enriches the semantic content of the source domain by interpolating samples with class prototypes to mitigate semantic deficiency; (2) Prototype graph-based label propagation, which constructs a class-level prototypical graph rather than a sample-level one to reduce computational complexity and alleviate class imbalance; (3) Domain alignment via prototypical contrastive learning, which facilitates dynamic mutual optimization between domain-invariant feature extraction and robust label propagation while narrowing domain discrepancy. Comprehensive experiments on various benchmark datasets demonstrate that the proposed DTLP outperforms state-of-the-art LP-based DA methods, validating its effectiveness and generalizability.
Read moreFeature disentanglement based domain adaptation network for cross-scene coastal wetland hyperspectral image classification
Feature disentanglement based domain adaptation network for cross-scene coastal wetland hyperspectral image classification
Read moreGenerative attention adversarial classification network for unsupervised domain adaptation
Generative attention adversarial classification network for unsupervised domain adaptation
Improving Unsupervised Domain Adaptation via Multiple Adversarial Learning
<p>Most machine learning methods assume the training and test sets to be independent and have identical distributions. However, this assumption does not always hold true in practical applications. Direct training usually induces poor performance if the training and test data have distribution shifts. To address this issue, a three-part model based on using a feature extractor, a classifier, and several domain discriminators is adopted herein. This unsupervised domain adaptation model is based on multiple adversarial learning with samples of different importance. A deep neural network is used for supervised classification learning of the source domain. Numerous adversarial networks are used to constitute the domain discriminators to align each category in the source and target domains and effectively transfer knowledge from the source domain to the target domain. Triplet loss functions&mdash;classification loss, label credibility loss, and discrimination loss&mdash;are presented to further optimize the model parameters. First, the label similarity metric is designed between the target and source domains data. Second, a credibility loss function is proposed to obtain an accurate label for the unlabeled data of the target domain under training iterations. Finally, a discrimination loss is designed for multiple adversarial domain discriminators to fully utilize the unlabeled data in the target domain during training. The discrimination loss function uses predicted label probabilities as dynamic weights for the train data. The proposed method is compared with mainstream domain adaptation approaches on four public datasets: Office-31, MNIST, USPS, and SVHN. Experimental results show that the proposed method can perform well in the target domain and improve generalization performance of the model.</p> <p>&nbsp;</p>
Read moreDomain adaptation with contrastive and adversarial oriented transferable semantic augmentation
Domain adaptation with contrastive and adversarial oriented transferable semantic augmentation
Partial adversarial domain adaptation by dual-domain alignment for fault diagnosis of rotating machines
Partial adversarial domain adaptation by dual-domain alignment for fault diagnosis of rotating machines
Pseudo-Label-Assisted Subdomain Adaptation for Hyperspectral Image Classification
Cross-domain classification of hyperspectral data is a critical challenge in remote sensing, especially when labels are unavailable in the target domain. Deep learning-based domain adaptation (DA) methods have been widely used in recent years. However, curren methods primarily focus on the global domain structure of the source and target domains when considering domain adaptation, neglecting the subdomain structure within each class. Additionally, current methods directly employ predicted outputs without further exploring the confidence level of the target domain samples. These limitations lead to confusion in domain adaptation and hinder effective feature selection in neural networks. In this paper, we propose the Pseudo-Label-Assisted Subdomain Adaptation (PASDA) method, which addresses these limitations by jointly considering the subdomain structure of the source and target domains and adopting a sample selection strategy. PASDA aligns the subdomains while learning domain-invariant features as a foundation. Furthermore, it selects high-quality pseudo-labeled samples from the target domain to enhance the learning of domain-invariant features. For generating pseudo-labels in the target domain, we employ the Reweighted Pruning Label Propagation (RPLPA) strategy to reweight the output of the predicted target domain. Finally, the high-confidence samples with pseudo-labels are selected to finetune the network. The entropy regularized dual classifier constraint is introduced to enhance the discriminative feature extraction ability for the target domain. Extensive experiments on three public HSI cross-domain datasets, Pavia, Houston, and HyRANK, using overall accuracy (OA), average accuracy (AA) and kappa coefficient (Kappa) as the evaluation indicators of classification performance, demonstrate the superiority of our method. Compared with the existing state-of-the-art (SOTA) unsupervised domain adaptation (UDA) methods, our method improves OA by 2% and AA by 4%.
Read more