• Home
  • Search
  • Domain Adaptation and Domain Generalization with Representation Learning
  • Cite Icon2
  • https://doi.org/10.26686/wgtn.17014700.v1Copy DOI Icon

Domain Adaptation and Domain Generalization with Representation Learning

  • Jan 1, 2016
  • Muhammad Ghifary
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

<p>Machine learning has achieved great successes in the area of computer vision, especially in object recognition or classification. One of the core factors of the successes is the availability of massive labeled image or video data for training, collected manually by human. Labeling source training data, however, can be expensive and time consuming. Furthermore, a large amount of labeled source data may not always guarantee traditional machine learning techniques to generalize well; there is a potential bias or mismatch in the data, i.e., the training data do not represent the target environment. To mitigate the above dataset bias/mismatch, one can consider domain adaptation: utilizing labeled training data and unlabeled target data to develop a well-performing classifier on the target environment. In some cases, however, the unlabeled target data are nonexistent, but multiple labeled sources of data exist. Such situations can be addressed by domain generalization: using multiple source training sets to produce a classifier that generalizes on the unseen target domain. Although several domain adaptation and generalization approaches have been proposed, the domain mismatch in object recognition remains a challenging, open problem – the model performance has yet reached to a satisfactory level in real world applications. The overall goal of this thesis is to progress towards solving dataset bias in visual object recognition through representation learning in the context of domain adaptation and domain generalization. Representation learning is concerned with finding proper data representations or features via learning rather than via engineering by human experts. This thesis proposes several representation learning solutions based on deep learning and kernel methods. This thesis introduces a robust-to-noise deep neural network for handwritten digit classification trained on “clean” images only, which we name Deep Hybrid Network (DHN). DHNs are based on a particular combination of sparse autoencoders and restricted Boltzmann machines. The results show that DHN performs better than the standard deep neural network in recognizing digits with Gaussian and impulse noise, block and border occlusions. This thesis proposes the Domain Adaptive Neural Network (DaNN), a neural network based domain adaptation algorithm that minimizes the classification error and the domain discrepancy between the source and target data representations. The experiments show the competitiveness of DaNN against several state-of-the-art methods on a benchmark object dataset. This thesis develops the Multi-task Autoencoder (MTAE), a domain generalization algorithm based on autoencoders trained via multi-task learning. MTAE learns to transform the original image into its analogs in multiple related domains simultaneously. The results show that the MTAE’s representations provide better classification performance than some alternative autoencoder-based models as well as the current state-of-the-art domain generalization algorithms. This thesis proposes a fast kernel-based representation learning algorithm for both domain adaptation and domain generalization, Scatter Component Analysis (SCA). SCA finds a data representation that trades between maximizing the separability of classes, minimizing the mismatch between domains, and maximizing the separability of the whole data points. The results show that SCA performs much faster than some competitive algorithms, while providing state-of-the-art accuracy in both domain adaptation and domain generalization. Finally, this thesis presents the Deep Reconstruction-Classification Network (DRCN), a deep convolutional network for domain adaptation. DRCN learns to classify labeled source data and also to reconstruct unlabeled target data via a shared encoding representation. The results show that DRCN provides competitive or better performance than the prior state-of-the-art model on several cross-domain object datasets.</p>

Similar Papers
  • Dissertation
  • Citations1

Domain Adaptation and Domain Generalization with Representation Learning

  • Jan 01, 2016
  • Muhammad Ghifary
  • Book Chapter
  • Citations45

Dual-Teacher: Integrating Intra-domain and Inter-domain Teachers for Annotation-Efficient Cardiac Segmentation

  • Jan 01, 2020
  • Kang Li +3
  • Conference Article
  • Citations1

Multi-modal Domain Adaptation for Text Visual Question Answering Tasks

  • Nov 28, 2023
  • Zhiyuan Li +2
  • Research Article

Trust-Aware Domain Adaptation Using Physics-Guided Reliability Learning for Cross-Condition Fault Diagnosis of Milling Machines

  • Jul 14, 2026
  • Sensors (Basel, Switzerland)
  • Saif Ullah +2
  • Research Article
  • Citations83

Cross-spatiotemporal land-cover classification from VHR remote sensing images with deep learning based domain adaptation

  • Jul 18, 2022
  • ISPRS Journal of Photogrammetry and Remote Sensing
  • Muying Luo +1
  • Conference Article
  • Citations22

Continual Unsupervised Domain Adaptation for Semantic Segmentation by Online Frequency Domain Style Transfer

  • Sep 19, 2021
  • Jan-Aike Termohlen +4
  • Book Chapter
  • Citations3

Diversity-Based Generalization for Unsupervised Text Classification Under Domain Shift

  • Jan 01, 2021
  • Jitin Krishnan +2
  • Conference Article
  • Citations7

Adversarial domain adaptation for multi-device retinal OCT segmentation

  • Mar 10, 2020
  • Yufan He +5
  • Conference Article
  • Citations9

Adaptive Feature Swapping for Unsupervised Domain Adaptation

  • Oct 26, 2023
  • Junbao Zhuo +4
  • Research Article
  • Citations12

Unsupervised Domain Adaptation via Discriminative Classes-Center Feature Learning in Adversarial Network

  • May 21, 2020
  • Neural Processing Letters
  • Wendong Chen +1
  • Research Article
  • Citations154

Unsupervised Domain Adaptation via Disentangled Representations: Application to Cross-Modality Liver Segmentation.

  • Jan 01, 2019
  • Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention
  • Junlin Yang +5
  • Conference Article
  • Citations10

Partially Zero-shot Domain Adaptation from Incomplete Target Data with Missing Classes

  • Mar 01, 2020
  • Masato Ishii +2
  • Research Article
  • Citations172

Correlation-aware adversarial domain adaptation and generalization

  • Nov 28, 2019
  • Pattern Recognition
  • Mohammad Mahfujur Rahman +3
  • PDF
  • Research Article
  • Citations33

Multi-View Collaborative Learning for Semi-Supervised Domain Adaptation

  • Jan 01, 2021
  • IEEE Access
  • Ba Hung Ngo +3
  • PDF
  • Research Article
  • Citations5

On the Importance of Attention and Augmentations for Hypothesis Transfer in Domain Adaptation and Generalization

  • Oct 12, 2023
  • Sensors (Basel, Switzerland)
  • Rajat Sahay +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.