• https://doi.org/10.1109/tcsvt.2025.3576937Copy DOI Icon

ClipMix for Domain Generalization

  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Domain Generalization (DG) is a growing field in machine learning that aims to train the model across multiple source domains, thereby enabling effective generalization to new, unseen target domains. Recent studies suggest that data augmentation, which enhances the diversity of the source domain, might be a promising solution to address this task. Current data augmentation methods use random fusion coefficients or local regional fusion, which cannot adaptively design the weights based on data, or preserve the integrity of original semantics. Inspired by the pre-trained model CLIP, which contains extensive multimodal knowledge, we propose ClipMix to address these limitations. Firstly, we use the CLIP model as the external knowledge to adaptively evaluate the alignment between images and their labels, using this alignment to assess the complexity of learning each image and guide adaptive augmentation. Secondly, we implement a label shift mechanism to dynamically assign soft labels to fused images, helping the model focus on hard-to-learn patterns and also gather domain-agnostic representation. Furthermore, we enhance the diversity of fused images at both the pixel and feature levels. Experimental results across sixteen domains from four databases verify the effectiveness of our method.

Similar Papers
  • Book Chapter
  • Citations3

Learning Cross-Domain Features for Domain Generalization on Point Clouds

  • Jan 01, 2022
  • Hang Xiao +2
  • Conference Article
  • Citations263

Learning to Diversify for Single Domain Generalization

  • Oct 01, 2021
  • Zijian Wang +4
  • Research Article
  • Citations23

Generative Inference Network for Imbalanced Domain Generalization.

  • Jan 01, 2023
  • IEEE Transactions on Image Processing
  • Haifeng Xia +2
  • Conference Article
  • Citations11

Learning Transferrable and Interpretable Representations for Domain Generalization

  • Oct 17, 2021
  • Zhekai Du +4
  • Conference Article
  • Citations1

Discovery of New Multi-Level Features for Domain Generalization via Knowledge Corruption

  • Aug 21, 2022
  • Ahmed Frikha +2
  • Conference Article
  • Citations61

Adaptive Mixture of Experts Learning for Generalizable Face Anti-Spoofing

  • Oct 10, 2022
  • Qianyu Zhou +5
  • Research Article
  • Citations1

Single-Domain Generalization via Path Flatness-Aware Optimization of Loss Landscapes.

  • Mar 01, 2026
  • IEEE transactions on neural networks and learning systems
  • Zizhou Wang +7
  • Research Article
  • Citations18

Randomized Spectrum Transformations for Adapting Object Detector in Unseen Domains.

  • Jan 01, 2023
  • IEEE Transactions on Image Processing
  • Lei Zhang +5
  • Research Article
  • Citations1

Restoration towards decomposition: A simple approach for domain generalization

  • Jun 21, 2024
  • Information Sciences
  • Mengwei Li +2
  • Research Article
  • Citations43

Dual Distribution Alignment Network for Generalizable Person Re-Identification

  • May 18, 2021
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Peixian Chen +6
  • Research Article
  • Citations70

Feature-Based Style Randomization for Domain Generalization

  • Aug 01, 2022
  • IEEE Transactions on Circuits and Systems for Video Technology
  • Yue Wang +3
  • Research Article

Generalizing to Unseen Domains With Wasserstein Distributional Robustness Under Limited Source Knowledge

  • Jan 01, 2025
  • IEEE Journal of Selected Topics in Signal Processing
  • Jingge Wang +4
  • Conference Article
  • Citations1

Multiple Domain-Adversarial Ensemble Learning for Domain Generalization

  • Jun 04, 2023
  • Ze-Yu Mi +2
  • Research Article
  • Citations29

Better pseudo-label: Joint domain-aware label and dual-classifier for semi-supervised domain generalization

  • Aug 18, 2022
  • Pattern Recognition
  • Ruiqi Wang +3
  • Conference Article
  • Citations45

Towards Unsupervised Domain Generalization

  • Jun 01, 2022
  • Xingxuan Zhang +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.