• Home
  • Search
  • PLACE Dropout: A Progressive Layer-wise and Channel-wise Dropout for Domain Generalization
  • Open Access IconOpen Access
  • Cite Icon13
  • https://doi.org/10.1145/3624015Copy DOI Icon

PLACE Dropout: A Progressive Layer-wise and Channel-wise Dropout for Domain Generalization

  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Domain generalization (DG) aims to learn a generic model from multiple observed source domains that generalizes well to arbitrary unseen target domains without further training. The major challenge in DG is that the model inevitably faces a severe overfitting issue due to the domain gap between source and target domains. To mitigate this problem, some dropout-based methods have been proposed to resist overfitting by discarding part of the representation of the intermediate layers. However, we observe that most of these methods only conduct the dropout operation in some specific layers, leading to an insufficient regularization effect on the model. We argue that applying dropout at multiple layers can produce stronger regularization effects, which could alleviate the overfitting problem on source domains more adequately than previous layer-specific dropout methods. In this article, we develop a novel layer-wise and channel-wise dropout for DG, which randomly selects one layer and then randomly selects its channels to conduct dropout. Particularly, the proposed method can generate a variety of data variants to better deal with the overfitting issue. We also provide theoretical analysis for our dropout method and prove that it can effectively reduce the generalization error bound. Besides, we leverage the progressive scheme to increase the dropout ratio with the training progress, which can gradually boost the difficulty of training the model to enhance its robustness. Extensive experiments on three standard benchmark datasets have demonstrated that our method outperforms several state-of-the-art DG methods. Our code is available at https://github.com/lingeringlight/PLACEdropout .

Similar Papers
  • Dissertation
  • Citations1

Domain adaptation and generalization for visual recognition

  • Jan 01, 2017
  • Li Niu
  • Research Article
  • Citations7

Adaptive Domain Generalization Via Online Disagreement Minimization.

  • Jan 01, 2023
  • IEEE Transactions on Image Processing
  • Xin Zhang +1
  • Research Article
  • Citations25

Domain Generalization for Face Anti-Spoofing via Negative Data Augmentation

  • Jan 01, 2023
  • IEEE Transactions on Information Forensics and Security
  • Weihang Wang +4
  • Research Article
  • Citations1

Restoration towards decomposition: A simple approach for domain generalization

  • Jun 21, 2024
  • Information Sciences
  • Mengwei Li +2
  • PDF
  • Research Article
  • Citations5

Local domain generalization with low-rank constraint for EEG-based emotion recognition.

  • Nov 07, 2023
  • Frontiers in Neuroscience
  • Jianwen Tao +2
  • Book Chapter
  • Citations31

Self-distilled Vision Transformer for Domain Generalization

  • Jan 01, 2023
  • Maryam Sultana +4
  • Research Article
  • Citations23

Generative Inference Network for Imbalanced Domain Generalization.

  • Jan 01, 2023
  • IEEE Transactions on Image Processing
  • Haifeng Xia +2
  • Research Article
  • Citations15

Fault Diagnosis of Unseen Modes in Chemical Processes Based on Labeling and Class Progressive Adversarial Learning

  • Jan 01, 2023
  • IEEE Transactions on Instrumentation and Measurement
  • Yutang Xiao +5
  • Research Article
  • Citations24

Style and content separation network for remote sensing image cross-scene generalization

  • May 22, 2023
  • ISPRS Journal of Photogrammetry and Remote Sensing
  • Sihan Zhu +3
  • Research Article
  • Citations20

Single Domain Generalization Method for Remote Sensing Image Segmentation via Category Consistency on Domain Randomization

  • Jan 01, 2024
  • IEEE Transactions on Geoscience and Remote Sensing
  • Chenbin Liang +3
  • Research Article
  • Citations70

Feature-Based Style Randomization for Domain Generalization

  • Aug 01, 2022
  • IEEE Transactions on Circuits and Systems for Video Technology
  • Yue Wang +3
  • Research Article
  • Citations7

It takes two: Dual Branch Augmentation Module for domain generalization

  • Jan 02, 2024
  • Neural Networks
  • Jingwei Li +3
  • Research Article
  • Citations2

Diverse Target and Contribution Scheduling for Domain Generalization.

  • Jan 01, 2025
  • IEEE transactions on image processing : a publication of the IEEE Signal Processing Society
  • Shaocong Long +4
  • Research Article
  • Citations29

Better pseudo-label: Joint domain-aware label and dual-classifier for semi-supervised domain generalization

  • Aug 18, 2022
  • Pattern Recognition
  • Ruiqi Wang +3
  • Conference Article
  • Citations1

Discovery of New Multi-Level Features for Domain Generalization via Knowledge Corruption

  • Aug 21, 2022
  • Ahmed Frikha +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.