• Home
  • Search
  • MCKD: Mutually Collaborative Knowledge Distillation For Federated Domain Adaptation And Generalization
  • Cite Icon7
  • https://doi.org/10.1109/icassp49357.2023.10095699Copy DOI Icon

MCKD: Mutually Collaborative Knowledge Distillation For Federated Domain Adaptation And Generalization

  • Jun 4, 2023
  • Ziwei Niu +5 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Conventional unsupervised domain adaptation (UDA) and domain generalization (DG) methods rely on the assumption that all source domains can be directly accessed and combined for model training. However, this centralized training strategy may violate privacy policies in many real-world applications. A paradigm for tackling this problem is to train multiple local models and aggregate a generalized central model without data sharing. Recent methods have made remarkable advancements in this paradigm by exploiting parameter alignment and aggregation. But when sources domain variety increases, directly aligning and aggregating local parameters becomes more challenging. Adapting a different approach in this work, we devised a data-free semantic collaborative distillation strategy to learn domain-invariant representation for both federated UDA and DG. Each local model transmits its predictions to the central server and derives its target distribution from the average of other local models' distributions to facilitate the mutual transfer of domain-specific knowledge. When unlabeled target data is available, we introduce a novel UDA strategy termed knowledge filter to adapt the central model to the target data. Extensive experiments on four UDA and DG datasets demonstrate that our method has a competitive performance compared with the state-of-the-art methods.

Similar Papers
  • Conference Article
  • Citations79

Collaborative Optimization and Aggregation for Decentralized Domain Generalization and Adaptation

  • Oct 01, 2021
  • Guile Wu +1
  • Research Article
  • Citations31

PCLUDA: A Pseudo-Label Consistency Learning- Based Unsupervised Domain Adaptation Method for Cross-Domain Optical Remote Sensing Image Retrieval

  • Jan 01, 2023
  • IEEE Transactions on Geoscience and Remote Sensing
  • Dongyang Hou +3
  • Conference Article
  • Citations19

Empirical Generalization Study: Unsupervised Domain Adaptation vs. Domain Generalization Methods for Semantic Segmentation in the Wild

  • Jan 01, 2023
  • Fabrizio J Piva +2
  • Research Article
  • Citations23

A Unified User-Generic Framework for Myoelectric Pattern Recognition: Mix-up and Adversarial Training for Domain Generalization and Adaptation.

  • Aug 01, 2023
  • IEEE Transactions on Biomedical Engineering
  • Xinhui Li +4
  • Abstract

Unsupervised Domain Adaptation of Auto-Segmentation on Multi-Source MRIs

  • Sep 29, 2023
  • International Journal of Radiation Oncology*Biology*Physics
  • W Zhang +4
  • Conference Article
  • Citations2

TUDAMatch: Time-Series Unsupervised Domain Adaptation for Automatic Sleep Staging

  • Apr 24, 2023
  • Yingying Luo +4
  • Research Article
  • Citations24

Semi-supervised domain adaptation for segmentation models on different monitoring settings

  • May 01, 2023
  • Automation in Construction
  • Yeji Hong +4
  • Research Article
  • Citations316

Domain Adaptive Ensemble Learning.

  • Jan 01, 2021
  • IEEE Transactions on Image Processing
  • Kaiyang Zhou +3
  • Research Article
  • Citations172

Correlation-aware adversarial domain adaptation and generalization

  • Nov 28, 2019
  • Pattern Recognition
  • Mohammad Mahfujur Rahman +3
  • PDF
  • Research Article
  • Citations5

On the Importance of Attention and Augmentations for Hypothesis Transfer in Domain Adaptation and Generalization

  • Oct 12, 2023
  • Sensors (Basel, Switzerland)
  • Rajat Sahay +5
  • Book Chapter
  • Citations1

Unsupervised Graph Domain Adaptation for Neurodevelopmental Disorders Diagnosis

  • Jan 01, 2020
  • Bomin Wang +7
  • Dissertation
  • Citations1

Domain adaptation and generalization for visual recognition

  • Jan 01, 2017
  • Li Niu
  • Research Article

Adaptive integrated weight unsupervised multi-source domain adaptation without source data

  • Apr 22, 2025
  • Complex & Intelligent Systems
  • Zhirui Wang +2
  • PDF
  • Research Article
  • Citations93

Evaluation of domain generalization and adaptation on improving model robustness to temporal dataset shift in clinical medicine

  • Feb 17, 2022
  • Scientific reports
  • Lin Lawrence Guo +7
  • Book Chapter

Iterative Discriminative Domain Adaptation

  • Jan 01, 2019
  • Xiaofu Wu +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.