• Home
  • Search
  • Cross Validation Framework to Choose amongst Models and Datasets for Transfer Learning
  • Open Access IconOpen Access
  • Cite Icon161
  • https://doi.org/10.1007/978-3-642-15939-8_35Copy DOI Icon

Cross Validation Framework to Choose amongst Models and Datasets for Transfer Learning

  • Jan 1, 2010
  • Erheng Zhong +4 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

One solution to the lack of label problem is to exploit transfer learning, whereby one acquires knowledge from source-domains to improve the learning performance in the target-domain. The main challenge is that the source and target domains may have different distributions. An open problem is how to select the available models (including algorithms and parameters) and importantly, abundance of source-domain data, through statistically reliable methods, thus making transfer learning practical and easy-to-use for real-world applications. To address this challenge, one needs to take into account the difference in both marginal and conditional distributions in the same time, but not just one of them. In this paper, we formulate a new criterion to overcome “double” distribution shift and present a practical approach “Transfer Cross Validation” (TrCV) to select both models and data in a cross validation framework, optimized for transfer learning. The idea is to use density ratio weighting to overcome the difference in marginal distributions and propose a “reverse validation” procedure to quantify how well a model approximates the true conditional distribution of target-domain. The usefulness of TrCV is demonstrated on different cross-domain tasks, including wine quality evaluation, web-user ranking and text categorization. The experiment results show that the proposed method outperforms both traditional cross-validation and one state-of-the-art method which only considers marginal distribution shift. The software and datasets are available from the authors.

Similar Papers
  • Research Article
  • Citations15

A particle swarm optimization-based feature selection for unsupervised transfer learning

  • Jun 26, 2020
  • Soft Computing
  • Rakesh Kumar Sanodiya +4
  • Research Article
  • Citations30

Deep conditional adversarial subdomain adaptation network for unsupervised mechanical fault diagnosis

  • Jun 26, 2024
  • Knowledge-Based Systems
  • Guiping Chen +4
  • Research Article
  • Citations287

Transfer Learning with Dynamic Distribution Adaptation

  • Feb 06, 2020
  • ACM Transactions on Intelligent Systems and Technology
  • Jindong Wang +5
  • Research Article
  • Citations24

Robust transfer learning based on Geometric Mean Metric Learning

  • Jun 16, 2021
  • Knowledge-Based Systems
  • Peng Zhao +3
  • PDF
  • Research Article
  • Citations131

A Fast, Efficient Domain Adaptation Technique for Cross-Domain Electroencephalography(EEG)-Based Emotion Recognition

  • May 03, 2017
  • Sensors (Basel, Switzerland)
  • Xin Chai +6
  • Research Article
  • Citations11

Multi-Source Selection Transfer Learning with Privacy-Preserving

  • May 07, 2022
  • Neural Processing Letters
  • Weifei Wu
  • Research Article
  • Citations11

Domain Adaptation Learning Based on Structural Similarity Weighted Mean Discrepancy for Credit Risk Classification

  • May 01, 2020
  • IEEE Intelligent Systems
  • Wei Chen +2
  • Conference Article
  • Citations77

Dual Transfer Learning

  • Apr 26, 2012
  • Mingsheng Long +5
  • Research Article
  • Citations8

Riemannian Locality Preserving Method for Transfer Learning With Applications on Brain-Computer Interface.

  • Aug 01, 2024
  • IEEE journal of biomedical and health informatics
  • Guiying Xu +6
  • Research Article
  • Citations2

Multisource Deep Transfer Learning Based on Balanced Distribution Adaptation

  • Apr 18, 2022
  • Computational Intelligence and Neuroscience
  • Peng Gao +3
  • Research Article
  • Citations20

A novel unsupervised Globality-Locality Preserving Projections in transfer learning

  • Aug 25, 2019
  • Image and Vision Computing
  • Rakesh Kumar Sanodiya +1
  • Research Article
  • Citations29

Correlation feature distribution matching for fault diagnosis of machines

  • Mar 01, 2023
  • Reliability Engineering & System Safety
  • Hongchuang Tan +4
  • Book Chapter

Correlated Matching and Structure Learning for Unsupervised Domain Adaptation

  • Jan 01, 2022
  • Xingping Luo +3
  • PDF
  • Research Article
  • Citations8

Normalized Recurrent Dynamic Adaption Network: A New Framework With Dynamic Alignment for Intelligent Fault Diagnosis

  • Jan 01, 2020
  • IEEE Access
  • Chengdong Zheng +4
  • Conference Article
  • Citations5

An Unsupervised Domain Adaptation Method for Multi-Modal Remote Sensing Image Classification

  • Jun 01, 2018
  • Wei Liu +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.