• Home
  • Search
  • Online Transfer Learning: Negative Transfer and Effect of Prior Knowledge
  • Open Access IconOpen Access
  • Cite Icon13
  • https://doi.org/10.1109/isit45174.2021.9517974Copy DOI Icon

Online Transfer Learning: Negative Transfer and Effect of Prior Knowledge

  • Jul 12, 2021
  • Xuetong Wu +3 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Transfer learning is a machine learning paradigm where the knowledge from one task is utilized to resolve the problem in a related task. On the one hand, it is conceivable that knowledge from one task could be useful for solving a related problem. On the other hand, it is also recognized that if not executed properly, transfer learning algorithms could in fact impair the learning performance instead of improving it - commonly known as negative transfer. In this paper, we study the online transfer learning problems where the source samples are given in an off-line way while the target samples arrive sequentially. We define the expected regret of the online transfer learning problem, and provide upper bounds on the regret using information-theoretic quantities. We also obtain exact expressions for the bounds when the sample size becomes large. Examples show that the derived bounds are accurate even for small sample sizes. Furthermore, the obtained bounds give valuable insight on the effect of prior knowledge for transfer learning in our formulation. In particular, we formally characterize the conditions under which negative transfer occurs.

Similar Papers
  • Research Article
  • Citations17

A Bayesian approach to (online) transfer learning: Theory and algorithms

  • Aug 11, 2023
  • Artificial Intelligence
  • Xuetong Wu +3
  • Conference Article
  • Citations5

HetEOTL: An Algorithm for Heterogeneous Online Transfer Learning

  • Nov 01, 2018
  • Qian Chen +3
  • Research Article
  • Citations28

OTLAMC: An Online Transfer Learning Algorithm for Multi-class Classification

  • Apr 02, 2019
  • Knowledge-Based Systems
  • Zhongfeng Kang +3
  • Research Article
  • Citations5

Online transfer learning with multiple decision trees

  • Aug 16, 2019
  • International Journal of Machine Learning and Cybernetics
  • Yimin Wen +4
  • Research Article
  • Citations37

Online transfer learning with multiple source domains for multi-class classification

  • Nov 05, 2019
  • Knowledge-Based Systems
  • Zhongfeng Kang +4
  • Research Article
  • Citations4

Online transfer learning with partial feedback

  • Sep 06, 2022
  • Expert Systems with Applications
  • Zhongfeng Kang +4
  • Research Article

Heterogeneous Transfer Learning for Linear Regression Model with Heteroscedasticity

  • Apr 21, 2026
  • Mathematics
  • Hongxia Hao +2
  • Conference Article
  • Citations30

An Investigation of Transfer Learning and Traditional Machine Learning Algorithms

  • Nov 01, 2016
  • Karl R Weiss +1
  • PDF
  • Research Article
  • Citations27

Adversarial Deep Transfer Learning in Fault Diagnosis: Progress, Challenges, and Future Prospects.

  • Aug 18, 2023
  • Sensors
  • Yu Guo +3
  • Research Article
  • Citations6

Few-Shot Synthetic Online Transfer Learning for Cross-Site Neurological Disease Diagnosis

  • Apr 01, 2024
  • IEEE Transactions on Computational Social Systems
  • Zhaodi Pei +3
  • Conference Article

Statistical Minimax Lower Bounds for Transfer Learning in Linear Binary Classification

  • Jun 26, 2022
  • Seyed Mohammadreza Mousavi Kalan +2
  • Research Article
  • Citations8

A buffered online transfer learning algorithm with multi-layer network

  • Nov 27, 2021
  • Neurocomputing
  • Zhongfeng Kang +4
  • Research Article
  • Citations20

Few-Shot Text and Image Classification via Analogical Transfer Learning

  • Oct 29, 2018
  • ACM Transactions on Intelligent Systems and Technology
  • Wenhe Liu +4
  • Research Article
  • Citations140

Online Transfer Learning with Multiple Homogeneous or Heterogeneous Sources

  • Jul 01, 2017
  • IEEE Transactions on Knowledge and Data Engineering
  • Qingyao Wu +6
  • Conference Article
  • Citations2

An Online Transfer Learning Algorithm with Adaptive Cost

  • Nov 28, 2018
  • Yuhong Zhang +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.