• Home
  • Search
  • Reducing the effect of sample bias for small data sets with double‐weighted support vector transfer regression
  • Cite Icon37
  • https://doi.org/10.1111/mice.12617Copy DOI Icon

Reducing the effect of sample bias for small data sets with double‐weighted support vector transfer regression

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Abstract Small data sets are an extremely challenging problem in the machine learning (ML) realm, and in specific, in regression scenarios, as the lack of relevant data can lead to ML models that have large bias. However, there are many applications for which a purely data‐driven procedure would be advantageous, but a large amount of data are not available. This article proposes a novel regression‐based transfer learning (TL) model to address this challenge, where TL is defined as knowledge transfer from a large, relevant data set (source domain data) to a small data set (target domain data). The proposed TL model is termed double‐weighted support vector transfer regression (DW‐SVTR), which couples least squares support vector machines for regression (LS‐SVMR) with two weight functions. The first weight function uses kernel mean matching (KMM) to reweight the source domain data such that the mean values of the source and target domain data in a reproduced kernel Hilbert space (RKHS) are close. In this way, the source domain data points relevant to the target domain points have a larger weight than irrelevant source domain points. The second weight is a function of estimated residuals, which aims to further reduce the negative interference of irrelevant source domain points. The proposed approach is assessed and validated via simulated data and by enhanced shear strength prediction of nonductile columns based on limited availability of nonductile column data. Specifically, the results for the latter show that the proposed DW‐SVTR can reduce the root mean square error (RMSE) by 34% and enhance the coefficient of determination (R2) by 229%. These numerical results demonstrate that the DW‐SVTR significantly reduces the effect of small sample bias and improves prediction performance compared to standard ML methods.

Similar Papers
  • Research Article
  • Citations16

Overcoming learning bias via Prototypical Feature Compensation for source-free domain adaptation

  • Sep 17, 2024
  • Pattern Recognition
  • Zicheng Pan +3
  • Research Article

Systematic Analysis of Source-Free Domain Adaptation Methods

  • Mar 27, 2025
  • Frontiers in Computing and Intelligent Systems
  • Zhiyi Miao
  • Research Article
  • Citations5

Dual Structural Consistent Partial Domain Adaptation Network for Intelligent Machinery Fault Diagnosis

  • Jan 01, 2024
  • IEEE Transactions on Instrumentation and Measurement
  • Kun Yu +5
  • PDF
  • Research Article
  • Citations8

Identifying Solitary Granulomatous Nodules from Solid Lung Adenocarcinoma: Exploring Robust Image Features with Cross-Domain Transfer Learning.

  • Jan 31, 2023
  • Cancers
  • Bao Feng +15
  • Conference Article

GM-transfer: Graph-based model for transfer learning

  • Nov 01, 2011
  • Shizhun Yang +2
  • Supplementary Content

On Transfer Learning Techniques for Machine Learning

  • Apr 30, 2020
  • Figshare
  • Debasmit Das
  • Research Article
  • Citations51

A MultiKernel Domain Adaptation Method for Unsupervised Transfer Learning on Cross-Source and Cross-Region Remote Sensing Data Classification

  • Jan 17, 2020
  • IEEE Transactions on Geoscience and Remote Sensing
  • Wei Liu +1
  • Research Article

Fault diagnosis of rolling bearing with variable working conditions in noisy environment based on dynamic soft threshold and attention mechanism

  • Dec 19, 2024
  • Measurement Science and Technology
  • Ankang Li +3
  • Research Article
  • Citations12

A complex process fault diagnosis method based on manifold distribution adaptation

  • Oct 15, 2019
  • Engineering Applications of Artificial Intelligence
  • Xiaogang Wang +1
  • Research Article
  • Citations53

Online transfer learning by leveraging multiple source domains

  • Jan 11, 2017
  • Knowledge and Information Systems
  • Qingyao Wu +4
  • Research Article
  • Citations4

Multi-layer transfer learning algorithm based on improved common spatial pattern for brain-computer interfaces

  • Mar 01, 2025
  • Journal of Neuroscience Methods
  • Zhuo Cai +4
  • PDF
  • Research Article

The manifold embedded selective pseudo-labeling algorithm and transfer learning of small sample dataset

  • Oct 01, 2021
  • Xibei Gongye Daxue Xuebao/Journal of Northwestern Polytechnical University
  • Yaoli Wang +3
  • Dissertation

Data-driven Fault Diagnosis for Cyber-Physical Systems

  • May 09, 2025
  • Mehdi Saman Azari
  • Research Article
  • Citations1

Efficient intelligent calculation method for conformal metasurface scattering field based on transfer learning

  • Jan 01, 2024
  • Acta Physica Sinica
  • Kai-Yue Liu +6
  • Research Article
  • Citations1

A novel Pseudo-label based domain adaptation method on tabular data

  • May 04, 2023
  • Journal of Intelligent & Fuzzy Systems
  • Chu Wang +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.