• Home
  • Search
  • Scalable Semi-Supervised SVM via Triply Stochastic Gradients
  • Cite Icon14
  • https://doi.org/10.24963/ijcai.2019/328Copy DOI Icon

Scalable Semi-Supervised SVM via Triply Stochastic Gradients

  • Aug 1, 2019
  • Xiang Geng +5 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Semi-supervised learning (SSL) plays an increasingly important role in the big data era because a large number of unlabeled samples can be used effectively to improve the performance of the classifier. Semi-supervised support vector machine (S3VM) is one of the most appealing methods for SSL, but scaling up S3VM for kernel learning is still an open problem. Recently, a doubly stochastic gradient (DSG) algorithm has been proposed to achieve efficient and scalable training for kernel methods. However, the algorithm and theoretical analysis of DSG are developed based on the convexity assumption which makes them incompetent for non-convex problems such as S3VM. To address this problem, in this paper, we propose a triply stochastic gradient algorithm for S3VM, called TSGS3VM. Specifically, to handle two types of data instances involved in S3VM, TSGS3VM samples a labeled instance and an unlabeled instance as well with the random features in each iteration to compute a triply stochastic gradient. We use the approximated gradient to update the solution. More importantly, we establish new theoretic analysis for TSGS3VM which guarantees that TSGS3VM can converge to a stationary point. Extensive experimental results on a variety of datasets demonstrate that TSGS3VM is much more efficient and scalable than existing S3VM algorithms.

Similar Papers
  • Research Article
  • Citations31

Biased stochastic conjugate gradient algorithm with adaptive step size for nonconvex problems

  • Sep 22, 2023
  • Expert Systems with Applications
  • Ruping Huang +3
  • Conference Article
  • Citations7

A Novel Constrained Adaptive Algorithm Using the Conjugate Gradient Method for Smart Antennas

  • Nov 01, 2007
  • Lei Wang +1
  • Research Article
  • Citations42

A new dynamic security assessment framework based on semi-supervised learning and data editing

  • Mar 28, 2019
  • Electric Power Systems Research
  • Ruidong Liu +2
  • Research Article
  • Citations8

Combining active learning and transductive support vector machines for sea ice detection

  • May 15, 2018
  • Journal of Applied Remote Sensing
  • Yanling Han +5
  • Conference Article

Low complexity variable step size mechanisms for constrained minimum variance CDMA receivers

  • May 17, 2004
  • R.C De Lamare +1
  • Research Article

Semi-Supervised Regression by Preserving Ranking Relationships Between Close Unlabeled Samples

  • Mar 14, 2026
  • X Li +4
  • Research Article
  • Citations2

Semi-supervised interlayer intelligent recognition method

  • May 26, 2023
  • Earth Science Informatics
  • Shixiang Jiao +6
  • Research Article
  • Citations29

Deep Semisupervised Teacher–Student Model Based on Label Propagation for Sea Ice Classification

  • Jan 01, 2021
  • IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
  • Salman Khaleghian +4
  • Conference Article

A Kalman smoother based estimation approach for dynamic adjustment systems with irregularly missing output data

  • May 10, 2021
  • Shaohua Ding +3
  • Conference Article
  • Citations31

New Incremental Learning Algorithm for Semi-Supervised Support Vector Machine

  • Jul 19, 2018
  • Bin Gu +3
  • Research Article
  • Citations3

Adaptive Biased Stochastic Optimization.

  • Jan 01, 2025
  • IEEE transactions on pattern analysis and machine intelligence
  • Zhuang Yang
  • Conference Article
  • Citations6

Scalable Semi-supervised kernel spectral learning using random Fourier features

  • Dec 01, 2016
  • Siamak Mehrkanoon +1
  • Research Article
  • Citations2

An Analysis Model of Sports Human Body Based on Computer Vision Tracking Technology

  • Sep 11, 2017
  • DEStech Transactions on Social Science, Education and Human Science
  • Mingzhu Yuan
  • Conference Article
  • Citations21

An Improved Fuzziness based Random Vector Functional Link Network for Liver Disease Detection

  • May 01, 2020
  • Weipeng Cao +4
  • Research Article
  • Citations278

Partially Coupled Stochastic Gradient Identification Methods for Non-Uniformly Sampled Systems

  • Aug 01, 2010
  • IEEE Transactions on Automatic Control
  • Feng Ding +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.