• Home
  • Search
  • Pseudo-Labeling Using Gaussian Process for Semi-Supervised Deep Learning
  • Cite Icon13
  • https://doi.org/10.1109/bigcomp.2018.00046Copy DOI Icon

Pseudo-Labeling Using Gaussian Process for Semi-Supervised Deep Learning

  • Jan 1, 2018
  • Zhun Li +2 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

The goal of semi-supervised learning is to improve the performance of supervised learning tasks using unlabeled data. Deep learning has a high demand for making use of large-scale unlabeled data. We propose a simple and novel method of utilizing unlabeled data for semi-supervised learning to improve the performance of the deep learning model. First, we train a Gaussian process classifier (GPC), and use its output on unlabeled data as a pseudo-label. Then, we pre-train the deep learning model with the pseudo-labeled data to initialize the parameters of the model. Finally, we fine-tune it with the labeled data. We apply this method to five classes of video from the UCF101 data set which contains a small amount of labeled data. The experiment results show significant performance improvements compared to those of the deep learning model without pre-training. We further study the pre-training effect using pseudo-labeled data with a different probability, and give some advice for practical application. Moreover, we propose to train GPC with stratified sampled data (SGPC) to reduce the computation time of GPC when there are large amounts of data. Finally, we generalize proposed pseudo-labeling method to any classifier having good performance and give some advice for pseudo-labeling method selection.

Similar Papers
  • Research Article
  • Citations42

Naive semi-supervised deep learning using pseudo-label

  • Dec 10, 2018
  • Peer-to-Peer Networking and Applications
  • Zhun Li +2
  • Research Article
  • Citations22

Discriminative semi-supervised learning via deep and dictionary representation for image classification

  • Mar 17, 2023
  • Pattern Recognition
  • Meng Yang +4
  • Research Article
  • Citations15

Semi-Supervised Temporal Meta-Learning Framework for Wind Turbine Bearing Fault Diagnosis Under Limited Annotation Data

  • Jan 01, 2024
  • IEEE Transactions on Instrumentation and Measurement
  • Hao Su +3
  • Research Article
  • Citations188

Semi-Supervised and Unsupervised Deep Visual Learning: A Survey.

  • Mar 01, 2024
  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • Yanbei Chen +3
  • Research Article

Abstract 184: The utility of deep metric learning for breast cancer identification on mammographic images

  • Jul 01, 2021
  • Cancer Research
  • Justin Du +8
  • Research Article
  • Citations8

Geostatistical semi-supervised learning for spatial prediction

  • Dec 01, 2022
  • Artificial Intelligence in Geosciences
  • Francky Fouedjio +1
  • Research Article
  • Citations65

Semi-Supervised Concept Learning by Concept-Cognitive Learning and Concept Space

  • Jul 21, 2020
  • IEEE Transactions on Knowledge and Data Engineering
  • Yunlong Mi +3
  • Conference Article
  • Citations7

STAR: Noisy Semi-Supervised Transfer Learning for Visual Classification

  • Oct 20, 2021
  • Hasib Zunair +3
  • Conference Article
  • Citations31

Incorporating Semi-Supervised and Positive-Unlabeled Learning for Boosting Full Reference Image Quality Assessment

  • Jun 01, 2022
  • Yue Cao +4
  • Research Article
  • Citations1

A Semi-Supervised-Learning-Aided Explainable Belief Rule-Based Approach to Predict the Energy Consumption of Buildings

  • May 23, 2025
  • Algorithms
  • Sami Kabir +2
  • Research Article
  • Citations19

A real use case of semi-supervised learning for mammogram classification in a local clinic of Costa Rica

  • Jan 01, 2022
  • Medical & Biological Engineering & Computing
  • Saul Calderon-Ramirez +6
  • Conference Article
  • Citations11

Semi-supervised convolutional neural networks with label propagation for image classification

  • Aug 01, 2018
  • Lin Chen +2
  • Research Article

Semi-Supervised Learning via Triplet Network Based Active Learning (Student Abstract)

  • May 18, 2021
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Divyanshu Sundriyal +3
  • Conference Article
  • Citations7

Semi-Supervised Learning with Gaussian Processes

  • Oct 01, 2008
  • Hongwei Li +2
  • Research Article
  • Citations75

Energy consumption modelling using deep learning embedded semi-supervised learning

  • Jun 24, 2019
  • Computers & Industrial Engineering
  • Chong Chen +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.