• Home
  • Search
  • Exploiting Self-Supervised and Semi-Supervised Learning for Facial Landmark Tracking with Unlabeled Data
  • Cite Icon6
  • https://doi.org/10.1145/3394171.3413547Copy DOI Icon

Exploiting Self-Supervised and Semi-Supervised Learning for Facial Landmark Tracking with Unlabeled Data

  • Oct 12, 2020
  • Shi Yin +3 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Current work of facial landmark tracking usually requires large amounts of fully annotated facial videos to train a landmark tracker. To relieve the burden of manual annotations, we propose a novel facial landmark tracking method that makes full use of unlabeled facial videos by exploiting both self-supervised and semi-supervised learning mechanisms. First, self-supervised learning is adopted for representation learning from unlabeled facial videos. Specifically, a facial video and its shuffled version are fed into a feature encoder and a classifier. The feature encoder is used to learn visual representations, and the classifier distinguishes the input videos as the original or the shuffled ones. The feature encoder and the classifier are trained jointly. Through self-supervised learning, the spatial and temporal patterns of a facial video are captured at representation level. After that, the facial landmark tracker, consisting of the pre-trained feature encoder and a regressor, is trained semi-supervisedly. The consistencies among the tracking results of the original, the inverse and the disturbed facial sequences are exploited as the constraints on the unlabeled facial videos, and the supervised loss is adopted for the labeled videos. Through semi-supervised end-to-end training, the tracker captures sequential patterns inherent in facial videos despite small amount of manual annotations. Experiments on two benchmark datasets show that the proposed framework outperforms state-of-the-art semi-supervised facial landmark tracking methods, and also achieves advanced performance compared to fully supervised facial landmark tracking methods.

Similar Papers
  • Conference Article
  • Citations16

A Novel Solution for EEG-based Emotion Recognition

  • Oct 13, 2021
  • Zhuofan Xie +2
  • Research Article
  • Citations2

Research on Self-Supervised Comparative Learning for Computer Vision

  • Aug 17, 2021
  • Journal of Electronic Research and Application
  • Yuanyuan Liu +1
  • Research Article
  • Citations2

Spatiotemporal self-supervised predictive learning for atmospheric variable prediction via multi-group multi-attention

  • Jun 13, 2024
  • Knowledge-Based Systems
  • Zhensheng Shi +2
  • Research Article

Trend-Error Decomposition for Self-Supervised Time Series Learning in Multivariate Forecasting Task

  • Jan 01, 2026
  • IEEE Access
  • Sara Pederzoli +3
  • Research Article
  • Citations20

Self-supervised visual learning in the low-data regime: A comparative evaluation

  • Mar 01, 2025
  • Neurocomputing
  • Sotirios Konstantakos +6
  • Research Article
  • Citations21

Self-Supervised Learning and Multisource Heterogeneous Information Fusion Based Quality Anomaly Detection for Heavy-Plate Shape

  • Apr 01, 2024
  • IEEE Transactions on Automation Science and Engineering
  • Datong Li +3
  • Research Article

Using self-supervised feature learning to improve the use of pulse oximeter signals to predict paediatric hospitalization.

  • Feb 01, 2023
  • Wellcome Open Research
  • Paul Mwaniki +5
  • PDF
  • Research Article

Using self-supervised feature learning to improve the use of pulse oximeter signals to predict paediatric hospitalization

  • Sep 28, 2021
  • Wellcome Open Research
  • Paul Mwaniki +5
  • Research Article

Facial Action Unit Representation Based on Self-Supervised Learning With Ensembled Priori Constraints.

  • Jan 01, 2024
  • IEEE transactions on image processing : a publication of the IEEE Signal Processing Society
  • Haifeng Chen +4
  • Book Chapter
  • Citations5

Improving Self-supervised Lightweight Model Learning via Hard-Aware Metric Distillation

  • Jan 01, 2022
  • Hao Liu +1
  • Research Article
  • Citations11

Joint Self-Supervised Image-Volume Representation Learning with Intra-inter Contrastive Clustering

  • Jun 26, 2023
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Duy M H Nguyen +9
  • PDF
  • Book Chapter
  • Citations13

Self-Supervised Contrastive Representation Learning in Computer Vision

  • Dec 21, 2022
  • Yalin Bastanlar +1
  • Research Article
  • Citations29

Exploring PolSAR Images Representation via Self-Supervised Learning and Its Application on Few-Shot Classification

  • Jan 01, 2022
  • IEEE Geoscience and Remote Sensing Letters
  • Wu Zhang +2
  • Conference Article
  • Citations58

LeBenchmark: A Reproducible Framework for Assessing Self-Supervised Representation Learning from Speech

  • Aug 30, 2021
  • Solène Evain +17
  • Preprint Article

Self-Supervised Learning Principles Challenges and Emerging Directions

  • Feb 24, 2025
  • Preprints.org
  • Jenifer Nadine
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.