• Home
  • Search
  • Pretext Tasks Selection for Multitask Self-Supervised Audio Representation Learning
  • Open Access IconOpen Access
  • Cite Icon16
  • https://doi.org/10.1109/jstsp.2022.3195430Copy DOI Icon

Pretext Tasks Selection for Multitask Self-Supervised Audio Representation Learning

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Through solving pretext tasks, self-supervised learning leverages unlabeled data to extract useful latent representations replacing traditional input features in the downstream task. In audio/speech signal processing, a wide range of features where engineered through decades of research efforts. As it turns out, learning to predict such features (a.k.a pseudo-labels) has proven to be a particularly relevant pretext task, leading to useful self-supervised representations which prove to be effective for downstream tasks. However, methods and common practices for combining such pretext tasks for better performance on the downstream task have not been explored and understood properly. In fact, the process relies almost exclusively on a computationally heavy experimental procedure, which becomes intractable with the increase of the number of pretext tasks. This paper introduces a method to select a group of pretext tasks among a set of candidates. The method we propose estimates calibrated weights for the partial losses corresponding to the considered pretext tasks during the self-supervised training process. The experiments conducted on automatic speech recognition, speaker and emotion recognition validate our approach, as the groups selected and weighted with our method perform better than classic baselines, thus facilitating the selection and combination of relevant pseudo-labels for self-supervised representation learning.

Similar Papers
  • Conference Article
  • Citations2

A Novel Multi-Task Self-Supervised Representation Learning Paradigm

  • May 28, 2021
  • Control theory & applications
  • Yinggang Li +5
  • Conference Article
  • Citations4

Conditional Independence for Pretext Task Selection in Self-Supervised Speech Representation Learning

  • Aug 30, 2021
  • Salah Zaiem +2
  • Conference Article
  • Citations4

Self-supervised Learning Based on Max-tree Representation for Medical Image Segmentation

  • Jul 18, 2022
  • Qian Tang +2
  • Research Article
  • Citations8

Self-supervised learning for heterogeneous graph via structure information based on metapath

  • May 12, 2023
  • Applied Soft Computing
  • Shuai Ma +2
  • Research Article
  • Citations45

Volumetric white matter tract segmentation with nested self-supervised learning using sequential pretext tasks.

  • Apr 30, 2021
  • Medical Image Analysis
  • Qi Lu +2
  • PDF
  • Research Article
  • Citations16

A Generic Self-Supervised Learning (SSL) Framework for Representation Learning from Spectral–Spatial Features of Unlabeled Remote Sensing Imagery

  • Nov 03, 2023
  • Remote Sensing
  • Xin Zhang +1
  • Research Article
  • Citations20

Self-supervised visual learning in the low-data regime: A comparative evaluation

  • Mar 01, 2025
  • Neurocomputing
  • Sotirios Konstantakos +6
  • Book Chapter
  • Citations7

CaSS: A Channel-Aware Self-supervised Representation Learning Framework for Multivariate Time Series Classification

  • Jan 01, 2022
  • Yijiang Chen +4
  • Research Article
  • Citations8

Attentive spatial-temporal contrastive learning for self-supervised video representation

  • Jul 11, 2023
  • Image and Vision Computing
  • Xingming Yang +4
  • Conference Article
  • Citations1518

Self-Supervised Learning of Pretext-Invariant Representations

  • Jun 01, 2020
  • Ishan Misra +1
  • Research Article
  • Citations11

Multi-view Graph Representation Learning Beyond Homophily

  • Jun 28, 2023
  • ACM Transactions on Knowledge Discovery from Data
  • Bei Lin +4
  • Research Article

Self-supervised learning for stroke lesion segmentation on CT: a new pretext task for neuroimaging.

  • Jul 14, 2025
  • Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference
  • Juliette Moreau +6
  • PDF
  • Conference Article
  • Citations3

Organoids Segmentation using Self-Supervised Learning: How Complex Should the Pretext Task Be?

  • Nov 09, 2023
  • Asmaa Haja +2
  • Research Article
  • Citations6

Self-Supervised Video Representation Learning by Serial Restoration With Elastic Complexity

  • Jan 01, 2024
  • IEEE Transactions on Multimedia
  • Ziyu Chen +2
  • Conference Article

Self-supervised multi-task learning for semantic segmentation of urban scenes

  • Sep 12, 2021
  • Jonathan Gonzalez-Santiago +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.