• Home
  • Search
  • Non-parametric Representation Learning with Kernels
  • Cite Icon4
  • https://doi.org/10.1609/aaai.v38i11.29077Copy DOI Icon

Non-parametric Representation Learning with Kernels

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Unsupervised and self-supervised representation learning has become popular in recent years for learning useful features from unlabelled data. Representation learning has been mostly developed in the neural network literature, and other models for representation learning are surprisingly unexplored. In this work, we introduce and analyze several kernel-based representation learning approaches: Firstly, we define two kernel Self-Supervised Learning (SSL) models using contrastive loss functions and secondly, a Kernel Autoencoder (AE) model based on the idea of embedding and reconstructing data. We argue that the classical representer theorems for supervised kernel machines are not always applicable for (self-supervised) representation learning, and present new representer theorems, which show that the representations learned by our kernel models can be expressed in terms of kernel matrices. We further derive generalisation error bounds for representation learning with kernel SSL and AE, and empirically evaluate the performance of these methods in both small data regimes as well as in comparison with neural network based models.

Similar Papers
  • Research Article
  • Citations2

Spatiotemporal self-supervised predictive learning for atmospheric variable prediction via multi-group multi-attention

  • Jun 13, 2024
  • Knowledge-Based Systems
  • Zhensheng Shi +2
  • PDF
  • Research Article
  • Citations11

SSRL-UAVs: A Self-Supervised Deep Representation Learning Approach for GPS Spoofing Attack Detection in Small Unmanned Aerial Vehicles

  • Sep 23, 2024
  • Drones
  • Abed Alanazi
  • Research Article

Abstract 5059: Self-supervised representation learning of somatic mutational data

  • Apr 21, 2025
  • Cancer Research
  • Marzieh Haghighi +2
  • Research Article
  • Citations19

Towards interpretable learned representations for ecoacoustics using variational auto-encoding

  • Dec 30, 2023
  • Ecological Informatics
  • K.A Gibb +3
  • Research Article
  • Citations1

Representation-based ECG signal prediction forneural networks pre-training

  • Apr 04, 2025
  • Herald of Advanced Information Technology
  • Serhii G Stavychenko +1
  • Research Article
  • Citations350

A comparison review of transfer learning and self-supervised learning: Definitions, applications, advantages and limitations

  • Dec 02, 2023
  • Expert Systems with Applications
  • Zehui Zhao +4
  • Research Article

Self-Supervised Deep Learning Models for Low-Resource NLP Applications

  • Feb 26, 2026
  • International Journal of Research and Review in Applied Science, Humanities, and Technology
  • Pardeep Kaur
  • Conference Article
  • Citations88

On Feature Decorrelation in Self-Supervised Learning

  • Oct 01, 2021
  • Tianyu Hua +5
  • Conference Article

Self-supervised representation learning for SAR change detection

  • Jun 13, 2023
  • Eric Davis +3
  • Research Article

The Impact of Cervical Cytology Category Imbalance on Self-Supervised Representation Learning.

  • Mar 23, 2026
  • Computational and structural biotechnology journal
  • Shenghua Cheng +7
  • Research Article
  • Citations16

Sleep Stage Classification Via Multi-View Based Self-Supervised Contrastive Learning of EEG.

  • Dec 01, 2024
  • IEEE journal of biomedical and health informatics
  • Chen Zhao +5
  • Research Article

Augmentation invariant manifold learning

  • Feb 07, 2025
  • Journal of the Royal Statistical Society Series B: Statistical Methodology
  • Shulei Wang
  • PDF
  • Research Article
  • Citations1

Advancements in Self-Supervised Learning for Remote Sensing Scene Classification: Present Innovations and Future Outlooks

  • Apr 23, 2024
  • Journal of Artificial Intelligence General science (JAIGS) ISSN:3006-4023
  • José Gabriel Carrasco Ramírez
  • PDF
  • Research Article
  • Citations72

Self-Supervised Learning for Scene Classification in Remote Sensing: Current State of the Art and Perspectives

  • Aug 17, 2022
  • Remote Sensing
  • Paul Berg +2
  • Research Article
  • Citations31

Self-Adaptive Training: Bridging Supervised and Self-Supervised Learning.

  • Mar 01, 2024
  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • Lang Huang +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.