• Home
  • Search
  • Vectorization and Rasterization: Self-Supervised Learning for Sketch and Handwriting
  • Open Access IconOpen Access
  • Cite Icon64
  • https://doi.org/10.1109/cvpr46437.2021.00562Copy DOI Icon

Vectorization and Rasterization: Self-Supervised Learning for Sketch and Handwriting

  • Jun 1, 2021
  • Ayan Kumar Bhunia +5 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Self-supervised learning has gained prominence due to its efficacy at learning powerful representations from unlabelled data that achieve excellent performance on many challenging downstream tasks. However, supervision-free pre-text tasks are challenging to design and usually modality specific. Although there is a rich literature of self-supervised methods for either spatial (such as images) or temporal data (sound or text) modalities, a common pretext task that benefits both modalities is largely missing. In this paper, we are interested in defining a self-supervised pre-text task for sketches and handwriting data. This data is uniquely characterised by its existence in dual modalities of rasterized images and vector coordinate sequences. We address and exploit this dual representation by proposing two novel cross-modal translation pre-text tasks for self-supervised feature learning: Vectorization and Rasterization. Vectorization learns to map image space to vector coordinates and rasterization maps vector coordinates to image space. We show that our learned encoder modules benefit both raster-based and vector-based downstream approaches to analysing hand-drawn data. Empirical evidence shows that our novel pre-text tasks surpass existing single and multi-modal self-supervision methods.

Similar Papers
  • Research Article
  • Citations8

Self-supervised learning for heterogeneous graph via structure information based on metapath

  • May 12, 2023
  • Applied Soft Computing
  • Shuai Ma +2
  • Research Article
  • Citations20

Self-supervised visual learning in the low-data regime: A comparative evaluation

  • Mar 01, 2025
  • Neurocomputing
  • Sotirios Konstantakos +6
  • PDF
  • Research Article
  • Citations16

A Generic Self-Supervised Learning (SSL) Framework for Representation Learning from Spectral–Spatial Features of Unlabeled Remote Sensing Imagery

  • Nov 03, 2023
  • Remote Sensing
  • Xin Zhang +1
  • Research Article
  • Citations45

Volumetric white matter tract segmentation with nested self-supervised learning using sequential pretext tasks.

  • Apr 30, 2021
  • Medical Image Analysis
  • Qi Lu +2
  • Research Article

Self-supervised learning for stroke lesion segmentation on CT: a new pretext task for neuroimaging.

  • Jul 14, 2025
  • Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference
  • Juliette Moreau +6
  • Book Chapter
  • Citations7

CaSS: A Channel-Aware Self-supervised Representation Learning Framework for Multivariate Time Series Classification

  • Jan 01, 2022
  • Yijiang Chen +4
  • Conference Article
  • Citations2

A Novel Multi-Task Self-Supervised Representation Learning Paradigm

  • May 28, 2021
  • Control theory & applications
  • Yinggang Li +5
  • Research Article
  • Citations5

A new self-supervised task on graphs: Geodesic distance prediction

  • Jun 16, 2022
  • Information Sciences
  • Zhen Peng +4
  • PDF
  • Conference Article
  • Citations3

Organoids Segmentation using Self-Supervised Learning: How Complex Should the Pretext Task Be?

  • Nov 09, 2023
  • Asmaa Haja +2
  • Conference Article
  • Citations4

Conditional Independence for Pretext Task Selection in Self-Supervised Speech Representation Learning

  • Aug 30, 2021
  • Salah Zaiem +2
  • Research Article
  • Citations16

Pretext Tasks Selection for Multitask Self-Supervised Audio Representation Learning

  • Oct 01, 2022
  • IEEE Journal of Selected Topics in Signal Processing
  • Salah Zaiem +3
  • Research Article
  • Citations6

Self-Supervised Video Representation Learning by Serial Restoration With Elastic Complexity

  • Jan 01, 2024
  • IEEE Transactions on Multimedia
  • Ziyu Chen +2
  • Conference Article
  • Citations2

Self-Supervised Point Cloud Learning in Few-Shot Scenario by Point Up-Sampling and Mutual Information Neural Estimation

  • Apr 22, 2022
  • Jiawei Li +2
  • Conference Article
  • Citations1518

Self-Supervised Learning of Pretext-Invariant Representations

  • Jun 01, 2020
  • Ishan Misra +1
  • Conference Article
  • Citations4

Self-supervised Learning Based on Max-tree Representation for Medical Image Segmentation

  • Jul 18, 2022
  • Qian Tang +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.