• Home
  • Search
  • An overview of self-supervised deep learning applications to molecular data.
  • https://doi.org/10.1093/bib/bbag380Copy DOI Icon

An overview of self-supervised deep learning applications to molecular data.

Show More
  • Abstract
  • Literature Map
  • Similar Papers
Abstract

The emergence of high-throughput sequencing technologies has generated unprecedented amounts of molecular data, posing significant challenges for analysis and interpretation. In the past 15 years, deep learning (DL) has revolutionized many data analysis fields. However, a key limitation of most DL approaches is their reliance on massive amounts of data that often require labeling. Self-supervised learning (SSL) uses large-scale unlabeled data to learn meaningful representations for specific tasks, allowing training of the models without labels. While SSL has primarily been applied to fields like natural language processing and medical image analysis, SSL can also be applied to molecular data to learn meaningful representations of molecular sequences that can be used for downstream tasks. Despite the growing interest in SSL applications using molecular data over the recent years, no comprehensive review has been published on this topic, so far, making it timely to address. This paper aims to provide researchers in DL and bioinformatics with a clear view of SSL omics applications to foster future work in the domain. This review examines the principles of SSL, such as foundation models, and it discusses the application of SSL to various omics data types, summarizes information from 17 studies, and categorizes applications by data type, detailing common tasks, model architectures, and repositories. Key applications such as DNABERT and Nucleotide Transformer are highlighted, demonstrating the contributions of SSL in understanding gene regulation. Future directions for SSL in omics are outlined, emphasizing the potential for integrating multi-omics data and developing more sophisticated pretext tasks.

Similar Papers
  • Research Article

Self-Supervised Deep Learning Models for Low-Resource NLP Applications

  • Feb 26, 2026
  • International Journal of Research and Review in Applied Science, Humanities, and Technology
  • Pardeep Kaur
  • Preprint Article

Self-Supervised Learning Principles Challenges and Emerging Directions

  • Feb 24, 2025
  • Preprints.org
  • Jenifer Nadine
  • Book Chapter
  • Citations12

Case Discrimination: Self-supervised Feature Learning for the Classification of Focal Liver Lesions

  • Jan 01, 2021
  • Haohua Dong +6
  • Research Article

Using self-supervised feature learning to improve the use of pulse oximeter signals to predict paediatric hospitalization.

  • Feb 01, 2023
  • Wellcome Open Research
  • Paul Mwaniki +5
  • PDF
  • Research Article

Using self-supervised feature learning to improve the use of pulse oximeter signals to predict paediatric hospitalization

  • Sep 28, 2021
  • Wellcome Open Research
  • Paul Mwaniki +5
  • Conference Article
  • Citations58

LeBenchmark: A Reproducible Framework for Assessing Self-Supervised Representation Learning from Speech

  • Aug 30, 2021
  • Solène Evain +17
  • Research Article
  • Citations2

Spatiotemporal self-supervised predictive learning for atmospheric variable prediction via multi-group multi-attention

  • Jun 13, 2024
  • Knowledge-Based Systems
  • Zhensheng Shi +2
  • Research Article

Abstract 5059: Self-supervised representation learning of somatic mutational data

  • Apr 21, 2025
  • Cancer Research
  • Marzieh Haghighi +2
  • Preprint Article

Pluto: A global volcanic activity early warning system powered by large scale self-supervised deep learning on InSAR data

  • May 15, 2023
  • Nikolaos Ioannis Bountos +4
  • Research Article
  • Citations1808

Self-supervised Learning: Generative or Contrastive

  • Jan 01, 2021
  • IEEE Transactions on Knowledge and Data Engineering
  • Xiao Liu +6
  • Dissertation

Active Uncertainty Representation Learning: Toward More Label Efficiency in Deep Learning

  • Jan 01, 2024
  • Salman Mohamadi
  • Research Article

Anatomy-Guided Self-Supervised Distillation Learning for Medical Image Analysis.

  • May 01, 2026
  • IEEE transactions on medical imaging
  • Huihui Yu +1
  • Research Article
  • Citations42

Self-Supervised RF Signal Representation Learning for NextG Signal Classification With Deep Learning

  • Jan 01, 2023
  • IEEE Wireless Communications Letters
  • Kemal Davaslioglu +4
  • Research Article
  • Citations1

Self-Supervised Attentive Feature Learning for Alzheimer’s Disease Detection

  • Sep 26, 2025
  • International Journal of Interactive Multimedia and Artificial Intelligence
  • Hela Elmannai +3
  • Research Article

Enhancing Slice-Wise Brain MRI Tasks using Self-Supervised and Auxiliary Learning.

  • Jan 01, 2025
  • IEEE journal of biomedical and health informatics
  • Giovanni Castiglioni +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.