• Home
  • Search
  • Active Uncertainty Representation Learning: Toward More Label Efficiency in Deep Learning
  • https://doi.org/10.33915/etd.12295Copy DOI Icon

Active Uncertainty Representation Learning: Toward More Label Efficiency in Deep Learning

  • Jan 1, 2024
  • Salman Mohamadi
Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

The primary goal of this dissertation is to investigate and improve the efficiency of deep learning algorithms, especially within computer vision problem domains, from the perspective of label-efficiency. This investigation showed that deep learning algorithms are mostly notorious for the lack of uncertainty representation. Accordingly, we aimed to develop an array of deep learning frameworks rich with uncertainty representation. These frameworks are mainly within two current pillars of machine learning, deep active learning and self-supervised learning. These frameworks include deep active ensemble sampling for efficient sample selection within deep active learning, a two-stage ensemble-based general self-training approach for existing visual self-supervised learning baselines, introduction of partial information decomposition to self-supervised learning and developing two techniques to exploit synergistic and unique information component within PID context, and a coloring approach for enhanced feature decoupling within self-supervised feature learning. Along with this major line of work, we also investigated the application of computational methods (e.g., machine learning and signal processing algorithms) in some problems in computational biology. This included applications in human genome sequence modeling, age estimation using gene expression data, age-related gene selection, and causal inference and association for age-related genes. Taken all these together, this dissertation shed insight on label-efficiency in deep learning, the efficient use of scarce data and resources (such as the case with computational biology), and on recent directions in generative AI.

Similar Papers
  • Book Chapter
  • Citations12

Case Discrimination: Self-supervised Feature Learning for the Classification of Focal Liver Lesions

  • Jan 01, 2021
  • Haohua Dong +6
  • Research Article
  • Citations24

Deep Bayesian Active Learning for Learning to Rank: A Case Study in Answer Selection

  • Nov 01, 2022
  • IEEE Transactions on Knowledge and Data Engineering
  • Qunbo Wang +3
  • Research Article

Using self-supervised feature learning to improve the use of pulse oximeter signals to predict paediatric hospitalization.

  • Feb 01, 2023
  • Wellcome Open Research
  • Paul Mwaniki +5
  • PDF
  • Research Article

Using self-supervised feature learning to improve the use of pulse oximeter signals to predict paediatric hospitalization

  • Sep 28, 2021
  • Wellcome Open Research
  • Paul Mwaniki +5
  • Research Article

Self-Supervised Deep Learning Models for Low-Resource NLP Applications

  • Feb 26, 2026
  • International Journal of Research and Review in Applied Science, Humanities, and Technology
  • Pardeep Kaur
  • Research Article
  • Citations52

Self-Supervised Feature Learning and Phenotyping for Assessing Age-Related Macular Degeneration Using Retinal Fundus Images

  • Jul 02, 2021
  • Ophthalmology Retina
  • Baladitya Yellapragada +4
  • Research Article

An overview of self-supervised deep learning applications to molecular data.

  • Jul 03, 2026
  • Briefings in bioinformatics
  • Lluis Borràs Ferrís +6
  • Research Article
  • Citations2

Spatiotemporal self-supervised predictive learning for atmospheric variable prediction via multi-group multi-attention

  • Jun 13, 2024
  • Knowledge-Based Systems
  • Zhensheng Shi +2
  • Preprint Article

Pluto: A global volcanic activity early warning system powered by large scale self-supervised deep learning on InSAR data

  • May 15, 2023
  • Nikolaos Ioannis Bountos +4
  • Research Article
  • Citations3

Overview of deep learning algorithms for PolSAR image classification

  • Jul 30, 2024
  • Chinese Science Bulletin
  • Haixia Bi +4
  • Research Article
  • Citations42

Self-Supervised RF Signal Representation Learning for NextG Signal Classification With Deep Learning

  • Jan 01, 2023
  • IEEE Wireless Communications Letters
  • Kemal Davaslioglu +4
  • Book Chapter
  • Citations179

Self-supervised Feature Learning for 3D Medical Images by Playing a Rubik’s Cube

  • Jan 01, 2019
  • Xinrui Zhuang +5
  • PDF
  • Research Article
  • Citations45

Detection of maternal and fetal stress from the electrocardiogram with self-supervised representation learning

  • Dec 01, 2021
  • Scientific Reports
  • Pritam Sarkar +7
  • Research Article
  • Citations110

A comprehensive survey on deep active learning in medical image analysis

  • May 13, 2024
  • Medical image analysis
  • Haoran Wang +5
  • PDF
  • Research Article
  • Citations4

Self-supervised maize kernel classification and segmentation for embryo identification

  • Apr 14, 2023
  • Frontiers in Plant Science
  • David Dong +6
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.