• Home
  • Search
  • UniMiSS+: Universal Medical Self-Supervised Learning From Cross-Dimensional Unpaired Data.
  • Cite Icon12
  • https://doi.org/10.1109/tpami.2024.3436105Copy DOI Icon

UniMiSS+: Universal Medical Self-Supervised Learning From Cross-Dimensional Unpaired Data.

  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Self-supervised learning (SSL) opens up huge opportunities for medical image analysis that is well known for its lack of annotations. However, aggregating massive (unlabeled) 3D medical images like computerized tomography (CT) remains challenging due to its high imaging cost and privacy restrictions. In our pilot study, we advocated bringing a wealth of 2D images like X-rays as compensation for the lack of 3D data, aiming to build a universal medical self-supervised representation learning framework, called UniMiSS. Especially, we designed a pyramid U-like medical Transformer (MiT) as the backbone to make UniMiSS possible to perform SSL with both 2D and 3D images. UniMiSS surpasses current 3D-specific SSL in effectiveness and versatility, excelling in various downstream tasks and overcoming the limitations of dimensionality. However, the initial version did not fully explore the anatomical correlations between 2D and 3D images due to the absence of paired multi-modal patient data. In this extension, we introduce UniMiSS+, which leverages digitally reconstructed radiographs (DRR) technology to simulate X-rays from CT volumes, providing access to paired data. Benefiting from the paired group, we introduce an extra pair-wise constraint to boost the cross modality correlation learning, which also can be adopted as a cross dimension regularization to further improve the representations. We conduct expensive experiments on multiple 3D/2D medical image analysis tasks, including segmentation and classification. The results show that our UniMiSS+ achieves promising performance on various downstream tasks, not only outperforming ImageNet pre-training and other advanced SSL counterparts but also improving the predecessor UniMiSS pre-training.

Similar Papers
  • Book Chapter
  • Citations63

UniMiSS: Universal Medical Self-supervised Learning via Breaking Dimensionality Barrier

  • Jan 01, 2022
  • Yutong Xie +3
  • Conference Article
  • Citations9

Self-Supervised Alignment Learning For Medical Image Segmentation

  • May 27, 2024
  • Haofeng Li +2
  • Research Article
  • Citations23

DrasCLR: A self-supervised framework of learning disease-related and anatomy-specific representation for 3D lung CT images

  • Dec 09, 2023
  • Medical image analysis
  • Ke Yu +5
  • Research Article

Anatomy-Guided Self-Supervised Distillation Learning for Medical Image Analysis.

  • May 01, 2026
  • IEEE transactions on medical imaging
  • Huihui Yu +1
  • Conference Article
  • Citations2

A Novel Multi-Task Self-Supervised Representation Learning Paradigm

  • May 28, 2021
  • Control theory & applications
  • Yinggang Li +5
  • Book Chapter
  • Citations179

Self-supervised Feature Learning for 3D Medical Images by Playing a Rubik’s Cube

  • Jan 01, 2019
  • Xinrui Zhuang +5
  • Book Chapter
  • Citations12

Case Discrimination: Self-supervised Feature Learning for the Classification of Focal Liver Lesions

  • Jan 01, 2021
  • Haohua Dong +6
  • Book Chapter
  • Citations4

Aggregative Self-supervised Feature Learning from Limited Medical Images

  • Jan 01, 2022
  • Jiuwen Zhu +3
  • Research Article
  • Citations20

Self-supervised visual learning in the low-data regime: A comparative evaluation

  • Mar 01, 2025
  • Neurocomputing
  • Sotirios Konstantakos +6
  • Research Article
  • Citations74

A Unified Visual Information Preservation Framework for Self-supervised Pre-Training in Medical Image Analysis.

  • Jan 01, 2023
  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • Hong-Yu Zhou +4
  • Research Article
  • Citations11

Joint Self-Supervised Image-Volume Representation Learning with Intra-inter Contrastive Clustering

  • Jun 26, 2023
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Duy M H Nguyen +9
  • Research Article

Enhancing Slice-Wise Brain MRI Tasks using Self-Supervised and Auxiliary Learning.

  • Jan 01, 2025
  • IEEE journal of biomedical and health informatics
  • Giovanni Castiglioni +4
  • Research Article
  • Citations7

MLVICX: Multi-Level Variance-Covariance Exploration for Chest X-Ray Self-Supervised Representation Learning.

  • Dec 01, 2024
  • IEEE journal of biomedical and health informatics
  • Azad Singh +2
  • Research Article
  • Citations1

Self-Supervised Attentive Feature Learning for Alzheimer’s Disease Detection

  • Sep 26, 2025
  • International Journal of Interactive Multimedia and Artificial Intelligence
  • Hela Elmannai +3
  • Research Article
  • Citations14

Benchmarking Self-Supervised Contrastive Learning Methods for Image-Based Plant Phenotyping

  • Jan 01, 2023
  • Plant Phenomics
  • Franklin C Ogidi +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.