• Home
  • Search
  • Self-supervised Feature Learning for 3D Medical Images by Playing a Rubik’s Cube
  • Open Access IconOpen Access
  • Cite Icon179
  • https://doi.org/10.1007/978-3-030-32251-9_46Copy DOI Icon

Self-supervised Feature Learning for 3D Medical Images by Playing a Rubik’s Cube

  • Jan 1, 2019
  • Xinrui Zhuang +5 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Witnessed the development of deep learning, increasing number of studies try to build computer aided diagnosis systems for 3D volumetric medical data. However, as the annotations of 3D medical data are difficult to acquire, the number of annotated 3D medical images is often not enough to well train the deep learning networks. The self-supervised learning deeply exploiting the information of raw data is one of the potential solutions to loose the requirement of training data. In this paper, we propose a self-supervised learning framework for the volumetric medical images. A novel proxy task, i.e., Rubik's cube recovery, is formulated to pre-train 3D neural networks. The proxy task involves two operations, i.e., cube rearrangement and cube rotation, which enforce networks to learn translational and rotational invariant features from raw 3D data. Compared to the train-from-scratch strategy, fine-tuning from the pre-trained network leads to a better accuracy on various tasks, e.g., brain hemorrhage classification and brain tumor segmentation. We show that our self-supervised learning approach can substantially boost the accuracies of 3D deep learning networks on the volumetric medical datasets without using extra data. To our best knowledge, this is the first work focusing on the self-supervised learning of 3D neural networks.

Similar Papers
  • Research Article
  • Citations171

Rubik's Cube+: A self-supervised feature learning framework for 3D medical image analysis.

  • Jun 06, 2020
  • Medical Image Analysis
  • Jiuwen Zhu +5
  • Book Chapter
  • Citations57

Revisiting Rubik’s Cube: Self-supervised Learning with Volume-Wise Transformation for 3D Medical Image Segmentation

  • Jan 01, 2020
  • Xing Tao +4
  • Book Chapter
  • Citations4

Aggregative Self-supervised Feature Learning from Limited Medical Images

  • Jan 01, 2022
  • Jiuwen Zhu +3
  • Conference Article
  • Citations3

Audio-Visual Predictive Coding for Self-Supervised Visual Representation Learning

  • Jan 10, 2021
  • Mani Kumar Tellamekala +3
  • Conference Article
  • Citations9

Self-Supervised Alignment Learning For Medical Image Segmentation

  • May 27, 2024
  • Haofeng Li +2
  • Research Article
  • Citations12

UniMiSS+: Universal Medical Self-Supervised Learning From Cross-Dimensional Unpaired Data.

  • Dec 01, 2024
  • IEEE transactions on pattern analysis and machine intelligence
  • Yutong Xie +3
  • Research Article

Anatomy-Guided Self-Supervised Distillation Learning for Medical Image Analysis.

  • May 01, 2026
  • IEEE transactions on medical imaging
  • Huihui Yu +1
  • Research Article
  • Citations23

SSL++: Improving Self-Supervised Learning by Mitigating the Proxy Task-Specificity Problem.

  • Jan 01, 2022
  • IEEE Transactions on Image Processing
  • Song Chen +5
  • Conference Article

Re-weighting and Hierarchical Pre-training Boost 3D Medical Self-Supervised Representation

  • Nov 26, 2022
  • Shouyu Chen +3
  • Book Chapter
  • Citations63

UniMiSS: Universal Medical Self-supervised Learning via Breaking Dimensionality Barrier

  • Jan 01, 2022
  • Yutong Xie +3
  • Book Chapter
  • Citations9

SAR: Scale-Aware Restoration Learning for 3D Tumor Segmentation

  • Jan 01, 2021
  • Xiaoman Zhang +4
  • Research Article
  • Citations168

Video Cloze Procedure for Self-Supervised Spatio-Temporal Learning

  • Apr 03, 2020
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Dezhao Luo +6
  • Research Article
  • Citations11

Joint Self-Supervised Image-Volume Representation Learning with Intra-inter Contrastive Clustering

  • Jun 26, 2023
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Duy M H Nguyen +9
  • Research Article
  • Citations52

Self-Supervised Feature Learning and Phenotyping for Assessing Age-Related Macular Degeneration Using Retinal Fundus Images

  • Jul 02, 2021
  • Ophthalmology Retina
  • Baladitya Yellapragada +4
  • PDF
  • Research Article
  • Citations8

Biologically Plausible Training Mechanisms for Self-Supervised Learning in Deep Networks

  • Mar 21, 2022
  • Frontiers in Computational Neuroscience
  • Mufeng Tang +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.