• Home
  • Search
  • Pre-text Representation Transfer for Deep Learning with Limited and Imbalanced Data: Application to CT-Based COVID-19 Detection
  • https://doi.org/10.1007/978-3-031-25825-1_9Copy DOI Icon

Pre-text Representation Transfer for Deep Learning with Limited and Imbalanced Data: Application to CT-Based COVID-19 Detection

  • Jan 1, 2023
  • Fouzia Altaf +3 more
Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Abstract Annotating medical images for disease detection is often tedious and expensive. Moreover, the available training samples for a given task are generally scarce and imbalanced. These conditions are not conducive for learning effective deep neural models. Hence, it is common to ‘transfer’ neural networks trained on natural images to the medical image domain. However, this paradigm lacks in performance due to the large domain gap between the natural and medical image data. To address that, we propose a novel concept of Pre-text Representation Transfer (PRT). In contrast to the conventional transfer learning, which fine-tunes a source model after replacing its classification layers, PRT retains the original classification layers and updates the representation layers through an unsupervised pre-text task. The task is performed with (original, not synthetic) medical images, without utilizing any annotations. This enables representation transfer with a large amount of training data. This high-fidelity representation transfer allows us to use the resulting model as a more effective feature extractor. Moreover, we can also subsequently perform the traditional transfer learning with this model. We devise a collaborative representation based classification layer for the case when we leverage the model as a feature extractor. We fuse the output of this layer with the predictions of a model induced with the traditional transfer learning performed over our pre-text transferred model. The utility of our technique for limited and imbalanced data classification problem is demonstrated with an extensive five-fold evaluation for three large-scale models, tested for five different class-imbalance ratios for CT based COVID-19 detection. Our results show a consistent gain over the conventional transfer learning with the proposed method.KeywordsTransfer learningImbalanced dataCOVID-19

Similar Papers
  • Research Article

Vitiligo state assessment based on progressive transfer learning and multimodal domain adaptation

  • May 08, 2026
  • Biomedical Physics & Engineering Express
  • Chuanhui Wu +7
  • Research Article
  • Citations21

A hybrid approach for multi modal brain tumor segmentation using two phase transfer learning, SSL and a hybrid 3DUNET

  • Jul 02, 2024
  • Computers and Electrical Engineering
  • Kaliprasad Pani +1
  • Research Article
  • Citations35

A two-stage deep transfer learning model and its application for medical image processing in Traditional Chinese Medicine

  • Dec 30, 2021
  • Knowledge-Based Systems
  • Xu Zhang +5
  • Research Article
  • Citations64

A comparative study of X-ray and CT images in COVID-19 detection using image processing and deep learning techniques

  • Jan 01, 2022
  • Computer methods and programs in biomedicine update
  • H Mary Shyni +1
  • Research Article
  • Citations15

T[formula omitted]L: Trans-transfer Learning for few-shot fine-grained visual categorization with extended adaptation

  • Jan 25, 2023
  • Knowledge-Based Systems
  • Nan Sun +1
  • Research Article
  • Citations205

Internet of health things-driven deep learning system for detection and classification of cervical cells using transfer learning

  • Jan 14, 2020
  • The Journal of Supercomputing
  • Aditya Khamparia +4
  • Research Article

A Physics-Guided Transfer Learning Framework with Consistency Verification for Cross-Domain Bearing Fault Diagnosis

  • Oct 19, 2025
  • Eksploatacja i Niezawodność – Maintenance and Reliability
  • Xinze Jiao Xinze Jiao +2
  • Research Article

Comparative Study of Deep Learning Models to Classify of Multi-Class Skin Cancer on Imbalanced Data

  • Jul 24, 2025
  • Jurnal Nasional Pendidikan Teknik Informatika (JANAPATI)
  • Widhia Kz Oktoeberza +5
  • Research Article
  • Citations6

Progressive learning with style transfer for distant domain adaptation

  • Oct 14, 2020
  • IET Image Processing
  • Suncheng Xiang +2
  • Research Article

Medical Diagnosis Using Hybrid of Machine Learning and Deep Learning Techniques

  • Jan 01, 2025
  • International Journal of Advanced Computer Science and Applications
  • Raed Alazaidah +9
  • Book Chapter
  • Citations9

Three Aspects on Using Convolutional Neural Networks for Computer-Aided Detection in Medical Imaging

  • Jan 01, 2017
  • Hoo-Chang Shin +8
  • Research Article
  • Citations2

Evaluation of effectiveness of pre-training method in chest X-ray imaging using vision transformer

  • May 25, 2024
  • Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization
  • Kuniki Imagawa +1
  • PDF
  • Front Matter
  • Citations49

3D printing and medical imaging.

  • Sep 01, 2018
  • Journal of Medical Radiation Sciences
  • Andrew Squelch
  • Research Article
  • Citations1

Non-invasive detection of choroidal melanoma via tear-derived protein corona on gold nanoparticles: a machine learning approach

  • Sep 25, 2025
  • Scientific Reports
  • Hakimeh Rakhshandeh +8
  • Research Article
  • Citations11

A hybridized feature extraction for COVID-19 multi-class classification on computed tomography images

  • Feb 24, 2024
  • Heliyon
  • Hassana Abubakar +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.