• Home
  • Search
  • Self-supervised representation learning using feature pyramid siamese networks for colorectal polyp detection
  • Cite Icon4
  • https://doi.org/10.1038/s41598-023-49057-6Copy DOI Icon

Self-supervised representation learning using feature pyramid siamese networks for colorectal polyp detection

Show More
  • Abstract
  • Highlights & Summary
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Colorectal cancer is a leading cause of cancer-related deaths globally. In recent years, the use of convolutional neural networks in computer-aided diagnosis (CAD) has facilitated simpler detection of early lesions like polyps during real-time colonoscopy. However, the majority of existing techniques require a large training dataset annotated by experienced experts. To alleviate the laborious task of image annotation and utilize the vast amounts of readily available unlabeled colonoscopy data to further improve the polyp detection ability, this study proposed a novel self-supervised representation learning method called feature pyramid siamese networks (FPSiam). First, a feature pyramid encoder module was proposed to effectively extract and fuse both local and global feature representations among colonoscopic images, which is important for dense prediction tasks like polyp detection. Next, a self-supervised visual feature representation containing the general feature of colonoscopic images is learned by the siamese networks. Finally, the feature representation will be transferred to the downstream colorectal polyp detection task. A total of 103 videos (861,400 frames), 100 videos (24,789 frames), and 60 videos (15,397 frames) in the LDPolypVideo dataset are used to pre-train, train, and test the performance of the proposed FPSiam and its counterparts, respectively. The experimental results have illustrated that our FPSiam approach obtains the optimal capability, which is better than that of other state-of-the-art self-supervised learning methods and is also higher than the method based on transfer learning by 2.3 mAP and 3.6 mAP for two typical detectors. In conclusion, FPSiam provides a cost-efficient solution for developing colorectal polyp detection systems, especially in conditions where only a small fraction of the dataset is labeled while the majority remains unlabeled. Besides, it also brings fresh perspectives into other endoscopic image analysis tasks.

Loading PDF

Similar Papers
  • Research Article
  • Citations14

Benchmarking Self-Supervised Contrastive Learning Methods for Image-Based Plant Phenotyping

  • Jan 01, 2023
  • Plant Phenomics
  • Franklin C Ogidi +2
  • Research Article
  • Citations2063

Self-Supervised Visual Feature Learning With Deep Neural Networks: A Survey.

  • May 04, 2020
  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • Longlong Jing +1
  • Research Article
  • Citations48

CS-CO: A Hybrid Self-Supervised Visual Representation Learning Method for H&E-stained Histopathological Images.

  • Oct 01, 2022
  • Medical Image Analysis
  • Pengshuai Yang +6
  • Conference Article
  • Citations15

TriBYOL: Triplet BYOL for Self-Supervised Representation Learning

  • May 23, 2022
  • Guang Li +3
  • Research Article
  • Citations20

In-Distribution and Out-of-Distribution Self-Supervised ECG Representation Learning for Arrhythmia Detection.

  • Feb 01, 2024
  • IEEE journal of biomedical and health informatics
  • Sahar Soltanieh +2
  • Research Article
  • Citations7

Randomly shuffled convolution for self-supervised representation learning

  • Nov 14, 2022
  • Information Sciences
  • Youngjin Oh +3
  • Conference Article
  • Citations2

A Novel Multi-Task Self-Supervised Representation Learning Paradigm

  • May 28, 2021
  • Control theory & applications
  • Yinggang Li +5
  • Conference Article
  • Citations18

Self-supervised Visual Attribute Learning for Fashion Compatibility

  • Oct 01, 2021
  • Donghyun Kim +5
  • Research Article
  • Citations47

Self-supervised reinforcement learning-based energy management for a hybrid electric vehicle

  • Dec 01, 2021
  • Journal of Power Sources
  • Chunyang Qi +7
  • Research Article

Study on Various Self-supervised Video Representation Learning Methods

  • Aug 31, 2022
  • Moving Image & Technology (MINT)
  • Soohyun Park +1
  • Research Article
  • Citations4

WISE: whole-scenario embryo identification using self-supervised learning encoder in IVF.

  • Mar 12, 2024
  • Journal of assisted reproduction and genetics
  • Mark Liu +5
  • Book Chapter
  • Citations7

CaSS: A Channel-Aware Self-supervised Representation Learning Framework for Multivariate Time Series Classification

  • Jan 01, 2022
  • Yijiang Chen +4
  • Research Article
  • Citations28

Self-Supervised Representation Learning for Video Quality Assessment

  • Mar 01, 2023
  • IEEE Transactions on Broadcasting
  • Shaojie Jiang +3
  • Research Article
  • Citations9

One-step progressive representation transfer learning for bird sound classification

  • Sep 01, 2023
  • Applied Acoustics
  • Chengyun Zhang +4
  • Supplementary Content

Subject-based Non-contrastive Self-Supervised Learning for ECG Signal Processing

  • May 12, 2023
  • arXiv (Cornell University)
  • Adrian Atienza +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.