• Home
  • Search
  • Deep learning based on self-supervised pre-training: Application on sandstone content prediction
  • Cite Icon4
  • https://doi.org/10.3389/feart.2022.1081998Copy DOI Icon

Deep learning based on self-supervised pre-training: Application on sandstone content prediction

Show More
  • Abstract
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Deep learning has been widely used in various fields and showed promise in recent years. Therefore, deep learning is the future trend to realize seismic data’s intelligent and automatic interpretation. However, traditional deep learning only uses labeled data to train the model, and thus, does not utilize a large amount of unlabeled data. Self-supervised learning, widely used in Natural Language Processing (NLP) and computer vision, is an effective method of learning information from unlabeled data. Thus, a pretext task is designed with reference to Masked Autoencoders (MAE) to realize self-supervised pre-training of unlabeled seismic data. After pre-training, we fine-tune the model to the downstream task. Experiments show that the model can effectively extract information from unlabeled data through the pretext task, and the pre-trained model has better performance in downstream tasks.

Loading PDF

Similar Papers
  • PDF
  • Research Article
  • Citations16

A Generic Self-Supervised Learning (SSL) Framework for Representation Learning from Spectral–Spatial Features of Unlabeled Remote Sensing Imagery

  • Nov 03, 2023
  • Remote Sensing
  • Xin Zhang +1
  • PDF
  • Research Article
  • Citations20

Self-supervised learning for remote sensing scene classification under the few shot scenario

  • Jan 09, 2023
  • Scientific Reports
  • Najd Alosaimi +4
  • PDF
  • Research Article
  • Citations1

CDEST: Class Distinguishability-Enhanced Self-Training Method for Adopting Pre-Trained Models to Downstream Remote Sensing Image Semantic Segmentation

  • Apr 06, 2024
  • Remote Sensing
  • Ming Zhang +7
  • Research Article
  • Citations40

A Novel Two-Stage Unsupervised Fault Recognition Framework Combining Feature Extraction and Fuzzy Clustering for Collaborative AIoT

  • Apr 29, 2021
  • IEEE Transactions on Industrial Informatics
  • Xufeng Hu +3
  • Conference Article
  • Citations4

Self-supervised Learning Based on Max-tree Representation for Medical Image Segmentation

  • Jul 18, 2022
  • Qian Tang +2
  • Conference Article
  • Citations1

Self-Supervised Contrastive Learning on Cross-Augmented Samples for SAR Target Recognition

  • May 01, 2023
  • Xiaoyu Liu +6
  • Research Article
  • Citations390

A comparison review of transfer learning and self-supervised learning: Definitions, applications, advantages and limitations

  • Dec 02, 2023
  • Expert Systems with Applications
  • Zehui Zhao +4
  • Research Article
  • Citations20

Self-supervised visual learning in the low-data regime: A comparative evaluation

  • Mar 01, 2025
  • Neurocomputing
  • Sotirios Konstantakos +6
  • Dissertation

Backdoor in deep learning: new threats and opportunities

  • Jan 01, 2025
  • Kangjie Chen
  • Conference Article

Self-supervised pre-training on industrial time-series

  • Jun 01, 2021
  • Luca Biggio +1
  • Preprint Article

Generalist Geospatial Foundation Model PhilEO on Satellite Sentinel-2 MajorTOM Multi-Spectral Data

  • Mar 15, 2025
  • Nikolaos Dionelis +9
  • Research Article
  • Citations2

FGSS: Federated global self-supervised framework for large-scale unlabeled data

  • May 24, 2023
  • Applied Soft Computing
  • Chen Zhang +4
  • Research Article
  • Citations1

A review of research and development of semi-supervised learning strategies for medical image processing

  • Jan 16, 2024
  • EAI Endorsed Transactions on e-Learning
  • Shengke Yang
  • PDF
  • Book Chapter
  • Citations13

Self-Supervised Contrastive Representation Learning in Computer Vision

  • Dec 21, 2022
  • Yalin Bastanlar +1
  • Research Article
  • Citations2

Spatiotemporal self-supervised predictive learning for atmospheric variable prediction via multi-group multi-attention

  • Jun 13, 2024
  • Knowledge-Based Systems
  • Zhensheng Shi +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.