• Home
  • Search
  • Evaluating Pretraining Methods for Deep Learning on Geophysical Imaging Datasets
  • https://doi.org/10.1002/essoar.10510520.1Copy DOI Icon

Evaluating Pretraining Methods for Deep Learning on Geophysical Imaging Datasets

  • Feb 15, 2022
  • James Chen
Show More
  • Abstract
  • Literature Map
  • Similar Papers
Abstract

Machine learning has the potential to automate the analysis of vast amounts of raw geophysical data, allowing scientists to monitor changes in key aspects of our climate such as cloud cover in real-time and at fine spatiotemporal scales. However, the lack of large labeled training datasets poses a significant barrier for effectively applying machine learning to these applications. Transfer learning, which involves first pretraining a neural network on an auxiliary “source” dataset and then finetuning on the “target” dataset, has been shown to improve accuracy for machine learning models trained on small datasets. Across prior work on machine learning for geophysical imaging, different choices are made about what data to pretrain on, and the impact of these choices on model performance is unclear. To address this, we systematically explore various settings of transfer learning for cloud classification, cloud segmentation, and aurora classification. We pretrain on different source datasets, including the large ImageNet dataset as well as smaller geophysical datasets that are more similar to the target datasets. We also experiment with multiple transfer learning steps where we pretrain on more than one source dataset. Despite the smaller source datasets’ similarity to the target datasets, we find that pretraining on the large, general-purpose ImageNet dataset yields significantly better results across all of our experiments. Transfer learning is especially effective for smaller target datasets, and in these cases, using multiple source datasets can give a marginal added benefit.

Similar Papers
  • Research Article
  • Citations3

Multilayer meta-matching: translating phenotypic prediction models from multiple datasets to small data

  • Dec 07, 2023
  • bioRxiv
  • Pansheng Chen +13
  • Research Article
  • Citations12

Multilayer meta-matching: Translating phenotypic prediction models from multiple datasets to small data

  • Jul 08, 2024
  • Imaging Neuroscience
  • Pansheng Chen +13
  • PDF
  • Research Article
  • Citations26

Deep Transfer Learning for the Multilabel Classification of Chest X-ray Images.

  • Jun 13, 2022
  • Diagnostics
  • Guan-Hua Huang +5
  • Research Article
  • Citations2

ScMUSCL: multi-source transfer learning for clustering scRNA-seq data.

  • Mar 27, 2025
  • Bioinformatics (Oxford, England)
  • Arash Khoeini +4
  • Research Article
  • Citations2

Similarity-based transfer learning with deep learning networks for accurate CRISPR-Cas9 off-target prediction

  • Oct 24, 2025
  • PLOS Computational Biology
  • Jeremy Charlier +2
  • Research Article
  • Citations21

Transfer (machine) learning approaches coupled with target data augmentation to predict the mechanical properties of concrete

  • Feb 09, 2022
  • Machine Learning with Applications
  • Emily Ford +4
  • Conference Article
  • Citations26

Improving Automatic Jazz Melody Generation by Transfer Learning Techniques

  • Nov 01, 2019
  • Hsiao-Tzu Hung +3
  • Research Article
  • Citations11

Model Reuse in Machine Learning for Author Name Disambiguation: An Exploration of Transfer Learning

  • Jan 01, 2020
  • IEEE Access
  • Jinseok Kim +1
  • Research Article
  • Citations1

Adaptive Transfer Learning for Time-to-Event Modeling with Applications in Disease Risk Assessment.

  • May 12, 2025
  • medRxiv : the preprint server for health sciences
  • Yuying Lu +2
  • Research Article
  • Citations1

Adaptive transfer learning for time-to-event modeling with applications in disease risk assessment.

  • Jan 20, 2026
  • Biostatistics (Oxford, England)
  • Yuying Lu +2
  • Dissertation

Efficient Machine Learning for Time-Varying Data

  • Mar 27, 2026
  • Luis Pedro Silvestrin
  • Conference Article
  • Citations15

P2L: Predicting Transfer Learning for Images and Semantic Relations

  • May 29, 2020
  • Bishwaranjan Bhattacharjee +9
  • Research Article
  • Citations24

Enhanced multi‐dataset transfer learning method for unsupervised person re‐identification using co‐training strategy

  • Oct 31, 2018
  • IET Computer Vision
  • Yuqiao Xian +1
  • PDF
  • Research Article
  • Citations8

Multiple-level biomedical event trigger recognition with transfer learning

  • Sep 06, 2019
  • BMC Bioinformatics
  • Yifei Chen
  • Research Article
  • Citations2

Two-Step Transfer Learning Improves Deep Learning–Based Drug Response Prediction in Small Datasets: A Case Study of Glioblastoma

  • Jan 01, 2025
  • Bioinformatics and Biology Insights
  • Jie Ju +6
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.