• Home
  • Search
  • Neural Operator Variational Inference Based on Regularized Stein Discrepancy for Deep Gaussian Processes.
  • Open Access IconOpen Access
  • Cite Icon5
  • https://doi.org/10.1109/tnnls.2024.3406635Copy DOI Icon

Neural Operator Variational Inference Based on Regularized Stein Discrepancy for Deep Gaussian Processes.

  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Deep Gaussian process (DGP) models offer a powerful nonparametric approach for Bayesian inference, but exact inference is typically intractable, motivating the use of various approximations. However, existing approaches, such as mean-field Gaussian assumptions, limit the expressiveness and efficacy of DGP models, while stochastic approximation can be computationally expensive. To tackle these challenges, we introduce neural operator variational inference (NOVI) for DGPs. NOVI uses a neural generator to obtain a sampler and minimizes the regularized Stein discrepancy (RSD) between the generated distribution and true posterior in L2 space. We solve the minimax problem using Monte Carlo estimation and subsampling stochastic optimization techniques and demonstrate that the bias introduced by our method can be controlled by multiplying the Fisher divergence with a constant, which leads to robust error control and ensures the stability and precision of the algorithm. Our experiments on datasets ranging from hundreds to millions demonstrate the effectiveness and the faster convergence rate of the proposed method. We achieve a classification accuracy of 93.56 on the CIFAR10 dataset, outperforming state-of-the-art (SOTA) Gaussian process (GP) methods. We are optimistic that NOVI possesses the potential to enhance the performance of deep Bayesian nonparametric models and could have significant implications for various practical applications.

Similar Papers
  • Research Article
  • Citations32

Empirical Assessment of Deep Gaussian Process Surrogate Models for Engineering Problems

  • Sep 18, 2020
  • Journal of Aircraft
  • Dushhyanth Rajaram +6
  • Conference Article
  • Citations1

Automatically Designed Deep Gaussian Process for Turbomachinery Application

  • Jun 07, 2021
  • Yuan Jin +2
  • Book Chapter
  • Citations5

Deep Gaussian Processes Using Expectation Propagation and Monte Carlo Methods

  • Jan 01, 2021
  • Gonzalo Hernández-Muñoz +2
  • Conference Article
  • Citations5

A Training Method Using DNN-guided Layerwise Pretraining for Deep Gaussian Processes

  • May 01, 2019
  • Tomoki Koriyama +1
  • PDF
  • Research Article
  • Citations17

Deep state-space Gaussian processes

  • Sep 23, 2021
  • Statistics and Computing
  • Zheng Zhao +2
  • Research Article

Abstract 2316: A deep Gaussian process (DGP)-based prediction model for immunecheckpoint inhibitor (ICI) response in gastric cancer (GC)

  • Mar 22, 2024
  • Cancer Research
  • Sunho Park +3
  • Research Article
  • Citations4

Deep Gaussian processes for music mood estimation and retrieval with locally aggregated acoustic Fisher vector

  • Mar 19, 2020
  • Sādhanā
  • Santosh Chapaneri +1
  • Conference Article
  • Citations2

Deep Gaussian Processes for Estimating Music Mood

  • Dec 01, 2018
  • Santosh Chapaneri +1
  • Research Article

Text Line Recognition of Dai Language using Statistical Characteristics of Texture Analysis and Deep Gaussian Process

  • May 18, 2021
  • International Journal of Circuits, Systems and Signal Processing
  • Jingying Zhao +4
  • Research Article
  • Citations66

Bayesian optimization using deep Gaussian processes with applications to aerospace system design

  • Jun 12, 2020
  • Optimization and Engineering
  • Ali Hebbal +4
  • Research Article
  • Citations25

Deep recurrent Gaussian processes for outlier-robust system identification

  • Jul 10, 2017
  • Journal of Process Control
  • César Lincoln C Mattos +4
  • Research Article
  • Citations45

Multi-fidelity modeling with different input domain definitions using deep Gaussian processes

  • Feb 23, 2021
  • Structural and Multidisciplinary Optimization
  • Ali Hebbal +4
  • Research Article
  • Citations9

Deep Gaussian process for enhanced Bayesian optimization and its application in additive manufacturing

  • Feb 08, 2024
  • IISE Transactions
  • Raghav Gnanasambandam +4
  • Research Article
  • Citations32

A new optical density granulometry-based descriptor for the classification of prostate histological images using shallow and deep Gaussian processes

  • Jul 04, 2019
  • Computer Methods and Programs in Biomedicine
  • Ángel E Esteban +5
  • Research Article
  • Citations1

Deep Gaussian process priors for Bayesian image reconstruction

  • Jun 11, 2025
  • Inverse Problems
  • Jonas Latz +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.