• Home
  • Search
  • Training Deep Gaussian Processes using Stochastic Expectation Propagation and Probabilistic Backpropagation
  • Cite Icon9
  • https://doi.org/10.17863/cam.21292Copy DOI Icon

Training Deep Gaussian Processes using Stochastic Expectation Propagation and Probabilistic Backpropagation

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Deep Gaussian processes (DGPs) are multi-layer hierarchical generalisations of Gaussian processes (GPs) and are formally equivalent to neural networks with multiple, infinitely wide hidden layers. DGPs are probabilistic and non-parametric and as such are arguably more flexible, have a greater capacity to generalise, and provide better calibrated uncertainty estimates than alternative deep models. The focus of this paper is scalable approximate Bayesian learning of these networks. The paper develops a novel and efficient extension of probabilistic backpropagation, a state-of-the-art method for training Bayesian neural networks, that can be used to train DGPs. The new method leverages a recently proposed method for scaling Expectation Propagation, called stochastic Expectation Propagation. The method is able to automatically discover useful input warping, expansion or compression, and it is therefore is a flexible form of Bayesian kernel design. We demonstrate the success of the new method for supervised learning on several real-world datasets, showing that it typically outperforms GP regression and is never much worse.

Similar Papers
  • Conference Article
  • Citations132

Deep Gaussian processes for regression using approximate expectation propagation

  • Jun 19, 2016
  • Apollo (University of Cambridge)
  • Thang D Bui +4
  • Book Chapter
  • Citations5

Deep Gaussian Processes Using Expectation Propagation and Monte Carlo Methods

  • Jan 01, 2021
  • Gonzalo Hernández-Muñoz +2
  • PDF
  • Research Article
  • Citations17

Deep state-space Gaussian processes

  • Sep 23, 2021
  • Statistics and Computing
  • Zheng Zhao +2
  • Conference Article
  • Citations1

Automatically Designed Deep Gaussian Process for Turbomachinery Application

  • Jun 07, 2021
  • Yuan Jin +2
  • Research Article
  • Citations1

Alpha-divergence minimization for deep Gaussian processes

  • Aug 22, 2022
  • International Journal of Approximate Reasoning
  • Carlos Villacampa-Calvo +2
  • Research Article
  • Citations9

Deep Gaussian process for enhanced Bayesian optimization and its application in additive manufacturing

  • Feb 08, 2024
  • IISE Transactions
  • Raghav Gnanasambandam +4
  • Conference Article
  • Citations1

Multi-Objective Bayesian Optimization Supported by Deep Gaussian Processes

  • Apr 11, 2023
  • SAE technical papers on CD-ROM/SAE technical paper series
  • Homero Valladares +1
  • Research Article
  • Citations4

Conditional Deep Gaussian Processes: Empirical Bayes Hyperdata Learning.

  • Oct 23, 2021
  • Entropy
  • Chi-Ken Lu +1
  • Research Article
  • Citations32

Empirical Assessment of Deep Gaussian Process Surrogate Models for Engineering Problems

  • Sep 18, 2020
  • Journal of Aircraft
  • Dushhyanth Rajaram +6
  • Research Article
  • Citations4

Deep Gaussian processes for music mood estimation and retrieval with locally aggregated acoustic Fisher vector

  • Mar 19, 2020
  • Sādhanā
  • Santosh Chapaneri +1
  • Research Article
  • Citations9

Reliability analysis of simply supported beam using GRNN, ELM and GPR

  • Jan 01, 2019
  • Structural Engineering and Mechanics
  • J Jagan +2
  • Research Article
  • Citations66

Bayesian optimization using deep Gaussian processes with applications to aerospace system design

  • Jun 12, 2020
  • Optimization and Engineering
  • Ali Hebbal +4
  • Research Article
  • Citations11

Locally Smoothed Gaussian Process Regression

  • Jan 01, 2022
  • Procedia Computer Science
  • Davit Gogolashvili +2
  • Research Article
  • Citations32

A new optical density granulometry-based descriptor for the classification of prostate histological images using shallow and deep Gaussian processes

  • Jul 04, 2019
  • Computer Methods and Programs in Biomedicine
  • Ángel E Esteban +5
  • Research Article

Text Line Recognition of Dai Language using Statistical Characteristics of Texture Analysis and Deep Gaussian Process

  • May 18, 2021
  • International Journal of Circuits, Systems and Signal Processing
  • Jingying Zhao +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.