• Home
  • Search
  • Bregman dynamics, contact transformations and convex optimization
  • Cite Icon1
  • https://doi.org/10.1007/s41884-023-00105-0Copy DOI Icon

Bregman dynamics, contact transformations and convex optimization

Show More
  • Abstract
  • Highlights & Summary
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Recent research on accelerated gradient methods of use in optimization has demonstrated that these methods can be derived as discretizations of dynamical systems. This, in turn, has provided a basis for more systematic investigations, especially into the geometric structure of those dynamical systems and their structure-preserving discretizations. In this work, we introduce dynamical systems defined through a contact geometry which are not only naturally suited to the optimization goal but also subsume all previous methods based on geometric dynamical systems. As a consequence, all the deterministic flows used in optimization share an extremely interesting geometric property: they are invariant under contact transformations. In our main result, we exploit this observation to show that the celebrated Bregman Hamiltonian system can always be transformed into an equivalent but separable Hamiltonian by means of a contact transformation. This in turn enables the development of fast and robust discretizations through geometric contact splitting integrators. As an illustration, we propose the Relativistic Bregman algorithm, and show in some paradigmatic examples that it compares favorably with respect to standard optimization algorithms such as classical momentum and Nesterov’s accelerated gradient.

Loading PDF

Similar Papers
  • Research Article
  • Citations29

Discrete dynamical systems and chaos

  • Jan 01, 1994
  • Choice Reviews Online
  • Mario Martelli
  • Conference Article
  • Citations2

On LTL Model Checking for Low-Dimensional Discrete Linear Dynamical Systems

  • Jan 01, 2020
  • DROPS (Schloss Dagstuhl – Leibniz Center for Informatics)
  • Toghrul Karimov +2
  • Book Chapter

Discrete Dynamical System Model of Distributed Computing with Embedded Partial Order

  • Jan 01, 2012
  • Susmit Bagchi
  • Research Article
  • Citations2

Numerical integration of differential algebraic systems and invariant manifolds

  • Jan 01, 1999
  • Repository for Publications and Research Data (ETH Zurich)
  • Kaspar Nipp
  • Single Book
  • Citations35

Dynamical Systems with Applications using Python

  • Jan 01, 2018
  • Stephen Lynch
  • PDF
  • Research Article
  • Citations3

Perturbation to Symmetry and Adiabatic Invariants of General Discrete Holonomic Dynamical Systems

  • Mar 01, 2011
  • Acta Physica Polonica A
  • P Wang +1
  • Research Article
  • Citations5

Relation of stability and bifurcation properties between continuous and ultradiscrete dynamical systems via discretization with positivity: One dimensional cases

  • Apr 01, 2023
  • Journal of Mathematical Physics
  • Shousuke Ohmori +1
  • Research Article
  • Citations6

Stability in terms of two measures for set difference equations in space

  • Dec 30, 2015
  • Applicable Analysis
  • V I Slyn’Ko
  • Supplementary Content
  • Citations1

Behavior Data Analysis of English Learners Based on Discrete Dynamic System Modeling Method.

  • Sep 02, 2022
  • Computational Intelligence and Neuroscience
  • Hongli Chen +1
  • Research Article

Using a Card Trick to Illustrate Fixed Points and Stability

  • May 11, 2015
  • PRIMUS
  • Jyoti Champanerkar +1
  • Research Article
  • Citations25

Localization of elastic waves in randomly disordered multi-coupled multi-span beams

  • Jul 01, 2004
  • Waves in Random Media
  • F M Li +3
  • Research Article
  • Citations12

On Ordering the Natural Numbers or The Sharkovski Theorem

  • Feb 01, 2008
  • The American Mathematical Monthly
  • Krzysztof Ciesielski +1
  • Research Article
  • Citations16

On t-entropy and variational principle for the spectral radius of weighted shift operators

  • Nov 24, 2009
  • Ergodic Theory and Dynamical Systems
  • V I Bakhtin
  • Book Chapter

Hybrid Cellular Automata Models for Discrete Dynamical Systems

  • Aug 06, 2021
  • Sreeya Ghosh +1
  • Book Chapter

Discrete Linear Dynamical Systems

  • Jan 01, 2013
  • Joël Ouaknine
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.