• Open Access IconOpen Access
  • Cite Icon8
  • https://doi.org/10.1109/tit.2016.2521364Copy DOI Icon

Maximum Rényi Entropy Rate

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

The supremum of the Renyi entropy rate over the class of discrete-time stationary stochastic processes, whose marginals are supported by some given set and satisfy some given cost constraint, is computed. Unlike the Shannon entropy, the Renyi entropy of a random vector can exceed the sum of the Renyi entropies of its components, and the supremum is, therefore, typically not achieved by memoryless processes. It is nonetheless related to Shannon’s entropy: when the Renyi parameter exceeds one, the supremum is equal to the corresponding supremum of Shannon’s entropy, and when it is smaller than one, the supremum equals the logarithm of the volume of the support set. A Burg-like supremum of the Renyi entropy rate over the class of stochastic processes, whose autocovariance function begins with some given values, is also solved. It is not achieved by Gauss–Markov processes, but it is nonetheless related to Burg’s supremum: the two are equal when the Renyi parameter exceeds one, and the former is infinite otherwise.

Similar Papers
  • Research Article
  • Citations44

Entanglement's dynamics from classical stochastic process

  • Nov 01, 2009
  • EPL (Europhysics Letters)
  • A Khrennikov
  • Book Chapter

Population Projection Methodology Based on Stochastic Population Processes

  • Jan 01, 1985
  • Charles J Mode
  • Book Chapter

Stochastic Processes Defined by ODE’s

  • Jan 01, 1996
  • Mark Freidlin
  • Research Article
  • Citations9

Bases in 𝐿₂ spaces with applications to stochastic processes with orthogonal increments

  • Jan 01, 1971
  • Proceedings of the American Mathematical Society
  • Stamatis Cambanis
  • Research Article

Non-exponential Decay in Classical Stochastic Processes with Memory

  • Jan 01, 2023
  • Acta Physica Polonica B
  • M Rybczyński +1
  • Research Article

Classical analogs of quasifree quantum stochastic processes given by stochastic states of the quantized electromagnetic field

  • Mar 01, 2001
  • Journal of Mathematical Physics
  • C Hertfelder +1
  • Conference Article
  • Citations4

Combinatorial Stochastic Processes and Nonparametric Bayesian Modeling

  • Jan 04, 2009
  • Michael I Jordan
  • Research Article
  • Citations795

On Transforming a Certain Class of Stochastic Processes by Absolutely Continuous Substitution of Measures

  • Jan 01, 1960
  • Theory of Probability & Its Applications
  • I V Girsanov
  • Book Chapter

Martingales

  • Oct 29, 2013
  • Sidney I Resnick
  • Research Article
  • Citations14

On a class of stochastic processes and its relationship to infinite particle gases

  • Jan 01, 1968
  • Transactions of the American Mathematical Society
  • D Paul Johnson
  • Single Book
  • Citations541

Semi-Markov Processes and Reliability

  • Jan 01, 2001
  • N Limnios +1
  • Conference Article

An efficient algorithm for dempster's completion of block-circulant covariance matrices

  • Dec 01, 2011
  • Francesca P Carli +3
  • Research Article

Asymptotic theory of inference for a certain class of stochastic processes

  • Jun 01, 1979
  • Advances in Applied Probability
  • I V Basawa
  • Research Article
  • Citations39

Rare events in generalized L\xe9vy Walks and the Big Jump principle

  • Feb 17, 2020
  • Scientific Reports
  • Alessandro Vezzani +2
  • Research Article
  • Citations5

Gradient walks and 𝑝-harmonic functions

  • Jun 09, 2017
  • Proceedings of the American Mathematical Society
  • Hannes Luiro +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.