8
- https://doi.org/10.1002/nla.1967
Computing the nearest reversible Markov chain
- Jan 27, 2015
- Numerical Linear Algebra with Applications
- A J N Nielsen +1 more
Abstract
SummaryReversible Markov chains are the basis of many applications. However, computing transition probabilities by a finite sampling of a Markov chain can lead to truncation errors. Even if the original Markov chain is reversible, the approximated Markov chain might be non‐reversible and will lose important properties, like the real‐valued spectrum. In this paper, we show how to find the closest reversible Markov chain to a given transition matrix. It turns out that this matrix can be computed by solving a convex minimization problem. Copyright © 2015 John Wiley & Sons, Ltd.
- # Markov Chain
- # Original Markov Chain
- # Computing Transition Probabilities
- # Transition Matrix
- # Convex Minimization Problem
- # Reversible Markov Chain
- # Original Markov
- # Finite Sampling
- # Convex Minimization
- # Truncation Errors