• Home
  • Search
  • Controlled Markov Chains with Weak and Strong Interactions: Asymptotic Optimality and Applications to Manufacturing
  • Cite Icon20
  • https://doi.org/10.1023/a:1022667905086Copy DOI Icon

Controlled Markov Chains with Weak and Strong Interactions: Asymptotic Optimality and Applications to Manufacturing

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

This paper deals with the asymptotic optimality of a stochastic dynamic system driven by a singularly perturbed Markov chain with finite state space. The states of the Markov chain belong to several groups such that transitions among the states within each group occur much more frequently than transitions among the states in different groups. Aggregating the states of the Markov chain leads to a limit control problem, which is obtained by replacing the states in each group by the corresponding average distribution. The limit control problem is simpler to solve as compared with the original one. A nearly-optimal solution for the original problem is constructed by using the optimal solution to the limit problem. To demonstrate, the suggested approach of asymptotic optimal control is applied to examples of manufacturing systems of production planning.

Similar Papers
  • Conference Article
  • Citations1

Application of stochastic control to analysis and optimization of TCP

  • Nov 01, 2013
  • Alexander Miller +1
  • Book Chapter
  • Citations1

Controlled Markov Chains

  • Jan 01, 1999
  • Christos G Cassandras +1
  • Research Article
  • Citations15

Document

  • Jan 01, 2001
  • Applied Mathematics & Optimization
  • R H Liu +2
  • Research Article
  • Citations32

Strong consistency of a modified maximum likelihood estimator for controlled Markov chains

  • Sep 01, 1980
  • Journal of Applied Probability
  • Bharat Doshi +1
  • Research Article
  • Citations6

Approximating the Solution of Stochastic Optimal Control Problems and the Merton’s Portfolio Selection Model

  • Sep 12, 2018
  • Computational Economics
  • Behzad Kafash
  • Research Article
  • Citations2

Statistics for Continuous Time Markov Chains, a Short Review

  • Apr 08, 2025
  • Axioms
  • Manuel L Esquível +1
  • Research Article

Adjoining batch Markov arrival processes of a Markov chain

  • Jan 01, 2018
  • Acta Mathematicae Applicatae Sinica, English Series
  • Xiao-Yun Mo +2
  • PDF
  • Research Article
  • Citations17

Markov chains under nonlinear expectation

  • Nov 08, 2020
  • Mathematical Finance
  • Max Nendel
  • Book Chapter
  • Citations2

Markov Models

  • Jan 01, 2012
  • Luminita Manuela Bujorianu
  • PDF
  • Research Article
  • Citations2

Robust Control, Optimization, and Applications to Markovian Jumping Systems

  • Jan 01, 2014
  • Abstract and Applied Analysis
  • Shuping He +4
  • Book Chapter

Markov Chains with Random Transition Probabilities

  • Jan 01, 2002
  • Anatoli V Skorokhod +2
  • Research Article
  • Citations139

Asymptotically Efficient Adaptive Choice of Control Laws inControlled Markov Chains

  • May 01, 1997
  • SIAM Journal on Control and Optimization
  • Todd L Graves +1
  • Research Article
  • Citations115

The ergodic theory of Markov chains in random environments

  • Jan 01, 1984
  • Zeitschrift f�r Wahrscheinlichkeitstheorie und Verwandte Gebiete
  • Robert Cogburn
  • PDF
  • Research Article
  • Citations7

Sharpe-Ratio Portfolio in Controllable Markov Chains: Analytic and Algorithmic Approach for Second Order Cone Programming

  • Sep 06, 2022
  • Mathematics
  • Lesly Lisset Ortiz-Cerezo +2
  • Research Article
  • Citations17

Practical stability of nonlinear stochastic hybrid parabolic systems of Itô-type: Vector Lyapunov functions approach

  • Oct 08, 2010
  • Nonlinear Analysis: Real World Applications
  • M.J Anabtawi
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.