• https://doi.org/10.1007/978-0-8176-8421-1_5Copy DOI Icon

Imbedded Markov Chain Models

  • Jan 1, 2015
  • U Narayan Bhat
Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Abstract In the last chapter, we used Markov process models for queueing systems with Poisson arrivals and exponential service times. To model a system as a Markov process, we should be able to give complete distribution characteristics of the process beyond time t, using what we know about the process at t and changes that may occur after t, without referring back to the events before t. When arrivals are Poisson and service times are exponential, because of the memoryless property of the exponential distribution we are able to use the Markov process as a model. If the arrival rate is λ and service rate is μ, at any time point t, time to next arrival has the exponential distribution with rate λ, and if a service is in progress, the remaining service time has the exponential distribution with rate μ. If one or both of the arrival and service distributions are non-exponential, the memoryless property does not hold and a Markov model of the type discussed in the last chapter does not work. In this chapter, we discuss a method by which a Markov model can be constructed, not for all t, but for specific time points on the time axis.KeywordsMarkov ChainService TimeTransition Probability MatrixProbability Generate FunctionService Time DistributionThese keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Similar Papers
  • Research Article
  • Citations4

The analysis of queue model on a motorcycle parking area

  • Mar 01, 2020
  • Journal of Physics: Conference Series
  • Susi Setiawani +2
  • Research Article
  • Citations3

An analysis of the equilibrium strategies for route-choosing customers in a two-station queueing system

  • Jul 06, 2024
  • Decision Analytics Journal
  • Geofferey Jiyun Kim +1
  • Research Article
  • Citations15

A Tandem Queuewith a Movable Server: An Eigenvalue Approach

  • Jan 01, 2002
  • SIAM Journal on Matrix Analysis and Applications
  • Winfried K Grassmann +1
  • Research Article
  • Citations1

The effect of restricted access to intermediate product inventory in two-stage production lines

  • Jan 01, 1983
  • International Journal of Production Research
  • Peter C Bell
  • Research Article
  • Citations31

Approximation Analysis of Open Acyclic Exponential Queueing Networks with Blocking

  • Dec 01, 1990
  • Operations Research
  • Hyo-Seong Lee +1
  • Research Article
  • Citations25

Heavy traffic results for single-server queues with dependent (EARMA) service and interarrival times

  • Jun 01, 1980
  • Advances in Applied Probability
  • Patricia A Jacobs
  • Research Article
  • Citations78

The Effect of Internal Storage on the Production Rate of a Series of Stages Having Exponential Service Times

  • Sep 01, 1970
  • A I I E Transactions
  • Jerome M Hatcher +1
  • Research Article
  • Citations62

The Effect of Internal Storage on the Production Rate of a Series of Stages Having Exponential Service Times

  • Jun 01, 1969
  • A I I E Transactions
  • Jerome M Hatcher
  • Book Chapter

Product form Solution for Queueing Networks with Poisson Arrivals and General Service Time Distributions with Finite Means

  • Jan 01, 1982
  • Christopher L. Samelson +1
  • Research Article
  • Citations765

The Age of Information: Real-Time Status Updating by Multiple Sources

  • Mar 01, 2019
  • IEEE Transactions on Information Theory
  • Roy D Yates +1
  • Research Article
  • Citations54

Bayesian inference in Markovian queues

  • Mar 01, 1994
  • Queueing Systems
  • Carmen Armero
  • Research Article

An adaptive model for traffic flow optimisation in dynamic environments

  • Jan 01, 2019
  • International Journal of Computational Science and Engineering
  • M.V Rahul +2
  • Conference Article
  • Citations2

An inventory system with multi-server service facility with negative demands

  • Jul 01, 2009
  • V S S Yadavalli +2
  • Research Article
  • Citations35

A multi-server perishable inventory system with negative customer

  • Aug 11, 2010
  • Computers & Industrial Engineering
  • V.S.S Yadavalli +3
  • PDF
  • Research Article
  • Citations3

Product‐Form Solutions for Integrated Services Packet Networks and Cloud Computing Systems

  • Jan 01, 2014
  • Mathematical Problems in Engineering
  • Wanyang Dai
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.