- Book Chapter
1
- 10.1016/s0169-7161(88)07008-7
6 Dependence notions in reliability theory
- Jan 01, 1988
- Handbook of Statistics
- Narasinga R Chaganty + 1 more +1
6 Dependence notions in reliability theory
At first there was the Markov property. The theory of stochastic processes, which can be considered as an exten- sion of probability theory, allows the modeling of the evolution of systems through the time. It cannot be properly understood just as pure mathemat- ics, separated from the body of experience and examples that have brought it to life. The theory of stochastic processes entered a period of intensive develop- ment, which is not finished yet, when the idea of the Markov property was brought in. Not even a serious study of the renewal processes is possible without using the strong tool of Markov processes. The modern theory of Markov processes has its origins in the studies by A. A: Markov (1856-1922) of sequences of experiments connected in a chain and in the attempts to describe mathematically the physical phenomenon known as Brownian mo- tion. Later, many generalizations (in fact all kinds of weakenings of the Markov property) of Markov type stochastic processes were proposed. Some of them have led to new classes of stochastic processes and useful applications. Let us mention some of them: systems with complete connections [90, 91, 45, 86]; K-dependent Markov processes [44]; semi-Markov processes, and so forth. The semi-Markov processes generalize the renewal processes as well as the Markov jump processes and have numerous applications, especially in relia- bility.
6 Dependence notions in reliability theory
6 Dependence notions in reliability theory
Introduction to Stochastic Processes, Markov Chains, and Monte Carlo Simulation
A major part of this book discusses the use of stochastic models for atmospheric convection, namely through the use of a stochastic model for CIN and a stochastic multicloud model which pertains to tracking the statistics of clouds of various types. These models rely on the theory of stochastic processes and Markov chains in particular. Here, we provide a brief introduction to this topic to help the reader better appreciate and comprehend the cloud models. The expert reader can skip this chapter. It is intended to readers with no or rather very little background in probability theory and stochastic processes. Nonetheless, we assume that the reader is familiar with the basic notions of probability distributions and random variables.
Read moreModeling of birth-death and diffusion processes in biological complex environments
This thesis is centered on the theory of stochastic processes and their applications in biological systems characterized by a complex environment. Three case studies have been modeled by the use of the three fundamental tools of stochastic processes: the master equation (ME), the stochastic differential equation (SDE) and the partial differential equation (PDE). The principal approach here applied to deal with complexity is the characterization of the system by means of probability distributions describing each a parameter of the model or the introduction of fractional order derivatives to include non-local and memory effects maintaining the linearity in the equations. In Chapter 1 we briefly review the theory of stochastic processes. In Chapter 2 we derive a birth-death process master equation to test if Long Interspersed Elements (LINEs) can be modeled according to the neutral theory of biodiversity. In Chapter 3 we derive a model of anomalous diffusion based on a Langevin approach in which anomalous behavior arise in the asymptotic intermediate state as a consequence of the heterogeneity of the system, from the superposition of Ornstein-Uhlenback processes. In Chapter 4 we propose an extension of the cable equation, used to describe anomalous diffusion phenomena as the signal conduction in spiny dendrites, by introducing a Caputo time fractional derivative.
Read moreNonparametric estimation based on censored observations of a Markov renewal process
Uniform consistency and weak convergence is proved of estimators of the transition probabilities of an arbitrary finite state space Markov renewal process, based on n independent and identically distributed “right censored” realizations of the process. The approach uses the theory of stochastic integrals and counting processes. It is shown how the results may be extended to the non-identically distributed case and to general censorship under suitable conditions.
Read moreSecond-Order Markov and Reciprocal Stationary Gaussian Processes
Previous article Next article Second-Order Markov and Reciprocal Stationary Gaussian ProcessesR. N. MiroshinR. N. Miroshinhttps://doi.org/10.1137/1124099PDFBibTexSections ToolsAdd to favoritesExport CitationTrack CitationsEmail SectionsAbout[1] S. N. Bernshtei˘n, On the dependencies among random variablesCollected Works, Vol. IV, Nauka, Moscow, 1964, 235–254, (In Russian.) Google Scholar[2] J. L. Doob, Stochastic processes, John Wiley & Sons Inc., New York, 1953viii+654 MR0058896 0053.26802 Google Scholar[3] Benton Jamison, Reciprocal processes: The stationary Gaussian case, Ann. Math. Statist., 41 (1970), 1624–1630 MR0267637 0248.60030 CrossrefGoogle Scholar[4] I. I. Gikhman and , A. V. Skorokhod, The Theory of Stochastic Processes, Vol. I, Springer-Verlag, New York, 1974 CrossrefGoogle Scholar[5] E. Kamke, Differentialgleichungen. Lösungsmethoden and Lösungen, Vol. 1, Chelsea, New York, 1974 Google Scholar[6] E. Wong, Some results concerning the zero-crossings of Gaussian noise, SIAM J. Appl. Math., 14 (1966), 1246–1254 10.1137/0114099 MR0207059 0147.15905 LinkGoogle Scholar[7] E. Wong, The distribution of intervals between zeros for a stationary Gaussian process, SIAM J. Appl. Math., 18 (1970), 67–73 10.1137/0118008 MR0256456 0221.60024 LinkGoogle Scholar[8] R. N. Miroshin, Convergence of Rice and Longuet-Higgins series for a Wong process, Theory Prob. Applications, 21 (1976), 863–866 10.1137/1121103 0374.60049 LinkGoogle Scholar[9] R. N. Miroshin, Asymptotics of the second factorial moment of the number of upward crossings of the line $kt+a$ by a Gaussian stationary process, Vestnik Leningrad. Univ., 23 (1968), 109–120 MR0235612 0165.52602 Google Scholar[10] M. Krein, Sur le problème du prolongement des fonctions hermitiennes positives et continues, C. R. (Doklady) Acad. Sci. URSS (N.S.), 26 (1940), 17–22 MR0004333 0022.35302 Google Scholar Previous article Next article FiguresRelatedReferencesCited byDetails Characterization of Multivariate Stationary Gaussian Reciprocal DiffusionsJournal of Multivariate Analysis, Vol. 62, No. 1 Cross Ref Gaussian reciprocal diffusions and positive definite sturm-liouville operators4 April 2007 | Stochastics and Stochastic Reports, Vol. 55, No. 3-4 Cross Ref Gaussian reciprocal processes revisitedStatistics & Probability Letters, Vol. 12, No. 4 Cross Ref Reciprocal covariance solutions of some matrix differential equationsStochastic Processes and their Applications, Vol. 37, No. 1 Cross Ref Characterization and Classification of Gaussian Second Order Reciprocal Processes Cross Ref Gaussian reciprocal processes and self-adjoint stochastic differential equations of second order2 May 2007 | Stochastics and Stochastic Reports, Vol. 34, No. 1-2 Cross Ref Reciprocal diffusions and stochastic differential equations of second order ∗Stochastics, Vol. 24, No. 4 Cross Ref Multivariate reciprocal stationary Gaussian processesJournal of Multivariate Analysis, Vol. 23, No. 1 Cross Ref On Miroshin’s Second-Order Reciprocal ProcessesJulia Abrahams3 August 2006 | SIAM Journal on Applied Mathematics, Vol. 44, No. 1AbstractPDF (316 KB)The Use of Rice SeriesR. N. Miroshin28 July 2006 | Theory of Probability & Its Applications, Vol. 28, No. 4AbstractPDF (1011 KB)The zero-crossing problem for some nonstationary Gaussian processes (Corresp.)IEEE Transactions on Information Theory, Vol. 28, No. 4 Cross Ref Convergence of Longuet-Higgins Series for Stationary Gaussian Markov Processes of First OrderR. N. Miroshin17 July 2006 | Theory of Probability & Its Applications, Vol. 26, No. 1AbstractPDF (1546 KB) Volume 24, Issue 4| 1980Theory of Probability & Its Applications History Submitted:11 July 1977Published online:17 July 2006 InformationCopyright © Society for Industrial and Applied MathematicsPDF Download Article & Publication DataArticle DOI:10.1137/1124099Article page range:pp. 845-852ISSN (print):0040-585XISSN (online):1095-7219Publisher:Society for Industrial and Applied Mathematics
Read moreIntroduction and Summary
For complex equipment and systems, reliability analysis is generally performed at two differents levels. At subassembly level, the designer performs failure rate and failure mode analyses to check fulfilment of reliability requirements, and to detect and eliminate reliability weaknesses as early as possible in the design phase. At equipment and system level, the reliability engineer also investigates time behaviour, taking into account reliability, maintainability, and logistical aspects. Depending upon the system complexity, upon the assumed distribution functions for failure-free and repair times, and with thought toward maintenance policy, investigations are performed either analytically, making use of stochastic processes, or numerically with the help of Monte Carlo simulations. Stochastic processes used in the modeling of reliability problems include renewal and alternating renewal processes, Markov processes with a finite state space, semi-Markov processes, regenerative stochastic processes with only one (or a few) regeneration state(s), and some kinds of non-regenerative stochastic processes. The reliability models covered by each of these processes are given in Table 1.KeywordsRegeneration StateRepair TimeReliability FunctionRepair RateMaintenance PolicyThese keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Read moreQuantum processes on phase space
Quantum processes on phase space
The semi-Markov beta-Stacy process: a Bayesian non-parametric prior for semi-Markov processes.
The literature on Bayesian methods for the analysis of discrete-time semi-Markov processes is sparse. In this paper, we introduce the semi-Markov beta-Stacy process, a stochastic process useful for the Bayesian non-parametric analysis of semi-Markov processes. The semi-Markov beta-Stacy process is conjugate with respect to data generated by a semi-Markov process, a property which makes it easy to obtain probabilistic forecasts. Its predictive distributions are characterized by a reinforced random walk on a system of urns.
Read moreMaximum Rényi Entropy Rate
The supremum of the Renyi entropy rate over the class of discrete-time stationary stochastic processes, whose marginals are supported by some given set and satisfy some given cost constraint, is computed. Unlike the Shannon entropy, the Renyi entropy of a random vector can exceed the sum of the Renyi entropies of its components, and the supremum is, therefore, typically not achieved by memoryless processes. It is nonetheless related to Shannon’s entropy: when the Renyi parameter exceeds one, the supremum is equal to the corresponding supremum of Shannon’s entropy, and when it is smaller than one, the supremum equals the logarithm of the volume of the support set. A Burg-like supremum of the Renyi entropy rate over the class of stochastic processes, whose autocovariance function begins with some given values, is also solved. It is not achieved by Gauss–Markov processes, but it is nonetheless related to Burg’s supremum: the two are equal when the Renyi parameter exceeds one, and the former is infinite otherwise.
Read moreAn example to teach Markov chains and Hardy–Weinberg equilibrium through Mendel’s laws
Graduates in biology or genetics learn Mendel’s laws and Hardy–Weinberg equilibrium as students, and they know, use, and sometimes teach these concepts. However, it is unusual to learn about stochastic processes during the graduate studies of these topics, although the applications of Markov chains in the fields of genetics or biology are increasing. In this paper, and from Mendel’s Laws, we are going to obtain an example of the Hardy–Weinberg Equilibrium that can be used to teach it. In the demonstration, stochastic processes theory and Markov chains will be used, in order to develop the transition matrix. In this way, we obtain an example that can be used to illustrate an explanation that involves, through Mendel’s laws, Hardy–Weinberg equilibrium for degree students, and stochastic processes for advanced students in biology or genetic sciences (predoctoral students at university). In this example, we are going to use the Scientific Workplace version 6.0 software.
Read moreStopping Times and Directed Processes
The notion of 'stopping times' is a useful one in probability theory; it can be applied to both classical problems and fresh ones. This book presents this technique in the context of the directed set, stochastic processes indexed by directed sets, and many applications in probability, analysis and ergodic theory. Martingales and related processes are considered from several points of view. The book opens with a discussion of pointwise and stochastic convergence of processes, with concise proofs arising from the method of stochastic convergence. Later, the rewording of Vitali covering conditions in terms of stopping times clarifies connections with the theory of stochastic processes. Solutions are presented here for nearly all the open problems in the Krickeberg convergence theory for martingales and submartingales indexed by directed set. Another theme of the book is the unification of martingale and ergodic theorems.
Read moreKinetic theory of age-structured stochastic birth-death processes.
Classical age-structured mass-action models such as the McKendrick-von Foerster equation have been extensively studied but are unable to describe stochastic fluctuations or population-size-dependent birth and death rates. Stochastic theories that treat semi-Markov age-dependent processes using, e.g., the Bellman-Harris equation do not resolve a population's age structure and are unable to quantify population-size dependencies. Conversely, current theories that include size-dependent population dynamics (e.g., mathematical models that include carrying capacity such as the logistic equation) cannot be easily extended to take into account age-dependent birth and death rates. In this paper, we present a systematic derivation of a new, fully stochastic kinetic theory for interacting age-structured populations. By defining multiparticle probability density functions, we derive a hierarchy of kinetic equations for the stochastic evolution of an aging population undergoing birth and death. We show that the fully stochastic age-dependent birth-death process precludes factorization of the corresponding probability densities, which then must be solved by using a Bogoliubov--Born--Green--Kirkwood--Yvon-like hierarchy. Explicit solutions are derived in three limits: no birth, no death, and steady state. These are then compared with their corresponding mean-field results. Our results generalize both deterministic models and existing master equation approaches by providing an intuitive and efficient way to simultaneously model age- and population-dependent stochastic dynamics applicable to the study of demography, stem cell dynamics, and disease evolution.
Read moreStationary Stochastic Processes
This chapter is devoted to further topics in the theory of stochastic processes and their applications. We start with a weaker definition of a stochastic process that is sufficient in the study of stationary processes. We said before that a stochastic process is a function u of both a variable ω in a probability space and a continuous parameter t, making u a random variable for each t and a function of t for each ω. We made statements about the kind of function of t that was obtained for each ω. The definition here is less specific about what happens for each ω.KeywordsStochastic ProcessCharacteristic FunctionCovariance FunctionRandom MeasureWide SenseThese keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Read moreEntanglement's dynamics from classical stochastic process
Entanglement is still one of the main mysteries of QM. In this note we show that entanglement and its dynamics can be described by classical (so to say “prequantum”) stochastic processes. This construction supports the original Einstein's attempt to reduce entanglement to correlations induced by the preparation procedure.
Read moreOn a fundamental identity in the theory of semi-Markov processes
A fundamental identity, due to Miller (1961a), (1962a, b) and Kemperman (1961), is generalized to semi-Markov processes. Thus the identity applies to processes defined on a Markov chain with discrete state space and random walks with Markov dependent steps (Section 2). Wald's identity is discussed briefly in Section 3. Section 4 is a study of the maxima of partial sums, and Section 5 of maxima in a semi-Markov process.
Read more