Computing approximate stationary distributions for discrete Markov processes with banded infinitesimal generators
Abstract
We develop an algorithm for computing approximations to the stationary distribution of a discrete birth-and-death process, provided that the infinitesimal generator is a banded matrix. We begin by computing stationary distributions for processes whose infinitesimal generators are Hessenberg. Our derivation in this special case is different from the classical case but it leads to the same result. We then show how to extend these ideas to processes where the infinitesimal generator is banded (or half-banded) and to quasi-birth-death processes. Finally, we give an example of the application of this method to a nearly completely decomposable Markov chain to demonstrate the general applicability of the technique.
Rights
This publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.Collections
Related items
Showing items related by title, author, creator and subject.
-
Computer simulation of random and non-random second-phase distributions in two-phase materials
Pas, Michael E. (Monterey, California: Naval Postgraduate School, 1990-12);The mechanical properties of any material with a discontinuous second phase dispersed in a matrix are recognized to be influenced by the distribution of the second-phase particles. Current models for the prediction of ... -
Computer simulation of random and non-random second-phase distributions in two-phase materials
Pas, Michael E. (Monterey, California: Naval Postgraduate School, 1990-12);The mechanical properties of any material with a discontinuous second phase dispersed in a matrix are recognized to be influenced by the distribution of the second-phase particles. Current models for the prediction of ... -
Finite birth-and-death models in randomly changing environments
Gaver, Donald Paul; Jacobs, Patricia A.; Latouche, G. (Guy) (Monterey, California. Naval Postgraduate School, 1982-02); NPS55-82-007This report provides computational methods for studying properties of birth-death processes whose transition rates (infinitesimal generator) varies in accordance with a random, 'environmental', process. In particular, the ...