This article describes an accurate procedure for computing the mean first passage times of a finite irreducible Markov chain and a Markov renewal process. The method is a refinement to the Kohlas, Zeit fur Oper Res, 30, 197–207, (1986) procedure. The technique is numerically stable in that it doesn’t involve subtractions. Algebraic expressions for the special cases of one, two, three and four states are derived.Aconsequence of the procedure is that the stationary distribution of the embedded Markov chain does not need to be derived in advance but can be found accurately from the derived mean first passage times. MatLab is utilized to carry out the computations, using some test problems from the literature.
 Dayar, T. and Akar, N. Computing the moments of first passage times to a subset of states in Markov chains. SIAM J Matrix Anal Appl, 27, (2005), 396–412. 10.1137/S0895479804442462Search in Google Scholar
 Grassman,W.K., Taksar, M.I., and Heyman, D.P. Regenerative analysis and steady state distributions forMarkov chains. Oper Res, 33, (1985), 1107–1116. 10.1287/opre.33.5.1107Search in Google Scholar
 Harrod,W.J. and Plemmons, R.J. Comparison of some direct methods for computing stationary distributions ofMarkov chains. SIAM J Sci Stat Comput, 5, (1984), 463–479. 10.1137/0905033Search in Google Scholar
 Heyman, D.P. and O’Leary, D.P.What is fundamental forMarkov chains: First Passage Times, Fundamentalmatrices, and Group Generalized Inverses, Computations with Markov Chains, Chap 10, 151–161, Ed W.J. Stewart, Springer. New York, (1995). Search in Google Scholar
 Hunter, J.J. Mathematical Techniques of Applied Probability, Volume 2, Discrete Time Models: Techniques and Applications, Academic, New York. (1983). Search in Google Scholar
 Kemeny, J. G. and Snell, J. L. Finite Markov chains, Springer- Verlag, New York (1983), (Original version, Princeton University Press, Princeton (1960).) Search in Google Scholar
 Kohlas, J. Numerical computation of mean passage times and absorption probabilities in Markov and semi-Markov models. Zeit Oper Res, 30, (1986), 197–207. 10.1007/BF01919287Search in Google Scholar
©2016 Jeffrey J. Hunter
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.