Generalized semi-Markov schemes were introduced by Matthes in 1962 under the designation 'Bedienungsschemata' (service schemes). They include a large variety of familiar stochastic models. It is shown in this paper that under appropriate regularity conditions the associated stochastic process...

Necessary and sufficient conditions are given for the convergence of the first moment of functionals of Markov chains.

This paper establishes a rather complete optimality theory for the average cost semi-Markov decision model with a denumerable state space, compact metric action sets and unbounded one-step costs for the case where the underlying Markov chains have a single ergotic set. Under a condition which,...