This paper provides series expansions of the stationary distribution of a finite Markov chain. This leads to an efficient numerical algorithm for computing the stationary distribution of a finite Markov chain. Numerical examples are given to illustrate the performance of the algorithm.

This paper provides series expansions of the stationary distribution of a finite Markov chain. This leads to an efficient numerical algorithm for computing the stationary distribution of a finite Markov chain. Numerical examples are given to illustrate the performance of the algorithm.

This paper provides series expansions of the stationary distribution of a finite Markov chain. This leads to an efficient numerical algorithm for computing the stationary distribution of a finite Markov chain. Numerical examples are given to illustrate the performance of the algorithm.

The Rouwenhorst method of approximating stationary AR(1) processes has been overlooked by much of the literature despite having many desirable properties unmatched by other methods. In particular, we prove that it can match the conditional and unconditional mean and variance, and the first-order...

Sequential randomized prediction of an arbitrary binary sequence is investigated. No assumption is made on the mechanism of generating the bit sequence. The goal of the predictor is to minimize its relative loss, i.e., to make (almost) as few mistakes as the best ``expert'' in a fixed, possibly...

We study the spatio-temporal evolution of populations made up from a few tens to thousands of monokinetic repulsive agents moving through a two-dimensional grid. We adopt the behavioral description of agents, in which each agent executes an action following a state automaton. In the first step,...

How can cooperation be achieved between self-interested individuals in commonly-occurring asymmetric interactions where agents have different positions? Should agents use the same strategies that are appropriate for symmetric social situations? We explore these questions through the asymmetric...