In this paper we prove a deterministic approximation theorem for a sequence of Markov decision processeswith finitely many actions and general state spaces as they appear frequently in economics, game theory and operations research. Using viscosity solution methods no a-priori differentiabililty...

This note contains complementary information to the paper Staudigl and Steg (2014). We present a martingale characterization of continuation payoff processes in a class of repeated games with imperfect public monitoring. Our martingale approach allows us to work out a clear connection between...

We consider a co-evolutionary model of social coordination and network formation where agents may decide on an action in a 2x2 - coordination game and on whom to establish costly links to. We fi nd that a payo ff dominant convention is selected for a wider parameter range when agents may only...

We describe the large deviations properties, stationary distribution asymptotics, and stochastically stable states of stochastic evolutionary processes based on the logit choice rule, focusing on behavior in the small noise double limit. These aspects of the stochastic evolutionary process can...

We consider a model of stochastic evolution under general noisy best response protocols, allowing the probabilities of suboptimal choices to depend on their payoff consequences. Our analysis focuses on behavior in the small noise double limit: we first take the noise level in agents' decisions...

We consider a model of stochastic evolution under general noisy best response protocols, allowing the probabilities of suboptimal choices to depend on their payoff consequences. Our analysis focuses on behavior in the small noise double limit: we first take the noise level in agents' decisions...

This note contains complementary information to the paper Staudigl and Steg (2014). We present a martingale characterization of continuation payoff processes in a class of repeated games with imperfect public monitoring. Our martingale approach allows us to work out a clear connection between...

Motivated by recent path-breaking contributions in the theory of repeated games in continuous time, this paper presents a family of discrete-time games which provides a consistent discrete-time approximation of the continuous-time limit game. Using probabilistic arguments, we prove that...