In this paper we prove a deterministic approximation theorem for a sequence of Markov decision processeswith finitely many actions and general state spaces as they appear frequently in economics, game theory and operations research. Using viscosity solution methods no a-priori differentiabililty...

This note contains complementary information to the paper Staudigl and Steg (2014). We present a martingale characterization of continuation payoff processes in a class of repeated games with imperfect public monitoring. Our martingale approach allows us to work out a clear connection between...

This paper studies the co-evolution of networks and play in the context of finite population potential games. Action revision, link creation and link destruction are combined in a continuous-time Markov process. I derive the unique invariant distribution of this process in closed form, as well...

Modeling the evolution of networks is central to our understanding of large communication systems, and more general, modern economic and social systems. The research on social and economic networks is truly interdisciplinary and the number of proposed models is huge. In this survey we discuss a...