Mertens and Parthasarathy (1987) proved the existence of sub-game perfect equilibria in discounted stochastic games.  Their method involved new techniques in dynamic programming, which were presented in a very general framework, with no expense spared in highlighting versatility and scope. ...

A long-standing open question raised in the seminal paper of Kalai and Lehrer (1993) is whether or not the play of a repeated game, in the rational learning model introduced there, must eventually resemble play of exact equilibria, and not just play of approximate equilibria as demonstrated...

Two-player zero-sum stochastic games with finite state and action spaces are known to have undiscounted values. We study such games under the assumption that one or both players observe the actions of their opponent after some time-dependent delay. We develop criteria for the rate of growth of...

We study nonzero-sum continuous-time stochastic games, also known as continuous-time Markov games, of fixed duration. We concentrate on Markovian strategies. We show by way of example that equilibria need not exist in Markovian strategies, but they always exist in Markovian public-signal...

Levy (2013) presents examples of discounted stochastic games that do not have stationary equilibria. The second named author has pointed out that one of these examples is incorrect. In addition to describing the details of this error, this note presents a new example by the first named author...

We present an example of a discounted stochastic game with a continuum of states, finitely many players and actions, and deterministic transitions, that possesses no measurable stationary equilibria, or even stationary approximate equilibria. The example is robust to perturbations of the...

Negative results on the the existence of Bayesian equilibria when state spaces have the cardinality of the continuum have been attained in recent years. This has led to the natural question: are there conditions that characterise when Bayesian games over continuum state spaces have measurable...

We present a discounted stochastic game with a continuum of states, finitely many players and actions, such that although all transitions are absolutely continuous w.r.t. a fixed measure, it possesses no stationary equilibria. This absolute continuity condition has been assumed in many...