This paper establishes existence of a stationary Markov perfect equilibrium in general stochastic games with noise — a component of the state that is nonatomically distributed and not directly affected by the previous period’s state and actions. Noise may be simply a payoff irrelevant public...

We show that dynamic bargaining games are characterized by a continuum of stationary Markov perfect equilibria, when the set of alternatives is multidimensional and players are patient. In fact, we show that there is a continuum of equilibria close to any alternative satisfying a simple linear...