We introduce a stochastic game in which transition probabilities depend on the history of the play, i.e., the players' past action choices. To solve this new type of game under the limiting average reward criterion, we determine the set of jointly-convergent pure-strategy rewards which can be...

This paper establishes existence of a stationary Markov perfect equilibrium in general stochastic games with noise — a component of the state that is nonatomically distributed and not directly affected by the previous period’s state and actions. Noise may be simply a payoff irrelevant public...