Mertens and Parthasarathy (1987) proved the existence of sub-game perfect equilibria in discounted stochastic games.  Their method involved new techniques in dynamic programming, which were presented in a very general framework, with no expense spared in highlighting versatility and scope. ...

Many dynamic economic situations, including certain markets, can be fruitfully modeled as binary-action stochastic sequential games.  Such games have a state variable, which in the case of a market might be the inventory of the good waiting for sale.  Conditional on the state, players choose...