We show that dynamic bargaining games are characterized by a continuum of stationary Markov perfect equilibria, when the set of alternatives is multidimensional and players are patient. In fact, we show that there is a continuum of equilibria close to any alternative satisfying a simple linear...