This paper studies the identification problem in infinite horizon Markovian games and proposes a generally applicable estimation method. Every period firms simultaneously select an action from a finite set. We characterize the set of Markov equilibria. Period profits are a linear function of...