Cogley, Timothy; Sargent, Thomas J. - In: International Economic Review 49 (2008) 1, pp. 185-221
We study a Markov decision problem with unknown transition probabilities. We compute the exact Bayesian decision rule and compare it with two approximations. The first is an infinite-history, rational-expectations approximation that assumes that the decision maker knows the transition...