In this paper we consider the optimal control problem of models with Markov regime shifts and forward-looking agents. These models are very general and flexible tools for modelling model uncertainty. An algorithm is devised to compute the solution of a linear rational expectations model with...