Kamihigashi, Takashi; Yao, Masayuki - Research Institute for Economics and Business … - 2015
We consider infinite-horizon deterministic dynamic programming problems in discrete time. We show that the value function is always a fixed point of a modified version of the Bellman operator. We also show that value iteration monotonically converges to the value function if the initial function...