In this note, we show that the least xed point of the Bellman op- erator in a certain set can be computed by value iteration whether or not the xed point is the value function. As an application, we show one of the main results of Kamihigashi (2014a) with a simpler proof.