This paper explores sufficient conditions for a continuous stationary Markov optimal policy and a concave value function in stochastic dynamic programming problems. Also, the paper addresses conditions needed for the differentiability of the value function. The paper uses conditions such as...