Strategies for constructing a Markov decision chain approximating a continuous-time finite-horizon optimal control problem are investigated. Some simple, analytically soluble, examples are treated and low computational complexity is reported. Extensions to the method and implementation are...

Computing the solution to a stochastic optimal control problem is difficult. A method of approximating a solution to a given stochatic optimal problem was developed in [1]. This paper describes a suite of Matlab functions implementing this method of approximating a solution to a given continuous...

We consider a general control problem with two types of optimal regime switch. The first one concerns technological and/or institutional regimes indexed by a finite number of discrete parameter values, and the second features ecological-like regimes relying on given threshold values for given...