Generalising the idea of the classical EM algorithm that is widely used for computing maximum likelihood estimates, we propose an EM-Control (EM-C) algorithm for solving multi-period finite time horizon stochastic control problems. The new algorithm sequentially updates the control policies in...

We consider the optimal strategy of R&D expenditure adopted by a firm that engages in R&D to develop an innovative product to be launched in the market. The firm faces with technological uncertainty associated with the success of the R&D effort and market uncertainty of the stochastic revenue...