This book presents recent findings and results concerning the solutions of especially finite state-space Markov decision problems and determining Nash equilibria for related stochastic games with average and total expected discounted reward payoffs. In addition, it focuses on a new class of...

We show that the equivalence between certain problems of singular stochastic control (SSC) and related questions of optimal stopping known for convex performance criteria (see, for example, Karatzas and Shreve (1984)) continues to hold in a non convex problem provided a related discretionary...

This paper examines a Markovian model for the optimal irreversible investment problem of a firm aiming at minimizing total expected costs of production. We model market uncertainty and the cost of investment per unit of production capacity as two independent one-dimensional regular diffusions,...