We consider constrained discounted-cost Markov control processes in Borel spaces, with unbounded costs. Conditions are given for the constrained problem to be solvable, and also equivalent to an equality-constrained (EC) linear program. In addition, it is shown that there is no duality gap...

In this paper, we consider constrained noncooperative N-person stochastic games with discounted cost criteria. The state space is assumed to be countable and the action sets are compact metric spaces. We present three main results. The first concerns the sensitivity or approximation of...

In this paper, we consider constrained noncooperative N-person stochastic games with discounted cost criteria. The state space is assumed to be countable and the action sets are compact metric spaces. We present three main results. The first concerns the sensitivity or approximation of...

We consider a class of time-varying stochastic control systems, with Borel state and action spaces, and possibly unbounded costs. The processes evolve according to a discrete-time equation x n + 1 =G n (x n , a n , ξ n), n=0, 1, … , where the ξ n are i.i.d. ℜ k-valued random vectors whose...

The paper deals with a class of semi-Markov control models with Borel state and control spaces, possibly unbounded costs, and unknown holding times distribution H. Assuming that H does not depend on state-action pairs, we combine suitable methods of statistical estimation of H with control...

We consider a class of time-varying stochastic control systems, with Borel state and action spaces, and possibly unbounded costs. The processes evolve according to a discrete-time equation x <Subscript>n + 1</Subscript>=G <Subscript>n</Subscript> (x <Subscript>n</Subscript> , a <Subscript>n</Subscript> , ξ<Subscript>n</Subscript>), n=0, 1, … , where the ξ<Subscript>n</Subscript> are i.i.d. ℜ<Superscript>k</Superscript>-valued random vectors whose...</superscript></subscript></subscript></subscript></subscript></subscript></subscript>

The paper deals with a class of semi-Markov control models with Borel state and control spaces, possibly unbounded costs, and unknown holding times distribution H. Assuming that H does not depend on state-action pairs, we combine suitable methods of statistical estimation of H with control...