In this paper we consider the weighted reward Markov decision process, with perturbation. The “weighted reward” refers to appropriately normalized convex combination of the discounted and the long-run average reward criteria. This criterion allows the controller to trade-off short-term costs...

In this paper, Weighted reward Perturbed Markov Decision Processes with finite state and countable action spaces (semi-infinite WMDP for short) are considered. The ”weighted reward” refers to appropriately normalized convex combination of the discounted and the long-run average reward...

In this paper, Weighted reward Perturbed Markov Decision Processes with finite state and countable action spaces (semi-infinite WMDP for short) are considered. The ”weighted reward” refers to appropriately normalized convex combination of the discounted and the long-run average reward...

In this paper weighted singularly perturbed hybrid stochastic systems are discussed. Under some reasonable assumptions, it is shown that there exists a uniformly δ-optimal policy when the perturbation is sufficiently small. Copyright Springer-Verlag Berlin Heidelberg 2005

In this paper weighted singularly perturbed hybrid stochastic systems are discussed. Under some reasonable assumptions, it is shown that there exists a uniformly δ-optimal policy when the perturbation is sufficiently small. Copyright Springer-Verlag Berlin Heidelberg 2005

The evolution of renewable resources is characterized in many cases by different time scales where some state variables such as biomass, may evolve relatively faster than other state variables such as carrying capacity. Ignoring this time scale separation means that a slowly changing variable is...

The evolution of renewable resources is characterized in many cases by different time scales where some state variables such as biomass, may evolve relatively faster than other state variables such as carrying capacity. Ignoring this time scale separation means that a slowly changing variable is...

Renewable resource modelling is usually characterized by different time scales where some state variables such as biomass may evolve relatively faster than other state variables such as carrying capacity. Ignoring this time scale separation means that a slowly changing variable is treated as...

In this paper, we develop numerical methods based on a non-polynomial spline function with uniform grid for solving certain class of singularly perturbed boundary value problems. The proposed methods are second-order and fourth-order accurate. Numerical examples are provided to demonstrate the...

We consider a singularly perturbed boundary value problem with two small parameters. The problem is numerically treated by a quadratic spline collocation method. The suitable choice of collocation points provides the discrete minimum principle. Error bounds for the numerical approximations are...