In this paper we consider the weighted reward Markov decision process, with perturbation. The “weighted reward” refers to appropriately normalized convex combination of the discounted and the long-run average reward criteria. This criterion allows the controller to trade-off short-term costs...

In this paper, Weighted reward Perturbed Markov Decision Processes with finite state and countable action spaces (semi-infinite WMDP for short) are considered. The ”weighted reward” refers to appropriately normalized convex combination of the discounted and the long-run average reward...

In this paper, Weighted reward Perturbed Markov Decision Processes with finite state and countable action spaces (semi-infinite WMDP for short) are considered. The ”weighted reward” refers to appropriately normalized convex combination of the discounted and the long-run average reward...

In this paper weighted singularly perturbed hybrid stochastic systems are discussed. Under some reasonable assumptions, it is shown that there exists a uniformly δ-optimal policy when the perturbation is sufficiently small. Copyright Springer-Verlag Berlin Heidelberg 2005

In this paper weighted singularly perturbed hybrid stochastic systems are discussed. Under some reasonable assumptions, it is shown that there exists a uniformly δ-optimal policy when the perturbation is sufficiently small. Copyright Springer-Verlag Berlin Heidelberg 2005

The evolution of renewable resources is characterized in many cases by different time scales where some state variables such as biomass, may evolve relatively faster than other state variables such as carrying capacity. Ignoring this time scale separation means that a slowly changing variable is...

The high pace at which many of the world's energy markets have gradually been opened tocompetition have generated a significant amount of new financial activity. Both academicians and practitioners alike recently started to develop the tools of energy derivatives pricing/hedging as a...

The behavior of the optimal exercise price of American puts near expiry has been well studied under the Black-Scholes model as a result of a series of publications. However, the behavior of the optimal exercise price under a stochastic volatility model, such as the Heston model, has not been...

The evolution of renewable resources is characterized in many cases by different time scales where some state variables such as biomass, may evolve relatively faster than other state variables such as carrying capacity. Ignoring this time scale separation means that a slowly changing variable is...

The behavior of the optimal exercise price of American puts near expiry has been well studied under the Black-Scholes model as a result of a series of publications. However, the behavior of the optimal exercise price under a stochastic volatility model, such as the Heston model, has not been...