We consider semi-Markov control models (SMCMs) with a Borel state space satisfying certain stochastic stability assumptions on the transition structure which imply the so-called V-uniform geometric ergodicity of the state process. We deal with a class of ε-perturbations of transition...

We consider zero-sum stochastic games with Borel state spaces satisfying a generalized geometric ergodicity condition. We prove under fairly general assumptions that the optimality equation has a solution which is unique up to an additive constant. Copyright Springer-Verlag Berlin Heidelberg 2001

Nonzero-sum ergodic semi-Markov games with Borel state spaces are studied. An equilibrium theorem is proved in the class of correlated stationary strategies using public randomization. Under some additivity assumption concerning the transition probabilities stationary Nash equilibria are also...

We study the minimization of a spectral risk measure of the total discounted cost generated by a Markov Decision Process (MDP) over a finite or infinite planning horizon. The MDP is assumed to have Borel state and action spaces and the cost function may be unbounded above. The optimization...

We consider a dynamic mean-risk problem, where the risk constraint is given by the Average Value–at–Risk. As financial market we choose a discrete-time binomial model which allows for explicit solutions. Problems where the risk constraint on the final wealth is replaced by intermediate risk...

We consider the classical Cramér-Lundberg model with dynamic proportional reinsurance and solve the problem of finding the optimal reinsurance strategy which minimizes the expected quadratic distance of the risk reserve to a given benchmark. This result is extended to a mean-variance problem....

In this paper we investigate dependence properties and comparison results for multidimensional Lévy processes. In particular we address the questions, whether or not dependence properties and orderings of the copulas of the distributions of a Lévy process can be characterized by corresponding...

We investigate the problem of minimizing the Average-Value-at-Risk (AVaR <Subscript> τ </Subscript>) of the discounted cost over a finite and an infinite horizon which is generated by a Markov Decision Process (MDP). We show that this problem can be reduced to an ordinary MDP with extended state space and give...</subscript>

We consider a two-station network with two types of jobs: type 0 jobs require service at station 1 only and type 1 jobs require service both at station 1 and 2 in sequence. Each station has a single server. The problem is to schedule the server at station 1 between the two types of jobs in order...

We consider a stochastic fluid production model, where m machines which are subject to breakdown and repair, produce a fluid at ratep 0 per machine if it is working. This fluid is fed into an infinite buffer with stochastic output rate. Under the assumption that the machine processes are...