This paper provides series expansions of the stationary distribution of a finite Markov chain. This leads to an efficient numerical algorithm for computing the stationary distribution of a finite Markov chain. Numerical examples are given to illustrate the performance of the algorithm.

In this paper, we consider deterministic (both fluid and discrete) polling systems with N queues with infinite buffers and we show how to compute the best polling sequence (minimizing the average total workload). With two queues, the best polling sequence is always periodic when the system is...

In this paper we study a challenging call center operation problem. The goal of our analysis is to identify an optimal policy for allocating tasks to agents. As a first step, we discuss promising randomized policies and use stochastic approximation for finding the optimal randomized policy when...

This paper deals with a system where batch arrivals wait in a station until a server (a train) is available, at which moment it services all customers in waiting. This is an example of a bulk server, which has many applications in public transportation, telecommunications, computer resource...

Quantiles play an important role in modelling quality of service in the service industry and in modelling risk in the financial industry. Recently, Hong showed in his breakthrough papers that efficient simulation based estimators can be obtained for quantile sensitivities by means of sample path...