This note corrects an error in van Nunen and Puterman (van Nunen, J. A. E. E., M. L. Puterman. 1983. Computing optimal control limits for GI/M/s queueing systems with controlled arrivals. Management Sci. 29 725--734.) and extends some of their results to the average reward case.

In this paper we study a class of modified policy iteration algorithms for solving Markov decision problems. These correspond to performing policy evaluation by successive approximations. We discuss the relationship of these algorithms to Newton-Kantorovich iteration and demonstrate their...

We consider a GI/M/s queuing system that is controlled by either accepting or rejecting arriving customers. Under weak conditions on the cost structure, Stidham (Stidham, S., Jr., 1978. Socially and individually optimal control of arrivals to a GI/M/1 queue. Management Sci. 24 1598--1610.)...