In this paper we look at some aspects of infinite horizon Markov decision processes in which information regarding parameter values is restricted to a finite time horizon, and in which decisions are based upon the finite horizon data but are recomputed as we move forward in time and gain...

No abstract available.

This paper studies a problem of determining the level of certain decisions, taken prior to certain events taking place, and the subsequent additional resource procurement decisions needed to implement the initial program once these events have materialised. The problem is formulated first of all...

In this paper we present an algorithm for solving infinite-horizon discounted Markov games based upon the fact that the value function is a least element of a superharmonic set. The algorithm produces a pair of policies whose value function is within a specified error of the solution to the...

This paper considers fluid analogues for the standard linear programming problem and for a separable nonlinear programming problem. In the former case the usual duality results are demonstrated using the principle of minimum potential energy. In addition by examining the dynamics of the system a...

This paper considers the problem of determining which jobs, of a specified set, should be done in a given week, and whether or not nonnormal working time arrangements should be used. Such arrangements are more expensive in the sense that plant has to be kept going under undesirable conditions,...

Value theory plays an essential role in the formal solution of decision problems, but the experimental determination of value functions is subject to errors of various kinds. Sensitivity analyses are methodologically invalid. An attempt is made to overcome the uncertainties in derivation of...