Ghellinck, Guy T. de; Eppen, Gary D. - In: Management Science 13 (1967) 5, pp. 371-394
This paper is concerned with the linear programming solutions to sequential decision (or control) problems in which the stochastic element is Markovian and in which the objective is to minimize the discounted sum of expected costs when a discount factor \lambda, 0 \leqq \lambda < 1, is used. In praticular, it deals with a class of "separable" problems for which it is possible to define a "reduced" linear programming problem which will yield the optimal policy and the shadow prices for this problem. The reduced problem involves a substantially smaller number (e.g., 3N vs. N<sup>2</sup>) of variables...</1,>