Sonin, Isaac M. - In: Statistics & Probability Letters 78 (2008) 12, pp. 1526-1533
We discuss the generalization of the classical Gittins Index for a Markov chain and propose a transparent recursive algorithm for its calculation. The foundation for this algorithm is a modified version of the Elimination algorithm proposed earlier by the author to solve the problem of optimal...