This chapter describes the recently developed policy evaluation techniques. It focuses on discrete time stochastic models and on relating the policy evaluation methods to the geometric approach commonly used in theoretical continuous time models. The exposition centers on a number of specific...