Discrete Markov Processes and Numerical Algorithms for Markov Chains -- Markov Decision Processes and Stochastic … decision problems and determining Nash equilibria for related stochastic games with average and total expected discounted …