In this paper, we use a Markov decision process (MDP) to model the joint inventory-promotion decision problem. The state variable of the MDP represents the demand state brought about by changing environmental factors as well as promotion decisions. The demand state in a period determines the...

Business environments change over time. They are cyclic, show seasonality or just evolve over time. This is certainly true for customer demand. As a result, stationary demand distributions are crude approximations of true customer behavior at best. Yet, most classical stochastic inventory models...