In this paper, we prove a maximum principle for general stochastic differential Stackelberg games, and apply the theory to continuous time newsvendor problems. In the newsvendor problem, a manufacturer sells goods to a retailer, and the objective of both parties is to maximize expected profits...

We consider a sequential decision problem where the decision maker is informed of the actual payoff with delay. We introduce a new condition, which generalizes the condition given by Blackwell and ensures that the decision maker can approach a fixed closed and convex set under delay. We show how...

In this paper we consider the problem of admission control of Bernoulli arrivals to a buffer with geometric server, in which the controller’s actions take effect one period after the actual change in the queue length. An optimal policy in terms of marginal productivity indices (MPI) is derived...