We consider a sequential decision problem where the decision maker is informed of the actual payoff with delay. We introduce a new condition, which generalizes the condition given by Blackwell and ensures that the decision maker can approach a fixed closed and convex set under delay. We show how...

In this paper, we prove a maximum principle for general stochastic differential Stackelberg games, and apply the theory to continuous time newsvendor problems. In the newsvendor problem, a manufacturer sells goods to a retailer, and the objective of both parties is to maximize expected profits...

We analyze the behavior of closed product-form queueing networks when the number of customers grows to infinity and remains proportionate on each route (or class). First, we focus on the stationary behavior and prove the conjecture that the stationary distribution at non-bottleneck queues...

In this paper a three-dimensional environmental defensive expenditures model with delay is considered. The model is based on the interactions among visitors V, quality of ecosystem goods E, and capital K, intended as accommodation and entertainment facilities, in Protected Areas (PAs). The...

Economic and demographic models governed by linear delay differential equations are expressed as optimal control problems in infinite dimensions. A general objective function is considered and the concavity of the Hamiltonian is not required. The value function is a viscosity solution of the...

The paper investigates the impact of delayed tax revenues on the fiscal policy out-comes. Choosing the delay as a bifurcation parameter we study the direction and the stability of the bifurcating periodic solutions. We show when the system is stable with respect to the delay. Some numerical...

Biological networks are often modeled by systems of ordinary differential equations. In chemical reaction kinetics, for instance, sigmoid functions represent the regulation of gene expression via transcription factors. Solutions of these models tend to converge to a unique steady state, and...

A family of economic and demographic models governed by linear delay differential equations is considered. They can be expressed as optimal control problems subject to delay differential equations (DDEs) characterized by some non-trivial mathematical difficulties: state/control constraints and...