We develop a general methodology for a partially observed stochastic control problem. The dynamics is governed by a discrete-time Markov process. We describe an application to an inventory system with possibility of shrinkage, and introduce unnormalized conditional probabilities to transform the...

We develop a general methodology for a partially observed stochastic control problem. The dynamics is governed by a discrete-time Markov process. We describe an application to an inventory system with possibility of shrinkage, and introduce unnormalized conditional probabilities to transform the...

This paper introduces recent developments in the analysis of inventory systems with partial observations. The states of these systems are typically conditional distributions, which evolve in infinite dimensional spaces over time. Our analysis involves introducing unnormalized probabilities to...

We study an economy in which the rate of change of population depends on population policy decisions. This requires population as well as capital as state variables. By showing the algebraic relationship between the shadow price of the population and the shadow price of the per capita capital...

We present a sufficient condition for a feedback Stackelberg equilibrium of a stochastic differential game on an infinite horizon. This condition gives rise to a system of elliptic partial differential equations involving a static Stackelberg game at the level of Lagrangian. As an example, we...

Information delays exist in an inventory system when it takes time to collect, process, validate, and transmit inventory/demand data. A general framework is developed in this paper to describe information flows in an inventory system with information delays. We characterize the suffcient...

We consider optimal consumption and portfolio investment problems of an investor who is interested in maximizing his utilities from consumption and terminal wealth subject to a random inflation in the consumption basket price over time. We consider two cases: (i) when the investor observes the...

We develop a new dynamic continuous-time model of optimal consumption and investment to include independent stochastic labor income. We reduce the problem of solving the Bellman equation to a problem of solving an integral equation. We then explicitly characterize the optimal consumption and...

This paper studies the issue of coordinating equipment maintenance operations with capital investment strategy in the presence of random equipment failures. This problem represents an important extension of the celebrated Kamien and Schwartz (KS) paper published in Management Science. The...