We introduce an envelope condition method (ECM) for solving dynamic programming problems. ECM iterates on the Bellman equation forward and is much faster than conventional value function methods that iterate backward. In the studied examples, ECM is comparable in accuracy and cost to Carroll's...

In this contribution we propose a dynamic tracking error problem and we consider the problem of monitoring at discrete point the shortfall of the portfolio below a set of given reference levels of wealth. We formulate and solve the resulting dynamic optimization problem using stochastic...

In this contribution we propose an approach to solve a multistage stochastic programming problem which allows us to obtain a time and nodal decomposition of the original problem. This double decomposition is achieved applying a discrete time optimal control formulation to the original stochastic...

Dynamic programming is the essential tool in dynamic economic analysis. Problems such as portfolio allocation for individuals and optimal economic growth are typical examples. Numerical methods typically approximate the value function. Recent work has focused on making numerical methods more...

Dynamic optimization problems cover a large class of problems in theoretical and applied economics. A simple iterative algorithm with fast convergence is proposed. It is demonstrated that the algorithm in a few steps produce excellent analytic (closed form) approximations including error bounds...

We introduce a novel simulated certainty equivalent approximation (SCEQ) method for solving dynamic stochastic problems. Our examples show that SCEQ can quickly solve high-dimensional finite- or infinite-horizon, stationary or non- stationary dynamic stochastic problems with hundreds of state...

The computational time required to solve and estimate dynamic economic models is one of the main constraints in empirical research. The Endogenous Grid Method (EGM) proposed by Carroll (2006) is known to offer impressive speed gains over more traditional stochastic dynamic programming methods,...

These notes provide an intuitive introduction to dynamic programming. The first two Sections present the standard deterministic Ramsey model using the Lagrangian approach. These can be skipped by whom is already acquainted with this framework. Section 3 shows how to solve the well understood...

The key element in the tension between those who believe climate change is an issue and those who do not is essentially the question of whether we are merely in a long period of shock-induced above average temperatures or if we have led to this increase in temperatures by anthropogenic carbon...

I introduce and evaluate a new stochastic simulation method for dynamic economic models. It is based on recent work in the operations research and engineering literatures (Van Roy et. al, 1997; Powell, 2007; Bertsekas, 2011). The baseline method involves rewriting the household's dynamic program in...