In this paper we prove a deterministic approximation theorem for a sequence of Markov decision processeswith finitely many actions and general state spaces as they appear frequently in economics, game theory and operations research. Using viscosity solution methods no a-priori differentiabililty...

In many countries, inducing large-scale technological changes has become an important policy objective, as in the context of climate policy or energy transitions. Such large-scale changes require the development of strongly interlinked technologies. But current economic models have little...

The paper develops an optimal control model to analyse various management options for infectious diseases that occur in metapopulations, under both Nash and cooperative behaviour. As pathogens are renewable resources with negative value, the problem may be non-convex. Since the disease can be...

In many countries, inducing large-scale technological changes has become an important policy objective, as in the context of climate policy or energy transitions. Such large-scale changes require the development of strongly interlinked technologies. But current economic models have little...

Forest management aims at building ecological networks that minimize the impacts on timber production. We formalize the construction of ecological networks in forest environments as the optimal control dynamic graph-theoretic problem. The ecological network is based on a set of bioreserves and...

Two oil price shocks changed the pattern of cheap oil. The first was the Arab embargo on oil exports in 1973. Oil prices rose five fold. In 1978, the second was the fall of Shah Iran. Prices soared to $80-$100 a barrel in today‘s prices. In 1960, OPEC was established and since then it has been...

Land subsidence threatens the living conditions of roughly 1.2 billion people worldwide in deltaic regions characterized by soft top soil. Economic activity in deltaic regions requires lowering the groundwater levels to keep the land sufficiently dry to maintain productivity, which, however,...

We introduce a continuous time overlapping generations demographic model, in which a social planner seeks to generate an optimal policy for influencing the demographic change of the underlying population in a neoclassical growth model. The model has the notable feature that the underlying state...

Policy makers constantly face optimal control problems: what controls allow to achieve certain targets in, e.g., GDP growth or inflation? Conventionally this is done by applying certain linear-quadratic optimization algorithms to dynamic econometric models. Several algorithms extend this...

Increasing renewable generation results in growing supply uncertainty. By now hydrostorages are the most efficient way of smoothing uncertain power supply. In liberalized and competitive markets the valuation of hydro storages investment projects needs to take the market information and...