This paper studies a Geo/Geo/1 GI queue in which the abandonments are endogenous. One crucial feature of this model is that the abandonment behavior is affected by the system performance and vice versa. Our model captures this interaction by developing two closely related models: an abandonment...

Based on a dynamic model of the stochastic repayment behavior exhibited by delinquent credit-card accounts as a self-exciting point process, a bank can control the arrival intensity of repayments using costly account-treatment actions. A semi-analytic solution to the corresponding stochastic...

We present a fully nonparametric method to estimate the value function, via simulation, in the context of expected infinite-horizon discounted rewards for Markov chains. Estimating such value functions plays an important role in approximate dynamic programming. We incorporate “soft...

Simulation is often used to evaluate and compare performances of stochastic systems, where the underlying stochastic models are estimated from real-world input data. Collecting more input data can derive closer-to-reality stochastic models while generating more simulation replications can reduce...

This paper develops the first method for the exact simulation of reflected Brownian motion (RBM) with non-stationary drift and infinitesimal variance. The running time of generating exact samples of non-stationary RBM at any time t is uniformly bounded. The method can be used as a guide for...

We introduce a family of generalized-method-of-moments estimators of the parameters of a continuous-time Markov process observed at random time intervals. The results include strong consistency, asymptotic normality, and a characterization of standard errors. Sampling is at an arrival intensity...