This tutorial reviews the design and analysis of simulation experiments. These experiments may have various goals: validation, prediction, sensitivity analysis, optimization (possibly robust), and risk or uncertainty analysis. These goals may be realized through metamodels. Two types of...

We derive new statistical tests for leave-one-out cross-validation of Kriging models. Graphically, we present these tests as scatterplots augmented with confidence intervals. We may wish to avoid extrapolation, which we define as prediction of the output for a point that is a vertex of the...

We study the correct estimation of the true variance of the predictor in stochastic Kriging (SK). First, we obtain macroreplications for a SK metamodel that approximates a single-server simulation model; these macroreplications give independently and identically distributed predictions. This...

This contribution presents an overview of sensitivity analysis of simulation models, including the estimation of gradients. It covers classic designs and their corresponding (meta)models; namely, resolution-III designs including fractional-factorial two-level designs for first-order polynomial...

Factor screening searches for the really important inputs (factors) among the many inputs that are changed in a realistic simulation experiment. Sequential bifurcation (SB) is a sequential method that changes groups of inputs simultaneously. SB is the most efficient and effective method if the...

Classic linear regression models and their concomitant statistical designs assume a univariate response and white noise. By definition, white noise is normally, independently, and identically distributed with zero mean. This survey tries to answer the following questions: (i) How realistic are...