Have we really been analyzing terminating simulations incorrectly all these years?
Sanchez, Paul J.
White, K. Preston Jr.
MetadataShow full item record
We all know how to estimate a confidence interval for the mean based on a random sample. The interval is centered on the sample mean, with the half-width proportional to the sample standard error. We know also that terminating simulations generate independent observations. What simulators appear to have overlooked is that independence alone is insufficient to guarantee a valid random sample—the observations must also be identically distributed. This is a good assumption if the outcome of each replication is a single observation, but it is demonstrably incorrect if the outcome is an aggregate value and the replications have differing numbers of observations. In this paper we explore the implications of this oversight when within-replication observations are independent. We then derive analytic results showing that although the impact on interval estimates can sometimes be negligible, there also are circumstances where the variance of our estimates is significantly increased. We finish with a simple example which demonstrates the potential impact for practitioners.
Proceedings of the 2013 Winter Simulation Conference R. Pasupathy, S.-H. Kim, A. Tolk, R. Hill, and M. E. Kuhl, eds.
Showing items related by title, author, creator and subject.
Elsberry, Russell L.; Coltrane, Glenn G.; Krueger, Paul L. (1975-06);A 10 year (1960--69) sample of observations in western North Pacific tropical cyclones over open ocean was used to derive statistical regression equations to forecast the maximum wind speed for 24, 48 and 72 h periods. ...
Singham, Dashi I.; Schruben, Lee W. (INFORMS, 2012);Absolute precision stopping rules are often used to determine the length of sequential experiments to estimate confidence intervals for simulated performance measures. Much is known about the asymptotic behavior of such ...
Borges, Carlos F. (1994);We consider a problem that arises in the evaluation of computer graphics illumination models. In particular, there is a need to find a finite set of wavelengths at which the illumination model should be evaluated. The ...