A user's guide to the brave new world of designing simulation experiments
Kleijnen, Jack P.C.
Cioppa, Thomas M.
Sanchez, Susan M.
Lucas, Thomas W.
MetadataShow full item record
Many simulation practitioners can get more from their analyses by using the statistical theory on design of experiments (DOE) developed specifically for exploring computer models. In this paper, we discuss a toolkit of designs for simulationists with limited DOE expertise who want to select a design and an appropriate analysis for their computational experiments. Furthermore, we provide a research agenda listing problems in the design of simulation experiments—as opposed to real world experiments—that require more investigation. We consider three types of practical problems: (1) developing a basic understanding of a particular simulation model or system; (2) finding robust decisions or policies; and (3) comparing the merits of various decisions or policies. Our discussion emphasizes aspects that are typical for simulation, such as sequential data collection. Because the same problem type may be addressed through different design types, we discuss quality attributes of designs. Furthermore, the selection of the design type depends on the metamodel (response surface) that the analysts tentatively assume; for example, more complicated metamodels require more simulation runs. For the validation of the metamodel estimated from a specific design, we present several procedures.
The article of record as published may be located at http://dx.doi.org/10.1287/ijoc.1050.0136SEED Center Paper"(with online supplement)", included here as a 2nd bitstream.
RightsThis publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.
Showing items related by title, author, creator and subject.
Representing Uncertainty of Hierarchical and Response Surface Models to Improve Design of Experiments Lucas, Thomas W.; Sanchez, Paul J.; McDonald, Mary; Upton, Steve; Pav, Russsell (Monterey, California. Naval Postgraduate School, 2015);The Office of the Chief of Naval Operations (OPNAV) uses a hierarchy of simulation models as part of scenario-based planning to help decide how the Navy should be equipped, organized, and employed. Simulation is used ...
Lucas, Thomas W.; Sanchez, Paul J.; Ilaslan, Salih (Monterey, California. Naval Postgraduate School, 2016); N16-N206-AThe Office of the Chief of Naval Operations (OPNAV) uses a hierarchy of simulation models as part of scenario-based planning to help decide how the Navy should be equipped, organized, and employed. Simulation is used ...
Sanchez, Susan M.; Wan, Hong (IEEE, 2012);Simulation models are integral to modern scientific research, national defense, industry and manufacturing, and in public policy debates. These models tend to be extremely complex, often with thousands of factors and many ...