An empirical study of the prediction performance of space-filling designs
Johnson, Rachel T.
Montgomery, Douglas C.
MetadataShow full item record
The Gaussian process (GASP) model has found widespread use as a surrogate model for results from deterministic computer model output. In this paper, we compare the fits of GASP models to specific space-filling designs based on their accuracy in predicting responses at previously unsampled locations. This is done empirically using several test functions. We demonstrate that no one space-filling design outperforms another with respect to prediction accuracy. We also found that while the GASP model is substantially easier to fit using the cubic correlation function than with the Gaussian correlation function, its prediction accuracy is not quite as good as the Gaussian correlation function for the chosen test functions especially for larger sample sizes. The best way to improve prediction accuracy is to increase the number of simulation runs, which suggests that the efficient augmentation of space filling designs is an important area for further research.
Approved for public release; distribution is unlimited
Showing items related by title, author, creator and subject.
Ivanov, Leonid M.; Chu, Peter C. (Copernicus Publications on behalf of the European Geosciences Union and the American Geophysical Union, 2007);A shallow-water model was used to understand model error induced by non-Gaussian wind uncertainty. Al- though the model was simple, it described a generic system with many degrees of freedom randomized by external noise. ...
Erickson, Collin B.; Ankenman, Bruce E.; Sanchez, Susan M. (Elsevier, 2017-10);Gaussian process fitting, or kriging, is often used to create a model from a set of data. Many available soft- ware packages do this, but we show that very different results can be obtained from different packages even ...
Erickson, Collin; Sanchez, Susan M.; Ankenman, Bruce E. (IEEE, 2016);Gaussian process fitting, or kriging, is often used to create a model from a set of data. Many available software packages do this, but we show that very different results can be obtained from different packages even ...