Multiresolution Functional ANOVA for Large-Scale, Many-Input Computer Experiments

Abstract

The Gaussian process is a standard tool for building emulators for both deterministic and stochastic computer experiments. However, application of Gaussian process models is greatly limited in practice, particularly for large-scale and many-input computer experiments that have become typical. We propose a multiresolution functional ANOVA (MRFA) model as a computationally feasible emulation alternative. More generally, this model can be used for large-scale and many-input nonlinear regression problems. An overlapping group lasso approach is used for estimation, ensuring computational feasibility in a large-scale and many-input setting. New results on consistency and inference for the (potentially overlapping) group lasso in a high-dimensional setting are developed and applied to the proposed MRFA model. Importantly, these results allow us to quantify the uncertainty in our predictions. Numerical examples demonstrate that the proposed model enjoys marked computational advantages. Data capabilities, in terms of both sample size and dimension, meet or exceed best available emulation tools while meeting or exceeding emulation accuracy. Supplementary materials for this article are available online.

Keywords:

• Computer experiments
• Large-scale
• Many-input
• Nonlinear regression
• Overlapping group lasso

Acknowledgment

The authors gratefully acknowledge helpful advice from the associate editor and two referees.

Additional information

Funding

This work is supported by NSF DMS-1739097 and DMS-1564438.