Optimal budget allocation for stochastic simulation with importance sampling: Exploration vs. replication

References

• Ankenman, B., Nelson, B.L. and Staum, J. (2010) Stochastic kriging for simulation metamodeling. Operations Research, 58(2), 371–382.
   Web of Science ®Google Scholar
• Binois, M., Huang, J., Gramacy, R.B. and Ludkovski, M. (2019) Replication or exploration? Sequential design for stochastic simulation experiments. Technometrics, 61(1), 7–23.
   Web of Science ®Google Scholar
• Broadie, M., Du, Y. and Moallemi, C. (2011) Efficient risk estimation via nested sequential simulation. Management Science, 57(6), 1172–1194.
   Web of Science ®Google Scholar
• Byon, E., Choe, Y. and Yampikulsakul, N. (2016) Adaptive learning in time-variant processes with application to wind power systems. IEEE Transactions on Automation Science and Engineering, 13(2), 997–1007.
   Web of Science ®Google Scholar
• Cao, Q.D. and Choe, Y. (2019) Cross-entropy based importance sampling for stochastic simulation models. Reliability Engineering & System Safety, 191, 106526.
   Web of Science ®Google Scholar
• Chapelle, O. and Li, L. (2011) An empirical evaluation of Thompson sampling. Advances in Neural Information Processing Systems, 24, 2249–2257.
   Google Scholar
• Chen, Y.C. and Choe, Y. (2019) Importance sampling and its optimality for stochastic simulation models. Electronic Journal of Statistics, 13(2), 3386–3423.
   Web of Science ®Google Scholar
• Choe, Y., Byon, E. and Chen, N. (2015) Importance sampling for reliability evaluation with stochastic simulation models. Technometrics, 57(3), 351–361.
   Web of Science ®Google Scholar
• Choe, Y., Lam, H. and Byon, E. (2018) Uncertainty quantification of stochastic simulation for black-box computer experiments. Methodology and Computing in Applied Probability, 20(4), 1155–1172.
   Web of Science ®Google Scholar
• Choe, Y., Pan, Q. and Byon, E. (2016) Computationally efficient uncertainty minimization in wind turbine extreme load assessments. Journal of Solar Energy Engineering, 138(4), 041012.
   Web of Science ®Google Scholar
• Ding, Y. (2019) Data Science for Wind Energy, CRC Press, Boca Raton, FL.
   Google Scholar
• Frazier, P.I. (2018) A tutorial on Bayesian optimization. Available at: https://arxiv.org/pdf/1807.02811.pdf. (accessed 10 August 2020).
   Google Scholar
• Gittins, J.C. and Jones, D.M. (1979) A dynamic allocation index for the discounted multiarmed bandit problem. Biometrika, 66(3), 561–565.
   Web of Science ®Google Scholar
• Glasserman, P., Heidelberger, P. and Perwez, S. (1999) Importance sampling and stratification for value-at-risk, in Proceedings of the Sixth International Conference on Computational Finance, MIT Press, New York, NY, pp. 7–24.
   Google Scholar
• Glasserman, P., Heidelberger, P. and Shahabuddin, P. (2000) Variance reduction techniques for estimating value-at-risk. Management Science, 46(10), 1349–1364.
   Web of Science ®Google Scholar
• Glynn, P.W. and Iglehart, D.L. (1989) Importance sampling for stochastic simulations. Management Science, 35(11), 1367–1392.
   Web of Science ®Google Scholar
• Goetz, J., Tewari, A. and Zimmerman, P. (2018) Active learning for non-parametric regression using purely random trees. Advances in Neural Information Processing Systems, 31, 2537–2546.
   Google Scholar
• Gordy, M.B. and Juneja, S. (2010) Nested simulation in portfolio risk measurement. Management Science, 56(10), 1833–1848.
   Web of Science ®Google Scholar
• Gramacy, R.B. and Lee, H.K.H. (2009) Adaptive design and analysis of supercomputer experiments. Technometrics, 51(2), 130–145.
   Web of Science ®Google Scholar
• International Electrotechnical Commission (2005) Wind Turbines - Part 1: Design Requirements, IEC/TC88, 61400–1 ed. 3, Geneva, Switzerland.
   Google Scholar
• Jonkman, B.J. (2009) TurbSim user’s guide: version 1.50, Technical Report NREL/TP-500-46198, National Renewable Energy Laboratory, Golden, CO.
   Google Scholar
• Jonkman, J.M. and Buhl Jr., M.L. (2005) FAST User’s Guide, Technical Report NREL/EL-500-38230, National Renewable Energy Laboratory, Golden, CO.
   Google Scholar
• Lan, H., Nelson, B.L. and Staum, J. (2010) A confidence interval procedure for expected shortfall risk measurement via two-level simulation. Operations Research, 58(5), 1481–1490.
   Web of Science ®Google Scholar
• Lee, G., Byon, E., Ntaimo, L. and Ding, Y. (2013) Bayesian spline method for assessing extreme loads on wind turbines. Annals of Applied Statistics, 7(4), 2034–2061.
   Web of Science ®Google Scholar
• Mockus, J. (1989) Bayesian Approach to Global Optimization, Springer, Dordrect, The Netherlands.
   Google Scholar
• Moriarty, P. (2008) Database for validation of design load extrapolation techniques. Wind Energy, 11(6), 559–576.
   Web of Science ®Google Scholar
• Owen, A.B. (2013) Monte Carlo Theory, Methods and Examples. Available at https://statweb.stanford.edu/˜owen/mc/. (accessed 10 August 2020).
   Google Scholar
• Pan, Q., Byon, E., Ko, Y. and Lam, H. (2020) Adaptive importance sampling for extreme quantile estimation with stochastic black box computer models. Naval Research Logistics, 67, 524–547.
   Web of Science ®Google Scholar
• Pan, Q., Ko, Y.M. and Byon, E. (2021) Uncertainty quantification for extreme quantile estimation with stochastic computer models. IEEE Transactions on Reliability, 70, 134–145.
   Web of Science ®Google Scholar
• Russo, D.J., Roy, B.V., Kazerouni, A., Osband, I. and Wen, Z. (2018) A tutorial on Thompson sampling. Foundations and Trends® in Machine Learning, 11(1), 1–96.
   Web of Science ®Google Scholar
• Sinha, S. and Wiens, D.P. (2002) Robust sequential designs for nonlinear regression. The Canadian Journal of Statistics, 30(4), 601–618.
   Web of Science ®Google Scholar
• Snoek, J., Larochelle, H. and Adams, R.P. (2012) Practical Bayesian optimization of machine learning algorithms, in Proceedings of the 25th International Conference on Neural Information Processing Systems (NIPS), Curran Associates Inc., Lake Tahoe, NV, pp. 2951–2959. https://nips.cc/Conferences/2012.
   Google Scholar
• Sun, Y., Apley, D.W. and Staum, J. (2011) Efficient nested simulation for estimating the variance of a conditional expectation. Operations Research, 59(4), 998–1007.
   Web of Science ®Google Scholar
• Thompson, W.R. (1933) On the likelihood that one unknown probability exceeds another in view of the evidence of two samples. Biometrika, 25(3/4), 285–294.
   Google Scholar
• Wang, L., Chen, X., Kang, S., Deng, X. and Jin, R. (2020) Meta-modeling of high-fidelity FEA simulation for efficient product and process design in additive manufacturing. Additive Manufacturing, 35, 101211.
   Web of Science ®Google Scholar
• Wang, W. and Haaland, B. (2019) Controlling sources of inaccuracy in stochastic kriging. Technometrics, 61(3), 309–321.
   Web of Science ®Google Scholar
• Xiong, S., Qian, P.Z.G. and Wu, C.F.J. (2013) Sequential design and analysis of high-accuracy and low-accuracy computer codes. Technometrics, 55(1), 37–46.
   Web of Science ®Google Scholar
• You, M., Byon, E., Jin, J. and Lee, G. (2017) When wind travels through turbines: A new statistical approach for characterizing heterogeneous wake effects in multi-turbine wind farms. IISE Transactions, 49(1), 84–95.
   Web of Science ®Google Scholar