Adaptive-region sequential design with quantitative and qualitative factors in application to HPC configuration

References

• Auer, P. 2002. Using confidence bounds for exploitation-exploration trade-offs. Journal of Machine Learning Research 3:397–422.
   Google Scholar
• Bichon, B., S. Mahadevan, and M. Eldred. 2009. Reliability-based design optimization using efficient global reliability analysis. 50th AIAA/ASME/ASCE/AHS/ASC structures, structural dynamics, and materials conference, AIAA, Palm Springs, California, 2009–2261. doi:10.2514/6.2009-2261.
   Google Scholar
• Bingham, D., P. Ranjan, and W. J. Welch. 2014. Design of computer experiments for optimization, estimation of function contours, and related objectives. Statistics in Action: A Canadian Outlook, 109–124.
   Google Scholar
• Cameron, K. W., A. Anwar, Y. Cheng, L. Xu, B. Li, U. Ananth, J. Bernard, C. Jearls, T. Lux, Y. Hong, et al. 2019. MOANA: Modeling and analyzing I/O variability in parallel system experimental design. IEEE Transactions on Parallel and Distributed Systems 30 (8):1843–56. doi:10.1109/TPDS.2019.2892129.
   Web of Science ®Google Scholar
• Chen, Z., S. Mak, and C. F. J. Wu. 2023. A hierarchical expected improvement method for Bayesian optimization. Journal of the American Statistical Association: 1–14. doi: 10.1080/01621459.2023.2210803.
   Web of Science ®Google Scholar
• Cortes, C., G. DeSalvo, C. Gentile, M. Mohri, and N. Zhang. 2020. Adaptive region-based active learning. Paper presented at the Proceedings of the 37th International Conference on Machine Learning, PMLR, 119: 2144–53.
   Google Scholar
• Deng, X., C. D. Lin, K. W. Liu, and R. K. Rowe. 2017. Additive Gaussian process for computer models with qualitative and quantitative factors. Technometrics 59 (3):283–92. doi:10.1080/00401706.2016.1211554.
   Web of Science ®Google Scholar
• Deng, X., Y. Hung, and C. D. Lin. 2015. Design for computer experiments with qualitative and quantitative factors. Statistica Sinica 25 (4):1567–81. doi:10.5705/ss.2013.388.
   Web of Science ®Google Scholar
• Fang, K. T., R. Li, and A. Sudjianto. 2005. Design and modeling for computer experiments. New York: Chapman & Hall/CRC Press.
   Google Scholar
• Frazier, P. I., W. B. Powell, and S. Dayanik. 2008. A knowledge-gradient policy for sequential information collection. SIAM Journal on Control and Optimization 47 (5):2410–39. doi:10.1137/070693424.
   Web of Science ®Google Scholar
• Gramacy, R. B. 2020. Surrogates: Gaussian process modeling, design, and optimization for the applied sciences. New York: Chapman & Hall/CRC Press.
   Google Scholar
• He, Y., C. D. Lin, F. Sun, and B. Lv. 2019. Construction of marginally coupled designs by subspace theory. Bernoulli 25 (3):2163–82. doi:10.3150/18-BEJ1049.
   Web of Science ®Google Scholar
• Jala, M., C. Levy-Leduc, E. Moulines, E. Conil, and J. Wiart. 2016. Sequential design of computer experiments for the assessment of fetus exposure to electromagnetic fields. Technometrics 58 (1):30–42. doi:10.1080/00401706.2014.979951.
   Web of Science ®Google Scholar
• Jones, D. R., M. Schonlau, and W. J. Welch. 1998. Efficient global optimization of expensive black-box functions. Journal of Global Optimization 13 (4):455–92. doi:10.1023/A:1008306431147.
   Web of Science ®Google Scholar
• Joseph, V. R. 2016. Space-filling designs for computer experiments: A review. Quality Engineering 28 (1):28–35. doi:10.1080/08982112.2015.1100447.
   Web of Science ®Google Scholar
• McKay, M. D., R. J. Beckman, and W. J. Conover. 1979. A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 21 (2):239–45. doi:10.2307/1268522.
   Web of Science ®Google Scholar
• Norcott, W. D. 2020. IOzone filesystem benchmark. http://www.iozone.org/.
   Google Scholar
• Picheny, V., D. Ginsbourger, O. Roustant, R. T. Haftka, and N. Kim. 2010. Adaptive designs of experiments for accurate approximation of a target region. Journal of Mechanical Design 132 (7):071008. doi:10.1115/1.4001873.
   Web of Science ®Google Scholar
• Picheny, V., R. B. Gramacy, S. M. Wild, and S. L. Digabel. 2016. Bayesian optimization under mixed constraints with a slack-variable augmented Lagrangian. Paper presented at the Proceedings of the 30th International Conference on Neural Information Processing Systems, 1435–43.
   Google Scholar
• Ponweiser, W., T. Wagner, and M. Vincze. 2008. Clustered multiple generalized expected improvement: A novel infill sampling criterion for surrogate models. 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence), Hong Kong, China, 3515–3522. doi:10.1109/CEC.2008.4631273.
   Google Scholar
• Qian, P. Z. 2012. Sliced Latin hypercube designs. Journal of the American Statistical Association 107 (497):393–9. doi:10.1080/01621459.2011.644132.
   Web of Science ®Google Scholar
• Ranjan, P., D. Bingham, and G. Michailidis. 2008. Sequential experiment design for contour estimation from complex computer codes. Technometrics 50 (4):527–41. doi:10.1198/004017008000000541.
   Web of Science ®Google Scholar
• Ranjan, P., R. Haynes, and R. Karsten. 2011. A computationally stable approach to Gaussian process interpolation of deterministic computer simulation data. Technometrics 53 (4):366–78. doi:10.1198/TECH.2011.09141.
   Web of Science ®Google Scholar
• Roy, S. 2008. Sequential-adaptive design of computer experiments for the estimation of percentiles. PhD Thesis., Ohio State University.
   Google Scholar
• Sacks, J., W. J. Welch, T. J. Mitchell, and H. P. Wynn. 1989. Design and analysis of computer experiments. Statistical Science 4 (4):409–23. doi:10.1214/ss/1177012413.
   Google Scholar
• Sakellariou, R., J. Buenabad-Ch, a Vez, E. Kavakli, I. Spais, and V. Tountopoulos. 2018. High performance computing and industry 4.0: Experiences from the DISRUPT project. Paper presented at the Proceedings of the 18th International Conference on Embedded Computer Systems. Architectures, Modeling, and Simulation, 218–219. doi:10.1145/3229631.3264660.
   Google Scholar
• Santner, T. J., B. J. Williams, and W. I. Notz. 2003. The design and analysis of computer experiments. New York: Springer.
   Google Scholar
• Sauer, A., R. B. Gramacy, and D. Higdon. 2023. Active learning for deep Gaussian process surrogates. Technometrics 65 (1):4–18. doi:10.1080/00401706.2021.2008505.
   Web of Science ®Google Scholar
• Scott, W., P. Frazier, and W. Powell. 2011. The correlated knowledge gradient for simulation optimization of continuous parameters using Gaussian process regression. SIAM Journal on Optimization 21 (3):996–1026. doi:10.1137/100801275.
   Web of Science ®Google Scholar
• Srinivas, N., A. Krause, S. M. Kakade, and M. Seeger. 2010. Gaussian process optimization in the bandit setting: No regret and experimental design. Paper presented at Proceedings of the 27th International Conference on Machine Learning (ICML-10), June 21–24, 2010, Haifa, Israel.
   Google Scholar
• Srinivas, N., A. Krause, S. M. Kakade, and M. Seeger. 2012. Information-theoretic regret bounds for Gaussian process optimization in the bandit setting. IEEE Transactions on Information Theory 58 (5):3250–65. doi:10.1109/TIT.2011.2182033.
   Web of Science ®Google Scholar
• Sung, C. L., Y. Hung, W. Rittase, C. Zhu, and C. F. J. Wu. 2020. A generalized Gaussian process model for computer experiments with binary time series. Journal of the American Statistical Association 115 (530):945–56. doi:10.1080/01621459.2019.1604361.
   Web of Science ®Google Scholar
• Wang, L., Q. Xiao, and H. Xu. 2018. Optimal maximin L1 distance Latin hypercube designs based on good lattice point designs. The Annals of Statistics 46 (6B):3741–66. doi:10.1214/17-AOS1674.
   Web of Science ®Google Scholar
• Wang, Y., Z. Peng, R. Zhang, and Q. Xiao. 2021. Robust sequential design for piecewise-stationary multi-armed bandit problem in the presence of outliers. Statistical Theory and Related Fields 5 (2):122–33. doi:10.1080/24754269.2021.1902687.
   Google Scholar
• Wu, C. F. J., and M. Hamada. 2009. Experiments: Planning, analysis, and optimization. New York: Wiley.
   Google Scholar
• Xie, W., and X. Deng. 2020. Scalable algorithms for the sparse ridge regression. SIAM Journal on Optimization 30 (4):3359–86. doi:10.1137/19M1245414.
   Web of Science ®Google Scholar
• Xu, L., T. Lux, T. Chang, B. Li, Y. Hong, L. Watson, A. Butt, D. Yao, and K. Cameron. 2021. Prediction of high-performance computing input/output variability and its application to optimization for system configurations. Quality Engineering 33 (2):318–34. doi:10.1080/08982112.2020.1866203.
   Web of Science ®Google Scholar
• Yang, F., C. D. Lin, and P. Ranjan. 2020. Global fitting of the response surface via estimating multiple contours of a simulator. Journal of Statistical Theory and Practice 14 (1):21. doi:10.1007/s42519-019-0077-0.
   Web of Science ®Google Scholar
• Zhang, Q., P. Chien, Q. Liu, L. Xu, and Y. Hong. 2021. Mixed-input Gaussian process emulators for computer experiments with a large number of categorical levels. Journal of Quality Technology 53 (4):410–20. doi:10.1080/00224065.2020.1778431.
   Web of Science ®Google Scholar
• Zhou, Q., P. G. Qian, and S. Zhou. 2011. A simple approach to emulation for computer models with qualitative and quantitative factors. Technometrics 53 (3):266–73. doi:10.1198/TECH.2011.10025.
   Web of Science ®Google Scholar