Purposeful cross-validation: a novel cross-validation strategy for improved surrogate optimizability

References

• Amouzgar, Kaveh, Sunith Bandaru, Tobias Andersson, and Amos H. C. Ng. 2019. “Metamodel-Based Multi-Objective Optimization of a Turning Process by Using Finite Element Simulation.” Engineering Optimization 52: 1–18.
   Web of Science ®Google Scholar
• Bhosekar, Atharv, and Marianthi Ierapetritou. 2018. “Advances in Surrogate Based Modeling, Feasibility Analysis, and Optimization: A Review.” Computers & Chemical Engineering 108: 250–267.
   Web of Science ®Google Scholar
• Bischl, B., O. Mersmann, H. Trautmann, and C. Weihs. 2012. “Resampling Methods for Meta-Model Validation with Recommendations for Evolutionary Computation.” Evolutionary Computation 20: 249–275.
   PubMed Web of Science ®Google Scholar
• Breiman, Leo, and Philip Spector. 1992. “Submodel Selection and Evaluation in Regression. The X-Random Case.” International Statistical Review/Revue Internationale de Statistique 60: 291.
   Web of Science ®Google Scholar
• Chen, Chong, Zhenfei Zhan, Huili Yu, and Hui Zhao. 2019. “An Efficient Decision-Making Framework for Hybrid Metamodelling.” Engineering Optimization 51: 1761–1776.
   Web of Science ®Google Scholar
• Correia, Daniel, and Daniel N. Wilke. 2019. “How We Solve the Weights in Our Surrogate Models Matters.” Journal of Mechanical Design 141 (7): Article ID 074501. doi:10.1115/1.4042622.
   PubMed Web of Science ®Google Scholar
• Dean, Angela, Daniel Voss, and Danel Draguljić. 2017. Design and Analysis of Experiments. 2nd ed. In the series Springer Texts in Statistics. Cham, Switzerland: Springer. doi:10.1007/978-3-319-52250-0_7.
   Google Scholar
• Dubrule, O. 1983. “Cross Validation of Kriging in a Unique Neighborhood.” Journal of the International Association for Mathematical Geology 15 (6): 687–699.
   Google Scholar
• Eggensperger, Katharina, Frank Hutter, Holger Hoos, and Kevin Leyton-Brown. 2015. “Efficient Benchmarking of Hyperparameter Optimizers via Surrogates.” In Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence (AAAI'15), 1114–1120. Palo Alto, CA: AAAI Press. https://dl.acm.org/doi/10.5555/2887007.2887162.
   Google Scholar
• Forrester, Alexander I. J., and Andy J. Keane. 2009. “Recent Advances in Surrogate-Based Optimization.” Progress in Aerospace Sciences 45 (1-3): 50–79.
   Web of Science ®Google Scholar
• Friedman, Jerome, Trevor Hastie, and Robert Tibshirani. 2001. The Elements of Statistical Learning—Data Mining, Inference, and Prediction. 1st ed. Springer Series in Statistics. New York: Springer-Verlag.
   Google Scholar
• Garbo, Andrea, and Brian J. German. 2019. “Performance Assessment of a Cross-Validation Sampling Strategy with Active Surrogate Model Selection.” Structural and Multidisciplinary Optimization 59 (6): 2257–2272.
   Web of Science ®Google Scholar
• Hare, Warren, Julie Nutini, and Solomon Tesfamariam. 2013. “A Survey of Non-Gradient Optimization Methods in Structural Engineering.” Advances in Engineering Software 59: 19–28.
   Web of Science ®Google Scholar
• Ilzarbe, Laura, María Jesús Álvarez, Elisabeth Viles, and Martín Tanco. 2008. “Practical Applications of Design of Experiments in the Field of Engineering: A Bibliographical Review.” Quality and Reliability Engineering International 24: 417–428. doi:10.1002/qre.909.
   Web of Science ®Google Scholar
• Jamil, Momin, and Xin-She Yang. 2013. “A Literature Survey of Benchmark Functions for Global Optimization Problems.” International Journal of Mathematical Modelling and Numerical Optimisation 4: 150–194.
   Google Scholar
• Kohavi, Ron. 1995. “A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection.” In Proceedings of the 14th International Joint Conference on Artificial Intelligence (IJCAI'95), Vol. 2, 1137–1143. San Francisco, CA: Morgan Kaufmann. https://dl.acm.org/doi/10.5555/1643031.1643047.
   Google Scholar
• Krusienski, D. J., and W. K. Jenkins. 2004. “A Particle Swarm Optimization—Least Mean Squares Algorithm for Adaptive Filtering.” In Conference Record of the Thirty-Eighth Asilomar Conference on Signals, Systems and Computers, 2004, Vol. 1, 241–245. Piscataway, NJ: IEEE. doi:10.1109/ACSSC.2004.1399128.
   Google Scholar
• Kyprioti, Aikaterini P., Jize Zhang, and Alexandros A. Taflanidis. 2020. “Adaptive Design of Experiments for Global Kriging Metamodeling Through Cross-Validation Information.” Structural and Multidisciplinary Optimization, 62 (3): 1135–1157. doi:10.1007/s00158-020-02543-1.
   Google Scholar
• Laguna, Manuel, and Rafael Martí. 2005. “Experimental Testing of Advanced Scatter Search Designs for Global Optimization of Multimodal Functions.” Journal of Global Optimization 33: 235–255. doi:10.1007/s10898-004-1936-z.
   Web of Science ®Google Scholar
• Lin, Ji, Yuxiang Zhao, Daniel Watson, and C. S. Chen. 2020. “The Radial Basis Function Differential Quadrature Method with Ghost Points.” Mathematics and Computers in Simulation 173: 105–114.
   Web of Science ®Google Scholar
• McKay, M. D., R. J. Beckman, and W. J. Conover. 1979. “Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code.” Technometrics 21 (2): 239–245.
   Web of Science ®Google Scholar
• Rippa, Shmuel. 1999. “An Algorithm for Selecting a Good Value for the Parameter c in Radial Basis Function Interpolation.” Advances in Computational Mathematics 11: 193–210.
   Web of Science ®Google Scholar
• Schwenker, Friedhelm, Hans A. Kestler, and Günther Palm. 2001. “Three Learning Phases for Radial-Basis-Function Networks.” Neural Networks 14 (4-5): 439–458. doi:10.1016/S0893-6080(01)00027-2.
   PubMed Web of Science ®Google Scholar
• Shan, Songqing, and Gary Wang. 2010. “Survey of Modeling and Optimization Strategies to Solve High-Dimensional Design Problems with Computationally-Expensive Black-Box Functions.” Structural and Multidisciplinary Optimization 41: 219–241.
   Web of Science ®Google Scholar
• Shi, Lingjian, Beibei Sun, and Dauda Sh. Ibrahim. 2019. “An Active Learning Reliability Method with Multiple Kernel Functions Based on Radial Basis Function.” Structural and Multidisciplinary Optimization 60 (1): 211–229.
   Web of Science ®Google Scholar
• Thomson, Quinn, and Joaquim R. R. A. Martins. 2011. “Adaptive Accuracy Trust Region: Using Cross-Validation in the Optimization Process.” Engineering Optimization 43 (6): 615–633.
   Web of Science ®Google Scholar
• Vanaret, Charlie, Jean-Baptiste Gotteland, Nicolas Durand, and Jean-Marc Alliot. 2014. Certified Global Minima for a Benchmark of Difficult Optimization Problems. Toulouse, France: École Nationale de l'Aviation Civile. https://hal-enac.archives-ouvertes.fr/hal-00996713.
   Google Scholar
• Wang, G. Gary, and Songqing Shan. 2007. “Review of Metamodeling Techniques in Support of Engineering Design Optimization.” Journal of Mechanical Design 129 (4): 370–380.
   Web of Science ®Google Scholar
• Wild, Stefan M., and Christine Shoemaker. 2013. “Global Convergence of Radial Basis Function Trust-Region Algorithms for Derivative-Free Optimization.” SIAM Review 55: 349–371.
   Web of Science ®Google Scholar
• Zhang, Yi, Wen Yao, Siyu Ye, and Xiaoqian Chen. 2019. “A Regularization Method for Constructing Trend Function in Kriging Model.” Structural and Multidisciplinary Optimization 59 (4): 1221–1239.
   Web of Science ®Google Scholar
• Zhang, Yi, Wen Yao, Xiaoqian Chen, and Siyu Ye. 2020. “A Penalized Blind Likelihood Kriging Method for Surrogate Modeling.” Structural and Multidisciplinary Optimization 61 (2): 457–474.
   Web of Science ®Google Scholar
• Zhang, Jian, Xinxin Yue, Jiajia Qiu, Muyu Zhang, and Xiaomei Wang. 2020. “A Unified Ensemble of Surrogates with Global and Local Measures for Global Metamodelling.” Engineering Optimization. doi:10.1080/0305215X.2020.1739280.
   Google Scholar