KT-EGO: a knowledge transfer assisted efficient global optimization algorithm for solving high-dimensional expensive black-box problems

References

• Amine Bouhlel, Mohamed, Nathalie Bartoli, Rommel G. Regis, Abdelkader Otsmane, and Joseph Morlier. 2022. “Efficient Global Optimization for High-Dimensional Constrained Problems by Using the Kriging Models Combined with the Partial Least Squares Method.” Engineering Optimization 50 (12): 2038–2053.
   Web of Science ®Google Scholar
• Boretti, A. 2010. “Experimental and Computational Analysis of a Transonic Compressor Rotor.” In Proceedings of the 17th Australasian Fluid Mechanics Conference, Vol. 4. Auckland, New Zealand: Faculty of Engineering in Association with the Centre for Continuing Education, The University of Auckland. https://people.eng.unimelb.edu.au/imarusic/proceedings/17/016_Paper.pdf.
   Google Scholar
• Cai, Xiwen, Liang Gao, and Xinyu Li. 2020. “Efficient Generalized Surrogate-Assisted Evolutionary Algorithm for High-Dimensional Expensive Problems.” IEEE Transactions on Evolutionary Computation 24 (2): 365–379.
   Web of Science ®Google Scholar
• Chen, Wenxiang, Thomas Weise, Zhenyu Yang, and Ke Tang. 2010. “Large-Scale Global Optimization Using Cooperative Coevolution with Variable Interaction Learning.” In Proceedings of Parallel Problem Solving from Nature (PPSN XI), edited by Robert Schaefer, Carlos Cotta, Joanna Kołodziej, and Günter Rudolph, 300–309. Berlin: Springer.
   Google Scholar
• Dong, Huachao, Baowei Song, Peng Wang, and Zuomin Dong. 2018. “Hybrid Surrogate-Based Optimization Using Space Reduction (HSOSR) for Expensive Black-Box Functions.” Applied Soft Computing 64: 641–655.
   Web of Science ®Google Scholar
• Dong, Huachao, Peng Wang, Xinkai Yu, and Baowei Song. 2021. “Surrogate-Assisted Teaching–Learning-Based Optimization for High-Dimensional and Computationally Expensive Problems.” Applied Soft Computing 99: Article ID 106934. doi:10.1016/j.asoc.2020.106934.
   Web of Science ®Google Scholar
• Guo, Zhendong, Haitao Liu, Yew-Soon Ong, Xinghua Qu, Yuzhe Zhang, and Jianmin Zheng. 2022. “Generative Multiform Bayesian Optimization.” IEEE Transactions on Cybernetics. 14pp. Advance online publication. doi:10.1109/TCYB.2022.3165044.
   Web of Science ®Google Scholar
• Guo, Zhendong, Yew-Soon Ong, and Haitao Liu. 2021. “Calibrated and Recalibrated Expected Improvements for Bayesian Optimization.” Structural and Multidisciplinary Optimization 64 (6): 3549–3567.
   Web of Science ®Google Scholar
• Guo, Zhendong, Liming Song, Chanyoung Park, Jun Li, and Raphael T. Haftka. 2018. “Analysis of Dataset Selection for Multi-Fidelity Surrogates for a Turbine Problem.” Structural and Multidisciplinary Optimization 57 (6): 2127–2142.
   Web of Science ®Google Scholar
• Guo, Zhendong, Qineng Wang, Liming Song, and Jun Li. 2021. “Parallel Multi-Fidelity Expected Improvement Method for Efficient Global Optimization.” Structural and Multidisciplinary Optimization64 (3): 1457–1468.
   Web of Science ®Google Scholar
• Gupta, Abhishek, Yew-Soon Ong, and Liang Feng. 2018. “Insights on Transfer Optimization: Because Experience is the Best Teacher.” IEEE Transactions on Emerging Topics in Computational Intelligence2 (1): 51–64.
   Google Scholar
• Hajikolaei, Kambiz Haji, Zhila Pirmoradi, George H. Cheng, and G. Gary Wang. 2022. “Decomposition for Large-Scale Global Optimization Based on Quantified Variable Correlations Uncovered by Metamodelling.” Engineering Optimization 47 (4): 429–452.
   Web of Science ®Google Scholar
• Han, Zhong-Hua, and Stefan Görtz. 2012. “Hierarchical Kriging Model for Variable-Fidelity Surrogate Modeling.” AIAA Journal 50 (9): 1885–1896.
   Web of Science ®Google Scholar
• Jones, Donald R., Matthias Schonlau, and William J. Welch. 1998. “Efficient Global Optimization of Expensive Black-Box Functions.” Journal of Global Optimization 13 (4): 455–492.
   Web of Science ®Google Scholar
• Krige, D. G. 1951. “A Statistical Approach to Some Basic Mine Valuation Problems on the Witwatersrand.” Journal of the Southern African Institute of Mining and Metallurgy 52 (6): 119–139. https://hdl.handle.net/10520/AJA0038223X_4792
   Google Scholar
• Li, Fan, Xiwen Cai, Liang Gao, and Weiming Shen. 2021. “A Surrogate-Assisted Multiswarm Optimization Algorithm for High-Dimensional Computationally Expensive Problems.” IEEE Transactions on Cybernetics 51 (3): 1390–1402.
   PubMed Web of Science ®Google Scholar
• Li, Zengcong, Tianhe Gao, Kuo Tian, and Bo Wang. 2022. “Elite-Driven Surrogate-Assisted CMA-ES Algorithm by Improved Lower Confidence Bound Method.” Engineering with Computers 21.
   Google Scholar
• Li, Genghui, Qingfu Zhang, Qiuzhen Lin, and Weifeng Gao. 2022. “A Three-Level Radial Basis Function Method for Expensive Optimization.” IEEE Transactions on Cybernetics 52 (7): 5720–5731.
   PubMed Web of Science ®Google Scholar
• Melanie, Mitchell. 1998. An Introduction to Genetic Algorithms. 5th ed. Cambridge, MA: MIT Press.
   Google Scholar
• Mohamed, Ali Wagdy, Anas A. Hadi, and Ali Khater Mohamed. 2020. “Gaining–Sharing Knowledge Based Algorithm for Solving Optimization Problems: A Novel Nature-Inspired Algorithm.” International Journal of Machine Learning and Cybernetics 11 (7): 1501–1529.
   Web of Science ®Google Scholar
• Omidvar, Mohammad Nabi, Xiaodong Li, and Xin Yao. 2022. “A Review of Population-Based Metaheuristics for Large-Scale Black-Box Global Optimization—Part 1.” IEEE Transactions on Evolutionary Computation 26 (5): 802–822. doi:10.1109/TEVC.2021.3130838
   Web of Science ®Google Scholar
• Pan, Sinno Jialin, and Qiang Yang. 2010. “A Survey on Transfer Learning.” IEEE Transactions on Knowledge and Data Engineering 22 (10): 1345–1359.
   Web of Science ®Google Scholar
• Peng, Xingguang, Yaochu Jin, and Handing Wang. 2018. “Multimodal Optimization Enhanced Cooperative Coevolution for Large-Scale Optimization.” IEEE Transactions on Cybernetics 49 (9): 3507–3520.
   PubMed Web of Science ®Google Scholar
• Ponweiser, Wolfgang, Tobias Wagner, and Markus Vincze. 2008. “Clustered Multiple Generalized Expected Improvement: A Novel Infill Sampling Criterion for Surrogate Models.” In Proceedings of the 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence), 3515–3522. Piscataway, NJ: IEEE.
   Google Scholar
• Sasena, Michael J., Panos Papalambros, and Pierre Goovaerts. 2002. “Exploration of Metamodelling Sampling Criteria for Constrained Global Optimization.” Engineering Optimization 34 (3): 263–278.
   Web of Science ®Google Scholar
• Shan, Songqing, and G. Gary Wang. 2009. “Development of Adaptive RBF-HDMR Model for Approximating High Dimensional Problems.” In Proceedings of the 35th Design Automation Conference, Parts A and B, Vol. 5, Paper No: DETC2009-86531, 727–740. New York: ASME. doi:10.1115/DETC2009-86531.
   Google Scholar
• Shan, Songqing, and G. Gary Wang. 2010a. “Metamodelling for High Dimensional Simulation-Based Design Problems.” Journal of Mechanical Design 132 (5): Article ID 051009. doi:10.1115/1.4001597.
   Web of Science ®Google Scholar
• Shan, Songqing, and G. Gary Wang. 2010b. “Survey of Modelling and Optimization Strategies to Solve High-Dimensional Design Problems with Computationally-Expensive Black-Box Functions.” Structural and Multidisciplinary Optimization 41 (2): 219–241.
   Web of Science ®Google Scholar
• Shang, Xiaobing, Ping Ma, Tao Chao, and Ming Yang. 2022. “A Sequential Experimental Design for Multivariate Sensitivity Analysis Using Polynomial Chaos Expansion.” Engineering Optimization 52 (8): 1382–1400.
   Web of Science ®Google Scholar
• Song, Liming, Zhendong Guo, Jun Li, and Zhenping Feng. 2016. “Research on Metamodel-Based Global Design Optimization and Data Mining Methods.” Journal of Engineering for Gas Turbines and Power138 (9): Article ID 092604. doi:10.1115/1.4032653.
   PubMed Web of Science ®Google Scholar
• Storn, Rainer, and Kenneth Price. 1997. “Differential Evolution—A Simple and Efficient Heuristic for Global Optimization Over Continuous Spaces.” Journal of Global Optimization 11: 341–359. doi:10.1023/A:1008202821328
   Web of Science ®Google Scholar
• Suder, K. L. 1996. “Experimental Investigation of the Flow Field in a Transonic, Axial Flow Compressor with Respect to the Development of Blockage and Loss.” NASA Technical Memorandum 107310, 268pp. Reston, VA: American Institute of Aeronautics and Astronautics. https://ntrs.nasa.gov/citations/19970001675.
   Google Scholar
• Sudret, Bruno. 2008. “Global Sensitivity Analysis Using Polynomial Chaos Expansions.” Reliability Engineering & System Safety 93 (7): 964–979.
   Web of Science ®Google Scholar
• Tang, Ke, Xiaodong Li, P. N. Suganthan, Zhenyu Yang, and Thomas Weise. 2010. “Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale Global Optimization.” https://typeset.io/papers/benchmark-functions-for-the-cec-2010-special-session-and-1igu0kaozd.
   Google Scholar
• Wang, Handing, Yaochu Jin, and John Doherty. 2017. “Committee-Based Active Learning for Surrogate-Assisted Particle Swarm Optimization of Expensive Problems.” IEEE Transactions on Cybernetics 47 (9): 2664–2677. doi:10.1109/TCYB.2017.2710978
   PubMed Web of Science ®Google Scholar
• Wang, Weizhong, Hai-Lin Liu, and Kay Chen Tan. 2022. “A Surrogate-Assisted Differential Evolution Algorithm for High-Dimensional Expensive Optimization Problems.” IEEE Transactions on Cybernetics. 13pp. Advance online publication. doi:10.1109/TCYB.2022.3175533.
   Web of Science ®Google Scholar
• Wang, Qineng, Liming Song, Zhendong Guo, and Jun Li. 2020. “Transfer Optimization in Accelerating the Design of Turbomachinery Cascades.” In Proceedings of ASME Turbo Expo 2020 Turbomachinery Technical Conference and Exposition, 12pp. New York: ASME. doi:10.1115/GT2020-16321.
   Google Scholar
• Wang, Fenggang, Fenfen Xiong, Huan Jiang, and Jianmei Song. 2022. “An Enhanced Data-Driven Polynomial Chaos Method for Uncertainty Propagation.” Engineering Optimization 50 (2): 273–292.
   Web of Science ®Google Scholar
• Xu, Shengguan, and Hongquan Chen. 2018. “Nash Game Based Efficient Global Optimization for Large-Scale Design Problems.” Journal of Global Optimization 71 (2): 361–381.
   Web of Science ®Google Scholar
• Zhan, Dawei, and Huanlai Xing. 2021. “A Fast Kriging-Assisted Evolutionary Algorithm Based on Incremental Learning.” IEEE Transactions on Evolutionary Computation 25 (5): 941–955. doi:10.1109/TEVC.2021.3067015
   Web of Science ®Google Scholar
• Zhang, Ning, Peng Wang, and Huachao Dong. 2022. “Research on High-Dimensional Model Representation with Various Metamodels.” Engineering Optimization 51 (8): 1336–1351.
   Web of Science ®Google Scholar