An improved optimization method combining particle swarm optimization and dimension reduction kriging surrogate model for high-dimensional optimization problems

References

• Abdi, H., and L. Williams. 2010. “Principal Component Analysis.” Wiley Interdisciplinary Reviews: Computational Statistics 2 (4): 433–459. https://doi.org/10.1002/wics.101.
   Google Scholar
• Akhtar, S., K. Tai, and T. Ray. 2002. “A Socio-behavioural Simulation Model for Engineering Design Optimization.” Engineering Optimization 34 (4): 341–354. https://doi.org/10.1080/03052150212723.
   Web of Science ®Google Scholar
• Alcántar, V., S. Aceves, E. Ledesma, S. Ledesma, and E. Aguilera. 2017. “Optimization of Type 4 Composite Pressure Vessels Using Genetic Algorithms and Simulated Annealing.” International Journal of Hydrogen Energy 42 (24): 15770–15781. https://doi.org/10.1016/j.ijhydene.2017.03.032.
   Web of Science ®Google Scholar
• Benassi, R., J. Bect, and E. Vazquez. 2011. “Robust Gaussian Process-Based Global Optimization Using a Fully Bayesian Expected Improvement Criterion.” In Proceedings of the Fifth International Conference on Learning and Intelligent Optimization (LION 5). Lecture Notes in Computer Science 6683, 176–190. Berlin: Springer. https://doi.org/10.1007/978-3-642-25566-3_13.
   Google Scholar
• Bouhlel, M., N. Bartoli, A. Otsmane, and J. Morlier. 2016. “Improving Kriging Surrogates of High-Dimensional Design Models by Partial Least Squares Dimension Reduction.” Structural and Multidisciplinary Optimization 53: 935–952. https://doi.org/10.1007/s00158-015-1395-9.
   Web of Science ®Google Scholar
• Bouhlel, M., N. Bartoli, R. Regis, A. Otsmane, and J. Morlier. 2018. “Efficient Global Optimization for High-Dimensional Constrained Problems by Using the Kriging Models Combined with the Partial Least Squares Method.” Engineering Optimization 50 (12): 2038–2053. https://doi.org/10.1080/0305215X.2017.1419344.
   Web of Science ®Google Scholar
• Chen, J., M. Aral, S. Kim, C. Park, and Y. Xie. 2023. “Constrained Bayesian Optimization and Spatio-temporal Surveillance for Sensor Network Design in the Presence of Measurement Errors.” Engineering Optimization 55 (3): 510–525. https://doi.org/10.1080/0305215X.2021.2014475.
   Web of Science ®Google Scholar
• Chen, J., R. Ge, and J. Wei. 2008. “Probabilistic Optimal Design of Laminates Using Improved Particle Swarm Optimization.” Engineering Optimization 40 (8): 695–708. https://doi.org/10.1080/03052150802010615.
   Web of Science ®Google Scholar
• Chen, Z., S. Mak, and C. Jeff Wu. 2023. “A Hierarchical Expected Improvement Method for Bayesian Optimization.” Journal of the American Statistical Association: 1–14. https://doi.org/10.1080/01621459.2023.2210803.
   Web of Science ®Google Scholar
• Chen, J., X. Zhang, and Z. Jing. 2018. “A Cooperative PSO-DP Approach for the Maintenance Planning and RBDO of Deteriorating Structures.” Structural and Multidisciplinary Optimization 58: 95–113. https://doi.org/10.1007/s00158-017-1879-x.
   Web of Science ®Google Scholar
• Cherkassky, V., and Y. Ma. 2004. “Practical Selection of SVM Parameters and Noise Estimation for SVM Regression.” Neural Networks 17 (1): 113–126. https://doi.org/10.1016/S0893-6080(03)00169-2.
   PubMed Web of Science ®Google Scholar
• Chu, W., X. Gao, and S. Sorooshian. 2011a. “A New Evolutionary Search Strategy for Global Optimization of High-Dimensional Problems.” Information Sciences 181 (22): 4909–4927. https://doi.org/10.1016/j.ins.2011.06.024.
   Web of Science ®Google Scholar
• Chu, W., X. Gao, and S. Sorooshian. 2011b. “A Solution to the Crucial Problem of Population Degeneration in High-Dimensional Evolutionary Optimization.” IEEE Systems Journal 5 (3): 362–373. https://doi.org/10.1109/JSYST.2011.2158682.
   Web of Science ®Google Scholar
• Chu, W., X. Gao, and S. Sorooshian. 2011c. “Handling Boundary Constraints for Particle Swarm Optimization in High-Dimensional Search Space.” Information Sciences 181 (20): 4569–4581. https://doi.org/10.1016/j.ins.2010.11.030.
   Web of Science ®Google Scholar
• Coello, C. 2000. “Use of a Self-Adaptive Penalty Approach for Engineering Optimization Problems.” Computers in Industry 41 (2): 113–127. https://doi.org/10.1016/S0166-3615(99)00046-9.
   Web of Science ®Google Scholar
• Craven, P., and G. Wahba. 1978. “Smoothing Noisy Data with Spline Functions.” Numerische Mathematik 31: 377–403. https://doi.org/10.1007/BF01404567.
   Web of Science ®Google Scholar
• Durrande, N., D. Ginsbourger, and O. Roustant. 2012. “Additive Covariance Kernels for High-Dimensional Gaussian Process Modeling.” Annales de la Faculté des Sciences de Toulouse: Mathématiques 21 (3): 481–499.
   Google Scholar
• Fernández-Martínez, J., and E. García-Gonzalo. 2008. “The Generalized PSO: A New Door to PSO Evolution.” Journal of Artificial Evolution and Applications 2008 (S1): 861275.
   Google Scholar
• Fernández-Martínez, J., and E. García-Gonzalo. 2009. “The PSO Family: Deduction, Stochastic Analysis and Comparison.” Swarm Intelligence 3: 245–273. https://doi.org/10.1007/s11721-009-0034-8.
   Google Scholar
• Gomes, H., and A. Awruch. 2004. “Comparison of Response Surface and Neural Network with Other Methods for Structural Reliability Analysis.” Structural Safety 26 (1): 49–67. https://doi.org/10.1016/S0167-4730(03)00022-5.
   Web of Science ®Google Scholar
• Gramacy, R., and H. Lee. 2011. “Optimization Under Unknown Constraints.” In Bayesian Statistics 9, 229–256. Oxford University Press. https://doi.org/10.1093/acprof:oso/9780199694587.003.0008.
   Google Scholar
• Hennig, P., and C. Schuler. 2012. “Entropy Search for Information-Efficient Global Optimization.” Journal of Machine Learning Research 13 (1): 1809–1837.
   Google Scholar
• Jing, Z., J. Chen, and X. Li. 2019. “RBF-GA: An Adaptive Radial Basis Function Metamodeling with Genetic Algorithm for Structural Reliability Analysis.” Reliability Engineering & System Safety 189: 42–57. https://doi.org/10.1016/j.ress.2019.03.005.
   Web of Science ®Google Scholar
• Jones, D., M. Schonlau, and W. Welch. 1998. “Efficient Global Optimization of Expensive Black-Box Functions.” Journal of Global Optimization 13 (4): 455–492. https://doi.org/10.1023/A:1008306431147.
   Web of Science ®Google Scholar
• Karaboga, D., and B. Akay. 2009. “A Comparative Study of Artificial Bee Colony Algorithm.” Applied Mathematics and Computation 214 (1): 108–132. https://doi.org/10.1016/j.amc.2009.03.090.
   Web of Science ®Google Scholar
• Kaveh, A., and M. Khayatazad. 2012. “A New Meta-heuristic Method: Ray Optimization.” Computers & Structures 112-113: 283–294. https://doi.org/10.1016/j.compstruc.2012.09.003.
   Web of Science ®Google Scholar
• Kaveh, A., and V. Mahdavi. 2014. “Colliding Bodies Optimization: A Novel Meta-heuristic Method.” Computers & Structures 139: 18–27. https://doi.org/10.1016/j.compstruc.2014.04.005.
   Web of Science ®Google Scholar
• Kaveh, A., and S. Talatahari. 2010. “Optimal Design of Skeletal Structures via the Charged System Search Algorithm.” Structural and Multidisciplinary Optimization 41: 893–911. https://doi.org/10.1007/s00158-009-0462-5.
   Web of Science ®Google Scholar
• Kennedy, J., and R. Eberhart. 2001. Swarm Intelligence. San Diego: Academic Press.
   Google Scholar
• Krige, D. 1951. “A Statistical Approach to Some Basic Mine Valuation Problems on the Witwatersrand.” Journal of the Southern African Institute of Mining and Metallurgy 52 (6): 119–139.
   Google Scholar
• Ku, K., S. Rao, and L. Chen. 1998. “Taguchi-Aided Search Method for Design Optimization of Engineering Systems.” Engineering Optimization 30 (1): 1–23. https://doi.org/10.1080/03052159808941235.
   Web of Science ®Google Scholar
• Kushner, H. 1964. “A New Method of Locating the Maximum Point of an Arbitrary Multipeak Curve in the Presence of Noise.” Journal of Basic Engineering 86 (1): 97–106. https://doi.org/10.1115/1.3653121.
   Google Scholar
• Le, H., and J. Branke. 2024. “Using the Knowledge Gradient Acquisition Function in Bayesian Optimization When Searching for Robust Solutions.” Engineering Optimization 56 (1): 36–53. https://doi.org/10.1080/0305215X.2022.2145604.
   Web of Science ®Google Scholar
• Li, J., and J. Chen. 2019. “Solving Time-Variant Reliability-Based Design Optimization by PSO-t-IRS: A Methodology Incorporating a Particle Swarm Optimization Algorithm and an Enhanced Instantaneous Response Surface.” Reliability Engineering & System Safety 191: 106580. https://doi.org/10.1016/j.ress.2019.106580.
   Web of Science ®Google Scholar
• Li, J., J. Chen, and Z. Chen. 2020. “Developing an Improved Composite Limit State Method for Time-Dependent Reliability Analysis.” Quality Engineering 32 (3): 298–311. https://doi.org/10.1080/08982112.2020.1735004.
   Web of Science ®Google Scholar
• Li, J., J. Chen, J. Wei, and X. Yang. 2022. “Temporal-Spatial Reliability Analysis of RC Bridges with Corroded Steel Reinforcement Bars.” Proceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science 236 (23): 11345–11357. https://doi.org/10.1177/09544062221105985.
   Web of Science ®Google Scholar
• Li, J., J. Chen, J. Wei, and X. Yang. 2023. “A Kriging-Based Important Region Sampling Method for Efficient Reliability Analysis.” Quality Technology and Quantitative Management 20 (3): 360–383. https://doi.org/10.1080/16843703.2022.2116265.
   Web of Science ®Google Scholar
• Li, J., J. Chen, J. Wei, X. Zhang, and B. Han. 2019. “Developing an Instantaneous Response Surface Method t-IRS for Time-Dependent Reliability Analysis.” Acta Mechanica Solida Sinica 32 (4): 446–462. https://doi.org/10.1007/s10338-019-00096-5.
   Web of Science ®Google Scholar
• Li, Z., W. Wang, Y. Yan, and Z. Li. 2015. “PS-ABC: A Hybrid Algorithm Based on Particle Swarm and Artificial Bee Colony for High-Dimensional Optimization Problems.” Expert Systems with Applications 42 (22): 8881–8895. https://doi.org/10.1016/j.eswa.2015.07.043.
   Web of Science ®Google Scholar
• Liu, Z., H. Huang, X. Xu, M. Xiong, and Q. Li. 2023. “An Efficient Global Optimization Algorithm Combining Revised Expectation Improvement Criteria and Kriging.” Engineering Optimization: 1–17. https://doi.org/10.1080/0305215X.2023.2170367.
   Web of Science ®Google Scholar
• Long, W., T. Wu, X. Liang, and S. Xu. 2019. “Solving High-Dimensional Global Optimization Problems Using an Improved Sine Cosine Algorithm.” Expert Systems with Applications 123: 108–126. https://doi.org/10.1016/j.eswa.2018.11.032.
   Web of Science ®Google Scholar
• Matheron, G. 1963. “Principles of Geostatistics.” Economic Geology 58 (8): 1246–1266. https://doi.org/10.2113/gsecongeo.58.8.1246.
   Google Scholar
• Mirjalili, S., and A. Lewis. 2016. “The Whale Optimization Algorithm.” Advances in Engineering Software 95: 51–67. https://doi.org/10.1016/j.advengsoft.2016.01.008.
   Web of Science ®Google Scholar
• Moriconi, R., M. Deisenroth, and K. Sesh Kumar. 2020. “High-Dimensional Bayesian Optimization Using Low-Dimensional Feature Spaces.” Machine Learning 109: 1925–1943. https://doi.org/10.1007/s10994-020-05899-z.
   Web of Science ®Google Scholar
• Raponi, E., M. Bujny, M. Olhofer, N. Aulig, S. Boria, and F. Duddeck. 2019. “Kriging-Assisted Topology Optimization of Crash Structures.” Computer Methods in Applied Mechanics and Engineering 348: 730–752. https://doi.org/10.1016/j.cma.2019.02.002.
   Web of Science ®Google Scholar
• Raponi, E., H. Wang, M. Bujny, S. Boria, and C. Doerr. 2020. “High Dimensional Bayesian Optimization Assisted by Principal Component Analysis.” In Parallel Problem Solving from Nature–PPSN XVI: 16th International Conference, PPSN 2020, Leiden, The Netherlands, September 5–9, 2020, Proceedings, Part I 16, 169–183. Springer International Publishing.
   Google Scholar
• Ray, T., and P. Saini. 2001. “Engineering Design Optimization Using a Swarm with Intelligent Information Sharing among Individuals.” Engineering Optimization 33 (6): 735–748. https://doi.org/10.1080/03052150108940941.
   Web of Science ®Google Scholar
• Regis, R. 2014. “Constrained Optimization by Radial Basis Function Interpolation for High-Dimensional Expensive Black-Box Problems with Infeasible Initial Points.” Engineering Optimization 46 (2): 218–243. https://doi.org/10.1080/0305215X.2013.765000.
   Web of Science ®Google Scholar
• Regis, R., and C. Shoemaker. 2013. “Combining Radial Basis Function Surrogates and Dynamic Coordinate Search in High-Dimensional Expensive Black-Box Optimization.” Engineering Optimization 45 (5): 529–555. https://doi.org/10.1080/0305215X.2012.687731.
   Web of Science ®Google Scholar
• Ringnér, M. 2008. “What is Principal Component Analysis.” Nature Biotechnology 26 (3): 303–304. https://doi.org/10.1038/nbt0308-303.
   PubMed Web of Science ®Google Scholar
• Roh, H., T. Hua, and R. Ahluwalia. 2013. “Optimization of Carbon Fiber Usage in Type 4 Hydrogen Storage Tanks for Fuel Cell Automobiles.” International Journal of Hydrogen Energy 38 (29): 12795–12802. https://doi.org/10.1016/j.ijhydene.2013.07.016.
   Web of Science ®Google Scholar
• Sakata, S., F. Ashida, and M. Zako. 2004. “An Efficient Algorithm for Kriging Approximation and Optimization with Large-Scale Sampling Data.” Computer Methods in Applied Mechanics and Engineering 193 (3): 385–404. https://doi.org/10.1016/j.cma.2003.10.006.
   Web of Science ®Google Scholar
• Scott, W., P. Frazier, and W. Powell. 2011. “The Correlated Knowledge Gradient for Simulation Optimization of Continuous Parameters Using Gaussian Process Regression.” SIAM Journal on Optimization 21 (3): 996–1026. https://doi.org/10.1137/100801275.
   Web of Science ®Google Scholar
• Snoek, J., O. Rippel, K. Swersky, et al. 2015. “Scalable Bayesian Optimization Using Deep Neural Networks.” ICML'15: Proceedings of the 32nd International Conference on International Conference on Machine Learning 37: 2171–2180.
   Google Scholar
• Sobester, A., S. Leary, and A. Keane. 2005. “On the Design of Optimization Strategies Based on Global Response Surface Approximation Models.” Journal of Global Optimization 33 (1): 31–59. https://doi.org/10.1007/s10898-004-6733-1.
   Web of Science ®Google Scholar
• Srinivas, N., A. Krause, S. Kakade, and M. Seeger. 2012. “Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting.” IEEE Transactions on Information Theory 58 (5): 3250–3265. https://doi.org/10.1109/TIT.2011.2182033.
   Web of Science ®Google Scholar
• Sun, C., Y. Jin, R. Cheng, J. Ding, and J. Zeng. 2017. “Surrogate-Assisted Cooperative Swarm Optimization of High-Dimensional Expensive Problems.” IEEE Transactions on Evolutionary Computation 21 (4): 644–660. https://doi.org/10.1109/TEVC.2017.2675628.
   Web of Science ®Google Scholar
• Tang, Y., J. Chen, and J. Wei. 2013. “A Surrogate-Based Particle Swarm Optimization Algorithm for Solving Optimization Problems with Expensive Black Box Functions.” Engineering Optimization 45 (5): 557–576. https://doi.org/10.1080/0305215X.2012.690759.
   Web of Science ®Google Scholar
• Tuo, S., L. Yong, F. Deng, Y. Li, Y. Lin, and Q. Lu. 2017. “HSTLBO: A Hybrid Algorithm Based on Harmony Search and Teaching-Learning-Based Optimization for Complex High-Dimensional Optimization Problems.” PLoS One 12 (4): e0175114.
   PubMed Web of Science ®Google Scholar
• Wang, H., S. Rahnamayan, and Z. Wu. 2013. “Parallel Differential Evolution with Self-Adapting Control Parameters and Generalized Opposition-Based Learning for Solving High-Dimensional Optimization Problems.” Journal of Parallel and Distributed Computing 73 (1): 62–73. https://doi.org/10.1016/j.jpdc.2012.02.019.
   Web of Science ®Google Scholar
• Wang, Z., M. Zoghi, F. Hutter, D. Matheson, and N. Freitas. 2013. “Bayesian Optimization in High Dimensions via Random Embeddings.” IJCAI ‘13: Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence 1778-1784.
   Google Scholar
• Xu, Z., Y. Guo, and J. Saleh. 2021. “Efficient Hybrid Bayesian Optimization Algorithm with Adaptive Expected Improvement Acquisition Function.” Engineering Optimization 53 (10): 1786–1804. https://doi.org/10.1080/0305215X.2020.1826467.
   Web of Science ®Google Scholar
• Yang, Z., H. Qiu, L. Gao, X. Cai, C. Jiang, and L. Chen. 2019. “A Surrogate-Assisted Particle Swarm Optimization Algorithm Based on Efficient Global Optimization for Expensive Black-Box Problems.” Engineering Optimization 51 (4): 549–566. https://doi.org/10.1080/0305215X.2018.1477940.
   Web of Science ®Google Scholar
• Zarachoff, M., A. Sheikh-Akbari, and D. Monekosso. 2022. “Non-decimated Wavelet Based Multi-band Ear Recognition Using Principal Component Analysis.” IEEE Access 10: 3949–3961. https://doi.org/10.1109/ACCESS.2021.3139684.
   Web of Science ®Google Scholar
• Zhang, X., J. Chen, and J. Wei. 2019. “Condition-Based Scheduled Maintenance Optimization of Structures Based on Reliability Requirements Under Continuous Degradation and Random Shocks.” Journal of Zhejiang University-SCIENCE A 20 (4): 272–289. https://doi.org/10.1631/jzus.A1800578.
   Web of Science ®Google Scholar
• Zhang, N., P. Wang, and H. Dong. 2019. “Research on High-Dimensional Model Representation with Various Metamodels.” Engineering Optimization 51 (8): 1336–1351. https://doi.org/10.1080/0305215X.2018.1521398.
   Web of Science ®Google Scholar
• Zhang, Y., and H. Xu. 2021. “Demixed Sparse Principal Component Analysis Through Hybrid Structural Regularizers.” IEEE Access 9: 103075–103090. https://doi.org/10.1109/ACCESS.2021.3098614.
   Web of Science ®Google Scholar