214
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Adaptive confidence bound based Bayesian optimization via potentially optimal Lipschitz conditions

, , , , , & show all
Pages 2051-2069 | Received 23 Dec 2021, Accepted 08 Aug 2022, Published online: 24 Nov 2022

References

  • Amani, Sanae, Mahnoosh Alizadeh, and Christos Thrampoulidis. 2021. “Regret Bounds for Safe Gaussian Process Bandit Optimization.” In IEEE International Symposium on Information Theory, 527–532.
  • Bergstra, James, Rémi Bardenet, Yoshua Bengio, and Balázs Kégl. 2011. “Algorithms for Hyper-Parameter Optimization.” In Advances in Neural Information Processing Systems, Vol. 24, 2546–2554.
  • Berk, Julian, Sunil Gupta, Santu Rana, and Svetha Venkatesh. 2020. “Randomised Gaussian Process Upper Confidence Bound for Bayesian Optimisation.” In International Joint Conference on Artificial Intelligence, 2284–2290. Red Hook, NY: IJCAI Organization/Curran Associates. doi:10.24963/ijcai.2020/316.
  • Bonfiglio, L., P. Perdikaris, S. Brizzolara, and G. E. Karniadakis. 2018. “Multi-Fidelity Optimization of Super-Cavitating Hydrofoils.” Computer Methods in Applied Mechanics and Engineering 332: 63–85.
  • Brenes, Benjamín Monge. 2014. “Design of Supercritical Carbon Dioxide Centrifugal Compressors.” PhD diss., Universidad de Sevilla.
  • Brochu, Eric, Vlad M. Cora, and Nando de Freitas. 2010. “A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning.” arXiv: 1012.2599.
  • Cox, D. Dennis, and Susan John. 1992. “A Statistical Method for Global Optimization.” In IEEE International Conference on Systems, Man, and Cybernetics, 1241–1246. doi:10.1109/ICSMC.1992.271617.
  • Daxberger, Erik A., and Bryan Kian Hsiang Low. 2017. “Distributed Batch Gaussian Process Optimization.” In Proceedings of the 34th International Conference on Machine Learning (ICML'17), Vol. 70, 951–960. https://www.researchgate.net/publication/324068188_Distributed_Batch_Gaussian_Process_Optimization.
  • Frazier, Peter I., and Jialei Wang. 2016. “Bayesian Optimization for Materials Design.” Information Science for Materials Discovery and Design 225: 45–75.
  • Hennig, Philipp, and Christian J. Schuler. 2011. “Entropy Search for Information-Efficient Global Optimization.” Journal of Machine Learning Research 13 (9): 1809–1837.
  • Hutter, Frank, Holger H. Hoos, and Kevin Leyton-Brown. 2011. “Sequential Model-Based Optimization for General Algorithm Configuration.” In International Conference on Learning and Intelligent Optimization, 507–523. Lecture Notes in Computer Science book series, Vol. 6683. Berlin: Springer. doi:10.1007/978-3-642-25566-3_40.
  • Jones, Donald R. 2001. “A Taxonomy of Global Optimization Methods Based on Response Surfaces.” Journal of Global Optimization 21 (4): 345–383.
  • Jones, D. R., C. D. Perttunen, and B. E. Stuckman. 1993. “Lipschitzian Optimization Without the Lipschitz Constant.” Journal of Optimization Theory and Applications 79 (1): 157–181.
  • Jones, Donald R., Matthias Schonlau, and William J. Welch. 1998. “Efficient Global Optimization of Expensive Black-Box Functions.” Journal of Global Optimization 13 (4): 455–492.
  • Joy, Tinu Theckel, Santu Rana, Sunil Gupta, and Svetha Venkatesh. 2020. “Batch Bayesian Optimization Using Multi-Scale Search.” Knowledge Based Systems 187: Article ID 104818.
  • Kandasamy, Kirthevasan, Jeff Schneider, and Barnabas Poczos. 2015. “High Dimensional Bayesian Optimisation and Bandits via Additive Models.” In Proceedings of the 32nd International Conference on Machine Learning (ICML'15), Vol. 37, 295–304. PMLR.
  • Kennedy, J., and R. Eberhart. 1995. “Particle Swarm Optimization.” In Proceedings of the International Conference on Neural Networks, Vol. 4, 1942–1948. Piscataway, NJ: IEEE. doi:10.1109/ICNN.1995.488968.
  • Kushner, Harold J. 1964. “A New Method of Locating the Maximum Point of An Arbitrary Multipeak Curve in the Presence of Noise.” Journal of Basic Engineering 86 (1): 97–106.
  • Liu, Haitao, Shengli Xu, Ying Ma, and Xiaofang Wang. 2015. “Global Optimization of Expensive Black Box Functions Using Potential Lipschitz Constants and Response Surfaces.” Journal of Global Optimization 63 (2): 229–251.
  • Loeppky, Jason L., Jerome Sacks, and William J. Welch. 2009. “Choosing the Sample Size of a Computer Experiment: A Practical Guide.” Technometrics 51 (4): 366–376.
  • Parr, James. 2013. “Improvement Criteria for Constraint Handling and Multiobjective Optimization.” PhD diss., University of Southampton.
  • Parr, J. M., A. J. Keane, A. I. J. Forrester, and C. M. E. Holden. 2012. “Infill Sampling Criteria for Surrogate-Based Optimization with Constraint Handling.” Engineering Optimization 44 (10): 1147–1166.
  • Rasmussen, Carl Edward, and Christopher K. I. Williams. 2005. Gaussian Processes for Machine Learning. Cambridge, MA: MIT Press. doi:10.7551/mitpress/3206.001.0001
  • Shahriari, Bobak, Kevin Swersky, Ziyu Wang, Ryan P. Adams, and Nando de Freitas. 2016. “Taking the Human Out of the Loop: A Review of Bayesian Optimization.” Proceedings of the IEEE 104 (1): 148–175.
  • Shao, Wenyang, Juan Du, Jinguang Yang, Xiaofang Wang, and Guochuan Lyu. 2021. “Investigation on One-Dimensional Loss Models for Predicting Performance of Multistage Centrifugal Compressors in Supercritical CO 2 Brayton Cycle.” Journal of Thermal Science 30 (1): 133–148.
  • Shields, Benjamin J., Jason Stevens, Jun Li, Marvin Parasram, Farhan Damani, Jesus I. Martinez Alvarado, Jacob M. Janey, Ryan P. Adams, and Abigail G. Doyle. 2021. “Bayesian Reaction Optimization As a Tool for Chemical Synthesis.” Nature 590 (7844): 89–96.
  • Snoek, Jasper, Oren Rippel, Kevin Swersky, Ryan Kiros, Nadathur Satish, Narayanan Sundaram, Mostofa Patwary, and Prabhat Ryan Adams. 2015. “Scalable Bayesian Optimization Using Deep Neural Networks.” In Proceedings of the 32nd International Conference on Machine Learning (ICML'15), Vol. 37, 2171–2180. PMLR. http://proceedings.mlr.press/v37/snoek15.html.
  • Srinivas, Niranjan, Andreas Krause, Matthias Seeger, and Sham M. Kakade. 2010. “Gaussian Process Optimization in the Bandit Setting: No Regret and Experimental Design.” In Proceedings of the 27th International Conference on Machine Learning, 1015–1022. https://icml.cc/Conferences/2010/papers/422.pdf.
  • Tran, Anh, Jing Sun, John M. Furlan, V. Pagalthivarthi, Robert J. Visintainer, and Yan Wang. 2019. “pBO-2GP-3B: A Batch Parallel Known/Unknown Constrained Bayesian Optimization with Feasibility Classification and Its Applications in Computational Fluid Dynamics.” Computer Methods in Applied Mechanics and Engineering 347: 827–852.
  • Viana, Felipe A. C., Gerhard Venter, and Vladimir Balabanov. 2010. “An Algorithm for Fast Optimal Latin Hypercube Design of Experiments.” International Journal for Numerical Methods in Engineering82 (2): 135–156.
  • Wright, Steven Alan, Thomas M. Conboy, Ross F. Radel, and Gary Eugene Rochau. 2011. Modeling and Experimental Results for Condensing Supercritical CO 2 Power Cycles. SANDIA Report SAND2010-8840. Sandia National Laboratories (SNL), Albuquerque, NM, and Livermore, CA. doi:10.2172/1030354.
  • Xu, Zhaoyi, Yanjie Guo, and Joseph H. Saleh. 2021. “Efficient Hybrid Bayesian Optimization Algorithm with Adaptive Expected Improvement Acquisition Function.” Engineering Optimization 53 (10): 1786–1804.
  • Zheng, Jun, Chunhua Lu, Zilong Li, Guosheng Jiang, and Huibin Zhao. 2022. “Adaptive Metamodel-Based Analytical Target Cascading for Natural Gas Hydrates Coring Tool Design Optimization.” Engineering Optimization 54 (7): 1089–1109.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.