Multi-Agent Collaborative Bayesian Optimization via Constrained Gaussian Processes

References

• Attia, P. M., Grover, A., Jin, N., Severson, K. A., Markov, T. M., Liao, Y.-H., Chen, M. H., Cheong, B., Perkins, N., Yang, Z., et al. (2020), “Closed-Loop Optimization of Fast-Charging Protocols for Batteries with Machine Learning,” Nature, 578, 397–402. DOI: 10.1038/s41586-020-1994-5.
   PubMed Web of Science ®Google Scholar
• Azimi, J., Fern, A., and Fern, X. (2010), “Batch Bayesian Optimization via Simulation Matching,” in Advances in Neural Information Processing Systems (Vol. 23).
   Google Scholar
• Bai, T., Li, Y., Shen, Y., Zhang, X., Zhang, W., and Cui, B. (2023), “Transfer Learning for Bayesian Optimization: A Survey,” arXiv preprint arXiv:2302.05927.
   Google Scholar
• Balandat, M., Karrer, B., Jiang, D., Daulton, S., Letham, B., Wilson, A. G., and Bakshy, E. (2020), “Botorch: A Framework for Efficient Monte-Carlo Bayesian Optimization,” in Advances in Neural Information Processing Systems (Vol. 33), pp. 21524–21538.
   Google Scholar
• Chowdhury, S. R., and Gopalan, A. (2017), “On Kernelized Multi-Armed Bandits,” in International Conference on Machine Learning, pp. 844–853, PMLR.
   Google Scholar
• Dai, Z., Low, B. K. H., and Jaillet, P. (2020), “Federated Byesian Optimization via Thompson Sampling,” in Advances in Neural Information Processing Systems (Vol. 33), pp. 9687–9699.
   Google Scholar
• —- (2021), “Differentially Private Federated Bayesian Optimization with Distributed Exploration,” in Advances in Neural Information Processing Systems (Vol. 34), pp. 9125–9139.
   Google Scholar
• Daulton, S., Cakmak, S., Balandat, M., Osborne, M. A., Zhou, E., and Bakshy, E. (2022), “Robust Multi-Objective Bayesian Optimization Under Input Noise,” in International Conference on Machine Learning, pp. 4831–4866, PMLR.
   Google Scholar
• Duan, W., Ankenman, B. E., Sanchez, S. M., and Sanchez, P. J. (2017), “Sliced Full Factorial-based Latin Hypercube Designs as a Framework for a Batch Sequential Design Algorithm,” Technometrics, 59, 11–22. DOI: 10.1080/00401706.2015.1108233.
   Web of Science ®Google Scholar
• Duris, J., Kennedy, D., Hanuka, A., Shtalenkova, J., Edelen, A., Baxevanis, P., Egger, A., Cope, T., McIntire, M., Ermon, S., et al. (2020), “Bayesian Optimization of a Free-Electron Laser,” Physical Review Letters, 124, 124801. DOI: 10.1103/PhysRevLett.124.124801.
   PubMed Web of Science ®Google Scholar
• Friedman, M., and Savage, L., (1947), “Planning Experiments Seeking Maxima,” in Selected Techniques of Statistical Analysis for Scientific and Industrial Research, and Production and Management Engineering, pp. 363–372.
   Google Scholar
• Gongora, A. E., Xu, B., Perry, W., Okoye, C., Riley, P., Reyes, K. G., Morgan, E. F., and Brown, K. A. (2020), “A Bayesian Experimental Autonomous Researcher for Mechanical Design,” Science Advances, 6, eaaz1708. DOI: 10.1126/sciadv.aaz1708.
   PubMed Web of Science ®Google Scholar
• Gonzalez, J., Longworth, J., James, D. C., and Lawrence, N. D. (2015), “Bayesian Optimization for Synthetic Gene Design,” arXiv preprint arXiv:1505.01627.
   Google Scholar
• Gramacy, R. B. (2020), Surrogates: Gaussian Process Modeling, Design, and Optimization for the Applied Sciences, Boca Raton, FL: CRC Press.
   Google Scholar
• Hotelling, H. (1941), “Experimental Determination of the Maximum of a Function,” The Annals of Mathematical Statistics, 12, 20–45. DOI: 10.1214/aoms/1177731784.
   Google Scholar
• Hunt, N. (2020), “Batch Bayesian Optimization,” PhD thesis, Massachusetts Institute of Technology.
   Google Scholar
• Irshad, F., Karsch, S., and Döpp, A. (2021), “Expected Hypervolume Improvement for Simultaneous Multi-Objective and Multi-Fidelity Optimization,” arXiv preprint arXiv:2112.13901.
   Google Scholar
• Jones, D. R., Schonlau, M., and Welch, W. J. (1998), “Efficient Global Optimization of Expensive Black-Box Functions,” Journal of Global Optimization, 13, 455–492. DOI: 10.1023/A:1008306431147.
   Web of Science ®Google Scholar
• Kontar, R., Shi, N., Yue, X., Chung, S., Byon, E., Chowdhury, M., Jin, J., Kontar, W., Masoud, N., Nouiehed, M., et al. (2021), “The Internet of Federated Things (ioft),” IEEE Access, 9, 156071–156113. DOI: 10.1109/ACCESS.2021.3127448.
   Google Scholar
• Kushner, H. J. (1963), “A New Method of Locating the Maximum Point of an Arbitrary Multipeak Curve in the Presence of Noise,” in Joint Automatic Control Conference, pp. 69–79.
   Google Scholar
• Letham, B., Karrer, B., Ottoni, G., and Bakshy, E. (2019), “Constrained Bayesian Optimization with Noisy Experiments,” Bayesian Analysis, 14, 495–519 DOI: 10.1214/18-BA1110.
   Web of Science ®Google Scholar
• Matheron, G. (1963), “Principles of Geostatistics,” Economic Geology, 58, 1246–1266. DOI: 10.2113/gsecongeo.58.8.1246.
   Google Scholar
• McKay, M. D., Beckman, R. J., and Conover, W. J. (1979), “A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output from a Computer Code,” Technometrics, 21, 239–245. DOI: 10.2307/1268522.
   Web of Science ®Google Scholar
• Moriconi, R., Deisenroth, M. P., and Sesh Kumar, K. (2020), “High-Dimensional Bayesian Optimization Using Low-Dimensional Feature Spaces,” Machine Learning, 109, 1925–1943. DOI: 10.1007/s10994-020-05899-z.
   Web of Science ®Google Scholar
• Raiffa, H., and Schlaifer, R. (1961), Applied Statistical Decision Theory, Boston: Harvard University.
   Google Scholar
• Rasmussen, C. (1999), “The Infinite Gaussian Mixture Model,” in Advances in Neural Information Processing Systems (Vol. 12).
   Google Scholar
• Shields, B. J., Stevens, J., Li, J., Parasram, M., Damani, F., Alvarado, J. I. M., Janey, J. M., Adams, R. P., and Doyle, A. G. (2021), “Bayesian Reaction Optimization as a Tool for Chemical Synthesis,” Nature, 590, 89–96. DOI: 10.1038/s41586-021-03213-y.
   PubMed Web of Science ®Google Scholar
• Srinivas, N., Krause, A., Kakade, S. M., and Seeger, M. (2009), “Gaussian Process Optimization in the Bandit Setting: No Regret and Experimental Design,” arXiv preprint arXiv:0912.3995.
   Google Scholar
• Thompson, W. R. (1933), “On the Likelihood that One Unknown Probability Exceeds Another in View of the Evidence of Two Samples,” Biometrika, 25, 285–294. DOI: 10.1093/biomet/25.3-4.285.
   Google Scholar
• Wang, Z., and Jegelka, S. (2017), “Max-Value Entropy Search for Efficient Bayesian Optimization,” in International Conference on Machine Learning, pp. 3627–3635, PMLR.
   Google Scholar
• Wilson, J. T., Moriconi, R., Hutter, F., and Deisenroth, M. P. (2017), “The Reparameterization Trick for Acquisition Functions,” arXiv preprint arXiv:1712.00424.
   Google Scholar
• Wu, J., and Frazier, P. (2016), “The Parallel Knowledge Gradient Method for Batch Bayesian Optimization,” in Advances in Neural Information Processing Systems (Vol. 29).
   PubMedGoogle Scholar
• Yao, A. C. (1982), “Protocols for Secure Computations,” in 23rd Annual Symposium on Foundations of Computer Science (SFCS 1982), pp. 160–164, IEEE. DOI: 10.1109/SFCS.1982.38.
   Google Scholar