Multi-Agent Collaborative Bayesian Optimization via Constrained Gaussian Processes

Abstract

The increase in the computational power of edge devices has opened a new paradigm for collaborative analytics whereby agents borrow strength from each other to improve their learning capabilities. This work focuses on collaborative Bayesian optimization (BO), in which agents work together to efficiently optimize black-box functions without the need for sensitive data exchange. Our idea revolves around introducing a class of constrained Gaussian process surrogates, enabling agents to borrow informative designs from high-performing collaborators to enhance and expedite their optimization process. Our approach presents the first general-purpose collaborative BO framework that is compatible with any Gaussian process kernel and most of the known acquisition functions. Despite the simplicity of our approach, we demonstrate that it offers elegant theoretical guarantees and significantly outperforms state-of-the-art methods, especially when agents have heterogeneous black-box functions. Through various simulations and a real-life experiment in additive manufacturing, we showcase the advantageous properties of our approach and the benefits derived from collaboration.

Keywords:

• Collaborative Bayesian optimization
• Constrained Gaussian processes
• Federated learning

Disclosure Statement

The authors report there are no competing interests to declare.