A generalizable hybrid search framework for optimizing expensive design problems using surrogate models

ABSTRACT

Experimental optimization of physical and biological processes is a difficult task. To address this, sequential surrogate models combined with search algorithms have been employed to solve nonlinear high-dimensional design problems with expensive objective function evaluations. In this article, a hybrid surrogate framework was built to learn the optimal parameters of a diverse set of simulated design problems meant to represent real-world physical and biological processes in both dimensionality and nonlinearity. The framework uses a hybrid radial basis function/genetic algorithm with dynamic coordinate search response, utilizing the strengths of both algorithms. The new hybrid method performs at least as well as its constituent algorithms in 19 of 20 high-dimensional test functions, making it a very practical surrogate framework for a wide variety of optimization design problems. Experiments also show that the hybrid framework can be improved even more when optimizing processes with simulated noise.

KEYWORDS:

• Hybrid surrogate
• meta-modelling
• DYCORS
• experimental optimization
• radial basis function

Disclosure statement

No potential conflict of interest was reported by the authors.

Additional information

Funding

This work was supported by New Harvest Inc. Graduate Fellowship Program [grant A19-4213] and the Ernest Gallo Endowed Chair in Viticulture and Enology.