Trends, features, and tests of common and recently introduced global optimization methods

References

• Bagley , J. D. 1967 . The behavior of adaptive systems which employ genetic and correlation algorithms , University of Michigan . Thesis (PhD)
   Google Scholar
• Barton , R. R. Meta-models for simulation input-output relations . Proceedings of the 30th conference on Winter simulation . December 13–16 , Washington D.C, USA. pp. 167 – 176 . Washington, D.C : IEEE Press .
   Google Scholar
• Barton , R. R. and Ivery , J. S. 1996 . Nelder-Mead simplex modifications for simulation optimization . Management Science , 42 ( 7 ) : 954 – 973 .
   Web of Science ®Google Scholar
• Bjorkman , M. and Holmstrom , K. 2000 . Global optimization of costly nonconvex functions using radial basis functions . Engineering Optimization , 1 ( 4 ) : 373 – 397 .
   Web of Science ®Google Scholar
• Boggs , P. T. 1995 . Sequential quadratic programming . Acta Numerica, , 4 : 1 – 52 .
   Google Scholar
• Booker , A. J. , Dennis , J. E. , Frank , P. D. , Serafini , D. B. , Toroczon , V. and Tosset , M. W. 1999 . A rigorous framework for optimization of expensive functions by surrogates . Structural Optimization , 17 ( 1 ) : 1 – 13 .
   Web of Science ®Google Scholar
• Box , G. E.P. and Draper , N. R. 1987 . Empirical model-building and response surfaces , New York : John Wiley & Sons Inc .
   Google Scholar
• Box , G. E.P. and Wilson , K. B. 1951 . On the experimental attainment of optimum conditions . Journal of the Royal Statistics Society , 13 : 1 – 45 .
   Google Scholar
• Cioppa , T. M. and Lucas , T. W. 2007 . Efficient nearly orthogonal and space filling Latin hypercubes . Technometrics , 49 ( 1 ) : 45 – 55 .
   Web of Science ®Google Scholar
• Clarke , S. M. , Griebsch , J. H. and Simpson , T. W. 2005 . Analysis of support vector regression for approximation of complex engineering analyses . Journal of Mechanical Design , 127 : 1077 – 1087 .
   Web of Science ®Google Scholar
• Conn , A. R. , Scheinberg , K. and Toint , P. L. 1997 . Recent progress in unconstrained non-linear optimization without derivatives . Mathematical Programming , 79 ( 3 ) : 397 – 414 .
   Web of Science ®Google Scholar
• Cressie , N. 1988 . Spatial prediction and ordinary Kriging . Mathematical Geology , 20 ( 4 ) : 405 – 421 .
   Google Scholar
• Dantzig , G. B. 1948 . “ Linear programming ” . In In: History of mathematical programming, a collection of personal reminiscences , 19 – 31 . Oxford : Elsevier Science .
   Google Scholar
• Dennis , J. E. and Torczon , V. 1991 . Direct search methods on parallel machines . Journal on Optimization , 1 ( 4 ) : 448 – 474 .
   Web of Science ®Google Scholar
• Dorigo , M. 1992 . Optimization, learning and natural algorithms , Italy : Politecnico di Milano . Thesis (PhD)
   Google Scholar
• Dorigo , M. , Maniezzo , V. and Colorni , A. 1996 . Ant system: Optimization by cooperating a colony agent . IEEE Transactions on Systems, Man, and Cybernetics – Part B Cybernetics , 26 ( 1 ) : 29 – 41 .
   PubMed Web of Science ®Google Scholar
• Dyn , N. , Levin , D. and Rippa , S. 1986 . Numerical procedures for surface fitting of scattered data by radial functions . SIAM Journal of Scientific and Statistical Computing , 7 ( 2 ) : 639 – 659 .
   Web of Science ®Google Scholar
• Fang , K.-T. , Lin , D. K.J. , Winker , P. and Zhang , Y. 2000 . Uniform design: Theory and application . Technometrics , 42 ( 3 ) : 237 – 248 .
   Web of Science ®Google Scholar
• Fang , K. T. and Wang , Y. 1994 . Number-theoretic methods in statistics , London : Chapman & Hall .
   Google Scholar
• Gablonsky , J. M. and Kelley , C. T. 2001 . A locally-biased form of the DIRECT algorithm . Journal of Global Optimization , 21 : 27 – 37 .
   Web of Science ®Google Scholar
• Glover , F. 1989 . Tabu search 1 . ORSA Journal on Computing , 1 ( 3 ) : 190 – 206 .
   Google Scholar
• Goldberg , D. E. 1989 . Genetic algorithms in search, optimization, and machine learning , New York : Addison-Wesley .
   Google Scholar
• Gutmann , H. M. 2001 . A radial basis function for global optimization . Journal of Global Optimization , 19 ( 3 ) : 201 – 227 .
   Web of Science ®Google Scholar
• Hardy , R. L. 1971 . Multiquadratic equations of topography and other irregular surfaces . Journal of Geophysical Research , 76 : 1905 – 1915 .
   Web of Science ®Google Scholar
• Hedayat , A. S. , Sloane , N. J.A. and Stuftken , J. 1999 . Orthogonal arrays, theory and applications , New York : Springer .
   Google Scholar
• Holland , J. H. 1975 . Adaptation in natural and artificial systems , Ann Arbor, MI : University of Michigan Press .
   Google Scholar
• Ingber , L. 1995 . “ Adaptive simulated annealing (ASA) ” . ASA – User Manual http://www.ugber.com
   Google Scholar
• Ishikawa , T. , Tsukui , Y. and Matsunami , M. 1999 . A combined method for the global optimization using radial basis function and deterministic approach . IEEE Transactions on Magnetics , 35 ( 3 ) : 1730 – 1733 .
   Web of Science ®Google Scholar
• Jin , R. , Chen , W. and Simpson , T. W. 2001 . Comparative studies of metamodelling techniques under multiple modelling criteria . Strcutural and Multidisiciplinary Optimization , 23 ( 1 ) : 1 – 13 .
   Web of Science ®Google Scholar
• Jones , D. R. 2001 . The DIRECT global optimization algorithm . Encyclopaedia of Optimization , 1 : 431 – 440 .
   Google Scholar
• Jones , D. R. , Schonlau , M. and Welch , W. J. 1998 . Efficient global optimization of expensive black-box functions . Journal of Global Optimization , 13 ( 4 ) : 455 – 492 .
   Web of Science ®Google Scholar
• Kalagnanam , J. R. and Diwekar , U. M. 1997 . An efficient sampling technique for off-line quality control . Technometrics , 39 ( 3 ) : 308 – 319 .
   Web of Science ®Google Scholar
• Karmarkar , N. 1984 . A new polynomial-time algorithm for linear programming . Combinatorica , 4 : 373 – 395 .
   Web of Science ®Google Scholar
• Kennedy , J. and Eberhart , R. C. Particle swarm optimization . IEEE international conference on neural networks . pp. 1783 – 1793 . Perth Piscataway NJ: IEEE Service Center
   Google Scholar
• Kingre , H. 2004 . Bezier curve for metamodelling of simulation output , Louisiana State University and Agricultural and Mechanical College . Thesis (Master)
   Google Scholar
• Kirkpatrick , S. , Gelatt , C. D. and Vecchi , M. P. 1983 . Optimization by simulated annealing . Science , 220 : 671 – 680 .
   PubMed Web of Science ®Google Scholar
• Kushner , H. J. 1964 . A new method of locating the maximum point on an arbitrary multipeak curve in the presence of noise . Journal of Basic Engineering , 86 : 97 – 106 .
   Google Scholar
• Mahdi , N. and Mansooreh , M. The development of a methodology for the use of neural networks and simulation modelling in system design . Winter simulation conference . December 5–8 , Phoenix, AZ. Vol. 1 , pp. 537 – 542 .
   Google Scholar
• Martin , F. T.S. and Gonzales , A. P. 2003 . Global optimization in path synthesis based on design space reduction . Mechanics and Machine Theory , 38 : 579 – 594 .
   Web of Science ®Google Scholar
• Mckay , M. D. , Bechman , R. J. and Conver , W. J. 1979 . A comparison of three methods for selecting values of input variables in the analysis techniques for computer codes . Technometrics , 21 ( 2 ) : 239 – 245 .
   Web of Science ®Google Scholar
• Melo , V. V.D. , Delbem , A. C.B. , Junior , D. L.P. and Federson , F. M. Improving global numerical optimization using a search-space reduction algorithm . GECCO’07 . July 7–11 , London, UK. pp. 1195 – 1202 . New York : ACM Press .
   Google Scholar
• Mitchell , T. J. 1974 . An algorithm for the construction of (D-optimal) experimental designs . Technometrics , 16 ( 2 ) : 203 – 210 .
   Web of Science ®Google Scholar
• Montgomery , D. C. 2001 . Design and analysis of experiments , 5 , New York, NY : John Wiley & Sons Inc .
   Google Scholar
• Myers , R. H. and Montgomery , D. C. 1995 . Response surface methodology , New York, NY : John Wiley & Sons, Inc .
   Google Scholar
• Nelder , J. A. and Mead , R. 1965 . A simplex method for function minimization . The Computer Journal , 7 : 308 – 313 .
   Web of Science ®Google Scholar
• Pettunen , C. D. , Jones , D. R. and Stuckman , B. E. 1993 . Lipschitzian optimization without the Lipschitz constant . Journal of Optimization Theory and Application , 79 ( 1 ) : 157 – 181 .
   Web of Science ®Google Scholar
• Powell , M. J.D. 1987 . Radial basis functions for multivariable interpolation: A review , Oxford : Clarendon Press .
   Google Scholar
• Powell , M. J.D. 2000 . UOBYQA: Unconstrained optimization by quadratic approximation . Mathematical Programming , 92 : 555 – 582 .
   Web of Science ®Google Scholar
• Rahimi-Vahed , A. R. , Migghorbani , S. M. and Rabbani , M. 2007 . A hybrid multi-objective particle algorithm for a mixed-model assembly line sequencing problem . Engineering Optimization , 39 ( 8 ) : 877 – 898 .
   Web of Science ®Google Scholar
• Rutenbar , R. A. 1989 . Simulated annealing algorithms: An overview . IEEE Circuits and Devices , : 19 – 26 .
   Web of Science ®Google Scholar
• Sacks , J. , Schiller , S. B. and Welch , W. J. 1989 . Designs for computer experiments . Technometrics , 31 ( 1 ) : 41 – 47 .
   Web of Science ®Google Scholar
• Sasena , M. J. 1998 . Optimization of computer simulations via smoothing splines and Kriging meta-models , University of Michigan . Thesis (Master)
   Google Scholar
• Shan , S. and Wang , G. G. 2004 . Space exploration and global optimization for computationally intensive design problems: A rough set based approach . Structural Multidisciplinary Optimization , 28 : 427 – 441 .
   Web of Science ®Google Scholar
• Simpson , T. W. , Manuery , T. M. , Korte , J. J. and Mistree , F. 1998 . Comparison of response surface and Kriging models for multidisplinary design optimization . AIAA Journal , 39 ( 12 ) : 2233 – 2241 .
   Web of Science ®Google Scholar
• Simpson , T. W. , Pepliniski , J. D. , Koch , P. N. and Allen , J. K. 2001 . Metamodelling for computer-based engineering design: Survey and recommendations . Engineering with computers , 17 : 129 – 150 .
   Web of Science ®Google Scholar
• Sundermann , E. and Lemahieu , I. 1996 . PET image reconstruction using simulated annealing , Belgium : University of Ghent .
   Google Scholar
• Tang , B. 1993 . Orthogonal array based Latin hypercubes . Journal of American Statistical Association , 88 ( 424 ) : 1392 – 1397 .
   Web of Science ®Google Scholar
• Toksari , M. D. 2006 . Ant colony optimization for finding the global minimum . Applied Mathematics and Computation , 176 : 308 – 316 .
   Web of Science ®Google Scholar
• Turner , C. J. , Crawford , R. H. and Campbell , M. I. 2007 . Global optimization of NURBS-based meta-models . Global Optimization , 29 ( 3 ) : 245 – 269 .
   Google Scholar
• Wang , G. 2003 . Adaptive response surface method using inherited Latin hypercube design points . Journal of Mechanical Engineering , 125 : 210 – 220 .
   Google Scholar
• Wang , G. , Goodman , E. and Punch , W. F. Towards the optimization of A class black box optimization algorithms . In 9th IEEE International Conference . November 2–8 , Newport Beach, CA. pp. 348 – 356 . New York : IEEE Press .
   Google Scholar
• Wang , G. G. , Dong , Z. and Aitchison , P. 2001 . Adaptive response surface method – A global optimization scheme for approximation based design problems . Journal of Mechanical Engineering , 33 : 707 – 733 .
   Google Scholar
• Wang , G. G. and Simpson , T. W. 2004 . Fuzzy clustering based hierarchical metamodelling for space reduction and design optimization . Engineering Optimization , 36 ( 3 ) : 313 – 335 .
   Web of Science ®Google Scholar
• Wang , L. , Shan , S. and Wang , G. G. 2004 . Mode-pursuing sampling method for global optimization on expensive black-box functions . Engineering Optimization , 36 ( 4 ) : 419 – 438 .
   Web of Science ®Google Scholar
• Younis , A. A. , Xu , R. and Dong , Z. 2009 . Approximated unimodal region elimination based global optimization method for engineering design . International Journal of Product Development , 9 ( 1/2/3 ) : 164 – 187 .
   Google Scholar
• Zhang , H. and Chen , Z. C. Optimal tool size determination for NURBS profile milling by using particle swarm optimization method . In Proceedings of ASME International Conference on Manufacturing Science and Engineering . October 8–11 , Ypsilanti, MI, USA. New York : ASME Press .
   Google Scholar
• Zhuge , Q. , Xue , C. , Shao , Z. , Liu , M. , Qiu , M. and Sha , E. H.-M. 2006 . Design optimization and space minimization considering timing and code size via retiming and unfolding . Microprocessors and Microsystems , 30 : 173 – 183 .
   Web of Science ®Google Scholar
• Zilinskas , A. 1980 . MINUN – optimization of one-dimensional multimodal functions in the presence of noise . Aplikace Matematiky , 25 : 392 – 402 .
   Google Scholar
• Zuhaimy , I. and Ibrahim , W. R.W. 2008 . Travelling salesman approach for solving petrol distribution using simulated annealing . American Journal of Applied Sciences , 5 ( 11 ) : 1543 – 1546 .
   Google Scholar