Asynchronous parallel hybrid optimization combining DIRECT and GSS

References

• Alba , E. 2005 . Parallel Metaheuristics , Edited by: Alba , E. Hoboken, NJ : John Wiley & Sons .
   Google Scholar
• Audet , C. , Béchard , V. and Le Digabel , S. 2008 . Nonsmooth optimization through mesh adaptive direct search and variable neighborhood search . J. Global Optim. , 41 ( 2 ) : 299 – 318 .
   Web of Science ®Google Scholar
• Bartholomew-Biggs , M. C. , Parkhurst , S. C. and Wilson , S. R. Global optimization – stochastic or deterministic? . SAGA 2003: 2nd International Symposium on Stochastic Algorithms . Edited by: Albrecht , A. and Steinhofel , K. Vol. 2827 , pp. 125 – 137 . Berlin/Heidelberg : Springer-Verlag . Lecture Notes in Computer Science
   Google Scholar
• Björkman , M. and Holmström , K. 1999 . Global optimization using the DIRECT algorithm in Matlab . Adv. Model. Optim. , 2 ( 2 ) : 17 – 37 .
   Google Scholar
• Booker , A. J. , Dennis , J. E. Jr. , Frank , P. D. , Serafini , D. B. , Torczon , V. and Trosset , M. W. 1999 . A rigorous framework for optimization of expensive functions by surrogates . Struct. Multidiscip. Optim. , 17 ( 1 ) : 1 – 13 .
   Web of Science ®Google Scholar
• Castro , J. P. , Gray , G. A. , Giunta , A. A. and Hough , P. D. 2005 . “ Developing a computationally efficient dynamic multilevel hybrid optimization scheme using multifidelity model interactions ” . Livermore, CA : Sandia National Laboratories . Tech. Rep. SAND2005-7498
   Google Scholar
• Chernyshenko , S. I. and Privalov , A. V. 2004 . Internal degrees of freedom of an actuator disk model . J. Propul. Power , 20 ( 1 ) : 155 – 163 .
   Google Scholar
• Chiesa , M. L. , Jones , R. E. , Perano , K. J. and Kolda , T. G. Parallel optimization of forging processes for optimal material properties . AIP Conference Proceedings . NUMIFORM 2004: The 8th International Conference on Numerical Methods in Industrial Forming Processes , Vol. 712 , pp. 2080 – 2084 .
   Google Scholar
• Chiter , L. 2006 . DIRECT algorithm: A new definition of potentially optimal hyperrectangles . Appl. Math. Comput. , 179 ( 2 ) : 742 – 749 .
   Google Scholar
• S.E. Cox, W.E. Hart, R. Haftka, and L. Watson, DIRECT algorithm with box penetration for improved local convergence: 9th AIAA/ISSMO Symposium on Multidisciplinary Analysis and Optimization, AIAA-2002-5581, 2002
   Google Scholar
• Dixon , L. C. W. and Szego , G. P. 1978 . “ The global optimization problem: An introduction ” . In Towards Global Optimization , 1 – 15 . North-Holland Publishing Company .
   Google Scholar
• Eitrich , T. and Lang , B. 2006 . Efficient optimization of support vector machine learning parameters for unbalanced datasets . J. Comput. Appl. Math. , 196 : 425 – 436 .
   Web of Science ®Google Scholar
• Fan , S.-K. S. and Zahara , E. 2007 . A hybrid simplex search and particle swarm optimization for unconstrained optimization . Eur. J. Oper. Res. , 181 ( 2 ) : 527 – 548 .
   Web of Science ®Google Scholar
• Fang , K.-T. , Li , R. and Sudjianto , A. 2005 . Design and Modeling for Computer Experiments (Computer Science and Data Analysis) , Chapman & Hall/CRC .
   Google Scholar
• Finkel , D. E. and Kelley , C. T. 2004 . “ An adaptive restart implementation of DIRECT ” . Raleigh, CA : Center for Research in Scientific Computation, North Carolina State University . Tech. Rep. CRSC-TR04-30
   Google Scholar
• Finkel , D. E. and Kelley , C. T. 2004 . “ Convergence analysis of the DIRECT algorithm ” . Raleigh, CA : Center for Research in Scientific Computation, North Carolina State University . Tech. Rep. CRSC-TR04-28
   Google Scholar
• Finkel , D. E. and Kelley , C. T. 2006 . Additive scaling and the DIRECT algorithm . J. Global Optim. , 36 ( 4 ) : 597 – 608 .
   Google Scholar
• Fowler , K. R. , Reese , J. P. , Kees , C. E. , Dennis , J. E. Jr. , Kelley , C. T. , Miller , C. T. , Audet , C. , Booker , A. J. , Couture , G. , Darwin , R. W. , Farthing , M. W. , Finkel , D. E. , Gablonsky , J. M. , Gray , G. and Kolda , T. G. 2008 . A comparison of derivative-free optimization methods for groundwater supply and hydraulic capture community problems . Ad. Water Resour. , 31 ( 5 ) : 743 – 757 .
   Web of Science ®Google Scholar
• Gablonsky , J. 2001 . “ Fortran code for DIRECT ” . Available at http://www4.ncsu.edu/~ctk/SOFTWARE/DIRECTv204.tar.gz
   Google Scholar
• Gablonsky , J. M. 2001 . “ Modifications of the DIRECT algorithm ” . North Carolina State University . Ph.D. thesis
   Google Scholar
• Gablonsky , J. M. and Kelley , C. T. 2001 . A locally-biased form of the DIRECT algorithm . J. Global Optim. , 21 ( 1 ) : 27 – 37 .
   Web of Science ®Google Scholar
• Goldberg , N. , Kolda , T. G. and Yoshimura , A. S. 2008 . “ Concurrent optimization with DUET: DIRECT using external trial points ” . Livermore, CA : Sandia National Laboratories . Tech. Rep. SAND2008-5844
   Google Scholar
• Gray , G. A. and Kolda , T. G. 2006 . Algorithm 856: APPSPACK 4.0: Asynchronous parallel pattern search for derivative-free optimization . ACM Tran. Math. Software , 32 ( 3 ) : 485 – 507 .
   Web of Science ®Google Scholar
• Gray , G. A. , Kolda , T. G. , Sale , K. L. and Young , M. M. 2004 . Optimizing an empirical scoring function for transmembrane protein structure determination . INFORMS J. Comput. , 16 ( 4 ) : 406 – 418 . (Special Issue on Computational Molecular Biology/Bioinformatics)
   Google Scholar
• Gray , G. A. , Taddy , M. , Martinez-Canales , M. and Lee , H. K. H. Enhancing parallel pattern search optimization with a Gaussian process oracle . Proceedings of the 14th Nuclear Explosive Codes Development Conference (NECDC) .
   Google Scholar
• G.A. Gray, M. Taddy, J.D. Griffin, M. Martinez-Canales, and H.K. H. Lee, Hybrid optimization: A tool for model calibration, in preparation
   Google Scholar
• Griffin , J. D. and Kolda , T. G. 2007 . “ Nonlinearly-constrained optimization using asynchronous parallel generating set search ” . Livermore, CA : Sandia National Laboratories . Tech. Rep. SAND2007-3257
   Google Scholar
• Griffin , J. D. , Kolda , T. G. and Lewis , R. M. 2006 . “ Asynchronous parallel generating set search for linearly-constrained optimization ” . Livermore, CA : Sandia National Laboratories . Tech. Rep. SAND2006-4621
   Google Scholar
• Helton , J. C. and Davis , F. J. 2000 . “ Sampling-based methods for uncertainty and sensitivity analysis ” . Albuquerque, NM : Sandia National Laboratories . Tech. Rep. SAND99-2240
   Google Scholar
• Hernández , C. 2004 . “ Stereo and silhouette fusion for 3D object modeling from uncalibrated images under circular motion ” . France : Ecole Nationale Supŕieure des Télécommunications . Ph.D. thesis
   Google Scholar
• Hogea , C. , Davatzikos , C. and Biros , G. 2008 . An image-driven parameter estimation problem for a reaction-diffusion glioma growth model with mass effects . J. Math. Biol. , 56 ( 6 ) : 793 – 825 .
   PubMed Web of Science ®Google Scholar
• Hough , P. D. , Kolda , T. G. and Patrick , H. A. 2000 . “ Usage manual for APPSPACK 2.0 ” . Livermore, CA : Sandia National Laboratories . Tech. Rep. SAND2000-8843
   Google Scholar
• Hough , P. D. , Kolda , T. G. and Torczon , V. J. 2001 . Asynchronous parallel pattern search for nonlinear optimization . SIAM J. Sci. Comput. , 23 ( 1 ) : 134 – 156 .
   Google Scholar
• Iman , R. and Conover , W. 1982 . A distribution-free approach to inducing rank correlation among input variables . Comm. Stat. , 11 ( 3 ) : 311 – 334 .
   Google Scholar
• Jones , D. R. 2001 . “ Direct global optimization algorithm ” . In Encyclopedia of Optimization , Edited by: Floudas , C. A. and Pardalos , P. M. 431 – 440 . Kluwer Academic Publishers .
   Google Scholar
• Jones , D. R. , Perttunen , C. D. and Stuckman , B. E. 1993 . Lipschitzian optimization without the Lipschitz constant . J. Optim. Theory Appl. , 79 ( 1 ) : 157 – 181 .
   Web of Science ®Google Scholar
• Kolda , T. G. 2005 . Revisiting asynchronous parallel pattern search for nonlinear optimization . SIAM J. Optim. , 16 ( 2 ) : 563 – 586 .
   Web of Science ®Google Scholar
• Kolda , T. G. and Torczon , V. 2004 . On the convergence of asynchronous parallel pattern search . SIAM J. Optim. , 14 ( 4 ) : 939 – 964 .
   Web of Science ®Google Scholar
• Kolda , T. G. , Lewis , R. M. and Torczon , V. 2003 . Optimization by direct search: New perspectives on some classical and modern methods . SIAM Rev. , 45 ( 3 ) : 385 – 482 .
   Web of Science ®Google Scholar
• Kolda , T. G. , Lewis , R. M. and Torczon , V. 2006 . “ A generating set direct search augmented Lagrangian algorithm for optimization with a combination of general and linear constraints ” . Livermore, CA : Sandia National Laboratories . Tech. Rep. SAND2006-5315
   Google Scholar
• Kolda , T. G. , Lewis , R. M. and Torczon , V. 2006 . Stationarity results for generating set search for linearly constrained optimization . SIAM J. Optim. , 17 ( 4 ) : 943 – 968 .
   Web of Science ®Google Scholar
• Kupinski , M. A. , Clarkson , E. , Hoppin , J. W. , Chen , L. and Barrett , H. H. 2003 . Experim ental determination of object statistics from noisy images . J. Opt. Soc. Am. A , 20 ( 3 ) : 421 – 429 .
   Google Scholar
• C. Lakhdar, Towards a new DIRECT algorithm: A two-points based sampling method, Department of Mathematics, University Ferhat-Abbas, Algeria 2005. Available at http://www.optimization-online.org/DB_FILE/2005/03/1077.pdf
   Google Scholar
• Lewis , R. M. and Torczon , V. 2002 . A globally convergent augmented Lagrangian pattern search algorithm for optimization with general constraints and simple bounds . SIAM J. Optim. , 12 ( 4 ) : 1075 – 1089 .
   Web of Science ®Google Scholar
• Lewis , R. M. , Shepherd , A. and Torczon , V. 2007 . Implementing generating set search methods for linearly constrained minimization . SIAM J. Sci. Comput. , 29 ( 6 ) : 2507 – 2530 .
   Web of Science ®Google Scholar
• Liang , J. and Chen , Y.-Q. 2003 . Optimiz ation of a fed-batch fermentation process control competition problem using the NEOS server . Proc. Inst. Mech. Eng. Part I J. Sys. Control Eng. , 217 ( 5 ) : 427 – 432 .
   Google Scholar
• McKay , M. D. , Conover , W. J. and Beckman , R. J. 1979 . A comparison of three methods for selecting values of input variables in the analysis of output from a computer code . Technometrics , 21 : 239 – 245 .
   Web of Science ®Google Scholar
• McKee , D. 2006 . “ A dynamic model of retirement in Indonesia ” . CA, USA : Center for Population Research On-Line Working Paper Series . Tech. Rep. CCPR-005-06
   Google Scholar
• Neumaier , A. 2004 . “ Complete search in continuous global optimization and constraint satisfaction ” . In Acta Numerica 2004 , 271 – 370 . Cambridge University Press .
   Google Scholar
• Nielsen , S. O. , Lopez , C. F. , Srinivas , G. and Klein , M. L. 2004 . Coarse grain models and the computer simulation of soft materials . J. Phys. Condens. Matter , 16 : R481 – R512 .
   Web of Science ®Google Scholar
• J.L. Payne and M.J. Eppstein, A hybrid genetic algorithm with pattern search for finding heavy atoms in protein crystals, GECCO ’05: Proceedings of the 2005 Conference on Genetic and Evolutionary Computation, New York, NY, USA, ACM, 2005, pp. 377–384
   Google Scholar
• Powell , M. J. D. 2002 . UOBYQA: unconstrained optimization by quadratic approximation . Math. Program , 92 ( 3 ) : 1436 – 4646 .
   Google Scholar
• Puchinger , J. and Raidl , G. R. Combining metaheuristics and exact algorithms in combinatorial optimization: A survey and classification . IWINAC 2005: Proceedings of First International Workshop on the Interplay between Natural and Artificial Computation . pp. 41 – 53 .
   Google Scholar
• Raidl , G. R. A unified view on hybrid metaheuristics . HM06: Third International Workshop on Hybrid Metaheuristics . pp. 1 – 12 .
   Google Scholar
• Regis , R. G. and Shoemaker , C. A. 2005 . Constrained global optimization of expensive black box functions using radial basis functions . J. Global Optim. , 31 ( 1 ) : 153 – 171 .
   Web of Science ®Google Scholar
• Santer , T. J. , Williams , B. J. and Notz , W. I. 2003 . The Design and Analysis of Computer Experiments , New York, , USA : Springer-Verlag Publication .
   Google Scholar
• Siah , E. S. , Sasena , M. , Volakis , J. L. , Papalambros , P. Y. and Wiese , R. W. 2004 . Fast parameter optimization of large-scale electromagnetic objects using DIRECT with Kriging metamodeling . IEEE Trans. Microw. Theory Tech. , 52 ( 1 ) : 276 – 285 .
   Web of Science ®Google Scholar
• M. Taddy, H.K. H. Lee, G.A. Gray, and J.D. Griffin, Bayesian guided pattern search for robust local optimization, Submitted to Technometrics, submitted for Publication
   Google Scholar
• Vaz , A. I. and Vicente , L. N. 2007 . A particle swarm pattern search method for bound constrained global optimization . J. Global Optim. , 39 ( 2 ) : 197 – 219 .
   Web of Science ®Google Scholar
• Wachowiak , M. P. and Peters , T. M. Parallel optimization approaches for medical image registration . MICCAI 2004: 7th International Conference on Medical Image Computing and Computer-Assisted Intervention . Vol. 3216 , pp. 781 – 788 . Berlin/Heidelberg : Lecture Notes in Computer Science, Springer-Verlag .
   Google Scholar
• Wachowiak , M. P. and Peters , T. M. 2005 . “ Combining global and local parallel optimization for medical image registration ” . In Medical Imaging 2005: Image Processing , Vol. 5747 , 1189 – 1200 . SPIE . J. Fitzpatrick, JM; Reinhardt, editor
   Google Scholar
• Wyss , G. D. and Jorgensen , K. H. 1998 . “ A user's guide to LHS: Sandia's Latin hypercube sampling software ” . Albuquerque, NM : Sandia National Laboratories . Tech. Rep. SAND98-0210
   Google Scholar
• Yao , Y. 1989 . Dynamic tunneling algorithm for global optimization . Trans. Syst. Man Cybern. , 19 ( 5 ) : 1222 – 1230 .
   Google Scholar
• Yehui , P. and Zhenhai , L. 2007 . A derivative-free algorithm for unconstrained optimization . App. Math. A J. Chin. Univ. , 20 ( 4 ) : 491 – 498 .
   Google Scholar
• Zacharaki , E. I. , Hogea , C. , Shen , G. D. , Biros , G. and Davatzikos , C. 2008 . Parallel optimization of tumor model parameters for fast registration of brain tumor images . Proc. SPIE , 6914
   Google Scholar
• Zhang , T. , Choi , K. K. , Rahman , S. , Cho , K. , Baker , P. , Shakil , M. and Heitkamp , D. 2006 . A hybrid surrogate and pattern search optimization method and application to microelectronics . Struct. Multidiscip. Optim. , 32 ( 4 ) : 327 – 345 .
   Web of Science ®Google Scholar