HOAX: a hyperparameter optimisation algorithm explorer for neural networks

References

• J. Baldwin-Philippi, Political Commun. 34 (4), 627–633 (2017). doi:10.1080/10584609.2017.1372999
   Web of Science ®Google Scholar
• E. Gardner, J. Phys. A Math. Theor. 19, L1047–L1056 (1986. doi:10.1088/0305-4470/19/16/017
   Google Scholar
• P. Gervás, B. Lönneker-Rodman, J.C. Meister and F. Peinado, in International Conference on Language Resources and Evaluation. Satellite Workshop: Toward Computational Models of Literary Analysis, pp. 44–51.
   Google Scholar
• J.C. Snyder, M. Rupp, K. Hansen, K.R. Müller and K. Burke, Phys. Rev. 108 (25), 253002 (2012. doi:10.1103/PhysRevLett.108.253002
   Google Scholar
• K.T. Schütt, H.E. Sauceda, P.J. Kindermans, A. Tkatchenko and K.R. Müller, J. Chem. Phys. 148 (24), 241722 (2018). doi:10.1063/1.5019779
   PubMed Web of Science ®Google Scholar
• J. Behler and M. Parrinello, Phys. Rev. 98, 146401 (2007. doi:10.1103/PhysRevLett.98.146401
   Google Scholar
• J. Westermayr and P. Marquetand, Chem. Rev. 121 (16), 9873–9926 (2021). doi:10.1021/acs.chemrev.0c00749
   PubMed Web of Science ®Google Scholar
• P.O. Dral, M. Barbatti and W. Thiel, J. Phys. Chem. Lett. 9 (19), 5660–5663 (2018). doi:10.1021/acs.jpclett.8b02469
   PubMed Web of Science ®Google Scholar
• J. Berner, P. Grohs, G. Kutyniok and P. Petersen, arXiv preprint arXiv:2105.04026, 2021.
   Google Scholar
• H.J. Kulik, T. Hammerschmidt, J. Schmidt, S. Botti, M.A.L Marques, M. Boley, M. Scheffler, M. Todorović, P. Rinke, C. Oses, A. Smolyanyuk, S. Curtarolo, A. Tkatchenko, A.P. Bartók, S. Manzhos, M. Ihara, T. Carrington, J. Behler, O. Isayev, M. Veit, A. Grisafi, J. Nigam, M. Ceriotti, K.T. Schótt, J. Westermayr, M. Gastegger, R.J. Maurer, B. Kalita, K. Burke, R. Nagai, R. Akashi, O. Sugino, J. Hermann, F. Noé, S. Pilati, C. Draxl, M. Kuban, S. Rigamonti, M. Scheidgen, M. Esters, D. Hicks, C. Toher, P.V. Balachandran, I. Tamblyn, S. Whitelam, C. Bellinger and L.M. Ghiringhelli, Electron. Struct. 4 (2), 023004 (2022). doi:10.1088/2516-1075/ac572f
   Google Scholar
• J. Bergstra, R. Bardenet, Y. Bengio and B. Kégl, Adv. Neural Inf. Process. Syst. 24, 2546– 2554 (2011. doi:10.1103/PhysRevLett.108.253002.
   Google Scholar
• R. Ramakrishnan, P.O. Dral, M. Rupp and O.A. von Lilienfeld, Sci. Data 1, (2014). doi:10.1038/sdata.2014.22
   PubMedGoogle Scholar
• J. Hermann, Z. Schatzle and F. Noé, Nat. Chem. 12 (10), 891–897 (2020). doi:10.1038/s41557-020-0544-y
   PubMed Web of Science ®Google Scholar
• K. Gubaev, E.V. Podryabinkin and A.V. Shapeev, J. Chem. Phys. 148 (24), 241727 (2018). doi:10.1063/1.5005095
   Google Scholar
• N. Lubbers, J.S. Smith and K. Barros, J. Chem. Phys. 148 (24), 241715 (2018). doi:10.1063/1.5011181
   PubMedGoogle Scholar
• B. Anderson, T.S. Hy and R. Kondor, Adv. Neural Inf. Process. Syst. 32, (2019. doi:10.48550/arXiv.1906.04015
   Google Scholar
• D.K. Duvenaud, D. Maclaurin, J. Iparraguirre, R. Bombarell, T. Hirzel, A. Aspuru-Guzik and R.P. Adams, Adv. Neural. Inf. Process. Syst. 28, (2015. doi:10.5555/2969442.2969488
   Google Scholar
• J. Gilmer, S.S. Schoenholz, P.F. Riley, O. Vinyals and G.E. Dahl, in Proceedings of the 34th International Conference on Machine Learning, Vol. 70, pp. 1263–1272, 2017.Sydney
   Google Scholar
• K.T. Schütt, F. Arbabzadah, S. Chmiela, K.R. Müller and A. Tkatchenko, Nat. Commun. 8 (1), (2017. doi:10.1038/ncomms13890
   Google Scholar
• A.S. Christensen, F.A. Faber and O.A. von Lilienfeld, J. Chem. Phys. 150 (6), 064105 (2019). doi:10.1063/1.5053562
   Google Scholar
• F.A. Faber, A.S. Christensen, B. Huang and O.A. von Lilienfeld, J. Chem. Phys. 148 (24), 241717 (2018). doi:10.1063/1.5020710
   PubMed Web of Science ®Google Scholar
• R. Ramakrishnan and O.A. von Lilienfeld, CHIMIA 69 (4), 182 (2015). doi:10.2533/chimia.2015.182
   PubMed Web of Science ®Google Scholar
• M. Rupp, R. Ramakrishnan and O.A. Von Lilienfeld, J. Phys. Chem. Lett. 6 (16), 3309–3313 (2015). doi:10.1021/acs.jpclett.5b01456
   Web of Science ®Google Scholar
• J. Westermayr, M. Gastegger and P. Marquetand, J. Phys. Chem. Lett. 11 (10), 3828–3834 (2020). doi:10.1021/acs.jpclett.0c00527
   PubMed Web of Science ®Google Scholar
• S. Mai, M. Richter, M. Heindl, M.F.S.J. Menger, A. Atkins, M. Ruckenbauer, F. Plasser, L.M. Ibele, S. Kropf, M. Oppel, P. Marquetand and L. González, SHARC2.1: Surface Hopping Including Arbitrary Couplings – Program Package for Non-Adiabatic Dynamics sharc-md.org 2019.
   Google Scholar
• W. Koch, M. Bonfanti, P. Eisenbrandt, A. Nandi, B. Fu, J. Bowman, D. Tannor and I. Burghardt, J. Chem. Phys. 151 (6), 064121 (2019). doi:10.1063/1.5113579
   Google Scholar
• Y. Guan and D.R. Yarkony, J. Phys. Chem. Lett. 11 (5), 1848–1858 (2020). doi:10.1021/acs.jpclett.0c00074
   PubMed Web of Science ®Google Scholar
• J. Westermayr, M. Gastegger, M.F. Menger, S. Mai, L. González and P. Marquetand, Chem. Sci. 10 (35), 8100–8107 (2019). doi:10.1039/C9SC01742A
   PubMed Web of Science ®Google Scholar
• B. Schölkopf, A.J. Smola and F. Bach, Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond (MIT Press, United States, 2002).
   Google Scholar
• G. Schmitz, I.H. Godtliebsen and O. Christiansen, J. Chem. Phys. 150 (24), 244113 (2019). doi:10.1063/1.5100141
   Google Scholar
• A.S. Abbott, J.M. Turney, B. Zhang, D.G.A. Smith, D. Altarawy and H.F. Schaefer, J. Chem. Theory Comput. 15 (8), 4386–4398 (2019). doi:10.1021/acs.jctc.9b00312
   PubMed Web of Science ®Google Scholar
• J. Bergstra, B. Komer, C. Eliasmith, D. Yamins and D.D. Cox, Comput. Sci. Discov. 8 (1), 014008 (2015). doi:10.1088/1749-4699/8/1/014008
   Google Scholar
• L.M. Rios and N.V. Sahinidis, J. Glob. Optim. 56 (3), 1247–1293 (2013). doi:10.1007/s10898-012-9951-y
   Web of Science ®Google Scholar
• K. Chandra, E. Meijer, S. Andow, E. Arroyo-Fang, I. Dea, J. George, M. Grueter, B. Hosmer, S. Stumpos, A. Tempest and S. Yang, arXiv preprint arXiv:1909.13371, 2019.
   Google Scholar
• Q. Huang, J. Mao and Y. Liu, in 2012 IEEE 14th International Conference on Communication Technology, pp. 1022–1026.
   Google Scholar
• S.R. Wilson, W. Cui, J.W. Moskowitz and K.E. Schmidt, J. Comput. Chem. 12 (3), 342–349 (1991). doi:10.1002/(ISSN)1096-987X
   Web of Science ®Google Scholar
• F. Hooft, A. Perez de Albaz Ortiz and B. Ensing, J. Chem. Theory Comput., 2294–2306 (2021. doi:10.1021/acs.jctc.0c00981
   PubMed Web of Science ®Google Scholar
• S. Ding, C. Su and J. Yu, Artif. Intell. Rev. 36, 153–162 (2011). doi:10.1007/s10462-011-9208-z
   Web of Science ®Google Scholar
• J. Snoek, H. Larochelle and R.P. Adams, Adv. Neural Inf. Process. Syst. 25, 2951–2959 (2012. doi:10.5555/2999325.2999464
   Google Scholar
• K. Gurney, An Introduction to Neural Networks (CRC Press, London, 2014).
   Google Scholar
• D.P. Kingma and J. Ba, arXiv preprint arXiv:1412.6980, 2017.
   Google Scholar
• A.M. Geoffrion, Math. Program 13 (1), 23–37 (1977). doi:10.1007/BF01584321
   Web of Science ®Google Scholar
• G. Harman and S. Kulkarni, Reliable Reasoning: Induction and Statistical Learning Theory (MIT Press, Cambridge, MA, 2012).
   Google Scholar
• L. Davis, Genetic Algorithms and Simulated Annealing (Morgan Kaufman Publishers, Inc., Los Altos, CA, United States, 1987).
   Google Scholar
• J. Bergstra and Y. Bengio, J. Mach. Learn. Res. 13 (2), 281–305 (2012. .
   Google Scholar
• J.Y. Hesterman, L. Caucci, M.A. Kupinski, H.H. Barrett and L.R. Furenlid, IEEE Trans. Nucl. Sci. 57 (3), 1077–1084 (2010). doi:10.1109/TNS.2010.2045898
   PubMed Web of Science ®Google Scholar
• S. Xu and Y. Rahmat-Samii, IEEE Trans. Antennas Propag. 55 (3), 760–765 (2007). doi:10.1109/TAP.2007.891562
   Web of Science ®Google Scholar
• D. Charles, On the Origin of Species by Means of Natural Selection, Or the Preservation of Favoured Races in the Struggle for Life (John Murray, London, 1859).
   Google Scholar
• G. Moghadampour, in Proceedings of the 13th International Conference on Enterprise Information Systems, pp. 54–62.Beijing
   Google Scholar
• A. Hassanat, K. Almohammadi, E. Alkafaween, E. Abunawas, A. Hammouri and V.B.S. Prasath, Information 10 (12), (390.2019). doi:10.3390/info10120390
   Google Scholar
• S. Russel and P. Norvig, Artificial Intelligence: A Modern Approach (Pearson Education, London, UK, 2003).
   Google Scholar
• K.R. Koch, Introduction to Bayesian Statistics (Springer Science & Business Media, Berlin, 2007).
   Google Scholar
• M.F. Menger, J. Ehrmaier and S. Faraji, J. Chem. Theory Comput. 16 (12), 7681–7689 (2020). doi:10.1021/acs.jctc.0c00825
   PubMed Web of Science ®Google Scholar
• R. Rew and G. Davis, IEEE Comput. Graph. Appl. 10 (4), 76–82 (1990). doi:10.1109/38.56302
   Web of Science ®Google Scholar
• S. Brown, M. Folk, G. Goucher, R. Rew and P. Dubois, Comput. Phys. Commun. 7, 304 (1993). doi:10.1063/1.4823180
   Google Scholar
• F. Pezoa, J.L. Reutter, F. Suarez, M. Ugarte and D. Vrgoč, in Proceedings of the 25th International Conference on World Wide Web, pp. 263–273.Montreal
   Google Scholar
• A. Paszke, S. Gross, F. Massa, A. Lerer, J. Bradbury, G. Chanan, T. Killeen, Z. Lin, N. Gimelshein and L. Antiga, Adv. Neural Inf. Process. Syst. 32, 8026–8037 (2019. doi:10.5555/3454287.3455008
   Google Scholar
• F. NogueiraBayesian Optimization: Open source constrained global optimization tool for Python https://github.com/fmfn/BayesianOptimization, 2014.
   Google Scholar
• A. Raab, G.A. Worth, H.D. Meyer and L. Cederbaum, J. Chem. Phys. 110 (2), 936–946 (1999). doi:10.1063/1.478061
   Web of Science ®Google Scholar
• R. Burcl, R.D. Amos and N.C. Handy, Chem. Phys. Lett. 355 (1), 8–18 (2002). doi:10.1016/S0009-2614(02)00122-7
   Web of Science ®Google Scholar
• A.K. Belyaev and O.V. Lebedev, Phys. Rev. A 84, 014701 (2011). doi:10.1103/PhysRevA.84.014701
   Web of Science ®Google Scholar
• L. Sun and W.L. Hase, J. Chem. Phys. 133 (4), 044313 (2010). doi:10.1063/1.3463717
   Google Scholar
• E. Epifanovsky, A.T.B. Gilbert, X. Feng, J. Lee, Y. Mao, N. Mardirossian, P. Pokhilko, A.F. White, M.P. Coons, A.L. Dempwolff and Z. Gan, J. Chem. Phys. 155 (8), 084801 (2021). doi:10.1063/5.0055522
   PubMed Web of Science ®Google Scholar
• C. Lee, W. Yang and R.G. Parr, Phys. Rev. B 37, 785–789 (1988). doi:10.1103/PhysRevB.37.785
   PubMed Web of Science ®Google Scholar
• W.J. Hehre, R. Ditchfield and J.A. Pople, J. Chem. Phys. 56 (5), 2257–2261 (1972). doi:10.1063/1.1677527
   Web of Science ®Google Scholar
• Y. Shao, M. Head-Gordon and A.I. Krylov, J. Chem. Phys. 118 (11), 4807–4818 (2003). doi:10.1063/1.1545679
   Web of Science ®Google Scholar
• A.D. Becke, J. Chem. Phys. 98 (2), 1372–1377 (1993). doi:10.1063/1.464304
   Web of Science ®Google Scholar
• T.H. Dunning, Chem. Phys. 90 (2), 1007–1023 (1989. doi:10.1063/1.456153
   Web of Science ®Google Scholar
• N. Srinivas, A. Krause, S.M. Kakade and M.W. Seeger, IEEE Trans. Inf. Theory 58 (5), 3250–3265 (2012). doi:10.1109/TIT.2011.2182033
   Web of Science ®Google Scholar
• V. Svetnik, A. Liaw, C. Tong, J.C. Culberson, R.P. Sheridan and B.P. Feuston, J. Chem. Inf. Comput. Sci. 43 (6), 1947–1958 (2003). doi:10.1021/ci034160g
   PubMedGoogle Scholar
• S. Albawi, T.A. Mohammed and S. Al-Zawi, in 2017 International Conference on Engineering and Technology (ICET), pp. 1–6.Antalya
   Google Scholar
• T.A. Feo and M.G. Resende, J. Glob. Optim. 6 (2), 109–133 (1995). doi:10.1007/BF01096763
   Web of Science ®Google Scholar