References
- Neugebauer J, Hickel T. Density functional theory in materials science. WIREs Comput Mol Sci. 2013;3(5):438–448. Available from: https://onlinelibrary.wiley.com/doi/pdf/10.1002/wcms.1125 OR http://onlinelibrary.wiley.com/doi/abs/10.1002/wcms.1125
- Agrawal A, Choudhary A. Deep materials informatics: Applications of deep learning in materials science. MRS Commun. 2019 Sep;9(3):779–792. Available from: https://www.cambridge.org/core/product/identifier/S2159685919000739/type/journal_article
- Bhadeshia HKDH. Neural networks in materials science. ISIJ Int. 1999;39(10):966–979.
- Bhadeshia HKDH. Neural Networks and Information in Materials Science. Stat Anal Data Min. 2009 Apr;1(5):296–305. Available from: http://doi.wiley.com/10.1002/sam.10018
- Krizhevsky A, Sutskever I, Hinton GE. ImageNet classification with deep convolutional neural networks. Commun ACM. 2017 May;60(6):84–90. Available from: https://doi.org/10.1145/3065386
- Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv:14091556 [cs]. 2015 Apr. Available from: http://arxiv.org/abs/1409.1556
- Ze H, Senior A, Schuster M. Statistical parametric speech synthesis using deep neural networks. 2013 IEEE International Conference on Acoustics, Speech and Signal Processing; 2013. p. 7962–7966. ISSN: 2379-190X.
- Fan Y, Qian Y, Xie FL, et al. TTS synthesis with bidirectional LSTM based recurrent neural networks. INTERSPEECH; 2014.
- Zen H, Sak H. Unidirectional long short-term memory recurrent neural network with recurrent output layer for low-latency speech synthesis. 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP); 2015. p. 4470–4474. ISSN: 2379-190X.
- Datta S, Chattopadhyay PP. Soft computing techniques in advancement of structural metals. Int Mater Rev. 2013 Nov;58(8):475–504. Available from: http://www.tandfonline.com/doi/full/10.1179/1743280413Y.0000000021
- Odejobi OA, Umoru LE. Applications of soft computing techniques in materials engineering: a review. p. 28.
- Laghari RA, Li J, Laghari AA, et al. A review on application of soft computing techniques in machining of particle reinforcement metal matrix composites. Arch Comput Meth Eng. 2020;27:1363–1377. Available from: http://link.springer.com/10.1007/s11831-019-09340-0
- Vasudevan M. Soft computing techniques in stainless steel welding. Mater Manuf Process. 2009 Jan;24(2):209–218. Available from: http://www.tandfonline.com/doi/abs/10.1080/10426910802612338
- Faghih-Roohi S, Hajizadeh S, Núñez A, et al. Deep convolutional neural networks for detection of rail surface defects. 2016 International Joint Conference on Neural Networks (IJCNN); 2016. p. 2584–2589. ISSN: 2161–4407.
- Masci J, Meier U, Ciresan D, et al. Steel defect classification with Max-Pooling Convolutional Neural Networks. The 2012 International Joint Conference on Neural Networks (IJCNN); 2012. p. 1–6. ISSN: 2161–4393.
- Dimiduk DM, Holm EA, Niezgoda SR. Perspectives on the impact of machine learning, deep learning, and artificial intelligence on materials, processes, and structures engineering. Integr Mater Manuf Innov. 2018 Sep;7(3):157–172. Available from: https://doi.org/10.1007/s40192-018-0117-8
- Kusche C, Reclik T, Freund M, et al. Large-area, high-resolution characterisation and classification of damage mechanisms in dual-phase steel using deep learning. PLoS One. 2019 May;14(5):e0216493. Available from: http://dx.plos.org/10.1371/journal.pone.0216493
- LeNail A. NN-SVG: publication-ready neural network architecture schematics. J Open Source Soft. 2019 Jan;4(33):747. Available from: https://joss.theoj.org/papers/10.21105/joss.00747
- Yescas MA. Prediction of the Vickers hardness in austempered ductile irons using neural networks. Int J Cast Metals Res. 2003 May;15(5):513–521. Available from: https://doi.org/10.1080/13640461.2003.11819537
- Calik A, Duzgun A, Sahin O. Effect of carbon content on the mechanical properties of medium carbon steels. Z Naturforsch A. 2010 May;65(5):468–472. Available from: http://www.degruyter.com/view/j/zna.2010.65.issue-5/zna-2010-0512/zna-2010-0512.xml
- Grange RA, Hribal CR, Porter LF. Hardness of tempered martensite in carbon and low-alloy steels. Met Trans A. 1977 Nov;8(11):1775–1785. Available from: https://doi.org/10.1007/BF02646882
- Häggblad H , Oldenburg M. Modelling and simulation of metal powder die pressing with use of explicit time integration. Model Simul Mater Sci Eng. 1994 Jul;2(4):893–911. Available from: https://doi.org/10.10882/F0965-03932F22F42F006
- Kafkas F, Karataş Ç, Sozen A, et al. Determination of residual stresses based on heat treatment conditions and densities on a hybrid (FLN2-4405) powder metallurgy steel using artificial neural network. Mater Des. 2007 Jan;28(9):2431–2442. Available from: http://www.sciencedirect.com/science/article/pii/S0261306906002494
- Windsor CG, Cottrell G, Kemp R. Prediction of yield stress in highly irradiated ferritic steels. Model Simul Mater Sci Eng. 2008 Mar;16(2):025005.Available from: http://stacks.iop.org/0965-0393/16/i=2/a=025005?key=crossref.56fb9fc74ebb12e8052615fef6020e7b
- Rahaman M, Mu W, Odqvist J, et al. Machine learning to predict the martensite start temperature in steels. Met Mater Trans A. 2019 May;50(5):2081–2091. Available from: https://doi.org/10.1007/s11661-019-05170-8
- MacKay DJC. A practical Bayesian framework for backprop networks. Neural Comput. 1992;4:448–472.
- MacKay DJC. Bayesian interpolation. Neural Comput. 1992 May;4(3):415–447. Available from: https://www.mitpressjournals.org/doi/10.1162/neco.1992.4.3.415
- Blundell C, Cornebise J, Kavukcuoglu K, et al. Weight uncertainty in neural networks. arXiv:150505424 [cs, stat]. 2015 May. Available from: http://arxiv.org/abs/1505.05424
- Pearce T, Leibfried F, Brintrup A, et al. Uncertainty in neural networks: approximately Bayesian ensembling. arXiv:181005546 [cs, stat]. 2019 Oct. Available from: http://arxiv.org/abs/1810.05546
- Goh GB, Hodas NO, Vishnu A. Deep learning for computational chemistry. J Comput Chem. 2017;38(16):1291–1307. Available from: https://onlinelibrary.wiley.com/doi/pdf/10.1002/jcc.24764 OR http://onlinelibrary.wiley.com/doi/abs/10.1002/jcc.24764
- Morris KC, Schlenoff C, Srinivasan V. Guest editorial: A remarkable resurgence of artificial intelligence and its impact on automation and autonomy. IEEE Trans Autom Sci Eng. 2017 Apr;14(2):407–409. IEEE Transactions on Automation Science and Engineering.
- Marcus G. Deep learning: a critical appraisal. arXiv:180100631 [cs, stat]. 2018 Jan. Available from: http://arxiv.org/abs/1801.00631
- Krizhevsky A, Sutskever I, Hinton GE. ImageNet classification with deep convolutional neural networks. Pereira F, Burges CJC, Bottou L, Weinberger KQ, editors, Advances in neural information processing systems 25. Curran Associates, Inc.; 2012. p. 1097–1105. Available from: http://papers.nips.cc/paper/4824-imagenet-classification-with-deep-convolutional-neural-networks.pdf
- Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation. 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2015. p. 3431–3440. ISSN: 1063–6919.
- Shi W, Caballero J, Huszar F, et al. Real-time single image and video super-resolution using an efficient sub-pixel convolutional. Neural Netw. 2016;1:1874–1883. Available from: https://www.cv-foundation.org/openaccess/content_cvpr_2016/html/Shi_Real_Time_Single_Image_CVPR_2016_paper.html
- Moore SW, Fox PJ, Marsh SJT, et al. Bluehive – a field-programable custom computing machine for extreme-scale real-time neural network simulation. 2012 IEEE 20th International Symposium on Field-Programmable Custom Computing Machines; 2012. p. 133–140.
- Jung S, Kim Ss. Hardware implementation of a real-time neural network controller with a DSP and an FPGA for nonlinear systems. IEEE Trans Indust Electron. 2007 Feb;54(1):265–271. IEEE Transactions on Industrial Electronics.
- Hawkins DM. The Problem of Overfitting. J Chem Inf Comput Sci. 2004 Jan;44(1):1–12. American Chemical Society. Available from: https://doi.org/10.1021/ci0342472
- Srivastava N, Hinton G, Krizhevsky A, et al. Dropout: a simple way to prevent neural networks from overfitting. J Machine Learn Res. 2014 Jan;15(1):1929–1958.
- Bianchini M, Scarselli F. On the complexity of neural network classifiers: a comparison between shallow and deep architectures. IEEE Trans Neural Netw Learn Syst. 2014 Aug;25(8):1553–1565. IEEE Transactions on Neural Networks and Learning Systems.
- Bornschein J, Visin F, Osindero S. Small data, big decisions: model selection in the small-data regime. p. 10.
- Pan SJ, Yang Q. A survey on transfer learning. IEEE Trans Knowl Data Eng. 2010 Oct;22(10):1345–1359. IEEE Transactions on Knowledge and Data Engineering.
- Shin HC, Roth HR, Gao M, et al. Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer Learning. IEEE Trans Med Imaging. 2016 May;35(5):1285–1298. Available from: http://ieeexplore.ieee.org/document/7404017/
- Shorten C, Khoshgoftaar TM. A survey on image data augmentation for deep learning. J Big Data. 2019 Jul;6(1):60. Available from: https://doi.org/10.1186/s40537-019-0197-0
- Wong SC, Gatt A, Stamatescu V, et al. Understanding data augmentation for classification: When to Warp? 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA); 2016. p. 1–6.
- Hubel DH, Wiesel TN. Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. J. Physiol. (Lond.). 1962 Jan;160(1):106–154. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1359523/
- Lecun Y, Bottou L, Bengio Y, et al. Gradient-based learning applied to document recognition. Proc IEEE. 1998 Nov;86(11):2278–2324.
- Cang R, Li H, Yao H, et al. Improving direct physical properties prediction of heterogeneous materials from imaging data via convolutional neural network and a morphology-aware generative model. Comput Mater Sci. 2018 Jul;150:212–221. Available from: http://www.sciencedirect.com/science/article/pii/S0927025618302337
- Li X, Dan Y, Dong R, et al. Computational screening of new perovskite materials using transfer learning and deep learning. Appl Sci. 2019 Jan;9(24):5510. Number: 24 Publisher: Multidisciplinary Digital Publishing Institute. Available from: https://www.mdpi.com/2076-3417/9/24/5510
- Jordan MI. Attractor dynamics and parallelism in a connectionist sequential machine. Artificial neural networks: concept learning. IEEE Press; 1990. p. 112–127.
- Elman JL. Finding structure in time. Cogn Sci. 1990;14:179–211.
- Pearlmutter X. Learning state space trajectories in recurrent neural networks. International 1989 Joint Conference on Neural Networks; Vol. 2, 1989. p. 365–372 ISSN: null.
- Cleeremans A, Servan-Schreiber D, McClelland JL. Finite state automata and simple recurrent networks. Neural Comput. 1989 Sep;1(3):372–381. Available from: http://www.mitpressjournals.org/doi/10.1162/neco.1989.1.3.372
- Hochreiter S, Schmidhuber J. Long short-term memory. Neural Comput. 1997 Nov;9(8):1735–1780. Available from: https://www.mitpressjournals.org/doi/10.1162/neco.1997.9.8.1735
- Cho K, van Merriënboer B, Gulcehre C, et al. Learning phrase representations using RNN encoder-decoder for statistical machine translation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). Doha, Qatar: Association for Computational Linguistics; 2014. p. 1724–1734. Available from: https://www.aclweb.org/anthology/D14-1179
- Olah C. Understanding LSTM networks – colah's blog. Available from: https://colah.github.io/posts/2015-08-Understanding-LSTMs/
- Zhou SM, Xu LD. Dynamic recurrent neural networks for a hybrid intelligent decision support system for the metallurgical industry. Expert Syst. 1999;16(4):240–247. Available from: http://onlinelibrary.wiley.com/doi/abs/10.1111/1468-0394.00115
- Veeramani AS, Crews JH, Buckner GD. Hysteretic recurrent neural networks: a tool for modeling hysteretic materials and systems. Smart Mater Struct. 2009 Jun;18(7):075004. Available from: https://doi.org/10.1088/2F0964-17262F182F72F075004
- Lien JP, York A, Fang T, et al. Modeling piezoelectric actuators with hysteretic recurrent neural networks. Sens Actuators A Phys. 2010 Oct;163(2):516–525. Available from: http://www.sciencedirect.com/science/article/pii/S0924424710003717
- Koeppe A, Hernandez Padilla CA, Voshage M, et al. Efficient numerical modeling of 3D-printed lattice-cell structures using neural networks. Manuf Lett. 2018 Jan;15:147–150. Available from: http://www.sciencedirect.com/science/article/pii/S2213846318300051
- Mozaffar M, Paul A, Al-Bahrani R, et al. Data-driven prediction of the high-dimensional thermal history in directed energy deposition processes via recurrent neural networks. Manuf Lett. 2018 Oct;18:35–39. Available from: http://www.sciencedirect.com/science/article/pii/S2213846318300804
- Venkatesh V, Rack HJ. A neural network approach to elevated temperature creep-fatigue life prediction. Int J Fatigue. 1999;21:225–234.
- Pleune TT, Chopra OK. Using artificial neural networks to predict the fatigue life of carbon and low-alloy steels. Nuclear Eng Design. 2000;197:1–12.
- Lowd D, Meek C. Adversarial learning. Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining. KDD '05. Chicago (IL): Association for Computing Machinery; 2005. p. 641–647. Available from: https://doi.org/10.1145/1081870.1081950
- Huang L, Joseph AD, Nelson B, et al. Adversarial machine learning. Proceedings of the 4th ACM workshop on Security and artificial intelligence - AISec '11. Chicago (IL): ACM Press; 2011. p. 43. Available from: http://dl.acm.org/citation.cfm?doid=2046684.2046692
- Dalvi N, Domingos P, Verma D. Adversarial classification. Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining. KDD '04. Seattle (WA): Association for Computing Machinery; 2004. p. 99–108. Available from: https://doi.org/10.1145/1014052.1014066
- Goodfellow IJ, Pouget-Abadie J, Mirza M, et al. Generative Adversarial Networks. arXiv:14062661 [cs, stat]. 2014 Jun. version: 1. Available from: http://arxiv.org/abs/1406.2661
- Karras T, Laine S, Aila T. A style-based generator architecture for generative adversarial networks. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); 2019. p. 4396–4405. ISSN: 1063–6919.
- Zhou X, Pan Z, Hu G, et al. Stock market prediction on high-frequency data using generative adversarial nets [Research Article]; 2018. Available from: https://www.hindawi.com/journals/mpe/2018/4907423/
- Shrivastava A, Pfister T, Tuzel O, et al. Learning from simulated and unsupervised images through adversarial training. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2017. p. 2242–2251. ISSN: 1063–6919.
- Yang Z, Li X, Catherine Brinson L, et al. Microstructural materials design via deep adversarial learning methodology. J Mech Design. 2018 Nov;140(11):111416. Available from: https://asmedigitalcollection.asme.org/mechanicaldesign/article/doi/10.1115/1.4041371/477902/Microstructural-Materials-Design-Via-Deep
- Liu Z, Zhu D, Rodrigues SP, et al. Generative model for the inverse design of metasurfaces. Nano Lett. 2018 Oct;18(10):6570–6576. Available from: https://doi.org/10.1021/acs.nanolett.8b03171
- Xie Y, Franz E, Chu M, et al. tempoGAN: a temporally coherent, volumetric GAN for super-resolution fluid flow. ACM Trans Graphics (TOG).. 2018;37(4):95–00.
- Miikkulainen BFaR. Using marker-based genetic encoding of neural networks to evolve finite-state behaviour. 1991. Available from: http://nn.cs.utexas.edu/?fullmer:ecal91
- Miikkulainen DEMaR. Efficient reinforcement learning through symbiotic evolution. 1996. Available from: http://nn.cs.utexas.edu/?moriarty:mlj96
- Gomez FJ, Miikkulainen R. Solving non-Markovian control tasks with neuroevolution. p. 6.
- Floreano D, Dürr P, Mattiussi C. Neuroevolution: from architectures to learning. Evol Intell. 2008 Mar;1(1):47–62. Available from: http://link.springer.com/10.1007/s12065-007-0002-4
- Hartke B. Global optimization. WIREs Computational Molecular Science. 2011;1(6):879–887. Available from: https://onlinelibrary.wiley.com/doi/pdf/10.1002/wcms.70 OR http://onlinelibrary.wiley.com/doi/abs/10.1002/wcms.70
- Stanley KO, Clune J, Lehman J, et al. Designing neural networks through neuroevolution. Nat Mach Intell. 2019 Jan;1(1):24–35. Number: 1 Publisher: Nature Publishing Group. Available from: http://www.nature.com/articles/s42256-018-0006-z
- Chakraborti N. Chapter 5 - evolutionary data-driven modeling. In: Rajan K, editor, Informatics for materials science and engineering. Oxford: Butterworth-Heinemann; 2013. p. 71–95. Available from: http://www.sciencedirect.com/science/article/pii/B9780123943996000059
- Coello CAC, Becerra RL. Evolutionary multiobjective optimization in materials science and engineering. Mater Manuf Process. 2009 Jan;24(2):119–129. Taylor & Francis; Available from: https://doi.org/10.1080/10426910802609110 OR https://doi.org/10.1080/10426910802609110
- Stanley KO, Miikkulainen R. Evolving neural networks through augmenting topologies. Evol Comput. 2002 Jun;10(2):99–127. MIT Press. Available from: https://doi.org/10.1162/106365602320169811
- Roy S, Chakraborti N. Development of an evolutionary deep neural net for materials research. TMS 2020 149th Annual Meeting & Exhibition Supplemental Proceedings. The Minerals, Metals & Materials Series. Cham: Springer International Publishing; 2020. p. 817–828.
- Deb K. Multi-objective optimization using evolutionary algorithms. Hoboken: Wiley; 2001.
- Chakraborti N. Genetic algorithms in materials design and processing. Int Mater Rev. 2004 Jun;49(3-4):246–260. Available from: https://doi.org/10.1179/095066004225021909
- Pettersson F, Chakraborti N, Saxén H. A genetic algorithms based multi-objective neural net applied to noisy blast furnace data. Appl Soft Comput. 2007 Jan;7(1):387–397. Available from: http://www.sciencedirect.com/science/article/pii/S1568494605000803
- Laumanns M, Rudolph G, Schwefel H. A spatial predator-prey approach to multi-objective optimization: a preliminary study. PPSN; 1998.
- Li X. A real-coded predator-prey genetic algorithm for multiobjective optimization. (Berlin): Springer; 2003. Available from: https://core.ac.uk/display/15612568
- Mahanta BK, Chakraborti N. Evolutionary data driven modeling and multi objective optimization of noisy data set in blast furnace iron making process. steel Res Int. 2018;89(9):1800121. Available From: https://onlinelibrary.wiley.com/doi/pdf/10.1002/srin.201800121 OR http://onlinelibrary.wiley.com/doi/abs/10.1002/srin.201800121
- Mondal DN, Sarangi K, Pettersson F, et al. Cu**Zn separation by supported liquid membrane analyzed through multi-objective genetic algorithms. Hydrometallurgy. 2011 May;107(3):112–123. Available from: http://www.sciencedirect.com/science/article/pii/S0304386X11000478
- Pettersson F, Suh C, Saxén H, et al. Analyzing sparse data for nitride spinels using data mining, neural networks, and multiobjective genetic algorithms. Mater Manuf Process. 2008 Dec;24(1):2–9. Available from: https://www.tandfonline.com/doi/full/10.1080/10426910802539762
- Pettersson F, Biswas A, Sen PK, et al. Analyzing leaching data for low-grade manganese ore using neural nets and multiobjective genetic algorithms. Mater Manuf Process. 2009 Feb;24(3):320–330. Available from: http://www.tandfonline.com/doi/abs/10.1080/10426910802679386
- Roy S, Saini BS, Chakrabarti D, et al. Mechanical properties of micro-alloyed steels studied using a evolutionary deep neural network. Mater Manuf Process. 2020 Apr;35(6):611–624. Taylor & Francis; Available from: https://doi.org/10.1080/10426914.2019.1660786 OR https://doi.org/10.1080/10426914.2019.1660786
- Mahanta BK, Chakraborti N. Tri-objective optimization of noisy dataset in blast furnace iron-making process using evolutionary algorithms. Mater Manuf Process. 2020 Apr;35(6):677–686. Taylor & Francis; Available from: https://doi.org/10.1080/10426914.2019.1643472 OR https://doi.org/10.1080/10426914.2019.1643472
- Mnih V, Kavukcuoglu K, Silver D, et al. Playing atari with deep reinforcement learning. arXiv:13125602 [cs]. 2013 Dec. Available from: http://arxiv.org/abs/1312.5602
- Silver D, Hubert T, Schrittwieser J, et al. A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play. Sci. 2018 Dec;362(6419):1140–1144. American Association for the Advancement of Science Section: Report. Available from: https://science.sciencemag.org/content/362/6419/1140
- Silver D, Huang A, Maddison CJ, et al. Mastering the game of Go with deep neural networks and tree search. Nature. 2016 Jan;529(7587):484–489. Number: 7587 Publisher: Nature Publishing Group; Available from: https://www.nature.com/articles/nature16961
- Vinyals O, Babuschkin I, Czarnecki WM, et al. Grandmaster level in StarCraft II using multi-agent reinforcement learning. Nature. 2019 Nov;575(7782):350–354. Number: 7782 Publisher: Nature Publishing Group; Available from: https://www.nature.com/articles/s41586-019-1724-z
- Nakajima K. Physical reservoir computing-an introductory perspective. Jpn J Appl Phys. 2020 May;59(6):060501. Publisher: IOP Publishing; Available from: https://doi.org/10.35848/2F1347-40652Fab8d4f
- Dale M, Miller JF, Stepney S. Reservoir computing as a model for in-materio computing. In: Adamatzky A, editor, Advances in unconventional computing. Cham: Springer International Publishing; 2017. p. 533–571. Series Title: (Emergence, Complexity and Computation; 22). Available from: http://link.springer.com/10.1007/978-3-319-33924-5-22
- Marinella MJ, Agarwal S. Efficient reservoir computing with memristors. Nat Electron. 2019 Oct;2(10):437–438. Available from: http://www.nature.com/articles/s41928-019-0318-y
- Obst O, Trinchi A, Hardin SG, et al. Nano-scale reservoir computing. Nano Commun Netw. 2013 Dec;4(4):189–196. Available from: http://www.sciencedirect.com/science/article/pii/S1878778913000495
- Du C, Cai F, Zidan MA, et al. Reservoir computing using dynamic memristors for temporal information processing. Nat Commun. 2017 Dec;8(1):2204. Number: 1 Publisher: Nature Publishing Group; Available from: https://www.nature.com/articles/s41467-017-02337-y
- Moon J, Ma W, Shin JH, et al. Temporal data classification and forecasting using a memristor-based reservoir computing system. Nat Electron. 2019 Oct;2(10):480–487. Number: 10 Publisher: Nature Publishing Group; Available from: https://www.nature.com/articles/s41928-019-0313-3