ANN-based methods for solving partial differential equations: a survey

References

• Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., … Isard, M. (2016). Tensorflow: A system for large-scale machine learning. 12th {USENIX} symposium on operating systems design and implementation ({OSDI} 16) (pp. 265–283). Savanah, GA, US: USENIX.
   Google Scholar
• Aggarwal, R., & Ugail, H. (2019). On the solution of poisson’s equation using deep learning. 2019 13th International Conference on Software, Knowledge, Information Management and Applications (SKIMA) (pp. 1–8). Piscataway, NJ: IEEE. doi:10.1109/SKIMA47702.2019.8982518
   Google Scholar
• Ahmat, N., Castro, G. G., & Ugail, H. (2014). Automatic shape optimisation of pharmaceutical tablets using partial differential equations. Computers & Structures, 130, 1–9. doi:10.1016/j.compstruc.2013.09.001
   Web of Science ®Google Scholar
• Arnal, A., Monterde, J., & Ugail, H. (2011). Explicit polynomial solutions of fourth order linear elliptic partial differential equations for boundary based smooth surface generation. Computer Aided Geometric Design, 28(6), 382–394. doi:10.1016/j.cagd.2011.06.001
   Web of Science ®Google Scholar
• Bakar, M. A., & Salhi, A. (2019). Rmeiemla: The recent advance in improving the robustness of lanczos-type algorithms. AIP Conference Proceedings (pp. 03–09). Melville, NY: AIP Publishing LLC.
   Google Scholar
• Bakar, M. A., N., A., Larasati, N., Salhi, A., & Khan, W. M. (2019). Lanczos-type algorithms with embedded interpolation and extrapolation models for solving large scale systems of linear equations. International Journal of Computing Science and Mathematics, 10(5), 429–442. doi:10.1504/IJCSM.2019.103675
   Web of Science ®Google Scholar
• Blakely, R. J. (1996). Potential theory in gravity and magnetic applications Cambridge: Cambridge University Press.
   Google Scholar
• Burden, R., Faires, J., & Burden, A. (2015). Numerical analysis, brooks and cole. Boston, MA: Cencag Learning.
   Google Scholar
• Chaudhry, E., Bian, S., Ugail, H., Jin, X., You, L., & Zhang, J. J. (2015). Dynamic skin deformation using finite difference solutions for character animation. Computers & Graphics, 46, 294–305. doi:10.1016/j.cag.2014.09.029
   Web of Science ®Google Scholar
• Chen, F., Sondak, D., Protopapas, P., Mattheakis, M., Liu, S., Agarwal, D., & Giovanni, M. D. (2020). Neurodiffeq: A python package for solving differential equations with neural networks. Journal of Open Source Software, 5(46), 1931. doi:10.21105/joss.01931
   Google Scholar
• Elmahmudi, A., & Ugail, H. (2019). The biharmonic eigenface. Signal, Image and Video Processing, 13(8), 1639–1647. doi:10.1007/s11760-019-01514-4
   Web of Science ®Google Scholar
• Elsherbeny, A. M., El-hassani, R. M., El-badry, H., & Abdallah, M. I. (2018). Solving 2d-Poisson equation using modified cubic b-spline differential quadrature method. Ain Shams Engineering Journal, 9(4), 2879–2885. doi:10.1016/j.asej.2017.12.001
   Web of Science ®Google Scholar
• Evans, G., Blackledge, J., & Yardley, P. (2012). Numerical methods for partial differential equations. Berlin, Germany: Springer Science & Business Media.
   Google Scholar
• Fardi, M., & Khan, A. Y. (2021). A novel finite difference-spectral method for fractal mobile and immobile transport (FM and it) model based on capito-fabrizio derivative. Chaos, Solitons and Fractals, 143(2021), 110573. doi:10.1016/j.chaos.2020.110573
   Google Scholar
• Goldberg, Y. (2016). A primer on neural network models for natural language processing. Journal of Artificial Intelligence Research, 57, 345–420. doi:10.1613/jair.4992
   Web of Science ®Google Scholar
• Goodfellow, I., Bengio, Y., & Courville, A. (2016). Deep learning. Cambridge, MA: MIT Press.
   Google Scholar
• Gu, J., Zhang, Y., & Dong, H. (2018). Dynamic behaviors of interaction solutions of (3 + 1)-dimensional shallow water wave equation. Computers & Mathematics with Applications, 76(6), 1408–1419. doi:10.1016/j.camwa.2018.06.034
   Web of Science ®Google Scholar
• Guo, Y., Cao, X., Liu, B., & Gao, M. (2020). Solving partial differential equations using deep learning and physical constraints. Applied Sciences, 10(17), 5917. doi:10.3390/app10175917
   Google Scholar
• Hayati, M., & Karami, B. (2007). Feedforward neural network for solving partial differential equations. Journal of Applied Sciences, 7(19), 2812–2817. doi:10.3923/jas.2007.2812.2817
   Google Scholar
• Haykin, S. (1999). Neural networks a comprehensive introduction.
   Google Scholar
• He, J.-H., & Latifizadeh, H. (2020). A general numerical algorithm for nonlinear differential equations by the variational iteration method. International Journal of Numerical Methods for Heat & Fluid Flow, 30(11), 4797–4810. doi:10.1108/HFF-01-2020-0029
   Web of Science ®Google Scholar
• Helbing, G., & Ritter, M. (2018). Deep learning for fault detection in wind turbines. Renewable and Sustainable Energy Reviews, 98, 189–198. doi:10.1016/j.rser.2018.09.012
   Web of Science ®Google Scholar
• Jagtap, A. D., Kawaguchi, K., & Karniadakis, G. E. (2020). Adaptive activation functions accelerate convergence in deep and physics-informed neural networks. Journal of Computational Physics, 404, 109136. doi:10.1016/j.jcp.2019.109136
   Web of Science ®Google Scholar
• Jha, R. K., Ugail, H., Haron, H., & Iglesias, A. (2018). Multiresolution discrete finite difference masks for rapid solution approximation of the Poisson’s equation. 2018 12th International Conference on Software, Knowledge, Information Management & Applications (SKIMA) (pp. 1–7). Piscataway, NJ: IEEE doi:10.1109/SKIMA.2018.8631514
   Google Scholar
• Karlik, B., & Olgac, A. V. (2011). Performance analysis of various activation functions in generalized mlp architectures of neural networks. International Journal of Artificial Intelligence and Expert Systems, 1(4), 111–122.
   Google Scholar
• Kazhdan, M., Bolitho, M., & Hoppe, H. (2006). Poisson surface reconstruction. Proceedings of the fourth Eurographics symposium on Geometry processing (Vol. 7, p. 0).
   Google Scholar
• Khanna, T. (1990). Foundations of neural networks. Boston, MA: Addison-Wesley Longman Publishing Co. Inc.
   Google Scholar
• Kim, D. (2019). A modified pml acoustic wave equation. Symmetry, 11(2), 177. doi:10.3390/sym11020177
   Google Scholar
• Lagaris, I. E., Likas, A., & Fotiadis, D. I. (1998). Artificial neural networks for solving ordinary and partial differential equations. IEEE Transactions on Neural Networks, 9(5), 987–1000. doi:10.1109/72.712178
   PubMedGoogle Scholar
• LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436–444. doi:10.1038/nature14539
   PubMed Web of Science ®Google Scholar
• LeVeque, R. J., & Leveque, R. J. (1992). Numerical methods for conservation laws (Vol. 3). Berlin, Germany: Springer.
   Google Scholar
• Li, J., Cheng, J. H., Shi, J. Y., & Huang, F. (2012). Brief introduction of back propagation (bp) neural network algorithm and its improvement. Advances in computer science and information engineering (pp. 553–558). Berlin, Germany: Springer.
   Google Scholar
• Li, J., Feng, Z., & Schuster, G. (2017). Wave-equation dispersion inversion. Geophysical Journal International, 208(3), 1567–1578. doi:10.1093/gji/ggw465
   Web of Science ®Google Scholar
• Li, S., Song, W., Fang, L., Chen, Y., Ghamisi, P., & Benediktsson, J. A. (2019). Deep learning for hyperspectral image classification: An overview. IEEE Transactions on Geoscience and Remote Sensing, 57(9), 6690–6709. doi:10.1109/TGRS.2019.2907932
   Web of Science ®Google Scholar
• Mabbutt, S., Picton, P., Shaw, P., & Black, S. (2012). Review of artificial neural networks (ann) applied to corrosion monitoring. Journal of Physics: Conference Series, 364(1), 012114. doi:10.1088/1742-6596/364/1/012114
   Google Scholar
• Maharani, M., & Salhi, A. (2015). Restarting from specific points to cure breakdown in Lanczos-type algorithms. Journal of Mathematical and Fundamental Sciences, 47(2), 167–184. doi:10.5614/j.math.fund.sci.2015.47.2.5
   Google Scholar
• Maharani, M., Salhi, A., & Suharto, R. A, . (2018). Introduction of interpolation and extrapolation model in Lanczos-type algorithms a13/b6 and a13/b13 to enhance their stability. Journal of Mathematical and Fundamental Sciences, 50(2), 148–165. doi:10.5614/j.math.fund.sci.2018.50.2.4
   Web of Science ®Google Scholar
• Malek, A., & Beidokhti, R. S. (2006). Numerical solution for high order differential equations using a hybrid neural network-optimization method. Applied Mathematics and Computation, 183(1), 260–271. doi:10.1016/j.amc.2006.05.068
   Web of Science ®Google Scholar
• McCulloch, W. S., & Pitts, W. (1943). A logical calculus of the ideas immanent in nervous activity. The Bulletin of Mathematical Biophysics, 5(4), 115–133. doi:10.1007/BF02478259
   Google Scholar
• McFall, K. S. (2006). An artificial neural network method for solving boundary value problems with arbitrary irregular boundaries (Ph.D thesis). Georgia Institute of Technology, Atlanta, GA.
   Google Scholar
• McFall, K. S. (2010). Solving coupled systems of differential equations using the length factor artificial neural network method. American Society of Mechanical Engineers Early Career Technical Journal, 9, 27–34.
   Google Scholar
• Nielsen, M. A. (2015). Neural networks and deep learning (Vol. 25). San Francisco, CA: Determination Press.
   Google Scholar
• Panghal, S., & Kumar, M. (2021). Optimization free neural network approach for solving ordinary and partial differential equations. Engineering with Computers, 37(4), 2989–2914. doi:10.1007/s00366-020-00985-1
   Web of Science ®Google Scholar
• Paszke, A., Gross, S., Chintala, S., Chanan, G., Yang, E., DeVito, Z., Lerer, A. (2017). Automatic differentiation in PyTorch. 31st Conference on Neural Information Processing Systems (NIPS 2017) (pp. 1–4). Long Beach, CA.
   Google Scholar
• Pérez, P., Gangnet, M., & Blake, A. (2003). Poisson image editing. ACM SIGGRAPH 2003 Papers (pp. 313–318). doi:10.1145/1201775.882269
   Google Scholar
• Rahaman, N., Baratin, A., Arpit, D., Draxler, F., Lin, M., Hamprecht, F., … Courville, A. (2019). On the spectral bias of neural networks. International Conference on Machine Learning (pp. 5301–5310). PMLR.
   Google Scholar
• Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2019). Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational Physics, 378, 686–707. doi:10.1016/j.jcp.2018.10.045
   Web of Science ®Google Scholar
• Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985). Learning internal representations by error propagation, Tech. rep., California Univ San Diego La Jolla Inst for Cognitive Science.
   Google Scholar
• Schalkoff, R. J. (1997). Artificial neural networks. New York, NY: McGraw-Hill Higher Education.
   Google Scholar
• Shanmuganathan, S. (2016). Artificial neural network modelling: An introduction. Artificial neural network modelling (pp. 1–14). Berlin, Germany: Springer.
   Google Scholar
• Shen, Q., Sheng, Y., Chen, C., Zhang, G., & Ugail, H. (2018). A pde patch-based spectral method for progressive mesh compression and mesh denoising. The Visual Computer, 34(11), 1563–1577. doi:10.1007/s00371-017-1431-4
   Web of Science ®Google Scholar
• Sirignano, J., & Spiliopoulos, K. (2018). DGM: A deep learning algorithm for solving partial differential equations. Journal of Computational Physics, 375, 1339–1364. doi:10.1016/j.jcp.2018.08.029
   Web of Science ®Google Scholar
• Thalib, R., Bakar, M. A., & Ibrahim, N. F. (2021). Application of support vector regression in Krylov solvers. Annals of Emerging Technologies in Computing, 5(5), 178–186. doi:10.33166/AETiC.2021.05.022
   Google Scholar
• Ugail, H., & Ismail, N. B. (2016). Method of modelling facial action units using partial differential equations. Advances in face detection and facial image analysis (pp. 129–143). Berlin, Germany: Springer.
   Google Scholar
• Xiao, X., Zhou, Y., Wang, H., & Yang, X. (2020). A novel CNN-based Poisson solver for fluid simulation. IEEE Transactions on Visualization and Computer Graphics, 26(3), 1454–1465. doi:10.1109/TVCG.2018.2873375
   Web of Science ®Google Scholar