Digital twin for human-machine interaction with convolutional neural network

References

• Aivaliotis, P., Georgoulias, K., and Chryssolouris, G. 2019. The use of Digital Twin for predictive maintenance in manufacturing. International Journal of Computer Integrated Manufacturing, 32(11), 1067–1080.
   Google Scholar
• Ashton, K., et al. 2009. “That ‘Internet of Things’ Thing.” RFID journal 22 (7): 97–114.
   Google Scholar
• Cai, Y., B. Starly, P. Cohen, and Y.-S. Lee. 2017. “Sensor Data and Information Fusion to Construct Digital-twins Virtual Machine Tools for Cyber-physical Manufacturing.” Procedia Manufacturing 10: 1031–1042. doi:https://doi.org/10.1016/j.promfg.2017.07.094.
   Google Scholar
• Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., and Wei, Y. 2017. “Deformable convolutional networks”. In Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy, 764–773.
   Google Scholar
• Delbrügger, T., and Rossmann, J. 2019. “Representing adaptation options in experimentable digital twins of production systems”. International Journal of Computer Integrated Manufacturing, 32(4-5), 352–365.
   Google Scholar
• Fourgeau, E., Gomez, E., Adli, H., Fernandes, C., and Hagege, M. 2016. “System engineering workbench for multi-views systems methodology with 3DEXPERIENCE Platform. the aircraft radar use case”. In Complex Systems Design & Management Asia. 269–270. Springer, Cham, Switzerland.
   Google Scholar
• Gabor, T., Belzner, L., Kiermeier, M., Beck, M. T., and Neitz, A. 2016. “A simulation-based architecture for smart cyber-physical systems”. In Proceedings of IEEE international conference on autonomic computing, Würzburg, Germany, 374–379.
   Google Scholar
• Grieves, M. 2014. “Digital twin: manufacturing excellence through virtual factory replication”. White paper, 1, 1–7.
   Google Scholar
• He, K., Zhang, X., Ren, S., and Sun, J. 2016. “Deep residual learning for image recognition”. In Proceedings of the IEEE conference on computer vision and pattern recognition. Las Vegas, Nevada, USA. 770–778.
   Google Scholar
• Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., and Salakhutdinov, R. R. 2012. “Improving neural networks by preventing co-adaptation of feature detectors”. arXiv preprint arXiv:1207.0580.
   Google Scholar
• Ioffe, S., and Szegedy, C. 2015. “Batch normalization: Accelerating deep network training by reducing internal covariate shift”. In Proceedings of International conference on machine learning. Lile, France. 448–456.
   Google Scholar
• Islam, T., S. C. Mukhopadhyay, and N. K. Suryadevara. 2017. “Smart Sensors and Internet of Things: A Postgraduate Paper.” IEEE Sensors Journal 17 (3): 577–584. doi:https://doi.org/10.1109/JSEN.2016.2630124.
   Web of Science ®Google Scholar
• Ji, S., X. Wei, M. Yang, and Y. Kai. 2013. “3D Convolutional Neural Networks for Human Action Recognition.” IEEE Transactions on Pattern Analysis and Machine Intelligence 35 (1): 221–231. doi:https://doi.org/10.1109/TPAMI.2012.59.
   PubMed Web of Science ®Google Scholar
• Kagermann, H. 2015. “Change through digitization-Value creation in the age of Industry 4.0”. In Management of permanent change. 23–45. Springer Gabler, Wiesbaden.
   Google Scholar
• Krizhevsky, A., Sutskever, I., and Hinton, G. E. 2012. “Imagenet classification with deep convolutional neural networks”. Advances in neural information processing systems, Harrahs and Harveys, Lake Tahoe, USA.25, 1097–1105.
   Google Scholar
• LeCun, Y., B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard, and L. D. Jackel. 1989. “Backpropagation Applied to Handwritten Zip Code Recognition.” Neural Computation 1 (4): 541–551. doi:https://doi.org/10.1162/neco.1989.1.4.541.
   Web of Science ®Google Scholar
• Li, B.-H., L. Zhang, S.-L. Wang, F. Tao, J. W. Cao, X. D. Jiang, X. Song, and X. D. Chai. 2010. “Cloud Manufacturing: A New Service-oriented Networked Manufacturing Model.” Computer Integrated Manufacturing Systems 16 (1): 1–7.
   Google Scholar
• Majumdar, P. K., FaisalHaider, M., and Reifsnider, K. 2013. “Multi-physics response of structural composites and framework for modeling using material geometry”. In Proceedings of AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference. Boston, Massachusetts, USA. 1577.
   Google Scholar
• Mell, P., T. Grance, et al. 2011. “The NIST Definition of Cloud Computing.”
   Google Scholar
• Moreno, A., G. Velez, A. Ardanza, I. Barandiaran, Á. R. De Infante, and R. Chopitea. 2017. “Virtualisation Process of a Sheet Metal Punching Machine within the Industry 4.0 Vision.” International Journal on Interactive Design and Manufacturing (Ijidem) 11 (2): 365–373. doi:https://doi.org/10.1007/s12008-016-0319-2.
   Google Scholar
• Neto, P. 2011. “Demystifying cloud computing”. In Proceeding of doctoral symposium on informatics engineering. Porto, Portugal. 24,16–21.
   Google Scholar
• Park, K. T., Nam, Y. W., Lee, H. S., Im, S. J., Noh, S. D., Son, J. Y., and Kim, H. 2019. “Design and implementation of a digital twin application for a connected micro smart factory”. International Journal of Computer Integrated Manufacturing, 32(6), 596-614.
   Google Scholar
• Ricks, T. M., Lacy, T., Pineda, E. J., Bednarcyk, B. A., and Arnold, S. M. 2015. “Computationally efficient solution of the high-fidelity generalized method of cells micromechanics relations”. In Proceedings of the American Society for Composites 30th Annual Technical Conference. East Lansing, Michigan, USA. 28-30.
   Google Scholar
• Ríos, J., Hernandez, J. C., Oliva, M., and Mas, F. 2015. “Product Avatar as Digital Counterpart of a Physical Individual Product: Literature Review and Implications in an Aircraft”. In Proceedings of ISPE CE. Delft, the Netherlands. 657-666.
   Google Scholar
• Schroeder, G. N., C. Steinmetz, C. E. Pereira, and D. B. Espindola. 2016. “Digital Twin Data Modeling with Automationml and a Communication Methodology for Data Exchange.” IFAC-PapersOnLine 49 (30): 12–17. doi:https://doi.org/10.1016/j.ifacol.2016.11.115.
   Google Scholar
• Scott-Emuakpor, O., George, T., Beck, J., Schwartz, J., Holycross, C., Shen, M. H., and Slater, J. 2014. “Material property determination of vibration fatigued DMLS and cold-rolled nickel alloys”. In  Proceedings ofTurbo Expo: Power for Land, Sea, and Air. Düsseldorf, Germany. 45769, V07AT28A008. American Society of Mechanical Engineers.
   Google Scholar
• Simonyan, K., and Zisserman, A. 2014. “Two-stream Convolutional Networks for Action Recognition in Videos.” Advances in neural information processing systems, Montreal, Quebec, Canada. 568–576.
   Google Scholar
• Simonyan, K., and Zisserman, A. 2015. “Very deep convolutional networks for large-scale image recognition”. In Proceedings of International Conference on Learning Representations. San Diego, California, USA. 1–14
   Google Scholar
• Tao, F., and Qi, Q. 2017. “New IT driven service-oriented smart manufacturing: framework and characteristics”. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 49(1), 81-91.
   Google Scholar
• Tao, F., Q. Qinglin, A. Liu, and A. Kusiak. 2018. “Data-driven Smart Manufacturing.” Journal of Manufacturing Systems 48: 157–169. doi:https://doi.org/10.1016/j.jmsy.2018.01.006.
   Web of Science ®Google Scholar
• Tao, F., Cheng, Y., Cheng, J., Zhang, M., Xu, W., and Qi, Q. 2017. “Theories and technologies for cyber-physical fusion in digital twin shop-floor”. Computer Integrated Manufacturing Systems 23(8), 1603-1611.
   Google Scholar
• Tao, F., Y. Cheng, L. Da Xu, L. Zhang, and B. H. Li. 2014. “CCIoT-CMfg: Cloud Computing and Internet of Things-based Cloud Manufacturing Service System.” IEEE Transactions on Industrial Informatics 10 (2): 1435–1442. doi:https://doi.org/10.1109/TII.2014.2306383.
   Web of Science ®Google Scholar
• Tran, D., Wang, H., Torresani, L., Ray, J., LeCun, Y., and Paluri, M. 2018. “A closer look at spatiotemporal convolutions for action recognition”. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City, Utah, USA. 6450-6459.
   Google Scholar
• Tran, D., Bourdev, L., Fergus, R., Torresani, L., and Paluri, M. 2015. “Learning spatiotemporal features with 3d convolutional networks”. In Proceedings of the IEEE International Conference on Computer Vision. Santiago, Chile. 4489–4497.
   Google Scholar
• Uhlemann, T. H.-J., C. Schock, C. Lehmann, S. Freiberger, and R. Steinhilper. 2017. “The Digital Twin: Demonstrating the Potential of Real Time Data Acquisition in Production Systems.” Procedia Manufacturing 9: 113–120. doi:https://doi.org/10.1016/j.promfg.2017.04.043.
   Google Scholar
• Wang, T., C. Zhang, H. Snoussi, and G. Zhang. 2020. “Machine Learning Approaches for Thermoelectric Materials Research.” Advanced Functional Materials 30 (5): 1906041. doi:https://doi.org/10.1002/adfm.201906041.
   Web of Science ®Google Scholar
• Wang, T., Qiao, M., Zhang, M., Yang, Y., and Snoussi, H. 2018. “Data-driven prognostic method based on self-supervised learning approaches for fault detection”. Journal of Intelligent Manufacturing  31(7):1611–1619
   Google Scholar
• Wang, T., M. Shao, R. Guo, F. Tao, G. Zhang, H. Snoussi, and X. Tang. 2021. “Surrogate Model via Artificial Intelligence Method for Accelerating Screening Materials and Performance Prediction.” Advanced Functional Materials 31 (8): 2006245. doi:https://doi.org/10.1002/adfm.202006245.
   Web of Science ®Google Scholar
• Wang, T., Y. Chen, M. Zhang, J. I. E. Chen, and H. Snoussi. 2017a. “Internal Transfer Learning for Improving Performance in Human Action Recognition for Small Datasets.” IEEE Access 5: 17627–17633. doi:https://doi.org/10.1109/ACCESS.2017.2746095.
   Web of Science ®Google Scholar
• Wang, X. V., Z. Kemény, J. Váncza, and L. Wang. 2017b. “Human–robot Collaborative Assembly in Cyber-physical Production: Classification Framework and Implementation.” CIRP Annals 66 (1): 5–8. doi:https://doi.org/10.1016/j.cirp.2017.04.101.
   Web of Science ®Google Scholar