4,806
Views
3
CrossRef citations to date
0
Altmetric
Research Article

Smart Control of Home Appliances Using Hand Gesture Recognition in an IoT-Enabled System

, , , , , & show all
Article: 2176607 | Received 15 Nov 2022, Accepted 31 Jan 2023, Published online: 15 Feb 2023

References

  • Relay. [Online] Available: https://tutorials.webduino.io/zh-tw/docs/basic/component/relay.html. May 2022a.
  • Alemuda, F. 2017. Gesture-based control in a smart home environment, Master Thesis,International Graduate Program of Electrical Engineering and Computer Science,National Chiao Tung University.
  • Chen, X., Y. Li, R. Hu, X. Zhang, and X. Chen. 2021. Hand gesture recognition based on surface electromyography using convolutional neural network with transfer learning method. IEEE Journal of Biomedical and Health Informatics 25 (4):1292–647. doi:10.1109/JBHI.2020.3009383.
  • Gan, L., Y. Liu, Y. Li, R. Zhang, L. Huang, and C. Shi. 2022. Gesture recognition system using 24 GHz FMCW radar sensor realized on real-time edge computing platform. IEEE Sensors Journal 22 (9):8904–14. doi:10.1109/JSEN.2022.3163449.
  • Get to know android studio. [Online] Available: https://developer.android.com/studio/intro?hl=zh-tw. May 2022b.
  • GitHub android studio. [Online] Available: https://github.com/android. May 2022c.
  • GitHub Google/mediapipe. [Online] Available: https://github.com/google/mediapipe. May 2022d.
  • GitHub tfreytag/WoPeD. [Online] Available: https://github.com/tfreytag/WoPeD (Visited in 2022/05)
  • GitHub Thonny. [Online] Available: https://github.com/thonny/thonny. May 2022e.
  • Gogineni, K., A. Chitreddy, A. Vattikuti, and N. Palaniappan. 2020. Gesture and speech recognizing helper bot. Applied Artificial Intelligence 34 (7):585–95. doi:10.1080/08839514.2020.1740473.
  • Hamroun, A., K. Labadi, M. Lazri, S. B. Sanap, V. K. Bhojwani, and M. V K. 2020. Modelling and performance analysis of electric car-sharing systems using Petri nets. E3S Web of Conferences 170 (3001):1–6. doi:10.1051/e3sconf/202017003001.
  • Kloetzer, M., and C. Mahulea. 2020. Path planning for robotic teams based on LTL specifications and petri net models. Discrete Event Dynamic Systems 30 (1):55–79. doi:10.1007/s10626-019-00300-1.
  • Lee, F. N. 2019. A real-time gesture recognition system based on image processing, Master Thesis, Department of Communication Engineering, National Taipei University.
  • Lin, C. H. 2018. ESP8266-based IoTtalk device application: Implementation and performance evaluation, Master Thesis, Graduate Institute of Network Engineering, National Chiao Tung University.
  • Ling, Y., X. Chen, Y. Ruan, X. Zhang, and X. Chen. 2021. Comparative study of gesture recognition based on accelerometer and photoplethysmography sensor for gesture interactions in wearable devices. IEEE Sensors Journal 21 (15):17107–17. doi:10.1109/JSEN.2021.3081714.
  • Lugaresi, C., J. Tang, H. Nash, C. McClanahan, E. Uboweja, M. Hays, F. Zhang, C. L. Chang, M. G. Yong, J. Lee et al, 2019. Mediapipe: A framework for building perception pipelines. arXiv preprint arXiv:1906.08172. doi:10.48550/arXiv.1906.08172.
  • Lu, X., S. Sun, K. Liu, J. Sun, and L. Xu. 2022. Development of a wearable gesture recognition system based on two-terminal electrical impedance tomography. IEEE Journal of Biomedical and Health Informatics 26 (6):2515–23. doi:10.1109/JBHI.2021.3130374.
  • OkHttp Internet Connection. [Online] Available: https://ithelp.ithome.com.tw/articles/10188600. May 2022.
  • OkHttp : Use Report for Android Third-party. [Online] Available: https://bng86.gitbooks.io/android-third-party-/content/okhttp.html. May 2022.
  • Padhy, S. 2021. A tensor-based approach using multilinear SVD for hand gesture recognition from sEMG signals. IEEE Sensors Journal 21 (5):6634–42. doi:10.1109/JSEN.2020.3042540.
  • Rajyalakshmi, V., and K. Lakshmanna. 2022. A review on smart city - IoT and deep learning algorithms, challenges. International Journal of Engineering Systems Modelling and Simulation 13 (1):3–26. doi:10.1504/IJESMS.2022.122733.
  • Ramadan, Z., M. F. Farah, and L. El Essrawi. 2020. Amazon.Love: How Alexa is redefining companionship and interdependence for people with special needs. Psychology & Marketing 10 (1):1–12.
  • Reference program for static gesture-image 2D method GitCode. [Online] Available: https://gitcode.net/EricLee/handpose_x/-/issues/3?from_codechina=yes. May 2022f.
  • Riedel, A., N. Brehm, and T. Pfeifroth. 2021. Hand gesture recognition of methods-time measurement-1 motions in manual assembly tasks using graph convolutional networks. Applied Artificial Intelligence 36 (1):1–12. doi:10.1080/08839514.2021.2014191.
  • Sharma, V., M. Gupta, A. K. Pandey, D. Mishra, and A. Kumar. 2022. A review of deep learning-based human activity recognition on benchmark video datasets. Applied Artificial Intelligence 36 (1):1–11. doi:10.1080/08839514.2022.2093705.
  • Shen, X., H. Zheng, X. Feng, and J. Hu. 2022. ML-HGR-Net: A meta-learning network for fmcw radar based hand gesture recognition. IEEE Sensors Journal 22 (11):10808–17. doi:10.1109/JSEN.2022.3169231.
  • Shih, W. H. 2019. Applying IoT and gesture control technology to build a friendly smart home environment, Master Thesis, Department of Computer Science & Information Engineering, Chung Hua University.
  • Thonny, Python IDE for beginners. [Online] Available: https://thonny.org/. May 2022.
  • WoPeD (Workflow Petri Net Designer). [Online] Available: https://woped.dhbw-karlsruhe.de/ (Visited in 2022/05)
  • Yu, C. R. 2021. Virtual touch system with assisted gesture based on deep learning and MediaPipe, Master Thesis, Department of Computer Science and Information Engineering, National Chung Cheng University.
  • Zeng, J., Y. Zhou, Y. Yang, J. Yan, and H. Liu. 2022. Fatigue-sensitivity comparison of sEMG and a-mode ultrasound based hand gesture recognition. IEEE Journal of Biomedical and Health Informatics 26 (4):1718–25. doi:10.1109/JBHI.2021.3122277.
  • Zhang, F., V. Bazarevsky, A. Vakunov, A. Tkachenka, G. Sung, C. L. Chang, and M. Grundmann. 2020. MediaPipe hands: On-device real-time hand tracking. arXiv preprintarXiv: 200610214
  • Zhu, H., J. Chen, X. Cai, Z. Ma, R. Jin, and L. Yang. 2019. A security control model based on Petri net for industrial IoT, Procs. of IEEE International Conference on Industrial Internet (ICII), Orlando, FL, USA, 156–59.