Development of a low-resource wearable continuous gesture-to-speech conversion system

References

• Uebersax D, Gall J, Van den Bergh M, et al. Real-time sign language letter and word recognition from depth data. In: 2011 IEEE international conference on computer vision workshops (ICCV Workshops); IEEE; 2011. p. 383–390.
   Google Scholar
• Pansare JR, Ingle M. Vision-based approach for american sign language recognition using edge orientation histogram. In: 2016 International Conference on Image, Vision and Computing (ICIVC); IEEE; 2016. p. 86–90.
   Google Scholar
• Starner T, Weaver J, Pentland A. Real-time american sign language recognition using desk and wearable computer based video. IEEE Trans Pattern Anal Machine Intell. 1998;20(12):1371–1375.
   Web of Science ®Google Scholar
• Liu Z, Chai X, Liu Z, et al. Continuous gesture recognition with hand-oriented spatiotemporal feature. In: Proceedings of the IEEE International Conference on Computer Vision; 2017. p. 3056–3064.
   Google Scholar
• Lee HK, Kim J. An hmm-based threshold model approach for gesture recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1999;21(10):961–973.
   Web of Science ®Google Scholar
• Kumar DA, Kishore P, Sastry A, et al. Selfie continuous sign language recognition using neural network. In: 2016 IEEE Annual India Conference (INDICON); IEEE; 2016. p. 1–6.
   Google Scholar
• Cihan Camgoz N, Hadfield S, Koller O, et al. Neural sign language translation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; 2018. p. 7784–7793.
   Google Scholar
• Ye Y, Tian Y, Huenerfauth M, et al. Recognizing american sign language gestures from within continuous videos. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops; 2018. p. 2064–2073.
   Google Scholar
• Islam MM, Siddiqua S, Afnan J. Real time hand gesture recognition using different algorithms based on american sign language. In: 2017 IEEE international conference on imaging, vision & pattern recognition (icIVPR); IEEE; 2017. p. 1–6.
   Google Scholar
• Oyedotun OK, Khashman A. Deep learning in vision-based static hand gesture recognition. Neural Comput & Applic. 2017;28(12):3941–3951.
   Web of Science ®Google Scholar
• Phi LT, Nguyen HD, Bui TQ, et al. A glove-based gesture recognition system for vietnamese sign language. In: 2015 15th International Conference on Control, Automation and Systems (ICCAS); IEEE; 2015. p. 1555–1559.
   Google Scholar
• Aarthi M, Vijayalakshmi P. Sign language to speech conversion. In: 2016 International Conference on Recent Trends in Information Technology (ICRTIT); IEEE; 2016. p. 1–6.
   Google Scholar
• Akl A, Valaee S. Accelerometer-based gesture recognition via dynamic-time warping, affinity propagation, & compressive sensing. In: 2010 IEEE International Conference on Acoustics, Speech and Signal Processing; IEEE; 2010. p. 2270–2273.
   Google Scholar
• Galka J, Masior M, Zaborski M, et al. Inertial motion sensing glove for sign language gesture acquisition and recognition. IEEE Sensors J. 2016;16(16):6310–6316.
   Web of Science ®Google Scholar
• Xu R, Zhou S, Li WJ. Mems accelerometer based nonspecific-user hand gesture recognition. IEEE Sensors J. 2012;12(5):1166–1173.
   Web of Science ®Google Scholar
• Wu J, Sun L, Jafari R. A wearable system for recognizing american sign language in real-time using imu and surface emg sensors. IEEE J Biomed Health Inform. 2016;20(5):1281–1290.
   PubMed Web of Science ®Google Scholar
• Aiswarya V, Naren Raju N, Johanan Joysingh S, et al. Hidden markov model-based sign language to speech conversion system in tamil. In: 2018 Fourth International Conference on Biosignals, Images and Instrumentation (ICBSII); IEEE; 2018. p. 206–212.
   Google Scholar
• Jayapriya R, Johanan Joysingh S, Vijayalakshmi P, et al. Development of mems sensorbased double handed gesture-to-speech conversion system. In: 2019 International Conference on Vision Towards Emerging Trends in Communication and Networking (ViTECoN); IEEE; 2019. p. 1–6.
   Google Scholar
• Zhang X, Chen X, Li Y, et al. A framework for hand gesture recognition based on accelerometer and emg sensors. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans. 2011;41(6):1064–1076.
   Web of Science ®Google Scholar
• Kim JH, Thang ND, Kim TS. 3-d hand motion tracking and gesture recognition using a data glove. In: 2009 IEEE International Symposium on Industrial Electronics; IEEE; 2009. p. 1013–1018.
   Google Scholar
• Abhishek KS, Qubeley LCF, Ho D. Glove-based hand gesture recognition sign language translator using capacitive touch sensor. In: 2016 IEEE International Conference on Electron Devices and Solid-State Circuits (EDSSC); IEEE; 2016. p. 334–337.
   Google Scholar
• Oz C, Leu MC. American sign language word recognition with a sensory glove using artificial neural networks. Engineering Applications of Artificial Intelligence. 2011;24(7):1204–1213.
   Web of Science ®Google Scholar
• Fang B, Sun F, Liu H, et al. 3d human gesture capturing and recognition by the immubased data glove. Neurocomputing. 2018;277:198–207.
   Web of Science ®Google Scholar
• Nagarajan T, O’Shaughnessy D. Bias estimation and correction in a classifier using product of likelihood-gaussians. In: 2007 IEEE International Conference on Acoustics, Speech and Signal Processing-ICASSP’07; Vol. 3; IEEE; 2007. p. 1061–1064.
   Google Scholar
• VijayaRajSolomon SS, Parthasarathy V, Thangavelu N. Exploiting acoustic similarities between tamil and indian english in the development of an hmm-based bilingual synthesiser. IET Signal Process. 2017;11(3):332–340.
   Web of Science ®Google Scholar
• Dhanalakshmi M, Celin TM, Nagarajan T, et al. Speech-input speech-output communication for dysarthric speakers using hmm-based speech recognition and adaptive synthesis system. Circuits Syst Signal Process. 2018;37(2):674–703.
   Web of Science ®Google Scholar
• Celin TM, Rachel GA, Nagarajan T, et al. A weighted speaker-specific confusion transducer-based augmentative and alternative speech communication aid for dysarthric speakers. IEEE Trans Neural Syst Rehabil Eng. 2019; 27(2):187–197.
   PubMed Web of Science ®Google Scholar
• Rachel GA, Solomi VS, Naveenkumar K, et al. A small-footprint context-independent hmm-based synthesizer for tamil. Int J Speech Technol. 2015;18(3):405–418. Springer.
   Google Scholar