Recognition of Indian Sign Language Using ORB with Bag of Visual Words by Kinect Sensor

References

• World Federation of the Deaf, Dec. 2017. [Online]. Available: https://wfdeaf.org/our-work.
   Google Scholar
• L. Dipieto, A. M. Sabatini, and P. Dario, “A survey of glove-based systems and their applications,” IEEE Trans. on Systems, Man and Cybernetics, Vol. 38, no. 4, pp. 461–482, 2008. doi: 10.1109/TSMCC.2008.923862
   Web of Science ®Google Scholar
• X. Zhao, X. Li, and C. Pang, “Structured streaming skeleton – A new features for online human gesture recognition,” ACM Trans. Multimedia Computer Communication. Appl, Vol. 11, pp. 1–18, Sep. 2014. Article 22. doi: 10.1145/2648583
   Web of Science ®Google Scholar
• S. Mitra, and T. Acharya, “Gesture recognition: A survey,” IEEE Trans. on Systems, Man, and Cybernetics, Part C: Applications and Reviews, Vol. 37, pp. 311–324, 2007. doi: 10.1109/TSMCC.2007.893280
   Web of Science ®Google Scholar
• Z. Khan, and N. Ibraheem, “Hand gesture recognition: A literature review,” Int. J. Artif. Intel. Appl (IJAIA), Vol. 3, no. 4, 2012. doi:10.5121/ijaia.2012.3412.
   Google Scholar
• H. Yang, “Sign language recognition with Kinect sensor based on condition random field,” Sensor, pp. 137–147, 2015. doi:10.3390/s150100135.
   Google Scholar
• Y. A. Ivanov, and A. F. Bobick, “Recognition of visual activities and interactions by stochastic parsing,” IEEE Trans. Pattern Anal. Mach. Intell, Vol. 22, pp. 852–872, 2000. doi:10.1109/34.868686.
   Web of Science ®Google Scholar
• S. Marcel, “Hand posture recognition in a body-face centered space,” in Proc. Conf. Human Factors Comput. Syst. (CHI), 1999, pp. 302–303.
   Google Scholar
• W. Chung, X. Wu, and Y. Xu, “A real-time hand gesture recognition based on Haar wavelet representation,” in Proc. IEEE Int. Conf. Robot Biomimetics, 2009, pp. 336–341.
   Google Scholar
• L. Yun, and Z. Peng, “An automatic hand gesture recognition system based on Viola-Jones method and SVMs,” in Proc. 2nd Int. Workshop Comput. Sci. Eng, 2009, pp. 72–76.
   Google Scholar
• S. G. Wysoski. “A rotation invariant static hand gesture recognition system using boundary information and neural networks,” ME thesis, Nagoya Institute of Technology, 2003.
   Google Scholar
• Q. Chen, N. D. Georganas, and E. M. Petriu, “Hand gesture recognition using Haar-like features and a stochastic context-free grammar,” IEEE Trans. Instrum. Meas., Vol. 57, no. 8, pp. 1562–1571, 2008. doi: 10.1109/TIM.2008.922070
   Web of Science ®Google Scholar
• F. Yikai, W. Kongqiao, C. Jian, and L. Hanquing, “A real-time hand gesture recognition method,” in Proceeding of the IEEE International Conference on Multimedia and Expo (ICME’07), 2007.
   Google Scholar
• M. Elmezai, A. Al-Hamadi, G. Krell, S. El-Etriby, and B. Michaelis, “Gesture recognition for alphabets from hand motion trajectory using hidden Markov models,” in Proceeding of IEEE International Symposium on Signal Processing and Information Technologies, 2007.
   Google Scholar
• D. H. Nasser, and G. D. Nicolas, “Real-time hand gesture detection and recognition using bag-of-features and support vector machine techniques,” IEEE Trans. Instrum. Meas., Vol. 60, no. 11, pp. 3592–3607, 2011. doi: 10.1109/TIM.2011.2161140
   Web of Science ®Google Scholar
• H. Khaled, S. G. Sayed, E. S. M. Saad, and H. Ali, “Hand gesture recognition using modified 1$ and background subtraction algorithms,” J Math Probl Eng, pp. 1–8, 2015.
   Web of Science ®Google Scholar
• P. Kishore, K. P. Rajesh, K. E. Kiran, and S. Kishore, “Video audio interface for recognizing gestures of Indian sign language,” Int. J. Image Process (IJIP), Vol. 5, pp. 479–503, 2011.
   Google Scholar
• P. S. Rajam, and G. Balakrishnan, “Real-time Indian sign language recognition system to aid deaf-dumb people,” in IEEE 13th International Conference on Communication Technology, 2011, pp. 737–742.
   Google Scholar
• M. Geetha, and U. Manjusha, “A vision-based recognition of Indian sign language alphabets and numerals using B-spline approximation,” Int. J. Comp. Sci. Eng. (IJCSE), Vol. 4, no. 3, pp. 406–415, 2012.
   Google Scholar
• T. Starner, J. Weaver, and A. Pentland, “Real-time American sign language recognition using desk and wearable computer-based video,” IEEE Trans. Pattern Anal. Mach. Intell, Vol. 20, no. 12, pp. 1371–1375, 1998. doi: 10.1109/34.735811
   Web of Science ®Google Scholar
• J. Rekha, J. Bhattacharya, and S. Majumder, “Shape, texture and local movement hand gesture features for Indian sign language recognition,” in 3rd International Conference on Trends in Information Sciences and Computing (TISC), 2011, pp. 30–35.
   Google Scholar
• M. Bhuyan, M. K. Kar, and D. R. Neogo, “Hand pose identification from monocular image for sign language recognition,” in IEEE International Conference on Signal and Image Processing Applications (ICSIPA), 2011, pp. 378–383.
   Google Scholar
• K. G. Kharate, and S. A. Ghotkar, “Vision-based multi-feature hand gesture recognition for Indian sign language manual signs,” Int. J. Smart Sensing and Intelligent Systems, Vol. 9, no. 1, pp. 124–147, 2016. doi: 10.21307/ijssis-2017-863
   Web of Science ®Google Scholar
• M. R. Andersen, and T. Jensen, “Kinect depth sensor evaluation for computer vision applications,” Technical Report Electronic and Computer Engineering, Vol. 1, pp. 1–37, 2012.
   Google Scholar
• S. Qin, X. Zhu, Y. Yang, and Y. Jiang, “Real-time hand gesture recognition from depth images using convex shape decomposition method,” J. Signal. Process. Syst., Vol. 74, pp. 47–58, 2014. doi: 10.1007/s11265-013-0778-7
   Web of Science ®Google Scholar
• Z. Ren, J. Yuan, and Z. Zhang, “Robust hand gesture recognition based on finger-earth mover’s distance with a commodity depth camera,” in ACM International Conference on Multimedia, Scottsdale, 2011, pp. 1093–1109.
   Google Scholar
• Y. Chong, J. Huang, and S. Pan, “Hand gesture recognition using appearance features based on the 3D point cloud,” J Softw Eng Appl, Vol. 09, pp. 103–111, 2016. doi: 10.4236/jsea.2016.94009
   Google Scholar
• A. Joshi, C. Monnier, M. Betke, and S. Sclaroff, “Comparing random forest approaches to segmenting and classifying gestures,” J Image Vis Comput, pp. 1–10, 2016. doi:10.1016/j.imavis.2016.06.001.
   Google Scholar
• K. Mehrotra, A. Godbole, and S. Belhe, “Indian sign language recognition using Kinect sensor,” in International Conference on Image Analysis and Recognition, 2015, pp. 528–535.
   Google Scholar
• A. Zafar, and G. Harit, “Nearest neighbor classification of Indian sign language gestures using the kinect camera,” SADHANA, Vol. 41, no. 2, pp. 161–182, 2016. doi: 10.1007/s12046-015-0405-3
   Web of Science ®Google Scholar
• S. G. M. Almeida, F. G. Guimaraes, and J. A. Ramırez, “Feature extraction in Brazilian sign language recognition based on phonological structure and using rgb-d sensors,” Expert. Syst. Appl., Vol. 41, no. 16, pp. 7259–7271, 2014. doi: 10.1016/j.eswa.2014.05.024
   Web of Science ®Google Scholar
• N. Pugeault, and R. Bowden, “Spelling it out: Real-time ASL fingerspelling recognition,” in IEEE International Conference on Computer Vision Workshops (ICCV Workshops), 2014, pp. 1114–1119.
   Google Scholar
• C. Keskin, F. Kıraç, Y. E. Kara, and L. Akarun. “Real-time hand pose estimation using depth sensors,” in Consumer depth cameras for computer vision, Springer, 2013, pp. 119–137.
   Google Scholar
• ISL Sign dictionaries for Indian deaf and dumb population Sign Language Unit, The Faculty of Disability Management & Special Education (FDMSE) of Ramakrishna Mission Vidyalaya, Perianaickenpalayam, Coimbatore, India, 2011. Available: https://indiansignlanguage.org
   Google Scholar
• G. Bradski, and A. Kaehler. Learning OpenCV. Sebastopol, CA: O’Reilly Media Inc, 2008, pp. 1–30.
   Google Scholar
• C. W. Hsu, and C. J. Lin, “A simple decomposition method for support vector machines,” Journal of Machine Learning, Vol. 46, pp. 291–314, 2002. doi:10.1023/A:10242. doi: 10.1023/A:1012427100071
   Google Scholar
• M. K. Hu, “Visual pattern recognition by moment invariants,” IRE Trans. Info. Theory, Vol. IT-8, pp. 179–187, 1962.
   Web of Science ®Google Scholar
• D. G. Lowe, “Distinctive image features from scale-invariant keypoints,” Int. J. Computer Vis, Vol. 60, no. 2, pp. 91–110, Nov. 2004. doi: 10.1023/B:VISI.0000029664.99615.94
   Web of Science ®Google Scholar
• H. Bay, T. Tuytelaars, and L. Van Gool. “SURF: Speeded up robust features,” in Computer vision – ECCV 2006. Lecture notes in computer science, Vol. 3951, A. Leonardis, H. Bischof, and A. Pinz Eds. Berlin, Heidelberg: Springer, 2006, pp. 404–417.
   Google Scholar
• E. Rublee, V. Rabaud, K. Konolige, and G. Bradski, “ORB: An efficient alternative to SIFT or SURF,” in IEEE International Conference on Computer Vision (ICCV), 2011.
   Google Scholar
• E. Rosten, and T. Drummond, “Machine learning for high-speed corner detection,” 9th European Conference on Computer Vision, Vol. 1, pp. 430–443, 2006.
   Google Scholar
• C. Gabriella, C. R. Dance, F. Lixin, J. Willamowski, and C. Bray. “Visual categorization with bags of keypoints,” in Workshop on statistical learning in computer vision, ECCV, 2004.
   Google Scholar
• O. Boiman, “In defense of nearest-neighbor based image classification,” Comput. Vis. Pattern Recognit, pp. 1–8, 2008.
   Google Scholar
• G. Li, H. Tang, Y. Sun, J. Kong, G. Jiang, D. Jiang, B. Tao, S. Xu, and H. Liu, “Hand gesture recognition based on convolution neural network,” Cluster. Comput., Vol. 22, pp. 2719–2729, 2019. doi: 10.1007/s10586-017-1435-x
   Web of Science ®Google Scholar
• Y. Li, X. Wang, W. Liu, and B. Feng, “Deep attention network for joint hand gesture localization and recognition using static RGB-D images,” Inf. Sci. (Ny), Vol. 441, pp. 66–78, 2018. doi: 10.1016/j.ins.2018.02.024
   Web of Science ®Google Scholar
• B. Xie, X. y. He, and Y. Li, “RGB-D static gesture recognition based on convolutional neural network,” J. Eng, Vol. 2018, no. 16, pp. 1515–1520, 2018.
   Google Scholar
• L. Jing, E. Vahdani, M. Huenerfauth, and Y. Tian, “Recognizing American sign language manual signs from RGB-D videos,” Comput. Vis. Pattern Recognit, 2019, arXiv: 1906.02851.
   Google Scholar
• P. K. Pisharady, P. Vadakkepat, and L. A. Poh, “Hand posture and face recognition using a fuzzy-rough approach,” Int. J. Humanoid Rob., Vol. 07, no. 3, pp. 331–356, Sept. 2010. doi: 10.1142/S0219843610002180
   Google Scholar
• P. K. Pisharady, P. Vadakkepat, and A. P. Loh, “Attention based detection and recognition of hand postures against complex backgrounds,” Int. J. Comput. Vision, Vol. 101, no. 3, pp. 403–419, Feb. 2013. doi: 10.1007/s11263-012-0560-5
   Web of Science ®Google Scholar
• Support vector machine. [Online]. Available: https://scikit-learn.org/stable/modules/svm.html.
   Google Scholar