Publication Cover
Assistive Technology
The Official Journal of RESNA
Volume 24, 2012 - Issue 4
210
Views
9
CrossRef citations to date
0
Altmetric
Original Articles

An Intelligent Computer-Based System for Sign Language Tutoring

, &
Pages 299-308 | Published online: 27 Sep 2012
 

ABSTRACT

A computer-based system for sign language tutoring has been developed using a low-cost data glove and a software application that processes the movement signals for signs in real-time and uses Pattern Matching techniques to decide if a trainee has closely replicated a teacher's recorded movements. The data glove provides 17 movement signals from Bend sensors and push down switches and is used initially by the teacher to record selected signs. A trainee can study an animated 3D model of a hand and arm showing the recorded sign movements at leisure, before using the data glove to try and replicate the sign. Four Arabic Sign Language (ArSL) teachers provided 65 common posture and gesture signs, and then 10 trainees from the local community were asked to evaluate the system. They achieved an overall average accuracy of 93.8% in replicating the signs, despite finding the gestures harder than the postures to perform, and found approximately 18% of the signs difficult because of particular thumb/finger and wrist bending angles. Both the teachers and the trainees were familiar with these signs, and a usability questionnaire revealed that they preferred this approach to sign-language tutoring than the traditional human based method they had already experienced.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.