Open Access Open Access  Restricted Access Subscription or Fee Access

Dynamic Indian Sign Language Character Recognition: Using HOG Descriptor and a Customized Neural Network

M. Niranjan, J. Ajtih, S. Padmavathi

Abstract


Communication is the exchange of thoughts, messages, or information, by speech, visual signals, writing, or behaviour. Deaf and dumb people communicate among themselves using sign languages, but they find it difficult to expose themselves to the outside world. This paper proposes a method for recognizing Indian sign language (ISL) Two hand characters given as input by the user in the form of hand gestures. There are 18 ISL characters which are shown using two hands. Unlike the conventional method, this method does not require any additional hardware and makes the user comfortable. The system takes input at real time through a webcam integrated in the laptop. The hand region is separated out from the background using skin segmentation and motion segmentation. Since the segregation of overlapping hands is difficult, two hand characters are identified using HOG features. A back propagation neural network is used as the learning algorithm to make the system adaptable for different users. The system has been tested for several people of varying skin complexions, in several environments and was found to have accuracy of about 90%. The accuracy mainly dropped due to the illumination of the environment and occlusion of hands involved in two hand gestures.

Keywords


Indian Sign Language Recognition, Hand gesture recognition, hand segmentation, Histogram of orientation gradient (HOG).

Full Text:

PDF


Disclaimer/Regarding indexing issue:

We have provided the online access of all issues and papers to the indexing agencies (as given on journal web site). It’s depend on indexing agencies when, how and what manner they can index or not. Hence, we like to inform that on the basis of earlier indexing, we can’t predict the today or future indexing policy of third party (i.e. indexing agencies) as they have right to discontinue any journal at any time without prior information to the journal. So, please neither sends any question nor expects any answer from us on the behalf of third party i.e. indexing agencies.Hence, we will not issue any certificate or letter for indexing issue. Our role is just to provide the online access to them. So we do properly this and one can visit indexing agencies website to get the authentic information.