Dynamic Hand Gesture Recognition of Arabic Sign Language using Hand Motion Trajectory Features

Mohamed sameer Mohamed Abdalla; Elsayed E. Hemayed

Dynamic Hand Gesture Recognition of Arabic Sign Language using Hand Motion Trajectory Features

Mohamed sameer Mohamed Abdalla * §

Contact

Elsayed E. Hemayed

Contact

§ Faculty of Engineering Cairo University

Dynamic Hand Gesture Recognition of Arabic Sign Language using Hand Motion Trajectory Features

Article Fingerprint

ReserarchID

CSTV6NKP

Dynamic Hand Gesture Recognition of Arabic Sign Language using Hand Motion Trajectory Features Banner

Key Research Insights

Synthesized scholarly intelligence & interactive research assistant

Abstract

In this paper we propose a system for dynamic hand gesture recognition of Arabic Sign Language. The proposed system takes the dynamic gesture (video stream) as input, extracts hand area and computes hand motion features, then uses these features to recognize the gesture. The system identifies the hand blob using YCbCr color space to detect skin color of hand. The system classifies the input pattern based on correlation coefficients matching technique. The significance of the system is its simplicity and ability to recognize the gestures independent of skin color and physical structure of the performers. The experiment results show that the gesture recognition rate of 20 different signs, performed by 8 different signers, is 85.67%.

References

38 Cites in Article

Reference Format

W Krueger (1991). Artificial Reality II.
F Wei,C Xiang,W Wen-Hui,Z Xu,Y Ji-Hai,V Lantz (2010). A Method of hand gesture recognition based on multiple sensors.
X Zhang,X Chen,Y Li,V Lantz,K Wang,J Yang (2011). A Framework for hand gesture recognition based on accelerometer and EMG sensors.
Y Quan (2003). Chinese sign language recognition based on video sequence appearance modeling.
G Ye,J Corso,G Hager (2004). Gesture recognition using 3D appearance and motion features.
J Lin,Y Wu,T Huang 3D model-based hand tracking using stochastic direct search method.
R Feris,M Turk,R Raskar,K Tan,G Ohashi (2004). Exploiting depth discontinuities for vision-based finger spelling recognition.
A Barczak,F Dadgostar,C Messom (2005). Real-time Hand Tracking based on Non-Invariant Features.
H Zhou,T Huang (2005). Okapi-Chamfer matching for articulate object recognition.
C Xin-Yan,L Hong-Fei,Z Ying-Yong (2010). Gesture segmentation based on monocular vision using skin color and motion cues.
D Sturman,D Zeltzer (1994). A survey of glove-based input.
S Mitra,T Acharya (2007). Gesture recognition: A Survey.
Y Wu,T Huang (1999). Vision-based gesture recognition: A Review.
Y Hamada,N Shimada,Y Shirai (2002). Hand shape estimation using sequence of multi-ocular images based on transition network.
N Tanibata,N Shimada,Y Shirai (2002). Extraction of hand features for recognition of sign language words.
Y Wu,T Huang (2002). Non-stationary color tracking for vision-based human computer interaction.
Tomasi,Petrov,Sastry (2003). 3D tracking = classification + interpolation.
N Salleh,J Jais (2006). Sign language to voice recognition: hand detection techniques for visionbased approach.
P Dreuw,T Deselaers,D Keysers,H Ney (2006). Modeling image variability in appearance-based gesture recognition.
Y Tabata,T Kuroda (2008). Finger spelling recognition using distinctive features of hand shape.
Qiong Fei,Xiaoqiong Li,Tao Wang,Xiongkui Zhang,Guoman Liu (2009). Real-time Hand Gesture Recognition System Based on Q6455 DSP Board.
F Om,L Tj,S Wibowo (2009). Hand gesture recognition: sign to voice system.
Xenophon Zabulis,Haris Baltzakis,Antonis Argyros (2009). Vision-Based Hand Gesture Recognition for Human-Computer Interaction.
M Paulraj,Sazali Yaacob,Mohd Bin Zanar Azalan,Rajkumar Palaniappan (2010). A phoneme based sign language recognition system using skin color segmentation.
Chen-Chiung Hsieh,Dung-Hua Liou,David Lee (2010). A real time hand gesture recognition system using motion history image.
J Bao,A Song,Y Guo,H Tang (2011). Dynamic hand gesture recognition based on SURF tracking.
Priyanka Mekala,Ying Gao,Jeffrey Fan,Asad Davari (2011). Real-time sign language recognition based on neural network architecture.
M Zaki,S Shaheen (2011). Sign language recognition using a combination of new vision based features.
M Mohandes,S Quadri,M Deriche (2001). Arabic Sign Language Recognition an Image-Based Approach.
S Halawani (2008). Arabic sign translation system on mobile devices.
Mohamed Farouk,Alistair Sutherland,Amin Shoukry (2009). A Multistage Hierarchical Algorithm for Hand Shape Recognition.
M Al-Rousan,K Assaleh,A Tala’a (2009). Video-based signer-independent Arabic sign language recognition using hidden Markov models.
N El-Bendary,H Zawbaa,M Daoud,A Hassanien,K Nakamatsu (2010). ArSLAT: arabic sign language alphabets translator.
E Hemayed,A Hassanien (2011). A Fast edge-based arabic sign language recognition using probabilistic neural network.
Paul Viola,Michael Jones (2004). Robust Real-Time Face Detection.
S Singh,D Chauha,M Vatsa,R Singh (2003). A Robust skin color based face detection algorithm.
J Flusser,T Suk,B Zitová (2009). Moments and Moment Invariants in Pattern Recognition.
B Horn (1986). Robot Vision.

Download References

Funding

No external funding was declared for this work.

Conflict of Interest

The authors declare no conflict of interest.

Ethical Approval

No ethics committee approval was required for this article type.

Data Availability

Not applicable for this article.

How to Cite This Article

Mohamed sameer Mohamed Abdalla, Elsayed E. Hemayed. 2013. "Dynamic Hand Gesture Recognition of Arabic Sign Language using Hand Motion Trajectory Features". Global Journal of Computer Science and Technology - F: Graphics & Vision GJCST-F Volume 13 (GJCST Volume 13 Issue F5).

More Citation Formats

Select Citation Style:

Download Citation

GJCST Volume 13 Issue F5

Explore Journals Explore Volume Read This Issue

Journal Specifications

Crossref Journal DOI 10.17406/gjcst

Print ISSN 0975-4350

e-ISSN 0975-4172

Keywords

arabic sign language correlation coefficients Face detection Gesture recognition hu moments skin color segmentation

Classification

GJCST-F Classification I.4.m

Submission ReceivedDecember 11, 2012
Peer Review Double Blind
Handling Editor
Accepted December 31, 2012
Published January 15, 2013

Version of record

v1.2

Issue date

June 29, 2013

Language

English

Experiance in AR

Explore published articles in an immersive Augmented Reality environment. Our platform converts research papers into interactive 3D books, allowing readers to view and interact with content using AR and VR compatible devices.

View in VR

Read in 3D

Your published article is automatically converted into a realistic 3D book. Flip through pages and read research papers in a more engaging and interactive format.

View in 3D

Article Matrices

Total Score: 142

Country: Egypt

Subject: Global Journal of Computer Science and Technology

Authors: Mohamed S. Abdalla, Elsayed E. Hemayed (PhD/Dr. count: 0)

View Count (all-time): 422

Total Views (Real + Logic): 3327

Total Downloads (simulated): 143

Publish Date: 2013 01, Tue

Monthly Totals (Real + Logic):

Month 1: 18 views
Month 2: 27 views
Month 3: 61 views
Month 4: 39 views
Month 5: 26 views
Month 6: 19 views
Month 7: 31 views
Month 8: 29 views
Month 9: 27 views
Month 10: 25 views
Month 11: 52 views
Month 12: 25 views
Month 13: 30 views
Month 14: 34 views
Month 15: 18 views
Month 16: 40 views
Month 17: 25 views
Month 18: 32 views
Month 19: 20 views
Month 20: 28 views
Month 21: 34 views
Month 22: 28 views
Month 23: 27 views
Month 24: 24 views
Month 25: 23 views
Month 26: 46 views
Month 27: 19 views
Month 28: 38 views
Month 29: 31 views
Month 30: 47 views
Month 31: 22 views
Month 32: 30 views
Month 33: 28 views
Month 34: 27 views
Month 35: 24 views
Month 36: 24 views
Month 37: 29 views
Month 38: 43 views
Month 39: 27 views
Month 40: 17 views
Month 41: 37 views
Month 42: 32 views
Month 43: 32 views
Month 44: 21 views
Month 45: 43 views
Month 46: 32 views
Month 47: 25 views
Month 48: 23 views
Month 49: 21 views
Month 50: 24 views
Month 51: 19 views
Month 52: 36 views
Month 53: 27 views
Month 54: 37 views
Month 55: 40 views
Month 56: 32 views
Month 57: 36 views
Month 58: 33 views
Month 59: 20 views
Month 60: 35 views
Month 61: 34 views
Month 62: 38 views
Month 63: 26 views
Month 64: 35 views
Month 65: 40 views
Month 66: 17 views
Month 67: 16 views
Month 68: 27 views
Month 69: 31 views
Month 70: 37 views
Month 71: 12 views
Month 72: 21 views
Month 73: 25 views
Month 74: 28 views
Month 75: 42 views
Month 76: 14 views
Month 77: 32 views
Month 78: 26 views
Month 79: 25 views
Month 80: 34 views
Month 81: 29 views
Month 82: 29 views
Month 83: 37 views
Month 84: 22 views
Month 85: 14 views
Month 86: 41 views
Month 87: 41 views
Month 88: 14 views
Month 89: 39 views
Month 90: 18 views
Month 91: 33 views
Month 92: 13 views
Month 93: 37 views
Month 94: 41 views
Month 95: 25 views
Month 96: 27 views
Month 97: 37 views
Month 98: 45 views
Month 99: 25 views
Month 100: 33 views
Month 101: 14 views
Month 102: 44 views
Month 103: 34 views
Month 104: 41 views
Month 105: 38 views
Month 106: 23 views
Month 107: 36 views
Month 108: 32 views
Month 109: 25 views
Month 110: 25 views
Month 111: 23 views
Month 112: 23 views
Month 113: 24 views
Month 114: 19 views
Month 115: 20 views
Month 116: 34 views
Month 117: 26 views
Month 118: 41 views
Month 119: 28 views
Month 120: 42 views
Month 121: 45 views
Month 122: 27 views
Month 123: 20 views
Month 124: 19 views
Month 125: 11 views
Month 126: 16 views
Month 127: 16 views
Month 128: 17 views
Month 129: 20 views
Month 130: 43 views
Month 131: 22 views
Month 132: 26 views
Month 133: 18 views
Month 134: 15 views
Month 135: 46 views
Month 136: 26 views
Month 137: 27 views
Month 138: 41 views
Month 139: 28 views
Month 140: 32 views
Month 141: 45 views
Month 142: 39 views
Month 143: 37 views
Month 144: 35 views
Month 145: 18 views
Month 146: 15 views
Month 147: 28 views
Month 148: 35 views
Month 149: 56 views
Month 150: 22 views
Month 151: 29 views
Month 152: 36 views
Month 153: 40 views
Month 154: 38 views
Month 155: 30 views
Month 156: 46 views
Month 157: 54 views
Month 158: 33 views
Month 159: 40 views
Month 160: 32 views
Month 161: 47 views
Month 162: 42 views
Month 163: 49 views
Month 164: 33 views
Month 165: 31 views

Total Views: 3.3K

Total Downloads: 143

All Trends