NORMA eResearch @NCI Library

American Sign Language Recognition using Computer Vision and Deep Learning

Aggarwal, Aayush (2023) American Sign Language Recognition using Computer Vision and Deep Learning. Masters thesis, Dublin, National College of Ireland.

[thumbnail of Master of Science]
Preview
PDF (Master of Science)
Download (3MB) | Preview
[thumbnail of Configuration manual]
Preview
PDF (Configuration manual)
Download (3MB) | Preview

Abstract

Sign language recognition system helps to understand the hand gestures made by speech and hearing-impaired community that involves movement of fingers and different palm orientations. This framework has experienced significant growth in the field of computer vision and deep learning. The researcher has investigated various hardware and software approaches for accurate sign recognition. American sign language dataset was used to achieve the goal of this study. The author has performed exploratory data analysis to get insights into data and applied preprocessing techniques such as image resizing, smoothing, and re-scaling. Two deep learning models were implemented for this research, namely Convolutional Neural Network (CNN) and Residual Network 50 (ResNet50). A 2D CNN which consists of optimized hyper-parameters outperformed the other model and achieved an accuracy of 98.76%. A learning curve was also demonstrated for accuracy and loss which was considered during model evaluation.

Item Type: Thesis (Masters)
Supervisors:
Name
Email
Mulwa, Catherine
UNSPECIFIED
Subjects: Q Science > QA Mathematics > Electronic computers. Computer science
T Technology > T Technology (General) > Information Technology > Electronic computers. Computer science
P Language and Literature > P Philology. Linguistics > Computational linguistics. Natural language processing
Q Science > QH Natural history > QH301 Biology > Methods of research. Technique. Experimental biology > Data processing. Bioinformatics > Artificial intelligence > Computer vision
Q Science > Q Science (General) > Self-organizing systems. Conscious automata > Artificial intelligence > Computer vision
R Medicine > Diseases > Disabilities
P Language and Literature > P Philology. Linguistics > Semiotics > Language. Linguistic theory > Gesture. Sign language
Divisions: School of Computing > Master of Science in Data Analytics
Depositing User: Tamara Malone
Date Deposited: 07 Nov 2024 16:46
Last Modified: 07 Nov 2024 16:46
URI: https://norma.ncirl.ie/id/eprint/7166

Actions (login required)

View Item View Item