Express-U: Real-time Indian Sign Language Recognition

Abstract

This study describes a system that recognizes Indian Sign Language (ISL) hand poses and gestures in real time using the Hand Tracking Algorithm and the LSTM Deep Learning model. This approach aims to close the communication gap between those who are deaf or hard of hearing and the rest of society. Existing solutions either have a low level of accuracy or do not operate in real time. On both measures, this system performs admirably. Hand gestures are captured from a smartphone camera and its frames are transmitted to a remote server for processing. It is user-friendly because no external hardware (such as gloves or sensor) is used. Machine learning is an artificial intelligence (AI) application that enables systems to learn and improve without being explicitly programmed. This method does not require a clear background or clean image; it extracts holistic key points and makes predictions.