Sign Language Translator for Speech Impaired People

• Published in: 2023 5th Biennial International Conference on Nascent Technologies in Engineering (ICNTE) pp. 1 - 5
• Main Authors: Mane, Vijay, Adsare, Tejas, Dharmik, Tejas, Agrawal, Neeraj, Patil, Dijasmit, Atram, Prajwal
• Format: Conference Proceeding
• Language: English
• Published: IEEE 20-01-2023
• Subjects: American Sign Language Convolutional Neural Network; Assistive technologies; Auditory system; Computer vision; Deep learning; Gesture recognition; hand gesture to speech; Linguistics; Speech recognition; Text recognition
• DOI: 10.1109/ICNTE56631.2023.10146708

Sign language is a way of transfer feelings and our thoughts non-verbally. People who are hearing impaired, dumb or speechless use sign language as their primary means of communication. For communication these people apply gestures which are based on hand signals to share their ideas. Sadly, the overwhelming most of the individuals aren't awake to the linguistics of those gestures. In a try to overcome these gaps, we offer real time Sign Language identification system which is based on the American Sign Language (ASL) Dataset. The system we proposed uses the CNN (Convolutional Neural Network) algorithm to recognize and interpret static hand signals of letters relating to American Sign Language into written output. An Android based application is produced for this system and further it can convert the text into Speech. The text on the screen is translated into voice using a text-to-speech feature. Text-to-speech is frequently employed as an accessibility tool to aid individuals who struggle to read text on screens, but it is also practical for those who want to be read to. This feature has proven to be quite popular and helpful for users.