Project in progress
A Glove That Translate Sign Language Into Text and Speech

A Glove That Translate Sign Language Into Text and Speech

The aim is to convert basic symbols that represent the 26 English letters as mentioned under American Sign Language script and display.

  • 5,728 views
  • 12 comments
  • 34 respects

Components and supplies

Necessary tools and machines

09507 01
Soldering iron (generic)
Hy gluegun
Hot glue gun (generic)
To fix the sensors
4966285
Solder Wire, Lead Free

Apps and online services

About this project

The project came into existence for one sole purpose, to help the deaf community to easily communicate and interact with thier nearby surrounding. The aim is to convert basic symbols that represent the 26 English alphabet as mentioned under ASL (American Sign Language) script and display them on a smartphone screen.

Circuit Assembly

Project Details

The project was inspired with the idea of controlling robotic arm with the help of hand movements. Most of the working is same but implementing the remaining part is rather a complex task. Accelorometer is used to measure the tilt in the palm. Five bend sensors are placed on a glove, four for the fingers and one for the thumb. These sensors measure the bend in the fingers and thumb and palm and according to the bend angle value the Arduino Nano microcontroller understands which set of value represent which symbol and transfer the appropriate outcome value to the Android app via Bluetooth which displays and speaks the symbol generated.

Representing the first few symbols was quite easy and fun, but there were few symbols that were hard to distinguish such as “U” and “V” which are very slightly different form each other and gave almost same value. The earlier prototype failed drastically to represent the same but the problem was solved using a metallic strip between the finger, which was used to tell if they are in contact or not.

The accuracy was increased by continuously updating the data set for each symbol from time to time.

Working Video

Sign language translator using arduino nano

Sample Picture

Android App

I have used Android Studio to create the app. The app shows the symbol generated with voice output.

Future Scope

This tool can be:

1) Further integrated with various services and help to generate employment for the deaf and dumb people.

2) Geared up with the controller to provide home automation on finger tips.

3) Paired up with fitness sensor to monitor health of the individual.

Reference:

www.theelectronics.co.in

https://www.youtube.com/user/satyamkr80

Code

Sign language translator repository
Still under development, all other details will be updated soon

Comments

Similar projects you might like

Race Photogate

Project tutorial by nfarrier

  • 1,522 views
  • 1 comment
  • 3 respects

Arduino Bluetooth-Controlled Matrix with Scrolling Text

Project tutorial by Mirko Pavleski

  • 7,499 views
  • 8 comments
  • 46 respects

IoTrix (Smart Advertisement LED Board)

Project tutorial by Ravi Parmar

  • 2,722 views
  • 0 comments
  • 23 respects

Marduino Party 1

Project tutorial by Arduino “having11” Guy

  • 1,590 views
  • 0 comments
  • 1 respect

Piezo Activated Drumlights

Project in progress by Tisham Dhar

  • 6,107 views
  • 3 comments
  • 7 respects

The Companion IC

Project tutorial by Srijal Poojari

  • 5,854 views
  • 11 comments
  • 33 respects
Add projectSign up / Login