Computer Vision

Develop Sign Language Translator with Python

Sign languages (also known as signed languages) are languages that utilize the visual-manual methodology to pass on importance. Language is communicated through the manual sign stream in the mix with non-manual components.

Read more..


The primary issue is that the hard of hearing like deaf and dumb people cannot communicate easily with normal people since persons other than disabled persons do not learn how to communicate in sign language with each other. The solution is to create a translator which can detect sign language performed by a disabled person and then that sign will be fed to a machine-learning algorithm performed by a neural network which is then detected by the neural network and translated on display so that a normal person can understand what the sign conveys.

Project Description

To build a Sign language translator we will need four things:

Data Gathering

A separate directory is created with a collection of various sub-directories labelled as A, B, C, D, E, F, G, H, I, J, K, L, M, N, O, P, Q, R, S, T, U, V, W, X, Y, Z. Each sub-directory contains various images of the hand gesture of a user displaying a sign language for the corresponding label i.e. Folder A will be having 20-30 images of the sign language of A displayed and saved by the user. Similarly, Folder B will be having 20-30 images of the sign language of B displayed and saved by the user and similar steps needed to perform for other alphabets.

Creating Model

A model is created using TensorFlow which will recognize the real-time input of the hand signs of the user and will display the corresponding letter of the sign language. This TensorFlow model is a GPU model that compares the real-time image with the data that is already stored in the database with the help of the data gathering process.

Training Model

The model which is created in the previous method of the project using TensorFlow is being trained with some samples of data from the database of the images of the words from each word. This step will help the model to get a hold of how a letter is being represented using a hand gesture to perform sign language. This model is trained for some random amount of time in order to get a better and efficient accuracy while performing the actual test with the model.

Testing Model


Latest projects on Computer Vision

Want to develop practical skills on Computer Vision? Checkout our latest projects and start learning for free


After the model is trained it can be tested to observe the actual working of the system. The user shows a hand gesture of any word based on the sign language data which is being provided in the model and also used for the training of the model. When the user creates a hand sign for any specific letter the model recognizes the gesture and displays the corresponding letter in the bottom left side of the console.

Project Implementation:

  1. Firstly we need to download a dataset. We can use the original MNIST (Modified National Institute of Standards and Technology) image dataset for our project or any other dataset that is available on the internet.
  2. After gathering the dataset, we will build and train the model, construct the model, we will require CNN (Convolutional Neural Network) to perceive the letters in order and some Keras to build the CNN.
  3. To build a model, we need tensorflow which will recognize the real-time input of the hand signs of the user and will display the corresponding letter of the sign language.
  4. The next step is to train the data; this step will help to remember how the letter is being represented using a hand gesture to perform sign language.
  5. Presently we have a prepared model, the next step is to create a window to take the input image from our webcam.
  6. At last, our model is prepared for testing and the user can create a hand sign for any specific letter the model recognizes the gesture and displays the corresponding letter in the bottom left side of the console.

Software Requirements:

Programming language - OpenCV, TensorFlow, Keras, Python


How to build Computer Vision projects Did you know

Skyfi Labs helps students learn practical skills by building real-world projects.

You can enrol with friends and receive kits at your doorstep

You can learn from experts, build working projects, showcase skills to the world and grab the best jobs.
Get started today!


Kit required to develop Develop Sign Language Translator with Python:
Technologies you will learn by working on Develop Sign Language Translator with Python:
Sign language translator using python,tensorflow,keras and open CV
Skyfi Labs Last Updated: 2022-05-14





Join 250,000+ students from 36+ countries & develop practical skills by building projects

Get kits shipped in 24 hours. Build using online tutorials.

More Project Ideas on Computer-vision

Hybrid Median Filter for Noise Removal in Digital Images
Image Processing based fire detection
Library Management System using SQL and C++
Detection of Asthma Trigger using Zigbee
Image retrieval
Number Plate Detector
Sign Language Reader
Optical Character Recognition(OCR)
Face recognition gate
Surveillance Camera using Raspi Cam and Android App
Template matching using Computer vision
Motion detector using Computer vision
Streaming Video to a web-page using Open CV
Computer vision based rescue robot
Smart gesture control for mobile phone using machine learning
Image Processing based ball tracking robot
Emotion recognition using image processing
Computer vision based self-recharging robot
Disease Prediction using Image Processing
Forgery detection using Image Processing
Invisible Cloak using Open CV and Python
Currency Recognition System using Image Processing
Cartooning an Image using Open CV
Develop Sign Language Translator with Python
Develop an Audio Sign Language Translator Using ML
Image classifier for identifying cat vs dogs using CNN and python
Age Prediction using Image Processing
Color detection
Gender and Age Detection using OpenCV
Car model recognition using Image Processing
Checking driver behavior with Raspberry Pi
Dimension Estimation using Image Processing
Typing Robot
Detection of Underground broken pipes
Computer vision based Smart Selfie
Computer vision based text scanner
Cancer detection using image processing
Develop A Sixth Sense Robot With Arduino
Lane Detection using Machine Learning

Subscribe to receive more project ideas

Stay up-to-date and build projects on latest technologies