This project helps the disabled people to understand alphabetical input and turns it into an animated sign language (Indian Sign Language) It also has image processing feeds that will help in translating sign language into English alphabets. The project comprises of three modules: Learn, Practice and Test. These Modules will help you in learning the basics of the Indian Sign Language.
You can view the Project Report and the Project Presentation, IIT Bombay Summer Internship Eklavya 2017.
This repository contains all the necessary models for building the project. There are separate repositories for the respective modules so you can simply clone it and run it.
Learn Module helps you to learn the Sign Language Alphabet Gestures. This can be accessed in two ways:
- Windows App (Zip file in models).
- Web App (Link).
The Learn Module Windows App can be downloaded from its repository.
These modules help you to test the gestures that you have performed using the webcam interface. You will need to install Python and Python packages that are mentioned further.
To run, simply execute the python file of the required alphabet.
The Practice and Test modules can be installed with the instructions provided in its repository.
The animations are done using Blender & Blender Game Engine. The image processing is done using Python.
- Install Blender if you want to modify the models.
- Install Python.
- Install additional Python Packages OpenCV, MatPlotLib and Numpy
You can also use pip to install OpenCV, MatPlotLib and Numpy.
Simply follow these instructions.
├── pip install numpy
├── pip install matplotlib
└── pip install opencv-python
- Linux users can also run the Linux_Installation.sh.
Please note this installation requires sudo permissions
Those who wish to train haar cascades can visit My Drive Link to get the negative samples. (The link is temporarily down)
There is a Bash file in folder "A" that has the commands to run the training process.