A machine vision and deep learning-based solution for translating sign language gestures into text or speech. This project aims to bridge the communication gap between individuals who use sign language and those who do not.
- Image Collection: Automatically captures and collects images required for gesture recognition.
- Dataset Creation: Prepares a comprehensive dataset for training.
- Model Training: Includes a script to train a classifier for recognizing sign language gestures.
- Inference: Real-time or pre-recorded gesture translation into text/speech.
- User-Friendly: Easily extendable and adaptable to other sign languages or datasets.
- Programming Language: Python
- Libraries and Tools:
- OpenCV for real-time image processing
- TensorFlow/Keras or PyTorch for training the classifier
- Numpy, Pandas - for data processing.
├── scripts/ # All scripts related to main functionalities
│ ├── imageCollection.py # Script to collect sign language images
│ ├── createDataset.py # Script to preprocess and organize datasets
│ ├── trainClassifier.py # Script for training the model
│ ├── inferenceClassifier.py # Script for running predictions
│
├── README.md # Project documentation (this file)
├── .gitignore # List of ignored files and directoriesBefore running the application, make sure to install the following:
- Python 3.8 or higher - Download Python.
- Install the required dependencies:
pip install -r requirements.txt
-
Clone the repository:
git clone <repository-url> cd Sign-Language-Translator
-
Set up a Python virtual environment:
python -m venv .venv source .venv/bin/activate # On macOS or Linux .venv\Scripts\activate # On Windows
-
Install dependencies:
pip install -r requirements.txt
-
Run Image Collection Script: Collect hand gesture images to create a dataset:
python scripts/imageCollection.py
-
Create Dataset: Process the collected images into labeled datasets.
python scripts/createDataset.py
-
Train the Classifier: Train a machine learning model to recognize gestures.
python scripts/trainClassifier.py
-
Run Inference: Translate sign language into text or speech using the trained model.
python scripts/inferenceClassifier.py
Contributions are welcome! Please follow these steps to contribute:
- Fork the repository.
- Create a new feature branch:
git checkout -b feature-name
- Commit changes:
git commit -m "Add your message" - Push to the branch:
git push origin feature-name
- Submit a pull request.
This project is licensed under the MIT License.
Special thanks to the developers of libraries like TensorFlow, OpenCV, and others that made this project possible.