Finetuning Zephyr 7B with QLoRa and PERF for Customer Support Chatbot

Documentation

View Documentation in Medium

Run it in Colab:

Colab notebook link

How to run it locally?

1. Unzip zephyr-tuning.zip in the same parent directory.

2. Install requirements.txt with:

pip install -r requirements.txt

3. Run app through terminal using

streamlit run app.py