albpurpura / llm-chatbot

A terminal based UI or a simple Python-based GUI to chat with llms via llama-cpp python wrapper.

Instructions

1. Edit config file withe the urls and paths of your models from Huggingface
2. Create empty models folder: mkdir ./models
3. pip install -r requirements.txt
4. Launch chatbot:

   • Terminal-based interface: python main.py

   • Tkinter GUI: python gui.py

Tested on Linux, no GPU.