tonymazn / chatbot

APAS Chatbot (by Llama2)

The Llama2 APAS Chatbot is a powerful tool designed to provide APAS information by answering user queries using state-of-the-art language models and vector stores. This README will guide you through the setup and usage of the Llama2 APAS Chatbot.

Please download the Llama 2 Quantized model by Bloke[1] in huggingface.

Happy coding with APAS ChatBot!

Build your own knowledge

Update or create a text file in the 'data' folder

run the ingest.py by Python

Run the Chatbot

chainlit run model.py -w

Credit:

[1] Llama 2 Model (Quantized one by the Bloke): https://huggingface.co/TheBloke/Llama-2-7B-Chat-GGML/blob/main/llama-2-7b-chat.ggmlv3.q8_0.bin

[2] Llama 2 HF Model (Original One): https://huggingface.co/meta-llama

[3] Chainlit docs: https://github.com/Chainlit/chainlit

[4] Faiss GitHub: https://github.com/facebookresearch/faiss

[5] AI Anytime: https://github.com/AIAnytime

[6] Langchain Docs: https://python.langchain.com/docs/get_started/introduction.html

[7] Sentence Transformers Hugging Face: https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2