delcos / opt-convogt

ConvoGPT that uses OPT models or any other pytorch LLM

OPT-convogpt

This is an updated version of convogpt that I've modified to run OPT models. It can also run any other LLM pytorch model with just 2 lines of code being changed to whatever model you're using.

Aside from this, it is now able to get repeated inputs instead of running once and outputting a value.

⚙️ Pretrained Models

Model ID	Parameter Count	Training Method
350	Basic and for testing setups.
2.7b	The standard and well preforming base.
6.7b	If you're able, use this model.
66b	This is a massive model, it will NOT run on any consumer hardware. Don't download this unless you know what you're doing.

🔑 Setup

git clone https://github.com/Delcos/OPT-Convogt
cd convogpt
pip install protobuf==3.20.*
python -m pip install -r requirements