"Mom can we have ChatGPT" "No, we have chatgpt at home".
ChatGPT at home:
Ensure you have docker (desktop) installed with docker compose. Then can run as a binary or:
cargo run
The first time this will pull images, and then pre-load it with a model (which is a few G normally to pull).
This is my first rust project, be kind.
cargo build
Uses wry
for the webview, and tao
for x-platform windowing. Ollama (https://github.com/jmorganca/ollama) for model hosting and Ollama chat gui for the actual GUI (https://github.com/ollama-webui/ollama-webui). Docker compose as well.