This repo allows one to spin up a private LLM with a UI for personal use.
$ make run
$ open localhost:3000
By default, llama3
LLM is downloaded and available for use.
Other models such as llama2-uncensored
can be downloaded as well:
$ make run llm=llama2-uncensored
$ make stop
$ make clean