Docker compose never responds about dalai

[DanielNobbe]

Experiencing the same on Ubuntu, not seeing any threads show high usage either

[okellotechconsults]

Same issue, trying to deploy on vps, I tried all methods, started with the npx methods, then docker but they all behave the same way, no response is ever returned, it's a 2CPU ARM64 with 16GB RAM

[cmerther]

Also getting the same on a windows 10 machine with the 13B model.

[fdyhgs]

Tick "debug" on top left and run again. I'd expect an error message to show.

[mirek190]

what do you expect from dead project?

Stop using that ancient dead project and go to llamacpp or koboldcpp ...
Also download models from https://huggingface.co/TheBloke ggml versions