catai serve exit with error: 132 (on MacOS M1 pro) about catai

[ido-pluto]

CatAI now uses a custom lib to connect to ggml models.
Try to update, and use a model listed in catai ls

[ido-pluto]

That is probably because you do not have enough memory available.
Check in the ActivityMonitor that there is a least 6GM of available memory and the memory pressure is green and try again.

[greenido]

I have over 20G of free memory (the physical memory is 32GB and the used is only 9)

[ido-pluto]

I could not reproduce this error,
I recommend you try this again from scratch just to be sure.

npm r -g catai
npm i -g catai
catai remove Vicuna-7B
catai install Vicuna-7B

If that still does not work, please open an issue on node-llama GitHub page.

This version of CatAI, uses node-llama 0.1.5,
Maybe the creator of the package will know what causing this error.

BTW: Did other models work for you?

[greenido]

Yep - other models did work for me (but not on node).
alpaca.cpp is working so I'm 'playing' with it for now.

I'll open an issue at node-llama.

Thank you for all the help 🙌🏾
It's really cool project you are starting here ;)

[ido-pluto]

Does llama-cpp works for you?

[greenido]

Yes - It did.

…

On Tue, Jul 18, 2023 at 12:05 PM Ido S. ***@***.***> wrote: Does llama-cpp <https://github.com/ggerganov/llama.cpp> works for you? — Reply to this email directly, view it on GitHub <#25 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAAPAIF4UMB3GO5QAPGWZ63XQ3NA7ANCNFSM6AAAAAAY7XH2RE> . You are receiving this because you authored the thread.Message ID: ***@***.***>