Does not work on ubuntu 22.04 & node 20 about catai

[ido-pluto]

Do other models work for you?

Try this:

# cd to catai directory
cd `where catai | rev | cut -c10- | rev`/lib/node_modules/catai/

# update node-llama-cpp to the latest version
npm i node-llama-cpp@latest

If it also does not work, we can try to recompile it:

npx node-llama-cpp download

After that tell me if it works, I want to check the issue more deeply :)

[Temtaime]

Hello

npm i node-llama-cpp@latest executed without errors, but it still was not working

After recompiling with npx node-llama-cpp download it started to work, thanks !

[ido-pluto]

It happened before when I did not have enough RAM for the model to run.
Which model do you try to run?
How many GB of memory do you have?
What is the CPU of your computer?

[Temtaime]

I have 64gb ram, tried wizard-vicuna-30b-uncensored-q4_k_s, cpu is ryzen 5900x.

[github-actions]

🎉 This issue has been resolved in version 3.0.1 🎉

The release is available on:

• npm package (@latest dist-tag)
• GitHub release

Your semantic-release bot 📦🚀

[0xGoenka]

Not working on Ubuntu 22.04.3 LTS and node 18

[0xGoenka]

[ido-pluto]

On it, I think the cpp binaries for AMD do not work properly

[github-actions]

🎉 This issue has been resolved in version 3.1.0-beta.1 🎉

The release is available on:

• npm package (@beta dist-tag)
• GitHub release

Your semantic-release bot 📦🚀

[ido-pluto]

You can fix this issue, by using catai beta and rebuilding the binaries

npm i -g catai@beta
catai cpp