Consider adding Windows on ARM build of llama.dll to LLamaSharp.Backend.Cpu about llamasharp

[martindevans]

Unfortunately it looks like Github Actions doesn't have Windows+ARM available (docs) :(

Edit: Note that's not a total blocker for this. I think we could cross compile the DLLs from Windows x64 Actions, it just means we couldn't test it.

[AsakusaRinne]

Hi, we're certainly willing to add such a backend. Could you please test whether it works well with current LLamaSharp? Though we could compile and test it with github actions, the period of debugging it will be much longer since we don't have arm windows device. So if you'd like to help it'll save a lot of time. :)

Here're some steps for it:

1. Clone llama.cpp and checkout to 3ab8b3a92ede46df88bc5a2dfca3777de4a2b2b6.
2. Compile it on your PC and get a file llama.dll.
3. Modify the code here to use NativeLibraryConfig.Instance.WithLibrary to load your compiled library file.
4. Run the examples one by one and see if they all works well.

If all things above go well, what we need to do is just adding it to CI and release next version. :)

[david-nordvall]

And using the ARM DLL from llama.cpp's official releases isn't a viable workaround?

[AsakusaRinne]

And using the ARM DLL from llama.cpp's official releases isn't a viable workaround?

Using dlls from llama.cpp's release will bring some troubles for auto binary-updating in CI, but I think we could make it as long as you've confirmed that LLamaSharp works well with that dll.