Cannot get CUDA backend to work. CPU backend does work. about llamasharp

[YourNightmar3]

@AsakusaRinne alright thank you for the infromation, i'll mark this as closed now.

[martindevans]

Have you installed the CUDA toolkit?

[YourNightmar3]

Have you installed the CUDA toolkit?

I certainly did not. Now that i have installed the CUDA toolkit it is working perfectly! Did i miss this in the instructions? I don't see any prerequisites listed, also not in the quick start guide for example?

[AsakusaRinne]

@YourNightmar3 We didn't claim this requirement and sorry for the confusion. Actually it is not required but we used to take it as a requirement. In #350 there's a discussion about it recently. We'll support using LLamaSharp without cuda installed soon. Instead some dlls will be required but we'll pack them as nuget packages or releases to make it easy to use.