Not working with GPU backend cuda12.x about llamasharp

[AsakusaRinne]

Could you please provide the following information? It will help a lot for me to find the problem!

• Your operation system information and the cuda version you installed.
• Your dotnet runtime version.
• All the packages you installed.
• The files in your output directory, for example, bin/Debug/netX.Y, to see if the library file has been copied correctly.

[ChezzPlaya]

@AsakusaRinne

OS: Windows 11 (64 bit)
.NET 7.0
Installed packages:

The folder: Debug\net7.0\runtimes\win-x64\native contains the libllama.dll

[ChezzPlaya]

sorry, my fault, the command nvcc --version gives me:

nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2022 NVIDIA Corporation
Built on Wed_Sep_21_10:41:10_Pacific_Daylight_Time_2022
Cuda compilation tools, release 11.8, V11.8.89
Build cuda_11.8.r11.8/compiler.31833905_0

which is clearly not the v12.x that gives me the nvidia-smi command. That's confusing.

Anyway, the v11 backend works fine.

[blackcement]

@AsakusaRinne , I have the same problem, can't figure out what I'm missing? Created a new project, the code is the same as the @ChezzPlaya .

`RuntimeError: The native library cannot be found. It could be one of the following reasons:

1. No LLamaSharp backend was installed. Please search LLamaSharp.Backend and install one of them.
2. You are using a device with only CPU but installed cuda backend. Please install cpu backend instead.
3. The backend is not compatible with your system cuda environment. Please check and fix it. If the environment is expected not to be changed, then consider build llama.cpp from source or submit an issue to LLamaSharp.
   `

OS: Windows 10 (64 bit) 19044.1288
.NET 7.0
CUDA\v11.7

[DavidixGT]

@AsakusaRinne , I have the same problem, can't figure out what I'm missing? Created a new project, the code is the same as the @ChezzPlaya .

`RuntimeError: The native library cannot be found. It could be one of the following reasons:

1. No LLamaSharp backend was installed. Please search LLamaSharp.Backend and install one of them.
2. You are using a device with only CPU but installed cuda backend. Please install cpu backend instead.
3. The backend is not compatible with your system cuda environment. Please check and fix it. If the environment is expected not to be changed, then consider build llama.cpp from source or submit an issue to LLamaSharp.
   `

OS: Windows 10 (64 bit) 19044.1288 .NET 7.0 CUDA\v11.7

попробуй установить куда12 и цпу бэкенд