System.TypeInitializationException: 'The type initializer for 'LLama.Native.NativeApi' threw an exception.' about llamasharp

[AsakusaRinne]

There's an error text in your project file, as below.

  <Target Name="EnsureNuGetPackageBuildImports" BeforeTargets="PrepareForBuild">
    <PropertyGroup>
      <ErrorText>This project references NuGet package(s) that are missing on this computer. Use NuGet Package Restore to download them.  For more information, see http://go.microsoft.com/fwlink/?LinkID=322105. The missing file is {0}.</ErrorText>
    </PropertyGroup>
    <Error Condition="!Exists('..\packages\LLamaSharp.Backend.Cpu.0.11.2\build\netstandard2.0\LLamaSharp.Backend.Cpu.props')" Text="$([System.String]::Format('$(ErrorText)', '..\packages\LLamaSharp.Backend.Cpu.0.11.2\build\netstandard2.0\LLamaSharp.Backend.Cpu.props'))" />
    <Error Condition="!Exists('..\packages\LLamaSharp.Backend.Cuda12.0.11.2\build\netstandard2.0\LLamaSharp.Backend.Cuda12.props')" Text="$([System.String]::Format('$(ErrorText)', '..\packages\LLamaSharp.Backend.Cuda12.0.11.2\build\netstandard2.0\LLamaSharp.Backend.Cuda12.props'))" />
    <Error Condition="!Exists('..\packages\LLamaSharp.Backend.Cuda11.0.11.2\build\netstandard2.0\LLamaSharp.Backend.Cuda11.props')" Text="$([System.String]::Format('$(ErrorText)', '..\packages\LLamaSharp.Backend.Cuda11.0.11.2\build\netstandard2.0\LLamaSharp.Backend.Cuda11.props'))" />
    <Error Condition="!Exists('..\packages\LLamaSharp.Backend.OpenCL.0.11.2\build\netstandard2.0\LLamaSharp.Backend.OpenCL.props')" Text="$([System.String]::Format('$(ErrorText)', '..\packages\LLamaSharp.Backend.OpenCL.0.11.2\build\netstandard2.0\LLamaSharp.Backend.OpenCL.props'))" />
  </Target>

Have you installed any backend packages of LLamaSharp? As you can see here.

[altxxr0]

Yes, Every backend is installed, because without most of the backends it would error that you din''t install the correct backend

Is the current released Nuget Packages not functioning?

[AsakusaRinne]

Could you please take a look at your output folder? For example, bin/debug/net6/. If there's a folder named runtimes, please check if there are dll files named llama.dll in its subfolders.

[altxxr0]

C:\Users(Username)\source\repos\Relate\Relate\bin\Debug

Directory of C:\Users(Username)\source\repos\Relate\Relate\bin\Debug

23/04/2024 04:15 pm

.
23/04/2024 04:15 pm ..
23/04/2024 04:15 pm linux-x64
06/04/2024 02:28 pm 175,104 LLamaSharp.dll
06/04/2024 02:28 pm 260,486 LLamaSharp.xml
31/10/2023 11:00 pm 26,904 Microsoft.Bcl.AsyncInterfaces.dll
31/10/2023 11:00 pm 31,280 Microsoft.Bcl.AsyncInterfaces.xml
15/02/2024 07:56 am 64,160 Microsoft.Extensions.DependencyInjection.Abstractions.dll
15/02/2024 07:56 am 203,027 Microsoft.Extensions.DependencyInjection.Abstractions.xml
15/02/2024 07:56 am 67,848 Microsoft.Extensions.Logging.Abstractions.dll
15/02/2024 07:56 am 91,749 Microsoft.Extensions.Logging.Abstractions.xml
23/04/2024 04:15 pm osx-arm64
23/04/2024 04:15 pm osx-x64
24/04/2024 07:31 am 9,216 Relate.exe
23/04/2024 03:42 pm 1,561 Relate.exe.config
24/04/2024 07:31 am 22,016 Relate.pdb
19/02/2020 06:05 pm 20,856 System.Buffers.dll
19/02/2020 06:05 pm 3,481 System.Buffers.xml
01/02/2022 11:33 pm 1,115,792 System.Linq.Async.dll
01/02/2022 11:27 pm 461,377 System.Linq.Async.xml
08/05/2022 11:31 am 142,240 System.Memory.dll
08/05/2022 11:31 am 13,950 System.Memory.xml
15/05/2018 09:29 pm 115,856 System.Numerics.Vectors.dll
15/05/2018 09:29 pm 183,484 System.Numerics.Vectors.xml
23/10/2021 07:40 am 18,024 System.Runtime.CompilerServices.Unsafe.dll
19/10/2021 03:14 pm 20,529 System.Runtime.CompilerServices.Unsafe.xml
31/10/2023 11:00 pm 79,024 System.Text.Encodings.Web.dll
19/09/2023 07:26 am 63,180 System.Text.Encodings.Web.xml
15/02/2024 08:02 am 643,744 System.Text.Json.dll
19/09/2023 07:26 am 537,044 System.Text.Json.xml
19/02/2020 06:05 pm 25,984 System.Threading.Tasks.Extensions.dll
19/02/2020 06:05 pm 10,147 System.Threading.Tasks.Extensions.xml
15/05/2018 09:29 pm 25,232 System.ValueTuple.dll
15/05/2018 09:29 pm 142 System.ValueTuple.xml
23/04/2024 04:15 pm win-x64

[altxxr0]

No There is no runtime folder only the native library of llama.dll

[AsakusaRinne]

Please add the following code to the very beginning of your program first.

NativeLibraryConfig.Instance.WithLibrary("<path>");

<path> is the path to a llama.dll, which you can choose one from the dlls shown above. If you don't know which to choose, please download this llama.dll, and this llava_shared.dll if you want to use LLaVA. This might be a quick fix for your problem.

However, that's a bit weird to have llama.dll but without the runtimes folder, might be a BUG here. Could you please tell me more information to further dig on this issue?

1. dotnet runtime version
2. project file (.csproj)
3. your operating system info, including windows version, cpu, etc.

[altxxr0]

Yeah, I'l tests it.

[altxxr0]

.NET Runtime is 8.0.204

[altxxr0]

Also

Severity	Code	Description	Project	File	Line	Suppression State
Error	CS1061	'NativeLibraryConfig' does not contain a definition for 'WithLibrary' and no accessible extension method 'WithLibrary' accepting a first argument of type 'NativeLibraryConfig' could be found (are you missing a using directive or an assembly reference?)	Relate	C:\Users\jpfau\source\repos\Relate\Relate\Program.cs	16	Active

[AsakusaRinne]

Please use WithLibrary(filename, null) if you don't need to use the LLaVA model.

[hswlab]

It seems, that the llava_shared,dll library only exists in the avx folders of deps.zip
Is it currently only possible to use llava for avx backends?

[SignalRT]

It should be also in the root folder: