Comments (12)
There's an error text in your project file, as below.
<Target Name="EnsureNuGetPackageBuildImports" BeforeTargets="PrepareForBuild">
<PropertyGroup>
<ErrorText>This project references NuGet package(s) that are missing on this computer. Use NuGet Package Restore to download them. For more information, see http://go.microsoft.com/fwlink/?LinkID=322105. The missing file is {0}.</ErrorText>
</PropertyGroup>
<Error Condition="!Exists('..\packages\LLamaSharp.Backend.Cpu.0.11.2\build\netstandard2.0\LLamaSharp.Backend.Cpu.props')" Text="$([System.String]::Format('$(ErrorText)', '..\packages\LLamaSharp.Backend.Cpu.0.11.2\build\netstandard2.0\LLamaSharp.Backend.Cpu.props'))" />
<Error Condition="!Exists('..\packages\LLamaSharp.Backend.Cuda12.0.11.2\build\netstandard2.0\LLamaSharp.Backend.Cuda12.props')" Text="$([System.String]::Format('$(ErrorText)', '..\packages\LLamaSharp.Backend.Cuda12.0.11.2\build\netstandard2.0\LLamaSharp.Backend.Cuda12.props'))" />
<Error Condition="!Exists('..\packages\LLamaSharp.Backend.Cuda11.0.11.2\build\netstandard2.0\LLamaSharp.Backend.Cuda11.props')" Text="$([System.String]::Format('$(ErrorText)', '..\packages\LLamaSharp.Backend.Cuda11.0.11.2\build\netstandard2.0\LLamaSharp.Backend.Cuda11.props'))" />
<Error Condition="!Exists('..\packages\LLamaSharp.Backend.OpenCL.0.11.2\build\netstandard2.0\LLamaSharp.Backend.OpenCL.props')" Text="$([System.String]::Format('$(ErrorText)', '..\packages\LLamaSharp.Backend.OpenCL.0.11.2\build\netstandard2.0\LLamaSharp.Backend.OpenCL.props'))" />
</Target>
Have you installed any backend packages of LLamaSharp? As you can see here.
from llamasharp.
Yes, Every backend is installed, because without most of the backends it would error that you din''t install the correct backend
Is the current released Nuget Packages not functioning?
from llamasharp.
Could you please take a look at your output folder? For example, bin/debug/net6/
. If there's a folder named runtimes
, please check if there are dll files named llama.dll
in its subfolders.
from llamasharp.
C:\Users(Username)\source\repos\Relate\Relate\bin\Debug
Directory of C:\Users(Username)\source\repos\Relate\Relate\bin\Debug
23/04/2024 04:15 pm
.23/04/2024 04:15 pm ..
23/04/2024 04:15 pm linux-x64
06/04/2024 02:28 pm 175,104 LLamaSharp.dll
06/04/2024 02:28 pm 260,486 LLamaSharp.xml
31/10/2023 11:00 pm 26,904 Microsoft.Bcl.AsyncInterfaces.dll
31/10/2023 11:00 pm 31,280 Microsoft.Bcl.AsyncInterfaces.xml
15/02/2024 07:56 am 64,160 Microsoft.Extensions.DependencyInjection.Abstractions.dll
15/02/2024 07:56 am 203,027 Microsoft.Extensions.DependencyInjection.Abstractions.xml
15/02/2024 07:56 am 67,848 Microsoft.Extensions.Logging.Abstractions.dll
15/02/2024 07:56 am 91,749 Microsoft.Extensions.Logging.Abstractions.xml
23/04/2024 04:15 pm osx-arm64
23/04/2024 04:15 pm osx-x64
24/04/2024 07:31 am 9,216 Relate.exe
23/04/2024 03:42 pm 1,561 Relate.exe.config
24/04/2024 07:31 am 22,016 Relate.pdb
19/02/2020 06:05 pm 20,856 System.Buffers.dll
19/02/2020 06:05 pm 3,481 System.Buffers.xml
01/02/2022 11:33 pm 1,115,792 System.Linq.Async.dll
01/02/2022 11:27 pm 461,377 System.Linq.Async.xml
08/05/2022 11:31 am 142,240 System.Memory.dll
08/05/2022 11:31 am 13,950 System.Memory.xml
15/05/2018 09:29 pm 115,856 System.Numerics.Vectors.dll
15/05/2018 09:29 pm 183,484 System.Numerics.Vectors.xml
23/10/2021 07:40 am 18,024 System.Runtime.CompilerServices.Unsafe.dll
19/10/2021 03:14 pm 20,529 System.Runtime.CompilerServices.Unsafe.xml
31/10/2023 11:00 pm 79,024 System.Text.Encodings.Web.dll
19/09/2023 07:26 am 63,180 System.Text.Encodings.Web.xml
15/02/2024 08:02 am 643,744 System.Text.Json.dll
19/09/2023 07:26 am 537,044 System.Text.Json.xml
19/02/2020 06:05 pm 25,984 System.Threading.Tasks.Extensions.dll
19/02/2020 06:05 pm 10,147 System.Threading.Tasks.Extensions.xml
15/05/2018 09:29 pm 25,232 System.ValueTuple.dll
15/05/2018 09:29 pm 142 System.ValueTuple.xml
23/04/2024 04:15 pm win-x64
from llamasharp.
No There is no runtime
folder only the native library of llama.dll
from llamasharp.
Please add the following code to the very beginning of your program first.
NativeLibraryConfig.Instance.WithLibrary("<path>");
<path>
is the path to a llama.dll
, which you can choose one from the dlls shown above. If you don't know which to choose, please download this llama.dll, and this llava_shared.dll if you want to use LLaVA. This might be a quick fix for your problem.
However, that's a bit weird to have llama.dll
but without the runtimes
folder, might be a BUG here. Could you please tell me more information to further dig on this issue?
- dotnet runtime version
- project file (.csproj)
- your operating system info, including windows version, cpu, etc.
from llamasharp.
Yeah, I'l tests it.
from llamasharp.
from llamasharp.
Also
Severity Code Description Project File Line Suppression State
Error CS1061 'NativeLibraryConfig' does not contain a definition for 'WithLibrary' and no accessible extension method 'WithLibrary' accepting a first argument of type 'NativeLibraryConfig' could be found (are you missing a using directive or an assembly reference?) Relate C:\Users\jpfau\source\repos\Relate\Relate\Program.cs 16 Active
from llamasharp.
Please use WithLibrary(filename, null)
if you don't need to use the LLaVA model.
from llamasharp.
It seems, that the llava_shared,dll library only exists in the avx folders of deps.zip
Is it currently only possible to use llava for avx backends?
from llamasharp.
It should be also in the root folder:
from llamasharp.
Related Issues (20)
- llamasharp provider for langchain.net is outdated HOT 2
- [BUG]: v0.14.0 hangs when initializing ModelParams HOT 3
- [BUG]: RTX 4080 - crash while loading Vulkan HOT 8
- [BUG]: Vulkan backend crash on model loading HOT 3
- [BUG]: Different continuation after restoring state HOT 1
- Improve `LLamaEmbedder` HOT 2
- [BUG]: KernelMemory.AskAsync() does not work - exception: object reference not set to an instance of an object HOT 25
- [BUG]: fatal error using gemma-2-2b-it HOT 3
- [BUG]: "The type or namespace 'Common' does not exist in the namespace 'LLama'" HOT 4
- Application Not Using GPU Despite Installing LlamaSharp.Backend.Cuda12 HOT 1
- [Feature]: Add development support for Dev Containers HOT 6
- How do i use RAG by kernel memory and Semantic kernel Handlebar Planner with llama3 HOT 3
- versioning issue HOT 11
- [BUG]: gemma-2-9b-it-GGUF - error loading model HOT 3
- [BUG]: Error when starting LLama Cuda11/12 HOT 6
- [BUG]: Second Response Empty when using Grammar HOT 3
- LLamaSharp v0.15.0 broke cuda backend HOT 15
- [BUG]: KernelMemory - Simultaneous execution of AskDocument & ImportDocument HOT 18
- [BUG]: Error setting variables HOT 1
- [BUG:] When switching to new versions of LLamaSharp 0.16.0, there was a slowdown HOT 30
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from llamasharp.