Comments (4)
You can see in Llama.Unitest.csproj the URLs of the models used in the example and UnitTest:
https://huggingface.co/cjpais/llava-1.6-mistral-7b-gguf/resolve/main/llava-v1.6-mistral-7b.Q3_K_XS.gguf
https://huggingface.co/cjpais/llava-1.6-mistral-7b-gguf/resolve/main/mmproj-model-f16.gguf
You will have both files in any vision model. Example:
![image](https://private-user-images.githubusercontent.com/16475613/330204815-1515451e-8823-448d-93ed-bb46f9565420.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjM1MTM4MzgsIm5iZiI6MTcyMzUxMzUzOCwicGF0aCI6Ii8xNjQ3NTYxMy8zMzAyMDQ4MTUtMTUxNTQ1MWUtODgyMy00NDhkLTkzZWQtYmI0NmY5NTY1NDIwLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODEzVDAxNDUzOFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTJhZDE3NTA3NDljZDI0YTZlODU2MWJlMDQwYTI1YmYwNjYxZGViMjYzZTNiOTUwNWUxZDFmZTk0NDI3YTJkYzcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.XJmJe7QZG3WSIv1b72Kg0qAQthEhG-zlPFWCLKARnn4)
from llamasharp.
Ah, thank you. So both models can be found at Huggingface. That's something completely new to me, usually I'm using just a single model^^'
from llamasharp.
Yes, you should download both files from the model you choose to use. Normally you will have several quantized models and one projection model
Llava is using CLIP with an MML Projection (mmproj).
You can find the details in this paper:
https://arxiv.org/pdf/2310.03744
from llamasharp.
Maybe some documentations are necessary. :D
from llamasharp.
Related Issues (20)
- [BUG]: App crashes with CUDA error in ggml-cuda.cu:1503
- [BUG]: llama_encode has no implementation HOT 4
- Always getting a "Ċ" before EOS when using Qwen HOT 1
- [BUG]: Object Reference Error in ApplyPenalty when setting nl_logit HOT 3
- [BUG]: ChatHistory and kv-cache in unsync (Possible MemLeak) HOT 2
- [BUG]: Vulkan - bad output after a while HOT 3
- Ho can i get functions calls? HOT 7
- [BUG]: Null reference in AskAsync() HOT 1
- Error Loading LLAMA 3.1 llama_model_load: error loading model: done_getting_tensors: wrong number of tensors; expected 292, got 291[BUG]: HOT 4
- llamasharp provider for langchain.net is outdated HOT 2
- [BUG]: v0.14.0 hangs when initializing ModelParams HOT 2
- [BUG]: RTX 4080 - crash while loading Vulkan HOT 8
- [BUG]: Vulkan backend crash on model loading HOT 3
- [BUG]: Different continuation after restoring state
- Improve `LLamaEmbedder` HOT 2
- [BUG]: KernelMemory.AskAsync() does not work - exception: object reference not set to an instance of an object HOT 7
- [BUG]: fatal error using gemma-2-2b-it HOT 2
- [BUG]: "The type or namespace 'Common' does not exist in the namespace 'LLama'" HOT 2
- Application Not Using GPU Despite Installing LlamaSharp.Backend.Cuda12 HOT 1
- [Feature]: Add development support for Dev Containers HOT 6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from llamasharp.