Comments (7)
@swb1234554321 @taeyeonlee we are aware of this and are actively working on this with other groups within Qualcomm.
We will be able to release sample app soon once "GenAI" dependencies are released in QNN SDK.
We will update on this issue once we can release sample app.
from ai-hub-models.
hi friend, qcom released a tutorial for deploy llama2 on 8gen3 in ai stack, it maybe helpful
from ai-hub-models.
hi friend, qcom released a tutorial for deploy llama2 on 8gen3 in ai stack, it maybe helpful
@AndreaChiChengdu I've tried to follow the tutorial but it turns out to need the “GenAI” feature in QNN.
However, there is no guide on how to get the permission....so lots of genAI related executable & libs missing and the tutorial is just failed.
Do you have any clue on this?
from ai-hub-models.
hi friend, qcom released a tutorial for deploy llama2 on 8gen3 in ai stack, it maybe helpful
Hi,Can you shared this tutorial? I dont find it.
Best regards.
from ai-hub-models.
@swb1234554321 @taeyeonlee we are aware of this and are actively working on this with other groups within Qualcomm. We will be able to release sample app soon once "GenAI" dependencies are released in QNN SDK.
We will update on this issue once we can release sample app.
@bhushan23 Thanks for your great work, when can you release the sample app? we are all looking forward to it, especially how to run those downloaded files using QNN
from ai-hub-models.
hi , i have a question.
In ai-hub, llama2-7B model is divided into 4 parts, and each part can run inference job seperetedly. We will get 4 bins as a result, which are like job_jogk97en5_optimized_bin_m6qek5zyq.bin.
Can I run this 4 parts as a whole model using QNN?
from ai-hub-models.
hi friend, qcom released a tutorial for deploy llama2 on 8gen3 in ai stack, it maybe helpful
@AndreaChiChengdu I've tried to follow the tutorial but it turns out to need the “GenAI” feature in QNN. However, there is no guide on how to get the permission....so lots of genAI related executable & libs missing and the tutorial is just failed.
Do you have any clue on this?
hi, can you share the tutorial link, thank u so much
from ai-hub-models.
Related Issues (20)
- NO of Inference Set to 20 or 30 HOT 2
- error occured when I run llama_v2_7b_chat_quantized HOT 4
- [BUG] Can hub.submit_inference_job API use online models? HOT 2
- Error uploading to QDC: status code=500
- Genie C API : Sample android app HOT 1
- QCT Genie SDK (genie-t2t-run) : Llama v2 7B performance HOT 6
- How to export Whisper small.En quantization model ? HOT 2
- QCT Genie SDK (genie-t2t-run) fails to run on QNN HTP backend HOT 3
- Operate with NPU HOT 1
- error occured when run llama_v2_7b_chat_quantized_PromptProcessor_3_Quantized HOT 1
- [BUG] fails to create context from binary for the 4 QNN Context Bin files (llama_v2_7b_chat_quantized_TokenGenerator_x_Quantized.bin) HOT 2
- [Question] Where did your tflite model come from? HOT 1
- [BUG] The generated text is strange from 8 QNN Context Bins which are generated in AI Hub. HOT 3
- [Question] Does the DLC engine only have one output? HOT 2
- No Python on Windows ARM available for < 3.11 HOT 6
- Has the AiHub's Whisper model been retrained? HOT 2
- [BUG] Mobile BYOM Issue: <insert issue here> HOT 1
- Does not support XR2 GEN2 chip?
- [BUG] Mobile BYOM Issue: <insert issue here> OnePlus 9 Pro modelo LE2121 HOT 1
- [BUG] Mobile BYOM Issue: How to generate .tflite models form export?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ai-hub-models.