Comments (5)
Root cause:
The extension detects only GPU models that start with 30 or 40. Which is incorrect, should cover other cases (E.g. Axx)
from jan.
im subbing to this, when you get a solution, Ill retest on that same platform.
from jan.
Im happy to help move this forward but I dont know the full .js tree and how it gets created to the point where we hit this bug. Ive been been reading through as much Tensorflow and Tensorflow-LLM documentation as I can but not entirely sure.
If i could have someone tell me how we end up getting to "index.js" in the spawning of the tree, Ill do my best to post what I find (if it helps) , I am under the assumption that this function ends up calling a "compile from source against Arch(itecture)" thread, but maybe Im wrong.
give me a little friends, and Ill give you a lot :) p.s. I am a former defect research engineer...
from jan.
Is a possible fix coming from cortex-cpp? cc @imtuyethan @Van-QA
from jan.
Root cause: The extension detects only GPU models that start with 30 or 40. Which is incorrect, should cover other cases (E.g. Axx)
I would go with CUDA compute levels, unless there are additional architectural reasons not to, but I could not find any.
I was actually trying to figure out how to code myself, but (again) im not a programmer kind of afraid of breaking stuff, Also... this is all gets autogenerated when Jan first executes (and regens when you reset, because i definitely tested that) so Im not sure what root this all comes out from.
from jan.
Related Issues (20)
- bug: [When I open it in a browser I get an error] HOT 1
- feat: [I can't send images with Phi-3.5-vision] HOT 2
- bug: [DESCRIPTION] Openrouter model selection? HOT 1
- milestone: Release v.0.5.3
- feat: Add button to clear input within all search box
- bug: Jan window can be resized to just the toolbar
- bug: Weird vector database toggle and no time-weighted retrieval action
- Jan's New Hub
- feat: Using command Key for Shortcut Badges
- bug: UI when RAG & Tools do not support remote models other than OpenAI HOT 2
- [UI updates] New model selection (once cortex models are populated) HOT 2
- bug: Mismatch ID between model.json and folder path
- bug: different region is causing input box not allowing float number with "."
- Github Projects Setup
- Threads settings & Settings Template (presets) HOT 1
- Opt-in Analytics / Crash reporting for Jan HOT 1
- Change API server to use Cortex Platform API server & show the logs
- epic: Jan supports Llama-3s
- bug: Unable to use nitro.tensorRT-llm on linux
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from jan.