Comments (5)
It has been confirmed on Discord, we have to wait for 0.2.22 version: That is the cause. Stay tuned for an announcement soon
from lmstudio.js.
Pleased to report it's working great on v0.2.22!
Thank you for all your hard work on this fantastic project!
from lmstudio.js.
I have the same kind of errors, it might be because we don't have the 0.2.22 version of LM Studio yet...
async function useModel(prompt) {
/* var llama3 = await lmstudio.llm.get({
path: "lmstudio-community/Meta-Llama-3-8B-Instruct-GGUF/Meta-Llama-3-8B-Instruct-Q4_K_M.gguf",
}); */
var llama3 = await lmstudio.llm.get({ path: "lmstudio-community/Meta-Llama-3-8B-Instruct-GGUF" });
var result = await llama3.complete(prompt);
console.log(result.content);
console.log(result.stats);
}
useModel("Tell me a joke");
W [LMStudioClient][LLM][ClientPort] Produced communication warning: Received invalid result for rpc, endpointName = getModelInfo, result = {"identifier":"lmstudio-community/Meta-Llama-3-8B-Instruct-GGUF/Meta-Llama-3-8B-Instruct-Q4_K_M.gguf","path":"lmstudio-community/Meta-Llama-3-8B-Instruct-GGUF/Meta-Llama-3-8B-Instruct-Q4_K_M.gguf"}. Zod error:
- result.sessionIdentifier: Required
- result.descriptor: Required
This is usually caused by communication protocol incompatibility. Please make sure you are using the up-to-date versions of the SDK and LM Studio.
from lmstudio.js.
OK, no worries. Thank you for reporting back here too.
from lmstudio.js.
@Trippnology @raphiki please try with 0.2.22 from the homepage: https://lmstudio.ai. If it still doesn't work, please let us know
from lmstudio.js.
Related Issues (20)
- npm install @lmstudio/sdk : HOT 9
- embeddings are not generated using langchain js OpenAIEmbeddings HOT 2
- Network Proxy HOT 2
- Adding new models in the model list HOT 1
- How to load a gguf model split into multiple files? HOT 2
- How to switch/choose different quantization version from a model path HOT 2
- Always got the messages as below when I start local http server HOT 2
- Model token context flushed after each competiton, a llama.cpp server limitation?
- [Feature request] Enable turning on multiple local inference server with different local models
- phi-3 vision : image support
- ARM64 Build LMStudio fails
- platform not supported
- Feature Request: Embedding model support
- deepseek2 not supported HOT 1
- how i use lm studio to infer with batch inputs
- - creationParameter.loadConfigStack: Required lm studio - Version 0.2.26 (0.2.26) HOT 1
- Received invalid creationParameter when calling client.llm.load(modelPath) HOT 6
- Unable to get local issuer certificate
- How to pass tools? HOT 4
- GPU Threads on Vulkan v0.2.31/v0.3.0
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from lmstudio.js.