Comments (5)
I'm not sure what you want to achieve.
Could you might add an example of what your app/project should do and how WebLLM could help you?
from web-llm.
I want to achieve the llm run off line and also want to make it work to gain a search optimization from internal data and from llm vectorized inter linking.
from web-llm.
Something like this .
search system optimization
but not for code base only. for the database search optimization locally which work together with llm and local folder coordination!!
from web-llm.
I'm not fully convinced I get your question. But from the link you provided it seems you want to use an LLM to make sense of all the data in a local folder so you can ask questions or complete tasks based on that data, right?
So the idea of WebLLM is that you can run Large Language Models in the browser. So either you provide a Model that is finetuned for your usecase (trained with the data you need) or you put the information in the prompt (context).
Since WebLLM runs as a browser application it has very limited access to file and folder structures on your device. You could take a look at the File System Access API. So you could prepare the needed context to add it to your prompt. But it from my understanding it won't be able to just remember all the necessary information and then generate the Text you would expect.
from web-llm.
yes, you understood quite close to what I want to implement. make sense of input search and already available data in folders locally and on customized demand interlinking and making relationships as for search optimization and not for text generation. Something like this.
from web-llm.
Related Issues (20)
- How to get in touch regarding a security concern HOT 2
- GPU Device Error: Uncaught (in promise) TypeError: lib$1.exports.detectGPUDevice is not a function HOT 4
- [TECHNICALDEBT] Put ChatRestModule in shape HOT 2
- Chrome demo frequently terminates while loading HOT 18
- I am seeing 100% RAM usage in my laptop when running this. Can you please let me know if its an issue or the minimum RAM requirement is higher than 8 GB? HOT 1
- Not working HOT 2
- WebCPU? HOT 3
- try to run gemma-7b but failed HOT 1
- simple-chat: error during loading params onto WebGPU, GPUPipelineError: A valid external Instance reference no longer exists HOT 3
- Simple-chat is successfully deployed on the PC, an error occurs:Init error, TypeError: crypto.randomUUlD is not a function when I accesses the web port using the smart phone browser HOT 1
- ES module build of web-llm
- Error: Unknown conv template gpt2 when using prebuild gpt2 in examples/get-started HOT 2
- [Announcement] Breaking changes regarding conversation template HOT 1
- CLI run on MacOS error "unrecognized arguments: --allreduce_strategy=RING" HOT 1
- Model request: new Mistral 7B with 32K context HOT 1
- [Vue/Vite/Nuxt] Build Error: require is not defined in ES module scope, you can use import instead HOT 2
- Gibberish output with `Llama-2-7b-chat-hf-q4f32_1` HOT 17
- Add support for Gemma 7B
- Link in main readme doesn't work HOT 1
- Error running the function calling example: Cannot find global function mlc.serve.BNFGrammarGetGrammarOfJSON HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from web-llm.