Comments (14)
Well, I'll test it once I implement it 😄
One thing I find strange is that there isn't a way to say who is speaking? Is it just assumed by the alternating order of conversations?
No need to test it. It does seem to work. My code has been uploaded to my repo, and you can find it here.
from transformers.js.
Yay!
from transformers.js.
Right, but if you look at the vocabulary of the model,
<s>
is not one of the tokens.
My bad. I've taken a look at the vocabulary file, and the tokens appear to be __start__
and __end__
. I haven't tested this yet, but that is what I can tell.
from transformers.js.
Thank you so much!!!
from transformers.js.
Thank you! I hope my testing code helped some!
from transformers.js.
Hi! As stated in a similar issue from 2 days ago (#29) I haven't yet implemented BlenderBot (no listed support in the README or on the demo website). I just uploaded the files since I plan to add it (which, I probably shouldn't have done haha). However, I do plan to add support for it in the next few days!
It will need a way to keep track of conversations, but I will look to HF's implementation for inspiration :)
(The error message you got is because I haven't uploaded the tokenizer yet ;) )
from transformers.js.
Hi! As stated in a similar issue from 2 days ago (#29) I haven't yet implemented BlenderBot (no listed support in the README or on the demo website). I just uploaded the files since I plan to add it (which, I probably shouldn't have done haha). However, I do plan to add support for it in the next few days!
It will need a way to keep track of conversations, but I will look to HF's implementation for inspiration :)
(The error message you got is because I haven't uploaded the tokenizer yet ;) )
I believe that the Blenderbot model keeps track of a conversation using certain tokens to tell when a speaker stops and starts talking, like this:
<s>Hello! How are you?</s> <s>I'm good. How are you?</s> <s>I'm doing pretty good.</s>
From what I can tell, this is implemented by the user. My really bad code (in Python) for this is here. Even though this code is for Blenderbot, I believe the same goes for Blenderbot Small. However, there are way better examples than my code. This is just what I've seen in multiple Spaces on Huggingface. I hope this helps!
from transformers.js.
Thanks @zap8600! I've seen similar examples for blenderbot, but the documentation for blenderbot small does not seem to be as clear. I raised an issue (huggingface/transformers#22301), but it looks like it's been hidden already by other issues.
If possible, do you think you could look into how blenderbot small handles it? (Which is apparently different to normal blenderbot)
from transformers.js.
Thanks @zap8600! I've seen similar examples for blenderbot, but the documentation for blenderbot small does not seem to be as clear. I raised an issue (huggingface/transformers#22301), but it looks like it's been hidden already by other issues.
If possible, do you think you could look into how blenderbot small handles it? (Which is apparently different to normal blenderbot)
I've look at the Transformers doc (which is where I based my code on) and it appears to be the same way.
from transformers.js.
Right, but if you look at the vocabulary of the model, <s>
is not one of the tokens.
from transformers.js.
Well, I'll test it once I implement it 😄
One thing I find strange is that there isn't a way to say who is speaking? Is it just assumed by the alternating order of conversations?
from transformers.js.
A little late since it wasn't as simple as some of the other models (combined with the fact that the python tokenizer is broken), but it's here now! 🤗 I'll make a release soon, so you'll be able to test it.
from transformers.js.
It did! Thanks 🤗
from transformers.js.
Np! I can't wait to use the BlenderBot model!
from transformers.js.
Related Issues (20)
- loading time
- What does "Error: failed to call OrtRun(). error code = 6." mean? I know it is ONNX related, but how to fix? HOT 6
- Request to this.path failed with status code 403
- GGUF support
- Useful snippets HOT 4
- Unknown model class "new", attempting to construct from base class. HOT 1
- Unknown PostProcessor type: Sequence HOT 6
- Chrome on Android crashes when starting Whisper HOT 3
- TypeError: Cannot read properties of undefined (reading 'create') HOT 5
- Could not read from file: D:\vite-project\node_modules\stream-browserify\web HOT 3
- Any plans to add moondream and build a demo? Xenova/moondream2 HOT 2
- TypeError: Failed to fetch dynamically imported module HOT 4
- Error using Xenova/nanoLLaVA in pipeline HOT 3
- Excessive Memory consumption. HOT 4
- could not find model_q4.onnx_data (v3 PR) HOT 1
- Uncaught (in promise) Error: no available backend found. ERR: [webgpu] TypeError: Failed to fetch dynamically imported module: HOT 10
- Options for the "translation" pipeline when using Xenova/t5-small
- Have considered using wasm technology to implement this library? HOT 1
- Example not working on Chrome/Arc v.124(M1 Mac) HOT 3
- Can you use all transformers models with transformers.js?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from transformers.js.