Comments (8)
What were the arguments you used? Have you tried to use beam search (e.g. beam_size=5
)?
from stable-ts.
Yes i can feel the same issue. Previously it was working perfect but with new updates, it has started making issues.
from stable-ts.
What were the arguments you used? Have you tried to use beam search (e.g.
beam_size=5
)?
I'll try with beam search and let you know
from stable-ts.
What were the arguments you used? Have you tried to use beam search (e.g.
beam_size=5
)?
Yes, it works with beam_size=5. However, now it worked without it as well.
Maybe the issue was fixed by one of the recent updates. I'll try new examples in the future, then let you know.
At least, it worked for the original example I was using.
from stable-ts.
I've found a way to reproduce the issue, it's still happening.
Issue is still happening.
The commands to replicate it with the exact same material are present in this Gist. You just need to run the cells and look for gaps in the generated SRT file.
https://gist.github.com/antiframes/fc9160ff30bb66fb8febd334da406a53#file-whisper-stable-ipynb
Most of the gaps take around one minute.
The conference is longer than 2 hours, so the bug will most probably be replicated at some point.
Although it's not a pattern, some of the gaps occur when the author is quoting a text, then making pauses to comment about it. Sometimes, the quotations are in Latin. Latin is not a problem for Whisper, sometimes the transcription is really precise. But confusion about languages may be related to the issue itself.
from stable-ts.
Try model.transcribe_minimal()
instead of model.transcribe()
. If the issue persists, then this is likely an issue with the model itself which can only be fixed by using different model that performs better with this material (e.g. large-v3
performs worse than large-v2
in some cases so try it, or try a smaller model such as medium
).
from stable-ts.
That seems to be the case. Issue persists with model.transcribe_minimal()
, but there's no problem when using base
model.
So the issue is probably due to Whisper algorithm instead of stable-ts.
from stable-ts.
There is no issue with large-v2
!
I'm closing this case as solved.
from stable-ts.
Related Issues (20)
- Is there anyway to make json file from the start time we want? HOT 2
- Fake Example? HOT 2
- How do I get the "string" from result? HOT 2
- I want to set threshold producing srt in order not to let the string length too long.
- Could not load library libcudnn_ops_infer.so.8. Error: libcudnn_ops_infer.so.8: cannot open shared object file: No such file or directory HOT 1
- `model.align` does not work with huggingface transformer HOT 1
- How to achieve real-time highlighted words in the demo video? HOT 1
- Optimising latency for short audio on CPU HOT 2
- Does the alignment result follow the segmentation of the input text? HOT 2
- Huggingface's Fine Tuned model that can be used? HOT 1
- Wrong subtitles shown during silence HOT 7
- Running on Mac: AttributeError: 'str' object has no attribute 'get' HOT 1
- ramdomly skipped a random part of audio (usually around 30 seconds) during transcription HOT 4
- Measuring accuracy of timestamps? HOT 1
- Why can't the audio after more than 10 minutes be aligned when using -align to align lyrics? HOT 6
- How to specify the address of a model
- Support for newest Faster Whisper HOT 3
- RuntimeError: quantile() input tensor is too large HOT 1
- AssertionError in `mask2timing` HOT 2
- performance differences when ran in python and flask
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from stable-ts.