Comments (3)
By "true timestamps", I'm assuming you mean accurate segment timestamps that matches the flow of how a human would time the dialogue. The start and end of each segment is dictated by the prediction of the model so that is not entire within our control. Lets say we force it to always end at a period or a specific word. Then that decoded ending timestamp is less likely to be accurate than what is produced by the current heuristics (that lets the model decide for itself when to end the segment). The "gapless" results is what the suppressing silence (or ignore silence) feature of stable-ts tries to reduce but it doesn't always work.
from stable-ts.
Yeah in that case, it's outside of our control at least for now WRT the start/end of each segment.
The inverse of this would be the measurement of anything other than speech, which would then give us the correct start/end times of segments although it would be a post-process at least for now.
Lets say we force it to always end at a period or a specific word. Then that decoded ending timestamp is less likely to be accurate than what is produced by the current heuristics (that lets the model decide for itself when to end the segment).
Correct, I just checked and it's totally not accurate or reliable this way. Currently, I'll be using speechbrain as a post process to get start/end of segments but again that's inaccurate too.
Ah well, we'll see soon how things develop with this. Cheers
from stable-ts.
ver 2.0.0 enables this now
from stable-ts.
Related Issues (20)
- Is there anyway to make json file from the start time we want? HOT 2
- Fake Example? HOT 2
- How do I get the "string" from result? HOT 2
- I want to set threshold producing srt in order not to let the string length too long.
- Could not load library libcudnn_ops_infer.so.8. Error: libcudnn_ops_infer.so.8: cannot open shared object file: No such file or directory HOT 1
- `model.align` does not work with huggingface transformer HOT 1
- How to achieve real-time highlighted words in the demo video? HOT 1
- Optimising latency for short audio on CPU HOT 2
- Does the alignment result follow the segmentation of the input text? HOT 2
- Huggingface's Fine Tuned model that can be used? HOT 1
- Wrong subtitles shown during silence HOT 7
- Running on Mac: AttributeError: 'str' object has no attribute 'get' HOT 1
- ramdomly skipped a random part of audio (usually around 30 seconds) during transcription HOT 4
- Measuring accuracy of timestamps? HOT 1
- Why can't the audio after more than 10 minutes be aligned when using -align to align lyrics? HOT 6
- How to specify the address of a model
- Support for newest Faster Whisper HOT 3
- RuntimeError: quantile() input tensor is too large HOT 1
- AssertionError in `mask2timing` HOT 2
- performance differences when ran in python and flask
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from stable-ts.