IndexError: index 1 is out of bounds for axis 0 with size 1 about faster-whisper

[guillaumekln]

The same error was reported in #12 (comment) but I was not able to reproduce it.

Can you share an audio file that produces this error?

[haveyouwantto]

I'm afraid i can't send you the audio because it is copyrighted material. However, I can provide you with more details. I've noticed that this error consistently occurs at the end of the audio.

[David-Pye]

To confirm I independently get the same error at the end of audio. I also can't share the audio. Note that I get it non deterministically, some times it's fine and ends with a final word of a... or a.

[haveyouwantto]

Here's the content of jump_times and word_boundaries when this error occurs:

# jump_times
[0.]

# word_boundaries
[ 0  1  4  5  6  7  8  9 10 13 16 17 18 19 20 21 22 23 24 25 28 29 32 33
 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 51 54 55 56 57 58 59 60 61
 62 63 66]

[guillaumekln]

Does the same file run without errors when using word-level timestamps in openai/whisper?

Also what model size are you using?

[haveyouwantto]

Yes, it can run normally in original whisper. I'm using large-v2 model

[guillaumekln]

Thanks for the info.

I found the issue. There is a small error in the DTW implementation in CTranslate2: OpenNMT/CTranslate2#1136

I will release a new version soon.

[Okabintaro]

Not sure if this is helpful or not but I had a similar traceback and found out that setting without_timestamps=True causes it to happen randomly. As soon as I set it to False, it never came back.
So yeah maybe just me being dumb setting the parameter, could be unrelated. Maybe could be caught by the library too.

Thanks for all your work btw. faster-whisper is really great!

[guillaumekln]

The error should be fixed with ctranslate2>=3.9.1.