Out of memory in Colab (free) about whisper-diarization

[MahmoudAshraf97]

@rashi-budati check max_split_size_mb Here

[KevinGeLe]

Thats weird havent had that problem on long audio files. Try with another smaller whisper model "--whisper-model" Default is "medium.en", so try with "small.en" it will reduce the accuracy but should use 3x less memory.

Edit: adding "torch.cuda.empty_cache()", will free up memory thats not in use.

[MahmoudAshraf97]

Hi, this is strange as nemo automatically segments the file to avoid OOM errors, setting the max split size might help because there's plenty of memory available

[rashi-budati]

Hello, I would like your help to know where to set the max split size. in the create_config function, i could not find any such parameter.

[kksgandhi]

If you're having OOM issues and don't mind a performance hit, always remember that you can run this with --device cpu, that way you aren't worrying about your GPU at all.

I'm running whisper-diarization locally though, unsure how this would interact with GColab