Out of vram and reboot about whisper-jax

[sanchit-gandhi]

Hey @tdzz1102 and sorry for the late reply! Could you try with XLA_PYTHON_CLIENT_MEM_FRACTION=.XX (where .XX is the percentage memory allocation you want to assign, e.g. .50 for 50% memory allocation) to reduce the memory fraction allocation? The docs say this should help combat OOMs that occur when the programme starts: https://jax.readthedocs.io/en/latest/gpu_memory_allocation.html

You might need to play with your value of .XX, e.g. incrementally reducing from .75 to .00

[tdzz1102]

@sanchit-gandhi I have solved this question by downgrading the nividia-driver and cuda version(but forgot what exactly the version was 😢). Now the server has been expired and I can't try this solution anylonger. The faster whisper has helped me a lot, and thank you anyway!