CUDA out of memory. about if

[realcarlos]

solved by adding "os.environ["FORCE_MEM_EFFICIENT_ATTN"] = "1""

[YeHaijia]

对我有用，赞

[404-xianjin]

hi，I got the same error, my error code is as follows,
torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 16.00 GiB (GPU 0; 23.99 GiB total capacity; 17.99 GiB already allocated; 3.23 GiB free; 18.43 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF

After seeing your solution, I don't know where to set this parameter? Can you tell me? Thanks @realcarlos

[404-xianjin]

大哥，我点开你的主页发现你也在北京，我直接

目前看好像可以了。

[Delicious-Bitter-Melon]

大哥，我点开你的主页发现你也在北京，我直接 目前看好像可以了。

I have the same problem using the 3090. Although I set the ""os.environ["FORCE_MEM_EFFICIENT_ATTN"] = "1""", I still have the problem. Do you also use the 3090 with the 24GB?