ImportError: cannot import name 'GpuBindingManager' from 'onnxruntime.transformers.io_binding_helper' about onnxruntime

[tianleiwu]

build wheel use CPU RAM. The error looks like during testing. You can skip tests if you follow the step I shared in the above link.

export CUDACXX=/usr/local/cuda-12.2/bin/nvcc
sh build.sh --config Release  --build_shared_lib --parallel --use_cuda --cuda_version 12.2 \
            --cuda_home /usr/local/cuda-12.2 --cudnn_home /usr/lib/x86_64-linux-gnu/ --build_wheel --skip_tests \
            --cmake_extra_defines onnxruntime_BUILD_UNIT_TESTS=OFF \
            --allow_running_as_root
python3 -m pip install build/Linux/Release/dist/onnxruntime_gpu-*.whl --force-reinstall

[tianleiwu]

You can git checkout rel-1.17.3 after git clone https://github.com/microsoft/onnxruntime.git to get the demo script for 1.17.3.

To run the demo in main branch, please follow the document to run in in docker (require the step of build onnxruntime from source):
https://github.com/microsoft/onnxruntime/blob/main/onnxruntime/python/tools/transformers/models/stable_diffusion/README.md#run-demo-with-docker
Or wait for 1.18 release that will be ready in about two weeks.

[nguyenthekhoig7]

Hi, thanks for your response.

I tried building from source by first cloning the repo, there was the GpuBindingManager in the code after cloning.
Then I ran

./build.sh --build-wheel

following the installing instruction, but encountered

RuntimeError: CUDA error: out of memory

Can I build wheel using my CPU RAM instead, and how can I do that? If further information is needed, please tell me.
Again, I appreciate your promptly support

[nguyenthekhoig7]

It worked(after I change 12.2 to my cuda version, and set some lib path in the enviromnent).
Thank you very much @tianleiwu. Hope you have a good day!