On torch-neuronx 2.1 Beta import xla_backend fails about aws-neuron-samples

[aws-donkrets]

Hi ajayvohra2005 - thx for reporting this. Looks like a potential missing package on your system or a config error. We are looking into it.

[ajayvohra2005]

This only happens when the code is run in Visual Studio Code inside the virtual environment with torch 2.1.* installed. It does not happen when the code is run in a terminal.

[jeffhataws]

Hi @ajayvohra2005 ,

libneuronpjrt-path is a utility that is installed with libneuronxla and should be in <virtual env>/bin path. Please check if this path is in your VSCode settings.

(aws_neuron_venv_pytorch) ubuntu@ip-10-0-8-190:~$ which libneuronpjrt-path
/home/ubuntu/aws_neuron_venv_pytorch/bin/libneuronpjrt-path
(aws_neuron_venv_pytorch) ubuntu@ip-10-0-8-190:~$ libneuronpjrt-path 
/home/ubuntu/aws_neuron_venv_pytorch/lib/python3.8/site-packages/libneuronxla/libneuronpjrt.so

[ajayvohra2005]

Yes, the library is there. As noted, the issue does not happen if the code is run in the terminal in the venv. Please try it in VS code and see if you can reproduce it. I selected the virtual environment in VS code by the usual Shift + Cmd + P -> Python: Select Interpreter -> Find the Python from the virtual environment ...

I tried directly specifying the venv path in the vS code settings as well.

[jeffhataws]

I was able to reproduce the issue. After I select the virtual environment (by the usual Shift + Cmd + P -> Python: Select Interpreter -> Find the path to Python from the virtual environment), I then see the error that you report. So I tried directly activate the environment in the terminal using "source /bin/activate", then I run the code and now there's no more error. Will you try this solution of activating the virtual environment in the terminal in addition to the usual selection of the interpreter?