Unable to use socket in containerized PyTorch app about aws-neuron-sdk

[hsonetta]

@duckontheweb when I try to run the neuron-rtd container, I get the below error:

`ubuntu@ip-192-168-19-125:~$ sudo docker run --device=/dev/neuron0 --cap-add IPC_LOCK -v /tmp/neuron_rtd_sock/:/sock -it neuron-rtd
nrtd[1]: [NRTD:nrtd_main] nrtd build using:1.1.1402.0
nrtd[1]: [NRTD:nrtd_main] nrtd build using:1.1.1402.0

sh: lspci: command not found
nrtd[1]: [TDRV:tdrv_init_mla_phase1] Could not open the device index:0

nrtd[1]: [TDRV:tdrv_init_mla_phase1] Could not open the device index:0

nrtd[1]: [TDRV:tdrv_destroy_one_mla] close device failed
nrtd[1]: [TDRV:tdrv_destroy_one_mla] close device failed

nrtd[1]: [TDRV:tdrv_destroy] TDRV not initialized
nrtd[1]: [TDRV:tdrv_destroy] TDRV not initialized

nrtd[1]: [NRTD:InitTongas] Failed to initialize devices, error:1
nrtd[1]: [NRTD:InitTongas] Failed to initialize devices, error:1

nrtd[1]: [NRTD:nrtd_main] Failed to initialize devices: , attempt: 1
nrtd[1]: [NRTD:nrtd_main] Failed to initialize devices: , attempt: 1`

Did you face this error? If so, can you please point me in the right diresction?

[awsrjh]

duckontheweb -- we will have a look and get back to you.

[awsrjh]

We have updated the docs to add the unix: to the socket environment variable :

NEURON_RTD_ADDRESS=unix:/sock/neuron.sock

Please see
https://github.com/aws/aws-neuron-sdk/blob/master/docs/neuron-container-tools/docker-example/README.md

thanks for letting us know.

[duckontheweb]

Thanks, that worked!

I did still have to run chmod o+x /tmp/neuron_rtd_sock in order to run the neuron-rtd container. Is that expected (I didn't see anything about it in the docs) or should I be running my container differently?

[micwade-aws]

You are correct. We missed the chmod operation in the example. Pull request #91 will correct our tutorial to reflect this. Thank you!

[duckontheweb]

@duckontheweb when I try to run the neuron-rtd container, I get the below error:

`ubuntu@ip-192-168-19-125:~$ sudo docker run --device=/dev/neuron0 --cap-add IPC_LOCK -v /tmp/neuron_rtd_sock/:/sock -it neuron-rtd
nrtd[1]: [NRTD:nrtd_main] nrtd build using:1.1.1402.0
nrtd[1]: [NRTD:nrtd_main] nrtd build using:1.1.1402.0

sh: lspci: command not found
nrtd[1]: [TDRV:tdrv_init_mla_phase1] Could not open the device index:0

nrtd[1]: [TDRV:tdrv_init_mla_phase1] Could not open the device index:0

nrtd[1]: [TDRV:tdrv_destroy_one_mla] close device failed
nrtd[1]: [TDRV:tdrv_destroy_one_mla] close device failed

nrtd[1]: [TDRV:tdrv_destroy] TDRV not initialized
nrtd[1]: [TDRV:tdrv_destroy] TDRV not initialized

nrtd[1]: [NRTD:InitTongas] Failed to initialize devices, error:1
nrtd[1]: [NRTD:InitTongas] Failed to initialize devices, error:1

nrtd[1]: [NRTD:nrtd_main] Failed to initialize devices: , attempt: 1
nrtd[1]: [NRTD:nrtd_main] Failed to initialize devices: , attempt: 1`

Did you face this error? If so, can you please point me in the right diresction?

To be honest, it's been so long that I don't recall. We were experimenting with the SDK at my previous employer but ended up not using it, so I'm not sure I'll be of much help. Sorry!

[john-heyer]

If you're seeing this error, make sure you stop the neuron runtime running on your instance outside of the container!