Node states are unknown about docker-centos7-slurm

[giovtorres]

Yes, I can reproduce in 21.08, but 20.11.8 appears to be working. Something related to networking changed in Slurm between those releases and the slurm.conf probably is missing something to accommodate. I saw errors about NodeHostName and NodeAddr being the same for all 4 nodes.

Help is appreciated 😄

[percyfal]

So I actually found a solution; removing redundant NodeHostName statements in slurm.conf seems to work:

NodeName=c1 NodeHostName=slurmctl NodeAddr=127.0.0.1 RealMemory=1000
NodeName=c2 NodeAddr=127.0.0.1 RealMemory=1000
NodeName=c3 NodeAddr=127.0.0.1 RealMemory=1000 Gres=gpu:titanxp:1
NodeName=c4 NodeAddr=127.0.0.1 RealMemory=1000 Gres=gpu:titanxp:1

Not that I could find anything in the docs that would suggest this solution; I basically reacted to this error in the logs:

cat /var/log/slurm/slurmctld.log | grep Duplicated
[2022-02-17T08:33:22.239] error: Duplicated NodeHostName slurmctl in the config file
[2022-02-17T08:33:22.239] error: Duplicated NodeHostName slurmctl in the config file
[2022-02-17T08:33:22.239] error: Duplicated NodeHostName slurmctl in the config file

I'm currently running the test on my fork (see changeset). I'll submit a pr on success.

[giovtorres]

Fixed in #38