RDMA over ethernet about caffeonspark

[mriduljain]

We don't have any plans for RoCE, but it would be great if you can make it work. Like Infiniband RDMA support it would be awesome to have ROCE support for CaffeOnSpark. I don't know much about RoCE, but can provide whatever help you need. Let me checkout Infiniband code tomorrow and help with what you are asking.

[mriduljain]

SInce we use libverbs, we are almost ready for RoCE too. I guess we just need to add a couple of lines for RoCE handshake or equivalent.

[mriduljain]

@markyeh I see, you apparently added that in your code. In next couple of weeks I may be able to check it by switching to RoCE, if you share the code.

[shenjingGitHub]

hi,markyeah!Can you run on InfiniBand status?When i use infiniband cards,the data cannot transfer between sending and receiving.Do you know how to resolve the problem?thank you~

[markyeh]

Hi Shenjing,

Sorry, I do not use CaffeOnSpark anymore.
The RoCE issue that I mentioned should be a driver setup issue, just FYI.
Good luck.