An example use case - Multiple raft cluster with in the server cluster about nuraft

[greensky00]

Hi @yashhema

Can you please elaborate more? Here is my understanding, please correct me If I misunderstood:

• There are 5 servers, which will be shared for running 7 tasks.
• Each task will pick 3 servers (out of 5) and organize a Raft group. Each group is independent each other, and will do quorum write (commit after being agreed by at least 2 replicas in the group).
• A server can be members of different groups at a time.

If so, once one node goes down, you can contact the current leader for each group, remove (by calling remove_srv) the node currently offline, and then add a new node (by calling add_srv). The new node will automatically sync up with leader using snapshot or log. In the meantime (while you remove previous node and new node is catching up), existing groups will be still available as long as remaining 2 nodes are alive.

[yashhema]

Hello,
Yes , your understanding is correct. Main idea is that I should be running one exe per server and with in the same exe - I can manage multiple raft groups (using the same port , something like https://github.com/atomix/atomix)
Any suggestion are welcome

[greensky00]

If that's the case, you can remove the problematic node and then add the other one. There will be automatic online sync-up once you add a node to existing running cluster. And you need to make sure that each Raft cluster (for each task) should have separate Raft log. Thanks.

[ZTJiu]

Hi @greensky00 , thanks for your great work!

Does each Raft cluster need a separate nuraft::raft_server instance? If so, could they use the same port for each Raft cluster?

[greensky00]

@ZTJiu
Yes, you need separate raft_server instances. And if they are running in the same process, they should use different listening ports.