Enhancing the model architecture customization? about marllib

[Ivan-Zhong]

Hi there! Thank you for reaching out and sharing your feedback on MARLlib.

The reason why MARLlib does not support highly customizable models for complex data structures, such as NeuralMMO, is due to the need for data sharing in MARLlib's algorithms, which is essential for centralized training methods like MAPPO and QMIX. Achieving a unified pipeline for handling diverse data sharing strategy becomes impractical in this context.

That being said, it is indeed possible to implement more customized models, especially if you are familiar with RLlib and are focusing on specific algorithm in MARLlib. But this may impact other parts of the code and introduce bugs that require fixing.

My suggestion is to begin with independent learning algorithms such as IPPO and customize the model for your environment, as they are quite similar to RLlib. Once you have gained familiarity and confidence, you can then explore more complex algorithms like MAPPO or HAPPO. I welcome any further concerns or questions you may have.