masterai-top / masterai-2.0-1vs1-nolimit

MasterAI is an AI poker dedicated to suport n-play (single- or multi-agent) Texas Hold'em imperfect-informatin games.

MasterAI-2.0-1vs1-NoLimit

Introduction

MasterAI v2.0 is an iterative algorithm derived from MasterAI v1.0 It utilizes profound Reinforcement Learning + Search in imperfect-information games and achieves superhuman performance in heads-up no-limit Texas Hold’em. Furthermore, it is a major step toward developing technologies for multiagent interactions in real world.

Technology

1.MaterAI v2.0 algorithm generalizes the paradigm of self-play reinforcement learning and deep learning and search through gargantuan imperfect-information. It makes decisions by factoring in the probability distribution of different beliefs each player might have about the current state of the game and uses counterfactual Regret minimization (CFR) algorithm to search efficiently.

2.Our experiments confirmed that MasterAI does indeed converge to an approximate Nash equilibrium in two-player zero-zum game

Technical bottlenecks

Some technical bottlenecks are encountered when training the algorithm model with CFR framework. For instance, the large state space is leading to too much computation:

1.Algorithm training has a large amount of calculation (2560000 * 1750 in the paper)

2.Deployment speculation and search time is too much: 3 ~ 5 seconds

3.The number of nodes in Abstract CFR (400BB) Betting Tree is too large, more than 400 million

Contact us

The Master team is constantly exploring the innovation of AI algorithm, and hoping that like-minded technical experts from all over the world can communicate and exchange here, or join us to make MasterAI bigger and stronger together. Please feel free to contact us at [email protected]

masterai-2.0-1vs1-nolimit's Issues

This project violates Apache2.0 License

This project use a lot of code from https://github.com/facebookresearch/rebel.

According to Apache 2.0 License rebel use, you should:

1. Embed the code with an Apache license

2. If you modify the code, you need to explain it in the modified file.

3. In the extended code (in the code modified and derived from the source code), it is necessary to carry the agreement, trademark, patent declaration and other instructions specified by the original author in the original code.

requirements.txt

Hi.

I'm trying to train the model with your code, but it seems like the version of hydra which is used by the code is not the latest.

Could you make requirements.txt ?

Thank you.