Comments (3)
Greetings,
We have prepared documentation on how to customize environments and algorithms within the LightZero framework, which can be accessed through the following links:
Although these documents provide fundamental guidance, they may not encompass all details. Should you encounter any issues or have queries during the customization process, please do not hesitate to reach out to us. We are eager to assist you in ensuring a smooth customization experience.
Best wishes!
from lightzero.
Thanks for getting back to me!
I appreciate the fast response and clear instructions. Another question I had, taking a loom at the documentation suggest two modes, board game and non board game atari based. Would it be possible to implement an environment that is two players but allows all actions as legal? I suppose I could simply pass all moves as legal. Adding onto this, could I encode a no-move as a 0 embedded plane? Do you have any suggestions for algorithms that are self-play but less data hungry?
I understand my questions are more beginner, and am asking for your instruction.
Thank you for the clarifiaction!
from lightzero.
Certainly, an environment that allows two players to make any legal moves can be created. In the field of Multi-Agent Reinforcement Learning (MARL), such types of environments are quite common. For example, the PettingZoo library provides many examples of such environments. You can browse PettingZoo's GitHub repository for more related information. In the LightZero project, we have some ongoing pull requests, such as PR#149, PR#153, and PR#171. You can follow the updates on these pull requests, or contribute your own insights.
Regarding the encoding of "no action" as an embedding vector with a value of 0, this is technically feasible. However, this requires that the design of the environment explicitly clarifies how to interpret this condition and how to enable agents to recognize and learn a "no action" strategy.
For self-play algorithms seeking data efficiency, you might refer to research papers that focus on data-efficient reinforcement learning. For instance, data utilization can be enhanced through methods like model-based reinforcement learning, representation learning, and so on. Relevant resources can be found on awesome-model-based-RL.
from lightzero.
Related Issues (20)
- Error with Convolutional Input in Example Environments (game_2048) HOT 2
- How to use efficient zero for board games HOT 5
- connect 4 setup bugs HOT 1
- Inconsistency Between Episode Counts in MuZero HOT 1
- LightZero on HPC and other questions HOT 3
- About Replicating SampledZero Performance in the Hopper-V3 Environment HOT 2
- Multi GPU EfficientZero import failure "No module named ding" HOT 1
- Multi-GPU issue
- The multi-GPU issue HOT 1
- When will Go be supported? HOT 1
- the sampled efficient zero portion of the code HOT 2
- Custom environment HOT 1
- Does LightZero currently support compilation on Windows? HOT 2
- Replicating multi-GPU EfficientZero Atari results HOT 1
- how to well model a grid env when it changes frequently? HOT 8
- Minigrid environment HOT 1
- Great!!! HOT 1
- Running a trained agent HOT 2
- Hyperparameter of Muzero and reproducibility of the results HOT 2
- Render and plot results: is there a code snippet?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from lightzero.