GithubHelp home page GithubHelp logo

gt-star-lab / marbler-ca Goto Github PK

View Code? Open in Web Editor NEW
1.0 1.0 1.0 11.36 MB

MARBLER for Generalization of Heterogeneous Multi-Robot Policies via Awareness and Communication of Capabilities

Home Page: https://sites.google.com/view/cap-comm

Python 68.20% Jupyter Notebook 31.80%

marbler-ca's Introduction

MARBLER: Multi-Agent RL Benchmark and Learning Environment for the Robotarium

Fork of MARBLER used for Generalization of Heterogeneous Multi-Robot Policies via Awareness and Communication of Capabilities

Installation Instructions

  1. Activate the cap-comm Conda Environment: conda activate cap-comm.
  2. Download and Install the Robotarium Python Simulator
  • The version of the Robotarium that this code was run with was commit 6bb184e. As of now, the code will run on the most recent version of the Robotarium but will not train.
  1. Install our environment by running pip install -e . in this directory
  2. To test successfull installation, run python3 -m robotarium_gym.main to run a pretrained model

Usage

  • To look at current scenarios or create new ones or to evaluate trained models, look at the README in robotarium_gym
  • To upload the agents to the Robotarium, look at the README in robotarium_eval

Training with our version of EPyMARL

  1. Train agents normally using our gym keys
  • For example: python3 src/main.py with alg_yaml=qmix env_yaml=gymma env_args.time_limit=1000 env_args.key="robotarium_gym:PredatorCapturePrey-v0"
  • To train faster, ensure robotarium is False, real_time is False, and show_figure_frequency is large or -1 in the environment's config.yaml
  • Known error: if env_args.time_limit<max_episode_steps, EPyMARL will crash after the first episode
  1. Copy the trained weights to the models folder for the scenario that was trained
  • Requires the agent.th file (location should be printed in the cout of the terminal the model was trained in, typically in EPyMARL/results/models/...)
  • Requires the config.json file (typically in EPyMARL/results/algorithm_name/gym:scenario/...)
  1. Update the scenario's config.yaml to use the newly trained agents

Citing

If you use this fork of MARBLER, please cite:

  • MARBLER:

Reza Torbati, Shubham Lohiya, Shivika Singh, Meher Shashwat Nigam, & Harish Ravichandar. (2023). MARBLER: An Open Platform for Standarized Evaluation of Multi-Robot Reinforcement Learning Algorithms.

  • Our paper:

Pierce Howell, Max Rudolph, Reza Torbati, Kevin Fu, & Harish Ravichandar (2023). Generalization of Heterogeneous Multi-Robot Policies via Awareness and Communication of Capabilities. In 7th Annual Conference on Robot Learning.

marbler-ca's People

Contributors

kfu02 avatar piercehowell avatar rezatorbati avatar shashwatnigam99 avatar shivika275 avatar shubhlohiya avatar

Stargazers

 avatar

Watchers

 avatar

Forkers

yuxin916

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.