mushroomrl / mushroom-rl-benchmark Goto Github PK
View Code? Open in Web Editor NEWBenchmarking suite for MushroomRL Deep RL algorithms
License: MIT License
Benchmarking suite for MushroomRL Deep RL algorithms
License: MIT License
I have this error
Traceback (most recent call last):
File "/home/davide/code/ML/RL/bench.py", line 37, in <module>
exp.run(
File "/home/davide/code/mushroom-rl-benchmark/mushroom_rl_benchmark/core/experiment.py", line 63, in run
run_fn(**executor_params, **run_params)
File "/home/davide/code/mushroom-rl-benchmark/mushroom_rl_benchmark/core/experiment.py", line 157, in run_parallel
runs = parallel(
File "/home/davide/code/mushroom-rl-benchmark/mushroom_rl_benchmark/utils/tqdm_parallel.py", line 9, in __call__
return joblib.Parallel.__call__(self, *args, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/joblib/parallel.py", line 1098, in __call__
self.retrieve()
File "/usr/local/lib/python3.10/dist-packages/joblib/parallel.py", line 975, in retrieve
self._output.extend(job.get(timeout=self.timeout))
File "/usr/local/lib/python3.10/dist-packages/joblib/_parallel_backends.py", line 567, in wrap_future_result
return future.result(timeout=timeout)
File "/usr/lib/python3.10/concurrent/futures/_base.py", line 458, in result
return self.__get_result()
File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result
raise self._exception
TypeError: Gym.__init__() missing 1 required positional argument: 'name'
With this code:
import time
from mushroom_rl_benchmark.core import BenchmarkExperiment, BenchmarkLogger
from mushroom_rl_benchmark.builders import EnvironmentBuilder, PPOBuilder
if __name__ == '__main__':
logger = BenchmarkLogger(
log_dir='./logs',
log_id='ppo_pendulum'
)
agent_builder = PPOBuilder.default(
actor_lr=3e-4,
critic_lr=3e-4,
n_features=32
)
env_name = 'Gym'
env_params = dict(
env_id='Pendulum-v0',
horizon=200,
gamma=.99
)
parallel = dict(
max_concurrent_runs=10
)
env_builder = EnvironmentBuilder(env_name, env_params)
logger.info('Environment is imported')
exp = BenchmarkExperiment(agent_builder, env_builder, logger)
logger.info('BenchmarkExperiment was built successfully')
start_time = time.time()
exp.run(
exec_type='parallel',
n_runs=10,
n_epochs=100,
n_steps=30000,
n_episodes_test=5,
parallel=parallel
)
end_time = time.time()
logger.info('Execution time: {} SEC'.format(end_time-start_time))
exp.save_plot()
Hi, thanks, this is great. Is there a list of benchmarks provided? Or figures of their performance?
I'm looking to do a full sweep on Atari, MujoCo, and DM-Control. Would the hyperparameters provided here be suitable for all of those? If not, which ones?
I'm trying to run benchmark.py -e BreakoutDeterministic-v4 but I have errors:
Traceback (most recent call last):
File "/home/davide/code/mushroom-rl-benchmark/benchmark.py", line 9, in <module>
from mushroom_rl_benchmark import BenchmarkSuite
ImportError: cannot import name 'BenchmarkSuite' from 'mushroom_rl_benchmark' (/home/davide/code/mushroom-rl-benchmark/mushroom_rl_benchmark/__init__.py)
I managed to fix this changing the import to
from mushroom_rl_benchmark.core.suite import BenchmarkSuite
but now I have another error:
Traceback (most recent call last):
File "/home/davide/code/mushroom-rl-benchmark/benchmark.py", line 9, in <module>
from mushroom_rl_benchmark.core.suite import BenchmarkSuite
File "/home/davide/code/mushroom-rl-benchmark/mushroom_rl_benchmark/core/__init__.py", line 1, in <module>
from .experiment import BenchmarkExperiment
File "/home/davide/code/mushroom-rl-benchmark/mushroom_rl_benchmark/core/experiment.py", line 12, in <module>
from mushroom_rl_benchmark.experiment import exec_run
File "/home/davide/code/mushroom-rl-benchmark/mushroom_rl_benchmark/experiment/__init__.py", line 1, in <module>
from .run import exec_run
File "/home/davide/code/mushroom-rl-benchmark/mushroom_rl_benchmark/experiment/run.py", line 7, in <module>
from mushroom_rl.utils.dataset import compute_J, parse_dataset, get_init_states
ImportError: cannot import name 'get_init_states' from 'mushroom_rl.utils.dataset' (/home/davide/.local/lib/python3.10/site-packages/mushroom_rl/utils/dataset.py)
get_init_states is not defined anywhere
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.