takuseno / d4rl-pybullet

Datasets for data-driven deep reinforcement learning with PyBullet environments

📖 About me

• 💻 Research Scientist @ Sony Research (2020/10/1 - Present)
• 🎓 Ph.D @ Keio University (2023)
• 🔥 IPA MITOU super creator (2020)
• ⌨️ Vimmer (a whole time)
• 👀 Visit here for more information

🚀 GitHub Projects

As an owner

• d3rlpy: An offline deep reinforcement learning library
• d4rl-atari: datasets for data-driven deep reinforcement learning with Atari 2600 (wrapper for datasets released by Google)
• MINERVA: An out-of-the-box GUI tool for offline deep reinforcement learning

As a contributor

• Sony's Nueral Network Libraries
• A CUDA Extension of Neural Network Libraries
• nnabla-rl
• nnabla-browser
• nnabla-js

d4rl-pybullet's Issues

Expert datasets

Hello,

I'm glad someone finally did that repo ;)
I was wondering if you would be interested by expert datasets? (where behavior cloning should perform relatively well)

I would use SB3 and the tuned hyperparameters from the zoo for that: https://github.com/DLR-RM/rl-baselines3-zoo

Performance report: DLR-RM/stable-baselines3#48

Network Error when using the demo in readme to get the dataset

Thanks for work of the developer. I just install this lib and try to pull data according to the demo in readme, but get the following errors. Is the dataset location on the network is still valid?

dataset = env.get_dataset()
Downloading dataset: https://www.dropbox.com/s/xv3p0h7dzgxt8xb/hopper-bullet-mixed-v0.hdf5?dl=1 to /root/.d4rl/datasets/hopper-bullet-mixed-v0.hdf5
Traceback (most recent call last):
File "/usr/lib/python3.6/urllib/request.py", line 1325, in do_open
encode_chunked=req.has_header('Transfer-encoding'))
File "/usr/lib/python3.6/http/client.py", line 1264, in request
self._send_request(method, url, body, headers, encode_chunked)
File "/usr/lib/python3.6/http/client.py", line 1310, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "/usr/lib/python3.6/http/client.py", line 1259, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/usr/lib/python3.6/http/client.py", line 1038, in _send_output
self.send(msg)
File "/usr/lib/python3.6/http/client.py", line 976, in send
self.connect()
File "/usr/lib/python3.6/http/client.py", line 1417, in connect
super().connect()
File "/usr/lib/python3.6/http/client.py", line 948, in connect
(self.host,self.port), self.timeout, self.source_address)
File "/usr/lib/python3.6/socket.py", line 724, in create_connection
raise err
File "/usr/lib/python3.6/socket.py", line 713, in create_connection
sock.connect(sa)
OSError: [Errno 99] Cannot assign requested address

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "", line 1, in
File "/usr/local/lib/python3.6/dist-packages/d4rl_pybullet/offline_env.py", line 72, in get_dataset
h5path = download_dataset_from_url(self.dataset_url)
File "/usr/local/lib/python3.6/dist-packages/d4rl_pybullet/offline_env.py", line 39, in download_dataset_from_url
urllib.request.urlretrieve(dataset_url, dataset_filepath)
File "/usr/lib/python3.6/urllib/request.py", line 248, in urlretrieve
with contextlib.closing(urlopen(url, data)) as fp:
File "/usr/lib/python3.6/urllib/request.py", line 223, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.6/urllib/request.py", line 526, in open
response = self._open(req, data)
File "/usr/lib/python3.6/urllib/request.py", line 544, in _open
'_open', req)
File "/usr/lib/python3.6/urllib/request.py", line 504, in _call_chain
result = func(*args)
File "/usr/lib/python3.6/urllib/request.py", line 1368, in https_open
context=self._context, check_hostname=self._check_hostname)
File "/usr/lib/python3.6/urllib/request.py", line 1327, in do_open
raise URLError(err)
urllib.error.URLError: <urlopen error [Errno 99] Cannot assign requested address>