lucas-emery / rocket-league-gym Goto Github PK

View Code? Open in Web Editor NEW

195.0 10.0 43.0 1.21 MB

A Gym-like environment for Reinforcement Learning in Rocket League

License: Apache License 2.0

Python 99.93% Batchfile 0.07%

reinforcement-learning rocket-league hacktoberfest gym-environment

rocket-league-gym's People

Stargazers

Watchers

rocket-league-gym's Issues

How to set ball respown position?

Hi, as the title. How do I set a ball's initial position?

Rocket league no longer closes on exit

With the update using the epic login tricks method, rocket league no longer closes cleanly on exit.

Add match_score and match_assist to PlayerData

Maybe also match_touches to make it in line with the other stats (as well as add support for multiple touches in a single frameskip) if possible

HTTPErrors under wine

Not sure if this is strictly a wine issue, but I haven't seen it under windows. I'm seeing errors like the following somewhat intermittently. They don't seem to be causing hangs/crashes, although this one did occur as part of a startup hang.

Does the the rlgym module communicate with the plugin via HTTP?

WebRequest_X_3 type: HTTPError, message:
WebRequest_X_4 type: HTTPError, message:
WebRequest_X_5 type: HTTPError, message:
WebRequest_X_6 type: HTTPError, message:
WebRequest_X_7 type: HTTPError, message:
WebRequest_X_9 type: HTTPError, message:
WebRequest_X_10 type: HTTPError, message:
WebRequest_X_11 type: HTTPError, message:
WebRequest_X_12 type: HTTPError, message:
WebRequest_X_13 type: HTTPError, message:
WebRequest_X_15 type: HTTPError, message:
WebRequest_X_16 type: HTTPError, message:
WebRequest_X_17 type: HTTPError, message:
WebRequest_X_18 type: HTTPError, message:
WebRequest_X_19 type: HTTPError, message:
WebRequest_X_21 type: HTTPError, message:
WebRequest_X_22 type: HTTPError, message:
WebRequest_X_23 type: HTTPError, message:
WebRequest_X_24 type: HTTPError, message:
WebRequest_X_25 type: HTTPError, message:
WebRequest_X_27 type: HTTPError, message:
WebRequest_X_28 type: HTTPError, message:
WebRequest_X_29 type: HTTPError, message:
WebRequest_X_30 type: HTTPError, message:
WebRequest_X_31 type: HTTPError, message:
WebRequest_X_32 type: HTTPError, message:
WebRequest_X_34 type: HTTPError, message:
WebRequest_X_35 type: HTTPError, message:

Feature: Remote control RL processes

In order to train on high-end hardware (high core density CPUs or multiple professional GPUs) would it be possible to dissociate game execution/control/metrics gathering from the compute part ?

V2 has no way to seed the env

In v2 there's no mention of seed in the RLGym class. FWIW, PettingZoo passes it as an optional arg to the reset function.

I'm also seeing two sources of randomness in the code so far. IIRC RocketSim also supports seeding its prng, so you'll likely want to support that.

Current use of PRNG in this code:

random.shuffle in the KickoffMutator
np.random, used in rand_vec3 and rand_uvec3
- note: these may be dead code, as I'm not seeing anything that makes use of them in this codebase.

Fix docstrings in StateWrapper, CarWrapper, and PhysicsWrapper

More specifically, the methods StateWrapper.format_state(), PhysicsWrapper._encode() and PhysicsWrapper._encode() state that they return strings when in fact they return python lists. Note: Other methods that deal with decoding/encoding most likely also have faulty docstrings.

Maybe they should be left as numpy arrays for performance reasons unless it makes sense to keep them as lists.

Add ability to select action for each tick in frameskip

Currently, the frameskip simply repeats each action for each frame.
Instead, we should be able to send it an action to perform for each of these frames.
Could be done by simply adding an extra (optional) dimension at the start of the action numpy array.

Bot difficulty

What is the default difficulty of the bot in the case of setting the spawn_opponents to True? Is there any way of changing this?

Doesn't get into game when run example.py

Hi,
I installed rlgym based on the instruction and tried to run the example.py.
The game is successfully started but stuck on this page.

I have the following output in the terminal

E:\ProgramData\Miniconda3\envs\rocketleague\python.exe E:/Study/rocketleague/playground.py
Version 0.4.1

- Updated euler angles to match rlbot [pitch, yaw, roll] and added accessor functions
- Bugfix: player.is_alive renamed to is_demoed
- Added common rewards - Rolv
- Added a reward combiner - Chainso
- Added missing kickoff spawn
- Fixed 2v2 and 3v3 action delivery
- Fixed issue in 2v2 and 3v3 were blue bots would disappear over time
- Added multi injector

Launching Rocket League, make sure bakkesmod is running.

I checked three times that my BakkesMod is working and displaying "Injected, press F2 ingame for options menu (Epic Games Version)"

StateWrapper._read_from_gamestate() crashes rocket league

I was attempting to use this method in a state setter. It caused the error(s) provided below. I then, as a sanity check, tried to replace it with just the content and not running it from the StateWrapper directly and it had exactly the same outcome. If the method is not used at all it should be either removed or fixed.

Here is a console output:

Send message failed
RLGym has encountered an exception!
Exception traceback:
Traceback (most recent call last):
  File "C:\Users\mrkva\PycharmProjects\rlgym_sb3\venv\lib\site-packages\rlgym\communication\communication_handler.py", line 76, in send_message
    encoded = struct.pack('%sf' % len(serialized), *serialized)
struct.error: required argument is not a float

EXCEPTION ARGS: ('required argument is not a float',)
!ROCKET LEAGUE HAS CRASHED!
ATTEMPTING RECOVERY
Discovered 1 existing Rocket League processes. Waiting 2 seconds before attempting to open a new one.
Launching Rocket League, make sure bakkesmod is running.
Launched Epic version
Executing injector...
Scanning processes
Found 1 processes
Done
Send message failed
RLGym has encountered an exception!
Exception traceback:
Traceback (most recent call last):
  File "C:\Users\mrkva\PycharmProjects\rlgym_sb3\venv\lib\site-packages\rlgym\communication\communication_handler.py", line 76, in send_message
    encoded = struct.pack('%sf' % len(serialized), *serialized)
struct.error: required argument is not a float

EXCEPTION ARGS: ('required argument is not a float',)
!UNABLE TO RECOVER ROCKET LEAGUE!
EXITING
Traceback (most recent call last):
  File "C:\Users\mrkva\AppData\Local\Programs\Python\Python38\lib\multiprocessing\connection.py", line 312, in _recv_bytes
    nread, err = ov.GetOverlappedResult(True)
BrokenPipeError: [WinError 109] The pipe has been ended

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:/Users/mrkva/PycharmProjects/rlgym_sb3/training_keepaway_bot.py", line 80, in <module>
    model.learn(100_000_000_000, callback=callback)
  File "C:\Users\mrkva\PycharmProjects\rlgym_sb3\venv\lib\site-packages\stable_baselines3\ppo\ppo.py", line 299, in learn
    return super(PPO, self).learn(
  File "C:\Users\mrkva\PycharmProjects\rlgym_sb3\venv\lib\site-packages\stable_baselines3\common\on_policy_algorithm.py", line 229, in learn
    total_timesteps, callback = self._setup_learn(
  File "C:\Users\mrkva\PycharmProjects\rlgym_sb3\venv\lib\site-packages\stable_baselines3\common\base_class.py", line 426, in _setup_learn
    self._last_obs = self.env.reset()  # pytype: disable=annotation-type-mismatch
  File "C:\Users\mrkva\PycharmProjects\rlgym_sb3\venv\lib\site-packages\stable_baselines3\common\vec_env\vec_normalize.py", line 222, in reset
    obs = self.venv.reset()
  File "C:\Users\mrkva\PycharmProjects\rlgym_sb3\venv\lib\site-packages\stable_baselines3\common\vec_env\vec_monitor.py", line 70, in reset
    obs = self.venv.reset()
  File "C:\Users\mrkva\PycharmProjects\rlgym_sb3\venv\lib\site-packages\stable_baselines3\common\vec_env\vec_check_nan.py", line 43, in reset
    observations = self.venv.reset()
  File "C:\Users\mrkva\PycharmProjects\rlgym_sb3\venv\lib\site-packages\rlgym_tools\sb3_utils\sb3_multiple_instance_env.py", line 135, in reset
    obs = remote.recv()
  File "C:\Users\mrkva\AppData\Local\Programs\Python\Python38\lib\multiprocessing\connection.py", line 250, in recv
    buf = self._recv_bytes()
  File "C:\Users\mrkva\AppData\Local\Programs\Python\Python38\lib\multiprocessing\connection.py", line 321, in _recv_bytes
    raise EOFError
EOFError

The gym environment does not use the OpenAI gym base environment

The base class instantiates a few other constants needed for wrappers to work. Currently, wrappers will break.

pywin32==228 not available under python 3.10

Using pip 22.2.1 and python 3.10.5 on Windows 11, I cannot pip install rlgym because it requires pywin32==228 but only version 302, 303, and 304 and available to me.

PS C:\Users\rotar> pip install --upgrade rlgym==1.2.0
Collecting rlgym==1.2.0
  Using cached rlgym-1.2.0.tar.gz (127 kB)
  Preparing metadata (setup.py) ... done
Collecting gym>=0.17
  Using cached gym-0.25.1.tar.gz (732 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting numpy>=1.19
  Using cached numpy-1.23.1-cp310-cp310-win_amd64.whl (14.6 MB)
ERROR: Could not find a version that satisfies the requirement pywin32==228 (from rlgym) (from versions: 302, 303, 304)
ERROR: No matching distribution found for pywin32==228

PS C:\Users\rotar> pip install --upgrade pywin32==228
ERROR: Could not find a version that satisfies the requirement pywin32==228 (from versions: 302, 303, 304)
ERROR: No matching distribution found for pywin32==228

Running on Wokrshop maps

Is there a way I can initialize the gym environment with a workshop map?

Installation Error during wheel building

Hello,

I got an issue when i try to install rlgym with pip.
I tried a lot of setup but i'm here with:

Window 11 (is it the problem ?)
Bakkesmod
A RocketLeague account
Python 3.8.8

Here is my error:
RLGym installation error.txt

Can you check if there is something wrong (I guess there is ofc)

Kind regards

Ability to set boost pads in state setters

Currently it seems like there is no way to set boost pads availability nor their respawn times. Great enhancement I would say.

Plugin does not load in BakkesMod after update

Project Page Stable Baselines3

Hello,

nice project =)

We would be also interested if you could do a pull request on stable-baselines3 where you add your project to the documentation (project section) ;)

Rocket League Crash on Start?

I am running rlgym for the first time, I have:

installed Rocket League with Epic
installed bakkesmod
installed rlgym using python 3.9.17
confirmed the plugin is loaded and checked
bakkesmod is running when i run my python program

I run the following example code given in the rlgym tutorial:

import rlgym
env = rlgym.make()

The rocket league windows appears for a split second, then disappears. Here are the contents of the rocket league log file after running. Any help would be appreciated. I am hard stuck without knowing what could be the cause of this.

Log: Log file open, 26/07/2023 13:08:12
Log: GPsyonixBuildID 230620.44144.425548
Log: Command line: -pipe \\.\pipe\22156 -nomovie -EpicPortal
Init: WinSock: version 1.1 (2.2), MaxSocks=32767, MaxUdp=65467
Log:  ... running in INSTALLED mode
Init: Language extension: INT
Init: Language extension: INT
DevConfig: GConfig::LoadFile associated file:  ..\..\TAGame\Config\TAUI.ini
Init: Version: 230620.44144.425548
Init: Compiled (64-bit): Jun 20 2023 14:05:44
Init: Command line: -pipe \\.\pipe\22156 -nomovie -EpicPortal
Init: Base directory: C:\Games\rocketleague\Binaries\Win64\
[0001.01] Log: Purging 30-day cache '..\..\TAGame\Cache\WebCache\*.*'...
[0001.01] Log: Purging 7-day cache '..\..\TAGame\Logs\*.dmp'...
[0001.01] Log: Purging 3-day cache '..\..\TAGame\Logs\*.log'...
[0001.01] Init: Computer: DESKTOP-J42R4E2
[0001.02] Init: User: Dave
[0001.02] Init: CPU Page size=4096, Processors=24
[0001.02] Init: High frequency timer resolution =10.000000 MHz
[0001.02] Init: Memory total: Physical=63.7GB (64GB approx) Pagefile=73.2GB Virtual=131072.0GB
[0001.02] Init: Presizing for 138000 objects not considered by GC, pre-allocating 0 bytes.
[0001.02] Init: Object subsystem initialized
[0001.05] Log: Using feature set PrimeUpdate43
[0001.05] Log: FOnlineSubsystemEOS: EOS version = 1.13.0-24551320
[0001.05] DevOnline: EOS Platform CacheDirectory=C:\Users\Dave\AppData\Local\Rocket League\
[0001.26] Log: Found D3D11 adapter 0: NVIDIA GeForce RTX 4070
[0001.26] Log: Adapter has 12026MB of dedicated video memory, 0MB of dedicated system memory, and 32638MB of shared system memory
[0001.27] Log: Found D3D11 adapter 1: Microsoft Basic Render Driver
[0001.27] Log: Adapter has 0MB of dedicated video memory, 0MB of dedicated system memory, and 32638MB of shared system memory
[0001.27] Log: Shader platform (RHI): PC-D3D-SM5
[0001.30] Breadcrumbs: Startup_PreInit: 1.297
[0001.31] Breadcrumbs: Startup_LoadGlobalShaders: 0.010
[0003.71] Log: ProductDatabase_TA::InitProductLabels  0.00 sec total.
[0003.74] Log: ProductDatabase_TA::UpdateAvailableProducts  0.03 sec total.
[0003.75] Breadcrumbs: Startup_LoadScriptPackages: 2.438
[0004.23] Breadcrumbs: Startup_LoadNonNativePackages: 0.485
[0004.24] Log: 140989 objects as part of root set at end of initial load.
[0004.24] Log: 0 out of 0 bytes used by permanent object pool.
[0004.24] Log: ShaderCache load stats: AccumLoadSeconds=(1.780) ShadersLoaded=(345780) Duplicates=(21250)
[0004.24] Log: Initializing Engine...
[0004.24] Log: BuildID: -1014409113 from GPsyonixBuildID
[0004.28] SystemSettings: Loading PC Settings
[0004.29] Breadcrumbs: Startup_BuildGuidCache: 0.056
[0004.31] Log: Running hardware survey...
[0004.31] Log: Wwise(R) SDK Version 2019.1.1 Build 6977. Copyright (c) 2006-2012 Audiokinetic Inc. / All Rights Reserved.
[0004.35] Breadcrumbs: Startup_ClientInit: 0.059
[0004.78] Log: OS: Microsoft Windows 10 Pro  (19045)
[0004.78] Log: WinSAT: 9.5 [9.5 CPU, 9.9 2D, 9.9 3D, 9.5 Mem, 9.6 Disk]
[0004.78] Log: Processor: 13th Gen Intel(R) Core(TM) i7-13700K (Intel64 Family 6 Model 183 Stepping 1) 16 Cores, 24 Threads
[0004.78] Log: Memory: 32.00GB
[0004.78] Log: Memory: 32.00GB
[0004.78] Log: VideoController: NVIDIA GeForce RTX 4070 (31.0.15.3598)
[0004.78] Log: Network Adapter: Intel(R) Ethernet Controller I226-V
[0004.78] Log: Disk C: 1551.32GB free of 1862.38GB
[0004.78] Log: Disk D: 787.36GB free of 931.50GB
[0004.78] Log: Disk E: 669.22GB free of 931.50GB
[0004.78] Log: Disk F: 825.39GB free of 931.50GB
[0004.78] Log: Disk G: 1473.75GB free of 1862.38GB
[0004.78] Log: Detected 1 GPUs for rendering
[0004.80] Log: Sound Device: Realtek High Definition Audio
[0004.80] Log: Sound Device: USB Audio Device
[0004.80] Log: Sound Device: SSL 2+ USB Audio Device
[0004.80] Log: Sound Device: NVIDIA High Definition Audio
[0004.80] Log: Sound Device: NVIDIA Virtual Audio Device (Wave Extensible) (WDM)
[0004.80] Log: Hardware survey complete in 0.50 seconds.
[0004.80] Breadcrumbs: Startup_CreateViewport: 0.454
[0004.80] DevOnline: Created named interface (RecentPlayersList) of type (Engine.OnlineRecentPlayersList)
[0004.86] ScriptLog: PsyNet using environment DBE_Production Prod
[0004.86] PsyNet: PsyNetConnection_X_0 disabled OSCS_ServiceUnavailable
[0004.86] PsyNetStaticData: HandleCacheExpired
[0004.86] PsyNetStaticData: HandleGetURL URL=(https://config.psynet.gg/v2/Config/BattleCars/-1014409113/Prod/Epic/INT/)
[0004.86] PsyNetStaticData: Blocking sync start
[0004.86] DevOnline: WebRequest_X_0 SEND: https://config.psynet.gg/v2/Config/BattleCars/-1014409113/Prod/Epic/INT/
[0005.10] DevOnline: WebRequest_X_0 RECV: 304 
[0005.10] PsyNetStaticData: Blocking sync complete. Elapsed=0.2395
[0005.10] PsyNetStaticData: HandleDataChanged
[0005.10] ScriptWarning: ScriptWarning, Sound cue could not be found for playlist Esports at index 2
	MusicThemeConfig_TA Transient.Untitled_0.MusicThemeConfig
	Function TAGame.MusicThemeConfig_TA:Apply:0244
Script call stack:
	Function ProjectX.OnlineConfigDispatcher_X:ApplyConfigObject
	Function TAGame.MusicThemeConfig_TA:Apply

[0005.13] Log: ProductDatabase_TA::UpdateAvailableProducts  0.03 sec total.
[0005.46] Log: ProductDatabase_TA::InitProductLabels  0.00 sec total.
[0005.46] PsyNet: PsyNetConnection_X_0 enabled
[0005.47] PsyNetStaticData: UpdateCacheTimerEnabled CacheTimer.bEnabled=(True)
[0005.48] AuthPsyNetVerbose: New auth error. Error 'OSCS_NotConnected'
[0005.48] AuthPsyNetVerbose: OnlinePlayerAuthentication_TA_0 None Unknown|0|0 Logout
[0005.48] PsyNet: PsyNetConnection_X_1 disabled OSCS_NotConnected
[0005.48] AuthPsyNetVerbose: PsyNet connection status changed. Error 'OSCS_NotConnected'
[0005.48] AuthPsyNetVerbose: New auth error. Error 'OSCS_NotConnected'
[0005.48] AuthPsyNetVerbose: OnlinePlayerAuthentication_TA_0 LoggedOut Unknown|0|0 Logout
[0005.48] ScriptLog: HandleBlockListStatusCreated Status=(PlatformBlockListStatus_0) ControllerId=(0)
[0005.73] Log: === Critical error: ===
Fatal error!

Address = 0x2f67aa33 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2f66ec50 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2f652b4d (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ece0900 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ecc64c9 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ecc6426 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ece5ac0 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ece0c8a (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ece5ac0 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ece0c8a (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ece5ac0 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ece0c8a (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ecc64c9 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ecc6426 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ece5ac0 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ece0c8a (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ecc64c9 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ecc6426 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ece5ac0 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ece0c8a (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ece5ac0 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ece0c8a (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ecc64c9 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ecc6426 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ece5ac0 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ece0c8a (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ece5aea (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ece0c8a (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ecc843d (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ecc202b (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ece5ac0 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ece0c8a (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ece5aea (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ece0c8a (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ecc202b (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ece5ac0 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ece58c1 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2f0576a5 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2f044833 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2f6c9bce (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2f6c933d (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2f6c93ba (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2f6cfc21 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x2ff52ef6 (filename not found) [in C:\Games\rocketleague\Binaries\Win64\RocketLeague.exe]
Address = 0x9d807614 (filename not found) [in C:\Windows\System32\KERNEL32.DLL]
Address = 0x9dd226b1 (filename not found) [in C:\Windows\SYSTEM32\ntdll.dll]
Address = 0x9dd226b1 (filename not found) [in C:\Windows\SYSTEM32\ntdll.dll]

ValueError when using default self

@lucas-emery
@AechPro
I have a simple example env to play with self enabled, but I am getting the following error.

ValueError: setting an array element with a sequence. The requested array would exceed the maximum number of dimension of 1.

This is the code that I am testing

env = rlgym.make("default self", reward_fn=CombinedReward(reward_functions=rewards))
# check_env(env, warn=True, skip_render_check=False)
model = PPO("MlpPolicy", env, verbose=1)
model.learn(total_timesteps=int(1e6))

This is the entire traceback of the workflow.

Traceback (most recent call last):
  File "rltestbot.py", line 19, in <module>
    model.learn(total_timesteps=int(1e6))
  File "lib\site-packages\stable_baselines3\ppo\ppo.py", line 289, in learn
    reset_num_timesteps=reset_num_timesteps,
  File "lib\site-packages\stable_baselines3\common\on_policy_algorithm.py", line 220, in learn
    total_timesteps, eval_env, callback, eval_freq, n_eval_episodes, eval_log_path, reset_num_timesteps, tb_log_name
  File "lib\site-packages\stable_baselines3\common\base_class.py", line 379, in _setup_learn
    self._last_obs = self.env.reset()
  File "lib\site-packages\stable_baselines3\common\vec_env\dummy_vec_env.py", line 62, in reset
    self._save_obs(env_idx, obs)
  File "lib\site-packages\stable_baselines3\common\vec_env\dummy_vec_env.py", line 92, in _save_obs
    self.buf_obs[key][env_idx] = obs
ValueError: setting an array element with a sequence. The requested array would exceed the maximum number of dimension of 1.

Anyone know how to resolve this?

force_paging doesn't seem to work on linux/proton

Per title, force_paging=True appears to have no effect under Linux/proton. This isn't a dealbreaker for use on linux, but I've found it useful on Windows for resource sizing purposes to be able to quickly force the process into its minimal resident memory usage shortly after startup.

I've done some cursory research on approaches that might work, but unfortunately I've come up empty-handed. It may be that documenting a workaround (e.g. increasing system swappiness) is the best approach, although I'm hopeful that some other more portable mechanism might exist that can be used on both platforms.

VelocityBallToGoalReward in rlgym.utils.reward_functions.common_rewards.ball_goal_rewards breaks ball speed after it is called

If you use velocityballtogoal as a reward, and then try to print the goal speed or print the ball speed after using that reward, the ball speed returns as 0.0.

Source for rlgym plugin

Haya! I cannot find the source for the plugin/RLGym.dll

Everywhere it says it is installed using pip :/

Is it even public?

lucas-emery / rocket-league-gym Goto Github PK

rocket-league-gym's People

Stargazers

Watchers

Forkers

rocket-league-gym's Issues

I have the following output in the terminal

Launching Rocket League, make sure bakkesmod is running.

Recommend Projects

Recommend Topics

Recommend Org

Jobs