Documentation question about rl_matrix

[asieradzk]

Hi. Thanks for trying RLMatrix

1. Yes cuda is used by default if available.

2. IContinuousEnvironment will not work and has been completely removed. I have not included a replacement yet.
   It will be something like this:
   https://github.com/asieradzk/RL_Matrix/blob/master/src/RLMatrix.Common/IEnvironmentAsync.cs
   I've decided to no longer reset env for users based on step counters, since some use-cases may not require that.

3. Looks like you might be using an older version, you can clone the one from the repo for best experience. There have been a lot of changes between now and the nuget...

4. I'll update you when ContinousEnv becomes available (maybe today)!

[asieradzk]

I got you homie. Try now. I've added
IContinuousEnvironmentAsync
you can use it with

LocalContinuousRolloutAgent

Clone the repo, its not on the nuget.

There are 2 caveats:
Only works with training: true
Only works with 1 environment.

Going to take weekend now but thanks for motivating me to put this in.

Its a bit hard to get right because I insist on using shared parameters for multiple discrete and continuous heads so I've made a mistake somewhere when slicing output tensors.

Example:
https://github.com/asieradzk/CartPoleForTesting/blob/master/TrivialContinuousEnvironmentAsync%20.cs

[Kermalis]

Awesome, it looks great. I won't be able to try it out for a while though. I'll close this issue for now