the definition of 'done' in step function from arm3d_disc_env about rllab-curriculum

[florensacc]

in these environements "done" simply means that the rollout terminates. It should be called "kill", but the code we built upon used the word "done" instead.
Note that when the environment is terminated by being too far from the goal there's no reward provided!

[mushroom1116]

in these environements "done" simply means that the rollout terminates. It should be called "kill", but the code we built upon used the word "done" instead.
Note that when the environment is terminated by being too far from the goal there's no reward provided!

So where did you provide the reach goal reward in arm3d_disc_env?

[florensacc]

Note that arm3d_disc_env is the inner_env, and we have a wrapper that is the one that gives the actual reward.

• rllab-curriculum/curriculum/experiments/starts/arm3d/arm3d_disc/arm3d_disc_brownian_algo.py

  Line 61 in 81a3714

  env=inner_env,

• https://github.com/florensacc/rllab-curriculum/blob/master/curriculum/envs/goal_env.py#L171
  Please read the code as it's executed, it will help understand it.