A question about the test_env_seed about denoised_mdp

[ssnl]

It was an intentional choice so that training configs don't affect test settings. You can split that if you want. Just be mindful of the behavior changes.

[MagiFeeney]

Thanks for yours explanation. However, my major concern is that only testing on a fixed seed would lead increase divergence between the training. To my knowledge, current RL algorithms either test on the same env used for training or at least keeps a constant shifting (i.e. test_env_seed = const + train_env_seed). I don't really have a clue how much those seedings affect the performance. Hope you can make some clarification.

[ssnl]

I'm not sure how test seeds can cause training divergence.

You can make an argument for either case and I think they are both valid.

[MagiFeeney]

Ok, I will experiment more see if there is an answer. Thanks for you time.