[Question] rl_zoo3 optimization pipeline for ros-based custom env about rl-baselines3-zoo

[ammar-n-abbas]

I found a possible problem:

In the training pipeline at setup_experiment method why is

env.close()

called when the optimization param is True?

When I uncomment it, it runs, however, does not optimize.

if self.continue_training:  
     model = self._load_pretrained_agent(self._hyperparams, env)  
elif self.optimize_hyperparameters:  
    env.close()  
    return None  

[ammar-n-abbas]

According to the openai_ros interface, when env.close() is invoked, it also shutdowns the ros signals and calls

rospy.signal_shutdown

Therefore, it drops the communication