AttributeError: 'SampledEfficientZeroPolicy' object has no attribute 'inverse_scalar_transform_handle' about lightzero

[puyuan1996]

• Hello, if your main goal is to use the policy in collect_mode for episode collection, keep in mind that the collected data will usually be utilized for learning and training.

• Consequently, value transformations are usually required, as indicated by: "pred_values = self.inverse_scalar_transform_handle(pred_values).detach().cpu().numpy()". Hence, a common recommended approach is (b): initialize an InverseScalarTransform object in the _init_collect() method, as depicted below:

self.inverse_scalar_transform_handle = InverseScalarTransform(
    self._cfg.model.support_scale, self._cfg.device, self._cfg.model.categorical_distribution
)

• If you want to delve deeper into the principles behind value transformations, you could refer to the corresponding academic paper. This paper offers a comprehensive theoretical basis and case studies, providing significant support in understanding and applying value transformation techniques.

• Of cource, If the collected data is not used for learning, you can consider alternative solution (c).

[duxtinto]

Hi @puyuan1996 !

Thank you very much for the detailed information!

I will follow with (b).

Best regards,

David.