env.step(env.action_space.sample()) vs env.pos about gym-pybullet-drones

[MegaCreater]

Thanks @JacopoPan ,
For your fast and detailed explanation. I got it (that obs return normalised values whereas env.pos reruns original values). Is there is any way so that I get max(x,y,z) and min(x,y,z) (original\not normalised).
If you want I make Google-Colaboratory examples for your example (non-gui) and for TensorFlow also. (For gui=True, it shows an error cannot connect to server x (same as it shows for cv2.imshow); we just had to make changes or add attribute like gui_show=False; so it don't show GUI but one can record video that can be later on visualised for Google-Colab.).

[JacopoPan]

Hi @MegaCreater,

I should double check your numbers and slicing but one sure reason why the obs in TakeoffAviary (and all other env classes meant for RL) does not contain the raw, world frame values is because it is clipped and normalized to the -1, +1 range:

gym-pybullet-drones/gym_pybullet_drones/envs/single_agent_rl/TakeoffAviary.py

Line 114 in 7688e72

def _clipAndNormalizeState(self,

You can use CtrlAviary for unbounded, raw obs.

[MegaCreater]

Hi @MegaCreater,

I should double check your numbers and slicing but one sure reason why the obs in TakeoffAviary (and all other env classes meant for RL) does not contain the raw, world frame values is because it is clipped and normalized to the -1, +1 range:

gym-pybullet-drones/gym_pybullet_drones/envs/single_agent_rl/TakeoffAviary.py

Line 114 in 7688e72

def _clipAndNormalizeState(self,

You can use CtrlAviary for unbounded, raw obs.

Hi @JacopoPan ,
That i got that why values are btwn -1 and 1 (or 0 and 1 for z) (That is not the issue.). I just only want to get/Know that obs, reward, done, info = env.step(env.action_space.sample()); obs numerical values are not equal to env-pos,vel or ang_v parameters (numerically not equal.).

[JacopoPan]

Because kinematic information is retrieved from PyBullet in:

gym-pybullet-drones/gym_pybullet_drones/envs/BaseAviary.py

Line 503 in 7688e72

def _updateAndStoreKinematicInformation(self):

Which is called at every step:

gym-pybullet-drones/gym_pybullet_drones/envs/BaseAviary.py

Line 272 in 7688e72

def step(self,

And those value are used to build a state:

gym-pybullet-drones/gym_pybullet_drones/envs/BaseAviary.py

Line 536 in 7688e72

def _getDroneStateVector(self,

But then that state is clipped to max, min values and divided by ranges in:

gym-pybullet-drones/gym_pybullet_drones/envs/single_agent_rl/BaseSingleAgentAviary.py

Line 355 in 7688e72

obs = self._clipAndNormalizeState(self._getDroneStateVector(0))

Before being returned as an obs.
If you spot any numerical mistake please let me know but I wouldn't expect obs and env.pos to contain the same values.