[CLI]: When resuming run with high-precision hyperparam `wandb.config.update()` throws an Exception about wandb

[thanos-wandb]

Hi @Niccolo-Ajroldi thank you for clarifying this. Looking further what's causing this discrepancy and I will get back to you with more information.

[thanos-wandb]

Hi @Niccolo-Ajroldi thank you for reporting this. It seems from the stack trace that the value 0.00018805814126031096 is what the run had in the config prior to resuming to this run. Regarding the error, the Sweep config is protected therefore you could update it if you explicitly pass the boolean arg as follows:
wandb.config.update(hyperparameters, allow_val_change=True)

Would this work for you?

[Niccolo-Ajroldi]

Hi @thanos-wandb, thank you for looking at this.

Please look better at my example: the saved value shoul be 0.00018805814126031094, but when resuming, this seems to magically be 0.00018805814126031096, hence the Exception.

If you just run my minimal example twice (1 time to mimic the original run, and a second time to mimic resuming), you will face the same Exception.