TypeError: FP16_DeepSpeedZeroOptimizer is not an Optimizer about deepspeed

[jeffra]

Thanks for reporting this bug. We will take a look at this as soon as possible. I just created two test cases that reproduce the error (one with ZeRO and one with FP16 but no ZeRO).

https://github.com/microsoft/DeepSpeed/blob/jeffra/onecycle_bug/tests/unit/test_fp16.py#L147-L246

[astariul]

Note : I have the same error when I try the same configuration and LRRangeTest as scheduler.

[jeffra]

Hi @colanim, it should be up to date. Can you tell us this info from inside your docker container?

python -c 'import deepspeed; print("deepspeed info:", deepspeed.__version__, deepspeed.__git_branch__, deepspeed.__git_hash__)'

Also I just looked at the lasted docker build, it prints this same version info and it looks to be aligned with the latest March 12th commit (3d3f8d3): https://dev.azure.com/DeepSpeedMSFT/DeepSpeed/_build/results?buildId=416&view=logs&j=3dc8fd7e-4368-5a92-293e-d53cefc8c4b3&t=a1aa9649-a94b-5ac4-3f5e-9bb6223edb04&l=1717

** info: 0.1.0 master 3d3f8d3

[astariul]

I'm still meeting this issue in deepspeed/deepspeed:latest. How should I update the docker image to pull latest code from source ?

[astariul]

My bad, I didn't pull the latest image..

After doing docker pull deepspeed/deepspeed:latest, it's working 👍